[PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[David Miller]

Ok Bob, I hope this finally does it.

We now move fully to 4 level page tables. :-)

64-bit userland can now take advantage of this increased virtual
address space as well.

The other adjustment here is that we increase the size of the vmalloc
region, as needed, so that embedded percpu areas should always fit.

This has openned the door for a bunch of cleanups.  For example, we
could put the OBP mappings into the kernel page tables and consolidate
several ktlb code paths.  In fact, everything should be serviced from
the kernel page tables at that point and the only thing to take care
with is to properly use the 4MB kernel TSB rather than the 8Kb kernel
TSB when handling PAGE_OFFSET linear area misses when DEBUG_PAGEALLOC
is disabled.

Anyways, let me know how these work for you.  I'll be running tests
on my T4-2 all weekend.

Signed-off-by: David S. Miller <davem@davemloft.net>

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[Bob Picco]

Hi,
David Miller wrote:	[Sat Sep 27 2014, 02:28:12PM EDT]
> 
> Ok Bob, I hope this finally does it.
Me too.
> 
> We now move fully to 4 level page tables. :-)
Okay.
> 
> 64-bit userland can now take advantage of this increased virtual
> address space as well.
Okay.
> 
> The other adjustment here is that we increase the size of the vmalloc
> region, as needed, so that embedded percpu areas should always fit.
Okay.
> 
> This has openned the door for a bunch of cleanups.  For example, we
> could put the OBP mappings into the kernel page tables and consolidate
> several ktlb code paths.  In fact, everything should be serviced from
> the kernel page tables at that point and the only thing to take care
> with is to properly use the 4MB kernel TSB rather than the 8Kb kernel
> TSB when handling PAGE_OFFSET linear area misses when DEBUG_PAGEALLOC
> is disabled.
Okay.
> 
> Anyways, let me know how these work for you.  I'll be running tests
> on my T4-2 all weekend.
I'll commence with T5-2 which is local to me.

M7-4 came up with an older kernel of mine but with hardware faults.

thanx!

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[David Miller]

From: Bob Picco <bpicco@meloft.net>
Date: Sat, 27 Sep 2014 16:46:51 -0400

>> Anyways, let me know how these work for you.  I'll be running tests
>> on my T4-2 all weekend.
> I'll commence with T5-2 which is local to me.
> 
> M7-4 came up with an older kernel of mine but with hardware faults.

Thanks in advance.

I added the following to my tree to deal with the MAX_BANKS issue,
I hope it helps the case you talked about, and it's essentially
free :-)

==========
From ed49895e9d85d33cc5d8e774a58b24b416fbd846 Mon Sep 17 00:00:00 2001
From: "David S. Miller" <davem@davemloft.net>
Date: Sat, 27 Sep 2014 21:30:57 -0700
Subject: [PATCH] sparc64: Kill unnecessary tables and increase MAX_BANKS.

swapper_low_pmd_dir and swapper_pud_dir are actually completely
useless and unnecessary.

We just need swapper_pg_dir[].  Naturally the other page table chunks
will be allocated on an as-needed basis.  Since the kernel actually
accesses these tables in the PAGE_OFFSET view, there is not even a TLB
locality advantage of placing them in the kernel image.

Use the hard coded vmlinux.ld.S slot for swapper_pg_dir which is
naturally page aligned.

Increase MAX_BANKS to 1024 in order to handle heavily fragmented
virtual guests.

Even with this MAX_BANKS increase, the kernel is 20K+ smaller.

Signed-off-by: David S. Miller <davem@davemloft.net>
---
 arch/sparc/include/asm/pgtable_64.h |  1 -
 arch/sparc/kernel/vmlinux.lds.S     |  5 +++--
 arch/sparc/mm/init_64.c             | 25 ++-----------------------
 3 files changed, 5 insertions(+), 26 deletions(-)

diff --git a/arch/sparc/include/asm/pgtable_64.h b/arch/sparc/include/asm/pgtable_64.h
index c093922..bfeb626 100644
--- a/arch/sparc/include/asm/pgtable_64.h
+++ b/arch/sparc/include/asm/pgtable_64.h
@@ -927,7 +927,6 @@ static inline void __set_pte_at(struct mm_struct *mm, unsigned long addr,
 #endif
 
 extern pgd_t swapper_pg_dir[PTRS_PER_PGD];
-extern pmd_t swapper_low_pmd_dir[PTRS_PER_PMD];
 
 void paging_init(void);
 unsigned long find_ecache_flush_span(unsigned long size);
diff --git a/arch/sparc/kernel/vmlinux.lds.S b/arch/sparc/kernel/vmlinux.lds.S
index 0bacceb..0924305 100644
--- a/arch/sparc/kernel/vmlinux.lds.S
+++ b/arch/sparc/kernel/vmlinux.lds.S
@@ -35,8 +35,9 @@ jiffies = jiffies_64;
 
 SECTIONS
 {
-	/* swapper_low_pmd_dir is sparc64 only */
-	swapper_low_pmd_dir = 0x0000000000402000;
+#ifdef CONFIG_SPARC64
+	swapper_pg_dir = 0x0000000000402000;
+#endif
 	. = INITIAL_ADDRESS;
 	.text TEXTSTART :
 	{
diff --git a/arch/sparc/mm/init_64.c b/arch/sparc/mm/init_64.c
index ede1840..b9a14a0 100644
--- a/arch/sparc/mm/init_64.c
+++ b/arch/sparc/mm/init_64.c
@@ -87,7 +87,7 @@ extern struct tsb swapper_tsb[KERNEL_TSB_NENTRIES];
 
 static unsigned long cpu_pgsz_mask;
 
-#define MAX_BANKS	32
+#define MAX_BANKS	1024
 
 static struct linux_prom64_registers pavail[MAX_BANKS];
 static int pavail_ents;
@@ -1947,12 +1947,6 @@ static void __init sun4v_linear_pte_xor_finalize(void)
 
 static unsigned long last_valid_pfn;
 
-/* These must be page aligned in order to not trigger the
- * alignment tests of pgd_bad() and pud_bad().
- */
-pgd_t swapper_pg_dir[PTRS_PER_PGD] __attribute__ ((aligned (PAGE_SIZE)));
-static pud_t swapper_pud_dir[PTRS_PER_PUD] __attribute__ ((aligned (PAGE_SIZE)));
-
 static void sun4u_pgprot_init(void);
 static void sun4v_pgprot_init(void);
 
@@ -2006,8 +2000,6 @@ void __init paging_init(void)
 {
 	unsigned long end_pfn, shift, phys_base;
 	unsigned long real_end, i;
-	pud_t *pud;
-	pmd_t *pmd;
 	int node;
 
 	setup_page_offset();
@@ -2103,20 +2095,7 @@ void __init paging_init(void)
 	 */
 	init_mm.pgd += ((shift) / (sizeof(pgd_t)));
 	
-	memset(swapper_low_pmd_dir, 0, sizeof(swapper_low_pmd_dir));
-
-	/* The kernel page tables we publish into what the rest of the
-	 * world sees must be adjusted so that they see the PAGE_OFFSET
-	 * address of these in-kerenel data structures.  However right
-	 * here we must access them from the kernel image side, because
-	 * the trap tables haven't been taken over and therefore we cannot
-	 * take TLB misses in the PAGE_OFFSET linear mappings yet.
-	 */
-	pud = swapper_pud_dir + (shift / sizeof(pud_t));
-	pgd_set(&swapper_pg_dir[0], pud);
-
-	pmd = swapper_low_pmd_dir + (shift / sizeof(pmd_t));
-	pud_set(&swapper_pud_dir[0], pmd);
+	memset(swapper_pg_dir, 0, sizeof(swapper_pg_dir));
 
 	inherit_prom_mappings();
 	
-- 
1.8.1.2

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[David Miller]

From: David Miller <davem@davemloft.net>
Date: Sun, 28 Sep 2014 00:35:25 -0400 (EDT)

> From: Bob Picco <bpicco@meloft.net>
> Date: Sat, 27 Sep 2014 16:46:51 -0400
> 
>>> Anyways, let me know how these work for you.  I'll be running tests
>>> on my T4-2 all weekend.
>> I'll commence with T5-2 which is local to me.
>> 
>> M7-4 came up with an older kernel of mine but with hardware faults.
> 
> Thanks in advance.
> 
> I added the following to my tree to deal with the MAX_BANKS issue,
> I hope it helps the case you talked about, and it's essentially
> free :-)

Bob, I know you're probably busy, but any updates wrt. testing
this series?

Thanks.

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[Bob Picco]

Hi,
David Miller wrote:	[Mon Sep 29 2014, 04:15:43PM EDT]
> From: David Miller <davem@davemloft.net>
> Date: Sun, 28 Sep 2014 00:35:25 -0400 (EDT)
> 
> > From: Bob Picco <bpicco@meloft.net>
> > Date: Sat, 27 Sep 2014 16:46:51 -0400
> > 
> >>> Anyways, let me know how these work for you.  I'll be running tests
> >>> on my T4-2 all weekend.
> >> I'll commence with T5-2 which is local to me.
> >> 
> >> M7-4 came up with an older kernel of mine but with hardware faults.
> > 
> > Thanks in advance.
> > 
> > I added the following to my tree to deal with the MAX_BANKS issue,
> > I hope it helps the case you talked about, and it's essentially
> > free :-)
> 
> Bob, I know you're probably busy, but any updates wrt. testing
> this series?
Apologies, I've been contexting switching heavily.

My local T4-2 and T5-2 seem solid for THP "always" and large kernel parallel
makes. I've seen no issues.

There is an issue with spec-jbb. I'm hoping to have dedicated time for
this issue during the week.

I've not had time to examine the DEBUG_PAGEALLOC issue.

I'll also test M7, faults permitting.

I'll commit to resolving these issues before the merge window closes.

Obviously it is your final decision that matters.

> 
you're welcome and thanx
> Thanks.

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[David Miller]

From: Bob Picco <bob.picco@oracle.com>
Date: Mon, 29 Sep 2014 17:03:22 -0400

> My local T4-2 and T5-2 seem solid for THP "always" and large kernel parallel
> makes. I've seen no issues.

Ok, how about the T5-8?  Does it at least boot properly with
DEBUG_PAGEALLOC disabled?

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[Bob Picco]

David Miller wrote:	[Mon Sep 29 2014, 05:33:17PM EDT]
> From: Bob Picco <bob.picco@oracle.com>
> Date: Mon, 29 Sep 2014 17:03:22 -0400
> 
> > My local T4-2 and T5-2 seem solid for THP "always" and large kernel parallel
> > makes. I've seen no issues.
> 
> Ok, how about the T5-8?  Does it at least boot properly with
> DEBUG_PAGEALLOC disabled?
> 
Sorry family issue on top of work!

It would require time to get on this machine but not required.

This is debug from the T5-8 from a while ago:
From the next line 
PERCPU: static=0x5d80 reserved=0x2000 dyn=0x6280 unit=0x10000
PERCPU: atom=0x400000 alloc=0x400000 __ai=0x2000 nr=8
PERCPU: group=0 ptr=0xffff803f5d000000 nid=0 nr_units\x128 cpu=0
PERCPU: group=1 ptr=0xffff883f7f000000 nid=1 nr_units\x128 cpu\x128
PERCPU: group=2 ptr=0xffff903f7f000000 nid=2 nr_units\x128 cpu%6
PERCPU: group=3 ptr=0xffff983f7f000000 nid=3 nr_units\x128 cpu84
PERCPU: group=4 ptr=0xffffa03f7f000000 nid=4 nr_units\x128 cpuQ2
PERCPU: group=5 ptr=0xffffa83f7f000000 nid=5 nr_units\x128 cpud0
PERCPU: group=6 ptr=0xffffb03f7f000000 nid=6 nr_units\x128 cpuv8
PERCPU: group=7 ptr=0xffffb83f5ec00000 nid=7 nr_units\x128 cpu‰6
PERCPU: base=0xffff803f5d000000
to the previous line is from percpu-debug.patch.
PERCPU: max_distance=0x380001c10000 too large for vmalloc space 0xff00000000
. So just subtract 0xffff800000000000UL from "ptr".

This from a SMI/Oracle hardware engineer and also contained within the
T5 hardware specification:
"But on T5 this has changed. Memory on T5 is spread out based on PA[45:43]. So,
that means same situation as above will see physical addresses as :"
.

This is current from my T5-2:
[    0.000000] MM: PAGE_OFFSET is 0xffff800000000000 (max_phys_bits = 47)
[    0.000000] MM: VMALLOC [0x0000000100000000 --> 0x0000400000000000]
[    0.000000] MM: VMEMMAP [0x0000400000000000 --> 0x0000800000000000]
[    0.000000] Kernel: Using 2 locked TLB entries for main kernel image.
...
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x30400000-0x1fef781fff]
[    0.000000]   node   0: [mem 0x1fef788000-0x1fef789fff]
[    0.000000]   node   1: [mem 0x80000000000-0x81ffff0ffff]
[    0.000000]   node   1: [mem 0x81ffff20000-0x81ffff43fff]

You can see the MCU increases linearly within bits positions PA[45:43] by
node. VMALLOC range is based on VMALLOC_END = (~PAGE_OFFSET + 1) >> 1;.
So it would seem to fail for T5-8. It indeed does for M7-4 but other
issues manifest too.

This is M7-4:
MM: PAGE_OFFSET is 0xfffe000000000000 (max_phys_bits = 49)^M
MM: VMALLOC [0x0000000100000000 --> 0x0001000000000000]^M
MM: VMEMMAP [0x0001000000000000 --> 0x0002000000000000]^M
Kernel: Using 3 locked TLB entries for main kernel image.^M
Remapping the kernel... done.^M
..
Early memory node ranges^M
  node   0: [mem 0x50400000-0x3fbf6bdfff]^M
  node   0: [mem 0x3fbf6c4000-0x3fbf6c5fff]^M
  node   1: [mem 0x400000000000-0x403bffffffff]^M
  node   2: [mem 0x800000000000-0x803fffffffff]^M
  node   3: [mem 0xc00000000000-0xc03fffd5dfff]^M
  node   3: [mem 0xc03fffd90000-0xc03fffdaffff]^M
  node   3: [mem 0xc03fffdc0000-0xc03fffdc3fff]^M
Booting Linux...^M
CPU CAPS: [flush,stbar,swap,muldiv,v9,mul32,div32,v8plus]^M
CPU CAPS: [popc,vis,vis2,ASIBlkInit,fmaf,vis3,hpc,ima]^M
CPU CAPS: [pause,cbcond,aes,des,camellia,md5,sha1,sha256]^M
CPU CAPS: [sha512,mpmul,montmul,montsqr,crc32c]^M
PERCPU: max_distance=0xc000c2410000 too large for vmalloc space 0xffff00000000^M
PERCPU: auto allocator failed (-22), falling back to page size^M
PERCPU: 6 8K pages/cpu @0000000100000000 s23552 r8192 d17408^M

Let me look at this in the morning when NOT distracted by family issue.

thanx,

bob

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[David Miller]

From: Bob Picco <bpicco@meloft.net>
Date: Mon, 29 Sep 2014 18:35:22 -0400

> PERCPU: max_distance=0x380001c10000 too large for vmalloc space 0xff00000000
> . So just subtract 0xffff800000000000UL from "ptr".

Bob you're not running my current patches.

The vmalloc space is enlarged by the current patch set and should
no longer run into this issue, and it's specifically what I was
interested in seeing work or not.

Thanks.

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[David Miller]

From: David Miller <davem@davemloft.net>
Date: Mon, 29 Sep 2014 21:52:54 -0400 (EDT)

> From: Bob Picco <bpicco@meloft.net>
> Date: Mon, 29 Sep 2014 18:35:22 -0400
> 
>> PERCPU: max_distance=0x380001c10000 too large for vmalloc space 0xff00000000
>> . So just subtract 0xffff800000000000UL from "ptr".
> 
> Bob you're not running my current patches.
> 
> The vmalloc space is enlarged by the current patch set and should
> no longer run into this issue, and it's specifically what I was
> interested in seeing work or not.

Ignore me, I see you were just trying to explain how memory is layed
out on this T5 machines and why (which I understood already :-)

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[David Miller]

From: Bob Picco <bpicco@meloft.net>
Date: Mon, 29 Sep 2014 18:35:22 -0400

> This is M7-4:
> MM: PAGE_OFFSET is 0xfffe000000000000 (max_phys_bits = 49)^M
> MM: VMALLOC [0x0000000100000000 --> 0x0001000000000000]^M
> MM: VMEMMAP [0x0001000000000000 --> 0x0002000000000000]^M
> Kernel: Using 3 locked TLB entries for main kernel image.^M
> Remapping the kernel... done.^M
> ..
> Early memory node ranges^M
>   node   0: [mem 0x50400000-0x3fbf6bdfff]^M
>   node   0: [mem 0x3fbf6c4000-0x3fbf6c5fff]^M
>   node   1: [mem 0x400000000000-0x403bffffffff]^M
>   node   2: [mem 0x800000000000-0x803fffffffff]^M
>   node   3: [mem 0xc00000000000-0xc03fffd5dfff]^M
>   node   3: [mem 0xc03fffd90000-0xc03fffdaffff]^M
>   node   3: [mem 0xc03fffdc0000-0xc03fffdc3fff]^M
> Booting Linux...^M
> CPU CAPS: [flush,stbar,swap,muldiv,v9,mul32,div32,v8plus]^M
> CPU CAPS: [popc,vis,vis2,ASIBlkInit,fmaf,vis3,hpc,ima]^M
> CPU CAPS: [pause,cbcond,aes,des,camellia,md5,sha1,sha256]^M
> CPU CAPS: [sha512,mpmul,montmul,montsqr,crc32c]^M
> PERCPU: max_distance=0xc000c2410000 too large for vmalloc space 0xffff00000000^M
> PERCPU: auto allocator failed (-22), falling back to page size^M
> PERCPU: 6 8K pages/cpu @0000000100000000 s23552 r8192 d17408^M

Ok, it looks like we need to expand the vmalloc area a bit or two
more, which is easy to do.  I'll cook up a patch for that.

> Let me look at this in the morning when NOT distracted by family issue.

Take your time, your help is appreciated.

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[David Miller]

From: David Miller <davem@davemloft.net>
Date: Mon, 29 Sep 2014 21:57:35 -0400 (EDT)

> From: Bob Picco <bpicco@meloft.net>
> Date: Mon, 29 Sep 2014 18:35:22 -0400
> 
>> This is M7-4:
>> MM: PAGE_OFFSET is 0xfffe000000000000 (max_phys_bits = 49)^M
>> MM: VMALLOC [0x0000000100000000 --> 0x0001000000000000]^M
>> MM: VMEMMAP [0x0001000000000000 --> 0x0002000000000000]^M
>> Kernel: Using 3 locked TLB entries for main kernel image.^M
>> Remapping the kernel... done.^M
>> ..
>> Early memory node ranges^M
>>   node   0: [mem 0x50400000-0x3fbf6bdfff]^M
>>   node   0: [mem 0x3fbf6c4000-0x3fbf6c5fff]^M
>>   node   1: [mem 0x400000000000-0x403bffffffff]^M
>>   node   2: [mem 0x800000000000-0x803fffffffff]^M
>>   node   3: [mem 0xc00000000000-0xc03fffd5dfff]^M
>>   node   3: [mem 0xc03fffd90000-0xc03fffdaffff]^M
>>   node   3: [mem 0xc03fffdc0000-0xc03fffdc3fff]^M
>> Booting Linux...^M
>> CPU CAPS: [flush,stbar,swap,muldiv,v9,mul32,div32,v8plus]^M
>> CPU CAPS: [popc,vis,vis2,ASIBlkInit,fmaf,vis3,hpc,ima]^M
>> CPU CAPS: [pause,cbcond,aes,des,camellia,md5,sha1,sha256]^M
>> CPU CAPS: [sha512,mpmul,montmul,montsqr,crc32c]^M
>> PERCPU: max_distance=0xc000c2410000 too large for vmalloc space 0xffff00000000^M
>> PERCPU: auto allocator failed (-22), falling back to page size^M
>> PERCPU: 6 8K pages/cpu @0000000100000000 s23552 r8192 d17408^M
> 
> Ok, it looks like we need to expand the vmalloc area a bit or two
> more, which is easy to do.  I'll cook up a patch for that.

Ok, this should do it, it's on top of my patch series:

diff --git a/arch/sparc/mm/init_64.c b/arch/sparc/mm/init_64.c
index b9a14a0..e2af052 100644
--- a/arch/sparc/mm/init_64.c
+++ b/arch/sparc/mm/init_64.c
@@ -1369,25 +1369,24 @@ static unsigned long max_phys_bits = 40;
 
 bool kern_addr_valid(unsigned long addr)
 {
-	unsigned long above = ((long)addr) >> max_phys_bits;
 	pgd_t *pgd;
 	pud_t *pud;
 	pmd_t *pmd;
 	pte_t *pte;
 
-	if (above != 0 && above != -1UL)
-		return false;
-
-	if (addr >= (unsigned long) KERNBASE &&
-	    addr < (unsigned long)&_end)
-		return true;
-
-	if (addr >= PAGE_OFFSET) {
+	if ((long)addr < 0L) {
 		unsigned long pa = __pa(addr);
 
+		if ((addr >> max_phys_bits) != 0UL)
+			return false;
+
 		return pfn_valid(pa >> PAGE_SHIFT);
 	}
 
+	if (addr >= (unsigned long) KERNBASE &&
+	    addr < (unsigned long)&_end)
+		return true;
+
 	pgd = pgd_offset_k(addr);
 	if (pgd_none(*pgd))
 		return 0;
@@ -1715,12 +1714,9 @@ static void __init setup_page_offset(void)
 		prom_halt();
 	}
 
-	/* PAGE_OFFSET must be calculated this way in order for the
-	 * 'above' checks in kern_addr_valid to work properly.
-	 */
-	PAGE_OFFSET = (-(1UL << max_phys_bits));
-
-	VMALLOC_END = (~PAGE_OFFSET + 1) >> 1;
+	PAGE_OFFSET = sparc64_va_hole_top;
+	VMALLOC_END = ((sparc64_va_hole_bottom >> 1) +
+		       (sparc64_va_hole_bottom >> 2));
 
 	pr_info("MM: PAGE_OFFSET is 0x%016lx (max_phys_bits = %lu)\n",
 		PAGE_OFFSET, max_phys_bits);

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[Bob Picco]

David Miller wrote:	[Mon Sep 29 2014, 09:56:10PM EDT]
> From: David Miller <davem@davemloft.net>
> Date: Mon, 29 Sep 2014 21:52:54 -0400 (EDT)
> 
> > From: Bob Picco <bpicco@meloft.net>
> > Date: Mon, 29 Sep 2014 18:35:22 -0400
> > 
> >> PERCPU: max_distance=0x380001c10000 too large for vmalloc space 0xff00000000
> >> . So just subtract 0xffff800000000000UL from "ptr".
> > 
> > Bob you're not running my current patches.
> > 
> > The vmalloc space is enlarged by the current patch set and should
> > no longer run into this issue, and it's specifically what I was
> > interested in seeing work or not.
> 
> Ignore me, I see you were just trying to explain how memory is layed
> out on this T5 machines and why (which I understood already :-)
Ah no problem, I feared being called away and the potential remains today.

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[Bob Picco]

Hi,
David Miller wrote:	[Mon Sep 29 2014, 10:16:37PM EDT]
> From: David Miller <davem@davemloft.net>
> Date: Mon, 29 Sep 2014 21:57:35 -0400 (EDT)
> 
> > From: Bob Picco <bpicco@meloft.net>
> > Date: Mon, 29 Sep 2014 18:35:22 -0400
> > 
> >> This is M7-4:
> >> MM: PAGE_OFFSET is 0xfffe000000000000 (max_phys_bits = 49)^M
> >> MM: VMALLOC [0x0000000100000000 --> 0x0001000000000000]^M
> >> MM: VMEMMAP [0x0001000000000000 --> 0x0002000000000000]^M
> >> Kernel: Using 3 locked TLB entries for main kernel image.^M
> >> Remapping the kernel... done.^M
> >> ..
> >> Early memory node ranges^M
> >>   node   0: [mem 0x50400000-0x3fbf6bdfff]^M
> >>   node   0: [mem 0x3fbf6c4000-0x3fbf6c5fff]^M
> >>   node   1: [mem 0x400000000000-0x403bffffffff]^M
> >>   node   2: [mem 0x800000000000-0x803fffffffff]^M
> >>   node   3: [mem 0xc00000000000-0xc03fffd5dfff]^M
> >>   node   3: [mem 0xc03fffd90000-0xc03fffdaffff]^M
> >>   node   3: [mem 0xc03fffdc0000-0xc03fffdc3fff]^M
> >> Booting Linux...^M
> >> CPU CAPS: [flush,stbar,swap,muldiv,v9,mul32,div32,v8plus]^M
> >> CPU CAPS: [popc,vis,vis2,ASIBlkInit,fmaf,vis3,hpc,ima]^M
> >> CPU CAPS: [pause,cbcond,aes,des,camellia,md5,sha1,sha256]^M
> >> CPU CAPS: [sha512,mpmul,montmul,montsqr,crc32c]^M
> >> PERCPU: max_distance=0xc000c2410000 too large for vmalloc space 0xffff00000000^M
> >> PERCPU: auto allocator failed (-22), falling back to page size^M
> >> PERCPU: 6 8K pages/cpu @0000000100000000 s23552 r8192 d17408^M
> > 
> > Ok, it looks like we need to expand the vmalloc area a bit or two
> > more, which is easy to do.  I'll cook up a patch for that.
> 
> Ok, this should do it, it's on top of my patch series:
Yes, I agree.

This is my cryptic confirmation the values will satisfy T5-8 and M7-4.

(gdb) p 0x0006000000000000UL-0x0000000100000000UL
$1 = 0x5ffff00000000
VMALLOC_TOTAL
(gdb) p 0x5ffff00000000UL * 3 / 4
$2 = 0x47fff40000000
(gdb) p 0xc000c2410000UL > 0x47fff40000000UL
M7-4
(gdb) p 0x380001c10000UL > 0x47fff40000000UL
$4 = 0x0
T5-8
.

Note the M7-4 max_distance was borrowed from last attempt before this
email's patch.

Unfortunately for M7-4 boot confirmation will have to wait. I lost a node
(socket). Of course three nodes booted beyond percpu space but then chaos
ensued :) I strongly doubt this is related to what we are focusing on here!

M7-4(?)
Allocated 40960 bytes for kernel page tables.
Zone ranges:
  DMA      [mem 0x50400000-0xffffffffffffffff]
  Normal   [mem 0x00000000-0x803fffdc5fff]
Movable zone start for each node
Early memory node ranges
  node   0: [mem 0x50400000-0x3fbf8d3fff]
  node   0: [mem 0x3fbf8da000-0x3fbf8dbfff]
  node   1: [mem 0x400000000000-0x403bffffffff]
  node   2: [mem 0x800000000000-0x803fffd6ffff]
  node   2: [mem 0x803fffda2000-0x803fffdc5fff]
Booting Linux...
CPU CAPS: [flush,stbar,swap,muldiv,v9,mul32,div32,v8plus]
CPU CAPS: [popc,vis,vis2,ASIBlkInit,fmaf,vis3,hpc,ima]
CPU CAPS: [pause,cbcond,aes,des,camellia,md5,sha1,sha256]
CPU CAPS: [sha512,mpmul,montmul,montsqr,crc32c]
PERCPU: Embedded 7 pages/cpu @fff8003f3c000000 s23552 r8192 d25600 u65536
SUN4V: Mondo queue sizes [cpu(131072) dev(16384) r(8192) nr(256)]

I'll share my T5-2 should you like but there is no issue.

Let me find time for spec-jbb and DEBUG_PAGEALLOC.

thanx!

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[Bob Picco]

Bob Picco wrote:	[Tue Sep 30 2014, 09:17:48AM EDT]
> Hi,
> David Miller wrote:	[Mon Sep 29 2014, 10:16:37PM EDT]
> > From: David Miller <davem@davemloft.net>
> > Date: Mon, 29 Sep 2014 21:57:35 -0400 (EDT)
> > 
> > > From: Bob Picco <bpicco@meloft.net>
> > > Date: Mon, 29 Sep 2014 18:35:22 -0400
> > > 
> > >> This is M7-4:
> > >> MM: PAGE_OFFSET is 0xfffe000000000000 (max_phys_bits = 49)^M
> > >> MM: VMALLOC [0x0000000100000000 --> 0x0001000000000000]^M
> > >> MM: VMEMMAP [0x0001000000000000 --> 0x0002000000000000]^M
> > >> Kernel: Using 3 locked TLB entries for main kernel image.^M
> > >> Remapping the kernel... done.^M
> > >> ..
> > >> Early memory node ranges^M
> > >>   node   0: [mem 0x50400000-0x3fbf6bdfff]^M
> > >>   node   0: [mem 0x3fbf6c4000-0x3fbf6c5fff]^M
> > >>   node   1: [mem 0x400000000000-0x403bffffffff]^M
> > >>   node   2: [mem 0x800000000000-0x803fffffffff]^M
> > >>   node   3: [mem 0xc00000000000-0xc03fffd5dfff]^M
> > >>   node   3: [mem 0xc03fffd90000-0xc03fffdaffff]^M
> > >>   node   3: [mem 0xc03fffdc0000-0xc03fffdc3fff]^M
> > >> Booting Linux...^M
> > >> CPU CAPS: [flush,stbar,swap,muldiv,v9,mul32,div32,v8plus]^M
> > >> CPU CAPS: [popc,vis,vis2,ASIBlkInit,fmaf,vis3,hpc,ima]^M
> > >> CPU CAPS: [pause,cbcond,aes,des,camellia,md5,sha1,sha256]^M
> > >> CPU CAPS: [sha512,mpmul,montmul,montsqr,crc32c]^M
> > >> PERCPU: max_distance=0xc000c2410000 too large for vmalloc space 0xffff00000000^M
> > >> PERCPU: auto allocator failed (-22), falling back to page size^M
> > >> PERCPU: 6 8K pages/cpu @0000000100000000 s23552 r8192 d17408^M
> > > 
> > > Ok, it looks like we need to expand the vmalloc area a bit or two
> > > more, which is easy to do.  I'll cook up a patch for that.
> > 
> > Ok, this should do it, it's on top of my patch series:
> Yes, I agree.
> 
> This is my cryptic confirmation the values will satisfy T5-8 and M7-4.
> 
Ah crap and I did make it cryptic!
> (gdb) p 0x0006000000000000UL-0x0000000100000000UL
> $1 = 0x5ffff00000000
> VMALLOC_TOTAL
> (gdb) p 0x5ffff00000000UL * 3 / 4
> $2 = 0x47fff40000000
> (gdb) p 0xc000c2410000UL > 0x47fff40000000UL
$3 = 0x0

I deleted the above line by mistake.

bob
> M7-4
> (gdb) p 0x380001c10000UL > 0x47fff40000000UL
> $4 = 0x0
> T5-8
> .
> 
> Note the M7-4 max_distance was borrowed from last attempt before this
> email's patch.
> 
> Unfortunately for M7-4 boot confirmation will have to wait. I lost a node
> (socket). Of course three nodes booted beyond percpu space but then chaos
> ensued :) I strongly doubt this is related to what we are focusing on here!
> 
> M7-4(?)
> Allocated 40960 bytes for kernel page tables.
> Zone ranges:
>   DMA      [mem 0x50400000-0xffffffffffffffff]
>   Normal   [mem 0x00000000-0x803fffdc5fff]
> Movable zone start for each node
> Early memory node ranges
>   node   0: [mem 0x50400000-0x3fbf8d3fff]
>   node   0: [mem 0x3fbf8da000-0x3fbf8dbfff]
>   node   1: [mem 0x400000000000-0x403bffffffff]
>   node   2: [mem 0x800000000000-0x803fffd6ffff]
>   node   2: [mem 0x803fffda2000-0x803fffdc5fff]
> Booting Linux...
> CPU CAPS: [flush,stbar,swap,muldiv,v9,mul32,div32,v8plus]
> CPU CAPS: [popc,vis,vis2,ASIBlkInit,fmaf,vis3,hpc,ima]
> CPU CAPS: [pause,cbcond,aes,des,camellia,md5,sha1,sha256]
> CPU CAPS: [sha512,mpmul,montmul,montsqr,crc32c]
> PERCPU: Embedded 7 pages/cpu @fff8003f3c000000 s23552 r8192 d25600 u65536
> SUN4V: Mondo queue sizes [cpu(131072) dev(16384) r(8192) nr(256)]
> 
> I'll share my T5-2 should you like but there is no issue.
> 
> Let me find time for spec-jbb and DEBUG_PAGEALLOC.
> 
> thanx!
> --
> To unsubscribe from this list: send the line "unsubscribe sparclinux" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[David Miller]

From: Bob Picco <bpicco@meloft.net>
Date: Tue, 30 Sep 2014 09:17:48 -0400

> I'll share my T5-2 should you like but there is no issue.
> 
> Let me find time for spec-jbb and DEBUG_PAGEALLOC.

I would like to see the T5-8 boot cleanly, for one thing.

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[Bob Picco]

David Miller wrote:	[Tue Sep 30 2014, 02:55:32PM EDT]
> From: Bob Picco <bpicco@meloft.net>
> Date: Tue, 30 Sep 2014 09:17:48 -0400
> 
> > I'll share my T5-2 should you like but there is no issue.
> > 
> > Let me find time for spec-jbb and DEBUG_PAGEALLOC.
> 
> I would like to see the T5-8 boot cleanly, for one thing.
This is an excellent suggestion and thanx!

M7 is unstable but the issues with our current work could be related. Though
I had to interact with PDU to recover a node.

We might also cross paths with spec-jbb issue. Other unrelated work has
consumed my time and prevented further effort here.

I have the T5-8 and should know more by morning.

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[Bob Picco]

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain; charset="windows-1254", Size: 229502 bytes --]

Bob Picco wrote:	[Tue Sep 30 2014, 04:58:07PM EDT]
> David Miller wrote:	[Tue Sep 30 2014, 02:55:32PM EDT]
> > From: Bob Picco <bpicco@meloft.net>
> > Date: Tue, 30 Sep 2014 09:17:48 -0400
> > 
> > > I'll share my T5-2 should you like but there is no issue.
> > > 
> > > Let me find time for spec-jbb and DEBUG_PAGEALLOC.
> > 
> > I would like to see the T5-8 boot cleanly, for one thing.
> This is an excellent suggestion and thanx!
> 
> M7 is unstable but the issues with our current work could be related. Though
> I had to interact with PDU to recover a node.
> 
> We might also cross paths with spec-jbb issue. Other unrelated work has
> consumed my time and prevented further effort here.
> 
> I have the T5-8 and should know more by morning.
Okay, I lied partially. Let me examine this in the morning. You can go first :)

PROMLIB: Sun IEEE Boot Prom 'OBP 4.36.1 2014/06/26 12:20'
PROMLIB: Root node compatible: sun4v
Initializing cgroup subsys cpuset
Initializing cgroup subsys cpu
Initializing cgroup subsys cpuacct
Linux version 3.17.0-rc7 (root@ca-qasparc24) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-4) (GCC) ) #1 SMP Tue Sep 30 18:05:33 EDT 2014
debug: ignoring loglevel setting.
bootconsole [earlyprom0] enabled
ARCH: SUN4V
Ethernet address: 00:10:e0:35:15:f6
MM: PAGE_OFFSET is 0xfff8000000000000 (max_phys_bits = 47)
MM: VMALLOC [0x0000000100000000 --> 0x0006000000000000]
MM: VMEMMAP [0x0006000000000000 --> 0x000c000000000000]
Kernel: Using 3 locked TLB entries for main kernel image.
Remapping the kernel... done.
OF stdout device is: /virtual-devices@100/console@1
PROM: Built device tree with 1487901 bytes of memory.
MDESC: Size is 774320 bytes.
PLATFORM: banner-name [SPARC T5-8]
PLATFORM: name [sun4v-platform]
PLATFORM: hostid [863515f6]
PLATFORM: serial# [003515f6]
PLATFORM: stick-frequency [3b9aca00]
PLATFORM: mac-address [10e03515f6]
PLATFORM: watchdog-resolution [1000 ms]
PLATFORM: watchdog-max-timeout [31536000000 ms]
PLATFORM: max-cpus [1024]
 [6000000000000-60000007fffff] PMD -> [fff8003fdd000000-fff8003fdd7fffff] on node 0
 [6000000800000-6000000ffffff] PMD -> [fff8003fdc800000-fff8003fdcffffff] on node 0
 [6000001000000-60000017fffff] PMD -> [fff8003fdc000000-fff8003fdc7fffff] on node 0
 [6000001800000-6000001ffffff] PMD -> [fff8003fdb800000-fff8003fdbffffff] on node 0
 [6000002000000-60000027fffff] PMD -> [fff8003fdb000000-fff8003fdb7fffff] on node 0
 [6000002800000-6000002ffffff] PMD -> [fff8003fda800000-fff8003fdaffffff] on node 0
 [6000003000000-60000037fffff] PMD -> [fff8003fda000000-fff8003fda7fffff] on node 0
 [6000003800000-6000003ffffff] PMD -> [fff8003fd9800000-fff8003fd9ffffff] on node 0
 [6000004000000-60000047fffff] PMD -> [fff8003fd9000000-fff8003fd97fffff] on node 0
 [6000004800000-6000004ffffff] PMD -> [fff8003fd8800000-fff8003fd8ffffff] on node 0
 [6000005000000-60000057fffff] PMD -> [fff8003fd8000000-fff8003fd87fffff] on node 0
 [6000005800000-6000005ffffff] PMD -> [fff8003fd7800000-fff8003fd7ffffff] on node 0
 [6000006000000-60000067fffff] PMD -> [fff8003fd7000000-fff8003fd77fffff] on node 0
 [6000006800000-6000006ffffff] PMD -> [fff8003fd6800000-fff8003fd6ffffff] on node 0
 [6000007000000-60000077fffff] PMD -> [fff8003fd6000000-fff8003fd67fffff] on node 0
 [6000007800000-6000007ffffff] PMD -> [fff8003fd5800000-fff8003fd5ffffff] on node 0
 [6000008000000-60000087fffff] PMD -> [fff8003fd5000000-fff8003fd57fffff] on node 0
 [6000008800000-6000008ffffff] PMD -> [fff8003fd4800000-fff8003fd4ffffff] on node 0
 [6000009000000-60000097fffff] PMD -> [fff8003fd4000000-fff8003fd47fffff] on node 0
 [6000009800000-6000009ffffff] PMD -> [fff8003fd3800000-fff8003fd3ffffff] on node 0
 [600000a000000-600000a7fffff] PMD -> [fff8003fd3000000-fff8003fd37fffff] on node 0
 [600000a800000-600000affffff] PMD -> [fff8003fd2800000-fff8003fd2ffffff] on node 0
 [600000b000000-600000b7fffff] PMD -> [fff8003fd2000000-fff8003fd27fffff] on node 0
 [600000b800000-600000bffffff] PMD -> [fff8003fd1800000-fff8003fd1ffffff] on node 0
 [600000c000000-600000c7fffff] PMD -> [fff8003fd1000000-fff8003fd17fffff] on node 0
 [600000c800000-600000cffffff] PMD -> [fff8003fd0800000-fff8003fd0ffffff] on node 0
 [600000d000000-600000d7fffff] PMD -> [fff8003fd0000000-fff8003fd07fffff] on node 0
 [600000d800000-600000dffffff] PMD -> [fff8003fcf800000-fff8003fcfffffff] on node 0
 [600000e000000-600000e7fffff] PMD -> [fff8003fcf000000-fff8003fcf7fffff] on node 0
 [600000e800000-600000effffff] PMD -> [fff8003fce800000-fff8003fceffffff] on node 0
 [600000f000000-600000f7fffff] PMD -> [fff8003fce000000-fff8003fce7fffff] on node 0
 [600000f800000-600000fffffff] PMD -> [fff8003fcd800000-fff8003fcdffffff] on node 0
 [6000010000000-60000107fffff] PMD -> [fff8003fcd000000-fff8003fcd7fffff] on node 0
 [6000010800000-6000010ffffff] PMD -> [fff8003fcc800000-fff8003fccffffff] on node 0
 [6000011000000-60000117fffff] PMD -> [fff8003fcc000000-fff8003fcc7fffff] on node 0
 [6000011800000-6000011ffffff] PMD -> [fff8003fcb800000-fff8003fcbffffff] on node 0
 [6000012000000-60000127fffff] PMD -> [fff8003fcb000000-fff8003fcb7fffff] on node 0
 [6000012800000-6000012ffffff] PMD -> [fff8003fca800000-fff8003fcaffffff] on node 0
 [6000013000000-60000137fffff] PMD -> [fff8003fca000000-fff8003fca7fffff] on node 0
 [6000013800000-6000013ffffff] PMD -> [fff8003fc9800000-fff8003fc9ffffff] on node 0
 [6000014000000-60000147fffff] PMD -> [fff8003fc9000000-fff8003fc97fffff] on node 0
 [6000014800000-6000014ffffff] PMD -> [fff8003fc8800000-fff8003fc8ffffff] on node 0
 [6000015000000-60000157fffff] PMD -> [fff8003fc8000000-fff8003fc87fffff] on node 0
 [6000015800000-6000015ffffff] PMD -> [fff8003fc7800000-fff8003fc7ffffff] on node 0
 [6000016000000-60000167fffff] PMD -> [fff8003fc7000000-fff8003fc77fffff] on node 0
 [6000016800000-6000016ffffff] PMD -> [fff8003fc6800000-fff8003fc6ffffff] on node 0
 [6000017000000-60000177fffff] PMD -> [fff8003fc6000000-fff8003fc67fffff] on node 0
 [6000017800000-6000017ffffff] PMD -> [fff8003fc5800000-fff8003fc5ffffff] on node 0
 [6000018000000-60000187fffff] PMD -> [fff8003fc5000000-fff8003fc57fffff] on node 0
 [6000018800000-6000018ffffff] PMD -> [fff8003fc4800000-fff8003fc4ffffff] on node 0
 [6000019000000-60000197fffff] PMD -> [fff8003fc4000000-fff8003fc47fffff] on node 0
 [6000019800000-6000019ffffff] PMD -> [fff8003fc3800000-fff8003fc3ffffff] on node 0
 [600001a000000-600001a7fffff] PMD -> [fff8003fc3000000-fff8003fc37fffff] on node 0
 [600001a800000-600001affffff] PMD -> [fff8003fc2800000-fff8003fc2ffffff] on node 0
 [600001b000000-600001b7fffff] PMD -> [fff8003fc2000000-fff8003fc27fffff] on node 0
 [600001b800000-600001bffffff] PMD -> [fff8003fc1800000-fff8003fc1ffffff] on node 0
 [600001c000000-600001c7fffff] PMD -> [fff8003fc1000000-fff8003fc17fffff] on node 0
 [600001c800000-600001cffffff] PMD -> [fff8003fc0800000-fff8003fc0ffffff] on node 0
 [600001d000000-600001d7fffff] PMD -> [fff8003fc0000000-fff8003fc07fffff] on node 0
 [600001d800000-600001dffffff] PMD -> [fff8003fbf800000-fff8003fbfffffff] on node 0
 [600001e000000-600001e7fffff] PMD -> [fff8003fbf000000-fff8003fbf7fffff] on node 0
 [600001e800000-600001effffff] PMD -> [fff8003fbe800000-fff8003fbeffffff] on node 0
 [600001f000000-600001f7fffff] PMD -> [fff8003fbe000000-fff8003fbe7fffff] on node 0
 [600001f800000-600001fffffff] PMD -> [fff8003fbd800000-fff8003fbdffffff] on node 0
 [6000020000000-60000207fffff] PMD -> [fff8003fbd000000-fff8003fbd7fffff] on node 0
 [6000020800000-6000020ffffff] PMD -> [fff8003fbc800000-fff8003fbcffffff] on node 0
 [6000021000000-60000217fffff] PMD -> [fff8003fbc000000-fff8003fbc7fffff] on node 0
 [6000021800000-6000021ffffff] PMD -> [fff8003fbb800000-fff8003fbbffffff] on node 0
 [6000022000000-60000227fffff] PMD -> [fff8003fbb000000-fff8003fbb7fffff] on node 0
 [6000022800000-6000022ffffff] PMD -> [fff8003fba800000-fff8003fbaffffff] on node 0
 [6000023000000-60000237fffff] PMD -> [fff8003fba000000-fff8003fba7fffff] on node 0
 [6000023800000-6000023ffffff] PMD -> [fff8003fb9800000-fff8003fb9ffffff] on node 0
 [6000024000000-60000247fffff] PMD -> [fff8003fb9000000-fff8003fb97fffff] on node 0
 [6000024800000-6000024ffffff] PMD -> [fff8003fb8800000-fff8003fb8ffffff] on node 0
 [6000025000000-60000257fffff] PMD -> [fff8003fb8000000-fff8003fb87fffff] on node 0
 [6000025800000-6000025ffffff] PMD -> [fff8003fb7800000-fff8003fb7ffffff] on node 0
 [6000026000000-60000267fffff] PMD -> [fff8003fb7000000-fff8003fb77fffff] on node 0
 [6000026800000-6000026ffffff] PMD -> [fff8003fb6800000-fff8003fb6ffffff] on node 0
 [6000027000000-60000277fffff] PMD -> [fff8003fb6000000-fff8003fb67fffff] on node 0
 [6000027800000-6000027ffffff] PMD -> [fff8003fb5800000-fff8003fb5ffffff] on node 0
 [6000028000000-60000287fffff] PMD -> [fff8003fb5000000-fff8003fb57fffff] on node 0
 [6000028800000-6000028ffffff] PMD -> [fff8003fb4800000-fff8003fb4ffffff] on node 0
 [6000029000000-60000297fffff] PMD -> [fff8003fb4000000-fff8003fb47fffff] on node 0
 [6000029800000-6000029ffffff] PMD -> [fff8003fb3800000-fff8003fb3ffffff] on node 0
 [600002a000000-600002a7fffff] PMD -> [fff8003fb3000000-fff8003fb37fffff] on node 0
 [600002a800000-600002affffff] PMD -> [fff8003fb2800000-fff8003fb2ffffff] on node 0
 [600002b000000-600002b7fffff] PMD -> [fff8003fb2000000-fff8003fb27fffff] on node 0
 [600002b800000-600002bffffff] PMD -> [fff8003fb1800000-fff8003fb1ffffff] on node 0
 [600002c000000-600002c7fffff] PMD -> [fff8003fb1000000-fff8003fb17fffff] on node 0
 [600002c800000-600002cffffff] PMD -> [fff8003fb0800000-fff8003fb0ffffff] on node 0
 [600002d000000-600002d7fffff] PMD -> [fff8003fb0000000-fff8003fb07fffff] on node 0
 [600002d800000-600002dffffff] PMD -> [fff8003faf800000-fff8003fafffffff] on node 0
 [600002e000000-600002e7fffff] PMD -> [fff8003faf000000-fff8003faf7fffff] on node 0
 [600002e800000-600002effffff] PMD -> [fff8003fae800000-fff8003faeffffff] on node 0
 [600002f000000-600002f7fffff] PMD -> [fff8003fae000000-fff8003fae7fffff] on node 0
 [600002f800000-600002fffffff] PMD -> [fff8003fad800000-fff8003fadffffff] on node 0
 [6000030000000-60000307fffff] PMD -> [fff8003fad000000-fff8003fad7fffff] on node 0
 [6000030800000-6000030ffffff] PMD -> [fff8003fac800000-fff8003facffffff] on node 0
 [6000031000000-60000317fffff] PMD -> [fff8003fac000000-fff8003fac7fffff] on node 0
 [6000031800000-6000031ffffff] PMD -> [fff8003fab800000-fff8003fabffffff] on node 0
 [6000032000000-60000327fffff] PMD -> [fff8003fab000000-fff8003fab7fffff] on node 0
 [6000032800000-6000032ffffff] PMD -> [fff8003faa800000-fff8003faaffffff] on node 0
 [6000033000000-60000337fffff] PMD -> [fff8003faa000000-fff8003faa7fffff] on node 0
 [6000033800000-6000033ffffff] PMD -> [fff8003fa9800000-fff8003fa9ffffff] on node 0
 [6000034000000-60000347fffff] PMD -> [fff8003fa9000000-fff8003fa97fffff] on node 0
 [6000034800000-6000034ffffff] PMD -> [fff8003fa8800000-fff8003fa8ffffff] on node 0
 [6000035000000-60000357fffff] PMD -> [fff8003fa8000000-fff8003fa87fffff] on node 0
 [6000035800000-6000035ffffff] PMD -> [fff8003fa7800000-fff8003fa7ffffff] on node 0
 [6000036000000-60000367fffff] PMD -> [fff8003fa7000000-fff8003fa77fffff] on node 0
 [6000036800000-6000036ffffff] PMD -> [fff8003fa6800000-fff8003fa6ffffff] on node 0
 [6000037000000-60000377fffff] PMD -> [fff8003fa6000000-fff8003fa67fffff] on node 0
 [6000037800000-6000037ffffff] PMD -> [fff8003fa5800000-fff8003fa5ffffff] on node 0
 [6000038000000-60000387fffff] PMD -> [fff8003fa5000000-fff8003fa57fffff] on node 0
 [6000038800000-6000038ffffff] PMD -> [fff8003fa4800000-fff8003fa4ffffff] on node 0
 [6000039000000-60000397fffff] PMD -> [fff8003fa4000000-fff8003fa47fffff] on node 0
 [6000039800000-6000039ffffff] PMD -> [fff8003fa3800000-fff8003fa3ffffff] on node 0
 [600003a000000-600003a7fffff] PMD -> [fff8003fa3000000-fff8003fa37fffff] on node 0
 [600003a800000-600003affffff] PMD -> [fff8003fa2800000-fff8003fa2ffffff] on node 0
 [600003b000000-600003b7fffff] PMD -> [fff8003fa2000000-fff8003fa27fffff] on node 0
 [600003b800000-600003bffffff] PMD -> [fff8003fa1800000-fff8003fa1ffffff] on node 0
 [600003c000000-600003c7fffff] PMD -> [fff8003fa1000000-fff8003fa17fffff] on node 0
 [600003c800000-600003cffffff] PMD -> [fff8003fa0800000-fff8003fa0ffffff] on node 0
 [600003d000000-600003d7fffff] PMD -> [fff8003fa0000000-fff8003fa07fffff] on node 0
 [600003d800000-600003dffffff] PMD -> [fff8003f9f800000-fff8003f9fffffff] on node 0
 [600003e000000-600003e7fffff] PMD -> [fff8003f9f000000-fff8003f9f7fffff] on node 0
 [600003e800000-600003effffff] PMD -> [fff8003f9e800000-fff8003f9effffff] on node 0
 [600003f000000-600003f7fffff] PMD -> [fff8003f9e000000-fff8003f9e7fffff] on node 0
 [600003f800000-600003fffffff] PMD -> [fff8003f9d800000-fff8003f9dffffff] on node 0
 [6000040000000-60000407fffff] PMD -> [fff8003f9d000000-fff8003f9d7fffff] on node 0
 [6000040800000-6000040ffffff] PMD -> [fff8003f9c800000-fff8003f9cffffff] on node 0
 [6000041000000-60000417fffff] PMD -> [fff8003f9c000000-fff8003f9c7fffff] on node 0
 [6000041800000-6000041ffffff] PMD -> [fff8003f9b800000-fff8003f9bffffff] on node 0
 [6000042000000-60000427fffff] PMD -> [fff8003f9b000000-fff8003f9b7fffff] on node 0
 [6000042800000-6000042ffffff] PMD -> [fff8003f9a800000-fff8003f9affffff] on node 0
 [6000043000000-60000437fffff] PMD -> [fff8003f9a000000-fff8003f9a7fffff] on node 0
 [6000043800000-6000043ffffff] PMD -> [fff8003f99800000-fff8003f99ffffff] on node 0
 [6000044000000-60000447fffff] PMD -> [fff8003f99000000-fff8003f997fffff] on node 0
 [6000044800000-6000044ffffff] PMD -> [fff8003f98800000-fff8003f98ffffff] on node 0
 [6000045000000-60000457fffff] PMD -> [fff8003f98000000-fff8003f987fffff] on node 0
 [6000045800000-6000045ffffff] PMD -> [fff8003f97800000-fff8003f97ffffff] on node 0
 [6000046000000-60000467fffff] PMD -> [fff8003f97000000-fff8003f977fffff] on node 0
 [6000046800000-6000046ffffff] PMD -> [fff8003f96800000-fff8003f96ffffff] on node 0
 [6000047000000-60000477fffff] PMD -> [fff8003f96000000-fff8003f967fffff] on node 0
 [6000047800000-6000047ffffff] PMD -> [fff8003f95800000-fff8003f95ffffff] on node 0
 [6000048000000-60000487fffff] PMD -> [fff8003f95000000-fff8003f957fffff] on node 0
 [6000048800000-6000048ffffff] PMD -> [fff8003f94800000-fff8003f94ffffff] on node 0
 [6000049000000-60000497fffff] PMD -> [fff8003f94000000-fff8003f947fffff] on node 0
 [6000049800000-6000049ffffff] PMD -> [fff8003f93800000-fff8003f93ffffff] on node 0
 [600004a000000-600004a7fffff] PMD -> [fff8003f93000000-fff8003f937fffff] on node 0
 [600004a800000-600004affffff] PMD -> [fff8003f92800000-fff8003f92ffffff] on node 0
 [600004b000000-600004b7fffff] PMD -> [fff8003f92000000-fff8003f927fffff] on node 0
 [600004b800000-600004bffffff] PMD -> [fff8003f91800000-fff8003f91ffffff] on node 0
 [600004c000000-600004c7fffff] PMD -> [fff8003f91000000-fff8003f917fffff] on node 0
 [600004c800000-600004cffffff] PMD -> [fff8003f90800000-fff8003f90ffffff] on node 0
 [600004d000000-600004d7fffff] PMD -> [fff8003f90000000-fff8003f907fffff] on node 0
 [600004d800000-600004dffffff] PMD -> [fff8003f8f800000-fff8003f8fffffff] on node 0
 [600004e000000-600004e7fffff] PMD -> [fff8003f8f000000-fff8003f8f7fffff] on node 0
 [600004e800000-600004effffff] PMD -> [fff8003f8e800000-fff8003f8effffff] on node 0
 [600004f000000-600004f7fffff] PMD -> [fff8003f8e000000-fff8003f8e7fffff] on node 0
 [600004f800000-600004fffffff] PMD -> [fff8003f8d800000-fff8003f8dffffff] on node 0
 [6000050000000-60000507fffff] PMD -> [fff8003f8d000000-fff8003f8d7fffff] on node 0
 [6000050800000-6000050ffffff] PMD -> [fff8003f8c800000-fff8003f8cffffff] on node 0
 [6000051000000-60000517fffff] PMD -> [fff8003f8c000000-fff8003f8c7fffff] on node 0
 [6000051800000-6000051ffffff] PMD -> [fff8003f8b800000-fff8003f8bffffff] on node 0
 [6000052000000-60000527fffff] PMD -> [fff8003f8b000000-fff8003f8b7fffff] on node 0
 [6000052800000-6000052ffffff] PMD -> [fff8003f8a800000-fff8003f8affffff] on node 0
 [6000053000000-60000537fffff] PMD -> [fff8003f8a000000-fff8003f8a7fffff] on node 0
 [6000053800000-6000053ffffff] PMD -> [fff8003f89800000-fff8003f89ffffff] on node 0
 [6000054000000-60000547fffff] PMD -> [fff8003f89000000-fff8003f897fffff] on node 0
 [6000054800000-6000054ffffff] PMD -> [fff8003f88800000-fff8003f88ffffff] on node 0
 [6000055000000-60000557fffff] PMD -> [fff8003f88000000-fff8003f887fffff] on node 0
 [6000055800000-6000055ffffff] PMD -> [fff8003f87800000-fff8003f87ffffff] on node 0
 [6000056000000-60000567fffff] PMD -> [fff8003f87000000-fff8003f877fffff] on node 0
 [6000056800000-6000056ffffff] PMD -> [fff8003f86800000-fff8003f86ffffff] on node 0
 [6000057000000-60000577fffff] PMD -> [fff8003f86000000-fff8003f867fffff] on node 0
 [6000057800000-6000057ffffff] PMD -> [fff8003f85800000-fff8003f85ffffff] on node 0
 [6000058000000-60000587fffff] PMD -> [fff8003f85000000-fff8003f857fffff] on node 0
 [6000058800000-6000058ffffff] PMD -> [fff8003f84800000-fff8003f84ffffff] on node 0
 [6000059000000-60000597fffff] PMD -> [fff8003f84000000-fff8003f847fffff] on node 0
 [6000059800000-6000059ffffff] PMD -> [fff8003f83800000-fff8003f83ffffff] on node 0
 [600005a000000-600005a7fffff] PMD -> [fff8003f83000000-fff8003f837fffff] on node 0
 [600005a800000-600005affffff] PMD -> [fff8003f82800000-fff8003f82ffffff] on node 0
 [600005b000000-600005b7fffff] PMD -> [fff8003f82000000-fff8003f827fffff] on node 0
 [600005b800000-600005bffffff] PMD -> [fff8003f81800000-fff8003f81ffffff] on node 0
 [600005c000000-600005c7fffff] PMD -> [fff8003f81000000-fff8003f817fffff] on node 0
 [600005c800000-600005cffffff] PMD -> [fff8003f80800000-fff8003f80ffffff] on node 0
 [600005d000000-600005d7fffff] PMD -> [fff8003f80000000-fff8003f807fffff] on node 0
 [600005d800000-600005dffffff] PMD -> [fff8003f7f800000-fff8003f7fffffff] on node 0
 [600005e000000-600005e7fffff] PMD -> [fff8003f7f000000-fff8003f7f7fffff] on node 0
 [600005e800000-600005effffff] PMD -> [fff8003f7e800000-fff8003f7effffff] on node 0
 [600005f000000-600005f7fffff] PMD -> [fff8003f7e000000-fff8003f7e7fffff] on node 0
 [600005f800000-600005fffffff] PMD -> [fff8003f7d800000-fff8003f7dffffff] on node 0
 [6000060000000-60000607fffff] PMD -> [fff8003f7d000000-fff8003f7d7fffff] on node 0
 [6000060800000-6000060ffffff] PMD -> [fff8003f7c800000-fff8003f7cffffff] on node 0
 [6000061000000-60000617fffff] PMD -> [fff8003f7c000000-fff8003f7c7fffff] on node 0
 [6000061800000-6000061ffffff] PMD -> [fff8003f7b800000-fff8003f7bffffff] on node 0
 [6000062000000-60000627fffff] PMD -> [fff8003f7b000000-fff8003f7b7fffff] on node 0
 [6000062800000-6000062ffffff] PMD -> [fff8003f7a800000-fff8003f7affffff] on node 0
 [6000063000000-60000637fffff] PMD -> [fff8003f7a000000-fff8003f7a7fffff] on node 0
 [6000063800000-6000063ffffff] PMD -> [fff8003f79800000-fff8003f79ffffff] on node 0
 [6000064000000-60000647fffff] PMD -> [fff8003f79000000-fff8003f797fffff] on node 0
 [6000064800000-6000064ffffff] PMD -> [fff8003f78800000-fff8003f78ffffff] on node 0
 [6000065000000-60000657fffff] PMD -> [fff8003f78000000-fff8003f787fffff] on node 0
 [6000065800000-6000065ffffff] PMD -> [fff8003f77800000-fff8003f77ffffff] on node 0
 [6000066000000-60000667fffff] PMD -> [fff8003f77000000-fff8003f777fffff] on node 0
 [6000066800000-6000066ffffff] PMD -> [fff8003f76800000-fff8003f76ffffff] on node 0
 [6000067000000-60000677fffff] PMD -> [fff8003f76000000-fff8003f767fffff] on node 0
 [6000067800000-6000067ffffff] PMD -> [fff8003f75800000-fff8003f75ffffff] on node 0
 [6000068000000-60000687fffff] PMD -> [fff8003f75000000-fff8003f757fffff] on node 0
 [6000068800000-6000068ffffff] PMD -> [fff8003f74800000-fff8003f74ffffff] on node 0
 [6000069000000-60000697fffff] PMD -> [fff8003f74000000-fff8003f747fffff] on node 0
 [6000069800000-6000069ffffff] PMD -> [fff8003f73800000-fff8003f73ffffff] on node 0
 [600006a000000-600006a7fffff] PMD -> [fff8003f73000000-fff8003f737fffff] on node 0
 [600006a800000-600006affffff] PMD -> [fff8003f72800000-fff8003f72ffffff] on node 0
 [600006b000000-600006b7fffff] PMD -> [fff8003f72000000-fff8003f727fffff] on node 0
 [600006b800000-600006bffffff] PMD -> [fff8003f71800000-fff8003f71ffffff] on node 0
 [600006c000000-600006c7fffff] PMD -> [fff8003f71000000-fff8003f717fffff] on node 0
 [600006c800000-600006cffffff] PMD -> [fff8003f70800000-fff8003f70ffffff] on node 0
 [600006d000000-600006d7fffff] PMD -> [fff8003f70000000-fff8003f707fffff] on node 0
 [600006d800000-600006dffffff] PMD -> [fff8003f6f800000-fff8003f6fffffff] on node 0
 [600006e000000-600006e7fffff] PMD -> [fff8003f6f000000-fff8003f6f7fffff] on node 0
 [600006e800000-600006effffff] PMD -> [fff8003f6e800000-fff8003f6effffff] on node 0
 [600006f000000-600006f7fffff] PMD -> [fff8003f6e000000-fff8003f6e7fffff] on node 0
 [600006f800000-600006fffffff] PMD -> [fff8003f6d800000-fff8003f6dffffff] on node 0
 [6000070000000-60000707fffff] PMD -> [fff8003f6d000000-fff8003f6d7fffff] on node 0
 [6000070800000-6000070ffffff] PMD -> [fff8003f6c800000-fff8003f6cffffff] on node 0
 [6000071000000-60000717fffff] PMD -> [fff8003f6c000000-fff8003f6c7fffff] on node 0
 [6000071800000-6000071ffffff] PMD -> [fff8003f6b800000-fff8003f6bffffff] on node 0
 [6000072000000-60000727fffff] PMD -> [fff8003f6b000000-fff8003f6b7fffff] on node 0
 [6000072800000-6000072ffffff] PMD -> [fff8003f6a800000-fff8003f6affffff] on node 0
 [6000073000000-60000737fffff] PMD -> [fff8003f6a000000-fff8003f6a7fffff] on node 0
 [6000073800000-6000073ffffff] PMD -> [fff8003f69800000-fff8003f69ffffff] on node 0
 [6000074000000-60000747fffff] PMD -> [fff8003f69000000-fff8003f697fffff] on node 0
 [6000074800000-6000074ffffff] PMD -> [fff8003f68800000-fff8003f68ffffff] on node 0
 [6000075000000-60000757fffff] PMD -> [fff8003f68000000-fff8003f687fffff] on node 0
 [6000075800000-6000075ffffff] PMD -> [fff8003f67800000-fff8003f67ffffff] on node 0
 [6000076000000-60000767fffff] PMD -> [fff8003f67000000-fff8003f677fffff] on node 0
 [6000076800000-6000076ffffff] PMD -> [fff8003f66800000-fff8003f66ffffff] on node 0
 [6000077000000-60000777fffff] PMD -> [fff8003f66000000-fff8003f667fffff] on node 0
 [6000077800000-6000077ffffff] PMD -> [fff8003f65800000-fff8003f65ffffff] on node 0
 [6000078000000-60000787fffff] PMD -> [fff8003f65000000-fff8003f657fffff] on node 0
 [6000078800000-6000078ffffff] PMD -> [fff8003f64800000-fff8003f64ffffff] on node 0
 [6000079000000-60000797fffff] PMD -> [fff8003f64000000-fff8003f647fffff] on node 0
 [6000079800000-6000079ffffff] PMD -> [fff8003f63800000-fff8003f63ffffff] on node 0
 [600007a000000-600007a7fffff] PMD -> [fff8003f63000000-fff8003f637fffff] on node 0
 [600007a800000-600007affffff] PMD -> [fff8003f62800000-fff8003f62ffffff] on node 0
 [600007b000000-600007b7fffff] PMD -> [fff8003f62000000-fff8003f627fffff] on node 0
 [600007b800000-600007bffffff] PMD -> [fff8003f61800000-fff8003f61ffffff] on node 0
 [600007c000000-600007c7fffff] PMD -> [fff8003f61000000-fff8003f617fffff] on node 0
 [600007c800000-600007cffffff] PMD -> [fff8003f60800000-fff8003f60ffffff] on node 0
 [600007d000000-600007d7fffff] PMD -> [fff8003f60000000-fff8003f607fffff] on node 0
 [600007d800000-600007dffffff] PMD -> [fff8003f5f800000-fff8003f5fffffff] on node 0
 [600007e000000-600007e7fffff] PMD -> [fff8003f5f000000-fff8003f5f7fffff] on node 0
 [600007e800000-600007effffff] PMD -> [fff8003f5e800000-fff8003f5effffff] on node 0
 [600007f000000-600007f7fffff] PMD -> [fff8003f5e000000-fff8003f5e7fffff] on node 0
 [600007f800000-600007fffffff] PMD -> [fff8003f5d800000-fff8003f5dffffff] on node 0
 [6001000000000-60010007fffff] PMD -> [fff8083fff000000-fff8083fff7fffff] on node 1
 [6001000800000-6001000ffffff] PMD -> [fff8083ffe800000-fff8083ffeffffff] on node 1
 [6001001000000-60010017fffff] PMD -> [fff8083ffe000000-fff8083ffe7fffff] on node 1
 [6001001800000-6001001ffffff] PMD -> [fff8083ffd800000-fff8083ffdffffff] on node 1
 [6001002000000-60010027fffff] PMD -> [fff8083ffd000000-fff8083ffd7fffff] on node 1
 [6001002800000-6001002ffffff] PMD -> [fff8083ffc800000-fff8083ffcffffff] on node 1
 [6001003000000-60010037fffff] PMD -> [fff8083ffc000000-fff8083ffc7fffff] on node 1
 [6001003800000-6001003ffffff] PMD -> [fff8083ffb800000-fff8083ffbffffff] on node 1
 [6001004000000-60010047fffff] PMD -> [fff8083ffb000000-fff8083ffb7fffff] on node 1
 [6001004800000-6001004ffffff] PMD -> [fff8083ffa800000-fff8083ffaffffff] on node 1
 [6001005000000-60010057fffff] PMD -> [fff8083ffa000000-fff8083ffa7fffff] on node 1
 [6001005800000-6001005ffffff] PMD -> [fff8083ff9800000-fff8083ff9ffffff] on node 1
 [6001006000000-60010067fffff] PMD -> [fff8083ff9000000-fff8083ff97fffff] on node 1
 [6001006800000-6001006ffffff] PMD -> [fff8083ff8800000-fff8083ff8ffffff] on node 1
 [6001007000000-60010077fffff] PMD -> [fff8083ff8000000-fff8083ff87fffff] on node 1
 [6001007800000-6001007ffffff] PMD -> [fff8083ff7800000-fff8083ff7ffffff] on node 1
 [6001008000000-60010087fffff] PMD -> [fff8083ff7000000-fff8083ff77fffff] on node 1
 [6001008800000-6001008ffffff] PMD -> [fff8083ff6800000-fff8083ff6ffffff] on node 1
 [6001009000000-60010097fffff] PMD -> [fff8083ff6000000-fff8083ff67fffff] on node 1
 [6001009800000-6001009ffffff] PMD -> [fff8083ff5800000-fff8083ff5ffffff] on node 1
 [600100a000000-600100a7fffff] PMD -> [fff8083ff5000000-fff8083ff57fffff] on node 1
 [600100a800000-600100affffff] PMD -> [fff8083ff4800000-fff8083ff4ffffff] on node 1
 [600100b000000-600100b7fffff] PMD -> [fff8083ff4000000-fff8083ff47fffff] on node 1
 [600100b800000-600100bffffff] PMD -> [fff8083ff3800000-fff8083ff3ffffff] on node 1
 [600100c000000-600100c7fffff] PMD -> [fff8083ff3000000-fff8083ff37fffff] on node 1
 [600100c800000-600100cffffff] PMD -> [fff8083ff2800000-fff8083ff2ffffff] on node 1
 [600100d000000-600100d7fffff] PMD -> [fff8083ff2000000-fff8083ff27fffff] on node 1
 [600100d800000-600100dffffff] PMD -> [fff8083ff1800000-fff8083ff1ffffff] on node 1
 [600100e000000-600100e7fffff] PMD -> [fff8083ff1000000-fff8083ff17fffff] on node 1
 [600100e800000-600100effffff] PMD -> [fff8083ff0800000-fff8083ff0ffffff] on node 1
 [600100f000000-600100f7fffff] PMD -> [fff8083ff0000000-fff8083ff07fffff] on node 1
 [600100f800000-600100fffffff] PMD -> [fff8083fef800000-fff8083fefffffff] on node 1
 [6001010000000-60010107fffff] PMD -> [fff8083fef000000-fff8083fef7fffff] on node 1
 [6001010800000-6001010ffffff] PMD -> [fff8083fee800000-fff8083feeffffff] on node 1
 [6001011000000-60010117fffff] PMD -> [fff8083fee000000-fff8083fee7fffff] on node 1
 [6001011800000-6001011ffffff] PMD -> [fff8083fed800000-fff8083fedffffff] on node 1
 [6001012000000-60010127fffff] PMD -> [fff8083fed000000-fff8083fed7fffff] on node 1
 [6001012800000-6001012ffffff] PMD -> [fff8083fec800000-fff8083fecffffff] on node 1
 [6001013000000-60010137fffff] PMD -> [fff8083fec000000-fff8083fec7fffff] on node 1
 [6001013800000-6001013ffffff] PMD -> [fff8083feb800000-fff8083febffffff] on node 1
 [6001014000000-60010147fffff] PMD -> [fff8083feb000000-fff8083feb7fffff] on node 1
 [6001014800000-6001014ffffff] PMD -> [fff8083fea800000-fff8083feaffffff] on node 1
 [6001015000000-60010157fffff] PMD -> [fff8083fea000000-fff8083fea7fffff] on node 1
 [6001015800000-6001015ffffff] PMD -> [fff8083fe9800000-fff8083fe9ffffff] on node 1
 [6001016000000-60010167fffff] PMD -> [fff8083fe9000000-fff8083fe97fffff] on node 1
 [6001016800000-6001016ffffff] PMD -> [fff8083fe8800000-fff8083fe8ffffff] on node 1
 [6001017000000-60010177fffff] PMD -> [fff8083fe8000000-fff8083fe87fffff] on node 1
 [6001017800000-6001017ffffff] PMD -> [fff8083fe7800000-fff8083fe7ffffff] on node 1
 [6001018000000-60010187fffff] PMD -> [fff8083fe7000000-fff8083fe77fffff] on node 1
 [6001018800000-6001018ffffff] PMD -> [fff8083fe6800000-fff8083fe6ffffff] on node 1
 [6001019000000-60010197fffff] PMD -> [fff8083fe6000000-fff8083fe67fffff] on node 1
 [6001019800000-6001019ffffff] PMD -> [fff8083fe5800000-fff8083fe5ffffff] on node 1
 [600101a000000-600101a7fffff] PMD -> [fff8083fe5000000-fff8083fe57fffff] on node 1
 [600101a800000-600101affffff] PMD -> [fff8083fe4800000-fff8083fe4ffffff] on node 1
 [600101b000000-600101b7fffff] PMD -> [fff8083fe4000000-fff8083fe47fffff] on node 1
 [600101b800000-600101bffffff] PMD -> [fff8083fe3800000-fff8083fe3ffffff] on node 1
 [600101c000000-600101c7fffff] PMD -> [fff8083fe3000000-fff8083fe37fffff] on node 1
 [600101c800000-600101cffffff] PMD -> [fff8083fe2800000-fff8083fe2ffffff] on node 1
 [600101d000000-600101d7fffff] PMD -> [fff8083fe2000000-fff8083fe27fffff] on node 1
 [600101d800000-600101dffffff] PMD -> [fff8083fe1800000-fff8083fe1ffffff] on node 1
 [600101e000000-600101e7fffff] PMD -> [fff8083fe1000000-fff8083fe17fffff] on node 1
 [600101e800000-600101effffff] PMD -> [fff8083fe0800000-fff8083fe0ffffff] on node 1
 [600101f000000-600101f7fffff] PMD -> [fff8083fe0000000-fff8083fe07fffff] on node 1
 [600101f800000-600101fffffff] PMD -> [fff8083fdf800000-fff8083fdfffffff] on node 1
 [6001020000000-60010207fffff] PMD -> [fff8083fdf000000-fff8083fdf7fffff] on node 1
 [6001020800000-6001020ffffff] PMD -> [fff8083fde800000-fff8083fdeffffff] on node 1
 [6001021000000-60010217fffff] PMD -> [fff8083fde000000-fff8083fde7fffff] on node 1
 [6001021800000-6001021ffffff] PMD -> [fff8083fdd800000-fff8083fddffffff] on node 1
 [6001022000000-60010227fffff] PMD -> [fff8083fdd000000-fff8083fdd7fffff] on node 1
 [6001022800000-6001022ffffff] PMD -> [fff8083fdc800000-fff8083fdcffffff] on node 1
 [6001023000000-60010237fffff] PMD -> [fff8083fdc000000-fff8083fdc7fffff] on node 1
 [6001023800000-6001023ffffff] PMD -> [fff8083fdb800000-fff8083fdbffffff] on node 1
 [6001024000000-60010247fffff] PMD -> [fff8083fdb000000-fff8083fdb7fffff] on node 1
 [6001024800000-6001024ffffff] PMD -> [fff8083fda800000-fff8083fdaffffff] on node 1
 [6001025000000-60010257fffff] PMD -> [fff8083fda000000-fff8083fda7fffff] on node 1
 [6001025800000-6001025ffffff] PMD -> [fff8083fd9800000-fff8083fd9ffffff] on node 1
 [6001026000000-60010267fffff] PMD -> [fff8083fd9000000-fff8083fd97fffff] on node 1
 [6001026800000-6001026ffffff] PMD -> [fff8083fd8800000-fff8083fd8ffffff] on node 1
 [6001027000000-60010277fffff] PMD -> [fff8083fd8000000-fff8083fd87fffff] on node 1
 [6001027800000-6001027ffffff] PMD -> [fff8083fd7800000-fff8083fd7ffffff] on node 1
 [6001028000000-60010287fffff] PMD -> [fff8083fd7000000-fff8083fd77fffff] on node 1
 [6001028800000-6001028ffffff] PMD -> [fff8083fd6800000-fff8083fd6ffffff] on node 1
 [6001029000000-60010297fffff] PMD -> [fff8083fd6000000-fff8083fd67fffff] on node 1
 [6001029800000-6001029ffffff] PMD -> [fff8083fd5800000-fff8083fd5ffffff] on node 1
 [600102a000000-600102a7fffff] PMD -> [fff8083fd5000000-fff8083fd57fffff] on node 1
 [600102a800000-600102affffff] PMD -> [fff8083fd4800000-fff8083fd4ffffff] on node 1
 [600102b000000-600102b7fffff] PMD -> [fff8083fd4000000-fff8083fd47fffff] on node 1
 [600102b800000-600102bffffff] PMD -> [fff8083fd3800000-fff8083fd3ffffff] on node 1
 [600102c000000-600102c7fffff] PMD -> [fff8083fd3000000-fff8083fd37fffff] on node 1
 [600102c800000-600102cffffff] PMD -> [fff8083fd2800000-fff8083fd2ffffff] on node 1
 [600102d000000-600102d7fffff] PMD -> [fff8083fd2000000-fff8083fd27fffff] on node 1
 [600102d800000-600102dffffff] PMD -> [fff8083fd1800000-fff8083fd1ffffff] on node 1
 [600102e000000-600102e7fffff] PMD -> [fff8083fd1000000-fff8083fd17fffff] on node 1
 [600102e800000-600102effffff] PMD -> [fff8083fd0800000-fff8083fd0ffffff] on node 1
 [600102f000000-600102f7fffff] PMD -> [fff8083fd0000000-fff8083fd07fffff] on node 1
 [600102f800000-600102fffffff] PMD -> [fff8083fcf800000-fff8083fcfffffff] on node 1
 [6001030000000-60010307fffff] PMD -> [fff8083fcf000000-fff8083fcf7fffff] on node 1
 [6001030800000-6001030ffffff] PMD -> [fff8083fce800000-fff8083fceffffff] on node 1
 [6001031000000-60010317fffff] PMD -> [fff8083fce000000-fff8083fce7fffff] on node 1
 [6001031800000-6001031ffffff] PMD -> [fff8083fcd800000-fff8083fcdffffff] on node 1
 [6001032000000-60010327fffff] PMD -> [fff8083fcd000000-fff8083fcd7fffff] on node 1
 [6001032800000-6001032ffffff] PMD -> [fff8083fcc800000-fff8083fccffffff] on node 1
 [6001033000000-60010337fffff] PMD -> [fff8083fcc000000-fff8083fcc7fffff] on node 1
 [6001033800000-6001033ffffff] PMD -> [fff8083fcb800000-fff8083fcbffffff] on node 1
 [6001034000000-60010347fffff] PMD -> [fff8083fcb000000-fff8083fcb7fffff] on node 1
 [6001034800000-6001034ffffff] PMD -> [fff8083fca800000-fff8083fcaffffff] on node 1
 [6001035000000-60010357fffff] PMD -> [fff8083fca000000-fff8083fca7fffff] on node 1
 [6001035800000-6001035ffffff] PMD -> [fff8083fc9800000-fff8083fc9ffffff] on node 1
 [6001036000000-60010367fffff] PMD -> [fff8083fc9000000-fff8083fc97fffff] on node 1
 [6001036800000-6001036ffffff] PMD -> [fff8083fc8800000-fff8083fc8ffffff] on node 1
 [6001037000000-60010377fffff] PMD -> [fff8083fc8000000-fff8083fc87fffff] on node 1
 [6001037800000-6001037ffffff] PMD -> [fff8083fc7800000-fff8083fc7ffffff] on node 1
 [6001038000000-60010387fffff] PMD -> [fff8083fc7000000-fff8083fc77fffff] on node 1
 [6001038800000-6001038ffffff] PMD -> [fff8083fc6800000-fff8083fc6ffffff] on node 1
 [6001039000000-60010397fffff] PMD -> [fff8083fc6000000-fff8083fc67fffff] on node 1
 [6001039800000-6001039ffffff] PMD -> [fff8083fc5800000-fff8083fc5ffffff] on node 1
 [600103a000000-600103a7fffff] PMD -> [fff8083fc5000000-fff8083fc57fffff] on node 1
 [600103a800000-600103affffff] PMD -> [fff8083fc4800000-fff8083fc4ffffff] on node 1
 [600103b000000-600103b7fffff] PMD -> [fff8083fc4000000-fff8083fc47fffff] on node 1
 [600103b800000-600103bffffff] PMD -> [fff8083fc3800000-fff8083fc3ffffff] on node 1
 [600103c000000-600103c7fffff] PMD -> [fff8083fc3000000-fff8083fc37fffff] on node 1
 [600103c800000-600103cffffff] PMD -> [fff8083fc2800000-fff8083fc2ffffff] on node 1
 [600103d000000-600103d7fffff] PMD -> [fff8083fc2000000-fff8083fc27fffff] on node 1
 [600103d800000-600103dffffff] PMD -> [fff8083fc1800000-fff8083fc1ffffff] on node 1
 [600103e000000-600103e7fffff] PMD -> [fff8083fc1000000-fff8083fc17fffff] on node 1
 [600103e800000-600103effffff] PMD -> [fff8083fc0800000-fff8083fc0ffffff] on node 1
 [600103f000000-600103f7fffff] PMD -> [fff8083fc0000000-fff8083fc07fffff] on node 1
 [600103f800000-600103fffffff] PMD -> [fff8083fbf800000-fff8083fbfffffff] on node 1
 [6001040000000-60010407fffff] PMD -> [fff8083fbf000000-fff8083fbf7fffff] on node 1
 [6001040800000-6001040ffffff] PMD -> [fff8083fbe800000-fff8083fbeffffff] on node 1
 [6001041000000-60010417fffff] PMD -> [fff8083fbe000000-fff8083fbe7fffff] on node 1
 [6001041800000-6001041ffffff] PMD -> [fff8083fbd800000-fff8083fbdffffff] on node 1
 [6001042000000-60010427fffff] PMD -> [fff8083fbd000000-fff8083fbd7fffff] on node 1
 [6001042800000-6001042ffffff] PMD -> [fff8083fbc800000-fff8083fbcffffff] on node 1
 [6001043000000-60010437fffff] PMD -> [fff8083fbc000000-fff8083fbc7fffff] on node 1
 [6001043800000-6001043ffffff] PMD -> [fff8083fbb800000-fff8083fbbffffff] on node 1
 [6001044000000-60010447fffff] PMD -> [fff8083fbb000000-fff8083fbb7fffff] on node 1
 [6001044800000-6001044ffffff] PMD -> [fff8083fba800000-fff8083fbaffffff] on node 1
 [6001045000000-60010457fffff] PMD -> [fff8083fba000000-fff8083fba7fffff] on node 1
 [6001045800000-6001045ffffff] PMD -> [fff8083fb9800000-fff8083fb9ffffff] on node 1
 [6001046000000-60010467fffff] PMD -> [fff8083fb9000000-fff8083fb97fffff] on node 1
 [6001046800000-6001046ffffff] PMD -> [fff8083fb8800000-fff8083fb8ffffff] on node 1
 [6001047000000-60010477fffff] PMD -> [fff8083fb8000000-fff8083fb87fffff] on node 1
 [6001047800000-6001047ffffff] PMD -> [fff8083fb7800000-fff8083fb7ffffff] on node 1
 [6001048000000-60010487fffff] PMD -> [fff8083fb7000000-fff8083fb77fffff] on node 1
 [6001048800000-6001048ffffff] PMD -> [fff8083fb6800000-fff8083fb6ffffff] on node 1
 [6001049000000-60010497fffff] PMD -> [fff8083fb6000000-fff8083fb67fffff] on node 1
 [6001049800000-6001049ffffff] PMD -> [fff8083fb5800000-fff8083fb5ffffff] on node 1
 [600104a000000-600104a7fffff] PMD -> [fff8083fb5000000-fff8083fb57fffff] on node 1
 [600104a800000-600104affffff] PMD -> [fff8083fb4800000-fff8083fb4ffffff] on node 1
 [600104b000000-600104b7fffff] PMD -> [fff8083fb4000000-fff8083fb47fffff] on node 1
 [600104b800000-600104bffffff] PMD -> [fff8083fb3800000-fff8083fb3ffffff] on node 1
 [600104c000000-600104c7fffff] PMD -> [fff8083fb3000000-fff8083fb37fffff] on node 1
 [600104c800000-600104cffffff] PMD -> [fff8083fb2800000-fff8083fb2ffffff] on node 1
 [600104d000000-600104d7fffff] PMD -> [fff8083fb2000000-fff8083fb27fffff] on node 1
 [600104d800000-600104dffffff] PMD -> [fff8083fb1800000-fff8083fb1ffffff] on node 1
 [600104e000000-600104e7fffff] PMD -> [fff8083fb1000000-fff8083fb17fffff] on node 1
 [600104e800000-600104effffff] PMD -> [fff8083fb0800000-fff8083fb0ffffff] on node 1
 [600104f000000-600104f7fffff] PMD -> [fff8083fb0000000-fff8083fb07fffff] on node 1
 [600104f800000-600104fffffff] PMD -> [fff8083faf800000-fff8083fafffffff] on node 1
 [6001050000000-60010507fffff] PMD -> [fff8083faf000000-fff8083faf7fffff] on node 1
 [6001050800000-6001050ffffff] PMD -> [fff8083fae800000-fff8083faeffffff] on node 1
 [6001051000000-60010517fffff] PMD -> [fff8083fae000000-fff8083fae7fffff] on node 1
 [6001051800000-6001051ffffff] PMD -> [fff8083fad800000-fff8083fadffffff] on node 1
 [6001052000000-60010527fffff] PMD -> [fff8083fad000000-fff8083fad7fffff] on node 1
 [6001052800000-6001052ffffff] PMD -> [fff8083fac800000-fff8083facffffff] on node 1
 [6001053000000-60010537fffff] PMD -> [fff8083fac000000-fff8083fac7fffff] on node 1
 [6001053800000-6001053ffffff] PMD -> [fff8083fab800000-fff8083fabffffff] on node 1
 [6001054000000-60010547fffff] PMD -> [fff8083fab000000-fff8083fab7fffff] on node 1
 [6001054800000-6001054ffffff] PMD -> [fff8083faa800000-fff8083faaffffff] on node 1
 [6001055000000-60010557fffff] PMD -> [fff8083faa000000-fff8083faa7fffff] on node 1
 [6001055800000-6001055ffffff] PMD -> [fff8083fa9800000-fff8083fa9ffffff] on node 1
 [6001056000000-60010567fffff] PMD -> [fff8083fa9000000-fff8083fa97fffff] on node 1
 [6001056800000-6001056ffffff] PMD -> [fff8083fa8800000-fff8083fa8ffffff] on node 1
 [6001057000000-60010577fffff] PMD -> [fff8083fa8000000-fff8083fa87fffff] on node 1
 [6001057800000-6001057ffffff] PMD -> [fff8083fa7800000-fff8083fa7ffffff] on node 1
 [6001058000000-60010587fffff] PMD -> [fff8083fa7000000-fff8083fa77fffff] on node 1
 [6001058800000-6001058ffffff] PMD -> [fff8083fa6800000-fff8083fa6ffffff] on node 1
 [6001059000000-60010597fffff] PMD -> [fff8083fa6000000-fff8083fa67fffff] on node 1
 [6001059800000-6001059ffffff] PMD -> [fff8083fa5800000-fff8083fa5ffffff] on node 1
 [600105a000000-600105a7fffff] PMD -> [fff8083fa5000000-fff8083fa57fffff] on node 1
 [600105a800000-600105affffff] PMD -> [fff8083fa4800000-fff8083fa4ffffff] on node 1
 [600105b000000-600105b7fffff] PMD -> [fff8083fa4000000-fff8083fa47fffff] on node 1
 [600105b800000-600105bffffff] PMD -> [fff8083fa3800000-fff8083fa3ffffff] on node 1
 [600105c000000-600105c7fffff] PMD -> [fff8083fa3000000-fff8083fa37fffff] on node 1
 [600105c800000-600105cffffff] PMD -> [fff8083fa2800000-fff8083fa2ffffff] on node 1
 [600105d000000-600105d7fffff] PMD -> [fff8083fa2000000-fff8083fa27fffff] on node 1
 [600105d800000-600105dffffff] PMD -> [fff8083fa1800000-fff8083fa1ffffff] on node 1
 [600105e000000-600105e7fffff] PMD -> [fff8083fa1000000-fff8083fa17fffff] on node 1
 [600105e800000-600105effffff] PMD -> [fff8083fa0800000-fff8083fa0ffffff] on node 1
 [600105f000000-600105f7fffff] PMD -> [fff8083fa0000000-fff8083fa07fffff] on node 1
 [600105f800000-600105fffffff] PMD -> [fff8083f9f800000-fff8083f9fffffff] on node 1
 [6001060000000-60010607fffff] PMD -> [fff8083f9f000000-fff8083f9f7fffff] on node 1
 [6001060800000-6001060ffffff] PMD -> [fff8083f9e800000-fff8083f9effffff] on node 1
 [6001061000000-60010617fffff] PMD -> [fff8083f9e000000-fff8083f9e7fffff] on node 1
 [6001061800000-6001061ffffff] PMD -> [fff8083f9d800000-fff8083f9dffffff] on node 1
 [6001062000000-60010627fffff] PMD -> [fff8083f9d000000-fff8083f9d7fffff] on node 1
 [6001062800000-6001062ffffff] PMD -> [fff8083f9c800000-fff8083f9cffffff] on node 1
 [6001063000000-60010637fffff] PMD -> [fff8083f9c000000-fff8083f9c7fffff] on node 1
 [6001063800000-6001063ffffff] PMD -> [fff8083f9b800000-fff8083f9bffffff] on node 1
 [6001064000000-60010647fffff] PMD -> [fff8083f9b000000-fff8083f9b7fffff] on node 1
 [6001064800000-6001064ffffff] PMD -> [fff8083f9a800000-fff8083f9affffff] on node 1
 [6001065000000-60010657fffff] PMD -> [fff8083f9a000000-fff8083f9a7fffff] on node 1
 [6001065800000-6001065ffffff] PMD -> [fff8083f99800000-fff8083f99ffffff] on node 1
 [6001066000000-60010667fffff] PMD -> [fff8083f99000000-fff8083f997fffff] on node 1
 [6001066800000-6001066ffffff] PMD -> [fff8083f98800000-fff8083f98ffffff] on node 1
 [6001067000000-60010677fffff] PMD -> [fff8083f98000000-fff8083f987fffff] on node 1
 [6001067800000-6001067ffffff] PMD -> [fff8083f97800000-fff8083f97ffffff] on node 1
 [6001068000000-60010687fffff] PMD -> [fff8083f97000000-fff8083f977fffff] on node 1
 [6001068800000-6001068ffffff] PMD -> [fff8083f96800000-fff8083f96ffffff] on node 1
 [6001069000000-60010697fffff] PMD -> [fff8083f96000000-fff8083f967fffff] on node 1
 [6001069800000-6001069ffffff] PMD -> [fff8083f95800000-fff8083f95ffffff] on node 1
 [600106a000000-600106a7fffff] PMD -> [fff8083f95000000-fff8083f957fffff] on node 1
 [600106a800000-600106affffff] PMD -> [fff8083f94800000-fff8083f94ffffff] on node 1
 [600106b000000-600106b7fffff] PMD -> [fff8083f94000000-fff8083f947fffff] on node 1
 [600106b800000-600106bffffff] PMD -> [fff8083f93800000-fff8083f93ffffff] on node 1
 [600106c000000-600106c7fffff] PMD -> [fff8083f93000000-fff8083f937fffff] on node 1
 [600106c800000-600106cffffff] PMD -> [fff8083f92800000-fff8083f92ffffff] on node 1
 [600106d000000-600106d7fffff] PMD -> [fff8083f92000000-fff8083f927fffff] on node 1
 [600106d800000-600106dffffff] PMD -> [fff8083f91800000-fff8083f91ffffff] on node 1
 [600106e000000-600106e7fffff] PMD -> [fff8083f91000000-fff8083f917fffff] on node 1
 [600106e800000-600106effffff] PMD -> [fff8083f90800000-fff8083f90ffffff] on node 1
 [600106f000000-600106f7fffff] PMD -> [fff8083f90000000-fff8083f907fffff] on node 1
 [600106f800000-600106fffffff] PMD -> [fff8083f8f800000-fff8083f8fffffff] on node 1
 [6001070000000-60010707fffff] PMD -> [fff8083f8f000000-fff8083f8f7fffff] on node 1
 [6001070800000-6001070ffffff] PMD -> [fff8083f8e800000-fff8083f8effffff] on node 1
 [6001071000000-60010717fffff] PMD -> [fff8083f8e000000-fff8083f8e7fffff] on node 1
 [6001071800000-6001071ffffff] PMD -> [fff8083f8d800000-fff8083f8dffffff] on node 1
 [6001072000000-60010727fffff] PMD -> [fff8083f8d000000-fff8083f8d7fffff] on node 1
 [6001072800000-6001072ffffff] PMD -> [fff8083f8c800000-fff8083f8cffffff] on node 1
 [6001073000000-60010737fffff] PMD -> [fff8083f8c000000-fff8083f8c7fffff] on node 1
 [6001073800000-6001073ffffff] PMD -> [fff8083f8b800000-fff8083f8bffffff] on node 1
 [6001074000000-60010747fffff] PMD -> [fff8083f8b000000-fff8083f8b7fffff] on node 1
 [6001074800000-6001074ffffff] PMD -> [fff8083f8a800000-fff8083f8affffff] on node 1
 [6001075000000-60010757fffff] PMD -> [fff8083f8a000000-fff8083f8a7fffff] on node 1
 [6001075800000-6001075ffffff] PMD -> [fff8083f89800000-fff8083f89ffffff] on node 1
 [6001076000000-60010767fffff] PMD -> [fff8083f89000000-fff8083f897fffff] on node 1
 [6001076800000-6001076ffffff] PMD -> [fff8083f88800000-fff8083f88ffffff] on node 1
 [6001077000000-60010777fffff] PMD -> [fff8083f88000000-fff8083f887fffff] on node 1
 [6001077800000-6001077ffffff] PMD -> [fff8083f87800000-fff8083f87ffffff] on node 1
 [6001078000000-60010787fffff] PMD -> [fff8083f87000000-fff8083f877fffff] on node 1
 [6001078800000-6001078ffffff] PMD -> [fff8083f86800000-fff8083f86ffffff] on node 1
 [6001079000000-60010797fffff] PMD -> [fff8083f86000000-fff8083f867fffff] on node 1
 [6001079800000-6001079ffffff] PMD -> [fff8083f85800000-fff8083f85ffffff] on node 1
 [600107a000000-600107a7fffff] PMD -> [fff8083f85000000-fff8083f857fffff] on node 1
 [600107a800000-600107affffff] PMD -> [fff8083f84800000-fff8083f84ffffff] on node 1
 [600107b000000-600107b7fffff] PMD -> [fff8083f84000000-fff8083f847fffff] on node 1
 [600107b800000-600107bffffff] PMD -> [fff8083f83800000-fff8083f83ffffff] on node 1
 [600107c000000-600107c7fffff] PMD -> [fff8083f83000000-fff8083f837fffff] on node 1
 [600107c800000-600107cffffff] PMD -> [fff8083f82800000-fff8083f82ffffff] on node 1
 [600107d000000-600107d7fffff] PMD -> [fff8083f82000000-fff8083f827fffff] on node 1
 [600107d800000-600107dffffff] PMD -> [fff8083f81800000-fff8083f81ffffff] on node 1
 [600107e000000-600107e7fffff] PMD -> [fff8083f81000000-fff8083f817fffff] on node 1
 [600107e800000-600107effffff] PMD -> [fff8083f80800000-fff8083f80ffffff] on node 1
 [600107f000000-600107f7fffff] PMD -> [fff8083f80000000-fff8083f807fffff] on node 1
 [600107f800000-600107fffffff] PMD -> [fff8083f7f800000-fff8083f7fffffff] on node 1
 [6002000000000-60020007fffff] PMD -> [fff8103fff000000-fff8103fff7fffff] on node 2
 [6002000800000-6002000ffffff] PMD -> [fff8103ffe800000-fff8103ffeffffff] on node 2
 [6002001000000-60020017fffff] PMD -> [fff8103ffe000000-fff8103ffe7fffff] on node 2
 [6002001800000-6002001ffffff] PMD -> [fff8103ffd800000-fff8103ffdffffff] on node 2
 [6002002000000-60020027fffff] PMD -> [fff8103ffd000000-fff8103ffd7fffff] on node 2
 [6002002800000-6002002ffffff] PMD -> [fff8103ffc800000-fff8103ffcffffff] on node 2
 [6002003000000-60020037fffff] PMD -> [fff8103ffc000000-fff8103ffc7fffff] on node 2
 [6002003800000-6002003ffffff] PMD -> [fff8103ffb800000-fff8103ffbffffff] on node 2
 [6002004000000-60020047fffff] PMD -> [fff8103ffb000000-fff8103ffb7fffff] on node 2
 [6002004800000-6002004ffffff] PMD -> [fff8103ffa800000-fff8103ffaffffff] on node 2
 [6002005000000-60020057fffff] PMD -> [fff8103ffa000000-fff8103ffa7fffff] on node 2
 [6002005800000-6002005ffffff] PMD -> [fff8103ff9800000-fff8103ff9ffffff] on node 2
 [6002006000000-60020067fffff] PMD -> [fff8103ff9000000-fff8103ff97fffff] on node 2
 [6002006800000-6002006ffffff] PMD -> [fff8103ff8800000-fff8103ff8ffffff] on node 2
 [6002007000000-60020077fffff] PMD -> [fff8103ff8000000-fff8103ff87fffff] on node 2
 [6002007800000-6002007ffffff] PMD -> [fff8103ff7800000-fff8103ff7ffffff] on node 2
 [6002008000000-60020087fffff] PMD -> [fff8103ff7000000-fff8103ff77fffff] on node 2
 [6002008800000-6002008ffffff] PMD -> [fff8103ff6800000-fff8103ff6ffffff] on node 2
 [6002009000000-60020097fffff] PMD -> [fff8103ff6000000-fff8103ff67fffff] on node 2
 [6002009800000-6002009ffffff] PMD -> [fff8103ff5800000-fff8103ff5ffffff] on node 2
 [600200a000000-600200a7fffff] PMD -> [fff8103ff5000000-fff8103ff57fffff] on node 2
 [600200a800000-600200affffff] PMD -> [fff8103ff4800000-fff8103ff4ffffff] on node 2
 [600200b000000-600200b7fffff] PMD -> [fff8103ff4000000-fff8103ff47fffff] on node 2
 [600200b800000-600200bffffff] PMD -> [fff8103ff3800000-fff8103ff3ffffff] on node 2
 [600200c000000-600200c7fffff] PMD -> [fff8103ff3000000-fff8103ff37fffff] on node 2
 [600200c800000-600200cffffff] PMD -> [fff8103ff2800000-fff8103ff2ffffff] on node 2
 [600200d000000-600200d7fffff] PMD -> [fff8103ff2000000-fff8103ff27fffff] on node 2
 [600200d800000-600200dffffff] PMD -> [fff8103ff1800000-fff8103ff1ffffff] on node 2
 [600200e000000-600200e7fffff] PMD -> [fff8103ff1000000-fff8103ff17fffff] on node 2
 [600200e800000-600200effffff] PMD -> [fff8103ff0800000-fff8103ff0ffffff] on node 2
 [600200f000000-600200f7fffff] PMD -> [fff8103ff0000000-fff8103ff07fffff] on node 2
 [600200f800000-600200fffffff] PMD -> [fff8103fef800000-fff8103fefffffff] on node 2
 [6002010000000-60020107fffff] PMD -> [fff8103fef000000-fff8103fef7fffff] on node 2
 [6002010800000-6002010ffffff] PMD -> [fff8103fee800000-fff8103feeffffff] on node 2
 [6002011000000-60020117fffff] PMD -> [fff8103fee000000-fff8103fee7fffff] on node 2
 [6002011800000-6002011ffffff] PMD -> [fff8103fed800000-fff8103fedffffff] on node 2
 [6002012000000-60020127fffff] PMD -> [fff8103fed000000-fff8103fed7fffff] on node 2
 [6002012800000-6002012ffffff] PMD -> [fff8103fec800000-fff8103fecffffff] on node 2
 [6002013000000-60020137fffff] PMD -> [fff8103fec000000-fff8103fec7fffff] on node 2
 [6002013800000-6002013ffffff] PMD -> [fff8103feb800000-fff8103febffffff] on node 2
 [6002014000000-60020147fffff] PMD -> [fff8103feb000000-fff8103feb7fffff] on node 2
 [6002014800000-6002014ffffff] PMD -> [fff8103fea800000-fff8103feaffffff] on node 2
 [6002015000000-60020157fffff] PMD -> [fff8103fea000000-fff8103fea7fffff] on node 2
 [6002015800000-6002015ffffff] PMD -> [fff8103fe9800000-fff8103fe9ffffff] on node 2
 [6002016000000-60020167fffff] PMD -> [fff8103fe9000000-fff8103fe97fffff] on node 2
 [6002016800000-6002016ffffff] PMD -> [fff8103fe8800000-fff8103fe8ffffff] on node 2
 [6002017000000-60020177fffff] PMD -> [fff8103fe8000000-fff8103fe87fffff] on node 2
 [6002017800000-6002017ffffff] PMD -> [fff8103fe7800000-fff8103fe7ffffff] on node 2
 [6002018000000-60020187fffff] PMD -> [fff8103fe7000000-fff8103fe77fffff] on node 2
 [6002018800000-6002018ffffff] PMD -> [fff8103fe6800000-fff8103fe6ffffff] on node 2
 [6002019000000-60020197fffff] PMD -> [fff8103fe6000000-fff8103fe67fffff] on node 2
 [6002019800000-6002019ffffff] PMD -> [fff8103fe5800000-fff8103fe5ffffff] on node 2
 [600201a000000-600201a7fffff] PMD -> [fff8103fe5000000-fff8103fe57fffff] on node 2
 [600201a800000-600201affffff] PMD -> [fff8103fe4800000-fff8103fe4ffffff] on node 2
 [600201b000000-600201b7fffff] PMD -> [fff8103fe4000000-fff8103fe47fffff] on node 2
 [600201b800000-600201bffffff] PMD -> [fff8103fe3800000-fff8103fe3ffffff] on node 2
 [600201c000000-600201c7fffff] PMD -> [fff8103fe3000000-fff8103fe37fffff] on node 2
 [600201c800000-600201cffffff] PMD -> [fff8103fe2800000-fff8103fe2ffffff] on node 2
 [600201d000000-600201d7fffff] PMD -> [fff8103fe2000000-fff8103fe27fffff] on node 2
 [600201d800000-600201dffffff] PMD -> [fff8103fe1800000-fff8103fe1ffffff] on node 2
 [600201e000000-600201e7fffff] PMD -> [fff8103fe1000000-fff8103fe17fffff] on node 2
 [600201e800000-600201effffff] PMD -> [fff8103fe0800000-fff8103fe0ffffff] on node 2
 [600201f000000-600201f7fffff] PMD -> [fff8103fe0000000-fff8103fe07fffff] on node 2
 [600201f800000-600201fffffff] PMD -> [fff8103fdf800000-fff8103fdfffffff] on node 2
 [6002020000000-60020207fffff] PMD -> [fff8103fdf000000-fff8103fdf7fffff] on node 2
 [6002020800000-6002020ffffff] PMD -> [fff8103fde800000-fff8103fdeffffff] on node 2
 [6002021000000-60020217fffff] PMD -> [fff8103fde000000-fff8103fde7fffff] on node 2
 [6002021800000-6002021ffffff] PMD -> [fff8103fdd800000-fff8103fddffffff] on node 2
 [6002022000000-60020227fffff] PMD -> [fff8103fdd000000-fff8103fdd7fffff] on node 2
 [6002022800000-6002022ffffff] PMD -> [fff8103fdc800000-fff8103fdcffffff] on node 2
 [6002023000000-60020237fffff] PMD -> [fff8103fdc000000-fff8103fdc7fffff] on node 2
 [6002023800000-6002023ffffff] PMD -> [fff8103fdb800000-fff8103fdbffffff] on node 2
 [6002024000000-60020247fffff] PMD -> [fff8103fdb000000-fff8103fdb7fffff] on node 2
 [6002024800000-6002024ffffff] PMD -> [fff8103fda800000-fff8103fdaffffff] on node 2
 [6002025000000-60020257fffff] PMD -> [fff8103fda000000-fff8103fda7fffff] on node 2
 [6002025800000-6002025ffffff] PMD -> [fff8103fd9800000-fff8103fd9ffffff] on node 2
 [6002026000000-60020267fffff] PMD -> [fff8103fd9000000-fff8103fd97fffff] on node 2
 [6002026800000-6002026ffffff] PMD -> [fff8103fd8800000-fff8103fd8ffffff] on node 2
 [6002027000000-60020277fffff] PMD -> [fff8103fd8000000-fff8103fd87fffff] on node 2
 [6002027800000-6002027ffffff] PMD -> [fff8103fd7800000-fff8103fd7ffffff] on node 2
 [6002028000000-60020287fffff] PMD -> [fff8103fd7000000-fff8103fd77fffff] on node 2
 [6002028800000-6002028ffffff] PMD -> [fff8103fd6800000-fff8103fd6ffffff] on node 2
 [6002029000000-60020297fffff] PMD -> [fff8103fd6000000-fff8103fd67fffff] on node 2
 [6002029800000-6002029ffffff] PMD -> [fff8103fd5800000-fff8103fd5ffffff] on node 2
 [600202a000000-600202a7fffff] PMD -> [fff8103fd5000000-fff8103fd57fffff] on node 2
 [600202a800000-600202affffff] PMD -> [fff8103fd4800000-fff8103fd4ffffff] on node 2
 [600202b000000-600202b7fffff] PMD -> [fff8103fd4000000-fff8103fd47fffff] on node 2
 [600202b800000-600202bffffff] PMD -> [fff8103fd3800000-fff8103fd3ffffff] on node 2
 [600202c000000-600202c7fffff] PMD -> [fff8103fd3000000-fff8103fd37fffff] on node 2
 [600202c800000-600202cffffff] PMD -> [fff8103fd2800000-fff8103fd2ffffff] on node 2
 [600202d000000-600202d7fffff] PMD -> [fff8103fd2000000-fff8103fd27fffff] on node 2
 [600202d800000-600202dffffff] PMD -> [fff8103fd1800000-fff8103fd1ffffff] on node 2
 [600202e000000-600202e7fffff] PMD -> [fff8103fd1000000-fff8103fd17fffff] on node 2
 [600202e800000-600202effffff] PMD -> [fff8103fd0800000-fff8103fd0ffffff] on node 2
 [600202f000000-600202f7fffff] PMD -> [fff8103fd0000000-fff8103fd07fffff] on node 2
 [600202f800000-600202fffffff] PMD -> [fff8103fcf800000-fff8103fcfffffff] on node 2
 [6002030000000-60020307fffff] PMD -> [fff8103fcf000000-fff8103fcf7fffff] on node 2
 [6002030800000-6002030ffffff] PMD -> [fff8103fce800000-fff8103fceffffff] on node 2
 [6002031000000-60020317fffff] PMD -> [fff8103fce000000-fff8103fce7fffff] on node 2
 [6002031800000-6002031ffffff] PMD -> [fff8103fcd800000-fff8103fcdffffff] on node 2
 [6002032000000-60020327fffff] PMD -> [fff8103fcd000000-fff8103fcd7fffff] on node 2
 [6002032800000-6002032ffffff] PMD -> [fff8103fcc800000-fff8103fccffffff] on node 2
 [6002033000000-60020337fffff] PMD -> [fff8103fcc000000-fff8103fcc7fffff] on node 2
 [6002033800000-6002033ffffff] PMD -> [fff8103fcb800000-fff8103fcbffffff] on node 2
 [6002034000000-60020347fffff] PMD -> [fff8103fcb000000-fff8103fcb7fffff] on node 2
 [6002034800000-6002034ffffff] PMD -> [fff8103fca800000-fff8103fcaffffff] on node 2
 [6002035000000-60020357fffff] PMD -> [fff8103fca000000-fff8103fca7fffff] on node 2
 [6002035800000-6002035ffffff] PMD -> [fff8103fc9800000-fff8103fc9ffffff] on node 2
 [6002036000000-60020367fffff] PMD -> [fff8103fc9000000-fff8103fc97fffff] on node 2
 [6002036800000-6002036ffffff] PMD -> [fff8103fc8800000-fff8103fc8ffffff] on node 2
 [6002037000000-60020377fffff] PMD -> [fff8103fc8000000-fff8103fc87fffff] on node 2
 [6002037800000-6002037ffffff] PMD -> [fff8103fc7800000-fff8103fc7ffffff] on node 2
 [6002038000000-60020387fffff] PMD -> [fff8103fc7000000-fff8103fc77fffff] on node 2
 [6002038800000-6002038ffffff] PMD -> [fff8103fc6800000-fff8103fc6ffffff] on node 2
 [6002039000000-60020397fffff] PMD -> [fff8103fc6000000-fff8103fc67fffff] on node 2
 [6002039800000-6002039ffffff] PMD -> [fff8103fc5800000-fff8103fc5ffffff] on node 2
 [600203a000000-600203a7fffff] PMD -> [fff8103fc5000000-fff8103fc57fffff] on node 2
 [600203a800000-600203affffff] PMD -> [fff8103fc4800000-fff8103fc4ffffff] on node 2
 [600203b000000-600203b7fffff] PMD -> [fff8103fc4000000-fff8103fc47fffff] on node 2
 [600203b800000-600203bffffff] PMD -> [fff8103fc3800000-fff8103fc3ffffff] on node 2
 [600203c000000-600203c7fffff] PMD -> [fff8103fc3000000-fff8103fc37fffff] on node 2
 [600203c800000-600203cffffff] PMD -> [fff8103fc2800000-fff8103fc2ffffff] on node 2
 [600203d000000-600203d7fffff] PMD -> [fff8103fc2000000-fff8103fc27fffff] on node 2
 [600203d800000-600203dffffff] PMD -> [fff8103fc1800000-fff8103fc1ffffff] on node 2
 [600203e000000-600203e7fffff] PMD -> [fff8103fc1000000-fff8103fc17fffff] on node 2
 [600203e800000-600203effffff] PMD -> [fff8103fc0800000-fff8103fc0ffffff] on node 2
 [600203f000000-600203f7fffff] PMD -> [fff8103fc0000000-fff8103fc07fffff] on node 2
 [600203f800000-600203fffffff] PMD -> [fff8103fbf800000-fff8103fbfffffff] on node 2
 [6002040000000-60020407fffff] PMD -> [fff8103fbf000000-fff8103fbf7fffff] on node 2
 [6002040800000-6002040ffffff] PMD -> [fff8103fbe800000-fff8103fbeffffff] on node 2
 [6002041000000-60020417fffff] PMD -> [fff8103fbe000000-fff8103fbe7fffff] on node 2
 [6002041800000-6002041ffffff] PMD -> [fff8103fbd800000-fff8103fbdffffff] on node 2
 [6002042000000-60020427fffff] PMD -> [fff8103fbd000000-fff8103fbd7fffff] on node 2
 [6002042800000-6002042ffffff] PMD -> [fff8103fbc800000-fff8103fbcffffff] on node 2
 [6002043000000-60020437fffff] PMD -> [fff8103fbc000000-fff8103fbc7fffff] on node 2
 [6002043800000-6002043ffffff] PMD -> [fff8103fbb800000-fff8103fbbffffff] on node 2
 [6002044000000-60020447fffff] PMD -> [fff8103fbb000000-fff8103fbb7fffff] on node 2
 [6002044800000-6002044ffffff] PMD -> [fff8103fba800000-fff8103fbaffffff] on node 2
 [6002045000000-60020457fffff] PMD -> [fff8103fba000000-fff8103fba7fffff] on node 2
 [6002045800000-6002045ffffff] PMD -> [fff8103fb9800000-fff8103fb9ffffff] on node 2
 [6002046000000-60020467fffff] PMD -> [fff8103fb9000000-fff8103fb97fffff] on node 2
 [6002046800000-6002046ffffff] PMD -> [fff8103fb8800000-fff8103fb8ffffff] on node 2
 [6002047000000-60020477fffff] PMD -> [fff8103fb8000000-fff8103fb87fffff] on node 2
 [6002047800000-6002047ffffff] PMD -> [fff8103fb7800000-fff8103fb7ffffff] on node 2
 [6002048000000-60020487fffff] PMD -> [fff8103fb7000000-fff8103fb77fffff] on node 2
 [6002048800000-6002048ffffff] PMD -> [fff8103fb6800000-fff8103fb6ffffff] on node 2
 [6002049000000-60020497fffff] PMD -> [fff8103fb6000000-fff8103fb67fffff] on node 2
 [6002049800000-6002049ffffff] PMD -> [fff8103fb5800000-fff8103fb5ffffff] on node 2
 [600204a000000-600204a7fffff] PMD -> [fff8103fb5000000-fff8103fb57fffff] on node 2
 [600204a800000-600204affffff] PMD -> [fff8103fb4800000-fff8103fb4ffffff] on node 2
 [600204b000000-600204b7fffff] PMD -> [fff8103fb4000000-fff8103fb47fffff] on node 2
 [600204b800000-600204bffffff] PMD -> [fff8103fb3800000-fff8103fb3ffffff] on node 2
 [600204c000000-600204c7fffff] PMD -> [fff8103fb3000000-fff8103fb37fffff] on node 2
 [600204c800000-600204cffffff] PMD -> [fff8103fb2800000-fff8103fb2ffffff] on node 2
 [600204d000000-600204d7fffff] PMD -> [fff8103fb2000000-fff8103fb27fffff] on node 2
 [600204d800000-600204dffffff] PMD -> [fff8103fb1800000-fff8103fb1ffffff] on node 2
 [600204e000000-600204e7fffff] PMD -> [fff8103fb1000000-fff8103fb17fffff] on node 2
 [600204e800000-600204effffff] PMD -> [fff8103fb0800000-fff8103fb0ffffff] on node 2
 [600204f000000-600204f7fffff] PMD -> [fff8103fb0000000-fff8103fb07fffff] on node 2
 [600204f800000-600204fffffff] PMD -> [fff8103faf800000-fff8103fafffffff] on node 2
 [6002050000000-60020507fffff] PMD -> [fff8103faf000000-fff8103faf7fffff] on node 2
 [6002050800000-6002050ffffff] PMD -> [fff8103fae800000-fff8103faeffffff] on node 2
 [6002051000000-60020517fffff] PMD -> [fff8103fae000000-fff8103fae7fffff] on node 2
 [6002051800000-6002051ffffff] PMD -> [fff8103fad800000-fff8103fadffffff] on node 2
 [6002052000000-60020527fffff] PMD -> [fff8103fad000000-fff8103fad7fffff] on node 2
 [6002052800000-6002052ffffff] PMD -> [fff8103fac800000-fff8103facffffff] on node 2
 [6002053000000-60020537fffff] PMD -> [fff8103fac000000-fff8103fac7fffff] on node 2
 [6002053800000-6002053ffffff] PMD -> [fff8103fab800000-fff8103fabffffff] on node 2
 [6002054000000-60020547fffff] PMD -> [fff8103fab000000-fff8103fab7fffff] on node 2
 [6002054800000-6002054ffffff] PMD -> [fff8103faa800000-fff8103faaffffff] on node 2
 [6002055000000-60020557fffff] PMD -> [fff8103faa000000-fff8103faa7fffff] on node 2
 [6002055800000-6002055ffffff] PMD -> [fff8103fa9800000-fff8103fa9ffffff] on node 2
 [6002056000000-60020567fffff] PMD -> [fff8103fa9000000-fff8103fa97fffff] on node 2
 [6002056800000-6002056ffffff] PMD -> [fff8103fa8800000-fff8103fa8ffffff] on node 2
 [6002057000000-60020577fffff] PMD -> [fff8103fa8000000-fff8103fa87fffff] on node 2
 [6002057800000-6002057ffffff] PMD -> [fff8103fa7800000-fff8103fa7ffffff] on node 2
 [6002058000000-60020587fffff] PMD -> [fff8103fa7000000-fff8103fa77fffff] on node 2
 [6002058800000-6002058ffffff] PMD -> [fff8103fa6800000-fff8103fa6ffffff] on node 2
 [6002059000000-60020597fffff] PMD -> [fff8103fa6000000-fff8103fa67fffff] on node 2
 [6002059800000-6002059ffffff] PMD -> [fff8103fa5800000-fff8103fa5ffffff] on node 2
 [600205a000000-600205a7fffff] PMD -> [fff8103fa5000000-fff8103fa57fffff] on node 2
 [600205a800000-600205affffff] PMD -> [fff8103fa4800000-fff8103fa4ffffff] on node 2
 [600205b000000-600205b7fffff] PMD -> [fff8103fa4000000-fff8103fa47fffff] on node 2
 [600205b800000-600205bffffff] PMD -> [fff8103fa3800000-fff8103fa3ffffff] on node 2
 [600205c000000-600205c7fffff] PMD -> [fff8103fa3000000-fff8103fa37fffff] on node 2
 [600205c800000-600205cffffff] PMD -> [fff8103fa2800000-fff8103fa2ffffff] on node 2
 [600205d000000-600205d7fffff] PMD -> [fff8103fa2000000-fff8103fa27fffff] on node 2
 [600205d800000-600205dffffff] PMD -> [fff8103fa1800000-fff8103fa1ffffff] on node 2
 [600205e000000-600205e7fffff] PMD -> [fff8103fa1000000-fff8103fa17fffff] on node 2
 [600205e800000-600205effffff] PMD -> [fff8103fa0800000-fff8103fa0ffffff] on node 2
 [600205f000000-600205f7fffff] PMD -> [fff8103fa0000000-fff8103fa07fffff] on node 2
 [600205f800000-600205fffffff] PMD -> [fff8103f9f800000-fff8103f9fffffff] on node 2
 [6002060000000-60020607fffff] PMD -> [fff8103f9f000000-fff8103f9f7fffff] on node 2
 [6002060800000-6002060ffffff] PMD -> [fff8103f9e800000-fff8103f9effffff] on node 2
 [6002061000000-60020617fffff] PMD -> [fff8103f9e000000-fff8103f9e7fffff] on node 2
 [6002061800000-6002061ffffff] PMD -> [fff8103f9d800000-fff8103f9dffffff] on node 2
 [6002062000000-60020627fffff] PMD -> [fff8103f9d000000-fff8103f9d7fffff] on node 2
 [6002062800000-6002062ffffff] PMD -> [fff8103f9c800000-fff8103f9cffffff] on node 2
 [6002063000000-60020637fffff] PMD -> [fff8103f9c000000-fff8103f9c7fffff] on node 2
 [6002063800000-6002063ffffff] PMD -> [fff8103f9b800000-fff8103f9bffffff] on node 2
 [6002064000000-60020647fffff] PMD -> [fff8103f9b000000-fff8103f9b7fffff] on node 2
 [6002064800000-6002064ffffff] PMD -> [fff8103f9a800000-fff8103f9affffff] on node 2
 [6002065000000-60020657fffff] PMD -> [fff8103f9a000000-fff8103f9a7fffff] on node 2
 [6002065800000-6002065ffffff] PMD -> [fff8103f99800000-fff8103f99ffffff] on node 2
 [6002066000000-60020667fffff] PMD -> [fff8103f99000000-fff8103f997fffff] on node 2
 [6002066800000-6002066ffffff] PMD -> [fff8103f98800000-fff8103f98ffffff] on node 2
 [6002067000000-60020677fffff] PMD -> [fff8103f98000000-fff8103f987fffff] on node 2
 [6002067800000-6002067ffffff] PMD -> [fff8103f97800000-fff8103f97ffffff] on node 2
 [6002068000000-60020687fffff] PMD -> [fff8103f97000000-fff8103f977fffff] on node 2
 [6002068800000-6002068ffffff] PMD -> [fff8103f96800000-fff8103f96ffffff] on node 2
 [6002069000000-60020697fffff] PMD -> [fff8103f96000000-fff8103f967fffff] on node 2
 [6002069800000-6002069ffffff] PMD -> [fff8103f95800000-fff8103f95ffffff] on node 2
 [600206a000000-600206a7fffff] PMD -> [fff8103f95000000-fff8103f957fffff] on node 2
 [600206a800000-600206affffff] PMD -> [fff8103f94800000-fff8103f94ffffff] on node 2
 [600206b000000-600206b7fffff] PMD -> [fff8103f94000000-fff8103f947fffff] on node 2
 [600206b800000-600206bffffff] PMD -> [fff8103f93800000-fff8103f93ffffff] on node 2
 [600206c000000-600206c7fffff] PMD -> [fff8103f93000000-fff8103f937fffff] on node 2
 [600206c800000-600206cffffff] PMD -> [fff8103f92800000-fff8103f92ffffff] on node 2
 [600206d000000-600206d7fffff] PMD -> [fff8103f92000000-fff8103f927fffff] on node 2
 [600206d800000-600206dffffff] PMD -> [fff8103f91800000-fff8103f91ffffff] on node 2
 [600206e000000-600206e7fffff] PMD -> [fff8103f91000000-fff8103f917fffff] on node 2
 [600206e800000-600206effffff] PMD -> [fff8103f90800000-fff8103f90ffffff] on node 2
 [600206f000000-600206f7fffff] PMD -> [fff8103f90000000-fff8103f907fffff] on node 2
 [600206f800000-600206fffffff] PMD -> [fff8103f8f800000-fff8103f8fffffff] on node 2
 [6002070000000-60020707fffff] PMD -> [fff8103f8f000000-fff8103f8f7fffff] on node 2
 [6002070800000-6002070ffffff] PMD -> [fff8103f8e800000-fff8103f8effffff] on node 2
 [6002071000000-60020717fffff] PMD -> [fff8103f8e000000-fff8103f8e7fffff] on node 2
 [6002071800000-6002071ffffff] PMD -> [fff8103f8d800000-fff8103f8dffffff] on node 2
 [6002072000000-60020727fffff] PMD -> [fff8103f8d000000-fff8103f8d7fffff] on node 2
 [6002072800000-6002072ffffff] PMD -> [fff8103f8c800000-fff8103f8cffffff] on node 2
 [6002073000000-60020737fffff] PMD -> [fff8103f8c000000-fff8103f8c7fffff] on node 2
 [6002073800000-6002073ffffff] PMD -> [fff8103f8b800000-fff8103f8bffffff] on node 2
 [6002074000000-60020747fffff] PMD -> [fff8103f8b000000-fff8103f8b7fffff] on node 2
 [6002074800000-6002074ffffff] PMD -> [fff8103f8a800000-fff8103f8affffff] on node 2
 [6002075000000-60020757fffff] PMD -> [fff8103f8a000000-fff8103f8a7fffff] on node 2
 [6002075800000-6002075ffffff] PMD -> [fff8103f89800000-fff8103f89ffffff] on node 2
 [6002076000000-60020767fffff] PMD -> [fff8103f89000000-fff8103f897fffff] on node 2
 [6002076800000-6002076ffffff] PMD -> [fff8103f88800000-fff8103f88ffffff] on node 2
 [6002077000000-60020777fffff] PMD -> [fff8103f88000000-fff8103f887fffff] on node 2
 [6002077800000-6002077ffffff] PMD -> [fff8103f87800000-fff8103f87ffffff] on node 2
 [6002078000000-60020787fffff] PMD -> [fff8103f87000000-fff8103f877fffff] on node 2
 [6002078800000-6002078ffffff] PMD -> [fff8103f86800000-fff8103f86ffffff] on node 2
 [6002079000000-60020797fffff] PMD -> [fff8103f86000000-fff8103f867fffff] on node 2
 [6002079800000-6002079ffffff] PMD -> [fff8103f85800000-fff8103f85ffffff] on node 2
 [600207a000000-600207a7fffff] PMD -> [fff8103f85000000-fff8103f857fffff] on node 2
 [600207a800000-600207affffff] PMD -> [fff8103f84800000-fff8103f84ffffff] on node 2
 [600207b000000-600207b7fffff] PMD -> [fff8103f84000000-fff8103f847fffff] on node 2
 [600207b800000-600207bffffff] PMD -> [fff8103f83800000-fff8103f83ffffff] on node 2
 [600207c000000-600207c7fffff] PMD -> [fff8103f83000000-fff8103f837fffff] on node 2
 [600207c800000-600207cffffff] PMD -> [fff8103f82800000-fff8103f82ffffff] on node 2
 [600207d000000-600207d7fffff] PMD -> [fff8103f82000000-fff8103f827fffff] on node 2
 [600207d800000-600207dffffff] PMD -> [fff8103f81800000-fff8103f81ffffff] on node 2
 [600207e000000-600207e7fffff] PMD -> [fff8103f81000000-fff8103f817fffff] on node 2
 [600207e800000-600207effffff] PMD -> [fff8103f80800000-fff8103f80ffffff] on node 2
 [600207f000000-600207f7fffff] PMD -> [fff8103f80000000-fff8103f807fffff] on node 2
 [600207f800000-600207fffffff] PMD -> [fff8103f7f800000-fff8103f7fffffff] on node 2
 [6003000000000-60030007fffff] PMD -> [fff8183fff000000-fff8183fff7fffff] on node 3
 [6003000800000-6003000ffffff] PMD -> [fff8183ffe800000-fff8183ffeffffff] on node 3
 [6003001000000-60030017fffff] PMD -> [fff8183ffe000000-fff8183ffe7fffff] on node 3
 [6003001800000-6003001ffffff] PMD -> [fff8183ffd800000-fff8183ffdffffff] on node 3
 [6003002000000-60030027fffff] PMD -> [fff8183ffd000000-fff8183ffd7fffff] on node 3
 [6003002800000-6003002ffffff] PMD -> [fff8183ffc800000-fff8183ffcffffff] on node 3
 [6003003000000-60030037fffff] PMD -> [fff8183ffc000000-fff8183ffc7fffff] on node 3
 [6003003800000-6003003ffffff] PMD -> [fff8183ffb800000-fff8183ffbffffff] on node 3
 [6003004000000-60030047fffff] PMD -> [fff8183ffb000000-fff8183ffb7fffff] on node 3
 [6003004800000-6003004ffffff] PMD -> [fff8183ffa800000-fff8183ffaffffff] on node 3
 [6003005000000-60030057fffff] PMD -> [fff8183ffa000000-fff8183ffa7fffff] on node 3
 [6003005800000-6003005ffffff] PMD -> [fff8183ff9800000-fff8183ff9ffffff] on node 3
 [6003006000000-60030067fffff] PMD -> [fff8183ff9000000-fff8183ff97fffff] on node 3
 [6003006800000-6003006ffffff] PMD -> [fff8183ff8800000-fff8183ff8ffffff] on node 3
 [6003007000000-60030077fffff] PMD -> [fff8183ff8000000-fff8183ff87fffff] on node 3
 [6003007800000-6003007ffffff] PMD -> [fff8183ff7800000-fff8183ff7ffffff] on node 3
 [6003008000000-60030087fffff] PMD -> [fff8183ff7000000-fff8183ff77fffff] on node 3
 [6003008800000-6003008ffffff] PMD -> [fff8183ff6800000-fff8183ff6ffffff] on node 3
 [6003009000000-60030097fffff] PMD -> [fff8183ff6000000-fff8183ff67fffff] on node 3
 [6003009800000-6003009ffffff] PMD -> [fff8183ff5800000-fff8183ff5ffffff] on node 3
 [600300a000000-600300a7fffff] PMD -> [fff8183ff5000000-fff8183ff57fffff] on node 3
 [600300a800000-600300affffff] PMD -> [fff8183ff4800000-fff8183ff4ffffff] on node 3
 [600300b000000-600300b7fffff] PMD -> [fff8183ff4000000-fff8183ff47fffff] on node 3
 [600300b800000-600300bffffff] PMD -> [fff8183ff3800000-fff8183ff3ffffff] on node 3
 [600300c000000-600300c7fffff] PMD -> [fff8183ff3000000-fff8183ff37fffff] on node 3
 [600300c800000-600300cffffff] PMD -> [fff8183ff2800000-fff8183ff2ffffff] on node 3
 [600300d000000-600300d7fffff] PMD -> [fff8183ff2000000-fff8183ff27fffff] on node 3
 [600300d800000-600300dffffff] PMD -> [fff8183ff1800000-fff8183ff1ffffff] on node 3
 [600300e000000-600300e7fffff] PMD -> [fff8183ff1000000-fff8183ff17fffff] on node 3
 [600300e800000-600300effffff] PMD -> [fff8183ff0800000-fff8183ff0ffffff] on node 3
 [600300f000000-600300f7fffff] PMD -> [fff8183ff0000000-fff8183ff07fffff] on node 3
 [600300f800000-600300fffffff] PMD -> [fff8183fef800000-fff8183fefffffff] on node 3
 [6003010000000-60030107fffff] PMD -> [fff8183fef000000-fff8183fef7fffff] on node 3
 [6003010800000-6003010ffffff] PMD -> [fff8183fee800000-fff8183feeffffff] on node 3
 [6003011000000-60030117fffff] PMD -> [fff8183fee000000-fff8183fee7fffff] on node 3
 [6003011800000-6003011ffffff] PMD -> [fff8183fed800000-fff8183fedffffff] on node 3
 [6003012000000-60030127fffff] PMD -> [fff8183fed000000-fff8183fed7fffff] on node 3
 [6003012800000-6003012ffffff] PMD -> [fff8183fec800000-fff8183fecffffff] on node 3
 [6003013000000-60030137fffff] PMD -> [fff8183fec000000-fff8183fec7fffff] on node 3
 [6003013800000-6003013ffffff] PMD -> [fff8183feb800000-fff8183febffffff] on node 3
 [6003014000000-60030147fffff] PMD -> [fff8183feb000000-fff8183feb7fffff] on node 3
 [6003014800000-6003014ffffff] PMD -> [fff8183fea800000-fff8183feaffffff] on node 3
 [6003015000000-60030157fffff] PMD -> [fff8183fea000000-fff8183fea7fffff] on node 3
 [6003015800000-6003015ffffff] PMD -> [fff8183fe9800000-fff8183fe9ffffff] on node 3
 [6003016000000-60030167fffff] PMD -> [fff8183fe9000000-fff8183fe97fffff] on node 3
 [6003016800000-6003016ffffff] PMD -> [fff8183fe8800000-fff8183fe8ffffff] on node 3
 [6003017000000-60030177fffff] PMD -> [fff8183fe8000000-fff8183fe87fffff] on node 3
 [6003017800000-6003017ffffff] PMD -> [fff8183fe7800000-fff8183fe7ffffff] on node 3
 [6003018000000-60030187fffff] PMD -> [fff8183fe7000000-fff8183fe77fffff] on node 3
 [6003018800000-6003018ffffff] PMD -> [fff8183fe6800000-fff8183fe6ffffff] on node 3
 [6003019000000-60030197fffff] PMD -> [fff8183fe6000000-fff8183fe67fffff] on node 3
 [6003019800000-6003019ffffff] PMD -> [fff8183fe5800000-fff8183fe5ffffff] on node 3
 [600301a000000-600301a7fffff] PMD -> [fff8183fe5000000-fff8183fe57fffff] on node 3
 [600301a800000-600301affffff] PMD -> [fff8183fe4800000-fff8183fe4ffffff] on node 3
 [600301b000000-600301b7fffff] PMD -> [fff8183fe4000000-fff8183fe47fffff] on node 3
 [600301b800000-600301bffffff] PMD -> [fff8183fe3800000-fff8183fe3ffffff] on node 3
 [600301c000000-600301c7fffff] PMD -> [fff8183fe3000000-fff8183fe37fffff] on node 3
 [600301c800000-600301cffffff] PMD -> [fff8183fe2800000-fff8183fe2ffffff] on node 3
 [600301d000000-600301d7fffff] PMD -> [fff8183fe2000000-fff8183fe27fffff] on node 3
 [600301d800000-600301dffffff] PMD -> [fff8183fe1800000-fff8183fe1ffffff] on node 3
 [600301e000000-600301e7fffff] PMD -> [fff8183fe1000000-fff8183fe17fffff] on node 3
 [600301e800000-600301effffff] PMD -> [fff8183fe0800000-fff8183fe0ffffff] on node 3
 [600301f000000-600301f7fffff] PMD -> [fff8183fe0000000-fff8183fe07fffff] on node 3
 [600301f800000-600301fffffff] PMD -> [fff8183fdf800000-fff8183fdfffffff] on node 3
 [6003020000000-60030207fffff] PMD -> [fff8183fdf000000-fff8183fdf7fffff] on node 3
 [6003020800000-6003020ffffff] PMD -> [fff8183fde800000-fff8183fdeffffff] on node 3
 [6003021000000-60030217fffff] PMD -> [fff8183fde000000-fff8183fde7fffff] on node 3
 [6003021800000-6003021ffffff] PMD -> [fff8183fdd800000-fff8183fddffffff] on node 3
 [6003022000000-60030227fffff] PMD -> [fff8183fdd000000-fff8183fdd7fffff] on node 3
 [6003022800000-6003022ffffff] PMD -> [fff8183fdc800000-fff8183fdcffffff] on node 3
 [6003023000000-60030237fffff] PMD -> [fff8183fdc000000-fff8183fdc7fffff] on node 3
 [6003023800000-6003023ffffff] PMD -> [fff8183fdb800000-fff8183fdbffffff] on node 3
 [6003024000000-60030247fffff] PMD -> [fff8183fdb000000-fff8183fdb7fffff] on node 3
 [6003024800000-6003024ffffff] PMD -> [fff8183fda800000-fff8183fdaffffff] on node 3
 [6003025000000-60030257fffff] PMD -> [fff8183fda000000-fff8183fda7fffff] on node 3
 [6003025800000-6003025ffffff] PMD -> [fff8183fd9800000-fff8183fd9ffffff] on node 3
 [6003026000000-60030267fffff] PMD -> [fff8183fd9000000-fff8183fd97fffff] on node 3
 [6003026800000-6003026ffffff] PMD -> [fff8183fd8800000-fff8183fd8ffffff] on node 3
 [6003027000000-60030277fffff] PMD -> [fff8183fd8000000-fff8183fd87fffff] on node 3
 [6003027800000-6003027ffffff] PMD -> [fff8183fd7800000-fff8183fd7ffffff] on node 3
 [6003028000000-60030287fffff] PMD -> [fff8183fd7000000-fff8183fd77fffff] on node 3
 [6003028800000-6003028ffffff] PMD -> [fff8183fd6800000-fff8183fd6ffffff] on node 3
 [6003029000000-60030297fffff] PMD -> [fff8183fd6000000-fff8183fd67fffff] on node 3
 [6003029800000-6003029ffffff] PMD -> [fff8183fd5800000-fff8183fd5ffffff] on node 3
 [600302a000000-600302a7fffff] PMD -> [fff8183fd5000000-fff8183fd57fffff] on node 3
 [600302a800000-600302affffff] PMD -> [fff8183fd4800000-fff8183fd4ffffff] on node 3
 [600302b000000-600302b7fffff] PMD -> [fff8183fd4000000-fff8183fd47fffff] on node 3
 [600302b800000-600302bffffff] PMD -> [fff8183fd3800000-fff8183fd3ffffff] on node 3
 [600302c000000-600302c7fffff] PMD -> [fff8183fd3000000-fff8183fd37fffff] on node 3
 [600302c800000-600302cffffff] PMD -> [fff8183fd2800000-fff8183fd2ffffff] on node 3
 [600302d000000-600302d7fffff] PMD -> [fff8183fd2000000-fff8183fd27fffff] on node 3
 [600302d800000-600302dffffff] PMD -> [fff8183fd1800000-fff8183fd1ffffff] on node 3
 [600302e000000-600302e7fffff] PMD -> [fff8183fd1000000-fff8183fd17fffff] on node 3
 [600302e800000-600302effffff] PMD -> [fff8183fd0800000-fff8183fd0ffffff] on node 3
 [600302f000000-600302f7fffff] PMD -> [fff8183fd0000000-fff8183fd07fffff] on node 3
 [600302f800000-600302fffffff] PMD -> [fff8183fcf800000-fff8183fcfffffff] on node 3
 [6003030000000-60030307fffff] PMD -> [fff8183fcf000000-fff8183fcf7fffff] on node 3
 [6003030800000-6003030ffffff] PMD -> [fff8183fce800000-fff8183fceffffff] on node 3
 [6003031000000-60030317fffff] PMD -> [fff8183fce000000-fff8183fce7fffff] on node 3
 [6003031800000-6003031ffffff] PMD -> [fff8183fcd800000-fff8183fcdffffff] on node 3
 [6003032000000-60030327fffff] PMD -> [fff8183fcd000000-fff8183fcd7fffff] on node 3
 [6003032800000-6003032ffffff] PMD -> [fff8183fcc800000-fff8183fccffffff] on node 3
 [6003033000000-60030337fffff] PMD -> [fff8183fcc000000-fff8183fcc7fffff] on node 3
 [6003033800000-6003033ffffff] PMD -> [fff8183fcb800000-fff8183fcbffffff] on node 3
 [6003034000000-60030347fffff] PMD -> [fff8183fcb000000-fff8183fcb7fffff] on node 3
 [6003034800000-6003034ffffff] PMD -> [fff8183fca800000-fff8183fcaffffff] on node 3
 [6003035000000-60030357fffff] PMD -> [fff8183fca000000-fff8183fca7fffff] on node 3
 [6003035800000-6003035ffffff] PMD -> [fff8183fc9800000-fff8183fc9ffffff] on node 3
 [6003036000000-60030367fffff] PMD -> [fff8183fc9000000-fff8183fc97fffff] on node 3
 [6003036800000-6003036ffffff] PMD -> [fff8183fc8800000-fff8183fc8ffffff] on node 3
 [6003037000000-60030377fffff] PMD -> [fff8183fc8000000-fff8183fc87fffff] on node 3
 [6003037800000-6003037ffffff] PMD -> [fff8183fc7800000-fff8183fc7ffffff] on node 3
 [6003038000000-60030387fffff] PMD -> [fff8183fc7000000-fff8183fc77fffff] on node 3
 [6003038800000-6003038ffffff] PMD -> [fff8183fc6800000-fff8183fc6ffffff] on node 3
 [6003039000000-60030397fffff] PMD -> [fff8183fc6000000-fff8183fc67fffff] on node 3
 [6003039800000-6003039ffffff] PMD -> [fff8183fc5800000-fff8183fc5ffffff] on node 3
 [600303a000000-600303a7fffff] PMD -> [fff8183fc5000000-fff8183fc57fffff] on node 3
 [600303a800000-600303affffff] PMD -> [fff8183fc4800000-fff8183fc4ffffff] on node 3
 [600303b000000-600303b7fffff] PMD -> [fff8183fc4000000-fff8183fc47fffff] on node 3
 [600303b800000-600303bffffff] PMD -> [fff8183fc3800000-fff8183fc3ffffff] on node 3
 [600303c000000-600303c7fffff] PMD -> [fff8183fc3000000-fff8183fc37fffff] on node 3
 [600303c800000-600303cffffff] PMD -> [fff8183fc2800000-fff8183fc2ffffff] on node 3
 [600303d000000-600303d7fffff] PMD -> [fff8183fc2000000-fff8183fc27fffff] on node 3
 [600303d800000-600303dffffff] PMD -> [fff8183fc1800000-fff8183fc1ffffff] on node 3
 [600303e000000-600303e7fffff] PMD -> [fff8183fc1000000-fff8183fc17fffff] on node 3
 [600303e800000-600303effffff] PMD -> [fff8183fc0800000-fff8183fc0ffffff] on node 3
 [600303f000000-600303f7fffff] PMD -> [fff8183fc0000000-fff8183fc07fffff] on node 3
 [600303f800000-600303fffffff] PMD -> [fff8183fbf800000-fff8183fbfffffff] on node 3
 [6003040000000-60030407fffff] PMD -> [fff8183fbf000000-fff8183fbf7fffff] on node 3
 [6003040800000-6003040ffffff] PMD -> [fff8183fbe800000-fff8183fbeffffff] on node 3
 [6003041000000-60030417fffff] PMD -> [fff8183fbe000000-fff8183fbe7fffff] on node 3
 [6003041800000-6003041ffffff] PMD -> [fff8183fbd800000-fff8183fbdffffff] on node 3
 [6003042000000-60030427fffff] PMD -> [fff8183fbd000000-fff8183fbd7fffff] on node 3
 [6003042800000-6003042ffffff] PMD -> [fff8183fbc800000-fff8183fbcffffff] on node 3
 [6003043000000-60030437fffff] PMD -> [fff8183fbc000000-fff8183fbc7fffff] on node 3
 [6003043800000-6003043ffffff] PMD -> [fff8183fbb800000-fff8183fbbffffff] on node 3
 [6003044000000-60030447fffff] PMD -> [fff8183fbb000000-fff8183fbb7fffff] on node 3
 [6003044800000-6003044ffffff] PMD -> [fff8183fba800000-fff8183fbaffffff] on node 3
 [6003045000000-60030457fffff] PMD -> [fff8183fba000000-fff8183fba7fffff] on node 3
 [6003045800000-6003045ffffff] PMD -> [fff8183fb9800000-fff8183fb9ffffff] on node 3
 [6003046000000-60030467fffff] PMD -> [fff8183fb9000000-fff8183fb97fffff] on node 3
 [6003046800000-6003046ffffff] PMD -> [fff8183fb8800000-fff8183fb8ffffff] on node 3
 [6003047000000-60030477fffff] PMD -> [fff8183fb8000000-fff8183fb87fffff] on node 3
 [6003047800000-6003047ffffff] PMD -> [fff8183fb7800000-fff8183fb7ffffff] on node 3
 [6003048000000-60030487fffff] PMD -> [fff8183fb7000000-fff8183fb77fffff] on node 3
 [6003048800000-6003048ffffff] PMD -> [fff8183fb6800000-fff8183fb6ffffff] on node 3
 [6003049000000-60030497fffff] PMD -> [fff8183fb6000000-fff8183fb67fffff] on node 3
 [6003049800000-6003049ffffff] PMD -> [fff8183fb5800000-fff8183fb5ffffff] on node 3
 [600304a000000-600304a7fffff] PMD -> [fff8183fb5000000-fff8183fb57fffff] on node 3
 [600304a800000-600304affffff] PMD -> [fff8183fb4800000-fff8183fb4ffffff] on node 3
 [600304b000000-600304b7fffff] PMD -> [fff8183fb4000000-fff8183fb47fffff] on node 3
 [600304b800000-600304bffffff] PMD -> [fff8183fb3800000-fff8183fb3ffffff] on node 3
 [600304c000000-600304c7fffff] PMD -> [fff8183fb3000000-fff8183fb37fffff] on node 3
 [600304c800000-600304cffffff] PMD -> [fff8183fb2800000-fff8183fb2ffffff] on node 3
 [600304d000000-600304d7fffff] PMD -> [fff8183fb2000000-fff8183fb27fffff] on node 3
 [600304d800000-600304dffffff] PMD -> [fff8183fb1800000-fff8183fb1ffffff] on node 3
 [600304e000000-600304e7fffff] PMD -> [fff8183fb1000000-fff8183fb17fffff] on node 3
 [600304e800000-600304effffff] PMD -> [fff8183fb0800000-fff8183fb0ffffff] on node 3
 [600304f000000-600304f7fffff] PMD -> [fff8183fb0000000-fff8183fb07fffff] on node 3
 [600304f800000-600304fffffff] PMD -> [fff8183faf800000-fff8183fafffffff] on node 3
 [6003050000000-60030507fffff] PMD -> [fff8183faf000000-fff8183faf7fffff] on node 3
 [6003050800000-6003050ffffff] PMD -> [fff8183fae800000-fff8183faeffffff] on node 3
 [6003051000000-60030517fffff] PMD -> [fff8183fae000000-fff8183fae7fffff] on node 3
 [6003051800000-6003051ffffff] PMD -> [fff8183fad800000-fff8183fadffffff] on node 3
 [6003052000000-60030527fffff] PMD -> [fff8183fad000000-fff8183fad7fffff] on node 3
 [6003052800000-6003052ffffff] PMD -> [fff8183fac800000-fff8183facffffff] on node 3
 [6003053000000-60030537fffff] PMD -> [fff8183fac000000-fff8183fac7fffff] on node 3
 [6003053800000-6003053ffffff] PMD -> [fff8183fab800000-fff8183fabffffff] on node 3
 [6003054000000-60030547fffff] PMD -> [fff8183fab000000-fff8183fab7fffff] on node 3
 [6003054800000-6003054ffffff] PMD -> [fff8183faa800000-fff8183faaffffff] on node 3
 [6003055000000-60030557fffff] PMD -> [fff8183faa000000-fff8183faa7fffff] on node 3
 [6003055800000-6003055ffffff] PMD -> [fff8183fa9800000-fff8183fa9ffffff] on node 3
 [6003056000000-60030567fffff] PMD -> [fff8183fa9000000-fff8183fa97fffff] on node 3
 [6003056800000-6003056ffffff] PMD -> [fff8183fa8800000-fff8183fa8ffffff] on node 3
 [6003057000000-60030577fffff] PMD -> [fff8183fa8000000-fff8183fa87fffff] on node 3
 [6003057800000-6003057ffffff] PMD -> [fff8183fa7800000-fff8183fa7ffffff] on node 3
 [6003058000000-60030587fffff] PMD -> [fff8183fa7000000-fff8183fa77fffff] on node 3
 [6003058800000-6003058ffffff] PMD -> [fff8183fa6800000-fff8183fa6ffffff] on node 3
 [6003059000000-60030597fffff] PMD -> [fff8183fa6000000-fff8183fa67fffff] on node 3
 [6003059800000-6003059ffffff] PMD -> [fff8183fa5800000-fff8183fa5ffffff] on node 3
 [600305a000000-600305a7fffff] PMD -> [fff8183fa5000000-fff8183fa57fffff] on node 3
 [600305a800000-600305affffff] PMD -> [fff8183fa4800000-fff8183fa4ffffff] on node 3
 [600305b000000-600305b7fffff] PMD -> [fff8183fa4000000-fff8183fa47fffff] on node 3
 [600305b800000-600305bffffff] PMD -> [fff8183fa3800000-fff8183fa3ffffff] on node 3
 [600305c000000-600305c7fffff] PMD -> [fff8183fa3000000-fff8183fa37fffff] on node 3
 [600305c800000-600305cffffff] PMD -> [fff8183fa2800000-fff8183fa2ffffff] on node 3
 [600305d000000-600305d7fffff] PMD -> [fff8183fa2000000-fff8183fa27fffff] on node 3
 [600305d800000-600305dffffff] PMD -> [fff8183fa1800000-fff8183fa1ffffff] on node 3
 [600305e000000-600305e7fffff] PMD -> [fff8183fa1000000-fff8183fa17fffff] on node 3
 [600305e800000-600305effffff] PMD -> [fff8183fa0800000-fff8183fa0ffffff] on node 3
 [600305f000000-600305f7fffff] PMD -> [fff8183fa0000000-fff8183fa07fffff] on node 3
 [600305f800000-600305fffffff] PMD -> [fff8183f9f800000-fff8183f9fffffff] on node 3
 [6003060000000-60030607fffff] PMD -> [fff8183f9f000000-fff8183f9f7fffff] on node 3
 [6003060800000-6003060ffffff] PMD -> [fff8183f9e800000-fff8183f9effffff] on node 3
 [6003061000000-60030617fffff] PMD -> [fff8183f9e000000-fff8183f9e7fffff] on node 3
 [6003061800000-6003061ffffff] PMD -> [fff8183f9d800000-fff8183f9dffffff] on node 3
 [6003062000000-60030627fffff] PMD -> [fff8183f9d000000-fff8183f9d7fffff] on node 3
 [6003062800000-6003062ffffff] PMD -> [fff8183f9c800000-fff8183f9cffffff] on node 3
 [6003063000000-60030637fffff] PMD -> [fff8183f9c000000-fff8183f9c7fffff] on node 3
 [6003063800000-6003063ffffff] PMD -> [fff8183f9b800000-fff8183f9bffffff] on node 3
 [6003064000000-60030647fffff] PMD -> [fff8183f9b000000-fff8183f9b7fffff] on node 3
 [6003064800000-6003064ffffff] PMD -> [fff8183f9a800000-fff8183f9affffff] on node 3
 [6003065000000-60030657fffff] PMD -> [fff8183f9a000000-fff8183f9a7fffff] on node 3
 [6003065800000-6003065ffffff] PMD -> [fff8183f99800000-fff8183f99ffffff] on node 3
 [6003066000000-60030667fffff] PMD -> [fff8183f99000000-fff8183f997fffff] on node 3
 [6003066800000-6003066ffffff] PMD -> [fff8183f98800000-fff8183f98ffffff] on node 3
 [6003067000000-60030677fffff] PMD -> [fff8183f98000000-fff8183f987fffff] on node 3
 [6003067800000-6003067ffffff] PMD -> [fff8183f97800000-fff8183f97ffffff] on node 3
 [6003068000000-60030687fffff] PMD -> [fff8183f97000000-fff8183f977fffff] on node 3
 [6003068800000-6003068ffffff] PMD -> [fff8183f96800000-fff8183f96ffffff] on node 3
 [6003069000000-60030697fffff] PMD -> [fff8183f96000000-fff8183f967fffff] on node 3
 [6003069800000-6003069ffffff] PMD -> [fff8183f95800000-fff8183f95ffffff] on node 3
 [600306a000000-600306a7fffff] PMD -> [fff8183f95000000-fff8183f957fffff] on node 3
 [600306a800000-600306affffff] PMD -> [fff8183f94800000-fff8183f94ffffff] on node 3
 [600306b000000-600306b7fffff] PMD -> [fff8183f94000000-fff8183f947fffff] on node 3
 [600306b800000-600306bffffff] PMD -> [fff8183f93800000-fff8183f93ffffff] on node 3
 [600306c000000-600306c7fffff] PMD -> [fff8183f93000000-fff8183f937fffff] on node 3
 [600306c800000-600306cffffff] PMD -> [fff8183f92800000-fff8183f92ffffff] on node 3
 [600306d000000-600306d7fffff] PMD -> [fff8183f92000000-fff8183f927fffff] on node 3
 [600306d800000-600306dffffff] PMD -> [fff8183f91800000-fff8183f91ffffff] on node 3
 [600306e000000-600306e7fffff] PMD -> [fff8183f91000000-fff8183f917fffff] on node 3
 [600306e800000-600306effffff] PMD -> [fff8183f90800000-fff8183f90ffffff] on node 3
 [600306f000000-600306f7fffff] PMD -> [fff8183f90000000-fff8183f907fffff] on node 3
 [600306f800000-600306fffffff] PMD -> [fff8183f8f800000-fff8183f8fffffff] on node 3
 [6003070000000-60030707fffff] PMD -> [fff8183f8f000000-fff8183f8f7fffff] on node 3
 [6003070800000-6003070ffffff] PMD -> [fff8183f8e800000-fff8183f8effffff] on node 3
 [6003071000000-60030717fffff] PMD -> [fff8183f8e000000-fff8183f8e7fffff] on node 3
 [6003071800000-6003071ffffff] PMD -> [fff8183f8d800000-fff8183f8dffffff] on node 3
 [6003072000000-60030727fffff] PMD -> [fff8183f8d000000-fff8183f8d7fffff] on node 3
 [6003072800000-6003072ffffff] PMD -> [fff8183f8c800000-fff8183f8cffffff] on node 3
 [6003073000000-60030737fffff] PMD -> [fff8183f8c000000-fff8183f8c7fffff] on node 3
 [6003073800000-6003073ffffff] PMD -> [fff8183f8b800000-fff8183f8bffffff] on node 3
 [6003074000000-60030747fffff] PMD -> [fff8183f8b000000-fff8183f8b7fffff] on node 3
 [6003074800000-6003074ffffff] PMD -> [fff8183f8a800000-fff8183f8affffff] on node 3
 [6003075000000-60030757fffff] PMD -> [fff8183f8a000000-fff8183f8a7fffff] on node 3
 [6003075800000-6003075ffffff] PMD -> [fff8183f89800000-fff8183f89ffffff] on node 3
 [6003076000000-60030767fffff] PMD -> [fff8183f89000000-fff8183f897fffff] on node 3
 [6003076800000-6003076ffffff] PMD -> [fff8183f88800000-fff8183f88ffffff] on node 3
 [6003077000000-60030777fffff] PMD -> [fff8183f88000000-fff8183f887fffff] on node 3
 [6003077800000-6003077ffffff] PMD -> [fff8183f87800000-fff8183f87ffffff] on node 3
 [6003078000000-60030787fffff] PMD -> [fff8183f87000000-fff8183f877fffff] on node 3
 [6003078800000-6003078ffffff] PMD -> [fff8183f86800000-fff8183f86ffffff] on node 3
 [6003079000000-60030797fffff] PMD -> [fff8183f86000000-fff8183f867fffff] on node 3
 [6003079800000-6003079ffffff] PMD -> [fff8183f85800000-fff8183f85ffffff] on node 3
 [600307a000000-600307a7fffff] PMD -> [fff8183f85000000-fff8183f857fffff] on node 3
 [600307a800000-600307affffff] PMD -> [fff8183f84800000-fff8183f84ffffff] on node 3
 [600307b000000-600307b7fffff] PMD -> [fff8183f84000000-fff8183f847fffff] on node 3
 [600307b800000-600307bffffff] PMD -> [fff8183f83800000-fff8183f83ffffff] on node 3
 [600307c000000-600307c7fffff] PMD -> [fff8183f83000000-fff8183f837fffff] on node 3
 [600307c800000-600307cffffff] PMD -> [fff8183f82800000-fff8183f82ffffff] on node 3
 [600307d000000-600307d7fffff] PMD -> [fff8183f82000000-fff8183f827fffff] on node 3
 [600307d800000-600307dffffff] PMD -> [fff8183f81800000-fff8183f81ffffff] on node 3
 [600307e000000-600307e7fffff] PMD -> [fff8183f81000000-fff8183f817fffff] on node 3
 [600307e800000-600307effffff] PMD -> [fff8183f80800000-fff8183f80ffffff] on node 3
 [600307f000000-600307f7fffff] PMD -> [fff8183f80000000-fff8183f807fffff] on node 3
 [600307f800000-600307fffffff] PMD -> [fff8183f7f800000-fff8183f7fffffff] on node 3
 [6004000000000-60040007fffff] PMD -> [fff8203fff000000-fff8203fff7fffff] on node 4
 [6004000800000-6004000ffffff] PMD -> [fff8203ffe800000-fff8203ffeffffff] on node 4
 [6004001000000-60040017fffff] PMD -> [fff8203ffe000000-fff8203ffe7fffff] on node 4
 [6004001800000-6004001ffffff] PMD -> [fff8203ffd800000-fff8203ffdffffff] on node 4
 [6004002000000-60040027fffff] PMD -> [fff8203ffd000000-fff8203ffd7fffff] on node 4
 [6004002800000-6004002ffffff] PMD -> [fff8203ffc800000-fff8203ffcffffff] on node 4
 [6004003000000-60040037fffff] PMD -> [fff8203ffc000000-fff8203ffc7fffff] on node 4
 [6004003800000-6004003ffffff] PMD -> [fff8203ffb800000-fff8203ffbffffff] on node 4
 [6004004000000-60040047fffff] PMD -> [fff8203ffb000000-fff8203ffb7fffff] on node 4
 [6004004800000-6004004ffffff] PMD -> [fff8203ffa800000-fff8203ffaffffff] on node 4
 [6004005000000-60040057fffff] PMD -> [fff8203ffa000000-fff8203ffa7fffff] on node 4
 [6004005800000-6004005ffffff] PMD -> [fff8203ff9800000-fff8203ff9ffffff] on node 4
 [6004006000000-60040067fffff] PMD -> [fff8203ff9000000-fff8203ff97fffff] on node 4
 [6004006800000-6004006ffffff] PMD -> [fff8203ff8800000-fff8203ff8ffffff] on node 4
 [6004007000000-60040077fffff] PMD -> [fff8203ff8000000-fff8203ff87fffff] on node 4
 [6004007800000-6004007ffffff] PMD -> [fff8203ff7800000-fff8203ff7ffffff] on node 4
 [6004008000000-60040087fffff] PMD -> [fff8203ff7000000-fff8203ff77fffff] on node 4
 [6004008800000-6004008ffffff] PMD -> [fff8203ff6800000-fff8203ff6ffffff] on node 4
 [6004009000000-60040097fffff] PMD -> [fff8203ff6000000-fff8203ff67fffff] on node 4
 [6004009800000-6004009ffffff] PMD -> [fff8203ff5800000-fff8203ff5ffffff] on node 4
 [600400a000000-600400a7fffff] PMD -> [fff8203ff5000000-fff8203ff57fffff] on node 4
 [600400a800000-600400affffff] PMD -> [fff8203ff4800000-fff8203ff4ffffff] on node 4
 [600400b000000-600400b7fffff] PMD -> [fff8203ff4000000-fff8203ff47fffff] on node 4
 [600400b800000-600400bffffff] PMD -> [fff8203ff3800000-fff8203ff3ffffff] on node 4
 [600400c000000-600400c7fffff] PMD -> [fff8203ff3000000-fff8203ff37fffff] on node 4
 [600400c800000-600400cffffff] PMD -> [fff8203ff2800000-fff8203ff2ffffff] on node 4
 [600400d000000-600400d7fffff] PMD -> [fff8203ff2000000-fff8203ff27fffff] on node 4
 [600400d800000-600400dffffff] PMD -> [fff8203ff1800000-fff8203ff1ffffff] on node 4
 [600400e000000-600400e7fffff] PMD -> [fff8203ff1000000-fff8203ff17fffff] on node 4
 [600400e800000-600400effffff] PMD -> [fff8203ff0800000-fff8203ff0ffffff] on node 4
 [600400f000000-600400f7fffff] PMD -> [fff8203ff0000000-fff8203ff07fffff] on node 4
 [600400f800000-600400fffffff] PMD -> [fff8203fef800000-fff8203fefffffff] on node 4
 [6004010000000-60040107fffff] PMD -> [fff8203fef000000-fff8203fef7fffff] on node 4
 [6004010800000-6004010ffffff] PMD -> [fff8203fee800000-fff8203feeffffff] on node 4
 [6004011000000-60040117fffff] PMD -> [fff8203fee000000-fff8203fee7fffff] on node 4
 [6004011800000-6004011ffffff] PMD -> [fff8203fed800000-fff8203fedffffff] on node 4
 [6004012000000-60040127fffff] PMD -> [fff8203fed000000-fff8203fed7fffff] on node 4
 [6004012800000-6004012ffffff] PMD -> [fff8203fec800000-fff8203fecffffff] on node 4
 [6004013000000-60040137fffff] PMD -> [fff8203fec000000-fff8203fec7fffff] on node 4
 [6004013800000-6004013ffffff] PMD -> [fff8203feb800000-fff8203febffffff] on node 4
 [6004014000000-60040147fffff] PMD -> [fff8203feb000000-fff8203feb7fffff] on node 4
 [6004014800000-6004014ffffff] PMD -> [fff8203fea800000-fff8203feaffffff] on node 4
 [6004015000000-60040157fffff] PMD -> [fff8203fea000000-fff8203fea7fffff] on node 4
 [6004015800000-6004015ffffff] PMD -> [fff8203fe9800000-fff8203fe9ffffff] on node 4
 [6004016000000-60040167fffff] PMD -> [fff8203fe9000000-fff8203fe97fffff] on node 4
 [6004016800000-6004016ffffff] PMD -> [fff8203fe8800000-fff8203fe8ffffff] on node 4
 [6004017000000-60040177fffff] PMD -> [fff8203fe8000000-fff8203fe87fffff] on node 4
 [6004017800000-6004017ffffff] PMD -> [fff8203fe7800000-fff8203fe7ffffff] on node 4
 [6004018000000-60040187fffff] PMD -> [fff8203fe7000000-fff8203fe77fffff] on node 4
 [6004018800000-6004018ffffff] PMD -> [fff8203fe6800000-fff8203fe6ffffff] on node 4
 [6004019000000-60040197fffff] PMD -> [fff8203fe6000000-fff8203fe67fffff] on node 4
 [6004019800000-6004019ffffff] PMD -> [fff8203fe5800000-fff8203fe5ffffff] on node 4
 [600401a000000-600401a7fffff] PMD -> [fff8203fe5000000-fff8203fe57fffff] on node 4
 [600401a800000-600401affffff] PMD -> [fff8203fe4800000-fff8203fe4ffffff] on node 4
 [600401b000000-600401b7fffff] PMD -> [fff8203fe4000000-fff8203fe47fffff] on node 4
 [600401b800000-600401bffffff] PMD -> [fff8203fe3800000-fff8203fe3ffffff] on node 4
 [600401c000000-600401c7fffff] PMD -> [fff8203fe3000000-fff8203fe37fffff] on node 4
 [600401c800000-600401cffffff] PMD -> [fff8203fe2800000-fff8203fe2ffffff] on node 4
 [600401d000000-600401d7fffff] PMD -> [fff8203fe2000000-fff8203fe27fffff] on node 4
 [600401d800000-600401dffffff] PMD -> [fff8203fe1800000-fff8203fe1ffffff] on node 4
 [600401e000000-600401e7fffff] PMD -> [fff8203fe1000000-fff8203fe17fffff] on node 4
 [600401e800000-600401effffff] PMD -> [fff8203fe0800000-fff8203fe0ffffff] on node 4
 [600401f000000-600401f7fffff] PMD -> [fff8203fe0000000-fff8203fe07fffff] on node 4
 [600401f800000-600401fffffff] PMD -> [fff8203fdf800000-fff8203fdfffffff] on node 4
 [6004020000000-60040207fffff] PMD -> [fff8203fdf000000-fff8203fdf7fffff] on node 4
 [6004020800000-6004020ffffff] PMD -> [fff8203fde800000-fff8203fdeffffff] on node 4
 [6004021000000-60040217fffff] PMD -> [fff8203fde000000-fff8203fde7fffff] on node 4
 [6004021800000-6004021ffffff] PMD -> [fff8203fdd800000-fff8203fddffffff] on node 4
 [6004022000000-60040227fffff] PMD -> [fff8203fdd000000-fff8203fdd7fffff] on node 4
 [6004022800000-6004022ffffff] PMD -> [fff8203fdc800000-fff8203fdcffffff] on node 4
 [6004023000000-60040237fffff] PMD -> [fff8203fdc000000-fff8203fdc7fffff] on node 4
 [6004023800000-6004023ffffff] PMD -> [fff8203fdb800000-fff8203fdbffffff] on node 4
 [6004024000000-60040247fffff] PMD -> [fff8203fdb000000-fff8203fdb7fffff] on node 4
 [6004024800000-6004024ffffff] PMD -> [fff8203fda800000-fff8203fdaffffff] on node 4
 [6004025000000-60040257fffff] PMD -> [fff8203fda000000-fff8203fda7fffff] on node 4
 [6004025800000-6004025ffffff] PMD -> [fff8203fd9800000-fff8203fd9ffffff] on node 4
 [6004026000000-60040267fffff] PMD -> [fff8203fd9000000-fff8203fd97fffff] on node 4
 [6004026800000-6004026ffffff] PMD -> [fff8203fd8800000-fff8203fd8ffffff] on node 4
 [6004027000000-60040277fffff] PMD -> [fff8203fd8000000-fff8203fd87fffff] on node 4
 [6004027800000-6004027ffffff] PMD -> [fff8203fd7800000-fff8203fd7ffffff] on node 4
 [6004028000000-60040287fffff] PMD -> [fff8203fd7000000-fff8203fd77fffff] on node 4
 [6004028800000-6004028ffffff] PMD -> [fff8203fd6800000-fff8203fd6ffffff] on node 4
 [6004029000000-60040297fffff] PMD -> [fff8203fd6000000-fff8203fd67fffff] on node 4
 [6004029800000-6004029ffffff] PMD -> [fff8203fd5800000-fff8203fd5ffffff] on node 4
 [600402a000000-600402a7fffff] PMD -> [fff8203fd5000000-fff8203fd57fffff] on node 4
 [600402a800000-600402affffff] PMD -> [fff8203fd4800000-fff8203fd4ffffff] on node 4
 [600402b000000-600402b7fffff] PMD -> [fff8203fd4000000-fff8203fd47fffff] on node 4
 [600402b800000-600402bffffff] PMD -> [fff8203fd3800000-fff8203fd3ffffff] on node 4
 [600402c000000-600402c7fffff] PMD -> [fff8203fd3000000-fff8203fd37fffff] on node 4
 [600402c800000-600402cffffff] PMD -> [fff8203fd2800000-fff8203fd2ffffff] on node 4
 [600402d000000-600402d7fffff] PMD -> [fff8203fd2000000-fff8203fd27fffff] on node 4
 [600402d800000-600402dffffff] PMD -> [fff8203fd1800000-fff8203fd1ffffff] on node 4
 [600402e000000-600402e7fffff] PMD -> [fff8203fd1000000-fff8203fd17fffff] on node 4
 [600402e800000-600402effffff] PMD -> [fff8203fd0800000-fff8203fd0ffffff] on node 4
 [600402f000000-600402f7fffff] PMD -> [fff8203fd0000000-fff8203fd07fffff] on node 4
 [600402f800000-600402fffffff] PMD -> [fff8203fcf800000-fff8203fcfffffff] on node 4
 [6004030000000-60040307fffff] PMD -> [fff8203fcf000000-fff8203fcf7fffff] on node 4
 [6004030800000-6004030ffffff] PMD -> [fff8203fce800000-fff8203fceffffff] on node 4
 [6004031000000-60040317fffff] PMD -> [fff8203fce000000-fff8203fce7fffff] on node 4
 [6004031800000-6004031ffffff] PMD -> [fff8203fcd800000-fff8203fcdffffff] on node 4
 [6004032000000-60040327fffff] PMD -> [fff8203fcd000000-fff8203fcd7fffff] on node 4
 [6004032800000-6004032ffffff] PMD -> [fff8203fcc800000-fff8203fccffffff] on node 4
 [6004033000000-60040337fffff] PMD -> [fff8203fcc000000-fff8203fcc7fffff] on node 4
 [6004033800000-6004033ffffff] PMD -> [fff8203fcb800000-fff8203fcbffffff] on node 4
 [6004034000000-60040347fffff] PMD -> [fff8203fcb000000-fff8203fcb7fffff] on node 4
 [6004034800000-6004034ffffff] PMD -> [fff8203fca800000-fff8203fcaffffff] on node 4
 [6004035000000-60040357fffff] PMD -> [fff8203fca000000-fff8203fca7fffff] on node 4
 [6004035800000-6004035ffffff] PMD -> [fff8203fc9800000-fff8203fc9ffffff] on node 4
 [6004036000000-60040367fffff] PMD -> [fff8203fc9000000-fff8203fc97fffff] on node 4
 [6004036800000-6004036ffffff] PMD -> [fff8203fc8800000-fff8203fc8ffffff] on node 4
 [6004037000000-60040377fffff] PMD -> [fff8203fc8000000-fff8203fc87fffff] on node 4
 [6004037800000-6004037ffffff] PMD -> [fff8203fc7800000-fff8203fc7ffffff] on node 4
 [6004038000000-60040387fffff] PMD -> [fff8203fc7000000-fff8203fc77fffff] on node 4
 [6004038800000-6004038ffffff] PMD -> [fff8203fc6800000-fff8203fc6ffffff] on node 4
 [6004039000000-60040397fffff] PMD -> [fff8203fc6000000-fff8203fc67fffff] on node 4
 [6004039800000-6004039ffffff] PMD -> [fff8203fc5800000-fff8203fc5ffffff] on node 4
 [600403a000000-600403a7fffff] PMD -> [fff8203fc5000000-fff8203fc57fffff] on node 4
 [600403a800000-600403affffff] PMD -> [fff8203fc4800000-fff8203fc4ffffff] on node 4
 [600403b000000-600403b7fffff] PMD -> [fff8203fc4000000-fff8203fc47fffff] on node 4
 [600403b800000-600403bffffff] PMD -> [fff8203fc3800000-fff8203fc3ffffff] on node 4
 [600403c000000-600403c7fffff] PMD -> [fff8203fc3000000-fff8203fc37fffff] on node 4
 [600403c800000-600403cffffff] PMD -> [fff8203fc2800000-fff8203fc2ffffff] on node 4
 [600403d000000-600403d7fffff] PMD -> [fff8203fc2000000-fff8203fc27fffff] on node 4
 [600403d800000-600403dffffff] PMD -> [fff8203fc1800000-fff8203fc1ffffff] on node 4
 [600403e000000-600403e7fffff] PMD -> [fff8203fc1000000-fff8203fc17fffff] on node 4
 [600403e800000-600403effffff] PMD -> [fff8203fc0800000-fff8203fc0ffffff] on node 4
 [600403f000000-600403f7fffff] PMD -> [fff8203fc0000000-fff8203fc07fffff] on node 4
 [600403f800000-600403fffffff] PMD -> [fff8203fbf800000-fff8203fbfffffff] on node 4
 [6004040000000-60040407fffff] PMD -> [fff8203fbf000000-fff8203fbf7fffff] on node 4
 [6004040800000-6004040ffffff] PMD -> [fff8203fbe800000-fff8203fbeffffff] on node 4
 [6004041000000-60040417fffff] PMD -> [fff8203fbe000000-fff8203fbe7fffff] on node 4
 [6004041800000-6004041ffffff] PMD -> [fff8203fbd800000-fff8203fbdffffff] on node 4
 [6004042000000-60040427fffff] PMD -> [fff8203fbd000000-fff8203fbd7fffff] on node 4
 [6004042800000-6004042ffffff] PMD -> [fff8203fbc800000-fff8203fbcffffff] on node 4
 [6004043000000-60040437fffff] PMD -> [fff8203fbc000000-fff8203fbc7fffff] on node 4
 [6004043800000-6004043ffffff] PMD -> [fff8203fbb800000-fff8203fbbffffff] on node 4
 [6004044000000-60040447fffff] PMD -> [fff8203fbb000000-fff8203fbb7fffff] on node 4
 [6004044800000-6004044ffffff] PMD -> [fff8203fba800000-fff8203fbaffffff] on node 4
 [6004045000000-60040457fffff] PMD -> [fff8203fba000000-fff8203fba7fffff] on node 4
 [6004045800000-6004045ffffff] PMD -> [fff8203fb9800000-fff8203fb9ffffff] on node 4
 [6004046000000-60040467fffff] PMD -> [fff8203fb9000000-fff8203fb97fffff] on node 4
 [6004046800000-6004046ffffff] PMD -> [fff8203fb8800000-fff8203fb8ffffff] on node 4
 [6004047000000-60040477fffff] PMD -> [fff8203fb8000000-fff8203fb87fffff] on node 4
 [6004047800000-6004047ffffff] PMD -> [fff8203fb7800000-fff8203fb7ffffff] on node 4
 [6004048000000-60040487fffff] PMD -> [fff8203fb7000000-fff8203fb77fffff] on node 4
 [6004048800000-6004048ffffff] PMD -> [fff8203fb6800000-fff8203fb6ffffff] on node 4
 [6004049000000-60040497fffff] PMD -> [fff8203fb6000000-fff8203fb67fffff] on node 4
 [6004049800000-6004049ffffff] PMD -> [fff8203fb5800000-fff8203fb5ffffff] on node 4
 [600404a000000-600404a7fffff] PMD -> [fff8203fb5000000-fff8203fb57fffff] on node 4
 [600404a800000-600404affffff] PMD -> [fff8203fb4800000-fff8203fb4ffffff] on node 4
 [600404b000000-600404b7fffff] PMD -> [fff8203fb4000000-fff8203fb47fffff] on node 4
 [600404b800000-600404bffffff] PMD -> [fff8203fb3800000-fff8203fb3ffffff] on node 4
 [600404c000000-600404c7fffff] PMD -> [fff8203fb3000000-fff8203fb37fffff] on node 4
 [600404c800000-600404cffffff] PMD -> [fff8203fb2800000-fff8203fb2ffffff] on node 4
 [600404d000000-600404d7fffff] PMD -> [fff8203fb2000000-fff8203fb27fffff] on node 4
 [600404d800000-600404dffffff] PMD -> [fff8203fb1800000-fff8203fb1ffffff] on node 4
 [600404e000000-600404e7fffff] PMD -> [fff8203fb1000000-fff8203fb17fffff] on node 4
 [600404e800000-600404effffff] PMD -> [fff8203fb0800000-fff8203fb0ffffff] on node 4
 [600404f000000-600404f7fffff] PMD -> [fff8203fb0000000-fff8203fb07fffff] on node 4
 [600404f800000-600404fffffff] PMD -> [fff8203faf800000-fff8203fafffffff] on node 4
 [6004050000000-60040507fffff] PMD -> [fff8203faf000000-fff8203faf7fffff] on node 4
 [6004050800000-6004050ffffff] PMD -> [fff8203fae800000-fff8203faeffffff] on node 4
 [6004051000000-60040517fffff] PMD -> [fff8203fae000000-fff8203fae7fffff] on node 4
 [6004051800000-6004051ffffff] PMD -> [fff8203fad800000-fff8203fadffffff] on node 4
 [6004052000000-60040527fffff] PMD -> [fff8203fad000000-fff8203fad7fffff] on node 4
 [6004052800000-6004052ffffff] PMD -> [fff8203fac800000-fff8203facffffff] on node 4
 [6004053000000-60040537fffff] PMD -> [fff8203fac000000-fff8203fac7fffff] on node 4
 [6004053800000-6004053ffffff] PMD -> [fff8203fab800000-fff8203fabffffff] on node 4
 [6004054000000-60040547fffff] PMD -> [fff8203fab000000-fff8203fab7fffff] on node 4
 [6004054800000-6004054ffffff] PMD -> [fff8203faa800000-fff8203faaffffff] on node 4
 [6004055000000-60040557fffff] PMD -> [fff8203faa000000-fff8203faa7fffff] on node 4
 [6004055800000-6004055ffffff] PMD -> [fff8203fa9800000-fff8203fa9ffffff] on node 4
 [6004056000000-60040567fffff] PMD -> [fff8203fa9000000-fff8203fa97fffff] on node 4
 [6004056800000-6004056ffffff] PMD -> [fff8203fa8800000-fff8203fa8ffffff] on node 4
 [6004057000000-60040577fffff] PMD -> [fff8203fa8000000-fff8203fa87fffff] on node 4
 [6004057800000-6004057ffffff] PMD -> [fff8203fa7800000-fff8203fa7ffffff] on node 4
 [6004058000000-60040587fffff] PMD -> [fff8203fa7000000-fff8203fa77fffff] on node 4
 [6004058800000-6004058ffffff] PMD -> [fff8203fa6800000-fff8203fa6ffffff] on node 4
 [6004059000000-60040597fffff] PMD -> [fff8203fa6000000-fff8203fa67fffff] on node 4
 [6004059800000-6004059ffffff] PMD -> [fff8203fa5800000-fff8203fa5ffffff] on node 4
 [600405a000000-600405a7fffff] PMD -> [fff8203fa5000000-fff8203fa57fffff] on node 4
 [600405a800000-600405affffff] PMD -> [fff8203fa4800000-fff8203fa4ffffff] on node 4
 [600405b000000-600405b7fffff] PMD -> [fff8203fa4000000-fff8203fa47fffff] on node 4
 [600405b800000-600405bffffff] PMD -> [fff8203fa3800000-fff8203fa3ffffff] on node 4
 [600405c000000-600405c7fffff] PMD -> [fff8203fa3000000-fff8203fa37fffff] on node 4
 [600405c800000-600405cffffff] PMD -> [fff8203fa2800000-fff8203fa2ffffff] on node 4
 [600405d000000-600405d7fffff] PMD -> [fff8203fa2000000-fff8203fa27fffff] on node 4
 [600405d800000-600405dffffff] PMD -> [fff8203fa1800000-fff8203fa1ffffff] on node 4
 [600405e000000-600405e7fffff] PMD -> [fff8203fa1000000-fff8203fa17fffff] on node 4
 [600405e800000-600405effffff] PMD -> [fff8203fa0800000-fff8203fa0ffffff] on node 4
 [600405f000000-600405f7fffff] PMD -> [fff8203fa0000000-fff8203fa07fffff] on node 4
 [600405f800000-600405fffffff] PMD -> [fff8203f9f800000-fff8203f9fffffff] on node 4
 [6004060000000-60040607fffff] PMD -> [fff8203f9f000000-fff8203f9f7fffff] on node 4
 [6004060800000-6004060ffffff] PMD -> [fff8203f9e800000-fff8203f9effffff] on node 4
 [6004061000000-60040617fffff] PMD -> [fff8203f9e000000-fff8203f9e7fffff] on node 4
 [6004061800000-6004061ffffff] PMD -> [fff8203f9d800000-fff8203f9dffffff] on node 4
 [6004062000000-60040627fffff] PMD -> [fff8203f9d000000-fff8203f9d7fffff] on node 4
 [6004062800000-6004062ffffff] PMD -> [fff8203f9c800000-fff8203f9cffffff] on node 4
 [6004063000000-60040637fffff] PMD -> [fff8203f9c000000-fff8203f9c7fffff] on node 4
 [6004063800000-6004063ffffff] PMD -> [fff8203f9b800000-fff8203f9bffffff] on node 4
 [6004064000000-60040647fffff] PMD -> [fff8203f9b000000-fff8203f9b7fffff] on node 4
 [6004064800000-6004064ffffff] PMD -> [fff8203f9a800000-fff8203f9affffff] on node 4
 [6004065000000-60040657fffff] PMD -> [fff8203f9a000000-fff8203f9a7fffff] on node 4
 [6004065800000-6004065ffffff] PMD -> [fff8203f99800000-fff8203f99ffffff] on node 4
 [6004066000000-60040667fffff] PMD -> [fff8203f99000000-fff8203f997fffff] on node 4
 [6004066800000-6004066ffffff] PMD -> [fff8203f98800000-fff8203f98ffffff] on node 4
 [6004067000000-60040677fffff] PMD -> [fff8203f98000000-fff8203f987fffff] on node 4
 [6004067800000-6004067ffffff] PMD -> [fff8203f97800000-fff8203f97ffffff] on node 4
 [6004068000000-60040687fffff] PMD -> [fff8203f97000000-fff8203f977fffff] on node 4
 [6004068800000-6004068ffffff] PMD -> [fff8203f96800000-fff8203f96ffffff] on node 4
 [6004069000000-60040697fffff] PMD -> [fff8203f96000000-fff8203f967fffff] on node 4
 [6004069800000-6004069ffffff] PMD -> [fff8203f95800000-fff8203f95ffffff] on node 4
 [600406a000000-600406a7fffff] PMD -> [fff8203f95000000-fff8203f957fffff] on node 4
 [600406a800000-600406affffff] PMD -> [fff8203f94800000-fff8203f94ffffff] on node 4
 [600406b000000-600406b7fffff] PMD -> [fff8203f94000000-fff8203f947fffff] on node 4
 [600406b800000-600406bffffff] PMD -> [fff8203f93800000-fff8203f93ffffff] on node 4
 [600406c000000-600406c7fffff] PMD -> [fff8203f93000000-fff8203f937fffff] on node 4
 [600406c800000-600406cffffff] PMD -> [fff8203f92800000-fff8203f92ffffff] on node 4
 [600406d000000-600406d7fffff] PMD -> [fff8203f92000000-fff8203f927fffff] on node 4
 [600406d800000-600406dffffff] PMD -> [fff8203f91800000-fff8203f91ffffff] on node 4
 [600406e000000-600406e7fffff] PMD -> [fff8203f91000000-fff8203f917fffff] on node 4
 [600406e800000-600406effffff] PMD -> [fff8203f90800000-fff8203f90ffffff] on node 4
 [600406f000000-600406f7fffff] PMD -> [fff8203f90000000-fff8203f907fffff] on node 4
 [600406f800000-600406fffffff] PMD -> [fff8203f8f800000-fff8203f8fffffff] on node 4
 [6004070000000-60040707fffff] PMD -> [fff8203f8f000000-fff8203f8f7fffff] on node 4
 [6004070800000-6004070ffffff] PMD -> [fff8203f8e800000-fff8203f8effffff] on node 4
 [6004071000000-60040717fffff] PMD -> [fff8203f8e000000-fff8203f8e7fffff] on node 4
 [6004071800000-6004071ffffff] PMD -> [fff8203f8d800000-fff8203f8dffffff] on node 4
 [6004072000000-60040727fffff] PMD -> [fff8203f8d000000-fff8203f8d7fffff] on node 4
 [6004072800000-6004072ffffff] PMD -> [fff8203f8c800000-fff8203f8cffffff] on node 4
 [6004073000000-60040737fffff] PMD -> [fff8203f8c000000-fff8203f8c7fffff] on node 4
 [6004073800000-6004073ffffff] PMD -> [fff8203f8b800000-fff8203f8bffffff] on node 4
 [6004074000000-60040747fffff] PMD -> [fff8203f8b000000-fff8203f8b7fffff] on node 4
 [6004074800000-6004074ffffff] PMD -> [fff8203f8a800000-fff8203f8affffff] on node 4
 [6004075000000-60040757fffff] PMD -> [fff8203f8a000000-fff8203f8a7fffff] on node 4
 [6004075800000-6004075ffffff] PMD -> [fff8203f89800000-fff8203f89ffffff] on node 4
 [6004076000000-60040767fffff] PMD -> [fff8203f89000000-fff8203f897fffff] on node 4
 [6004076800000-6004076ffffff] PMD -> [fff8203f88800000-fff8203f88ffffff] on node 4
 [6004077000000-60040777fffff] PMD -> [fff8203f88000000-fff8203f887fffff] on node 4
 [6004077800000-6004077ffffff] PMD -> [fff8203f87800000-fff8203f87ffffff] on node 4
 [6004078000000-60040787fffff] PMD -> [fff8203f87000000-fff8203f877fffff] on node 4
 [6004078800000-6004078ffffff] PMD -> [fff8203f86800000-fff8203f86ffffff] on node 4
 [6004079000000-60040797fffff] PMD -> [fff8203f86000000-fff8203f867fffff] on node 4
 [6004079800000-6004079ffffff] PMD -> [fff8203f85800000-fff8203f85ffffff] on node 4
 [600407a000000-600407a7fffff] PMD -> [fff8203f85000000-fff8203f857fffff] on node 4
 [600407a800000-600407affffff] PMD -> [fff8203f84800000-fff8203f84ffffff] on node 4
 [600407b000000-600407b7fffff] PMD -> [fff8203f84000000-fff8203f847fffff] on node 4
 [600407b800000-600407bffffff] PMD -> [fff8203f83800000-fff8203f83ffffff] on node 4
 [600407c000000-600407c7fffff] PMD -> [fff8203f83000000-fff8203f837fffff] on node 4
 [600407c800000-600407cffffff] PMD -> [fff8203f82800000-fff8203f82ffffff] on node 4
 [600407d000000-600407d7fffff] PMD -> [fff8203f82000000-fff8203f827fffff] on node 4
 [600407d800000-600407dffffff] PMD -> [fff8203f81800000-fff8203f81ffffff] on node 4
 [600407e000000-600407e7fffff] PMD -> [fff8203f81000000-fff8203f817fffff] on node 4
 [600407e800000-600407effffff] PMD -> [fff8203f80800000-fff8203f80ffffff] on node 4
 [600407f000000-600407f7fffff] PMD -> [fff8203f80000000-fff8203f807fffff] on node 4
 [600407f800000-600407fffffff] PMD -> [fff8203f7f800000-fff8203f7fffffff] on node 4
 [6005000000000-60050007fffff] PMD -> [fff8283fff000000-fff8283fff7fffff] on node 5
 [6005000800000-6005000ffffff] PMD -> [fff8283ffe800000-fff8283ffeffffff] on node 5
 [6005001000000-60050017fffff] PMD -> [fff8283ffe000000-fff8283ffe7fffff] on node 5
 [6005001800000-6005001ffffff] PMD -> [fff8283ffd800000-fff8283ffdffffff] on node 5
 [6005002000000-60050027fffff] PMD -> [fff8283ffd000000-fff8283ffd7fffff] on node 5
 [6005002800000-6005002ffffff] PMD -> [fff8283ffc800000-fff8283ffcffffff] on node 5
 [6005003000000-60050037fffff] PMD -> [fff8283ffc000000-fff8283ffc7fffff] on node 5
 [6005003800000-6005003ffffff] PMD -> [fff8283ffb800000-fff8283ffbffffff] on node 5
 [6005004000000-60050047fffff] PMD -> [fff8283ffb000000-fff8283ffb7fffff] on node 5
 [6005004800000-6005004ffffff] PMD -> [fff8283ffa800000-fff8283ffaffffff] on node 5
 [6005005000000-60050057fffff] PMD -> [fff8283ffa000000-fff8283ffa7fffff] on node 5
 [6005005800000-6005005ffffff] PMD -> [fff8283ff9800000-fff8283ff9ffffff] on node 5
 [6005006000000-60050067fffff] PMD -> [fff8283ff9000000-fff8283ff97fffff] on node 5
 [6005006800000-6005006ffffff] PMD -> [fff8283ff8800000-fff8283ff8ffffff] on node 5
 [6005007000000-60050077fffff] PMD -> [fff8283ff8000000-fff8283ff87fffff] on node 5
 [6005007800000-6005007ffffff] PMD -> [fff8283ff7800000-fff8283ff7ffffff] on node 5
 [6005008000000-60050087fffff] PMD -> [fff8283ff7000000-fff8283ff77fffff] on node 5
 [6005008800000-6005008ffffff] PMD -> [fff8283ff6800000-fff8283ff6ffffff] on node 5
 [6005009000000-60050097fffff] PMD -> [fff8283ff6000000-fff8283ff67fffff] on node 5
 [6005009800000-6005009ffffff] PMD -> [fff8283ff5800000-fff8283ff5ffffff] on node 5
 [600500a000000-600500a7fffff] PMD -> [fff8283ff5000000-fff8283ff57fffff] on node 5
 [600500a800000-600500affffff] PMD -> [fff8283ff4800000-fff8283ff4ffffff] on node 5
 [600500b000000-600500b7fffff] PMD -> [fff8283ff4000000-fff8283ff47fffff] on node 5
 [600500b800000-600500bffffff] PMD -> [fff8283ff3800000-fff8283ff3ffffff] on node 5
 [600500c000000-600500c7fffff] PMD -> [fff8283ff3000000-fff8283ff37fffff] on node 5
 [600500c800000-600500cffffff] PMD -> [fff8283ff2800000-fff8283ff2ffffff] on node 5
 [600500d000000-600500d7fffff] PMD -> [fff8283ff2000000-fff8283ff27fffff] on node 5
 [600500d800000-600500dffffff] PMD -> [fff8283ff1800000-fff8283ff1ffffff] on node 5
 [600500e000000-600500e7fffff] PMD -> [fff8283ff1000000-fff8283ff17fffff] on node 5
 [600500e800000-600500effffff] PMD -> [fff8283ff0800000-fff8283ff0ffffff] on node 5
 [600500f000000-600500f7fffff] PMD -> [fff8283ff0000000-fff8283ff07fffff] on node 5
 [600500f800000-600500fffffff] PMD -> [fff8283fef800000-fff8283fefffffff] on node 5
 [6005010000000-60050107fffff] PMD -> [fff8283fef000000-fff8283fef7fffff] on node 5
 [6005010800000-6005010ffffff] PMD -> [fff8283fee800000-fff8283feeffffff] on node 5
 [6005011000000-60050117fffff] PMD -> [fff8283fee000000-fff8283fee7fffff] on node 5
 [6005011800000-6005011ffffff] PMD -> [fff8283fed800000-fff8283fedffffff] on node 5
 [6005012000000-60050127fffff] PMD -> [fff8283fed000000-fff8283fed7fffff] on node 5
 [6005012800000-6005012ffffff] PMD -> [fff8283fec800000-fff8283fecffffff] on node 5
 [6005013000000-60050137fffff] PMD -> [fff8283fec000000-fff8283fec7fffff] on node 5
 [6005013800000-6005013ffffff] PMD -> [fff8283feb800000-fff8283febffffff] on node 5
 [6005014000000-60050147fffff] PMD -> [fff8283feb000000-fff8283feb7fffff] on node 5
 [6005014800000-6005014ffffff] PMD -> [fff8283fea800000-fff8283feaffffff] on node 5
 [6005015000000-60050157fffff] PMD -> [fff8283fea000000-fff8283fea7fffff] on node 5
 [6005015800000-6005015ffffff] PMD -> [fff8283fe9800000-fff8283fe9ffffff] on node 5
 [6005016000000-60050167fffff] PMD -> [fff8283fe9000000-fff8283fe97fffff] on node 5
 [6005016800000-6005016ffffff] PMD -> [fff8283fe8800000-fff8283fe8ffffff] on node 5
 [6005017000000-60050177fffff] PMD -> [fff8283fe8000000-fff8283fe87fffff] on node 5
 [6005017800000-6005017ffffff] PMD -> [fff8283fe7800000-fff8283fe7ffffff] on node 5
 [6005018000000-60050187fffff] PMD -> [fff8283fe7000000-fff8283fe77fffff] on node 5
 [6005018800000-6005018ffffff] PMD -> [fff8283fe6800000-fff8283fe6ffffff] on node 5
 [6005019000000-60050197fffff] PMD -> [fff8283fe6000000-fff8283fe67fffff] on node 5
 [6005019800000-6005019ffffff] PMD -> [fff8283fe5800000-fff8283fe5ffffff] on node 5
 [600501a000000-600501a7fffff] PMD -> [fff8283fe5000000-fff8283fe57fffff] on node 5
 [600501a800000-600501affffff] PMD -> [fff8283fe4800000-fff8283fe4ffffff] on node 5
 [600501b000000-600501b7fffff] PMD -> [fff8283fe4000000-fff8283fe47fffff] on node 5
 [600501b800000-600501bffffff] PMD -> [fff8283fe3800000-fff8283fe3ffffff] on node 5
 [600501c000000-600501c7fffff] PMD -> [fff8283fe3000000-fff8283fe37fffff] on node 5
 [600501c800000-600501cffffff] PMD -> [fff8283fe2800000-fff8283fe2ffffff] on node 5
 [600501d000000-600501d7fffff] PMD -> [fff8283fe2000000-fff8283fe27fffff] on node 5
 [600501d800000-600501dffffff] PMD -> [fff8283fe1800000-fff8283fe1ffffff] on node 5
 [600501e000000-600501e7fffff] PMD -> [fff8283fe1000000-fff8283fe17fffff] on node 5
 [600501e800000-600501effffff] PMD -> [fff8283fe0800000-fff8283fe0ffffff] on node 5
 [600501f000000-600501f7fffff] PMD -> [fff8283fe0000000-fff8283fe07fffff] on node 5
 [600501f800000-600501fffffff] PMD -> [fff8283fdf800000-fff8283fdfffffff] on node 5
 [6005020000000-60050207fffff] PMD -> [fff8283fdf000000-fff8283fdf7fffff] on node 5
 [6005020800000-6005020ffffff] PMD -> [fff8283fde800000-fff8283fdeffffff] on node 5
 [6005021000000-60050217fffff] PMD -> [fff8283fde000000-fff8283fde7fffff] on node 5
 [6005021800000-6005021ffffff] PMD -> [fff8283fdd800000-fff8283fddffffff] on node 5
 [6005022000000-60050227fffff] PMD -> [fff8283fdd000000-fff8283fdd7fffff] on node 5
 [6005022800000-6005022ffffff] PMD -> [fff8283fdc800000-fff8283fdcffffff] on node 5
 [6005023000000-60050237fffff] PMD -> [fff8283fdc000000-fff8283fdc7fffff] on node 5
 [6005023800000-6005023ffffff] PMD -> [fff8283fdb800000-fff8283fdbffffff] on node 5
 [6005024000000-60050247fffff] PMD -> [fff8283fdb000000-fff8283fdb7fffff] on node 5
 [6005024800000-6005024ffffff] PMD -> [fff8283fda800000-fff8283fdaffffff] on node 5
 [6005025000000-60050257fffff] PMD -> [fff8283fda000000-fff8283fda7fffff] on node 5
 [6005025800000-6005025ffffff] PMD -> [fff8283fd9800000-fff8283fd9ffffff] on node 5
 [6005026000000-60050267fffff] PMD -> [fff8283fd9000000-fff8283fd97fffff] on node 5
 [6005026800000-6005026ffffff] PMD -> [fff8283fd8800000-fff8283fd8ffffff] on node 5
 [6005027000000-60050277fffff] PMD -> [fff8283fd8000000-fff8283fd87fffff] on node 5
 [6005027800000-6005027ffffff] PMD -> [fff8283fd7800000-fff8283fd7ffffff] on node 5
 [6005028000000-60050287fffff] PMD -> [fff8283fd7000000-fff8283fd77fffff] on node 5
 [6005028800000-6005028ffffff] PMD -> [fff8283fd6800000-fff8283fd6ffffff] on node 5
 [6005029000000-60050297fffff] PMD -> [fff8283fd6000000-fff8283fd67fffff] on node 5
 [6005029800000-6005029ffffff] PMD -> [fff8283fd5800000-fff8283fd5ffffff] on node 5
 [600502a000000-600502a7fffff] PMD -> [fff8283fd5000000-fff8283fd57fffff] on node 5
 [600502a800000-600502affffff] PMD -> [fff8283fd4800000-fff8283fd4ffffff] on node 5
 [600502b000000-600502b7fffff] PMD -> [fff8283fd4000000-fff8283fd47fffff] on node 5
 [600502b800000-600502bffffff] PMD -> [fff8283fd3800000-fff8283fd3ffffff] on node 5
 [600502c000000-600502c7fffff] PMD -> [fff8283fd3000000-fff8283fd37fffff] on node 5
 [600502c800000-600502cffffff] PMD -> [fff8283fd2800000-fff8283fd2ffffff] on node 5
 [600502d000000-600502d7fffff] PMD -> [fff8283fd2000000-fff8283fd27fffff] on node 5
 [600502d800000-600502dffffff] PMD -> [fff8283fd1800000-fff8283fd1ffffff] on node 5
 [600502e000000-600502e7fffff] PMD -> [fff8283fd1000000-fff8283fd17fffff] on node 5
 [600502e800000-600502effffff] PMD -> [fff8283fd0800000-fff8283fd0ffffff] on node 5
 [600502f000000-600502f7fffff] PMD -> [fff8283fd0000000-fff8283fd07fffff] on node 5
 [600502f800000-600502fffffff] PMD -> [fff8283fcf800000-fff8283fcfffffff] on node 5
 [6005030000000-60050307fffff] PMD -> [fff8283fcf000000-fff8283fcf7fffff] on node 5
 [6005030800000-6005030ffffff] PMD -> [fff8283fce800000-fff8283fceffffff] on node 5
 [6005031000000-60050317fffff] PMD -> [fff8283fce000000-fff8283fce7fffff] on node 5
 [6005031800000-6005031ffffff] PMD -> [fff8283fcd800000-fff8283fcdffffff] on node 5
 [6005032000000-60050327fffff] PMD -> [fff8283fcd000000-fff8283fcd7fffff] on node 5
 [6005032800000-6005032ffffff] PMD -> [fff8283fcc800000-fff8283fccffffff] on node 5
 [6005033000000-60050337fffff] PMD -> [fff8283fcc000000-fff8283fcc7fffff] on node 5
 [6005033800000-6005033ffffff] PMD -> [fff8283fcb800000-fff8283fcbffffff] on node 5
 [6005034000000-60050347fffff] PMD -> [fff8283fcb000000-fff8283fcb7fffff] on node 5
 [6005034800000-6005034ffffff] PMD -> [fff8283fca800000-fff8283fcaffffff] on node 5
 [6005035000000-60050357fffff] PMD -> [fff8283fca000000-fff8283fca7fffff] on node 5
 [6005035800000-6005035ffffff] PMD -> [fff8283fc9800000-fff8283fc9ffffff] on node 5
 [6005036000000-60050367fffff] PMD -> [fff8283fc9000000-fff8283fc97fffff] on node 5
 [6005036800000-6005036ffffff] PMD -> [fff8283fc8800000-fff8283fc8ffffff] on node 5
 [6005037000000-60050377fffff] PMD -> [fff8283fc8000000-fff8283fc87fffff] on node 5
 [6005037800000-6005037ffffff] PMD -> [fff8283fc7800000-fff8283fc7ffffff] on node 5
 [6005038000000-60050387fffff] PMD -> [fff8283fc7000000-fff8283fc77fffff] on node 5
 [6005038800000-6005038ffffff] PMD -> [fff8283fc6800000-fff8283fc6ffffff] on node 5
 [6005039000000-60050397fffff] PMD -> [fff8283fc6000000-fff8283fc67fffff] on node 5
 [6005039800000-6005039ffffff] PMD -> [fff8283fc5800000-fff8283fc5ffffff] on node 5
 [600503a000000-600503a7fffff] PMD -> [fff8283fc5000000-fff8283fc57fffff] on node 5
 [600503a800000-600503affffff] PMD -> [fff8283fc4800000-fff8283fc4ffffff] on node 5
 [600503b000000-600503b7fffff] PMD -> [fff8283fc4000000-fff8283fc47fffff] on node 5
 [600503b800000-600503bffffff] PMD -> [fff8283fc3800000-fff8283fc3ffffff] on node 5
 [600503c000000-600503c7fffff] PMD -> [fff8283fc3000000-fff8283fc37fffff] on node 5
 [600503c800000-600503cffffff] PMD -> [fff8283fc2800000-fff8283fc2ffffff] on node 5
 [600503d000000-600503d7fffff] PMD -> [fff8283fc2000000-fff8283fc27fffff] on node 5
 [600503d800000-600503dffffff] PMD -> [fff8283fc1800000-fff8283fc1ffffff] on node 5
 [600503e000000-600503e7fffff] PMD -> [fff8283fc1000000-fff8283fc17fffff] on node 5
 [600503e800000-600503effffff] PMD -> [fff8283fc0800000-fff8283fc0ffffff] on node 5
 [600503f000000-600503f7fffff] PMD -> [fff8283fc0000000-fff8283fc07fffff] on node 5
 [600503f800000-600503fffffff] PMD -> [fff8283fbf800000-fff8283fbfffffff] on node 5
 [6005040000000-60050407fffff] PMD -> [fff8283fbf000000-fff8283fbf7fffff] on node 5
 [6005040800000-6005040ffffff] PMD -> [fff8283fbe800000-fff8283fbeffffff] on node 5
 [6005041000000-60050417fffff] PMD -> [fff8283fbe000000-fff8283fbe7fffff] on node 5
 [6005041800000-6005041ffffff] PMD -> [fff8283fbd800000-fff8283fbdffffff] on node 5
 [6005042000000-60050427fffff] PMD -> [fff8283fbd000000-fff8283fbd7fffff] on node 5
 [6005042800000-6005042ffffff] PMD -> [fff8283fbc800000-fff8283fbcffffff] on node 5
 [6005043000000-60050437fffff] PMD -> [fff8283fbc000000-fff8283fbc7fffff] on node 5
 [6005043800000-6005043ffffff] PMD -> [fff8283fbb800000-fff8283fbbffffff] on node 5
 [6005044000000-60050447fffff] PMD -> [fff8283fbb000000-fff8283fbb7fffff] on node 5
 [6005044800000-6005044ffffff] PMD -> [fff8283fba800000-fff8283fbaffffff] on node 5
 [6005045000000-60050457fffff] PMD -> [fff8283fba000000-fff8283fba7fffff] on node 5
 [6005045800000-6005045ffffff] PMD -> [fff8283fb9800000-fff8283fb9ffffff] on node 5
 [6005046000000-60050467fffff] PMD -> [fff8283fb9000000-fff8283fb97fffff] on node 5
 [6005046800000-6005046ffffff] PMD -> [fff8283fb8800000-fff8283fb8ffffff] on node 5
 [6005047000000-60050477fffff] PMD -> [fff8283fb8000000-fff8283fb87fffff] on node 5
 [6005047800000-6005047ffffff] PMD -> [fff8283fb7800000-fff8283fb7ffffff] on node 5
 [6005048000000-60050487fffff] PMD -> [fff8283fb7000000-fff8283fb77fffff] on node 5
 [6005048800000-6005048ffffff] PMD -> [fff8283fb6800000-fff8283fb6ffffff] on node 5
 [6005049000000-60050497fffff] PMD -> [fff8283fb6000000-fff8283fb67fffff] on node 5
 [6005049800000-6005049ffffff] PMD -> [fff8283fb5800000-fff8283fb5ffffff] on node 5
 [600504a000000-600504a7fffff] PMD -> [fff8283fb5000000-fff8283fb57fffff] on node 5
 [600504a800000-600504affffff] PMD -> [fff8283fb4800000-fff8283fb4ffffff] on node 5
 [600504b000000-600504b7fffff] PMD -> [fff8283fb4000000-fff8283fb47fffff] on node 5
 [600504b800000-600504bffffff] PMD -> [fff8283fb3800000-fff8283fb3ffffff] on node 5
 [600504c000000-600504c7fffff] PMD -> [fff8283fb3000000-fff8283fb37fffff] on node 5
 [600504c800000-600504cffffff] PMD -> [fff8283fb2800000-fff8283fb2ffffff] on node 5
 [600504d000000-600504d7fffff] PMD -> [fff8283fb2000000-fff8283fb27fffff] on node 5
 [600504d800000-600504dffffff] PMD -> [fff8283fb1800000-fff8283fb1ffffff] on node 5
 [600504e000000-600504e7fffff] PMD -> [fff8283fb1000000-fff8283fb17fffff] on node 5
 [600504e800000-600504effffff] PMD -> [fff8283fb0800000-fff8283fb0ffffff] on node 5
 [600504f000000-600504f7fffff] PMD -> [fff8283fb0000000-fff8283fb07fffff] on node 5
 [600504f800000-600504fffffff] PMD -> [fff8283faf800000-fff8283fafffffff] on node 5
 [6005050000000-60050507fffff] PMD -> [fff8283faf000000-fff8283faf7fffff] on node 5
 [6005050800000-6005050ffffff] PMD -> [fff8283fae800000-fff8283faeffffff] on node 5
 [6005051000000-60050517fffff] PMD -> [fff8283fae000000-fff8283fae7fffff] on node 5
 [6005051800000-6005051ffffff] PMD -> [fff8283fad800000-fff8283fadffffff] on node 5
 [6005052000000-60050527fffff] PMD -> [fff8283fad000000-fff8283fad7fffff] on node 5
 [6005052800000-6005052ffffff] PMD -> [fff8283fac800000-fff8283facffffff] on node 5
 [6005053000000-60050537fffff] PMD -> [fff8283fac000000-fff8283fac7fffff] on node 5
 [6005053800000-6005053ffffff] PMD -> [fff8283fab800000-fff8283fabffffff] on node 5
 [6005054000000-60050547fffff] PMD -> [fff8283fab000000-fff8283fab7fffff] on node 5
 [6005054800000-6005054ffffff] PMD -> [fff8283faa800000-fff8283faaffffff] on node 5
 [6005055000000-60050557fffff] PMD -> [fff8283faa000000-fff8283faa7fffff] on node 5
 [6005055800000-6005055ffffff] PMD -> [fff8283fa9800000-fff8283fa9ffffff] on node 5
 [6005056000000-60050567fffff] PMD -> [fff8283fa9000000-fff8283fa97fffff] on node 5
 [6005056800000-6005056ffffff] PMD -> [fff8283fa8800000-fff8283fa8ffffff] on node 5
 [6005057000000-60050577fffff] PMD -> [fff8283fa8000000-fff8283fa87fffff] on node 5
 [6005057800000-6005057ffffff] PMD -> [fff8283fa7800000-fff8283fa7ffffff] on node 5
 [6005058000000-60050587fffff] PMD -> [fff8283fa7000000-fff8283fa77fffff] on node 5
 [6005058800000-6005058ffffff] PMD -> [fff8283fa6800000-fff8283fa6ffffff] on node 5
 [6005059000000-60050597fffff] PMD -> [fff8283fa6000000-fff8283fa67fffff] on node 5
 [6005059800000-6005059ffffff] PMD -> [fff8283fa5800000-fff8283fa5ffffff] on node 5
 [600505a000000-600505a7fffff] PMD -> [fff8283fa5000000-fff8283fa57fffff] on node 5
 [600505a800000-600505affffff] PMD -> [fff8283fa4800000-fff8283fa4ffffff] on node 5
 [600505b000000-600505b7fffff] PMD -> [fff8283fa4000000-fff8283fa47fffff] on node 5
 [600505b800000-600505bffffff] PMD -> [fff8283fa3800000-fff8283fa3ffffff] on node 5
 [600505c000000-600505c7fffff] PMD -> [fff8283fa3000000-fff8283fa37fffff] on node 5
 [600505c800000-600505cffffff] PMD -> [fff8283fa2800000-fff8283fa2ffffff] on node 5
 [600505d000000-600505d7fffff] PMD -> [fff8283fa2000000-fff8283fa27fffff] on node 5
 [600505d800000-600505dffffff] PMD -> [fff8283fa1800000-fff8283fa1ffffff] on node 5
 [600505e000000-600505e7fffff] PMD -> [fff8283fa1000000-fff8283fa17fffff] on node 5
 [600505e800000-600505effffff] PMD -> [fff8283fa0800000-fff8283fa0ffffff] on node 5
 [600505f000000-600505f7fffff] PMD -> [fff8283fa0000000-fff8283fa07fffff] on node 5
 [600505f800000-600505fffffff] PMD -> [fff8283f9f800000-fff8283f9fffffff] on node 5
 [6005060000000-60050607fffff] PMD -> [fff8283f9f000000-fff8283f9f7fffff] on node 5
 [6005060800000-6005060ffffff] PMD -> [fff8283f9e800000-fff8283f9effffff] on node 5
 [6005061000000-60050617fffff] PMD -> [fff8283f9e000000-fff8283f9e7fffff] on node 5
 [6005061800000-6005061ffffff] PMD -> [fff8283f9d800000-fff8283f9dffffff] on node 5
 [6005062000000-60050627fffff] PMD -> [fff8283f9d000000-fff8283f9d7fffff] on node 5
 [6005062800000-6005062ffffff] PMD -> [fff8283f9c800000-fff8283f9cffffff] on node 5
 [6005063000000-60050637fffff] PMD -> [fff8283f9c000000-fff8283f9c7fffff] on node 5
 [6005063800000-6005063ffffff] PMD -> [fff8283f9b800000-fff8283f9bffffff] on node 5
 [6005064000000-60050647fffff] PMD -> [fff8283f9b000000-fff8283f9b7fffff] on node 5
 [6005064800000-6005064ffffff] PMD -> [fff8283f9a800000-fff8283f9affffff] on node 5
 [6005065000000-60050657fffff] PMD -> [fff8283f9a000000-fff8283f9a7fffff] on node 5
 [6005065800000-6005065ffffff] PMD -> [fff8283f99800000-fff8283f99ffffff] on node 5
 [6005066000000-60050667fffff] PMD -> [fff8283f99000000-fff8283f997fffff] on node 5
 [6005066800000-6005066ffffff] PMD -> [fff8283f98800000-fff8283f98ffffff] on node 5
 [6005067000000-60050677fffff] PMD -> [fff8283f98000000-fff8283f987fffff] on node 5
 [6005067800000-6005067ffffff] PMD -> [fff8283f97800000-fff8283f97ffffff] on node 5
 [6005068000000-60050687fffff] PMD -> [fff8283f97000000-fff8283f977fffff] on node 5
 [6005068800000-6005068ffffff] PMD -> [fff8283f96800000-fff8283f96ffffff] on node 5
 [6005069000000-60050697fffff] PMD -> [fff8283f96000000-fff8283f967fffff] on node 5
 [6005069800000-6005069ffffff] PMD -> [fff8283f95800000-fff8283f95ffffff] on node 5
 [600506a000000-600506a7fffff] PMD -> [fff8283f95000000-fff8283f957fffff] on node 5
 [600506a800000-600506affffff] PMD -> [fff8283f94800000-fff8283f94ffffff] on node 5
 [600506b000000-600506b7fffff] PMD -> [fff8283f94000000-fff8283f947fffff] on node 5
 [600506b800000-600506bffffff] PMD -> [fff8283f93800000-fff8283f93ffffff] on node 5
 [600506c000000-600506c7fffff] PMD -> [fff8283f93000000-fff8283f937fffff] on node 5
 [600506c800000-600506cffffff] PMD -> [fff8283f92800000-fff8283f92ffffff] on node 5
 [600506d000000-600506d7fffff] PMD -> [fff8283f92000000-fff8283f927fffff] on node 5
 [600506d800000-600506dffffff] PMD -> [fff8283f91800000-fff8283f91ffffff] on node 5
 [600506e000000-600506e7fffff] PMD -> [fff8283f91000000-fff8283f917fffff] on node 5
 [600506e800000-600506effffff] PMD -> [fff8283f90800000-fff8283f90ffffff] on node 5
 [600506f000000-600506f7fffff] PMD -> [fff8283f90000000-fff8283f907fffff] on node 5
 [600506f800000-600506fffffff] PMD -> [fff8283f8f800000-fff8283f8fffffff] on node 5
 [6005070000000-60050707fffff] PMD -> [fff8283f8f000000-fff8283f8f7fffff] on node 5
 [6005070800000-6005070ffffff] PMD -> [fff8283f8e800000-fff8283f8effffff] on node 5
 [6005071000000-60050717fffff] PMD -> [fff8283f8e000000-fff8283f8e7fffff] on node 5
 [6005071800000-6005071ffffff] PMD -> [fff8283f8d800000-fff8283f8dffffff] on node 5
 [6005072000000-60050727fffff] PMD -> [fff8283f8d000000-fff8283f8d7fffff] on node 5
 [6005072800000-6005072ffffff] PMD -> [fff8283f8c800000-fff8283f8cffffff] on node 5
 [6005073000000-60050737fffff] PMD -> [fff8283f8c000000-fff8283f8c7fffff] on node 5
 [6005073800000-6005073ffffff] PMD -> [fff8283f8b800000-fff8283f8bffffff] on node 5
 [6005074000000-60050747fffff] PMD -> [fff8283f8b000000-fff8283f8b7fffff] on node 5
 [6005074800000-6005074ffffff] PMD -> [fff8283f8a800000-fff8283f8affffff] on node 5
 [6005075000000-60050757fffff] PMD -> [fff8283f8a000000-fff8283f8a7fffff] on node 5
 [6005075800000-6005075ffffff] PMD -> [fff8283f89800000-fff8283f89ffffff] on node 5
 [6005076000000-60050767fffff] PMD -> [fff8283f89000000-fff8283f897fffff] on node 5
 [6005076800000-6005076ffffff] PMD -> [fff8283f88800000-fff8283f88ffffff] on node 5
 [6005077000000-60050777fffff] PMD -> [fff8283f88000000-fff8283f887fffff] on node 5
 [6005077800000-6005077ffffff] PMD -> [fff8283f87800000-fff8283f87ffffff] on node 5
 [6005078000000-60050787fffff] PMD -> [fff8283f87000000-fff8283f877fffff] on node 5
 [6005078800000-6005078ffffff] PMD -> [fff8283f86800000-fff8283f86ffffff] on node 5
 [6005079000000-60050797fffff] PMD -> [fff8283f86000000-fff8283f867fffff] on node 5
 [6005079800000-6005079ffffff] PMD -> [fff8283f85800000-fff8283f85ffffff] on node 5
 [600507a000000-600507a7fffff] PMD -> [fff8283f85000000-fff8283f857fffff] on node 5
 [600507a800000-600507affffff] PMD -> [fff8283f84800000-fff8283f84ffffff] on node 5
 [600507b000000-600507b7fffff] PMD -> [fff8283f84000000-fff8283f847fffff] on node 5
 [600507b800000-600507bffffff] PMD -> [fff8283f83800000-fff8283f83ffffff] on node 5
 [600507c000000-600507c7fffff] PMD -> [fff8283f83000000-fff8283f837fffff] on node 5
 [600507c800000-600507cffffff] PMD -> [fff8283f82800000-fff8283f82ffffff] on node 5
 [600507d000000-600507d7fffff] PMD -> [fff8283f82000000-fff8283f827fffff] on node 5
 [600507d800000-600507dffffff] PMD -> [fff8283f81800000-fff8283f81ffffff] on node 5
 [600507e000000-600507e7fffff] PMD -> [fff8283f81000000-fff8283f817fffff] on node 5
 [600507e800000-600507effffff] PMD -> [fff8283f80800000-fff8283f80ffffff] on node 5
 [600507f000000-600507f7fffff] PMD -> [fff8283f80000000-fff8283f807fffff] on node 5
 [600507f800000-600507fffffff] PMD -> [fff8283f7f800000-fff8283f7fffffff] on node 5
 [6006000000000-60060007fffff] PMD -> [fff8303fff000000-fff8303fff7fffff] on node 6
 [6006000800000-6006000ffffff] PMD -> [fff8303ffe800000-fff8303ffeffffff] on node 6
 [6006001000000-60060017fffff] PMD -> [fff8303ffe000000-fff8303ffe7fffff] on node 6
 [6006001800000-6006001ffffff] PMD -> [fff8303ffd800000-fff8303ffdffffff] on node 6
 [6006002000000-60060027fffff] PMD -> [fff8303ffd000000-fff8303ffd7fffff] on node 6
 [6006002800000-6006002ffffff] PMD -> [fff8303ffc800000-fff8303ffcffffff] on node 6
 [6006003000000-60060037fffff] PMD -> [fff8303ffc000000-fff8303ffc7fffff] on node 6
 [6006003800000-6006003ffffff] PMD -> [fff8303ffb800000-fff8303ffbffffff] on node 6
 [6006004000000-60060047fffff] PMD -> [fff8303ffb000000-fff8303ffb7fffff] on node 6
 [6006004800000-6006004ffffff] PMD -> [fff8303ffa800000-fff8303ffaffffff] on node 6
 [6006005000000-60060057fffff] PMD -> [fff8303ffa000000-fff8303ffa7fffff] on node 6
 [6006005800000-6006005ffffff] PMD -> [fff8303ff9800000-fff8303ff9ffffff] on node 6
 [6006006000000-60060067fffff] PMD -> [fff8303ff9000000-fff8303ff97fffff] on node 6
 [6006006800000-6006006ffffff] PMD -> [fff8303ff8800000-fff8303ff8ffffff] on node 6
 [6006007000000-60060077fffff] PMD -> [fff8303ff8000000-fff8303ff87fffff] on node 6
 [6006007800000-6006007ffffff] PMD -> [fff8303ff7800000-fff8303ff7ffffff] on node 6
 [6006008000000-60060087fffff] PMD -> [fff8303ff7000000-fff8303ff77fffff] on node 6
 [6006008800000-6006008ffffff] PMD -> [fff8303ff6800000-fff8303ff6ffffff] on node 6
 [6006009000000-60060097fffff] PMD -> [fff8303ff6000000-fff8303ff67fffff] on node 6
 [6006009800000-6006009ffffff] PMD -> [fff8303ff5800000-fff8303ff5ffffff] on node 6
 [600600a000000-600600a7fffff] PMD -> [fff8303ff5000000-fff8303ff57fffff] on node 6
 [600600a800000-600600affffff] PMD -> [fff8303ff4800000-fff8303ff4ffffff] on node 6
 [600600b000000-600600b7fffff] PMD -> [fff8303ff4000000-fff8303ff47fffff] on node 6
 [600600b800000-600600bffffff] PMD -> [fff8303ff3800000-fff8303ff3ffffff] on node 6
 [600600c000000-600600c7fffff] PMD -> [fff8303ff3000000-fff8303ff37fffff] on node 6
 [600600c800000-600600cffffff] PMD -> [fff8303ff2800000-fff8303ff2ffffff] on node 6
 [600600d000000-600600d7fffff] PMD -> [fff8303ff2000000-fff8303ff27fffff] on node 6
 [600600d800000-600600dffffff] PMD -> [fff8303ff1800000-fff8303ff1ffffff] on node 6
 [600600e000000-600600e7fffff] PMD -> [fff8303ff1000000-fff8303ff17fffff] on node 6
 [600600e800000-600600effffff] PMD -> [fff8303ff0800000-fff8303ff0ffffff] on node 6
 [600600f000000-600600f7fffff] PMD -> [fff8303ff0000000-fff8303ff07fffff] on node 6
 [600600f800000-600600fffffff] PMD -> [fff8303fef800000-fff8303fefffffff] on node 6
 [6006010000000-60060107fffff] PMD -> [fff8303fef000000-fff8303fef7fffff] on node 6
 [6006010800000-6006010ffffff] PMD -> [fff8303fee800000-fff8303feeffffff] on node 6
 [6006011000000-60060117fffff] PMD -> [fff8303fee000000-fff8303fee7fffff] on node 6
 [6006011800000-6006011ffffff] PMD -> [fff8303fed800000-fff8303fedffffff] on node 6
 [6006012000000-60060127fffff] PMD -> [fff8303fed000000-fff8303fed7fffff] on node 6
 [6006012800000-6006012ffffff] PMD -> [fff8303fec800000-fff8303fecffffff] on node 6
 [6006013000000-60060137fffff] PMD -> [fff8303fec000000-fff8303fec7fffff] on node 6
 [6006013800000-6006013ffffff] PMD -> [fff8303feb800000-fff8303febffffff] on node 6
 [6006014000000-60060147fffff] PMD -> [fff8303feb000000-fff8303feb7fffff] on node 6
 [6006014800000-6006014ffffff] PMD -> [fff8303fea800000-fff8303feaffffff] on node 6
 [6006015000000-60060157fffff] PMD -> [fff8303fea000000-fff8303fea7fffff] on node 6
 [6006015800000-6006015ffffff] PMD -> [fff8303fe9800000-fff8303fe9ffffff] on node 6
 [6006016000000-60060167fffff] PMD -> [fff8303fe9000000-fff8303fe97fffff] on node 6
 [6006016800000-6006016ffffff] PMD -> [fff8303fe8800000-fff8303fe8ffffff] on node 6
 [6006017000000-60060177fffff] PMD -> [fff8303fe8000000-fff8303fe87fffff] on node 6
 [6006017800000-6006017ffffff] PMD -> [fff8303fe7800000-fff8303fe7ffffff] on node 6
 [6006018000000-60060187fffff] PMD -> [fff8303fe7000000-fff8303fe77fffff] on node 6
 [6006018800000-6006018ffffff] PMD -> [fff8303fe6800000-fff8303fe6ffffff] on node 6
 [6006019000000-60060197fffff] PMD -> [fff8303fe6000000-fff8303fe67fffff] on node 6
 [6006019800000-6006019ffffff] PMD -> [fff8303fe5800000-fff8303fe5ffffff] on node 6
 [600601a000000-600601a7fffff] PMD -> [fff8303fe5000000-fff8303fe57fffff] on node 6
 [600601a800000-600601affffff] PMD -> [fff8303fe4800000-fff8303fe4ffffff] on node 6
 [600601b000000-600601b7fffff] PMD -> [fff8303fe4000000-fff8303fe47fffff] on node 6
 [600601b800000-600601bffffff] PMD -> [fff8303fe3800000-fff8303fe3ffffff] on node 6
 [600601c000000-600601c7fffff] PMD -> [fff8303fe3000000-fff8303fe37fffff] on node 6
 [600601c800000-600601cffffff] PMD -> [fff8303fe2800000-fff8303fe2ffffff] on node 6
 [600601d000000-600601d7fffff] PMD -> [fff8303fe2000000-fff8303fe27fffff] on node 6
 [600601d800000-600601dffffff] PMD -> [fff8303fe1800000-fff8303fe1ffffff] on node 6
 [600601e000000-600601e7fffff] PMD -> [fff8303fe1000000-fff8303fe17fffff] on node 6
 [600601e800000-600601effffff] PMD -> [fff8303fe0800000-fff8303fe0ffffff] on node 6
 [600601f000000-600601f7fffff] PMD -> [fff8303fe0000000-fff8303fe07fffff] on node 6
 [600601f800000-600601fffffff] PMD -> [fff8303fdf800000-fff8303fdfffffff] on node 6
 [6006020000000-60060207fffff] PMD -> [fff8303fdf000000-fff8303fdf7fffff] on node 6
 [6006020800000-6006020ffffff] PMD -> [fff8303fde800000-fff8303fdeffffff] on node 6
 [6006021000000-60060217fffff] PMD -> [fff8303fde000000-fff8303fde7fffff] on node 6
 [6006021800000-6006021ffffff] PMD -> [fff8303fdd800000-fff8303fddffffff] on node 6
 [6006022000000-60060227fffff] PMD -> [fff8303fdd000000-fff8303fdd7fffff] on node 6
 [6006022800000-6006022ffffff] PMD -> [fff8303fdc800000-fff8303fdcffffff] on node 6
 [6006023000000-60060237fffff] PMD -> [fff8303fdc000000-fff8303fdc7fffff] on node 6
 [6006023800000-6006023ffffff] PMD -> [fff8303fdb800000-fff8303fdbffffff] on node 6
 [6006024000000-60060247fffff] PMD -> [fff8303fdb000000-fff8303fdb7fffff] on node 6
 [6006024800000-6006024ffffff] PMD -> [fff8303fda800000-fff8303fdaffffff] on node 6
 [6006025000000-60060257fffff] PMD -> [fff8303fda000000-fff8303fda7fffff] on node 6
 [6006025800000-6006025ffffff] PMD -> [fff8303fd9800000-fff8303fd9ffffff] on node 6
 [6006026000000-60060267fffff] PMD -> [fff8303fd9000000-fff8303fd97fffff] on node 6
 [6006026800000-6006026ffffff] PMD -> [fff8303fd8800000-fff8303fd8ffffff] on node 6
 [6006027000000-60060277fffff] PMD -> [fff8303fd8000000-fff8303fd87fffff] on node 6
 [6006027800000-6006027ffffff] PMD -> [fff8303fd7800000-fff8303fd7ffffff] on node 6
 [6006028000000-60060287fffff] PMD -> [fff8303fd7000000-fff8303fd77fffff] on node 6
 [6006028800000-6006028ffffff] PMD -> [fff8303fd6800000-fff8303fd6ffffff] on node 6
 [6006029000000-60060297fffff] PMD -> [fff8303fd6000000-fff8303fd67fffff] on node 6
 [6006029800000-6006029ffffff] PMD -> [fff8303fd5800000-fff8303fd5ffffff] on node 6
 [600602a000000-600602a7fffff] PMD -> [fff8303fd5000000-fff8303fd57fffff] on node 6
 [600602a800000-600602affffff] PMD -> [fff8303fd4800000-fff8303fd4ffffff] on node 6
 [600602b000000-600602b7fffff] PMD -> [fff8303fd4000000-fff8303fd47fffff] on node 6
 [600602b800000-600602bffffff] PMD -> [fff8303fd3800000-fff8303fd3ffffff] on node 6
 [600602c000000-600602c7fffff] PMD -> [fff8303fd3000000-fff8303fd37fffff] on node 6
 [600602c800000-600602cffffff] PMD -> [fff8303fd2800000-fff8303fd2ffffff] on node 6
 [600602d000000-600602d7fffff] PMD -> [fff8303fd2000000-fff8303fd27fffff] on node 6
 [600602d800000-600602dffffff] PMD -> [fff8303fd1800000-fff8303fd1ffffff] on node 6
 [600602e000000-600602e7fffff] PMD -> [fff8303fd1000000-fff8303fd17fffff] on node 6
 [600602e800000-600602effffff] PMD -> [fff8303fd0800000-fff8303fd0ffffff] on node 6
 [600602f000000-600602f7fffff] PMD -> [fff8303fd0000000-fff8303fd07fffff] on node 6
 [600602f800000-600602fffffff] PMD -> [fff8303fcf800000-fff8303fcfffffff] on node 6
 [6006030000000-60060307fffff] PMD -> [fff8303fcf000000-fff8303fcf7fffff] on node 6
 [6006030800000-6006030ffffff] PMD -> [fff8303fce800000-fff8303fceffffff] on node 6
 [6006031000000-60060317fffff] PMD -> [fff8303fce000000-fff8303fce7fffff] on node 6
 [6006031800000-6006031ffffff] PMD -> [fff8303fcd800000-fff8303fcdffffff] on node 6
 [6006032000000-60060327fffff] PMD -> [fff8303fcd000000-fff8303fcd7fffff] on node 6
 [6006032800000-6006032ffffff] PMD -> [fff8303fcc800000-fff8303fccffffff] on node 6
 [6006033000000-60060337fffff] PMD -> [fff8303fcc000000-fff8303fcc7fffff] on node 6
 [6006033800000-6006033ffffff] PMD -> [fff8303fcb800000-fff8303fcbffffff] on node 6
 [6006034000000-60060347fffff] PMD -> [fff8303fcb000000-fff8303fcb7fffff] on node 6
 [6006034800000-6006034ffffff] PMD -> [fff8303fca800000-fff8303fcaffffff] on node 6
 [6006035000000-60060357fffff] PMD -> [fff8303fca000000-fff8303fca7fffff] on node 6
 [6006035800000-6006035ffffff] PMD -> [fff8303fc9800000-fff8303fc9ffffff] on node 6
 [6006036000000-60060367fffff] PMD -> [fff8303fc9000000-fff8303fc97fffff] on node 6
 [6006036800000-6006036ffffff] PMD -> [fff8303fc8800000-fff8303fc8ffffff] on node 6
 [6006037000000-60060377fffff] PMD -> [fff8303fc8000000-fff8303fc87fffff] on node 6
 [6006037800000-6006037ffffff] PMD -> [fff8303fc7800000-fff8303fc7ffffff] on node 6
 [6006038000000-60060387fffff] PMD -> [fff8303fc7000000-fff8303fc77fffff] on node 6
 [6006038800000-6006038ffffff] PMD -> [fff8303fc6800000-fff8303fc6ffffff] on node 6
 [6006039000000-60060397fffff] PMD -> [fff8303fc6000000-fff8303fc67fffff] on node 6
 [6006039800000-6006039ffffff] PMD -> [fff8303fc5800000-fff8303fc5ffffff] on node 6
 [600603a000000-600603a7fffff] PMD -> [fff8303fc5000000-fff8303fc57fffff] on node 6
 [600603a800000-600603affffff] PMD -> [fff8303fc4800000-fff8303fc4ffffff] on node 6
 [600603b000000-600603b7fffff] PMD -> [fff8303fc4000000-fff8303fc47fffff] on node 6
 [600603b800000-600603bffffff] PMD -> [fff8303fc3800000-fff8303fc3ffffff] on node 6
 [600603c000000-600603c7fffff] PMD -> [fff8303fc3000000-fff8303fc37fffff] on node 6
 [600603c800000-600603cffffff] PMD -> [fff8303fc2800000-fff8303fc2ffffff] on node 6
 [600603d000000-600603d7fffff] PMD -> [fff8303fc2000000-fff8303fc27fffff] on node 6
 [600603d800000-600603dffffff] PMD -> [fff8303fc1800000-fff8303fc1ffffff] on node 6
 [600603e000000-600603e7fffff] PMD -> [fff8303fc1000000-fff8303fc17fffff] on node 6
 [600603e800000-600603effffff] PMD -> [fff8303fc0800000-fff8303fc0ffffff] on node 6
 [600603f000000-600603f7fffff] PMD -> [fff8303fc0000000-fff8303fc07fffff] on node 6
 [600603f800000-600603fffffff] PMD -> [fff8303fbf800000-fff8303fbfffffff] on node 6
 [6006040000000-60060407fffff] PMD -> [fff8303fbf000000-fff8303fbf7fffff] on node 6
 [6006040800000-6006040ffffff] PMD -> [fff8303fbe800000-fff8303fbeffffff] on node 6
 [6006041000000-60060417fffff] PMD -> [fff8303fbe000000-fff8303fbe7fffff] on node 6
 [6006041800000-6006041ffffff] PMD -> [fff8303fbd800000-fff8303fbdffffff] on node 6
 [6006042000000-60060427fffff] PMD -> [fff8303fbd000000-fff8303fbd7fffff] on node 6
 [6006042800000-6006042ffffff] PMD -> [fff8303fbc800000-fff8303fbcffffff] on node 6
 [6006043000000-60060437fffff] PMD -> [fff8303fbc000000-fff8303fbc7fffff] on node 6
 [6006043800000-6006043ffffff] PMD -> [fff8303fbb800000-fff8303fbbffffff] on node 6
 [6006044000000-60060447fffff] PMD -> [fff8303fbb000000-fff8303fbb7fffff] on node 6
 [6006044800000-6006044ffffff] PMD -> [fff8303fba800000-fff8303fbaffffff] on node 6
 [6006045000000-60060457fffff] PMD -> [fff8303fba000000-fff8303fba7fffff] on node 6
 [6006045800000-6006045ffffff] PMD -> [fff8303fb9800000-fff8303fb9ffffff] on node 6
 [6006046000000-60060467fffff] PMD -> [fff8303fb9000000-fff8303fb97fffff] on node 6
 [6006046800000-6006046ffffff] PMD -> [fff8303fb8800000-fff8303fb8ffffff] on node 6
 [6006047000000-60060477fffff] PMD -> [fff8303fb8000000-fff8303fb87fffff] on node 6
 [6006047800000-6006047ffffff] PMD -> [fff8303fb7800000-fff8303fb7ffffff] on node 6
 [6006048000000-60060487fffff] PMD -> [fff8303fb7000000-fff8303fb77fffff] on node 6
 [6006048800000-6006048ffffff] PMD -> [fff8303fb6800000-fff8303fb6ffffff] on node 6
 [6006049000000-60060497fffff] PMD -> [fff8303fb6000000-fff8303fb67fffff] on node 6
 [6006049800000-6006049ffffff] PMD -> [fff8303fb5800000-fff8303fb5ffffff] on node 6
 [600604a000000-600604a7fffff] PMD -> [fff8303fb5000000-fff8303fb57fffff] on node 6
 [600604a800000-600604affffff] PMD -> [fff8303fb4800000-fff8303fb4ffffff] on node 6
 [600604b000000-600604b7fffff] PMD -> [fff8303fb4000000-fff8303fb47fffff] on node 6
 [600604b800000-600604bffffff] PMD -> [fff8303fb3800000-fff8303fb3ffffff] on node 6
 [600604c000000-600604c7fffff] PMD -> [fff8303fb3000000-fff8303fb37fffff] on node 6
 [600604c800000-600604cffffff] PMD -> [fff8303fb2800000-fff8303fb2ffffff] on node 6
 [600604d000000-600604d7fffff] PMD -> [fff8303fb2000000-fff8303fb27fffff] on node 6
 [600604d800000-600604dffffff] PMD -> [fff8303fb1800000-fff8303fb1ffffff] on node 6
 [600604e000000-600604e7fffff] PMD -> [fff8303fb1000000-fff8303fb17fffff] on node 6
 [600604e800000-600604effffff] PMD -> [fff8303fb0800000-fff8303fb0ffffff] on node 6
 [600604f000000-600604f7fffff] PMD -> [fff8303fb0000000-fff8303fb07fffff] on node 6
 [600604f800000-600604fffffff] PMD -> [fff8303faf800000-fff8303fafffffff] on node 6
 [6006050000000-60060507fffff] PMD -> [fff8303faf000000-fff8303faf7fffff] on node 6
 [6006050800000-6006050ffffff] PMD -> [fff8303fae800000-fff8303faeffffff] on node 6
 [6006051000000-60060517fffff] PMD -> [fff8303fae000000-fff8303fae7fffff] on node 6
 [6006051800000-6006051ffffff] PMD -> [fff8303fad800000-fff8303fadffffff] on node 6
 [6006052000000-60060527fffff] PMD -> [fff8303fad000000-fff8303fad7fffff] on node 6
 [6006052800000-6006052ffffff] PMD -> [fff8303fac800000-fff8303facffffff] on node 6
 [6006053000000-60060537fffff] PMD -> [fff8303fac000000-fff8303fac7fffff] on node 6
 [6006053800000-6006053ffffff] PMD -> [fff8303fab800000-fff8303fabffffff] on node 6
 [6006054000000-60060547fffff] PMD -> [fff8303fab000000-fff8303fab7fffff] on node 6
 [6006054800000-6006054ffffff] PMD -> [fff8303faa800000-fff8303faaffffff] on node 6
 [6006055000000-60060557fffff] PMD -> [fff8303faa000000-fff8303faa7fffff] on node 6
 [6006055800000-6006055ffffff] PMD -> [fff8303fa9800000-fff8303fa9ffffff] on node 6
 [6006056000000-60060567fffff] PMD -> [fff8303fa9000000-fff8303fa97fffff] on node 6
 [6006056800000-6006056ffffff] PMD -> [fff8303fa8800000-fff8303fa8ffffff] on node 6
 [6006057000000-60060577fffff] PMD -> [fff8303fa8000000-fff8303fa87fffff] on node 6
 [6006057800000-6006057ffffff] PMD -> [fff8303fa7800000-fff8303fa7ffffff] on node 6
 [6006058000000-60060587fffff] PMD -> [fff8303fa7000000-fff8303fa77fffff] on node 6
 [6006058800000-6006058ffffff] PMD -> [fff8303fa6800000-fff8303fa6ffffff] on node 6
 [6006059000000-60060597fffff] PMD -> [fff8303fa6000000-fff8303fa67fffff] on node 6
 [6006059800000-6006059ffffff] PMD -> [fff8303fa5800000-fff8303fa5ffffff] on node 6
 [600605a000000-600605a7fffff] PMD -> [fff8303fa5000000-fff8303fa57fffff] on node 6
 [600605a800000-600605affffff] PMD -> [fff8303fa4800000-fff8303fa4ffffff] on node 6
 [600605b000000-600605b7fffff] PMD -> [fff8303fa4000000-fff8303fa47fffff] on node 6
 [600605b800000-600605bffffff] PMD -> [fff8303fa3800000-fff8303fa3ffffff] on node 6
 [600605c000000-600605c7fffff] PMD -> [fff8303fa3000000-fff8303fa37fffff] on node 6
 [600605c800000-600605cffffff] PMD -> [fff8303fa2800000-fff8303fa2ffffff] on node 6
 [600605d000000-600605d7fffff] PMD -> [fff8303fa2000000-fff8303fa27fffff] on node 6
 [600605d800000-600605dffffff] PMD -> [fff8303fa1800000-fff8303fa1ffffff] on node 6
 [600605e000000-600605e7fffff] PMD -> [fff8303fa1000000-fff8303fa17fffff] on node 6
 [600605e800000-600605effffff] PMD -> [fff8303fa0800000-fff8303fa0ffffff] on node 6
 [600605f000000-600605f7fffff] PMD -> [fff8303fa0000000-fff8303fa07fffff] on node 6
 [600605f800000-600605fffffff] PMD -> [fff8303f9f800000-fff8303f9fffffff] on node 6
 [6006060000000-60060607fffff] PMD -> [fff8303f9f000000-fff8303f9f7fffff] on node 6
 [6006060800000-6006060ffffff] PMD -> [fff8303f9e800000-fff8303f9effffff] on node 6
 [6006061000000-60060617fffff] PMD -> [fff8303f9e000000-fff8303f9e7fffff] on node 6
 [6006061800000-6006061ffffff] PMD -> [fff8303f9d800000-fff8303f9dffffff] on node 6
 [6006062000000-60060627fffff] PMD -> [fff8303f9d000000-fff8303f9d7fffff] on node 6
 [6006062800000-6006062ffffff] PMD -> [fff8303f9c800000-fff8303f9cffffff] on node 6
 [6006063000000-60060637fffff] PMD -> [fff8303f9c000000-fff8303f9c7fffff] on node 6
 [6006063800000-6006063ffffff] PMD -> [fff8303f9b800000-fff8303f9bffffff] on node 6
 [6006064000000-60060647fffff] PMD -> [fff8303f9b000000-fff8303f9b7fffff] on node 6
 [6006064800000-6006064ffffff] PMD -> [fff8303f9a800000-fff8303f9affffff] on node 6
 [6006065000000-60060657fffff] PMD -> [fff8303f9a000000-fff8303f9a7fffff] on node 6
 [6006065800000-6006065ffffff] PMD -> [fff8303f99800000-fff8303f99ffffff] on node 6
 [6006066000000-60060667fffff] PMD -> [fff8303f99000000-fff8303f997fffff] on node 6
 [6006066800000-6006066ffffff] PMD -> [fff8303f98800000-fff8303f98ffffff] on node 6
 [6006067000000-60060677fffff] PMD -> [fff8303f98000000-fff8303f987fffff] on node 6
 [6006067800000-6006067ffffff] PMD -> [fff8303f97800000-fff8303f97ffffff] on node 6
 [6006068000000-60060687fffff] PMD -> [fff8303f97000000-fff8303f977fffff] on node 6
 [6006068800000-6006068ffffff] PMD -> [fff8303f96800000-fff8303f96ffffff] on node 6
 [6006069000000-60060697fffff] PMD -> [fff8303f96000000-fff8303f967fffff] on node 6
 [6006069800000-6006069ffffff] PMD -> [fff8303f95800000-fff8303f95ffffff] on node 6
 [600606a000000-600606a7fffff] PMD -> [fff8303f95000000-fff8303f957fffff] on node 6
 [600606a800000-600606affffff] PMD -> [fff8303f94800000-fff8303f94ffffff] on node 6
 [600606b000000-600606b7fffff] PMD -> [fff8303f94000000-fff8303f947fffff] on node 6
 [600606b800000-600606bffffff] PMD -> [fff8303f93800000-fff8303f93ffffff] on node 6
 [600606c000000-600606c7fffff] PMD -> [fff8303f93000000-fff8303f937fffff] on node 6
 [600606c800000-600606cffffff] PMD -> [fff8303f92800000-fff8303f92ffffff] on node 6
 [600606d000000-600606d7fffff] PMD -> [fff8303f92000000-fff8303f927fffff] on node 6
 [600606d800000-600606dffffff] PMD -> [fff8303f91800000-fff8303f91ffffff] on node 6
 [600606e000000-600606e7fffff] PMD -> [fff8303f91000000-fff8303f917fffff] on node 6
 [600606e800000-600606effffff] PMD -> [fff8303f90800000-fff8303f90ffffff] on node 6
 [600606f000000-600606f7fffff] PMD -> [fff8303f90000000-fff8303f907fffff] on node 6
 [600606f800000-600606fffffff] PMD -> [fff8303f8f800000-fff8303f8fffffff] on node 6
 [6006070000000-60060707fffff] PMD -> [fff8303f8f000000-fff8303f8f7fffff] on node 6
 [6006070800000-6006070ffffff] PMD -> [fff8303f8e800000-fff8303f8effffff] on node 6
 [6006071000000-60060717fffff] PMD -> [fff8303f8e000000-fff8303f8e7fffff] on node 6
 [6006071800000-6006071ffffff] PMD -> [fff8303f8d800000-fff8303f8dffffff] on node 6
 [6006072000000-60060727fffff] PMD -> [fff8303f8d000000-fff8303f8d7fffff] on node 6
 [6006072800000-6006072ffffff] PMD -> [fff8303f8c800000-fff8303f8cffffff] on node 6
 [6006073000000-60060737fffff] PMD -> [fff8303f8c000000-fff8303f8c7fffff] on node 6
 [6006073800000-6006073ffffff] PMD -> [fff8303f8b800000-fff8303f8bffffff] on node 6
 [6006074000000-60060747fffff] PMD -> [fff8303f8b000000-fff8303f8b7fffff] on node 6
 [6006074800000-6006074ffffff] PMD -> [fff8303f8a800000-fff8303f8affffff] on node 6
 [6006075000000-60060757fffff] PMD -> [fff8303f8a000000-fff8303f8a7fffff] on node 6
 [6006075800000-6006075ffffff] PMD -> [fff8303f89800000-fff8303f89ffffff] on node 6
 [6006076000000-60060767fffff] PMD -> [fff8303f89000000-fff8303f897fffff] on node 6
 [6006076800000-6006076ffffff] PMD -> [fff8303f88800000-fff8303f88ffffff] on node 6
 [6006077000000-60060777fffff] PMD -> [fff8303f88000000-fff8303f887fffff] on node 6
 [6006077800000-6006077ffffff] PMD -> [fff8303f87800000-fff8303f87ffffff] on node 6
 [6006078000000-60060787fffff] PMD -> [fff8303f87000000-fff8303f877fffff] on node 6
 [6006078800000-6006078ffffff] PMD -> [fff8303f86800000-fff8303f86ffffff] on node 6
 [6006079000000-60060797fffff] PMD -> [fff8303f86000000-fff8303f867fffff] on node 6
 [6006079800000-6006079ffffff] PMD -> [fff8303f85800000-fff8303f85ffffff] on node 6
 [600607a000000-600607a7fffff] PMD -> [fff8303f85000000-fff8303f857fffff] on node 6
 [600607a800000-600607affffff] PMD -> [fff8303f84800000-fff8303f84ffffff] on node 6
 [600607b000000-600607b7fffff] PMD -> [fff8303f84000000-fff8303f847fffff] on node 6
 [600607b800000-600607bffffff] PMD -> [fff8303f83800000-fff8303f83ffffff] on node 6
 [600607c000000-600607c7fffff] PMD -> [fff8303f83000000-fff8303f837fffff] on node 6
 [600607c800000-600607cffffff] PMD -> [fff8303f82800000-fff8303f82ffffff] on node 6
 [600607d000000-600607d7fffff] PMD -> [fff8303f82000000-fff8303f827fffff] on node 6
 [600607d800000-600607dffffff] PMD -> [fff8303f81800000-fff8303f81ffffff] on node 6
 [600607e000000-600607e7fffff] PMD -> [fff8303f81000000-fff8303f817fffff] on node 6
 [600607e800000-600607effffff] PMD -> [fff8303f80800000-fff8303f80ffffff] on node 6
 [600607f000000-600607f7fffff] PMD -> [fff8303f80000000-fff8303f807fffff] on node 6
 [600607f800000-600607fffffff] PMD -> [fff8303f7f800000-fff8303f7fffffff] on node 6
 [6007000000000-60070007fffff] PMD -> [fff8383ffb000000-fff8383ffb7fffff] on node 7
 [6007000800000-6007000ffffff] PMD -> [fff8383ffa800000-fff8383ffaffffff] on node 7
 [6007001000000-60070017fffff] PMD -> [fff8383ffa000000-fff8383ffa7fffff] on node 7
 [6007001800000-6007001ffffff] PMD -> [fff8383ff9800000-fff8383ff9ffffff] on node 7
 [6007002000000-60070027fffff] PMD -> [fff8383ff9000000-fff8383ff97fffff] on node 7
 [6007002800000-6007002ffffff] PMD -> [fff8383ff8800000-fff8383ff8ffffff] on node 7
 [6007003000000-60070037fffff] PMD -> [fff8383ff8000000-fff8383ff87fffff] on node 7
 [6007003800000-6007003ffffff] PMD -> [fff8383ff7800000-fff8383ff7ffffff] on node 7
 [6007004000000-60070047fffff] PMD -> [fff8383ff7000000-fff8383ff77fffff] on node 7
 [6007004800000-6007004ffffff] PMD -> [fff8383ff6800000-fff8383ff6ffffff] on node 7
 [6007005000000-60070057fffff] PMD -> [fff8383ff6000000-fff8383ff67fffff] on node 7
 [6007005800000-6007005ffffff] PMD -> [fff8383ff5800000-fff8383ff5ffffff] on node 7
 [6007006000000-60070067fffff] PMD -> [fff8383ff5000000-fff8383ff57fffff] on node 7
 [6007006800000-6007006ffffff] PMD -> [fff8383ff4800000-fff8383ff4ffffff] on node 7
 [6007007000000-60070077fffff] PMD -> [fff8383ff4000000-fff8383ff47fffff] on node 7
 [6007007800000-6007007ffffff] PMD -> [fff8383ff3800000-fff8383ff3ffffff] on node 7
 [6007008000000-60070087fffff] PMD -> [fff8383ff3000000-fff8383ff37fffff] on node 7
 [6007008800000-6007008ffffff] PMD -> [fff8383ff2800000-fff8383ff2ffffff] on node 7
 [6007009000000-60070097fffff] PMD -> [fff8383ff2000000-fff8383ff27fffff] on node 7
 [6007009800000-6007009ffffff] PMD -> [fff8383ff1800000-fff8383ff1ffffff] on node 7
 [600700a000000-600700a7fffff] PMD -> [fff8383ff1000000-fff8383ff17fffff] on node 7
 [600700a800000-600700affffff] PMD -> [fff8383ff0800000-fff8383ff0ffffff] on node 7
 [600700b000000-600700b7fffff] PMD -> [fff8383ff0000000-fff8383ff07fffff] on node 7
 [600700b800000-600700bffffff] PMD -> [fff8383fef800000-fff8383fefffffff] on node 7
 [600700c000000-600700c7fffff] PMD -> [fff8383fef000000-fff8383fef7fffff] on node 7
 [600700c800000-600700cffffff] PMD -> [fff8383fee800000-fff8383feeffffff] on node 7
 [600700d000000-600700d7fffff] PMD -> [fff8383fee000000-fff8383fee7fffff] on node 7
 [600700d800000-600700dffffff] PMD -> [fff8383fed800000-fff8383fedffffff] on node 7
 [600700e000000-600700e7fffff] PMD -> [fff8383fed000000-fff8383fed7fffff] on node 7
 [600700e800000-600700effffff] PMD -> [fff8383fec800000-fff8383fecffffff] on node 7
 [600700f000000-600700f7fffff] PMD -> [fff8383fec000000-fff8383fec7fffff] on node 7
 [600700f800000-600700fffffff] PMD -> [fff8383feb800000-fff8383febffffff] on node 7
 [6007010000000-60070107fffff] PMD -> [fff8383feb000000-fff8383feb7fffff] on node 7
 [6007010800000-6007010ffffff] PMD -> [fff8383fea800000-fff8383feaffffff] on node 7
 [6007011000000-60070117fffff] PMD -> [fff8383fea000000-fff8383fea7fffff] on node 7
 [6007011800000-6007011ffffff] PMD -> [fff8383fe9800000-fff8383fe9ffffff] on node 7
 [6007012000000-60070127fffff] PMD -> [fff8383fe9000000-fff8383fe97fffff] on node 7
 [6007012800000-6007012ffffff] PMD -> [fff8383fe8800000-fff8383fe8ffffff] on node 7
 [6007013000000-60070137fffff] PMD -> [fff8383fe8000000-fff8383fe87fffff] on node 7
 [6007013800000-6007013ffffff] PMD -> [fff8383fe7800000-fff8383fe7ffffff] on node 7
 [6007014000000-60070147fffff] PMD -> [fff8383fe7000000-fff8383fe77fffff] on node 7
 [6007014800000-6007014ffffff] PMD -> [fff8383fe6800000-fff8383fe6ffffff] on node 7
 [6007015000000-60070157fffff] PMD -> [fff8383fe6000000-fff8383fe67fffff] on node 7
 [6007015800000-6007015ffffff] PMD -> [fff8383fe5800000-fff8383fe5ffffff] on node 7
 [6007016000000-60070167fffff] PMD -> [fff8383fe5000000-fff8383fe57fffff] on node 7
 [6007016800000-6007016ffffff] PMD -> [fff8383fe4800000-fff8383fe4ffffff] on node 7
 [6007017000000-60070177fffff] PMD -> [fff8383fe4000000-fff8383fe47fffff] on node 7
 [6007017800000-6007017ffffff] PMD -> [fff8383fe3800000-fff8383fe3ffffff] on node 7
 [6007018000000-60070187fffff] PMD -> [fff8383fe3000000-fff8383fe37fffff] on node 7
 [6007018800000-6007018ffffff] PMD -> [fff8383fe2800000-fff8383fe2ffffff] on node 7
 [6007019000000-60070197fffff] PMD -> [fff8383fe2000000-fff8383fe27fffff] on node 7
 [6007019800000-6007019ffffff] PMD -> [fff8383fe1800000-fff8383fe1ffffff] on node 7
 [600701a000000-600701a7fffff] PMD -> [fff8383fe1000000-fff8383fe17fffff] on node 7
 [600701a800000-600701affffff] PMD -> [fff8383fe0800000-fff8383fe0ffffff] on node 7
 [600701b000000-600701b7fffff] PMD -> [fff8383fe0000000-fff8383fe07fffff] on node 7
 [600701b800000-600701bffffff] PMD -> [fff8383fdf800000-fff8383fdfffffff] on node 7
 [600701c000000-600701c7fffff] PMD -> [fff8383fdf000000-fff8383fdf7fffff] on node 7
 [600701c800000-600701cffffff] PMD -> [fff8383fde800000-fff8383fdeffffff] on node 7
 [600701d000000-600701d7fffff] PMD -> [fff8383fde000000-fff8383fde7fffff] on node 7
 [600701d800000-600701dffffff] PMD -> [fff8383fdd800000-fff8383fddffffff] on node 7
 [600701e000000-600701e7fffff] PMD -> [fff8383fdd000000-fff8383fdd7fffff] on node 7
 [600701e800000-600701effffff] PMD -> [fff8383fdc800000-fff8383fdcffffff] on node 7
 [600701f000000-600701f7fffff] PMD -> [fff8383fdc000000-fff8383fdc7fffff] on node 7
 [600701f800000-600701fffffff] PMD -> [fff8383fdb800000-fff8383fdbffffff] on node 7
 [6007020000000-60070207fffff] PMD -> [fff8383fdb000000-fff8383fdb7fffff] on node 7
 [6007020800000-6007020ffffff] PMD -> [fff8383fda800000-fff8383fdaffffff] on node 7
 [6007021000000-60070217fffff] PMD -> [fff8383fda000000-fff8383fda7fffff] on node 7
 [6007021800000-6007021ffffff] PMD -> [fff8383fd9800000-fff8383fd9ffffff] on node 7
 [6007022000000-60070227fffff] PMD -> [fff8383fd9000000-fff8383fd97fffff] on node 7
 [6007022800000-6007022ffffff] PMD -> [fff8383fd8800000-fff8383fd8ffffff] on node 7
 [6007023000000-60070237fffff] PMD -> [fff8383fd8000000-fff8383fd87fffff] on node 7
 [6007023800000-6007023ffffff] PMD -> [fff8383fd7800000-fff8383fd7ffffff] on node 7
 [6007024000000-60070247fffff] PMD -> [fff8383fd7000000-fff8383fd77fffff] on node 7
 [6007024800000-6007024ffffff] PMD -> [fff8383fd6800000-fff8383fd6ffffff] on node 7
 [6007025000000-60070257fffff] PMD -> [fff8383fd6000000-fff8383fd67fffff] on node 7
 [6007025800000-6007025ffffff] PMD -> [fff8383fd5800000-fff8383fd5ffffff] on node 7
 [6007026000000-60070267fffff] PMD -> [fff8383fd5000000-fff8383fd57fffff] on node 7
 [6007026800000-6007026ffffff] PMD -> [fff8383fd4800000-fff8383fd4ffffff] on node 7
 [6007027000000-60070277fffff] PMD -> [fff8383fd4000000-fff8383fd47fffff] on node 7
 [6007027800000-6007027ffffff] PMD -> [fff8383fd3800000-fff8383fd3ffffff] on node 7
 [6007028000000-60070287fffff] PMD -> [fff8383fd3000000-fff8383fd37fffff] on node 7
 [6007028800000-6007028ffffff] PMD -> [fff8383fd2800000-fff8383fd2ffffff] on node 7
 [6007029000000-60070297fffff] PMD -> [fff8383fd2000000-fff8383fd27fffff] on node 7
 [6007029800000-6007029ffffff] PMD -> [fff8383fd1800000-fff8383fd1ffffff] on node 7
 [600702a000000-600702a7fffff] PMD -> [fff8383fd1000000-fff8383fd17fffff] on node 7
 [600702a800000-600702affffff] PMD -> [fff8383fd0800000-fff8383fd0ffffff] on node 7
 [600702b000000-600702b7fffff] PMD -> [fff8383fd0000000-fff8383fd07fffff] on node 7
 [600702b800000-600702bffffff] PMD -> [fff8383fcf800000-fff8383fcfffffff] on node 7
 [600702c000000-600702c7fffff] PMD -> [fff8383fcf000000-fff8383fcf7fffff] on node 7
 [600702c800000-600702cffffff] PMD -> [fff8383fce800000-fff8383fceffffff] on node 7
 [600702d000000-600702d7fffff] PMD -> [fff8383fce000000-fff8383fce7fffff] on node 7
 [600702d800000-600702dffffff] PMD -> [fff8383fcd800000-fff8383fcdffffff] on node 7
 [600702e000000-600702e7fffff] PMD -> [fff8383fcd000000-fff8383fcd7fffff] on node 7
 [600702e800000-600702effffff] PMD -> [fff8383fcc800000-fff8383fccffffff] on node 7
 [600702f000000-600702f7fffff] PMD -> [fff8383fcc000000-fff8383fcc7fffff] on node 7
 [600702f800000-600702fffffff] PMD -> [fff8383fcb800000-fff8383fcbffffff] on node 7
 [6007030000000-60070307fffff] PMD -> [fff8383fcb000000-fff8383fcb7fffff] on node 7
 [6007030800000-6007030ffffff] PMD -> [fff8383fca800000-fff8383fcaffffff] on node 7
 [6007031000000-60070317fffff] PMD -> [fff8383fca000000-fff8383fca7fffff] on node 7
 [6007031800000-6007031ffffff] PMD -> [fff8383fc9800000-fff8383fc9ffffff] on node 7
 [6007032000000-60070327fffff] PMD -> [fff8383fc9000000-fff8383fc97fffff] on node 7
 [6007032800000-6007032ffffff] PMD -> [fff8383fc8800000-fff8383fc8ffffff] on node 7
 [6007033000000-60070337fffff] PMD -> [fff8383fc8000000-fff8383fc87fffff] on node 7
 [6007033800000-6007033ffffff] PMD -> [fff8383fc7800000-fff8383fc7ffffff] on node 7
 [6007034000000-60070347fffff] PMD -> [fff8383fc7000000-fff8383fc77fffff] on node 7
 [6007034800000-6007034ffffff] PMD -> [fff8383fc6800000-fff8383fc6ffffff] on node 7
 [6007035000000-60070357fffff] PMD -> [fff8383fc6000000-fff8383fc67fffff] on node 7
 [6007035800000-6007035ffffff] PMD -> [fff8383fc5800000-fff8383fc5ffffff] on node 7
 [6007036000000-60070367fffff] PMD -> [fff8383fc5000000-fff8383fc57fffff] on node 7
 [6007036800000-6007036ffffff] PMD -> [fff8383fc4800000-fff8383fc4ffffff] on node 7
 [6007037000000-60070377fffff] PMD -> [fff8383fc4000000-fff8383fc47fffff] on node 7
 [6007037800000-6007037ffffff] PMD -> [fff8383fc3800000-fff8383fc3ffffff] on node 7
 [6007038000000-60070387fffff] PMD -> [fff8383fc3000000-fff8383fc37fffff] on node 7
 [6007038800000-6007038ffffff] PMD -> [fff8383fc2800000-fff8383fc2ffffff] on node 7
 [6007039000000-60070397fffff] PMD -> [fff8383fc2000000-fff8383fc27fffff] on node 7
 [6007039800000-6007039ffffff] PMD -> [fff8383fc1800000-fff8383fc1ffffff] on node 7
 [600703a000000-600703a7fffff] PMD -> [fff8383fc1000000-fff8383fc17fffff] on node 7
 [600703a800000-600703affffff] PMD -> [fff8383fc0800000-fff8383fc0ffffff] on node 7
 [600703b000000-600703b7fffff] PMD -> [fff8383fc0000000-fff8383fc07fffff] on node 7
 [600703b800000-600703bffffff] PMD -> [fff8383fbf800000-fff8383fbfffffff] on node 7
 [600703c000000-600703c7fffff] PMD -> [fff8383fbf000000-fff8383fbf7fffff] on node 7
 [600703c800000-600703cffffff] PMD -> [fff8383fbe800000-fff8383fbeffffff] on node 7
 [600703d000000-600703d7fffff] PMD -> [fff8383fbe000000-fff8383fbe7fffff] on node 7
 [600703d800000-600703dffffff] PMD -> [fff8383fbd800000-fff8383fbdffffff] on node 7
 [600703e000000-600703e7fffff] PMD -> [fff8383fbd000000-fff8383fbd7fffff] on node 7
 [600703e800000-600703effffff] PMD -> [fff8383fbc800000-fff8383fbcffffff] on node 7
 [600703f000000-600703f7fffff] PMD -> [fff8383fbc000000-fff8383fbc7fffff] on node 7
 [600703f800000-600703fffffff] PMD -> [fff8383fbb800000-fff8383fbbffffff] on node 7
 [6007040000000-60070407fffff] PMD -> [fff8383fbb000000-fff8383fbb7fffff] on node 7
 [6007040800000-6007040ffffff] PMD -> [fff8383fba800000-fff8383fbaffffff] on node 7
 [6007041000000-60070417fffff] PMD -> [fff8383fba000000-fff8383fba7fffff] on node 7
 [6007041800000-6007041ffffff] PMD -> [fff8383fb9800000-fff8383fb9ffffff] on node 7
 [6007042000000-60070427fffff] PMD -> [fff8383fb9000000-fff8383fb97fffff] on node 7
 [6007042800000-6007042ffffff] PMD -> [fff8383fb8800000-fff8383fb8ffffff] on node 7
 [6007043000000-60070437fffff] PMD -> [fff8383fb8000000-fff8383fb87fffff] on node 7
 [6007043800000-6007043ffffff] PMD -> [fff8383fb7800000-fff8383fb7ffffff] on node 7
 [6007044000000-60070447fffff] PMD -> [fff8383fb7000000-fff8383fb77fffff] on node 7
 [6007044800000-6007044ffffff] PMD -> [fff8383fb6800000-fff8383fb6ffffff] on node 7
 [6007045000000-60070457fffff] PMD -> [fff8383fb6000000-fff8383fb67fffff] on node 7
 [6007045800000-6007045ffffff] PMD -> [fff8383fb5800000-fff8383fb5ffffff] on node 7
 [6007046000000-60070467fffff] PMD -> [fff8383fb5000000-fff8383fb57fffff] on node 7
 [6007046800000-6007046ffffff] PMD -> [fff8383fb4800000-fff8383fb4ffffff] on node 7
 [6007047000000-60070477fffff] PMD -> [fff8383fb4000000-fff8383fb47fffff] on node 7
 [6007047800000-6007047ffffff] PMD -> [fff8383fb3800000-fff8383fb3ffffff] on node 7
 [6007048000000-60070487fffff] PMD -> [fff8383fb3000000-fff8383fb37fffff] on node 7
 [6007048800000-6007048ffffff] PMD -> [fff8383fb2800000-fff8383fb2ffffff] on node 7
 [6007049000000-60070497fffff] PMD -> [fff8383fb2000000-fff8383fb27fffff] on node 7
 [6007049800000-6007049ffffff] PMD -> [fff8383fb1800000-fff8383fb1ffffff] on node 7
 [600704a000000-600704a7fffff] PMD -> [fff8383fb1000000-fff8383fb17fffff] on node 7
 [600704a800000-600704affffff] PMD -> [fff8383fb0800000-fff8383fb0ffffff] on node 7
 [600704b000000-600704b7fffff] PMD -> [fff8383fb0000000-fff8383fb07fffff] on node 7
 [600704b800000-600704bffffff] PMD -> [fff8383faf800000-fff8383fafffffff] on node 7
 [600704c000000-600704c7fffff] PMD -> [fff8383faf000000-fff8383faf7fffff] on node 7
 [600704c800000-600704cffffff] PMD -> [fff8383fae800000-fff8383faeffffff] on node 7
 [600704d000000-600704d7fffff] PMD -> [fff8383fae000000-fff8383fae7fffff] on node 7
 [600704d800000-600704dffffff] PMD -> [fff8383fad800000-fff8383fadffffff] on node 7
 [600704e000000-600704e7fffff] PMD -> [fff8383fad000000-fff8383fad7fffff] on node 7
 [600704e800000-600704effffff] PMD -> [fff8383fac800000-fff8383facffffff] on node 7
 [600704f000000-600704f7fffff] PMD -> [fff8383fac000000-fff8383fac7fffff] on node 7
 [600704f800000-600704fffffff] PMD -> [fff8383fab800000-fff8383fabffffff] on node 7
 [6007050000000-60070507fffff] PMD -> [fff8383fab000000-fff8383fab7fffff] on node 7
 [6007050800000-6007050ffffff] PMD -> [fff8383faa800000-fff8383faaffffff] on node 7
 [6007051000000-60070517fffff] PMD -> [fff8383faa000000-fff8383faa7fffff] on node 7
 [6007051800000-6007051ffffff] PMD -> [fff8383fa9800000-fff8383fa9ffffff] on node 7
 [6007052000000-60070527fffff] PMD -> [fff8383fa9000000-fff8383fa97fffff] on node 7
 [6007052800000-6007052ffffff] PMD -> [fff8383fa8800000-fff8383fa8ffffff] on node 7
 [6007053000000-60070537fffff] PMD -> [fff8383fa8000000-fff8383fa87fffff] on node 7
 [6007053800000-6007053ffffff] PMD -> [fff8383fa7800000-fff8383fa7ffffff] on node 7
 [6007054000000-60070547fffff] PMD -> [fff8383fa7000000-fff8383fa77fffff] on node 7
 [6007054800000-6007054ffffff] PMD -> [fff8383fa6800000-fff8383fa6ffffff] on node 7
 [6007055000000-60070557fffff] PMD -> [fff8383fa6000000-fff8383fa67fffff] on node 7
 [6007055800000-6007055ffffff] PMD -> [fff8383fa5800000-fff8383fa5ffffff] on node 7
 [6007056000000-60070567fffff] PMD -> [fff8383fa5000000-fff8383fa57fffff] on node 7
 [6007056800000-6007056ffffff] PMD -> [fff8383fa4800000-fff8383fa4ffffff] on node 7
 [6007057000000-60070577fffff] PMD -> [fff8383fa4000000-fff8383fa47fffff] on node 7
 [6007057800000-6007057ffffff] PMD -> [fff8383fa3800000-fff8383fa3ffffff] on node 7
 [6007058000000-60070587fffff] PMD -> [fff8383fa3000000-fff8383fa37fffff] on node 7
 [6007058800000-6007058ffffff] PMD -> [fff8383fa2800000-fff8383fa2ffffff] on node 7
 [6007059000000-60070597fffff] PMD -> [fff8383fa2000000-fff8383fa27fffff] on node 7
 [6007059800000-6007059ffffff] PMD -> [fff8383fa1800000-fff8383fa1ffffff] on node 7
 [600705a000000-600705a7fffff] PMD -> [fff8383fa1000000-fff8383fa17fffff] on node 7
 [600705a800000-600705affffff] PMD -> [fff8383fa0800000-fff8383fa0ffffff] on node 7
 [600705b000000-600705b7fffff] PMD -> [fff8383fa0000000-fff8383fa07fffff] on node 7
 [600705b800000-600705bffffff] PMD -> [fff8383f9f800000-fff8383f9fffffff] on node 7
 [600705c000000-600705c7fffff] PMD -> [fff8383f9f000000-fff8383f9f7fffff] on node 7
 [600705c800000-600705cffffff] PMD -> [fff8383f9e800000-fff8383f9effffff] on node 7
 [600705d000000-600705d7fffff] PMD -> [fff8383f9e000000-fff8383f9e7fffff] on node 7
 [600705d800000-600705dffffff] PMD -> [fff8383f9d800000-fff8383f9dffffff] on node 7
 [600705e000000-600705e7fffff] PMD -> [fff8383f9d000000-fff8383f9d7fffff] on node 7
 [600705e800000-600705effffff] PMD -> [fff8383f9c800000-fff8383f9cffffff] on node 7
 [600705f000000-600705f7fffff] PMD -> [fff8383f9c000000-fff8383f9c7fffff] on node 7
 [600705f800000-600705fffffff] PMD -> [fff8383f9b800000-fff8383f9bffffff] on node 7
 [6007060000000-60070607fffff] PMD -> [fff8383f9b000000-fff8383f9b7fffff] on node 7
 [6007060800000-6007060ffffff] PMD -> [fff8383f9a800000-fff8383f9affffff] on node 7
 [6007061000000-60070617fffff] PMD -> [fff8383f9a000000-fff8383f9a7fffff] on node 7
 [6007061800000-6007061ffffff] PMD -> [fff8383f99800000-fff8383f99ffffff] on node 7
 [6007062000000-60070627fffff] PMD -> [fff8383f99000000-fff8383f997fffff] on node 7
 [6007062800000-6007062ffffff] PMD -> [fff8383f98800000-fff8383f98ffffff] on node 7
 [6007063000000-60070637fffff] PMD -> [fff8383f98000000-fff8383f987fffff] on node 7
 [6007063800000-6007063ffffff] PMD -> [fff8383f97800000-fff8383f97ffffff] on node 7
 [6007064000000-60070647fffff] PMD -> [fff8383f97000000-fff8383f977fffff] on node 7
 [6007064800000-6007064ffffff] PMD -> [fff8383f96800000-fff8383f96ffffff] on node 7
 [6007065000000-60070657fffff] PMD -> [fff8383f96000000-fff8383f967fffff] on node 7
 [6007065800000-6007065ffffff] PMD -> [fff8383f95800000-fff8383f95ffffff] on node 7
 [6007066000000-60070667fffff] PMD -> [fff8383f95000000-fff8383f957fffff] on node 7
 [6007066800000-6007066ffffff] PMD -> [fff8383f94800000-fff8383f94ffffff] on node 7
 [6007067000000-60070677fffff] PMD -> [fff8383f94000000-fff8383f947fffff] on node 7
 [6007067800000-6007067ffffff] PMD -> [fff8383f93800000-fff8383f93ffffff] on node 7
 [6007068000000-60070687fffff] PMD -> [fff8383f93000000-fff8383f937fffff] on node 7
 [6007068800000-6007068ffffff] PMD -> [fff8383f92800000-fff8383f92ffffff] on node 7
 [6007069000000-60070697fffff] PMD -> [fff8383f92000000-fff8383f927fffff] on node 7
 [6007069800000-6007069ffffff] PMD -> [fff8383f91800000-fff8383f91ffffff] on node 7
 [600706a000000-600706a7fffff] PMD -> [fff8383f91000000-fff8383f917fffff] on node 7
 [600706a800000-600706affffff] PMD -> [fff8383f90800000-fff8383f90ffffff] on node 7
 [600706b000000-600706b7fffff] PMD -> [fff8383f90000000-fff8383f907fffff] on node 7
 [600706b800000-600706bffffff] PMD -> [fff8383f8f800000-fff8383f8fffffff] on node 7
 [600706c000000-600706c7fffff] PMD -> [fff8383f8f000000-fff8383f8f7fffff] on node 7
 [600706c800000-600706cffffff] PMD -> [fff8383f8e800000-fff8383f8effffff] on node 7
 [600706d000000-600706d7fffff] PMD -> [fff8383f8e000000-fff8383f8e7fffff] on node 7
 [600706d800000-600706dffffff] PMD -> [fff8383f8d800000-fff8383f8dffffff] on node 7
 [600706e000000-600706e7fffff] PMD -> [fff8383f8d000000-fff8383f8d7fffff] on node 7
 [600706e800000-600706effffff] PMD -> [fff8383f8c800000-fff8383f8cffffff] on node 7
 [600706f000000-600706f7fffff] PMD -> [fff8383f8c000000-fff8383f8c7fffff] on node 7
 [600706f800000-600706fffffff] PMD -> [fff8383f8b800000-fff8383f8bffffff] on node 7
 [6007070000000-60070707fffff] PMD -> [fff8383f8b000000-fff8383f8b7fffff] on node 7
 [6007070800000-6007070ffffff] PMD -> [fff8383f8a800000-fff8383f8affffff] on node 7
 [6007071000000-60070717fffff] PMD -> [fff8383f8a000000-fff8383f8a7fffff] on node 7
 [6007071800000-6007071ffffff] PMD -> [fff8383f89800000-fff8383f89ffffff] on node 7
 [6007072000000-60070727fffff] PMD -> [fff8383f89000000-fff8383f897fffff] on node 7
 [6007072800000-6007072ffffff] PMD -> [fff8383f88800000-fff8383f88ffffff] on node 7
 [6007073000000-60070737fffff] PMD -> [fff8383f88000000-fff8383f887fffff] on node 7
 [6007073800000-6007073ffffff] PMD -> [fff8383f87800000-fff8383f87ffffff] on node 7
 [6007074000000-60070747fffff] PMD -> [fff8383f87000000-fff8383f877fffff] on node 7
 [6007074800000-6007074ffffff] PMD -> [fff8383f86800000-fff8383f86ffffff] on node 7
 [6007075000000-60070757fffff] PMD -> [fff8383f86000000-fff8383f867fffff] on node 7
 [6007075800000-6007075ffffff] PMD -> [fff8383f85800000-fff8383f85ffffff] on node 7
 [6007076000000-60070767fffff] PMD -> [fff8383f85000000-fff8383f857fffff] on node 7
 [6007076800000-6007076ffffff] PMD -> [fff8383f84800000-fff8383f84ffffff] on node 7
 [6007077000000-60070777fffff] PMD -> [fff8383f84000000-fff8383f847fffff] on node 7
 [6007077800000-6007077ffffff] PMD -> [fff8383f83800000-fff8383f83ffffff] on node 7
 [6007078000000-60070787fffff] PMD -> [fff8383f83000000-fff8383f837fffff] on node 7
 [6007078800000-6007078ffffff] PMD -> [fff8383f82800000-fff8383f82ffffff] on node 7
 [6007079000000-60070797fffff] PMD -> [fff8383f82000000-fff8383f827fffff] on node 7
 [6007079800000-6007079ffffff] PMD -> [fff8383f81800000-fff8383f81ffffff] on node 7
 [600707a000000-600707a7fffff] PMD -> [fff8383f81000000-fff8383f817fffff] on node 7
 [600707a800000-600707affffff] PMD -> [fff8383f80800000-fff8383f80ffffff] on node 7
 [600707b000000-600707b7fffff] PMD -> [fff8383f80000000-fff8383f807fffff] on node 7
 [600707b800000-600707bffffff] PMD -> [fff8383f7f800000-fff8383f7fffffff] on node 7
 [600707c000000-600707c7fffff] PMD -> [fff8383f7f000000-fff8383f7f7fffff] on node 7
 [600707c800000-600707cffffff] PMD -> [fff8383f7e800000-fff8383f7effffff] on node 7
 [600707d000000-600707d7fffff] PMD -> [fff8383f7e000000-fff8383f7e7fffff] on node 7
 [600707d800000-600707dffffff] PMD -> [fff8383f7d800000-fff8383f7dffffff] on node 7
 [600707e000000-600707e7fffff] PMD -> [fff8383f7d000000-fff8383f7d7fffff] on node 7
 [600707e800000-600707effffff] PMD -> [fff8383f7c800000-fff8383f7cffffff] on node 7
 [600707f000000-600707f7fffff] PMD -> [fff8383f7c000000-fff8383f7c7fffff] on node 7
 [600707f800000-600707fffffff] on node 7
Allocated 81920 bytes for kernel page tables.
Zone ranges:
  DMA      [mem 0x30400000-0xffffffffffffffff]
  Normal   [mem 0x00000000-0x383fffd43fff]
Movable zone start for each node
Early memory node ranges
  node   0: [mem 0x30400000-0x3fddeeffff]
  node   0: [mem 0x3fddef6000-0x3fddef7fff]
  node   1: [mem 0x80000000000-0x83fffffffff]
  node   2: [mem 0x100000000000-0x103fffffffff]
  node   3: [mem 0x180000000000-0x183fffffffff]
  node   4: [mem 0x200000000000-0x203fffffffff]
  node   5: [mem 0x280000000000-0x283fffffffff]
  node   6: [mem 0x300000000000-0x303fffffffff]
  node   7: [mem 0x380000000000-0x383fffcddfff]
  node   7: [mem 0x383fffcee000-0x383fffd0dfff]
  node   7: [mem 0x383fffd40000-0x383fffd43fff]
On node 0 totalpages: 33385849
  Normal zone: 260827 pages used for memmap
  Normal zone: 33385849 pages, LIFO batch:15
On node 1 totalpages: 33554432
  Normal zone: 262144 pages used for memmap
  Normal zone: 33554432 pages, LIFO batch:15
On node 2 totalpages: 33554432
  Normal zone: 262144 pages used for memmap
  Normal zone: 33554432 pages, LIFO batch:15
On node 3 totalpages: 33554432
  Normal zone: 262144 pages used for memmap
  Normal zone: 33554432 pages, LIFO batch:15
On node 4 totalpages: 33554432
  Normal zone: 262144 pages used for memmap
  Normal zone: 33554432 pages, LIFO batch:15
On node 5 totalpages: 33554432
  Normal zone: 262144 pages used for memmap
  Normal zone: 33554432 pages, LIFO batch:15
On node 6 totalpages: 33554432
  Normal zone: 262144 pages used for memmap
  Normal zone: 33554432 pages, LIFO batch:15
On node 7 totalpages: 33554049
  Normal zone: 262142 pages used for memmap
  Normal zone: 33554049 pages, LIFO batch:15
Booting Linux...
CPU CAPS: [flush,stbar,swap,muldiv,v9,blkinit,n2,mul32]
CPU CAPS: [div32,v8plus,popc,vis,vis2,ASIBlkInit,fmaf,vis3]
CPU CAPS: [hpc,ima,pause,cbcond,aes,des,kasumi,camellia]
CPU CAPS: [md5,sha1,sha256,sha512,mpmul,montmul,montsqr,crc32c]
PERCPU: Embedded 7 pages/cpu @fff8003f5d000000 s23552 r8192 d25600 u65536
pcpu-alloc: s23552 r8192 d25600 u65536 alloc=1*4194304
pcpu-alloc: [0] 0000 0001 0002 0003 0004 0005 0006 0007 0008 0009 0010 0011 0012 0013 0014 0015 0016 0017 0018 0019 0020 0021 0022 0023 0024 0025 0026 0027 0028 0029 0030 0031 0032 0033 0034 0035 0036 0037 0038 0039 0040 0041 0042 0043 0044 0045 0046 0047 0048 0049 0050 0051 0052 0053 0054 0055 0056 0057 0058 0059 0060 0061 0062 0063 
pcpu-alloc: [0] 0064 0065 0066 0067 0068 0069 0070 0071 0072 0073 0074 0075 0076 0077 0078 0079 0080 0081 0082 0083 0084 0085 0086 0087 0088 0089 0090 0091 0092 0093 0094 0095 0096 0097 0098 0099 0100 0101 0102 0103 0104 0105 0106 0107 0108 0109 0110 0111 0112 0113 0114 0115 0116 0117 0118 0119 0120 0121 0122 0123 0124 0125 0126 0127 
pcpu-alloc: [1] 0128 0129 0130 0131 0132 0133 0134 0135 0136 0137 0138 0139 0140 0141 0142 0143 0144 0145 0146 0147 0148 0149 0150 0151 0152 0153 0154 0155 0156 0157 0158 0159 0160 0161 0162 0163 0164 0165 0166 0167 0168 0169 0170 0171 0172 0173 0174 0175 0176 0177 0178 0179 0180 0181 0182 0183 0184 0185 0186 0187 0188 0189 0190 0191 
pcpu-alloc: [1] 0192 0193 0194 0195 0196 0197 0198 0199 0200 0201 0202 0203 0204 0205 0206 0207 0208 0209 0210 0211 0212 0213 0214 0215 0216 0217 0218 0219 0220 0221 0222 0223 0224 0225 0226 0227 0228 0229 0230 0231 0232 0233 0234 0235 0236 0237 0238 0239 0240 0241 0242 0243 0244 0245 0246 0247 0248 0249 0250 0251 0252 0253 0254 0255 
pcpu-alloc: [2] 0256 0257 0258 0259 0260 0261 0262 0263 0264 0265 0266 0267 0268 0269 0270 0271 0272 0273 0274 0275 0276 0277 0278 0279 0280 0281 0282 0283 0284 0285 0286 0287 0288 0289 0290 0291 0292 0293 0294 0295 0296 0297 0298 0299 0300 0301 0302 0303 0304 0305 0306 0307 0308 0309 0310 0311 0312 0313 0314 0315 0316 0317 0318 0319 
pcpu-alloc: [2] 0320 0321 0322 0323 0324 0325 0326 0327 0328 0329 0330 0331 0332 0333 0334 0335 0336 0337 0338 0339 0340 0341 0342 0343 0344 0345 0346 0347 0348 0349 0350 0351 0352 0353 0354 0355 0356 0357 0358 0359 0360 0361 0362 0363 0364 0365 0366 0367 0368 0369 0370 0371 0372 0373 0374 0375 0376 0377 0378 0379 0380 0381 0382 0383 
pcpu-alloc: [3] 0384 0385 0386 0387 0388 0389 0390 0391 0392 0393 0394 0395 0396 0397 0398 0399 0400 0401 0402 0403 0404 0405 0406 0407 0408 0409 0410 0411 0412 0413 0414 0415 0416 0417 0418 0419 0420 0421 0422 0423 0424 0425 0426 0427 0428 0429 0430 0431 0432 0433 0434 0435 0436 0437 0438 0439 0440 0441 0442 0443 0444 0445 0446 0447 
pcpu-alloc: [3] 0448 0449 0450 0451 0452 0453 0454 0455 0456 0457 0458 0459 0460 0461 0462 0463 0464 0465 0466 0467 0468 0469 0470 0471 0472 0473 0474 0475 0476 0477 0478 0479 0480 0481 0482 0483 0484 0485 0486 0487 0488 0489 0490 0491 0492 0493 0494 0495 0496 0497 0498 0499 0500 0501 0502 0503 0504 0505 0506 0507 0508 0509 0510 0511 
pcpu-alloc: [4] 0512 0513 0514 0515 0516 0517 0518 0519 0520 0521 0522 0523 0524 0525 0526 0527 0528 0529 0530 0531 0532 0533 0534 0535 0536 0537 0538 0539 0540 0541 0542 0543 0544 0545 0546 0547 0548 0549 0550 0551 0552 0553 0554 0555 0556 0557 0558 0559 0560 0561 0562 0563 0564 0565 0566 0567 0568 0569 0570 0571 0572 0573 0574 0575 
pcpu-alloc: [4] 0576 0577 0578 0579 0580 0581 0582 0583 0584 0585 0586 0587 0588 0589 0590 0591 0592 0593 0594 0595 0596 0597 0598 0599 0600 0601 0602 0603 0604 0605 0606 0607 0608 0609 0610 0611 0612 0613 0614 0615 0616 0617 0618 0619 0620 0621 0622 0623 0624 0625 0626 0627 0628 0629 0630 0631 0632 0633 0634 0635 0636 0637 0638 0639 
pcpu-alloc: [5] 0640 0641 0642 0643 0644 0645 0646 0647 0648 0649 0650 0651 0652 0653 0654 0655 0656 0657 0658 0659 0660 0661 0662 0663 0664 0665 0666 0667 0668 0669 0670 0671 0672 0673 0674 0675 0676 0677 0678 0679 0680 0681 0682 0683 0684 0685 0686 0687 0688 0689 0690 0691 0692 0693 0694 0695 0696 0697 0698 0699 0700 0701 0702 0703 
pcpu-alloc: [5] 0704 0705 0706 0707 0708 0709 0710 0711 0712 0713 0714 0715 0716 0717 0718 0719 0720 0721 0722 0723 0724 0725 0726 0727 0728 0729 0730 0731 0732 0733 0734 0735 0736 0737 0738 0739 0740 0741 0742 0743 0744 0745 0746 0747 0748 0749 0750 0751 0752 0753 0754 0755 0756 0757 0758 0759 0760 0761 0762 0763 0764 0765 0766 0767 
pcpu-alloc: [6] 0768 0769 0770 0771 0772 0773 0774 0775 0776 0777 0778 0779 0780 0781 0782 0783 0784 0785 0786 0787 0788 0789 0790 0791 0792 0793 0794 0795 0796 0797 0798 0799 0800 0801 0802 0803 0804 0805 0806 0807 0808 0809 0810 0811 0812 0813 0814 0815 0816 0817 0818 0819 0820 0821 0822 0823 0824 0825 0826 0827 0828 0829 0830 0831 
pcpu-alloc: [6] 0832 0833 0834 0835 0836 0837 0838 0839 0840 0841 0842 0843 0844 0845 0846 0847 0848 0849 0850 0851 0852 0853 0854 0855 0856 0857 0858 0859 0860 0861 0862 0863 0864 0865 0866 0867 0868 0869 0870 0871 0872 0873 0874 0875 0876 0877 0878 0879 0880 0881 0882 0883 0884 0885 0886 0887 0888 0889 0890 0891 0892 0893 0894 0895 
pcpu-alloc: [7] 0896 0897 0898 0899 0900 0901 0902 0903 0904 0905 0906 0907 0908 0909 0910 0911 0912 0913 0914 0915 0916 0917 0918 0919 0920 0921 0922 0923 0924 0925 0926 0927 0928 0929 0930 0931 0932 0933 0934 0935 0936 0937 0938 0939 0940 0941 0942 0943 0944 0945 0946 0947 0948 0949 0950 0951 0952 0953 0954 0955 0956 0957 0958 0959 
pcpu-alloc: [7] 0960 0961 0962 0963 0964 0965 0966 0967 0968 0969 0970 0971 0972 0973 0974 0975 0976 0977 0978 0979 0980 0981 0982 0983 0984 0985 0986 0987 0988 0989 0990 0991 0992 0993 0994 0995 0996 0997 0998 0999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 
SUN4V: Mondo queue sizes [cpu(131072) dev(16384) r(8192) nr(256)]
Built 8 zonelists in Node order, mobility grouping on.  Total pages: 266170657
Policy zone: Normal
Kernel command line: root=/dev/mapper/VolGroup-lv_root ro rd_NO_LUKS LANG=en_US.UTF-8 rd_NO_MD rd_LVM_LV=VolGroup/lv_swap SYSFONT=latarcyrheb-sun16 rd_LVM_LV=VolGroup/lv_root KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM ignore_loglevel
log_buf_len individual max cpu contribution: 4096 bytes
log_buf_len total cpu_extra contributions: 4190208 bytes
log_buf_len min size: 1048576 bytes
log_buf_len: 8388608 bytes
early log buf free: 824736(78%)
PID hash table entries: 4096 (order: 2, 32768 bytes)
Sorting __ex_table...
Memory: 2129222120K/2146131920K available (5616K kernel code, 840K rwdata, 2192K rodata, 536K init, 2132K bss, 16909800K reserved)
Hierarchical RCU implementation.
NR_IRQS:2048 nr_irqs:2048 1
SUN4V: Using IRQ API major 3, cookie only virqs enabled
clocksource: mult[800000] shift[23]
clockevent: mult[80000000] shift[31]
Console: colour dummy device 80x25
console [tty0] enabled
bootconsole [earlyprom0] disabled
allocated 4294967296 bytes of page_cgroup
please try 'cgroup_disable=memory' option if you don't want memory cgroups
Calibrating delay using timer specific routine.. 2001.44 BogoMIPS (lpj@02890)
pid_max: default: 1048576 minimum: 8192
Security Framework initialized
SELinux:  Initializing.
SELinux:  Starting in permissive mode
Dentry cache hash table entries: 268435456 (order: 18, 2147483648 bytes)
Inode-cache hash table entries: 134217728 (order: 17, 1073741824 bytes)
Mount-cache hash table entries: 4194304 (order: 12, 33554432 bytes)
Mountpoint-cache hash table entries: 4194304 (order: 12, 33554432 bytes)
Initializing cgroup subsys memory
Initializing cgroup subsys devices
Initializing cgroup subsys freezer
Initializing cgroup subsys net_cls
Initializing cgroup subsys blkio
Initializing cgroup subsys perf_event
Initializing cgroup subsys hugetlb
ftrace: allocating 20149 entries in 40 pages
Brought up 1024 CPUs
devtmpfs: initialized
Performance events: No support for PMU type 'niagara5'
ldc.c:v1.1 (July 22, 2008)
regulator-dummy: no parameters
NET: Registered protocol family 16
VIO: Adding device channel-devices
VIO: Adding device vldc-port-0-0
VIO: Adding device vldc-port-0-1
VIO: Adding device vldc-port-0-2
VIO: Adding device vldc-port-1-0
VIO: Adding device vldc-port-2-0
VIO: Adding device vldc-port-3-0
VIO: Adding device vldc-port-3-1
VIO: Adding device vldc-port-3-4
VIO: Adding device vldc-port-3-3
VIO: Adding device vlds-port-0-0
VIO: Adding device ds-0
VIO: Adding device ds-1
pci_sun4v: Registered hvapi major[1] minor[0]
/pci@300: SUN4V PCI Bus Module
/pci@300: On NUMA node -1
/pci@300: PCI IO[804000000000] MEM[800000000000]
/pci@300: Unable to request IOMMU resource.
/pci@300: Imported 26 TSB entries from OBP
/pci@300: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@300: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@300: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@300: MSI queues at RA [0000383f41000000]
PCI: Scanning PBM /pci@300
pci_sun4v f02dbd38: PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x804000000000-0x80400fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0000:00: root bus resource [mem 0x800000000000-0x80007effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0000:00: root bus resource [bus 00-77]
pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
pci 0000:02:04.0: PME# supported from D0 D3hot D3cold
pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
pci 0000:04:06.0: PME# supported from D0 D3hot D3cold
pci 0000:05:00.0: PME# supported from D0 D3hot D3cold
pci 0000:04:08.0: PME# supported from D0 D3hot D3cold
pci 0000:06:00.0: PME# supported from D0 D3hot D3cold
pci 0000:06:00.0: reg 0x184: can't handle BAR above 4G (bus address 0x110204000)
pci 0000:06:00.0: reg 0x184: [mem size 0x00004000 64bit]
pci 0000:06:00.0: reg 0x190: can't handle BAR above 4G (bus address 0x110304000)
pci 0000:06:00.0: reg 0x190: [mem size 0x00004000 64bit]
pci 0000:06:00.1: PME# supported from D0 D3hot D3cold
pci 0000:06:00.1: reg 0x184: can't handle BAR above 4G (bus address 0x110408000)
pci 0000:06:00.1: reg 0x184: [mem size 0x00004000 64bit]
pci 0000:06:00.1: reg 0x190: can't handle BAR above 4G (bus address 0x110800000)
pci 0000:06:00.1: reg 0x190: [mem size 0x00004000 64bit]
pci 0000:04:0c.0: PME# supported from D0 D3hot D3cold
pci 0000:07:00.0: supports D1 D2
pci 0000:02:06.0: PME# supported from D0 D3hot D3cold
pci 0000:02:04.0: can't claim BAR 15 [mem 0x800000000000-0x80002fffffff pref]: no compatible bridge window
pci 0000:05:00.0: can't claim BAR 0 [mem 0x800100000000-0x800100001fff]: no compatible bridge window
pci 0000:06:00.0: can't claim BAR 0 [mem 0x800110000000-0x8001101fffff pref]: no compatible bridge window
pci 0000:06:00.0: can't claim BAR 4 [mem 0x800110200000-0x800110203fff pref]: no compatible bridge window
pci 0000:06:00.1: can't claim BAR 0 [mem 0x800110600000-0x8001107fffff pref]: no compatible bridge window
pci 0000:06:00.1: can't claim BAR 4 [mem 0x800110404000-0x800110407fff pref]: no compatible bridge window
pci 0000:07:00.0: can't claim BAR 1 [mem 0x800120000000-0x80012000ffff]: no compatible bridge window
pci 0000:07:00.0: can't claim BAR 3 [mem 0x800120040000-0x80012007ffff]: no compatible bridge window
/pci@340: SUN4V PCI Bus Module
/pci@340: On NUMA node -1
/pci@340: PCI IO[804100000000] MEM[801000000000]
/pci@340: Unable to request IOMMU resource.
/pci@340: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@340: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@340: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@340: MSI queues at RA [0000203f42000000]
PCI: Scanning PBM /pci@340
pci_sun4v f02eab60: PCI host bridge to bus 0001:00
pci_bus 0001:00: root bus resource [io  0x804100000000-0x80410fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0001:00: root bus resource [mem 0x801000000000-0x80107effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0001:00: root bus resource [bus 00-e2]
pci 0001:00:01.0: PME# supported from D0 D3hot D3cold
pci 0001:01:00.0: PME# supported from D0 D3hot D3cold
pci 0001:02:06.0: PME# supported from D0 D3hot D3cold
/pci@380: SUN4V PCI Bus Module
/pci@380: On NUMA node -1
/pci@380: PCI IO[80c000000000] MEM[808000000000]
/pci@380: Unable to request IOMMU resource.
/pci@380: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@380: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@380: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@380: MSI queues at RA [0000303f42a00000]
PCI: Scanning PBM /pci@380
pci_sun4v f02f9988: PCI host bridge to bus 0002:00
pci_bus 0002:00: root bus resource [io  0x80c000000000-0x80c00fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0002:00: root bus resource [mem 0x808000000000-0x80807effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0002:00: root bus resource [bus 00-e2]
pci 0002:00:01.0: PME# supported from D0 D3hot D3cold
pci 0002:01:00.0: PME# supported from D0 D3hot D3cold
pci 0002:02:0a.0: PME# supported from D0 D3hot D3cold
pci 0002:03:00.0: can't claim BAR 1 [mem 0x808100000000-0x808100003fff]: no compatible bridge window
pci 0002:03:00.1: can't claim BAR 1 [mem 0x808100004000-0x808100007fff]: no compatible bridge window
/pci@3c0: SUN4V PCI Bus Module
/pci@3c0: On NUMA node -1
/pci@3c0: PCI IO[80c100000000] MEM[809000000000]
/pci@3c0: Unable to request IOMMU resource.
/pci@3c0: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@3c0: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@3c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@3c0: MSI queues at RA [0000083f42600000]
PCI: Scanning PBM /pci@3c0
pci_sun4v f03087b0: PCI host bridge to bus 0003:00
pci_bus 0003:00: root bus resource [io  0x80c100000000-0x80c10fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0003:00: root bus resource [mem 0x809000000000-0x80907effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0003:00: root bus resource [bus 00-e2]
pci 0003:00:01.0: PME# supported from D0 D3hot D3cold
pci 0003:01:00.0: PME# supported from D0 D3hot D3cold
pci 0003:02:0e.0: PME# supported from D0 D3hot D3cold
/pci@400: SUN4V PCI Bus Module
/pci@400: On NUMA node -1
/pci@400: PCI IO[814000000000] MEM[810000000000]
/pci@400: Unable to request IOMMU resource.
/pci@400: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@400: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@400: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@400: MSI queues at RA [0000103f41a00000]
PCI: Scanning PBM /pci@400
pci_sun4v f03175d8: PCI host bridge to bus 0004:00
pci_bus 0004:00: root bus resource [io  0x814000000000-0x81400fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0004:00: root bus resource [mem 0x810000000000-0x81007effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0004:00: root bus resource [bus 00-72]
pci 0004:00:01.0: PME# supported from D0 D3hot D3cold
pci 0004:01:00.0: PME# supported from D0 D3hot D3cold
pci 0004:02:0c.0: PME# supported from D0 D3hot D3cold
pci 0004:02:0c.0: can't claim BAR 15 [mem 0x810000000000-0x810077ffffff pref]: no compatible bridge window
/pci@440: SUN4V PCI Bus Module
/pci@440: On NUMA node -1
/pci@440: PCI IO[814100000000] MEM[811000000000]
/pci@440: Unable to request IOMMU resource.
/pci@440: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@440: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@440: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@440: MSI queues at RA [0000203f41800000]
PCI: Scanning PBM /pci@440
pci_sun4v f0326400: PCI host bridge to bus 0005:00
pci_bus 0005:00: root bus resource [io  0x814100000000-0x81410fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0005:00: root bus resource [mem 0x811000000000-0x81107effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0005:00: root bus resource [bus 00-e2]
pci 0005:00:01.0: PME# supported from D0 D3hot D3cold
pci 0005:01:00.0: PME# supported from D0 D3hot D3cold
pci 0005:02:0c.0: PME# supported from D0 D3hot D3cold
/pci@480: SUN4V PCI Bus Module
/pci@480: On NUMA node -1
/pci@480: PCI IO[81c000000000] MEM[818000000000]
/pci@480: Unable to request IOMMU resource.
/pci@480: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@480: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@480: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@480: MSI queues at RA [0000283f41800000]
PCI: Scanning PBM /pci@480
pci_sun4v f0335228: PCI host bridge to bus 0006:00
pci_bus 0006:00: root bus resource [io  0x81c000000000-0x81c00fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0006:00: root bus resource [mem 0x818000000000-0x81807effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0006:00: root bus resource [bus 00-e2]
pci 0006:00:01.0: PME# supported from D0 D3hot D3cold
pci 0006:01:00.0: PME# supported from D0 D3hot D3cold
pci 0006:02:04.0: PME# supported from D0 D3hot D3cold
/pci@4c0: SUN4V PCI Bus Module
/pci@4c0: On NUMA node -1
/pci@4c0: PCI IO[81c100000000] MEM[819000000000]
/pci@4c0: Unable to request IOMMU resource.
/pci@4c0: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@4c0: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@4c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@4c0: MSI queues at RA [0000303f42400000]
PCI: Scanning PBM /pci@4c0
pci_sun4v f0344050: PCI host bridge to bus 0007:00
pci_bus 0007:00: root bus resource [io  0x81c100000000-0x81c10fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0007:00: root bus resource [mem 0x819000000000-0x81907effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0007:00: root bus resource [bus 00-e2]
pci 0007:00:01.0: PME# supported from D0 D3hot D3cold
pci 0007:01:00.0: PME# supported from D0 D3hot D3cold
pci 0007:02:08.0: PME# supported from D0 D3hot D3cold
/pci@500: SUN4V PCI Bus Module
/pci@500: On NUMA node -1
/pci@500: PCI IO[824000000000] MEM[820000000000]
/pci@500: Unable to request IOMMU resource.
/pci@500: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@500: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@500: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@500: MSI queues at RA [0000003f11c00000]
PCI: Scanning PBM /pci@500
pci_sun4v f0352e78: PCI host bridge to bus 0008:00
pci_bus 0008:00: root bus resource [io  0x824000000000-0x82400fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0008:00: root bus resource [mem 0x820000000000-0x82007effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0008:00: root bus resource [bus 00-e2]
pci 0008:00:01.0: PME# supported from D0 D3hot D3cold
pci 0008:01:00.0: PME# supported from D0 D3hot D3cold
pci 0008:02:0e.0: PME# supported from D0 D3hot D3cold
/pci@540: SUN4V PCI Bus Module
/pci@540: On NUMA node -1
/pci@540: PCI IO[824100000000] MEM[821000000000]
/pci@540: Unable to request IOMMU resource.
/pci@540: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@540: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@540: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@540: MSI queues at RA [0000003f11e00000]
PCI: Scanning PBM /pci@540
pci_sun4v f0361ca0: PCI host bridge to bus 0009:00
pci_bus 0009:00: root bus resource [io  0x824100000000-0x82410fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0009:00: root bus resource [mem 0x821000000000-0x82107effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0009:00: root bus resource [bus 00-e2]
pci 0009:00:01.0: PME# supported from D0 D3hot D3cold
pci 0009:01:00.0: PME# supported from D0 D3hot D3cold
pci 0009:02:0e.0: PME# supported from D0 D3hot D3cold
/pci@580: SUN4V PCI Bus Module
/pci@580: On NUMA node -1
/pci@580: PCI IO[82c000000000] MEM[828000000000]
/pci@580: Unable to request IOMMU resource.
/pci@580: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@580: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@580: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@580: MSI queues at RA [0000103f41c00000]
PCI: Scanning PBM /pci@580
pci_sun4v f0370ac8: PCI host bridge to bus 000a:00
pci_bus 000a:00: root bus resource [io  0x82c000000000-0x82c00fffffff] (bus address [0x0000-0xfffffff])
pci_bus 000a:00: root bus resource [mem 0x828000000000-0x82807effffff] (bus address [0x00000000-0x7effffff])
pci_bus 000a:00: root bus resource [bus 00-e2]
pci 000a:00:01.0: PME# supported from D0 D3hot D3cold
pci 000a:01:00.0: PME# supported from D0 D3hot D3cold
pci 000a:02:0a.0: PME# supported from D0 D3hot D3cold
/pci@5c0: SUN4V PCI Bus Module
/pci@5c0: On NUMA node -1
/pci@5c0: PCI IO[82c100000000] MEM[829000000000]
/pci@5c0: Unable to request IOMMU resource.
/pci@5c0: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@5c0: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@5c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@5c0: MSI queues at RA [0000203f41000000]
PCI: Scanning PBM /pci@5c0
pci_sun4v f037f8f0: PCI host bridge to bus 000b:00
pci_bus 000b:00: root bus resource [io  0x82c100000000-0x82c10fffffff] (bus address [0x0000-0xfffffff])
pci_bus 000b:00: root bus resource [mem 0x829000000000-0x82907effffff] (bus address [0x00000000-0x7effffff])
pci_bus 000b:00: root bus resource [bus 00-72]
pci 000b:00:01.0: PME# supported from D0 D3hot D3cold
pci 000b:01:00.0: PME# supported from D0 D3hot D3cold
pci 000b:02:08.0: PME# supported from D0 D3hot D3cold
pci 000b:02:08.0: can't claim BAR 15 [mem 0x829000000000-0x829077ffffff pref]: no compatible bridge window
/pci@600: SUN4V PCI Bus Module
/pci@600: On NUMA node -1
/pci@600: PCI IO[834000000000] MEM[830000000000]
/pci@600: Unable to request IOMMU resource.
/pci@600: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@600: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@600: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@600: MSI queues at RA [0000303f41000000]
PCI: Scanning PBM /pci@600
pci_sun4v f038e718: PCI host bridge to bus 000c:00
pci_bus 000c:00: root bus resource [io  0x834000000000-0x83400fffffff] (bus address [0x0000-0xfffffff])
pci_bus 000c:00: root bus resource [mem 0x830000000000-0x83007effffff] (bus address [0x00000000-0x7effffff])
pci_bus 000c:00: root bus resource [bus 00-e2]
pci 000c:00:01.0: PME# supported from D0 D3hot D3cold
pci 000c:01:00.0: PME# supported from D0 D3hot D3cold
pci 000c:02:08.0: PME# supported from D0 D3hot D3cold
/pci@640: SUN4V PCI Bus Module
/pci@640: On NUMA node -1
/pci@640: PCI IO[834100000000] MEM[831000000000]
/pci@640: Unable to request IOMMU resource.
/pci@640: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@640: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@640: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@640: MSI queues at RA [0000003f11000000]
PCI: Scanning PBM /pci@640
pci_sun4v f039d540: PCI host bridge to bus 000d:00
pci_bus 000d:00: root bus resource [io  0x834100000000-0x83410fffffff] (bus address [0x0000-0xfffffff])
pci_bus 000d:00: root bus resource [mem 0x831000000000-0x83107effffff] (bus address [0x00000000-0x7effffff])
pci_bus 000d:00: root bus resource [bus 00-e2]
pci 000d:00:01.0: PME# supported from D0 D3hot D3cold
pci 000d:01:00.0: PME# supported from D0 D3hot D3cold
pci 000d:02:08.0: PME# supported from D0 D3hot D3cold
pci 000d:03:00.0: can't claim BAR 0 [mem 0x831100000000-0x831100001fff]: no compatible bridge window
pci 000d:03:00.0: can't claim BAR 2 [mem 0x831100004000-0x831100007fff]: no compatible bridge window
pci 000d:03:00.1: can't claim BAR 0 [mem 0x831100002000-0x831100003fff]: no compatible bridge window
pci 000d:03:00.1: can't claim BAR 2 [mem 0x831100008000-0x83110000bfff]: no compatible bridge window
/pci@680: SUN4V PCI Bus Module
/pci@680: On NUMA node -1
/pci@680: PCI IO[83c000000000] MEM[838000000000]
/pci@680: Unable to request IOMMU resource.
/pci@680: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@680: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@680: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@680: MSI queues at RA [0000083f41800000]
PCI: Scanning PBM /pci@680
pci_sun4v f03ac368: PCI host bridge to bus 000e:00
pci_bus 000e:00: root bus resource [io  0x83c000000000-0x83c00fffffff] (bus address [0x0000-0xfffffff])
pci_bus 000e:00: root bus resource [mem 0x838000000000-0x83807effffff] (bus address [0x00000000-0x7effffff])
pci_bus 000e:00: root bus resource [bus 00-e2]
pci 000e:00:01.0: PME# supported from D0 D3hot D3cold
pci 000e:01:00.0: PME# supported from D0 D3hot D3cold
pci 000e:02:04.0: PME# supported from D0 D3hot D3cold
/pci@6c0: SUN4V PCI Bus Module
/pci@6c0: On NUMA node -1
/pci@6c0: PCI IO[83c100000000] MEM[839000000000]
/pci@6c0: Unable to request IOMMU resource.
/pci@6c0: Imported 13 TSB entries from OBP
/pci@6c0: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@6c0: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@6c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@6c0: MSI queues at RA [0000183f41a00000]
PCI: Scanning PBM /pci@6c0
pci_sun4v f03bb190: PCI host bridge to bus 000f:00
pci_bus 000f:00: root bus resource [io  0x83c100000000-0x83c10fffffff] (bus address [0x0000-0xfffffff])
pci_bus 000f:00: root bus resource [mem 0x839000000000-0x83907effffff] (bus address [0x00000000-0x7effffff])
pci_bus 000f:00: root bus resource [bus 00-78]
pci 000f:00:01.0: PME# supported from D0 D3hot D3cold
pci 000f:01:00.0: PME# supported from D0 D3hot D3cold
pci 000f:02:04.0: PME# supported from D0 D3hot D3cold
pci 000f:02:0c.0: PME# supported from D0 D3hot D3cold
pci 000f:73:00.0: PME# supported from D0 D3hot D3cold
pci 000f:74:04.0: PME# supported from D0 D3hot D3cold
pci 000f:75:00.0: PME# supported from D0 D3hot D3cold
pci 000f:75:00.0: reg 0x184: can't handle BAR above 4G (bus address 0x480204000)
pci 000f:75:00.0: reg 0x184: [mem size 0x00004000 64bit]
pci 000f:75:00.0: reg 0x190: can't handle BAR above 4G (bus address 0x480304000)
pci 000f:75:00.0: reg 0x190: [mem size 0x00004000 64bit]
pci 000f:75:00.1: PME# supported from D0 D3hot D3cold
pci 000f:75:00.1: reg 0x184: can't handle BAR above 4G (bus address 0x480408000)
pci 000f:75:00.1: reg 0x184: [mem size 0x00004000 64bit]
pci 000f:75:00.1: reg 0x190: can't handle BAR above 4G (bus address 0x480800000)
pci 000f:75:00.1: reg 0x190: [mem size 0x00004000 64bit]
pci 000f:74:06.0: PME# supported from D0 D3hot D3cold
pci 000f:76:00.0: PME# supported from D0 D3hot D3cold
pci 000f:74:07.0: PME# supported from D0 D3hot D3cold
pci 000f:74:0c.0: PME# supported from D0 D3hot D3cold
pci 000f:78:00.0: supports D1 D2
pci 000f:02:04.0: can't claim BAR 15 [mem 0x839000000000-0x839077ffffff pref]: no compatible bridge window
pci 000f:75:00.0: can't claim BAR 0 [mem 0x839480000000-0x8394801fffff pref]: no compatible bridge window
pci 000f:75:00.0: can't claim BAR 4 [mem 0x839480200000-0x839480203fff pref]: no compatible bridge window
pci 000f:75:00.1: can't claim BAR 0 [mem 0x839480600000-0x8394807fffff pref]: no compatible bridge window
pci 000f:75:00.1: can't claim BAR 4 [mem 0x839480404000-0x839480407fff pref]: no compatible bridge window
pci 000f:76:00.0: can't claim BAR 0 [mem 0x839490000000-0x839490001fff]: no compatible bridge window
pci 000f:78:00.0: can't claim BAR 1 [mem 0x8394a0000000-0x8394a000ffff]: no compatible bridge window
pci 000f:78:00.0: can't claim BAR 3 [mem 0x8394a0040000-0x8394a007ffff]: no compatible bridge window
vgaarb: device added: PCI:000f:77:00.0,decodes=io+mem,owns=none,locks=none
vgaarb: loaded
vgaarb: bridge control possible 000f:77:00.0
SCSI subsystem initialized
libata version 3.00 loaded.
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
SUN4V: Reboot data supported (maj=1,min=0).
ds.c:v1.0 (Jul 11, 2007)
Switched to clocksource stick
ds-1: Registered pri service.
ds-1: Registered var-config-backup service.
NET: Registered protocol family 2
TCP established hash table entries: 524288 (order: 9, 4194304 bytes)
TCP bind hash table entries: 65536 (order: 7, 1048576 bytes)
TCP: Hash tables configured (established 524288 bind 65536)
TCP: reno registered
UDP hash table entries: 65536 (order: 8, 2097152 bytes)
UDP-Lite hash table entries: 65536 (order: 8, 2097152 bytes)
NET: Registered protocol family 1
pci 0000:05:00.0: xHCI BIOS handoff failed (BIOS bug ?) 00010401
pci 000f:76:00.0: xHCI BIOS handoff failed (BIOS bug ?) 00010401
PCI: CLS mismatch (64 != 512), using 64 bytes
Trying to unpack rootfs image as initramfs...
Freeing initrd memory: 17280K (fff8380004000000 - fff83800050e0000)
futex hash table entries: 262144 (order: 11, 16777216 bytes)
audit: initializing netlink subsys (disabled)
audit: type 00 audit(7.124:1): initialized
HugeTLB registered 8 MB page size, pre-allocated 0 pages
VFS: Disk quotas dquot_6.5.2
Dquot-cache hash table entries: 1024 (order 0, 8192 bytes)
msgmni has been set to 32768
SELinux:  Registering netfilter hooks
Kernel unaligned access at TPC[675f74] sha256_transform+0x14/0x2840
Kernel unaligned access at TPC[675f88] sha256_transform+0x28/0x2840
Kernel unaligned access at TPC[675f88] sha256_transform+0x28/0x2840
Kernel unaligned access at TPC[675f88] sha256_transform+0x28/0x2840
Kernel unaligned access at TPC[675f88] sha256_transform+0x28/0x2840
alg: No test for stdrng (krng)
Key type asymmetric registered
Asymmetric key parser 'x509' registered
bounce: pool size: 64 pages
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
io scheduler noop registered
io scheduler deadline registered (default)
io scheduler cfq registered
f0290d30: ttyS0 at I/O 0x0 (irq = 1, base_baud = 115200) is a SUN4V HCONS
NMI watchdog: BUG: soft lockup - CPU#527 stuck for 22s! [swapper/0:1]
Modules linked in:
CPU: 527 PID: 1 Comm: swapper/0 Not tainted 3.17.0-rc7 #1
task: fff8003f19649820 ti: fff8003f1964c000 task.ti: fff8003f1964c000
TSTATE: 0000000080001604 TPC: 00000000004ae140 TNPC: 00000000004ae144 Y: 00000000    Not tainted
TPC: <console_unlock+0x2c0/0x300>
g0: 0000000000d69e05 g1: 0000000000c44df0 g2: 0000000000000000 g3: 000000000000000a
g4: fff8003f19649820 g5: fff8203f7e3ee000 g6: fff8003f1964c000 g7: 0000000000000000
o0: 0000000000000000 o1: 0000000000000054 o2: 0000000000000000 o3: 0000000000d69e10
o4: 0000000000000400 o5: 0000000000000006 sp: fff8003f1964e891 ret_pc: 00000000004ae044
RPC: <console_unlock+0x1c4/0x300>
l0: fff8383ffe429630 l1: 0000000000d6a710 l2: 0000000000d6a718 l3: 0000000000000000
l4: 0000000000d6a71c l5: 0000000000000000 l6: 0000000000d69e05 l7: 0000000000d6a700
i0: 0000000000000007 i1: 0000000000d6a608 i2: 0000000000d69e05 i3: 0000000000d69e08
i4: 0000000000d6a6f0 i5: 0000000000bf5cb8 i6: fff8003f1964e951 i7: 00000000004af6ec
I7: <register_console+0x32c/0x400>
Call Trace:
 [00000000004af6ec] register_console+0x32c/0x400
 [000000000074f9b8] uart_configure_port+0x238/0x280
 [00000000007500d0] uart_add_one_port+0xf0/0x1e0
 [0000000000753f78] hv_probe+0xf8/0x1e0
 [0000000000772458] platform_drv_probe+0x18/0x60
 [00000000007707f8] really_probe+0x78/0x340
 [0000000000770afc] driver_probe_device+0x3c/0xa0
 [0000000000770be8] __driver_attach+0x88/0xa0
 [000000000076eb0c] bus_for_each_dev+0x6c/0xa0
 [000000000077045c] driver_attach+0x1c/0x40
 [000000000076f55c] bus_add_driver+0x17c/0x220
 [0000000000770f74] driver_register+0x74/0x120
 [0000000000772378] __platform_driver_register+0x58/0x80
 [0000000000cacaa0] sunhv_init+0x20/0x34
 [0000000000426bb8] do_one_initcall+0xb8/0x200
 [0000000000c8234c] do_basic_setup+0xa4/0xe4
console [ttyHV0] enabled
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
brd: module loaded
loop: module loaded
zram: Created 1 device(s) ...
libphy: Fixed MDIO Bus: probed
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ehci-pci: EHCI PCI platform driver
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
ohci-pci: OHCI PCI platform driver
uhci_hcd: USB Universal Host Controller Interface driver
mousedev: PS/2 mouse device common for all mice
rtc-sun4v rtc-sun4v: rtc core: registered sun4v as rtc0
hidraw: raw HID events driver (C) Jiri Kosina
usbcore: registered new interface driver usbhid
usbhid: USB HID core driver
drop_monitor: Initializing network drop monitor service
TCP: cubic registered
Initializing XFRM netlink socket
NET: Registered protocol family 17
Key type dns_resolver registered
registered taskstats version 1
ima: No TPM chip found, activating TPM-bypass!
rtc-sun4v rtc-sun4v: setting system clock to 2014-09-30 22:23:15 UTC (1412115795)
dracut: dracut-004-336.0.2.el6_5.2
dracut: rd_NO_LUKS: removing cryptoluks activation
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.27.0-ioctl (2013-10-30) initialised: dm-devel@redhat.com
udev: starting version 147
dracut: Starting plymouth daemon
dracut: rd_NO_DM: removing DM RAID activation
dracut: rd_NO_MD: removing MD RAID activation
camellia_sparc64: Using sparc64 camellia opcodes optimized CAMELLIA implementation
sha256_sparc64: Using sparc64 sha256 opcode optimized SHA-256/SHA-224 implementation
aes_sparc64: Using sparc64 aes opcodes optimized AES implementation
alg: skcipher-ddst: Test 5 failed on encryption for ctr-aes-sparc64
00000000: da 4e 3f bc e8 b6 3a a2 d5 4d 84 4a a9 0c e1 a5
00000010: b8 73 bc f9 bb 59 2f 44 8b ab 82 6c b4 32 9a de
00000020: 5a 0b db 7a 6b f2 38 9f 06 f7 f7 ff ff c0 8a 2e
00000030: 76 ea 06 32 23 f3 59 2e 75 de 71 86 3c 98 23 44
00000040: 5b f2 fa 6a 00 bb c1 ad 58 bd 3e 6f 2e b4 19 04
00000050: 70 8b 92 55 23 e9 6a 3a 78 7a 1b 10 85 52 9c 12
00000060: e4 55 81 21 ce 53 d0 3b 63 77 2c 74 d1 f5 60 f3
00000070: a1 de 44 3c 8f 4d 2f dd 8a fe 3c 42 8e d3 f2 8e
00000080: a8 28 69 65 31 e1 45 83 e4 49 c4 9c a7 28 aa 21
00000090: cd 5d 0f 15 b7 93 07 26 b0 65 6d 91 90 23 7a c6
000000a0: db 68 b0 a1 8e a4 76 4e c6 91 83 20 92 4d 63 7a
000000b0: 45 18 18 74 19 ad 71 01 6b 23 ad 9d 4e e4 6e 46
000000c0: c9 73 7a f9 02 95 f4 07 0e 7a a6 c5 ae fa 15 2c
000000d0: 51 71 f1 dc 22 b6 ac d8 19 24 44 bc 0c fb 3c 2d
000000e0: b1 50 47 15 0e db b6 d7 e8 61 e5 95 52 1e 3e 49
000000f0: 70 e9 66 04 4c e1 af bd dd 15 3b 20 59 24 ff b0
00000100: 39 aa e7 bf 23 a3 6e d5 15 f0 61 4f ae 89 10 58
00000110: 5a 33 95 52 2a b5 77 9c a5 43 80 40 27 2d ae d9
00000120: 3f e0 80 94 78 79 cb 7e ad 12 44 4c ec 27 b0 ee
00000130: 0b 05 2a 82 99 58 bb 7a 8d 6d 9d 8e e2 8e e7 93
00000140: 2f b3 09 8d 06 d5 ee 70 16 ae 35 c5 52 0f 46 1f
00000150: 71 f9 5e f2 67 dc 98 2f a3 23 aa d5 d0 49 f4 a6
00000160: f6 b8 32 cd d6 85 73 60 59 20 e7 55 0e 91 e2 0c
00000170: 3f 1c eb 3d df 52 64 f2 7d 8b 5d 63 16 b9 b2 5d
00000180: 5e ab b2 97 ab 78 44 e7 c6 72 20 c5 90 9b dc 5d
00000190: b0 ef 44 ef 87 31 8d f4 fb 81 5d f7 96 96 d4 50
000001a0: 89 a7 f6 b9 67 76 40 9e 9d 40 d5 2c 30 b8 01 8f
000001b0: e4 7b 71 48 a9 a0 a0 1d 87 52 a4 91 a9 d7 a9 51
000001c0: d9 59 f7 cc 63 22 c1 8d 84 7b d8 22 32 5c 6f 1d
000001d0: 6e 9f fa dd 49 40 dc 37 14 8c e1 80 1b dd 36 2a
000001e0: d0 e9 54 99 5d ba 3b 11 d8 fe c9 5b 5c 25 e5 76
000001f0: 4e ed 4b
qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.08-k.
qla2xxx [0002:03:00.0]-001d: : Found an ISP2532 irq 11 iobase 0x0000808100000000.
qla2xxx 0002:03:00.0: Direct firmware load for ql2500_fw.bin failed with error -2
qla2xxx [0002:03:00.0]-0063:0: Failed to load firmware image (ql2500_fw.bin).
qla2xxx [0002:03:00.0]-0090:0: Fimware image unavailable.
qla2xxx [0002:03:00.0]-0091:0: Firmware images can be retrieved from: http://ldriver.qlogic.com/firmware/.
qla2xxx [0002:03:00.0]-1020:0: **** Failed mbx[0]@06, mb[1]7, mb[2]€00, mb[3]a00, cmdY ****.
scsi host0: qla2xxx
qla2xxx [0002:03:00.0]-00fb:0: QLogic QLE2562 - Sun StorageTek 8Gb FC PCIe HBA, dual port.
qla2xxx [0002:03:00.0]-00fc:0: ISP2532: PCIe (2.5GT/s x8) @ 0002:03:00.0 hdma- host#=0 fw=4.03.02 (80).
qla2xxx [0002:03:00.1]-001d: : Found an ISP2532 irq 12 iobase 0x0000808100004000.
qla2xxx [0002:03:00.0]-505f:0: Link is operational (8 Gbps).
qla2xxx 0002:03:00.1: Direct firmware load for ql2500_fw.bin failed with error -2
qla2xxx [0002:03:00.1]-0063:1: Failed to load firmware image (ql2500_fw.bin).
qla2xxx [0002:03:00.1]-0090:1: Fimware image unavailable.
qla2xxx [0002:03:00.1]-0091:1: Firmware images can be retrieved from: http://ldriver.qlogic.com/firmware/.
qla2xxx [0002:03:00.1]-1020:1: **** Failed mbx[0]@06, mb[1]7, mb[2]€06, mb[3]A00, cmdY ****.
scsi host1: qla2xxx
qla2xxx [0002:03:00.1]-00fb:1: QLogic QLE2562 - Sun StorageTek 8Gb FC PCIe HBA, dual port.
qla2xxx [0002:03:00.1]-00fc:1: ISP2532: PCIe (2.5GT/s x8) @ 0002:03:00.1 hdma- host#=1 fw=4.03.02 (80).
scsi: waiting for bus probes to complete ...
Emulex LightPulse Fibre Channel SCSI driver 10.2.8001.0.
Copyright(c) 2004-2014 Emulex.  All rights reserved.
scsi host2: Emulex LPe12000-S PCIe Fibre Channel Adapter  on PCI bus 03 device 00 irq 35
scsi host3: Emulex LPe12000-S PCIe Fibre Channel Adapter  on PCI bus 03 device 01 irq 36
xhci_hcd 0000:05:00.0: xHCI Host Controller
xhci_hcd 0000:05:00.0: new USB bus registered, assigned bus number 1
usb usb1: New USB device found, idVendor\x1d6b, idProduct\002
usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb1: Product: xHCI Host Controller
usb usb1: Manufacturer: Linux 3.17.0-rc7 xhci_hcd
usb usb1: SerialNumber: 0000:05:00.0
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 4 ports detected
xhci_hcd 0000:05:00.0: xHCI Host Controller
xhci_hcd 0000:05:00.0: new USB bus registered, assigned bus number 2
usb usb2: New USB device found, idVendor\x1d6b, idProduct\003
usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb2: Product: xHCI Host Controller
usb usb2: Manufacturer: Linux 3.17.0-rc7 xhci_hcd
usb usb2: SerialNumber: 0000:05:00.0
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 4 ports detected
xhci_hcd 000f:76:00.0: xHCI Host Controller
xhci_hcd 000f:76:00.0: new USB bus registered, assigned bus number 3
usb usb3: New USB device found, idVendor\x1d6b, idProduct\002
usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb3: Product: xHCI Host Controller
usb usb3: Manufacturer: Linux 3.17.0-rc7 xhci_hcd
usb usb3: SerialNumber: 000f:76:00.0
hub 3-0:1.0: USB hub found
hub 3-0:1.0: 4 ports detected
xhci_hcd 000f:76:00.0: xHCI Host Controller
xhci_hcd 000f:76:00.0: new USB bus registered, assigned bus number 4
usb usb4: New USB device found, idVendor\x1d6b, idProduct\003
usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb4: Product: xHCI Host Controller
usb usb4: Manufacturer: Linux 3.17.0-rc7 xhci_hcd
usb usb4: SerialNumber: 000f:76:00.0
hub 4-0:1.0: USB hub found
hub 4-0:1.0: 4 ports detected
mpt2sas version 16.100.00.00 loaded
mpt2sas0: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (2129239936 kB)
mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 989
mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 990
mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 991
mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 992
mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 993
mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 994
mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 995
mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 996
usb 1-3: new high-speed USB device number 2 using xhci_hcd
mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 997
mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 998
mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 999
mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 1000
mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 1001
mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 1002
mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 1003
mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 1004
mpt2sas0: iomem(0x0000800120000000), mapped(0x0000800120000000), size(65536)
mpt2sas0: ioport(0x0000804000001000), size(256)
mpt2sas0: Allocated physical memory: size(4992 kB)
mpt2sas0: Current Controller Queue Depth(2811), Max Controller Queue Depth(3072)
mpt2sas0: Scatter Gather Elements per IO(128)
usb 1-3: New USB device found, idVendor	0c, idProduct\x1000
usb 1-3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
usb 1-3: Product: USB DISK
usb 1-3: Manufacturer: SMI Corporation
usb 1-3: SerialNumber: 2011081500000723
usb 1-3: ep 0x81 - rounding interval to 128 microframes, ep desc says 255 microframes
usb 1-3: ep 0x2 - rounding interval to 128 microframes, ep desc says 255 microframes
mpt2sas0: LSISAS2308: FWVersion(14.00.00.00), ChipRevision(0x05), BiosVersion(00.00.00.00)
mpt2sas0: Protocol=(Initiator), Capabilities=(Raid,TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
scsi host4: Fusion MPT SAS Host
mpt2sas0: sending port enable !!
mpt2sas1: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (2129239936 kB)
mpt2sas1-msix0: PCI-MSI-X enabled: IRQ 1005
mpt2sas1-msix1: PCI-MSI-X enabled: IRQ 1006
mpt2sas1-msix2: PCI-MSI-X enabled: IRQ 1007
mpt2sas1-msix3: PCI-MSI-X enabled: IRQ 1008
mpt2sas1-msix4: PCI-MSI-X enabled: IRQ 1009
mpt2sas1-msix5: PCI-MSI-X enabled: IRQ 1010
mpt2sas1-msix6: PCI-MSI-X enabled: IRQ 1011
mpt2sas1-msix7: PCI-MSI-X enabled: IRQ 1012
mpt2sas1-msix8: PCI-MSI-X enabled: IRQ 1013
mpt2sas1-msix9: PCI-MSI-X enabled: IRQ 1014
mpt2sas1-msix10: PCI-MSI-X enabled: IRQ 1015
mpt2sas1-msix11: PCI-MSI-X enabled: IRQ 1016
mpt2sas1-msix12: PCI-MSI-X enabled: IRQ 1017
mpt2sas1-msix13: PCI-MSI-X enabled: IRQ 1018
mpt2sas1-msix14: PCI-MSI-X enabled: IRQ 1019
mpt2sas1-msix15: PCI-MSI-X enabled: IRQ 1020
mpt2sas1: iomem(0x00008394a0000000), mapped(0x00008394a0000000), size(65536)
mpt2sas1: ioport(0x000083c104001000), size(256)
mpt2sas1: Allocated physical memory: size(4992 kB)
mpt2sas1: Current Controller Queue Depth(2811), Max Controller Queue Depth(3072)
mpt2sas1: Scatter Gather Elements per IO(128)
mpt2sas1: LSISAS2308: FWVersion(14.00.00.00), ChipRevision(0x05), BiosVersion(00.00.00.00)
mpt2sas1: Protocol=(Initiator), Capabilities=(Raid,TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
scsi host5: Fusion MPT SAS Host
mpt2sas1: sending port enable !!
mpt2sas0: host_add: handle(0x0001), sas_addr(0x508002000159c0d0), phys(8)
mpt2sas1: host_add: handle(0x0001), sas_addr(0x508002000159c0d1), phys(8)
mpt2sas0: port enable: SUCCESS
scsi 4:0:0:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
scsi 4:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca0163295b1), phy(1), device_name(0x5000cca0163295b3)
scsi 4:0:0:0: SSP: enclosure_logical_id(0x508002000159c0d0), slot(1)
scsi 4:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
scsi 4:0:1:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
scsi 4:0:1:0: SSP: handle(0x000a), sas_addr(0x5000cca0162a4c1d), phy(2), device_name(0x5000cca0162a4c1f)
scsi 4:0:1:0: SSP: enclosure_logical_id(0x508002000159c0d0), slot(2)
scsi 4:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
mpt2sas1: port enable: SUCCESS
scsi 5:0:0:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
scsi 5:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca0162f2e39), phy(0), device_name(0x5000cca0162f2e3b)
scsi 5:0:0:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(0)
scsi 5:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
scsi 5:0:1:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
scsi 5:0:1:0: SSP: handle(0x000a), sas_addr(0x5000cca016322ee5), phy(1), device_name(0x5000cca016322ee7)
scsi 5:0:1:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(1)
scsi 5:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
scsi 5:0:2:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
scsi 5:0:2:0: SSP: handle(0x000b), sas_addr(0x5000cca016322f71), phy(2), device_name(0x5000cca016322f73)
scsi 5:0:2:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(2)
scsi 5:0:2:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
usb-storage 1-3:1.0: USB Mass Storage device detected
scsi host6: usb-storage 1-3:1.0
usbcore: registered new interface driver usb-storage
sd 4:0:0:0: [sda] Enabling DIF Type 1 protection
sd 4:0:0:0: [sda] 585937500 512-byte logical blocks: (300 GB/279 GiB)
sd 5:0:0:0: [sdc] Enabling DIF Type 1 protection
sd 5:0:0:0: [sdc] 585937500 512-byte logical blocks: (300 GB/279 GiB)
sd 5:0:1:0: [sdd] Enabling DIF Type 1 protection
sd 5:0:1:0: [sdd] 585937500 512-byte logical blocks: (300 GB/279 GiB)
sd 5:0:2:0: [sde] Enabling DIF Type 1 protection
sd 5:0:2:0: [sde] 585937500 512-byte logical blocks: (300 GB/279 GiB)
sd 4:0:1:0: [sdb] Enabling DIF Type 1 protection
sd 4:0:1:0: [sdb] 585937500 512-byte logical blocks: (300 GB/279 GiB)
sd 4:0:1:0: [sdb] Write Protect is off
sd 4:0:1:0: [sdb] Mode Sense: e7 00 10 08
sd 4:0:1:0: [sdb] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 5:0:0:0: [sdc] Write Protect is off
sd 5:0:0:0: [sdc] Mode Sense: e7 00 10 08
sd 5:0:1:0: [sdd] Write Protect is off
sd 5:0:1:0: [sdd] Mode Sense: e7 00 10 08
sd 5:0:2:0: [sde] Write Protect is off
sd 5:0:2:0: [sde] Mode Sense: e7 00 10 08
sd 5:0:0:0: [sdc] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 5:0:1:0: [sdd] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 5:0:2:0: [sde] Write cache: disabled, read cache: enabled, supports DPO and FUA
 sdb: sdb1 sdb2 sdb3 sdb7
 sde: sde1 sde2 sde3
sd 4:0:1:0: [sdb] Attached SCSI disk
 sdc: sdc1 sdc2 sdc3 sdc7
 sdd: sdd1 sdd2 sdd3 sdd7
sd 5:0:2:0: [sde] Attached SCSI disk
sd 5:0:0:0: [sdc] Attached SCSI disk
sd 5:0:1:0: [sdd] Attached SCSI disk
sd 4:0:0:0: [sda] Write Protect is off
sd 4:0:0:0: [sda] Mode Sense: e7 00 10 08
sd 4:0:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
 sda: sda1 sda2 sda3
sd 4:0:0:0: [sda] Attached SCSI disk
random: nonblocking pool is initialized
dracut: Scanning devices sda2 sde2  for LVM logical volumes VolGroup/lv_swap VolGroup/lv_root 
dracut: inactive '/dev/VolGroup/lv_root' [274.38 GiB] inherit
dracut: inactive '/dev/VolGroup/lv_swap' [4.00 GiB] inherit
dracut: inactive '/dev/vg/root' [10.00 GiB] inherit
dracut: inactive '/dev/vg/swap' [2.00 GiB] inherit
dracut: inactive '/dev/vg/tmpdir' [10.00 GiB] inherit
dracut: inactive '/dev/vg/mountpoint' [5.00 GiB] inherit
qla2xxx [0002:03:00.1]-8038:1: Cable is unplugged...
scsi 6:0:0:0: Direct-Access     SMI      USB DISK         3000 PQ: 0 ANSI: 0 CCS
sd 6:0:0:0: [sdf] 62652416 512-byte logical blocks: (32.0 GB/29.8 GiB)
sd 6:0:0:0: [sdf] Write Protect is off
sd 6:0:0:0: [sdf] Mode Sense: 43 00 00 00
sd 6:0:0:0: [sdf] No Caching mode page found
sd 6:0:0:0: [sdf] Assuming drive cache: write through
 sdf: sdf1 sdf2 sdf3
sd 6:0:0:0: [sdf] Attached SCSI removable disk
EXT4-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null)
dracut: Mounted root filesystem /dev/mapper/VolGroup-lv_root
dracut: Loading SELinux policy
audit: type\x1404 audit(1412115828.712:2): enforcing=1 old_enforcing=0 auidB94967295 sesB94967295
SELinux: 2048 avtab hash slots, 277818 rules.
SELinux: 2048 avtab hash slots, 277818 rules.
SELinux:  9 users, 12 roles, 3918 types, 217 bools, 1 sens, 1024 cats
SELinux:  81 classes, 277818 rules
SELinux:  Permission audit_access in class file not defined in policy.
SELinux:  Permission audit_access in class dir not defined in policy.
SELinux:  Permission execmod in class dir not defined in policy.
SELinux:  Permission audit_access in class lnk_file not defined in policy.
SELinux:  Permission open in class lnk_file not defined in policy.
SELinux:  Permission execmod in class lnk_file not defined in policy.
SELinux:  Permission audit_access in class chr_file not defined in policy.
SELinux:  Permission audit_access in class blk_file not defined in policy.
SELinux:  Permission execmod in class blk_file not defined in policy.
SELinux:  Permission audit_access in class sock_file not defined in policy.
SELinux:  Permission execmod in class sock_file not defined in policy.
SELinux:  Permission audit_access in class fifo_file not defined in policy.
SELinux:  Permission execmod in class fifo_file not defined in policy.
SELinux:  Permission syslog in class capability2 not defined in policy.
SELinux:  Permission wake_alarm in class capability2 not defined in policy.
SELinux:  Permission block_suspend in class capability2 not defined in policy.
SELinux:  Permission audit_read in class capability2 not defined in policy.
SELinux:  Permission attach_queue in class tun_socket not defined in policy.
SELinux: the above unknown classes and permissions will be allowed
SELinux:  Completing initialization.
SELinux:  Setting up existing superblocks.
SELinux: initialized (dev rootfs, type rootfs), uses genfs_contexts
SELinux: initialized (dev bdev, type bdev), uses genfs_contexts
SELinux: initialized (dev proc, type proc), uses genfs_contexts
SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
SELinux: initialized (dev devtmpfs, type devtmpfs), uses transition SIDs
SELinux: initialized (dev debugfs, type debugfs), uses genfs_contexts
SELinux: initialized (dev sockfs, type sockfs), uses task SIDs
SELinux: initialized (dev pipefs, type pipefs), uses task SIDs
SELinux: initialized (dev anon_inodefs, type anon_inodefs), uses genfs_contexts
SELinux: initialized (dev aio, type aio), not configured for labeling
SELinux: initialized (dev devpts, type devpts), uses transition SIDs
SELinux: initialized (dev hugetlbfs, type hugetlbfs), uses transition SIDs
SELinux: initialized (dev mqueue, type mqueue), uses transition SIDs
SELinux: initialized (dev selinuxfs, type selinuxfs), uses genfs_contexts
SELinux: initialized (dev securityfs, type securityfs), uses genfs_contexts
SELinux: initialized (dev sysfs, type sysfs), uses genfs_contexts
SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
SELinux: initialized (dev dm-0, type ext4), uses xattr
audit: type\x1403 audit(1412115829.860:3): policy loaded auidB94967295 sesB94967295
dracut: 
dracut: Switching root
udev: starting version 147
sha1_sparc64: Using sparc64 sha1 opcode optimized SHA-1 implementation
sha512_sparc64: Using sparc64 sha512 opcode optimized SHA-512/SHA-384 implementation
md5_sparc64: Using sparc64 md5 opcode optimized MD5 implementation
des_sparc64: Using sparc64 des opcodes optimized DES implementation
crc32c_sparc64: Using sparc64 crc32c opcode optimized CRC32C implementation
pps_core: LinuxPPS API ver. 1 registered
pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
PTP clock support registered
ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 3.19.1-k
ixgbe: Copyright (c) 1999-2014 Intel Corporation.
PCI: Enabling device: (0000:06:00.0), cmd 2
ixgbe 0000:06:00.0: Using OpenPROM MAC address
ixgbe 0000:06:00.0: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
ixgbe 0000:06:00.0: PCI Express bandwidth of 32GT/s available
ixgbe 0000:06:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
ixgbe 0000:06:00.0: MAC: 3, PHY: 3, PBA No: 000000-000
ixgbe 0000:06:00.0: 00:10:e0:35:15:f6
ixgbe 0000:06:00.0: Intel(R) 10 Gigabit Network Connection
PCI: Enabling device: (0000:06:00.1), cmd 2
ixgbe 0000:06:00.1: Using OpenPROM MAC address
ixgbe 0000:06:00.1: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
ixgbe 0000:06:00.1: PCI Express bandwidth of 32GT/s available
ixgbe 0000:06:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
ixgbe 0000:06:00.1: MAC: 3, PHY: 3, PBA No: 000000-000
ixgbe 0000:06:00.1: 00:10:e0:35:15:f7
ixgbe 0000:06:00.1: Intel(R) 10 Gigabit Network Connection
PCI: Enabling device: (000f:75:00.0), cmd 2
ixgbe 000f:75:00.0: Using OpenPROM MAC address
ixgbe 000f:75:00.0: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
ixgbe 000f:75:00.0: PCI Express bandwidth of 32GT/s available
ixgbe 000f:75:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
ixgbe 000f:75:00.0: MAC: 3, PHY: 3, PBA No: 000000-000
ixgbe 000f:75:00.0: 00:10:e0:35:15:f8
ixgbe 000f:75:00.0: Intel(R) 10 Gigabit Network Connection
PCI: Enabling device: (000f:75:00.1), cmd 2
ixgbe 000f:75:00.1: Using OpenPROM MAC address
ixgbe 000f:75:00.1: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
ixgbe 000f:75:00.1: PCI Express bandwidth of 32GT/s available
ixgbe 000f:75:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
ixgbe 000f:75:00.1: MAC: 3, PHY: 3, PBA No: 000000-000
ixgbe 000f:75:00.1: 00:10:e0:35:15:f9
ixgbe 000f:75:00.1: Intel(R) 10 Gigabit Network Connection
sd 4:0:0:0: Attached scsi generic sg0 type 0
sd 4:0:1:0: Attached scsi generic sg1 type 0
sd 5:0:0:0: Attached scsi generic sg2 type 0
sd 5:0:1:0: Attached scsi generic sg3 type 0
sd 5:0:2:0: Attached scsi generic sg4 type 0
sd 6:0:0:0: Attached scsi generic sg5 type 0
EXT4-fs (dm-0): re-mounted. Opts: (null)
kjournald starting.  Commit interval 5 seconds
EXT3-fs (sde1): using internal journal
EXT3-fs (sde1): mounted filesystem with ordered data mode
SELinux: initialized (dev sde1, type ext3), uses xattr
Adding 4194296k swap on /dev/mapper/VolGroup-lv_swap.  Priority:-1 extents:1 across:4194296k FS
SELinux: initialized (dev binfmt_misc, type binfmt_misc), uses genfs_contexts
NET: Registered protocol family 10
pps pps0: new PPS source ptp0
ixgbe 0000:06:00.0: registered PHC device on eth0
IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
ixgbe 0000:06:00.0 eth0: NIC Link is Up 1 Gbps, Flow Control: RX/TX
IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
audit: type\x1305 audit(1412115855.876:4): audit_pid\x12388 old=0 auidB94967295 sesB94967295 subj=system_u:system_r:auditd_t:s0 res=1
sd 5:0:2:0: attempting task abort! scmd(fff8183f401d97a0)
sd 5:0:2:0: [sde] CDB: 
Read(10): 28 20 0a 20 2b 23 00 00 08 00
scsi target5:0:2: handle(0x000b), sas_address(0x5000cca016322f71), phy(2)
scsi target5:0:2: enclosure_logical_id(0x508002000159c0d1), slot(2)
sd 5:0:2:0: task abort: SUCCESS scmd(fff8183f401d97a0)
--
To unsubscribe from this list: send the line "unsubscribe sparclinux" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[David Miller]

From: Bob Picco <bpicco@meloft.net>
Date: Tue, 30 Sep 2014 18:28:41 -0400

> Okay, I lied partially. Let me examine this in the morning. You can
> go first :)

Thanks :)  The boot mostly looks successful no?

There are a couple blips, let's take a look:

> Performance events: No support for PMU type 'niagara5'

Hmmm, this was patched into an older tree I guess, as supported_pmu()
accepts 'niagara5' as far as I can tell.  Oh I see, you patched
against vanilla 3.17-rc7 instead of my 'sparc' GIT tree.

> SELinux:  Registering netfilter hooks
> Kernel unaligned access at TPC[675f74] sha256_transform+0x14/0x2840
> Kernel unaligned access at TPC[675f88] sha256_transform+0x28/0x2840
> Kernel unaligned access at TPC[675f88] sha256_transform+0x28/0x2840
> Kernel unaligned access at TPC[675f88] sha256_transform+0x28/0x2840
> Kernel unaligned access at TPC[675f88] sha256_transform+0x28/0x2840
> alg: No test for stdrng (krng)

Interesting.  sha256_transform() depends upon the input data being
at least 32-bit aligned.  Let's get a stack backtrace to see how
this happens:

==========
diff --git a/arch/sparc/kernel/unaligned_64.c b/arch/sparc/kernel/unaligned_64.c
index 62098a8..59ea98a 100644
--- a/arch/sparc/kernel/unaligned_64.c
+++ b/arch/sparc/kernel/unaligned_64.c
@@ -299,6 +299,7 @@ static void log_unaligned(struct pt_regs *regs)
 	if (__ratelimit(&ratelimit)) {
 		printk("Kernel unaligned access at TPC[%lx] %pS\n",
 		       regs->tpc, (void *) regs->tpc);
+		dump_stack();
 	}
 }
 
==========

> f0290d30: ttyS0 at I/O 0x0 (irq = 1, base_baud = 115200) is a SUN4V HCONS
> NMI watchdog: BUG: soft lockup - CPU#527 stuck for 22s! [swapper/0:1]
> Modules linked in:

I think this is triggered because in console_unlock() all buffered console
output is emitted all at once.  And with all of those vmemmap log messages
it gets huge.

I guess this is another reason to trim down those messages, so I'll work
on that now. :)

> aes_sparc64: Using sparc64 aes opcodes optimized AES implementation
> alg: skcipher-ddst: Test 5 failed on encryption for ctr-aes-sparc64
> 00000000: da 4e 3f bc e8 b6 3a a2 d5 4d 84 4a a9 0c e1 a5

Hmmm, interesting.  I just noticed that I haven't enabled the
sparc64 crypto drivers in my current test .config, but I
turned them on and I don't get this test failure.

I'll try to reproduce with the 'tcrypt' module or similar.

> sd 5:0:2:0: attempting task abort! scmd(fff8183f401d97a0)
> sd 5:0:2:0: [sde] CDB: 
> Read(10): 28 20 0a 20 2b 23 00 00 08 00
> scsi target5:0:2: handle(0x000b), sas_address(0x5000cca016322f71), phy(2)
> scsi target5:0:2: enclosure_logical_id(0x508002000159c0d1), slot(2)
> sd 5:0:2:0: task abort: SUCCESS scmd(fff8183f401d97a0)

I get these every once in a while, the block I/O always recovers.

I assume this booted all the way to a login prompt or similar?

Thanks!

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[David Miller]

From: David Miller <davem@davemloft.net>
Date: Tue, 30 Sep 2014 22:29:00 -0400 (EDT)

> From: Bob Picco <bpicco@meloft.net>
> Date: Tue, 30 Sep 2014 18:28:41 -0400
> 
>> aes_sparc64: Using sparc64 aes opcodes optimized AES implementation
>> alg: skcipher-ddst: Test 5 failed on encryption for ctr-aes-sparc64
>> 00000000: da 4e 3f bc e8 b6 3a a2 d5 4d 84 4a a9 0c e1 a5
> 
> Hmmm, interesting.  I just noticed that I haven't enabled the
> sparc64 crypto drivers in my current test .config, but I
> turned them on and I don't get this test failure.
> 
> I'll try to reproduce with the 'tcrypt' module or similar.

I don't see it because my config has CRYPTO_MANAGER_DISABLE_TESTS set,
which is the default :-/

I can reproduce this AES failure as well as the unaligned accesses.

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[Bob Picco]

Hi,
David Miller wrote:	[Tue Sep 30 2014, 10:29:00PM EDT]
> From: Bob Picco <bpicco@meloft.net>
> Date: Tue, 30 Sep 2014 18:28:41 -0400
> 
> > Okay, I lied partially. Let me examine this in the morning. You can
> > go first :)
> 
> Thanks :)  The boot mostly looks successful no?
You're welcome. Yes it does.
> 
> There are a couple blips, let's take a look:
> 
> > Performance events: No support for PMU type 'niagara5'
> 
> Hmmm, this was patched into an older tree I guess, as supported_pmu()
> accepts 'niagara5' as far as I can tell.  Oh I see, you patched
> against vanilla 3.17-rc7 instead of my 'sparc' GIT tree.
Yes.
> 
> > SELinux:  Registering netfilter hooks
> > Kernel unaligned access at TPC[675f74] sha256_transform+0x14/0x2840
> > Kernel unaligned access at TPC[675f88] sha256_transform+0x28/0x2840
> > Kernel unaligned access at TPC[675f88] sha256_transform+0x28/0x2840
> > Kernel unaligned access at TPC[675f88] sha256_transform+0x28/0x2840
> > Kernel unaligned access at TPC[675f88] sha256_transform+0x28/0x2840
> > alg: No test for stdrng (krng)
> 
> Interesting.  sha256_transform() depends upon the input data being
> at least 32-bit aligned.  Let's get a stack backtrace to see how
> this happens:
> 
> ==========
> diff --git a/arch/sparc/kernel/unaligned_64.c b/arch/sparc/kernel/unaligned_64.c
> index 62098a8..59ea98a 100644
> --- a/arch/sparc/kernel/unaligned_64.c
> +++ b/arch/sparc/kernel/unaligned_64.c
> @@ -299,6 +299,7 @@ static void log_unaligned(struct pt_regs *regs)
>  	if (__ratelimit(&ratelimit)) {
>  		printk("Kernel unaligned access at TPC[%lx] %pS\n",
>  		       regs->tpc, (void *) regs->tpc);
> +		dump_stack();
>  	}
>  }
>  
> ==========
> 
> > f0290d30: ttyS0 at I/O 0x0 (irq = 1, base_baud = 115200) is a SUN4V HCONS
> > NMI watchdog: BUG: soft lockup - CPU#527 stuck for 22s! [swapper/0:1]
> > Modules linked in:
> 
> I think this is triggered because in console_unlock() all buffered console
> output is emitted all at once.  And with all of those vmemmap log messages
> it gets huge.
Agree.
> 
> I guess this is another reason to trim down those messages, so I'll work
> on that now. :)
Thanx.
> 
> > aes_sparc64: Using sparc64 aes opcodes optimized AES implementation
> > alg: skcipher-ddst: Test 5 failed on encryption for ctr-aes-sparc64
> > 00000000: da 4e 3f bc e8 b6 3a a2 d5 4d 84 4a a9 0c e1 a5
> 
> Hmmm, interesting.  I just noticed that I haven't enabled the
> sparc64 crypto drivers in my current test .config, but I
> turned them on and I don't get this test failure.
> 
> I'll try to reproduce with the 'tcrypt' module or similar.
okay.
> 
> > sd 5:0:2:0: attempting task abort! scmd(fff8183f401d97a0)
> > sd 5:0:2:0: [sde] CDB: 
> > Read(10): 28 20 0a 20 2b 23 00 00 08 00
> > scsi target5:0:2: handle(0x000b), sas_address(0x5000cca016322f71), phy(2)
> > scsi target5:0:2: enclosure_logical_id(0x508002000159c0d1), slot(2)
> > sd 5:0:2:0: task abort: SUCCESS scmd(fff8183f401d97a0)
> 
> I get these every once in a while, the block I/O always recovers.
Me too. One exception being local T5-2 because of management dinosaur
deception.
> 
> I assume this booted all the way to a login prompt or similar?
Yes. I just cloned sparc.git during VPN and proxy quiet period.
I'll attempt to hang on to T5-8 until we conclude :)
> 
> Thanks!
you're welcome and thanx!
> 

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[Bob Picco]

Bob Picco wrote:	[Wed Oct 01 2014, 07:51:08AM EDT]
> Hi,
> David Miller wrote:	[Tue Sep 30 2014, 10:29:00PM EDT]
> > I assume this booted all the way to a login prompt or similar?
> Yes. I just cloned sparc.git during VPN and proxy quiet period.
> I'll attempt to hang on to T5-8 until we conclude :)
We seem to encounter the spec-jbb like issue under heavy threaded make
of sparc.git with our work. A similar load had no issue on local T5-2 and
T4-2. It raised its ugly head quickly on T5-8. It could be painful to pursue
on T5-8.

Last night I was pondering whether it might be slab related for spec-jbb.
Though I've not flushed these thoughts thoroughly in or out.

I'm in pursuit! Bloody dentist today.

[root@ca-qasparc24 ~]# Unable to handle kernel NULL pointer dereference
BUG: Bad page map in process cc1  pte:9800003fdd860690 pmd:183f3f4b6000
page:000600007fbb0c00 count:107055216 mapcount:-524287 mapping:          (null) index:0xfff8000107659c00
page flags: 0x6c4b6e00004f56(error|referenced|dirty|active|owner_priv_1|arch_1|reserved|private|head)
page dumped because: bad pte
addr:0000000000124000 vm_flags:00000875 anon_vma:          (null) mapping:fff8003f18a06a78 index:12
vma->vm_ops->fault: filemap_fault+0x8/0x440
vma->vm_file->f_op->mmap: ext4_file_mmap+0x8/0x40 [ext4]
CPU: 497 PID: 19886 Comm: cc1 Tainted: G             L 3.17.0-rc7 #1
Call Trace:
 [0000000000567394] print_bad_pte+0x134/0x1e0
 [000000000056ade0] zap_pte_range+0x4c0/0x580
 [000000000056afd4] unmap_page_range+0x134/0x220
 [000000000056b11c] unmap_single_vma+0x5c/0xc0
 [000000000056b1a8] unmap_vmas+0x28/0x60
 [000000000056e248] exit_mmap+0x88/0x160
 [0000000000465c74] mmput+0x54/0xe0
 [00000000004691bc] exit_mm+0x13c/0x1c0
 [000000000046a750] do_exit+0x130/0x440
 [000000000046aa90] do_group_exit+0x30/0xc0
 [000000000046ab3c] SyS_exit_group+0x1c/0x40
 [0000000000406234] linux_sparc_syscall+0x34/0x44

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[David Miller]

From: Bob Picco <bpicco@meloft.net>
Date: Wed, 1 Oct 2014 10:29:00 -0400

> [root@ca-qasparc24 ~]# Unable to handle kernel NULL pointer dereference
> BUG: Bad page map in process cc1  pte:9800003fdd860690 pmd:183f3f4b6000
> page:000600007fbb0c00 count:107055216 mapcount:-524287 mapping:          (null) index:0xfff8000107659c00
> page flags: 0x6c4b6e00004f56(error|referenced|dirty|active|owner_priv_1|arch_1|reserved|private|head)
> page dumped because: bad pte

The first thing I notice is that the count, mapcount, and flags are all garbage.

But not just random garbage, all of the non-zero bytes in the page
flags are in visible the ASCII character range.

0x6c = 'l'
0x4b = 'K'
0x6e = 'n'
0x4f = 'O'
0x56 = 'V'

Anyways, just FYI...

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[David Miller]

From: David Miller <davem@davemloft.net>
Date: Wed, 01 Oct 2014 16:42:01 -0400 (EDT)

> From: Bob Picco <bpicco@meloft.net>
> Date: Wed, 1 Oct 2014 10:29:00 -0400
> 
>> [root@ca-qasparc24 ~]# Unable to handle kernel NULL pointer dereference
>> BUG: Bad page map in process cc1  pte:9800003fdd860690 pmd:183f3f4b6000
>> page:000600007fbb0c00 count:107055216 mapcount:-524287 mapping:          (null) index:0xfff8000107659c00
>> page flags: 0x6c4b6e00004f56(error|referenced|dirty|active|owner_priv_1|arch_1|reserved|private|head)
>> page dumped because: bad pte
> 
> The first thing I notice is that the count, mapcount, and flags are all garbage.
> 
> But not just random garbage, all of the non-zero bytes in the page
> flags are in visible the ASCII character range.
> 
> 0x6c = 'l'
> 0x4b = 'K'
> 0x6e = 'n'
> 0x4f = 'O'
> 0x56 = 'V'
> 
> Anyways, just FYI...

Also, Bob, that "Unable to handle kernel NULL pointer dereference"
should have placed a good register dump and backtrace into the kernel
logs, maybe you can provide that as well.

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[Bob Picco]

Hi,
David Miller wrote:	[Wed Oct 01 2014, 04:44:55PM EDT]
> From: David Miller <davem@davemloft.net>
> Date: Wed, 01 Oct 2014 16:42:01 -0400 (EDT)
> 
> > From: Bob Picco <bpicco@meloft.net>
> > Date: Wed, 1 Oct 2014 10:29:00 -0400
> > 
> >> [root@ca-qasparc24 ~]# Unable to handle kernel NULL pointer dereference
> >> BUG: Bad page map in process cc1  pte:9800003fdd860690 pmd:183f3f4b6000
> >> page:000600007fbb0c00 count:107055216 mapcount:-524287 mapping:          (null) index:0xfff8000107659c00
> >> page flags: 0x6c4b6e00004f56(error|referenced|dirty|active|owner_priv_1|arch_1|reserved|private|head)
> >> page dumped because: bad pte
> > 
> > The first thing I notice is that the count, mapcount, and flags are all garbage.
> > 
> > But not just random garbage, all of the non-zero bytes in the page
> > flags are in visible the ASCII character range.
> > 
> > 0x6c = 'l'
> > 0x4b = 'K'
> > 0x6e = 'n'
> > 0x4f = 'O'
> > 0x56 = 'V'
> > 
> > Anyways, just FYI...
> 
> Also, Bob, that "Unable to handle kernel NULL pointer dereference"
> should have placed a good register dump and backtrace into the kernel
> logs, maybe you can provide that as well.
I'll let you examine this one closely. I was examining code and what was
observed on Sunday and not inspected closely.

On T4-2 I'm obtaining a solid baseline. sparc.git !THP and !HUGEPAGES
with spec-jbb. It appears good.

On T5-8 I did build sparc.git but not with as massive parallel make -j10.

Please let me know should you want more or whether this is worthless.

BUG: Bad page map in process cc1  pte:9800003fdd860690 pmd:183f3f4b6000
page:000600007fbb0c00 count:107055216 mapcount:-524287 mapping:          (null) index:0xfff8000107659c00
page flags: 0x6c4b6e00004f56(error|referenced|dirty|active|owner_priv_1|arch_1|reserved|private|head)
page dumped because: bad pte
addr:0000000000124000 vm_flags:00000875 anon_vma:          (null) mapping:fff8003f18a06a78 index:12
vma->vm_ops->fault: filemap_fault+0x8/0x440
vma->vm_file->f_op->mmap: ext4_file_mmap+0x8/0x40 [ext4]
CPU: 497 PID: 19886 Comm: cc1 Tainted: G             L 3.17.0-rc7 #1
Call Trace:
 [0000000000567394] print_bad_pte+0x134/0x1e0
 [000000000056ade0] zap_pte_range+0x4c0/0x580
 [000000000056afd4] unmap_page_range+0x134/0x220
 [000000000056b11c] unmap_single_vma+0x5c/0xc0
 [000000000056b1a8] unmap_vmas+0x28/0x60
 [000000000056e248] exit_mmap+0x88/0x160
 [0000000000465c74] mmput+0x54/0xe0
 [00000000004691bc] exit_mm+0x13c/0x1c0
 [000000000046a750] do_exit+0x130/0x440
 [000000000046aa90] do_group_exit+0x30/0xc0
 [000000000046ab3c] SyS_exit_group+0x1c/0x40
 [0000000000406234] linux_sparc_syscall+0x34/0x44
Disabling lock debugging due to kernel taint
BUG: Bad page map in process cc1  pte:9800003fdd860690 pmd:183f3c6e4000
page:000600007fbb0c00 count:107055215 mapcount:-524288 mapping:          (null) index:0xfff8000107659c00
page flags: 0x6c4b6e00004f56(error|referenced|dirty|active|owner_priv_1|arch_1|reserved|private|head)
page dumped because: bad pte
addr:0000000000124000 vm_flags:00000875 anon_vma:          (null) mapping:fff8003f18a06a78 index:12
vma->vm_ops->fault: filemap_fault+0x8/0x440
vma->vm_file->f_op->mmap: ext4_file_mmap+0x8/0x40 [ext4]
CPU: 442 PID: 19996 Comm: cc1 Tainted: G    B        L 3.17.0-rc7 #1
Call Trace:
 [0000000000567394] print_bad_pte+0x134/0x1e0
 [000000000056ade0] zap_pte_range+0x4c0/0x580
 [000000000056afd4] unmap_page_range+0x134/0x220
 [000000000056b11c] unmap_single_vma+0x5c/0xc0
 [000000000056b1a8] unmap_vmas+0x28/0x60
 [000000000056e248] exit_mmap+0x88/0x160
 [0000000000465c74] mmput+0x54/0xe0
 [00000000004691bc] exit_mm+0x13c/0x1c0
Unable to handle kernel NULL pointer dereference
 [000000000046a750] do_exit+0x130/0x440
tsk->{mm,active_mm}->context = 00000000000017c4
tsk->{mm,active_mm}->pgd = fff8003e95b7e000
 [000000000046aa90] do_group_exit+0x30/0xc0
              \|/ ____ \|/
              "@'/ .. \`@"
              /_| \__/ |_\
                 \__U_/
 [000000000046ab3c] SyS_exit_group+0x1c/0x40
cc1(20076): Oops [#1]
 [0000000000406234] linux_sparc_syscall+0x34/0x44
CPU: 105 PID: 20076 Comm: cc1 Tainted: G    B        L 3.17.0-rc7 #1
task: fff8003f07de88a0 ti: fff8003e95c88000 task.ti: fff8003e95c88000
TSTATE: 0000000011e01602 TPC: 000000000058ea2c TNPC: 000000000058ea30 Y: fcdcf300    Tainted: G    B        L
TPC: <kfree+0x8c/0x2a0>
g0: fff8003fddef7888 g1: 0006000000000000 g2: 00000000000003c8 g3: 0000000000be6800
g4: fff8003f07de88a0 g5: fff8003f5c98e000 g6: fff8003e95c88000 g7: 0000000000d62000
o0: 0000000000000000 o1: 0000000000000081 o2: 0000000000000020 o3: 0000000000000000
o4: 0000000000008000 o5: 0000000000000008 sp: fff8003e95c8aff1 ret_pc: 000000000063e4cc
RPC: <security_inode_permission+0x2c/0x40>
l0: 0000000000000000 l1: fff8003f0852f220 l2: 0000000000000000 l3: 0000000000643408
l4: 0000000000000014 l5: 00000000009fd430 l6: fff8003e95c88000 l7: 00000000005a1860
i0: fff8003f0852f220 i1: 0000000000000081 i2: 0000000000000010 i3: 0000000014fed5a6
i4: 0000000000666100 i5: 0000000000000078 i6: fff8003e95c8b0c1 i7: 0000000000643030
I7: <selinux_file_free_security+0x10/0x20>
Call Trace:
 [0000000000643030] selinux_file_free_security+0x10/0x20
 [000000000063c2b8] security_file_free+0x18/0x40
 [00000000005a55c8] put_filp+0x28/0x60
 [00000000005b336c] path_openat+0xec/0x4c0
 [00000000005b3868] do_filp_open+0x28/0xa0
 [00000000005a1728] do_sys_open+0x148/0x240
 [00000000005a1884] SyS_open+0x24/0x40
 [0000000000406234] linux_sparc_syscall+0x34/0x44
Caller[0000000000643030]: selinux_file_free_security+0x10/0x20
Caller[000000000063c2b8]: security_file_free+0x18/0x40
Caller[00000000005a55c8]: put_filp+0x28/0x60
Caller[00000000005b336c]: path_openat+0xec/0x4c0
Caller[00000000005b3868]: do_filp_open+0x28/0xa0
Caller[00000000005a1728]: do_sys_open+0x148/0x240
Caller[00000000005a1884]: SyS_open+0x24/0x40
Caller[0000000000406234]: linux_sparc_syscall+0x34/0x44
Caller[0000000000659d38]: constraint_expr_eval+0x658/0x6a0
Instruction DUMP: 84048002  80a36001  04400015 <e658a008> c459e2b8  a207a7e7  c658e198  84260002  f077a7f7 
BUG: Bad page map in process cc1  pte:9800003fdd860690 pmd:3e95b92000
page:000600007fbb0c00 count:107055215 mapcount:-524289 mapping:          (null) index:0xfff8000107659c00
page flags: 0x6c4b6e00004f56(error|referenced|dirty|active|owner_priv_1|arch_1|reserved|private|head)
page dumped because: bad pte
addr:0000000000124000 vm_flags:00000875 anon_vma:          (null) mapping:fff8003f18a06a78 index:12
vma->vm_ops->fault: filemap_fault+0x8/0x440
vma->vm_file->f_op->mmap: ext4_file_mmap+0x8/0x40 [ext4]
CPU: 105 PID: 20076 Comm: cc1 Tainted: G    B D      L 3.17.0-rc7 #1
Call Trace:
 [0000000000567394] print_bad_pte+0x134/0x1e0
 [000000000056ade0] zap_pte_range+0x4c0/0x580
 [000000000056afd4] unmap_page_range+0x134/0x220
 [000000000056b11c] unmap_single_vma+0x5c/0xc0
 [000000000056b1a8] unmap_vmas+0x28/0x60
 [000000000056e248] exit_mmap+0x88/0x160
 [0000000000465c74] mmput+0x54/0xe0
 [00000000004691bc] exit_mm+0x13c/0x1c0
 [000000000046a750] do_exit+0x130/0x440
 [0000000000428500] die_if_kernel+0x1a0/0x340
 [000000000097f498] unhandled_fault+0x78/0xe0
 [000000000097f528] do_kernel_fault+0x28/0x100
 [000000000097f820] do_sparc64_fault+0x220/0x7a0
 [0000000000407b8c] sparc64_realfault_common+0x10/0x20
 [000000000058ea2c] kfree+0x8c/0x2a0
 [0000000000643030] selinux_file_free_security+0x10/0x20
BUG: Bad page map in process cc1  pte:9800003f0a92c690 pmd:3e95b92000
page:000600007e152580 count:0 mapcount:-1 mapping:          (null) index:0x0
page flags: 0x0()
page dumped because: bad pte
addr:0000000000126000 vm_flags:00000875 anon_vma:          (null) mapping:fff8003f18a06a78 index:13
vma->vm_ops->fault: filemap_fault+0x8/0x440
vma->vm_file->f_op->mmap: ext4_file_mmap+0x8/0x40 [ext4]
CPU: 105 PID: 20076 Comm: cc1 Tainted: G    B D      L 3.17.0-rc7 #1
Call Trace:
 [0000000000567394] print_bad_pte+0x134/0x1e0
 [000000000056ade0] zap_pte_range+0x4c0/0x580
 [000000000056afd4] unmap_page_range+0x134/0x220
 [000000000056b11c] unmap_single_vma+0x5c/0xc0
 [000000000056b1a8] unmap_vmas+0x28/0x60
 [000000000056e248] exit_mmap+0x88/0x160
 [0000000000465c74] mmput+0x54/0xe0
 [00000000004691bc] exit_mm+0x13c/0x1c0
 [000000000046a750] do_exit+0x130/0x440
 [0000000000428500] die_if_kernel+0x1a0/0x340
 [000000000097f498] unhandled_fault+0x78/0xe0
 [000000000097f528] do_kernel_fault+0x28/0x100
 [000000000097f820] do_sparc64_fault+0x220/0x7a0
 [0000000000407b8c] sparc64_realfault_common+0x10/0x20
 [000000000058ea2c] kfree+0x8c/0x2a0
 [0000000000643030] selinux_file_free_security+0x10/0x20
BUG: Bad page map in process cc1  pte:9800003f0c4d8690 pmd:3e95b92000
page:000600007e189b00 count:0 mapcount:-1 mapping:          (null) index:0x0
page flags: 0x0()
page dumped because: bad pte
addr:0000000000128000 vm_flags:00000875 anon_vma:          (null) mapping:fff8003f18a06a78 index:14
vma->vm_ops->fault: filemap_fault+0x8/0x440
vma->vm_file->f_op->mmap: ext4_file_mmap+0x8/0x40 [ext4]
CPU: 105 PID: 20076 Comm: cc1 Tainted: G    B D      L 3.17.0-rc7 #1
Call Trace:
 [0000000000567394] print_bad_pte+0x134/0x1e0
 [000000000056ade0] zap_pte_range+0x4c0/0x580
 [000000000056afd4] unmap_page_range+0x134/0x220
 [000000000056b11c] unmap_single_vma+0x5c/0xc0
 [000000000056b1a8] unmap_vmas+0x28/0x60
 [000000000056e248] exit_mmap+0x88/0x160
 [0000000000465c74] mmput+0x54/0xe0
 [00000000004691bc] exit_mm+0x13c/0x1c0
 [000000000046a750] do_exit+0x130/0x440
 [0000000000428500] die_if_kernel+0x1a0/0x340
 [000000000097f498] unhandled_fault+0x78/0xe0
 [000000000097f528] do_kernel_fault+0x28/0x100
 [000000000097f820] do_sparc64_fault+0x220/0x7a0
 [0000000000407b8c] sparc64_realfault_common+0x10/0x20
 [000000000058ea2c] kfree+0x8c/0x2a0
 [0000000000643030] selinux_file_free_security+0x10/0x20
BUG: Bad page map in process cc1  pte:9800003f0d876690 pmd:3e95b92000
page:000600007e1b0ec0 count:0 mapcount:-1 mapping:fff800010722cf60 index:0x0
page flags: 0x0()
page dumped because: bad pte
addr:000000000027a000 vm_flags:00000875 anon_vma:          (null) mapping:fff8003f18a06a78 index:bd
vma->vm_ops->fault: filemap_fault+0x8/0x440
vma->vm_file->f_op->mmap: ext4_file_mmap+0x8/0x40 [ext4]
CPU: 105 PID: 20076 Comm: cc1 Tainted: G    B D      L 3.17.0-rc7 #1
Call Trace:
 [0000000000567394] print_bad_pte+0x134/0x1e0
 [000000000056ade0] zap_pte_range+0x4c0/0x580
 [000000000056afd4] unmap_page_range+0x134/0x220
 [000000000056b11c] unmap_single_vma+0x5c/0xc0
 [000000000056b1a8] unmap_vmas+0x28/0x60
 [000000000056e248] exit_mmap+0x88/0x160
 [0000000000465c74] mmput+0x54/0xe0
 [00000000004691bc] exit_mm+0x13c/0x1c0
 [000000000046a750] do_exit+0x130/0x440
 [0000000000428500] die_if_kernel+0x1a0/0x340
 [000000000097f498] unhandled_fault+0x78/0xe0
 [000000000097f528] do_kernel_fault+0x28/0x100
 [000000000097f820] do_sparc64_fault+0x220/0x7a0
 [0000000000407b8c] sparc64_realfault_common+0x10/0x20
 [000000000058ea2c] kfree+0x8c/0x2a0
 [0000000000643030] selinux_file_free_security+0x10/0x20
Unable to handle kernel NULL pointer dereference
tsk->{mm,active_mm}->context = 0000000000001835
tsk->{mm,active_mm}->pgd = fff8003e95bf0000
              \|/ ____ \|/
              "@'/ .. \`@"
              /_| \__/ |_\
                 \__U_/
cc1(20161): Oops [#2]
CPU: 3 PID: 20161 Comm: cc1 Tainted: G    B D      L 3.17.0-rc7 #1
task: fff8003e95e19d20 ti: fff8003e95e1c000 task.ti: fff8003e95e1c000
TSTATE: 0000000011e01602 TPC: 000000000058ea2c TNPC: 000000000058ea30 Y: fcdcf300    Tainted: G    B D      L
TPC: <kfree+0x8c/0x2a0>
g0: fff8003fddef7888 g1: 0006000000000000 g2: 0000000000000098 g3: 0000000000be6800
g4: fff8003e95e19d20 g5: fff8003f5c32e000 g6: fff8003e95e1c000 g7: 0000000000d62000
o0: 0000000000000000 o1: 0000000000000081 o2: 0000000000000020 o3: 0000000000000000
o4: 0000000000008000 o5: 0000000000000008 sp: fff8003e95e1eff1 ret_pc: 000000000063e4cc
RPC: <security_inode_permission+0x2c/0x40>
l0: 0000000000000000 l1: fff8003f0f5887e0 l2: 0000000000000000 l3: 0000000000643408
l4: 0000000000000014 l5: 00000000009e3e40 l6: fff8003e95e1c000 l7: 00000000005a1860
i0: fff8003f0f5887e0 i1: 0000000000000081 i2: 0000000000000010 i3: 000000007b401fe7
i4: 0000000000b9f723 i5: 0000000000000078 i6: fff8003e95e1f0c1 i7: 0000000000643030
I7: <selinux_file_free_security+0x10/0x20>
Call Trace:
 [0000000000643030] selinux_file_free_security+0x10/0x20
 [000000000063c2b8] security_file_free+0x18/0x40
 [00000000005a55c8] put_filp+0x28/0x60
 [00000000005b336c] path_openat+0xec/0x4c0
 [00000000005b3868] do_filp_open+0x28/0xa0
 [00000000005a1728] do_sys_open+0x148/0x240
 [00000000005a1884] SyS_open+0x24/0x40
 [0000000000406234] linux_sparc_syscall+0x34/0x44
Caller[0000000000643030]: selinux_file_free_security+0x10/0x20
Caller[000000000063c2b8]: security_file_free+0x18/0x40
Caller[00000000005a55c8]: put_filp+0x28/0x60
Caller[00000000005b336c]: path_openat+0xec/0x4c0
Caller[00000000005b3868]: do_filp_open+0x28/0xa0
Caller[00000000005a1728]: do_sys_open+0x148/0x240
Caller[00000000005a1884]: SyS_open+0x24/0x40
Caller[0000000000406234]: linux_sparc_syscall+0x34/0x44
Caller[0000000000659d38]: constraint_expr_eval+0x658/0x6a0
Instruction DUMP: 84048002  80a36001  04400015 <e658a008> c459e2b8  a207a7e7  c658e198  84260002  f077a7f7 
BUG: Bad page map in process cc1  pte:9800003fdd860690 pmd:3e95e48000
page:000600007fbb0c00 count:107055215 mapcount:-524290 mapping:          (null) index:0xfff8000107659c00
page flags: 0x6c4b6e00004f56(error|referenced|dirty|active|owner_priv_1|arch_1|reserved|private|head)
page dumped because: bad pte
addr:0000000000124000 vm_flags:00000875 anon_vma:          (null) mapping:fff8003f18a06a78 index:12
vma->vm_ops->fault: filemap_fault+0x8/0x440
vma->vm_file->f_op->mmap: ext4_file_mmap+0x8/0x40 [ext4]
CPU: 3 PID: 20161 Comm: cc1 Tainted: G    B D      L 3.17.0-rc7 #1
Call Trace:
 [0000000000567394] print_bad_pte+0x134/0x1e0
 [000000000056ade0] zap_pte_range+0x4c0/0x580
 [000000000056afd4] unmap_page_range+0x134/0x220
 [000000000056b11c] unmap_single_vma+0x5c/0xc0
 [000000000056b1a8] unmap_vmas+0x28/0x60
 [000000000056e248] exit_mmap+0x88/0x160
 [0000000000465c74] mmput+0x54/0xe0
 [00000000004691bc] exit_mm+0x13c/0x1c0
 [000000000046a750] do_exit+0x130/0x440
 [0000000000428500] die_if_kernel+0x1a0/0x340
 [000000000097f498] unhandled_fault+0x78/0xe0
 [000000000097f528] do_kernel_fault+0x28/0x100
 [000000000097f820] do_sparc64_fault+0x220/0x7a0
 [0000000000407b8c] sparc64_realfault_common+0x10/0x20
 [000000000058ea2c] kfree+0x8c/0x2a0
 [0000000000643030] selinux_file_free_security+0x10/0x20
BUG: Bad page map in process cc1  pte:9800003f0a92c690 pmd:3e95e48000
page:000600007e152580 count:0 mapcount:-2 mapping:          (null) index:0x0
page flags: 0x4(referenced)
page dumped because: bad pte
addr:0000000000126000 vm_flags:00000875 anon_vma:          (null) mapping:fff8003f18a06a78 index:13
vma->vm_ops->fault: filemap_fault+0x8/0x440
vma->vm_file->f_op->mmap: ext4_file_mmap+0x8/0x40 [ext4]
CPU: 3 PID: 20161 Comm: cc1 Tainted: G    B D      L 3.17.0-rc7 #1
Call Trace:
 [0000000000567394] print_bad_pte+0x134/0x1e0
 [000000000056ade0] zap_pte_range+0x4c0/0x580
 [000000000056afd4] unmap_page_range+0x134/0x220
 [000000000056b11c] unmap_single_vma+0x5c/0xc0
 [000000000056b1a8] unmap_vmas+0x28/0x60
 [000000000056e248] exit_mmap+0x88/0x160
 [0000000000465c74] mmput+0x54/0xe0
 [00000000004691bc] exit_mm+0x13c/0x1c0
 [000000000046a750] do_exit+0x130/0x440
 [0000000000428500] die_if_kernel+0x1a0/0x340
 [000000000097f498] unhandled_fault+0x78/0xe0
 [000000000097f528] do_kernel_fault+0x28/0x100
 [000000000097f820] do_sparc64_fault+0x220/0x7a0
 [0000000000407b8c] sparc64_realfault_common+0x10/0x20
 [000000000058ea2c] kfree+0x8c/0x2a0
 [0000000000643030] selinux_file_free_security+0x10/0x20
BUG: Bad page map in process cc1  pte:9800003f0ccc6690 pmd:3e95e48000

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[Bob Picco]

Hi,
Bob Picco wrote:	[Wed Oct 01 2014, 05:51:09PM EDT]
> Hi,
> David Miller wrote:	[Wed Oct 01 2014, 04:44:55PM EDT]
> > From: David Miller <davem@davemloft.net>
> > Date: Wed, 01 Oct 2014 16:42:01 -0400 (EDT)
> > 
> > > From: Bob Picco <bpicco@meloft.net>
> > > Date: Wed, 1 Oct 2014 10:29:00 -0400
> > > 
> > >> [root@ca-qasparc24 ~]# Unable to handle kernel NULL pointer dereference
> > >> BUG: Bad page map in process cc1  pte:9800003fdd860690 pmd:183f3f4b6000
> > >> page:000600007fbb0c00 count:107055216 mapcount:-524287 mapping:          (null) index:0xfff8000107659c00
> > >> page flags: 0x6c4b6e00004f56(error|referenced|dirty|active|owner_priv_1|arch_1|reserved|private|head)
> > >> page dumped because: bad pte
> > > 
Okay I have two meetings today.

This is where we seem to go bad on T4-2. We go equally bad very quickly on
T5-8 with all patches applied and !THP.

T4-2 is configured for THP "madvise". At this commit:
59a35b1 sparc64: Use kernel page tables for vmemmap.
we seem to fall apart on T4-2 with the program below.

./thp4-loop -a 1024 8192

This all needs to be reverified.

thanx!

<<toy program>>

#define	_GNU_SOURCE
#include <stdio.h>
#include <errno.h>
#include <stdlib.h>
#include <sys/mman.h>

#ifndef MADV_HUGEPAGE
#define MADV_HUGEPAGE	14
#endif

#define HPAGE_SHIFT	(22UL)
#define	HPAGE_SIZE	(1UL << HPAGE_SHIFT)
#define	PAGE_SHIFT	(13UL)
#define	NR_PAGES_HPAGE	(HPAGE_SIZE >> PAGE_SHIFT)
#define __round_mask(x, y) ((__typeof__(x))((y)-1))
#define round_up(x, y) ((((x)-1) | __round_mask(x, y))+1)

/* Note failure assumes an exit(1).
 */
void *allocate_thps(size_t sz)
{
	int rc;
	void *addr;
	size_t align = HPAGE_SIZE;

	rc = posix_memalign(&addr, align, sz);

	if (rc)
		perror("posix_memalign"), exit(1);

	rc = madvise(addr, sz, MADV_HUGEPAGE);

	if (rc) {
		static int warn_once;

		if (warn_once)
			goto out;
		fprintf(stderr, "Couldn't madvise for MADV_HUGEPAGE.\n");
		warn_once = 1;
	}
out:
	return addr;
}

/* Verify the array.
 */
static void verify_thp(void *addr, void *end, int pagesize, int cnt)
{
	unsigned long pc;
	void *p;

	for (pc = 0, p = addr; p < end; p += pagesize, pc++) {
		if (*(unsigned long *) p != 0xbeefUL + (pc << 32UL)) {
			fprintf(stderr, "\n\tcnt = %d pc=0x%lx thp = 0x%lx "
				" addr=0x%lx *addr=0x%lx\n",
				cnt, pc, pc >> 9UL, p, *(unsigned long *) p);
			pc = (pc + NR_PAGES_HPAGE) & ~(NR_PAGES_HPAGE - 1);
			pc--;
			p = addr + (pc << PAGE_SHIFT);
		}
	}

}

int main(int argc, char **argv)
{
	void *addr, *end, *p;
	size_t sz;
	int pagesize = getpagesize();
	int loop, cnt, nthp, rc;
	int recycle = 1;
	unsigned long pc;
	int optind = 0;

	if (argc = 4 && argv[1][1] = 'a')
		optind = 1;
	else if (argc != 3)
		fprintf(stderr, "%s: -a iterations 4Mb-pages\n",
			argv[0]), exit(1);

	rc = sscanf(argv[optind + 1], "%d", &loop);

	if (rc != 1)
		fprintf(stderr, "%s: sscanf (%s) failed\n",
			argv[0], argv[optind + 1]), exit(1);

	rc = sscanf(argv[optind + 2], "%d", &nthp);

	if (rc != 1)
		fprintf(stderr, "%s: sscanf (%s) failed\n",
			argv[0], argv[optind + 2]), exit(1);

	if (optind)
		recycle = 0;

	sz = HPAGE_SIZE * nthp;

	for (cnt = 0; cnt < loop; cnt++) {
		addr = allocate_thps(sz);
		end = addr + sz;

		fprintf(stderr, "[0x%lx-0x%lx) ",
			(unsigned long) addr, (unsigned long) end);

		for (pc = 0, p = addr; p < end; p += pagesize, pc++)
			*(unsigned long *) p = 0xbeefUL + (pc << 32UL);

		verify_thp(addr, end, pagesize, cnt);

		sleep(cnt % 5);

		verify_thp(addr, end, pagesize, cnt);

		if (recycle)
			free(addr);

		fprintf(stdout, ".\n");
		fflush(stdout);
	}

	fprintf(stderr, "%s: Done! cnt = %d\n", argv[0], cnt);

	return 0;
}

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[David Miller]

From: Bob Picco <bpicco@meloft.net>
Date: Thu, 2 Oct 2014 10:24:35 -0400

> This is where we seem to go bad on T4-2. We go equally bad very quickly on
> T5-8 with all patches applied and !THP.
> 
> T4-2 is configured for THP "madvise". At this commit:
> 59a35b1 sparc64: Use kernel page tables for vmemmap.
> we seem to fall apart on T4-2 with the program below.
> 
> ./thp4-loop -a 1024 8192
> 
> This all needs to be reverified.

Excellent report, I'll try to reproduce and look into that
vmemmap commit for problems.

Thanks!

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[David Miller]

From: Bob Picco <bpicco@meloft.net>
Date: Thu, 2 Oct 2014 10:24:35 -0400

> At this commit:
> 59a35b1 sparc64: Use kernel page tables for vmemmap.

I think I figured out what the bug is.

It has to do with how KERN_PGTABLE_WALK masks in the sub-pagesize
bits for huge pages.

That assembler works fine for PAGE_OFFSET mappings where the
sub-pagesize bits always have a direct correspondance to the
physical bits.  But for something like vmemmap that doesn't
work.

I'll verify this and work on a fix.

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[David Miller]

From: David Miller <davem@davemloft.net>
Date: Sat, 04 Oct 2014 15:12:37 -0400 (EDT)

> From: Bob Picco <bpicco@meloft.net>
> Date: Thu, 2 Oct 2014 10:24:35 -0400
> 
>> At this commit:
>> 59a35b1 sparc64: Use kernel page tables for vmemmap.
> 
> I think I figured out what the bug is.
> 
> It has to do with how KERN_PGTABLE_WALK masks in the sub-pagesize
> bits for huge pages.
> 
> That assembler works fine for PAGE_OFFSET mappings where the
> sub-pagesize bits always have a direct correspondance to the
> physical bits.  But for something like vmemmap that doesn't
> work.
> 
> I'll verify this and work on a fix.

Ok, this should do it, looking forward to see your test results:

diff --git a/arch/sparc/include/asm/tsb.h b/arch/sparc/include/asm/tsb.h
index 93a84ea..ecb49cf 100644
--- a/arch/sparc/include/asm/tsb.h
+++ b/arch/sparc/include/asm/tsb.h
@@ -134,8 +134,23 @@ extern struct tsb_phys_patch_entry __tsb_phys_patch, __tsb_phys_patch_end;
 	TSB_STORE(TSB, TAG);
 
 	/* Do a kernel page table walk.  Leaves valid PTE value in
-	 * REG1.  Jumps to FAIL_LABEL on early page table walk termination.
-	 * VADDR will not be clobbered, but REG2 will.
+	 * REG1.  Jumps to FAIL_LABEL on early page table walk
+	 * termination.  VADDR will not be clobbered, but REG2 will.
+	 *
+	 * There are two masks we must apply to propagate bits from
+	 * the virtual address into the PTE physical address field
+	 * when dealing with huge pages.  This is because the page
+	 * table boundaries do not match the huge page size(s) the
+	 * hardware supports.
+	 *
+	 * In these cases we propagate the bits that are below the
+	 * page table level where we saw the huge page mapping, but
+	 * are still within the relevant physical bits for the huge
+	 * page size in question.  So for PMD mappings (which fall on
+	 * bit 23, for 8MB per PMD) we must propagate bit 22 for a
+	 * 4MB huge page.  For huge PUDs (which fall on bit 33, for
+	 * 8GB per PUD), we have to accomodate 256MB and 2GB huge
+	 * pages.  So for those we propagate bits 32 to 28.
 	 */
 #define KERN_PGTABLE_WALK(VADDR, REG1, REG2, FAIL_LABEL)	\
 	sethi		%hi(swapper_pg_dir), REG1; \
@@ -154,8 +169,10 @@ extern struct tsb_phys_patch_entry __tsb_phys_patch, __tsb_phys_patch_end;
 	brz,pn		REG1, FAIL_LABEL; \
 	 sllx		REG2, 32, REG2; \
 	andcc		REG1, REG2, %g0; \
+	sethi		%hi(0xf8000000), REG2; \
 	bne,pt		%xcc, 697f; \
-	 sllx		VADDR, 64 - (PMD_SHIFT + PMD_BITS), REG2; \
+	 sllx		REG2, 1, REG2; \
+	sllx		VADDR, 64 - (PMD_SHIFT + PMD_BITS), REG2; \
 	srlx		REG2, 64 - PAGE_SHIFT, REG2; \
 	andn		REG2, 0x7, REG2; \
 	ldxa		[REG1 + REG2] ASI_PHYS_USE_EC, REG1; \
@@ -164,9 +181,8 @@ extern struct tsb_phys_patch_entry __tsb_phys_patch, __tsb_phys_patch_end;
 	 sllx		REG2, 32, REG2; \
 	andcc		REG1, REG2, %g0; \
 	be,pn		%xcc, 698f; \
-697:	 sethi		%hi(0xffe00000), REG2; \
-	sllx		REG2, 1, REG2; \
-	brgez,pn	REG1, FAIL_LABEL; \
+	 sethi		%hi(0x400000), REG2; \
+697:	brgez,pn	REG1, FAIL_LABEL; \
 	 andn		REG1, REG2, REG1; \
 	and		VADDR, REG2, REG2; \
 	ba,pt		%xcc, 699f; \

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[Bob Picco]

David Miller wrote:	[Sat Oct 04 2014, 03:12:37PM EDT]
> From: Bob Picco <bpicco@meloft.net>
> Date: Thu, 2 Oct 2014 10:24:35 -0400
> 
> > At this commit:
> > 59a35b1 sparc64: Use kernel page tables for vmemmap.
> 
> I think I figured out what the bug is.
> 
> It has to do with how KERN_PGTABLE_WALK masks in the sub-pagesize
> bits for huge pages.
> 
> That assembler works fine for PAGE_OFFSET mappings where the
> sub-pagesize bits always have a direct correspondance to the
> physical bits.  But for something like vmemmap that doesn't
> work.
> 
> I'll verify this and work on a fix.
This is exactly where I was on Friday afternoon. Unfortunately I was too
exhausted to contribute.

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[Bob Picco]

David Miller wrote:	[Sat Oct 04 2014, 04:00:06PM EDT]
> From: David Miller <davem@davemloft.net>
> Date: Sat, 04 Oct 2014 15:12:37 -0400 (EDT)
> 
> > From: Bob Picco <bpicco@meloft.net>
> > Date: Thu, 2 Oct 2014 10:24:35 -0400
> > 
> >> At this commit:
> >> 59a35b1 sparc64: Use kernel page tables for vmemmap.
> > 
> > I think I figured out what the bug is.
> > 
> > It has to do with how KERN_PGTABLE_WALK masks in the sub-pagesize
> > bits for huge pages.
> > 
> > That assembler works fine for PAGE_OFFSET mappings where the
> > sub-pagesize bits always have a direct correspondance to the
> > physical bits.  But for something like vmemmap that doesn't
> > work.
> > 
> > I'll verify this and work on a fix.
> 
> Ok, this should do it, looking forward to see your test results:
This incremental patch has been on T5-8 since Saturday evening. There have
been NO issues related to our work for MM-IRQ.

I will use your version 3 and sparc.git for T5-8, local T5-2 and M7-4. Some
will occur today. The remainder early this week.

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[David Miller]

From: David Miller <davem@davemloft.net>
Date: Tue, 30 Sep 2014 22:57:12 -0400 (EDT)

> I can reproduce this AES failure as well as the unaligned accesses.

I've figured out the nature of the AES failure.

The code tries to optimize the case of processing many blocks at a
time, by preloading the KEY material into the FPU registers then
running the encrypt/decrypt routine over and over again reusing
those precooked registers.

Somehow it appears that the pre-cooked key registers get spammed
upon.  Even if we get an intervening memcpy() via the blkcipher*()
calls, we fully support recursive FPU usage in the kernel on sparc64
so it should "just work".

The test case passes if I change the ->ecb_encrypt() call in
ctr_crypt_final() to ->encrypt() (which hand loads the key into the
FPU before performing a single block encrypt).

Anyways I'll dig further and fix this.

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[David Miller]

From: David Miller <davem@davemloft.net>
Date: Sun, 12 Oct 2014 23:53:09 -0400 (EDT)

> Anyways I'll dig further and fix this.

Bob, I am putting the following fix through some tests, I'll
commit and push everywhere after my tests complete.

Let me know if it works for you too, it should make that bootup
AES test faulure disappear.

Thanks!

==========
[PATCH] sparc64: Fix FPU register corruption with AES crypto offload.

The AES loops in arch/sparc/crypto/aes_glue.c use a scheme where the
key material is preloaded into the FPU registers, and then we loop
over and over doing the crypt operation, reusing those pre-cooked key
registers.

There are intervening blkcipher*() calls between the crypt operation
calls.  And those might perform memcpy() and thus also try to use the
FPU.

The sparc64 kernel FPU usage mechanism is designed to allow such
recursive uses, but with a catch.

There has to be a trap between the two FPU using threads of control.

The mechanism works by, when the FPU is already in use by the kernel,
allocating a slot for FPU saving at trap time.  Then if, within the
trap handler, we try to use the FPU registers, the pre-trap FPU
register state is saved into the slot.  Then at trap return time we
notice this and restore the pre-trap FPU state.

Over the long term there are various more involved ways we can make
this work, but for a quick fix let's take advantage of the fact that
the situation where this happens is very limited.

All sparc64 chips that support the crypto instructiosn also are using
the Niagara4 memcpy routine, and that routine only uses the FPU for
large copies where we can't get the source aligned properly to a
multiple of 8 bytes.

We look to see if the FPU is already in use in this context, and if so
we use the non-large copy path which only uses integer registers.

Furthermore, we also limit this special logic to when we are doing
kernel copy, rather than a user copy.

Signed-off-by: David S. Miller <davem@davemloft.net>
---
 arch/sparc/include/asm/visasm.h |  8 ++++++++
 arch/sparc/lib/NG4memcpy.S      | 14 +++++++++++++-
 2 files changed, 21 insertions(+), 1 deletion(-)

diff --git a/arch/sparc/include/asm/visasm.h b/arch/sparc/include/asm/visasm.h
index b266737..1f0aa20 100644
--- a/arch/sparc/include/asm/visasm.h
+++ b/arch/sparc/include/asm/visasm.h
@@ -39,6 +39,14 @@
 297:	wr		%o5, FPRS_FEF, %fprs;		\
 298:
 
+#define VISEntryHalfFast(fail_label)			\
+	rd		%fprs, %o5;			\
+	andcc		%o5, FPRS_FEF, %g0;		\
+	be,pt		%icc, 297f;			\
+	 nop;						\
+	ba,a,pt		%xcc, fail_label;		\
+297:	wr		%o5, FPRS_FEF, %fprs;
+
 #define VISExitHalf					\
 	wr		%o5, 0, %fprs;
 
diff --git a/arch/sparc/lib/NG4memcpy.S b/arch/sparc/lib/NG4memcpy.S
index 9cf2ee0..140527a 100644
--- a/arch/sparc/lib/NG4memcpy.S
+++ b/arch/sparc/lib/NG4memcpy.S
@@ -41,6 +41,10 @@
 #endif
 #endif
 
+#if !defined(EX_LD) && !defined(EX_ST)
+#define NON_USER_COPY
+#endif
+
 #ifndef EX_LD
 #define EX_LD(x)	x
 #endif
@@ -197,9 +201,13 @@ FUNC_NAME:	/* %o0=dst, %o1=src, %o2=len */
 	 mov		EX_RETVAL(%o3), %o0
 
 .Llarge_src_unaligned:
+#ifdef NON_USER_COPY
+	VISEntryHalfFast(.Lmedium_vis_entry_fail)
+#else
+	VISEntryHalf
+#endif
 	andn		%o2, 0x3f, %o4
 	sub		%o2, %o4, %o2
-	VISEntryHalf
 	alignaddr	%o1, %g0, %g1
 	add		%o1, %o4, %o1
 	EX_LD(LOAD(ldd, %g1 + 0x00, %f0))
@@ -240,6 +248,10 @@ FUNC_NAME:	/* %o0=dst, %o1=src, %o2=len */
 	 nop
 	ba,a,pt		%icc, .Lmedium_unaligned
 
+#ifdef NON_USER_COPY
+.Lmedium_vis_entry_fail:
+	 or		%o0, %o1, %g2
+#endif
 .Lmedium:
 	LOAD(prefetch, %o1 + 0x40, #n_reads_strong)
 	andcc		%g2, 0x7, %g0
-- 
1.8.1.2

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[Bob Picco]

Hi,
David Miller wrote:	[Tue Oct 14 2014, 10:40:28PM EDT]
> From: David Miller <davem@davemloft.net>
> Date: Sun, 12 Oct 2014 23:53:09 -0400 (EDT)
> 
> > Anyways I'll dig further and fix this.
> 
> Bob, I am putting the following fix through some tests, I'll
> commit and push everywhere after my tests complete.
> 
> Let me know if it works for you too, it should make that bootup
> AES test faulure disappear.
> 
> Thanks!
You're welcome. Thanx for the splendid changelog! Otherwise time reviewing
the fpu paths and etc. would have been a challenge to schedule. Boots and
tests without issue on T5-2. Though I had configure them in and 
# CONFIG_CRYPTO_MANAGER_DISABLE_TESTS is not set
. I did review the patch modifications too.

Re: [PATCH v2 0/8] sparc64: MM/IRQ patch queue.

[David Miller]

From: Bob Picco <bpicco@meloft.net>
Date: Thu, 16 Oct 2014 08:36:54 -0400

> You're welcome. Thanx for the splendid changelog! Otherwise time reviewing
> the fpu paths and etc. would have been a challenge to schedule. Boots and
> tests without issue on T5-2. Though I had configure them in and 
> # CONFIG_CRYPTO_MANAGER_DISABLE_TESTS is not set
> . I did review the patch modifications too.

Thanks Bob.

I started working on a text document explaining how the FPU saving
stuff works on sparc64, and will use that to sprinkle comments around
and perhaps clean some of it up.

I think there is one bug I discovered during this documenting process,
in that if we do a VISEntryHalf I think we might not restore the %gsr
register on trap return.  In the rtrap pseudo-code below there are
two code paths which bypass the %gsr load, it is a combination of two
checks which run in sequence, the first is:

	!(t->fpsaved[depth] & (FPRS_FSF | FPRS_DU))

and the second is:

	!(t->fpsaved[depth] & FPRS_FSF)

The second check therefore can only trigger if only FPRS_DU is set.
There might be a reason why skipping the %gsr load is kosher in this
case, but I haven't figure it out yet.

Anyways, here is my doc in progress.

==========

struct thread_info:

       convention is that slot [0] of save arrays is for the user's FPU
       state, and slot [1] and later are for kernel FPU state

       thread_info->fpdepth bit zero indicates if there is user FPU
       state saved or not, bits one and higher are the kernel FPU
       save depth.  So user stuff is saved in slot zero, and kernel
       stuff is saved in slot "(fpdepth >> 1) + 1".

VisEntry:
	struct thread_info *t = current_thread_info();

	/* %o5 = %fprs */
	if (t->fpdepth = 0) {
		t->fpsaved[0] = 0;
		t->xfsr[0] = %fsr;
		return;
	}
	if (t->fpdepth = 1) {
	vis1:

	}


VisEntryHalf:
	struct thread_info *t = current_thread_info();

	/* %o5 = %fprs */
	g1 = t->fpdepth;
	if (t->fpdepth = 0) {
		t->fpsaved[0] = 0;
		t->xfsr[0] = %fsr;
		o5 = 0;
		%fprs = FPRS_FEF;
		return;
	}
	if (t->fpdepth = 1) {
		backtrack_return_pc(8);
		goto vis1;
	}

	tp->fpsaved[tp->fpdepth] = o5 & ~FPRS_DU;
	tp->gsr[tp->fpdepth] = %gsr;
	if (o5 & FPRS_DL) {
		store_block(f0, tp->fpregs + (g1 << 5) + 0x00);
		store_block(f16, tp->fpregs + (g1 << 5) + 0x40);
	}
	%fprs = (o5 & FPRS_DU) ^ FPRS_FEF;
	return;

VisExit/VisExitHalf:
	%fprs = 0

etrap:
	( from kernel )
	struct thread_info *t = current_thread_info();
	t->fpsaved[(t->fpdepth >> 1) + 1] = 0;
	t->fpdepth += 2;

rtrap:
	( to kernel )
	struct thread_info *t = current_thread_info();
	if (t->fpdepth) {
		l2 = t->fpsaved[t->fpdepth >> 1];
		o0 = tp->fpdepth >> 1;
		o1 = t + TI_GSR;
		l6 = l2 & FPRS_DL;
		if (!(l2 & (FPRS_FEF | FPRS_DU)))
			goto out_2;
		o5 = o0 << 3;
		if (!(l2 & FPRS_FEF))
			goto out_5;

		g1 = %fprs;
		%fprs = %g1 ^ FPRS_FEF;

		g1 = t->gsr[tp->fpdepth];
		o2 = o0 << 8;
		if (l6) {
			load_block(f0, tp->fpregs + %o2)
			load_block(f16, tp->fpregs + 0x40 + %o2)
		}
		%gsr = %g1
		if (l2 & FPRS_DU) {
			load_block(f32, tp->fpregs + 0x80 + %o2)
			load_block(f48, tp->fpregs + 0xc0 + %o2)
		}
		/* fallthru */
	out_2:
		t->fpdepth -= 2;
		goto out_99;
	out_5:
		%fprs = FPRS_FEF;
		o2 = o0 << 8;
		load_block(f32, tp->fpregs + 0x80 + %o2)
		load_block(f48, tp->fpregs + 0xc0 + %o2)
		%fprs = FPRS_DU;
		tp->fpdepth -= 2;
		goto out_99;
	}
	out_99:

{TSTATE,PSTATE}_PEF management:

	Firstly, as per V9, all traps set PSTATE_PEF in %pstate for
	the trap handler.  The "predefined" state for %pstate upon
	entry to a trap handler is:

		PSTATE.MM = unchanged
		PSTATE.RED = 0
		PSTATE.PEF = 1
		PSTATE.AM = 0
		PSTATE.PRIV = 1
		PSTATE.IE = 0
		PSTATE.AG = 1
		PSTATE.CLE = PSTATE.TLE

	1) start_thread{,32}() clears TSTATE_PEF
	2) All traps into kernel (both from user and kernel) set TSTATE_PEF in
	   %tstate and do a 'done' which propagates it into PSTATE_PEF in
	   %pstate.
	3) fpu_disabled trap sets TSTATE_PEF in %tstate before finishing
	   with 'retry' (which like 'done' propagates it to PSTATE_PEF in
	   %pstate).
	4) If the 64-bit set_context system call saves FPU state, TSTATE_PEF
	   is cleared in the task's registers.