xen-devel.lists.xenproject.org archive mirror
 help / color / mirror / Atom feed
* Memory missing in 2.6.32.36
       [not found] <SNT0-MC4-F34MpzkUY6002755b8@snt0-mc4-f34.Snt0.hotmail.com>
@ 2011-05-18 14:58 ` MaoXiaoyun
  2011-05-19  3:58   ` MaoXiaoyun
  0 siblings, 1 reply; 12+ messages in thread
From: MaoXiaoyun @ 2011-05-18 14:58 UTC (permalink / raw)
  To: xen devel


[-- Attachment #1.1: Type: text/plain, Size: 1587 bytes --]


Hi: 
 
    Recently I am trying pvops dom0 kernel, 2.6.32.36, but confronted some strange things.
 
    In my grub, i give dom0 5630M memory. But when system startup, use free -m, only see 2869M in total.
 
title Red Hat Enterprise Linux Server (2.6.32.36xen)
        root (hd0,0)
        kernel /xen-4.0.1.gz msi=1 iommu=off x2apic=off console=com1,vga com1=115200,8n1 noreboot dom0_mem=5630M dom0_max_vcpus=4 dom0_vcpus_pin cpuidle=    0 cpufreq=none no-xsave
        module /vmlinuz-2.6.32.36xen ro root=LABEL=/ hda=noprobe console=hvc0
        module /initrd-2.6.32.36xen.img
 
 
Free -m output
 
root@xmao # free -m
             total       used       free     shared    buffers     cached
Mem:          2869       1068       1800          0         25         65
-/+ buffers/cache:        977       1892
Swap:         1027          0       1027
 
root@xmao# xm li 
Name                                        ID   Mem VCPUs      State   Time(s)
Domain-0                                     0  4862     4     r-----   1272.6
 
root@xmao # xenstore-read /local/domain/0/memory/target
4979676
 
and dom0 auto balloon is disabled in /etc/xen/xend-config.
 
Well, when I use 2.6.32.10. Everything is OK
Free output in 2.6.32.10
root@xmao # free -m
             total       used       free     shared    buffers     cached
Mem:          4860       1550       3309          0         14         75
-/+ buffers/cache:       1460       3399
Swap:         1027          0       1027
 
Where is my memory going with 32.36?
 
Thanks.
 
  		 	   		  

[-- Attachment #1.2: Type: text/html, Size: 3947 bytes --]

[-- Attachment #2: Type: text/plain, Size: 138 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

^ permalink raw reply	[flat|nested] 12+ messages in thread

* RE: Memory missing in 2.6.32.36
  2011-05-18 14:58 ` Memory missing in 2.6.32.36 MaoXiaoyun
@ 2011-05-19  3:58   ` MaoXiaoyun
  2011-05-19  5:30     ` MaoXiaoyun
  0 siblings, 1 reply; 12+ messages in thread
From: MaoXiaoyun @ 2011-05-19  3:58 UTC (permalink / raw)
  To: xen devel


[-- Attachment #1.1: Type: text/plain, Size: 2050 bytes --]


if xend is not started at the very beginning
 
root@xmao # free -m
             total       used       free     shared    buffers     cached
Mem:          3636       1020       2616          0         12         52
-/+ buffers/cache:        955       2681
Swap:         1027          0       1027
 


From: tinnycloud@hotmail.com
To: xen-devel@lists.xensource.com
Subject: Memory missing in 2.6.32.36
Date: Wed, 18 May 2011 22:58:55 +0800




Hi: 
 
    Recently I am trying pvops dom0 kernel, 2.6.32.36, but confronted some strange things.
 
    In my grub, i give dom0 5630M memory. But when system startup, use free -m, only see 2869M in total.
 
title Red Hat Enterprise Linux Server (2.6.32.36xen)
        root (hd0,0)
        kernel /xen-4.0.1.gz msi=1 iommu=off x2apic=off console=com1,vga com1=115200,8n1 noreboot dom0_mem=5630M dom0_max_vcpus=4 dom0_vcpus_pin cpuidle=    0 cpufreq=none no-xsave
        module /vmlinuz-2.6.32.36xen ro root=LABEL=/ hda=noprobe console=hvc0
        module /initrd-2.6.32.36xen.img
 
 
Free -m output
 
root@xmao # free -m
             total       used       free     shared    buffers     cached
Mem:          2869       1068       1800          0         25         65
-/+ buffers/cache:        977       1892
Swap:         1027          0       1027
 
root@xmao# xm li 
Name                                        ID   Mem VCPUs      State   Time(s)
Domain-0                                     0  4862     4     r-----   1272.6
 
root@xmao # xenstore-read /local/domain/0/memory/target
4979676
 
and dom0 auto balloon is disabled in /etc/xen/xend-config.
 
Well, when I use 2.6.32.10. Everything is OK
Free output in 2.6.32.10
root@xmao # free -m
             total       used       free     shared    buffers     cached
Mem:          4860       1550       3309          0         14         75
-/+ buffers/cache:       1460       3399
Swap:         1027          0       1027
 
Where is my memory going with 32.36?
 
Thanks.
 
 
 		 	   		  

[-- Attachment #1.2: Type: text/html, Size: 5237 bytes --]

[-- Attachment #2: Type: text/plain, Size: 138 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

^ permalink raw reply	[flat|nested] 12+ messages in thread

* RE: Memory missing in 2.6.32.36
  2011-05-19  3:58   ` MaoXiaoyun
@ 2011-05-19  5:30     ` MaoXiaoyun
  2011-05-19 13:17       ` RE:2Gb Memory lost " MaoXiaoyun
  0 siblings, 1 reply; 12+ messages in thread
From: MaoXiaoyun @ 2011-05-19  5:30 UTC (permalink / raw)
  To: xen devel


[-- Attachment #1.1: Type: text/plain, Size: 16587 bytes --]



Boot up info below. 
>From line 4 and 70, see I give dom0 5630M memory, 
but from line 230:
229 Memory: 3717504k/52165668k available (4404k kernel code, 1057688k absent, 47389772k reserved, 2847k data, 732k init)

which is printed in  arch/x86/mm/init_64.c, nr_free_pages() only 3717504K,  something wrong?
 
static struct kcore_list kcore_vsyscall;
void __init mem_init(void)
{
 long codesize, reservedpages, datasize, initsize;
 unsigned long absent_pages;
 pci_iommu_alloc();
 /* clear_bss() already clear the empty_zero_page */
 reservedpages = 0;
 /* this will put all low memory onto the freelists */
#ifdef CONFIG_NUMA
 totalram_pages = numa_free_all_bootmem();
#else
 totalram_pages = free_all_bootmem();
#endif
 absent_pages = absent_pages_in_range(0, max_pfn);
 reservedpages = max_pfn - totalram_pages - absent_pages;
 after_bootmem = 1;
 codesize =  (unsigned long) &_etext - (unsigned long) &_text;
 datasize =  (unsigned long) &_edata - (unsigned long) &_etext;
 initsize =  (unsigned long) &__init_end - (unsigned long) &__init_begin;
 /* Register memory areas for /proc/kcore */
 kclist_add(&kcore_vsyscall, (void *)VSYSCALL_START,
    VSYSCALL_END - VSYSCALL_START, KCORE_OTHER);
 printk(KERN_INFO "Memory: %luk/%luk available (%ldk kernel code, "
    "%ldk absent, %ldk reserved, %ldk data, %ldk init)\n",
  nr_free_pages() << (PAGE_SHIFT-10),
  max_pfn << (PAGE_SHIFT-10),
  codesize >> 10,
  absent_pages << (PAGE_SHIFT-10),
  reservedpages << (PAGE_SHIFT-10),
  datasize >> 10,
  initsize >> 10);
}
 
  1 root (hd0,0)
  2  Filesystem type is ext2fs, partition type 0x83
  3 kernel /xen-4.0.1.gz msi=1 iommu=off x2apic=off console=com1,vga com1=115200,8n
  4 1 noreboot dom0_mem=5630M dom0_max_vcpus=4 dom0_vcpus_pin cpuidle=0 cpufreq=none
  5                                                                      
  6  \ \/ /___ _ __   | || |  / _ \ / |                                        *
  7   \  // _ \ '_ \  | || |_| | | || |                                        *
  8   /  \  __/ | | | |__   _| |_| || |                                        *
  9  /_/\_\___|_| |_|    |_|(_)___(_)_|                                        *
 10 (XEN) ACPI: RSDP 000FA000, 0024 (r2 ACPIAM)
 11 (XEN) ACPI: XSDT BF790100, 005C (r1 080510 XSDT1021 20100805 MSFT       97)
 12 (XEN) ACPI: FACP BF790290, 00F4 (r4 080510 FACP1021 20100805 MSFT       97)
 13 (XEN) ACPI: DSDT BF7904F0, 4E48 (r2  CTSAV CTSAV031       31 INTL 20051117)
 14 (XEN) ACPI: FACS BF79E000, 0040
 15 (XEN) ACPI: APIC BF790390, 0118 (r2 080510 APIC1021 20100805 MSFT       97)
 16 (XEN) ACPI: MCFG BF7904B0, 003C (r1 080510 OEMMCFG  20100805 MSFT       97)
 17 (XEN) ACPI: OEMB BF79E040, 0082 (r1 080510 OEMB1021 20100805 MSFT       97)
 18 (XEN) ACPI: SRAT BF79A4F0, 01D0 (r2 080510 OEMSRAT         1 INTL        1)
 19 (XEN) ACPI: HPET BF79A6C0, 0038 (r1 080510 OEMHPET  20100805 MSFT       97)
 20 (XEN) ACPI: SSDT BF7A1A10, 0363 (r1 DpgPmm    CpuPm       12 INTL 20051117)
 21 (XEN) System RAM: 49143MB (50322600kB)
 22 (XEN) Domain heap initialised DMA width 32 bits
 23 (XEN) Processor #0 6:12 APIC version 21
 24 (XEN) Processor #2 6:12 APIC version 21
 25 (XEN) Processor #18 6:12 APIC version 21
 26 (XEN) Processor #20 6:12 APIC version 21
 27 (XEN) Processor #32 6:12 APIC version 21
 28 (XEN) Processor #34 6:12 APIC version 21
 29 (XEN) Processor #50 6:12 APIC version 21
 30 (XEN) Processor #52 6:12 APIC version 21
 31 (XEN) Processor #1 6:12 APIC version 21
 32 (XEN) Processor #3 6:12 APIC version 21
 33 (XEN) Processor #19 6:12 APIC version 21
 
 66 (XEN) *** LOADING DOMAIN 0 ***
 67 (XEN)  Xen  kernel: 64-bit, lsb, compat32
 68 (XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x19b7000
 69 (XEN) PHYSICAL MEMORY ARRANGEMENT:
 70 (XEN)  Dom0 alloc.:   0000000434000000->0000000438000000 (1424896 pages to be allocated)
 71 (XEN) VIRTUAL MEMORY ARRANGEMENT:
 72 (XEN)  Loaded kernel: ffffffff81000000->ffffffff819b7000
 73 (XEN)  Init. ramdisk: ffffffff819b7000->ffffffff81ec6e00
 74 (XEN)  Phys-Mach map: ffffffff81ec7000->ffffffff829c6000
 75 (XEN)  Start info:    ffffffff829c6000->ffffffff829c64b4
 76 (XEN)  Page tables:   ffffffff829c7000->ffffffff829e0000
 77 (XEN)  Boot stack:    ffffffff829e0000->ffffffff829e1000
 78 (XEN)  TOTAL:         ffffffff80000000->ffffffff82c00000
 79 (XEN)  ENTRY ADDRESS: ffffffff8172c200
 80 (XEN) Dom0 has maximum 4 VCPUs
 81 (XEN) Scrubbing Free RAM: ...............................................................................................................................    .........................................................................................................................................................    ..............
 82 ...............................
 83 (XEN) Xen trace buffers: disabled
 84 (XEN) Std. Loglevel: Errors and warnings
 85 (XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
 86 (XEN) Xen is relinquishing VGA console.
 87 (XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
 88 (XEN) Freed 168kB init memory.
 89 mapping kernel into physical memory
 90 Xen: setup ISA identity maps
 91 about to get started...
 92 Initializing cgroup subsys cpuset
 93 Initializing cgroup subsys cpu
 94 Linux version 2.6.32.36xen (root@houyi-chunk2.dev.sd.aliyun.com) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-46)) #1 SMP Wed May 18 22:10:07 CST 2011
 95 Command line: ro root=LABEL=/ hda=noprobe console=hvc0
 96 KERNEL supported cpus:
 97   Intel GenuineIntel
 98   AMD AuthenticAMD
 99   Centaur CentaurHauls
100 xen_release_chunk: looking at area pfn bf7e0-bf7ec: 12 pages freed
101 xen_release_chunk: looking at area pfn c0000-e0000: 131072 pages freed
102 xen_release_chunk: looking at area pfn f0000-fec00: 60416 pages freed
103 xen_release_chunk: looking at area pfn fec01-fec8a: 137 pages freed
104 xen_release_chunk: looking at area pfn fec8b-fee00: 373 pages freed
105 xen_release_chunk: looking at area pfn fee01-fff00: 4351 pages freed
106 released 196361 pages of unused memory
107 BIOS-provided physical RAM map:
108  Xen: 0000000000000000 - 000000000009a000 (usable)
109  Xen: 000000000009a400 - 0000000000100000 (reserved)
110  Xen: 0000000000100000 - 00000000bf790000 (usable)
111  Xen: 00000000bf790000 - 00000000bf79e000 (ACPI data)
112  Xen: 00000000bf79e000 - 00000000bf7d0000 (ACPI NVS)
113  Xen: 00000000bf7d0000 - 00000000bf7e0000 (reserved)
114  Xen: 00000000bf7ec000 - 00000000c0000000 (reserved)
115  Xen: 00000000e0000000 - 00000000f0000000 (reserved)
116  Xen: 00000000fec00000 - 00000000fec01000 (reserved)
117  Xen: 00000000fec8a000 - 00000000fec8b000 (reserved)
118  Xen: 00000000fee00000 - 00000000fee01000 (reserved)
119  Xen: 00000000fff00000 - 0000000100000000 (reserved)
120  Xen: 0000000100000000 - 0000000c6ff09000 (usable)
121 DMI present.
122 AMI BIOS detected: BIOS may corrupt low RAM, working around it.
123 last_pfn = 0xc6ff09 max_arch_pfn = 0x400000000
124 last_pfn = 0xbf790 max_arch_pfn = 0x400000000
125 init_memory_mapping: 0000000000000000-00000000bf790000
126 init_memory_mapping: 0000000100000000-0000000c6ff09000
127 RAMDISK: 019b7000 - 01ec6e00
128 ACPI: RSDP 00000000000fa000 00024 (v02 ACPIAM)
129 ACPI: XSDT 00000000bf790100 0005C (v01 080510 XSDT1021 20100805 MSFT 00000097)
130 ACPI: FACP 00000000bf790290 000F4 (v04 080510 FACP1021 20100805 MSFT 00000097)
131 ACPI: DSDT 00000000bf7904f0 04E48 (v02  CTSAV CTSAV031 00000031 INTL 20051117)
132 ACPI: FACS 00000000bf79e000 00040
133 ACPI: APIC 00000000bf790390 00118 (v02 080510 APIC1021 20100805 MSFT 00000097)
134 ACPI: MCFG 00000000bf7904b0 0003C (v01 080510 OEMMCFG  20100805 MSFT 00000097)
135 ACPI: OEMB 00000000bf79e040 00082 (v01 080510 OEMB1021 20100805 MSFT 00000097)
136 ACPI: SRAT 00000000bf79a4f0 001D0 (v02 080510 OEMSRAT  00000001 INTL 00000001)
137 ACPI: HPET 00000000bf79a6c0 00038 (v01 080510 OEMHPET  20100805 MSFT 00000097)
138 ACPI: SSDT 00000000bf7a1a10 00363 (v01 DpgPmm    CpuPm 00000012 INTL 20051117)
139 (10 early reservations) ==> bootmem [0000000000 - 0c6ff09000]
140   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
141   #1 [00029c7000 - 00029e0000]   XEN PAGETABLES ==> [00029c7000 - 00029e0000]
142   #2 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
143   #3 [0001000000 - 000188c3b8]    TEXT DATA BSS ==> [0001000000 - 000188c3b8]
144   #4 [00019b7000 - 0001ec6e00]          RAMDISK ==> [00019b7000 - 0001ec6e00]
145   #5 [0001ec7000 - 00029c7000]   XEN START INFO ==> [0001ec7000 - 00029c7000]
146   #6 [015fe00000 - 0c6ff09000]        XEN EXTRA ==> [015fe00000 - 0c6ff09000]
147   #7 [000188d000 - 00018a31c0]              BRK ==> [000188d000 - 00018a31c0]
148   #8 [0000100000 - 00006e4000]          PGTABLE ==> [0000100000 - 00006e4000]
149   #9 [00029e0000 - 000858e000]          PGTABLE ==> [00029e0000 - 000858e000]
150 Zone PFN ranges:
151   DMA      0x00000010 -> 0x00001000
152   DMA32    0x00001000 -> 0x00100000
153   Normal   0x00100000 -> 0x00c6ff09
154 Movable zone start PFN for each node
155 early_node_map[3] active PFN ranges
156     0: 0x00000010 -> 0x0000009a
157     0: 0x00000100 -> 0x000bf790
158     0: 0x00100000 -> 0x00c6ff09
159 ACPI: PM-Timer IO Port: 0x808
160 ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
161 ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
162 ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled)
163 ACPI: LAPIC (acpi_id[0x04] lapic_id[0x14] enabled)
164 ACPI: LAPIC (acpi_id[0x05] lapic_id[0x20] enabled)
165 ACPI: LAPIC (acpi_id[0x06] lapic_id[0x22] enabled)
166 ACPI: LAPIC (acpi_id[0x07] lapic_id[0x32] enabled)
167 ACPI: LAPIC (acpi_id[0x08] lapic_id[0x34] enabled)
168 ACPI: LAPIC (acpi_id[0x09] lapic_id[0x01] enabled)
169 ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x03] enabled)
170 ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x13] enabled)
171 ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x15] enabled)
172 ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x21] enabled)
173 ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x23] enabled)
174 ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x33] enabled)
175 ACPI: LAPIC (acpi_id[0x10] lapic_id[0x35] enabled)
176 ACPI: LAPIC (acpi_id[0x11] lapic_id[0x90] disabled)
177 ACPI: LAPIC (acpi_id[0x12] lapic_id[0x91] disabled)
178 ACPI: LAPIC (acpi_id[0x13] lapic_id[0x92] disabled)
179 ACPI: LAPIC (acpi_id[0x14] lapic_id[0x93] disabled)
180 ACPI: LAPIC (acpi_id[0x15] lapic_id[0x94] disabled)
181 ACPI: LAPIC (acpi_id[0x16] lapic_id[0x95] disabled)
182 ACPI: LAPIC (acpi_id[0x17] lapic_id[0x96] disabled)
183 ACPI: LAPIC (acpi_id[0x18] lapic_id[0x97] disabled)
184 ACPI: IOAPIC (id[0x06] address[0xfec00000] gsi_base[0])
185 IOAPIC[0]: apic_id 6, version 0, address 0xfec00000, GSI 0-0
186 ACPI: IOAPIC (id[0x07] address[0xfec8a000] gsi_base[24])
187 IOAPIC[1]: apic_id 7, version 0, address 0xfec8a000, GSI 24-24
188 ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
189 ERROR: Unable to locate IOAPIC for GSI 2
190 ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
191 ERROR: Unable to locate IOAPIC for GSI 9
192 Using ACPI (MADT) for SMP configuration information
193 ACPI: HPET id: 0x8086a301 base: 0xfed00000
194 SMP: Allowing 4 CPUs, 0 hotplug CPUs
195 PM: Registered nosave memory: 000000000009a000 - 000000000009b000
196 PM: Registered nosave memory: 000000000009b000 - 0000000000100000
197 PM: Registered nosave memory: 00000000bf790000 - 00000000bf79e000
198 PM: Registered nosave memory: 00000000bf79e000 - 00000000bf7d0000
199 PM: Registered nosave memory: 00000000bf7d0000 - 00000000bf7e0000
200 PM: Registered nosave memory: 00000000bf7e0000 - 00000000bf7ec000
201 PM: Registered nosave memory: 00000000bf7ec000 - 00000000c0000000
202 PM: Registered nosave memory: 00000000c0000000 - 00000000e0000000
203 PM: Registered nosave memory: 00000000e0000000 - 00000000f0000000
204 PM: Registered nosave memory: 00000000f0000000 - 00000000fec00000
205 PM: Registered nosave memory: 00000000fec00000 - 00000000fec01000
206 PM: Registered nosave memory: 00000000fec01000 - 00000000fec8a000
207 PM: Registered nosave memory: 00000000fec8a000 - 00000000fec8b000
208 PM: Registered nosave memory: 00000000fec8b000 - 00000000fee00000
209 PM: Registered nosave memory: 00000000fee00000 - 00000000fee01000
210 PM: Registered nosave memory: 00000000fee01000 - 00000000fff00000
211 PM: Registered nosave memory: 00000000fff00000 - 0000000100000000
212 Allocating PCI resources starting at c0000000 (gap: c0000000:20000000)
213 Booting paravirtualized kernel on Xen
214 Xen version: 4.0.1 (preserve-AD) (dom0)
215 NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
216 PERCPU: Embedded 29 pages/cpu @ffff88002803b000 s90072 r8192 d20520 u118784
217 pcpu-alloc: s90072 r8192 d20520 u118784 alloc=29*4096
218 pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3
219 Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 12597183
220 Kernel command line: ro root=LABEL=/ hda=noprobe console=hvc0
221 PID hash table entries: 4096 (order: 3, 32768 bytes)
222 Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes)
223 Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes)
224 Initializing CPU#0
225 DMA: Placing 64MB software IO TLB between ffff880020000000 - ffff880024000000
226 DMA: software IO TLB at phys 0x20000000 - 0x24000000
227 xen_swiotlb_fixup: buf=ffff880020000000 size=67108864
228 xen_swiotlb_fixup: buf=ffff880024060000 size=32768
229 Memory: 3717504k/52165668k available (4404k kernel code, 1057688k absent, 47389772k reserved, 2847k data, 732k init)
230 SLUB: Genslabs=13, HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
231 Hierarchical RCU implementation.
232 NR_IRQS:4352 nr_irqs:1280
233 ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
234 ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
235 xen: sci override: source_irq=9 global_irq=9 trigger=c polarity=1
236 xen_allocate_pirq: returning irq 9 for gsi 9
237 xen: acpi sci 9
238 Console: colour VGA+ 80x25
239 console [hvc0] enabled
240 allocated 511180800 bytes of page_cgroup
241 please try 'cgroup_disable=memory' option if you don't want memory cgroups
242 installing Xen timer for CPU 0


From: tinnycloud@hotmail.com
To: xen-devel@lists.xensource.com
Subject: RE: Memory missing in 2.6.32.36
Date: Thu, 19 May 2011 11:58:01 +0800




if xend is not started at the very beginning
 
root@xmao # free -m
             total       used       free     shared    buffers     cached
Mem:          3636       1020       2616          0         12         52
-/+ buffers/cache:        955       2681
Swap:         1027          0       1027
 


From: tinnycloud@hotmail.com
To: xen-devel@lists.xensource.com
Subject: Memory missing in 2.6.32.36
Date: Wed, 18 May 2011 22:58:55 +0800



Hi: 
 
    Recently I am trying pvops dom0 kernel, 2.6.32.36, but confronted some strange things.
 
    In my grub, i give dom0 5630M memory. But when system startup, use free -m, only see 2869M in total.
 
title Red Hat Enterprise Linux Server (2.6.32.36xen)
        root (hd0,0)
        kernel /xen-4.0.1.gz msi=1 iommu=off x2apic=off console=com1,vga com1=115200,8n1 noreboot dom0_mem=5630M dom0_max_vcpus=4 dom0_vcpus_pin cpuidle=    0 cpufreq=none no-xsave
        module /vmlinuz-2.6.32.36xen ro root=LABEL=/ hda=noprobe console=hvc0
        module /initrd-2.6.32.36xen.img
 
 
Free -m output
 
root@xmao # free -m
             total       used       free     shared    buffers     cached
Mem:          2869       1068       1800          0         25         65
-/+ buffers/cache:        977       1892
Swap:         1027          0       1027
 
root@xmao# xm li 
Name                                        ID   Mem VCPUs      State   Time(s)
Domain-0                                     0  4862     4     r-----   1272.6
 
root@xmao # xenstore-read /local/domain/0/memory/target
4979676
 
and dom0 auto balloon is disabled in /etc/xen/xend-config.
 
Well, when I use 2.6.32.10. Everything is OK
Free output in 2.6.32.10
root@xmao # free -m
             total       used       free     shared    buffers     cached
Mem:          4860       1550       3309          0         14         75
-/+ buffers/cache:       1460       3399
Swap:         1027          0       1027
 
Where is my memory going with 32.36?
 
Thanks.
 
 
 		 	   		  

[-- Attachment #1.2: Type: text/html, Size: 23732 bytes --]

[-- Attachment #2: Type: text/plain, Size: 138 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

^ permalink raw reply	[flat|nested] 12+ messages in thread

* RE:2Gb Memory lost in 2.6.32.36
  2011-05-19  5:30     ` MaoXiaoyun
@ 2011-05-19 13:17       ` MaoXiaoyun
  2011-05-19 14:42         ` RE:2Gb Memory lost in 2.6.32.36 - 50G memory, maxmem=50G, 2G used for pagetable Konrad Rzeszutek Wilk
  2011-05-19 14:44         ` 2Gb Memory lost in 2.6.32.36 Konrad Rzeszutek Wilk
  0 siblings, 2 replies; 12+ messages in thread
From: MaoXiaoyun @ 2011-05-19 13:17 UTC (permalink / raw)
  To: xen devel; +Cc: jeremy, konrad.wilk


[-- Attachment #1.1: Type: text/plain, Size: 22521 bytes --]


Hi:
 
      I was able to do some debug. And I'd like to sum this issue again. It looks like has relation with xen_memory_setup(). arch/x86/xen/setup.c 
 
1) first in grub config, give dom0 5630M memory
        kernel /xen-4.0.1.gz msi=1 iommu=off x2apic=off console=com1,vga com1=115200,8n1 noreboot dom0_mem=5630M dom0_max_vcpus=4 dom0_vcpus_pin cpuidle= 0 cpufreq=none no-xsave

2) use 2.6.32.36 kernel, free -m only see 2869 memory
 
root@xmao# xm info | grep memory
total_memory           : 49143
free_memory            : 44512
node_to_memory         : node0:24424
 
root@xmao # free -m
             total       used       free     shared    buffers     cached
Mem:          2869       1068       1800          0         25         65
-/+ buffers/cache:        977       1892
Swap:         1027          0       1027
 
root@xmao# xm li 
Name                                        ID   Mem VCPUs      State   Time(s)
Domain-0                                     0  4862     4     r-----   1272.6

3) use 2.6.32.10 kernel,  I got 4860, which means 4860 - 2869 memory is lost!

root@xmao # free -m
             total       used       free     shared    buffers     cached
Mem:          4860       1550       3309          0         14         75
-/+ buffers/cache:       1460       3399
Swap:         1027          0       1027
 
 
4) Compare the boot log   between kernel 10 and 36, I noticed something different, they have different last_pfn.
 
===below is 36====
 Xen: 0000000000000000 - 000000000009a000 (usable)
 Xen: 000000000009a400 - 0000000000100000 (reserved)
 Xen: 0000000000100000 - 00000000bf790000 (usable)
 Xen: 00000000bf790000 - 00000000bf79e000 (ACPI data)
 Xen: 00000000bf79e000 - 00000000bf7d0000 (ACPI NVS)
 Xen: 00000000bf7d0000 - 00000000bf7e0000 (reserved)
 Xen: 00000000bf7ec000 - 00000000c0000000 (reserved)
 Xen: 00000000e0000000 - 00000000f0000000 (reserved)
 Xen: 00000000fec00000 - 00000000fec01000 (reserved)
 Xen: 00000000fec8a000 - 00000000fec8b000 (reserved)
 Xen: 00000000fee00000 - 00000000fee01000 (reserved)
 Xen: 00000000fff00000 - 0000000100000000 (reserved)
 Xen: 0000000100000000 - 0000000c6ff09000 (usable)
DMI present.
AMI BIOS detected: BIOS may corrupt low RAM, working around it.
last_pfn = 0xc6ff09 max_arch_pfn = 0x400000000
last_pfn = 0xbf790 max_arch_pfn = 0x400000000
 
=========below is 10
 
 Xen: 0000000000000000 - 000000000009a400 (usable)
 Xen: 000000000009a400 - 0000000000100000 (reserved)
 Xen: 0000000000100000 - 00000000bf790000 (usable)
 Xen: 00000000bf790000 - 00000000bf79e000 (ACPI data)
 Xen: 00000000bf79e000 - 00000000bf7d0000 (ACPI NVS)
 Xen: 00000000bf7d0000 - 00000000bf7e0000 (reserved)
 Xen: 00000000bf7ec000 - 00000000c0000000 (reserved)
 Xen: 00000000e0000000 - 00000000f0000000 (reserved)
 Xen: 00000000fec00000 - 00000000fec01000 (reserved)
 Xen: 00000000fec8a000 - 00000000fec8b000 (reserved)
 Xen: 00000000fee00000 - 00000000fee01000 (reserved)
 Xen: 00000000fff00000 - 0000000100000000 (reserved)
 Xen: 0000000100000000 - 000000015fe00000 (usable)
DMI present.
AMI BIOS detected: BIOS may corrupt low RAM, working around it.
last_pfn = 0x15fe00 max_arch_pfn = 0x400000000
last_pfn = 0xbf790 max_arch_pfn = 0x400000000
 
 
5) this makes me take a look char * __init xen_memory_setup(void) in arch/x86/xen/setup.c
 
compare with the source code with 2.6.31, I noticed that code from line 242 is newly added, and I comment line 261.
And the result is some of the memory comes back. I got 3662. But some others still lost.
 
root@xmao# free -m
             total       used       free     shared    buffers     cached
Mem:          3662        406       3255          0         14        105
-/+ buffers/cache:        286       3375
Swap:         1027          0       1027
 
root@xmao   # xm info | grep memory
total_memory           : 49143
free_memory            : 44512
node_to_memory         : node0:24424
 
and BIOS got info same as kernel 10
 
BIOS-provided physical RAM map:
 Xen: 0000000000000000 - 000000000009a000 (usable)
 Xen: 000000000009a400 - 0000000000100000 (reserved)
 Xen: 0000000000100000 - 00000000bf790000 (usable)
 Xen: 00000000bf790000 - 00000000bf79e000 (ACPI data)
 Xen: 00000000bf79e000 - 00000000bf7d0000 (ACPI NVS)
 Xen: 00000000bf7d0000 - 00000000bf7e0000 (reserved)
 Xen: 00000000bf7ec000 - 00000000c0000000 (reserved)
 Xen: 00000000e0000000 - 00000000f0000000 (reserved)
 Xen: 00000000fec00000 - 00000000fec01000 (reserved)
 Xen: 00000000fec8a000 - 00000000fec8b000 (reserved)
 Xen: 00000000fee00000 - 00000000fee01000 (reserved)
 Xen: 00000000fff00000 - 0000000100000000 (reserved)
 Xen: 0000000100000000 - 000000015fe00000 (usable)
DMI present.
AMI BIOS detected: BIOS may corrupt low RAM, working around it.
last_pfn = 0x15fe00 max_arch_pfn = 0x400000000
last_pfn = 0xbf790 max_arch_pfn = 0x400000000
 
=======code below========
 
144 char * __init xen_memory_setup(void)
145 {
146 <+++static struct e820entry map[E820MAX] __initdata;
147 
148 <+++unsigned long max_pfn = xen_start_info->nr_pages;
149 <+++unsigned long long mem_end;
150 <+++int rc;
151 <+++struct xen_memory_map memmap;
152 <+++unsigned long extra_pages = 0;
153 <+++unsigned long extra_limit;
154 <+++int op;
155 <+++int i;
156 
157 <+++max_pfn = min(MAX_DOMAIN_PAGES, max_pfn);
158 <+++mem_end = PFN_PHYS(max_pfn);
159 
160 <+++memmap.nr_entries = E820MAX;
161 <+++set_xen_guest_handle(memmap.buffer, map);
162 
163 <+++op = xen_initial_domain() ?
164 <+++<+++XENMEM_machine_memory_map :
165 <+++<+++XENMEM_memory_map;
166 <+++rc = HYPERVISOR_memory_op(op, &memmap);
167 <+++if (rc == -ENOSYS) {
168 <+++<+++BUG_ON(xen_initial_domain());
169 <+++<+++memmap.nr_entries = 1;
170 <+++<+++map[0].addr = 0ULL;
171 <+++<+++map[0].size = mem_end;
172 <+++<+++/* 8MB slack (to balance backend allocations). */
173 <+++<+++map[0].size += 8ULL << 20;
174 <+++<+++map[0].type = E820_RAM;
175 <+++<+++rc = 0;
176 <+++}                                                                                                                                                    
177 <+++BUG_ON(rc);
178 
179 <+++e820.nr_map = 0;
 
 
242 <+++/*
243 <+++ * Clamp the amount of extra memory to a EXTRA_MEM_RATIO
244 <+++ * factor the base size.  On non-highmem systems, the base
245 <+++ * size is the full initial memory allocation; on highmem it
246 <+++ * is limited to the max size of lowmem, so that it doesn't
247 <+++ * get completely filled.
248 <+++ *
249 <+++ * In principle there could be a problem in lowmem systems if
250 <+++ * the initial memory is also very large with respect to
251 <+++ * lowmem, but we won't try to deal with that here.
252 <+++ */
253 <+++extra_limit = min(EXTRA_MEM_RATIO * min(max_pfn, PFN_DOWN(MAXMEM)),
254 <+++<+++<+++  max_pfn + extra_pages);
255 
256 <+++if (extra_limit >= max_pfn)
257 <+++<+++extra_pages = extra_limit - max_pfn;
258 <+++else
259 <+++<+++extra_pages = 0;
260 
261 <+++//xen_add_extra_mem(extra_pages);                                                                                                                    
262 
263 <+++return "Xen";
 


From: tinnycloud@hotmail.com
To: xen-devel@lists.xensource.com
Subject: RE: Memory missing in 2.6.32.36
Date: Thu, 19 May 2011 13:30:03 +0800




Boot up info below. 
>From line 4 and 70, see I give dom0 5630M memory, 
but from line 230:
229 Memory: 3717504k/52165668k available (4404k kernel code, 1057688k absent, 47389772k reserved, 2847k data, 732k init)

which is printed in  arch/x86/mm/init_64.c, nr_free_pages() only 3717504K,  something wrong?
 
static struct kcore_list kcore_vsyscall;
void __init mem_init(void)
{
 long codesize, reservedpages, datasize, initsize;
 unsigned long absent_pages;
 pci_iommu_alloc();
 /* clear_bss() already clear the empty_zero_page */
 reservedpages = 0;
 /* this will put all low memory onto the freelists */
#ifdef CONFIG_NUMA
 totalram_pages = numa_free_all_bootmem();
#else
 totalram_pages = free_all_bootmem();
#endif
 absent_pages = absent_pages_in_range(0, max_pfn);
 reservedpages = max_pfn - totalram_pages - absent_pages;
 after_bootmem = 1;
 codesize =  (unsigned long) &_etext - (unsigned long) &_text;
 datasize =  (unsigned long) &_edata - (unsigned long) &_etext;
 initsize =  (unsigned long) &__init_end - (unsigned long) &__init_begin;
 /* Register memory areas for /proc/kcore */
 kclist_add(&kcore_vsyscall, (void *)VSYSCALL_START,
    VSYSCALL_END - VSYSCALL_START, KCORE_OTHER);
 printk(KERN_INFO "Memory: %luk/%luk available (%ldk kernel code, "
    "%ldk absent, %ldk reserved, %ldk data, %ldk init)\n",
  nr_free_pages() << (PAGE_SHIFT-10),
  max_pfn << (PAGE_SHIFT-10),
  codesize >> 10,
  absent_pages << (PAGE_SHIFT-10),
  reservedpages << (PAGE_SHIFT-10),
  datasize >> 10,
  initsize >> 10);
}
 
  1 root (hd0,0)
  2  Filesystem type is ext2fs, partition type 0x83
  3 kernel /xen-4.0.1.gz msi=1 iommu=off x2apic=off console=com1,vga com1=115200,8n
  4 1 noreboot dom0_mem=5630M dom0_max_vcpus=4 dom0_vcpus_pin cpuidle=0 cpufreq=none
  5                                                                      
  6  \ \/ /___ _ __   | || |  / _ \ / |                                        *
  7   \  // _ \ '_ \  | || |_| | | || |                                        *
  8   /  \  __/ | | | |__   _| |_| || |                                        *
  9  /_/\_\___|_| |_|    |_|(_)___(_)_|                                        *
 10 (XEN) ACPI: RSDP 000FA000, 0024 (r2 ACPIAM)
 11 (XEN) ACPI: XSDT BF790100, 005C (r1 080510 XSDT1021 20100805 MSFT       97)
 12 (XEN) ACPI: FACP BF790290, 00F4 (r4 080510 FACP1021 20100805 MSFT       97)
 13 (XEN) ACPI: DSDT BF7904F0, 4E48 (r2  CTSAV CTSAV031       31 INTL 20051117)
 14 (XEN) ACPI: FACS BF79E000, 0040
 15 (XEN) ACPI: APIC BF790390, 0118 (r2 080510 APIC1021 20100805 MSFT       97)
 16 (XEN) ACPI: MCFG BF7904B0, 003C (r1 080510 OEMMCFG  20100805 MSFT       97)
 17 (XEN) ACPI: OEMB BF79E040, 0082 (r1 080510 OEMB1021 20100805 MSFT       97)
 18 (XEN) ACPI: SRAT BF79A4F0, 01D0 (r2 080510 OEMSRAT         1 INTL        1)
 19 (XEN) ACPI: HPET BF79A6C0, 0038 (r1 080510 OEMHPET  20100805 MSFT       97)
 20 (XEN) ACPI: SSDT BF7A1A10, 0363 (r1 DpgPmm    CpuPm       12 INTL 20051117)
 21 (XEN) System RAM: 49143MB (50322600kB)
 22 (XEN) Domain heap initialised DMA width 32 bits
 23 (XEN) Processor #0 6:12 APIC version 21
 24 (XEN) Processor #2 6:12 APIC version 21
 25 (XEN) Processor #18 6:12 APIC version 21
 26 (XEN) Processor #20 6:12 APIC version 21
 27 (XEN) Processor #32 6:12 APIC version 21
 28 (XEN) Processor #34 6:12 APIC version 21
 29 (XEN) Processor #50 6:12 APIC version 21
 30 (XEN) Processor #52 6:12 APIC version 21
 31 (XEN) Processor #1 6:12 APIC version 21
 32 (XEN) Processor #3 6:12 APIC version 21
 33 (XEN) Processor #19 6:12 APIC version 21
 
 66 (XEN) *** LOADING DOMAIN 0 ***
 67 (XEN)  Xen  kernel: 64-bit, lsb, compat32
 68 (XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x19b7000
 69 (XEN) PHYSICAL MEMORY ARRANGEMENT:
 70 (XEN)  Dom0 alloc.:   0000000434000000->0000000438000000 (1424896 pages to be allocated)
 71 (XEN) VIRTUAL MEMORY ARRANGEMENT:
 72 (XEN)  Loaded kernel: ffffffff81000000->ffffffff819b7000
 73 (XEN)  Init. ramdisk: ffffffff819b7000->ffffffff81ec6e00
 74 (XEN)  Phys-Mach map: ffffffff81ec7000->ffffffff829c6000
 75 (XEN)  Start info:    ffffffff829c6000->ffffffff829c64b4
 76 (XEN)  Page tables:   ffffffff829c7000->ffffffff829e0000
 77 (XEN)  Boot stack:    ffffffff829e0000->ffffffff829e1000
 78 (XEN)  TOTAL:         ffffffff80000000->ffffffff82c00000
 79 (XEN)  ENTRY ADDRESS: ffffffff8172c200
 80 (XEN) Dom0 has maximum 4 VCPUs
 81 (XEN) Scrubbing Free RAM: ...............................................................................................................................    .........................................................................................................................................................    ..............
 82 ...............................
 83 (XEN) Xen trace buffers: disabled
 84 (XEN) Std. Loglevel: Errors and warnings
 85 (XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
 86 (XEN) Xen is relinquishing VGA console.
 87 (XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
 88 (XEN) Freed 168kB init memory.
 89 mapping kernel into physical memory
 90 Xen: setup ISA identity maps
 91 about to get started...
 92 Initializing cgroup subsys cpuset
 93 Initializing cgroup subsys cpu
 94 Linux version 2.6.32.36xen (root@houyi-chunk2.dev.sd.aliyun.com) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-46)) #1 SMP Wed May 18 22:10:07 CST 2011
 95 Command line: ro root=LABEL=/ hda=noprobe console=hvc0
 96 KERNEL supported cpus:
 97   Intel GenuineIntel
 98   AMD AuthenticAMD
 99   Centaur CentaurHauls
100 xen_release_chunk: looking at area pfn bf7e0-bf7ec: 12 pages freed
101 xen_release_chunk: looking at area pfn c0000-e0000: 131072 pages freed
102 xen_release_chunk: looking at area pfn f0000-fec00: 60416 pages freed
103 xen_release_chunk: looking at area pfn fec01-fec8a: 137 pages freed
104 xen_release_chunk: looking at area pfn fec8b-fee00: 373 pages freed
105 xen_release_chunk: looking at area pfn fee01-fff00: 4351 pages freed
106 released 196361 pages of unused memory
107 BIOS-provided physical RAM map:
108  Xen: 0000000000000000 - 000000000009a000 (usable)
109  Xen: 000000000009a400 - 0000000000100000 (reserved)
110  Xen: 0000000000100000 - 00000000bf790000 (usable)
111  Xen: 00000000bf790000 - 00000000bf79e000 (ACPI data)
112  Xen: 00000000bf79e000 - 00000000bf7d0000 (ACPI NVS)
113  Xen: 00000000bf7d0000 - 00000000bf7e0000 (reserved)
114  Xen: 00000000bf7ec000 - 00000000c0000000 (reserved)
115  Xen: 00000000e0000000 - 00000000f0000000 (reserved)
116  Xen: 00000000fec00000 - 00000000fec01000 (reserved)
117  Xen: 00000000fec8a000 - 00000000fec8b000 (reserved)
118  Xen: 00000000fee00000 - 00000000fee01000 (reserved)
119  Xen: 00000000fff00000 - 0000000100000000 (reserved)
120  Xen: 0000000100000000 - 0000000c6ff09000 (usable)
121 DMI present.
122 AMI BIOS detected: BIOS may corrupt low RAM, working around it.
123 last_pfn = 0xc6ff09 max_arch_pfn = 0x400000000
124 last_pfn = 0xbf790 max_arch_pfn = 0x400000000
125 init_memory_mapping: 0000000000000000-00000000bf790000
126 init_memory_mapping: 0000000100000000-0000000c6ff09000
127 RAMDISK: 019b7000 - 01ec6e00
128 ACPI: RSDP 00000000000fa000 00024 (v02 ACPIAM)
129 ACPI: XSDT 00000000bf790100 0005C (v01 080510 XSDT1021 20100805 MSFT 00000097)
130 ACPI: FACP 00000000bf790290 000F4 (v04 080510 FACP1021 20100805 MSFT 00000097)
131 ACPI: DSDT 00000000bf7904f0 04E48 (v02  CTSAV CTSAV031 00000031 INTL 20051117)
132 ACPI: FACS 00000000bf79e000 00040
133 ACPI: APIC 00000000bf790390 00118 (v02 080510 APIC1021 20100805 MSFT 00000097)
134 ACPI: MCFG 00000000bf7904b0 0003C (v01 080510 OEMMCFG  20100805 MSFT 00000097)
135 ACPI: OEMB 00000000bf79e040 00082 (v01 080510 OEMB1021 20100805 MSFT 00000097)
136 ACPI: SRAT 00000000bf79a4f0 001D0 (v02 080510 OEMSRAT  00000001 INTL 00000001)
137 ACPI: HPET 00000000bf79a6c0 00038 (v01 080510 OEMHPET  20100805 MSFT 00000097)
138 ACPI: SSDT 00000000bf7a1a10 00363 (v01 DpgPmm    CpuPm 00000012 INTL 20051117)
139 (10 early reservations) ==> bootmem [0000000000 - 0c6ff09000]
140   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
141   #1 [00029c7000 - 00029e0000]   XEN PAGETABLES ==> [00029c7000 - 00029e0000]
142   #2 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
143   #3 [0001000000 - 000188c3b8]    TEXT DATA BSS ==> [0001000000 - 000188c3b8]
144   #4 [00019b7000 - 0001ec6e00]          RAMDISK ==> [00019b7000 - 0001ec6e00]
145   #5 [0001ec7000 - 00029c7000]   XEN START INFO ==> [0001ec7000 - 00029c7000]
146   #6 [015fe00000 - 0c6ff09000]        XEN EXTRA ==> [015fe00000 - 0c6ff09000]
147   #7 [000188d000 - 00018a31c0]              BRK ==> [000188d000 - 00018a31c0]
148   #8 [0000100000 - 00006e4000]          PGTABLE ==> [0000100000 - 00006e4000]
149   #9 [00029e0000 - 000858e000]          PGTABLE ==> [00029e0000 - 000858e000]
150 Zone PFN ranges:
151   DMA      0x00000010 -> 0x00001000
152   DMA32    0x00001000 -> 0x00100000
153   Normal   0x00100000 -> 0x00c6ff09
154 Movable zone start PFN for each node
155 early_node_map[3] active PFN ranges
156     0: 0x00000010 -> 0x0000009a
157     0: 0x00000100 -> 0x000bf790
158     0: 0x00100000 -> 0x00c6ff09
159 ACPI: PM-Timer IO Port: 0x808
160 ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
161 ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
162 ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled)
163 ACPI: LAPIC (acpi_id[0x04] lapic_id[0x14] enabled)
164 ACPI: LAPIC (acpi_id[0x05] lapic_id[0x20] enabled)
165 ACPI: LAPIC (acpi_id[0x06] lapic_id[0x22] enabled)
166 ACPI: LAPIC (acpi_id[0x07] lapic_id[0x32] enabled)
167 ACPI: LAPIC (acpi_id[0x08] lapic_id[0x34] enabled)
168 ACPI: LAPIC (acpi_id[0x09] lapic_id[0x01] enabled)
169 ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x03] enabled)
170 ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x13] enabled)
171 ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x15] enabled)
172 ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x21] enabled)
173 ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x23] enabled)
174 ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x33] enabled)
175 ACPI: LAPIC (acpi_id[0x10] lapic_id[0x35] enabled)
176 ACPI: LAPIC (acpi_id[0x11] lapic_id[0x90] disabled)
177 ACPI: LAPIC (acpi_id[0x12] lapic_id[0x91] disabled)
178 ACPI: LAPIC (acpi_id[0x13] lapic_id[0x92] disabled)
179 ACPI: LAPIC (acpi_id[0x14] lapic_id[0x93] disabled)
180 ACPI: LAPIC (acpi_id[0x15] lapic_id[0x94] disabled)
181 ACPI: LAPIC (acpi_id[0x16] lapic_id[0x95] disabled)
182 ACPI: LAPIC (acpi_id[0x17] lapic_id[0x96] disabled)
183 ACPI: LAPIC (acpi_id[0x18] lapic_id[0x97] disabled)
184 ACPI: IOAPIC (id[0x06] address[0xfec00000] gsi_base[0])
185 IOAPIC[0]: apic_id 6, version 0, address 0xfec00000, GSI 0-0
186 ACPI: IOAPIC (id[0x07] address[0xfec8a000] gsi_base[24])
187 IOAPIC[1]: apic_id 7, version 0, address 0xfec8a000, GSI 24-24
188 ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
189 ERROR: Unable to locate IOAPIC for GSI 2
190 ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
191 ERROR: Unable to locate IOAPIC for GSI 9
192 Using ACPI (MADT) for SMP configuration information
193 ACPI: HPET id: 0x8086a301 base: 0xfed00000
194 SMP: Allowing 4 CPUs, 0 hotplug CPUs
195 PM: Registered nosave memory: 000000000009a000 - 000000000009b000
196 PM: Registered nosave memory: 000000000009b000 - 0000000000100000
197 PM: Registered nosave memory: 00000000bf790000 - 00000000bf79e000
198 PM: Registered nosave memory: 00000000bf79e000 - 00000000bf7d0000
199 PM: Registered nosave memory: 00000000bf7d0000 - 00000000bf7e0000
200 PM: Registered nosave memory: 00000000bf7e0000 - 00000000bf7ec000
201 PM: Registered nosave memory: 00000000bf7ec000 - 00000000c0000000
202 PM: Registered nosave memory: 00000000c0000000 - 00000000e0000000
203 PM: Registered nosave memory: 00000000e0000000 - 00000000f0000000
204 PM: Registered nosave memory: 00000000f0000000 - 00000000fec00000
205 PM: Registered nosave memory: 00000000fec00000 - 00000000fec01000
206 PM: Registered nosave memory: 00000000fec01000 - 00000000fec8a000
207 PM: Registered nosave memory: 00000000fec8a000 - 00000000fec8b000
208 PM: Registered nosave memory: 00000000fec8b000 - 00000000fee00000
209 PM: Registered nosave memory: 00000000fee00000 - 00000000fee01000
210 PM: Registered nosave memory: 00000000fee01000 - 00000000fff00000
211 PM: Registered nosave memory: 00000000fff00000 - 0000000100000000
212 Allocating PCI resources starting at c0000000 (gap: c0000000:20000000)
213 Booting paravirtualized kernel on Xen
214 Xen version: 4.0.1 (preserve-AD) (dom0)
215 NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
216 PERCPU: Embedded 29 pages/cpu @ffff88002803b000 s90072 r8192 d20520 u118784
217 pcpu-alloc: s90072 r8192 d20520 u118784 alloc=29*4096
218 pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3
219 Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 12597183
220 Kernel command line: ro root=LABEL=/ hda=noprobe console=hvc0
221 PID hash table entries: 4096 (order: 3, 32768 bytes)
222 Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes)
223 Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes)
224 Initializing CPU#0
225 DMA: Placing 64MB software IO TLB between ffff880020000000 - ffff880024000000
226 DMA: software IO TLB at phys 0x20000000 - 0x24000000
227 xen_swiotlb_fixup: buf=ffff880020000000 size=67108864
228 xen_swiotlb_fixup: buf=ffff880024060000 size=32768
229 Memory: 3717504k/52165668k available (4404k kernel code, 1057688k absent, 47389772k reserved, 2847k data, 732k init)
230 SLUB: Genslabs=13, HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
231 Hierarchical RCU implementation.
232 NR_IRQS:4352 nr_irqs:1280
233 ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
234 ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
235 xen: sci override: source_irq=9 global_irq=9 trigger=c polarity=1
236 xen_allocate_pirq: returning irq 9 for gsi 9
237 xen: acpi sci 9
238 Console: colour VGA+ 80x25
239 console [hvc0] enabled
240 allocated 511180800 bytes of page_cgroup
241 please try 'cgroup_disable=memory' option if you don't want memory cgroups
242 installing Xen timer for CPU 0


From: tinnycloud@hotmail.com
To: xen-devel@lists.xensource.com
Subject: RE: Memory missing in 2.6.32.36
Date: Thu, 19 May 2011 11:58:01 +0800



if xend is not started at the very beginning
 
root@xmao # free -m
             total       used       free     shared    buffers     cached
Mem:          3636       1020       2616          0         12         52
-/+ buffers/cache:        955       2681
Swap:         1027          0       1027
 


From: tinnycloud@hotmail.com
To: xen-devel@lists.xensource.com
Subject: Memory missing in 2.6.32.36
Date: Wed, 18 May 2011 22:58:55 +0800



Hi: 
 
    Recently I am trying pvops dom0 kernel, 2.6.32.36, but confronted some strange things.
 
   

 		 	   		  

[-- Attachment #1.2: Type: text/html, Size: 32827 bytes --]

[-- Attachment #2: Type: text/plain, Size: 138 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: RE:2Gb Memory lost in 2.6.32.36 - 50G memory, maxmem=50G, 2G used for pagetable.
  2011-05-19 13:17       ` RE:2Gb Memory lost " MaoXiaoyun
@ 2011-05-19 14:42         ` Konrad Rzeszutek Wilk
  2011-05-19 15:31           ` MaoXiaoyun
  2011-05-19 14:44         ` 2Gb Memory lost in 2.6.32.36 Konrad Rzeszutek Wilk
  1 sibling, 1 reply; 12+ messages in thread
From: Konrad Rzeszutek Wilk @ 2011-05-19 14:42 UTC (permalink / raw)
  To: MaoXiaoyun; +Cc: jeremy, xen devel

> 4) Compare the boot log   between kernel 10 and 36, I noticed something different, they have different last_pfn.
>  
> ===below is 36====
>  Xen: 0000000000000000 - 000000000009a000 (usable)
>  Xen: 000000000009a400 - 0000000000100000 (reserved)
>  Xen: 0000000000100000 - 00000000bf790000 (usable)
>  Xen: 00000000bf790000 - 00000000bf79e000 (ACPI data)
>  Xen: 00000000bf79e000 - 00000000bf7d0000 (ACPI NVS)
>  Xen: 00000000bf7d0000 - 00000000bf7e0000 (reserved)
>  Xen: 00000000bf7ec000 - 00000000c0000000 (reserved)
>  Xen: 00000000e0000000 - 00000000f0000000 (reserved)
>  Xen: 00000000fec00000 - 00000000fec01000 (reserved)
>  Xen: 00000000fec8a000 - 00000000fec8b000 (reserved)
>  Xen: 00000000fee00000 - 00000000fee01000 (reserved)
>  Xen: 00000000fff00000 - 0000000100000000 (reserved)
>  Xen: 0000000100000000 - 0000000c6ff09000 (usable)

Ok, C6FF09-100000 is 46GB

> DMI present.
> AMI BIOS detected: BIOS may corrupt low RAM, working around it.
> last_pfn = 0xc6ff09 max_arch_pfn = 0x400000000
> last_pfn = 0xbf790 max_arch_pfn = 0x400000000
>  
> =========below is 10
>  
>  Xen: 0000000000000000 - 000000000009a400 (usable)
>  Xen: 000000000009a400 - 0000000000100000 (reserved)
>  Xen: 0000000000100000 - 00000000bf790000 (usable)
>  Xen: 00000000bf790000 - 00000000bf79e000 (ACPI data)
>  Xen: 00000000bf79e000 - 00000000bf7d0000 (ACPI NVS)
>  Xen: 00000000bf7d0000 - 00000000bf7e0000 (reserved)
>  Xen: 00000000bf7ec000 - 00000000c0000000 (reserved)
>  Xen: 00000000e0000000 - 00000000f0000000 (reserved)
>  Xen: 00000000fec00000 - 00000000fec01000 (reserved)
>  Xen: 00000000fec8a000 - 00000000fec8b000 (reserved)
>  Xen: 00000000fee00000 - 00000000fee01000 (reserved)
>  Xen: 00000000fff00000 - 0000000100000000 (reserved)
>  Xen: 0000000100000000 - 000000015fe00000 (usable)

And, 15FE00-100000 = 392704*4K/1K/1K = 1534MB = 1.5G

> DMI present.
> AMI BIOS detected: BIOS may corrupt low RAM, working around it.
> last_pfn = 0x15fe00 max_arch_pfn = 0x400000000
> last_pfn = 0xbf790 max_arch_pfn = 0x400000000
>  

So the problem looks as the .36 is creating a pagetable for the
memory above the 5G you provided - which sounds correct as
you gave it 5G and the expectation that it can balloon up to 50G.

What happens if you provide dom0_mem=max:5G to clamp on the size?

^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: 2Gb Memory lost in 2.6.32.36
  2011-05-19 13:17       ` RE:2Gb Memory lost " MaoXiaoyun
  2011-05-19 14:42         ` RE:2Gb Memory lost in 2.6.32.36 - 50G memory, maxmem=50G, 2G used for pagetable Konrad Rzeszutek Wilk
@ 2011-05-19 14:44         ` Konrad Rzeszutek Wilk
  2011-05-19 15:32           ` MaoXiaoyun
  1 sibling, 1 reply; 12+ messages in thread
From: Konrad Rzeszutek Wilk @ 2011-05-19 14:44 UTC (permalink / raw)
  To: MaoXiaoyun; +Cc: jeremy, xen devel

On Thu, May 19, 2011 at 09:17:11PM +0800, MaoXiaoyun wrote:
> 
> Hi:
>  
>       I was able to do some debug. And I'd like to sum this issue again. It looks like has relation with xen_memory_setup(). arch/x86/xen/setup.c 
>  
> 1) first in grub config, give dom0 5630M memory
>         kernel /xen-4.0.1.gz msi=1 iommu=off x2apic=off console=com1,vga com1=115200,8n1 noreboot dom0_mem=5630M dom0_max_vcpus=4 dom0_vcpus_pin cpuidle= 0 cpufreq=none no-xsave

Hm, no-xsave? I think you mean xsave=0

Also the cpuidle looks wrong. It should be cpuidle=0 (no space).
Lastly, why 'msi=1'? It is turned on by defualt.

^ permalink raw reply	[flat|nested] 12+ messages in thread

* RE: RE:2Gb Memory lost in 2.6.32.36 - 50G memory, maxmem=50G, 2G used for pagetable.
  2011-05-19 14:42         ` RE:2Gb Memory lost in 2.6.32.36 - 50G memory, maxmem=50G, 2G used for pagetable Konrad Rzeszutek Wilk
@ 2011-05-19 15:31           ` MaoXiaoyun
  2011-05-19 16:16             ` RE:2Gb Memory lost in 2.6.32.36 - 50G memory, maxmem=50G, 2G used for pagetable, clamping (max:5G) is not helping Konrad Rzeszutek Wilk
  0 siblings, 1 reply; 12+ messages in thread
From: MaoXiaoyun @ 2011-05-19 15:31 UTC (permalink / raw)
  To: konrad.wilk; +Cc: jeremy, xen devel


[-- Attachment #1.1: Type: text/plain, Size: 4440 bytes --]



 

> Date: Thu, 19 May 2011 10:42:42 -0400
> From: konrad.wilk@oracle.com
> To: tinnycloud@hotmail.com
> CC: xen-devel@lists.xensource.com; jeremy@goop.org
> Subject: Re: [Xen-devel] RE:2Gb Memory lost in 2.6.32.36 - 50G memory, maxmem=50G, 2G used for pagetable.
> 
> > 4) Compare the boot log between kernel 10 and 36, I noticed something different, they have different last_pfn.
> > 
> > ===below is 36====
> > Xen: 0000000000000000 - 000000000009a000 (usable)
> > Xen: 000000000009a400 - 0000000000100000 (reserved)
> > Xen: 0000000000100000 - 00000000bf790000 (usable)
> > Xen: 00000000bf790000 - 00000000bf79e000 (ACPI data)
> > Xen: 00000000bf79e000 - 00000000bf7d0000 (ACPI NVS)
> > Xen: 00000000bf7d0000 - 00000000bf7e0000 (reserved)
> > Xen: 00000000bf7ec000 - 00000000c0000000 (reserved)
> > Xen: 00000000e0000000 - 00000000f0000000 (reserved)
> > Xen: 00000000fec00000 - 00000000fec01000 (reserved)
> > Xen: 00000000fec8a000 - 00000000fec8b000 (reserved)
> > Xen: 00000000fee00000 - 00000000fee01000 (reserved)
> > Xen: 00000000fff00000 - 0000000100000000 (reserved)
> > Xen: 0000000100000000 - 0000000c6ff09000 (usable)
> 
> Ok, C6FF09-100000 is 46GB
> 
> > DMI present.
> > AMI BIOS detected: BIOS may corrupt low RAM, working around it.
> > last_pfn = 0xc6ff09 max_arch_pfn = 0x400000000
> > last_pfn = 0xbf790 max_arch_pfn = 0x400000000
> > 
> > =========below is 10
> > 
> > Xen: 0000000000000000 - 000000000009a400 (usable)
> > Xen: 000000000009a400 - 0000000000100000 (reserved)
> > Xen: 0000000000100000 - 00000000bf790000 (usable)
> > Xen: 00000000bf790000 - 00000000bf79e000 (ACPI data)
> > Xen: 00000000bf79e000 - 00000000bf7d0000 (ACPI NVS)
> > Xen: 00000000bf7d0000 - 00000000bf7e0000 (reserved)
> > Xen: 00000000bf7ec000 - 00000000c0000000 (reserved)
> > Xen: 00000000e0000000 - 00000000f0000000 (reserved)
> > Xen: 00000000fec00000 - 00000000fec01000 (reserved)
> > Xen: 00000000fec8a000 - 00000000fec8b000 (reserved)
> > Xen: 00000000fee00000 - 00000000fee01000 (reserved)
> > Xen: 00000000fff00000 - 0000000100000000 (reserved)
> > Xen: 0000000100000000 - 000000015fe00000 (usable)
> 
> And, 15FE00-100000 = 392704*4K/1K/1K = 1534MB = 1.5G
> 
> > DMI present.
> > AMI BIOS detected: BIOS may corrupt low RAM, working around it.
> > last_pfn = 0x15fe00 max_arch_pfn = 0x400000000
> > last_pfn = 0xbf790 max_arch_pfn = 0x400000000
> > 
> 
> So the problem looks as the .36 is creating a pagetable for the
> memory above the 5G you provided - which sounds correct as
> you gave it 5G and the expectation that it can balloon up to 50G.
> 
> What happens if you provide dom0_mem=max:5G to clamp on the size?
> 
 
Seems nothing different(what is clamp means? ^_^ )
 
released 196361 pages of unused memory
BIOS-provided physical RAM map:
 Xen: 0000000000000000 - 000000000009a000 (usable)
 Xen: 000000000009a400 - 0000000000100000 (reserved)
 Xen: 0000000000100000 - 00000000bf790000 (usable)
 Xen: 00000000bf790000 - 00000000bf79e000 (ACPI data)
 Xen: 00000000bf79e000 - 00000000bf7d0000 (ACPI NVS)
 Xen: 00000000bf7d0000 - 00000000bf7e0000 (reserved)
 Xen: 00000000bf7ec000 - 00000000c0000000 (reserved)
 Xen: 00000000e0000000 - 00000000f0000000 (reserved)
 Xen: 00000000fec00000 - 00000000fec01000 (reserved)
 Xen: 00000000fec8a000 - 00000000fec8b000 (reserved)
 Xen: 00000000fee00000 - 00000000fee01000 (reserved)
 Xen: 00000000fff00000 - 0000000100000000 (reserved)
 Xen: 0000000100000000 - 0000000c6ff09000 (usable)
DMI present.
AMI BIOS detected: BIOS may corrupt low RAM, working around it.
last_pfn = 0xc6ff09 max_arch_pfn = 0x400000000
last_pfn = 0xbf790 max_arch_pfn = 0x400000000
init_memory_mapping: 0000000000000000-00000000bf790000
init_memory_mapping: 0000000100000000-0000000c6ff09000
RAMDISK: 019b7000 - 01ec6e00
 
root@xmao # xm info | grep 'memory\|command'
total_memory           : 49143
free_memory            : 45022
node_to_memory         : node0:24424
xen_commandline        : msi=1 iommu=off x2apic=off console=com1,vga com1=115200,8n1 noreboot dom0_mem=max:5G dom0_max_vcpus=4 dom0_vcpus_pin cpuidle=0 cpufreq=none xsave=0
 
root@xmao # free -m
             total       used       free     shared    buffers     cached
Mem:          2360       1136       1224          0         15        122
-/+ buffers/cache:        997       1363
Swap:         1027          0       1027
 		 	   		  

[-- Attachment #1.2: Type: text/html, Size: 6086 bytes --]

[-- Attachment #2: Type: text/plain, Size: 138 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

^ permalink raw reply	[flat|nested] 12+ messages in thread

* RE: 2Gb Memory lost in 2.6.32.36
  2011-05-19 14:44         ` 2Gb Memory lost in 2.6.32.36 Konrad Rzeszutek Wilk
@ 2011-05-19 15:32           ` MaoXiaoyun
  0 siblings, 0 replies; 12+ messages in thread
From: MaoXiaoyun @ 2011-05-19 15:32 UTC (permalink / raw)
  To: konrad.wilk; +Cc: jeremy, xen devel


[-- Attachment #1.1: Type: text/plain, Size: 911 bytes --]



 

> Date: Thu, 19 May 2011 10:44:57 -0400
> From: konrad.wilk@oracle.com
> To: tinnycloud@hotmail.com
> CC: xen-devel@lists.xensource.com; jeremy@goop.org
> Subject: Re: 2Gb Memory lost in 2.6.32.36
> 
> On Thu, May 19, 2011 at 09:17:11PM +0800, MaoXiaoyun wrote:
> > 
> > Hi:
> > 
> > I was able to do some debug. And I'd like to sum this issue again. It looks like has relation with xen_memory_setup(). arch/x86/xen/setup.c 
> > 
> > 1) first in grub config, give dom0 5630M memory
> > kernel /xen-4.0.1.gz msi=1 iommu=off x2apic=off console=com1,vga com1=115200,8n1 noreboot dom0_mem=5630M dom0_max_vcpus=4 dom0_vcpus_pin cpuidle= 0 cpufreq=none no-xsave
> 
> Hm, no-xsave? I think you mean xsave=0
> 
> Also the cpuidle looks wrong. It should be cpuidle=0 (no space).
> Lastly, why 'msi=1'? It is turned on by defualt.
 
Thanks for correction. I'll apply the change.
 		 	   		  

[-- Attachment #1.2: Type: text/html, Size: 1254 bytes --]

[-- Attachment #2: Type: text/plain, Size: 138 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: RE:2Gb Memory lost in 2.6.32.36 - 50G memory, maxmem=50G, 2G used for pagetable, clamping (max:5G) is not helping.
  2011-05-19 15:31           ` MaoXiaoyun
@ 2011-05-19 16:16             ` Konrad Rzeszutek Wilk
  2011-05-25  9:08               ` MaoXiaoyun
  0 siblings, 1 reply; 12+ messages in thread
From: Konrad Rzeszutek Wilk @ 2011-05-19 16:16 UTC (permalink / raw)
  To: MaoXiaoyun; +Cc: jeremy, xen devel

> > What happens if you provide dom0_mem=max:5G to clamp on the size?
> > 
>  
> Seems nothing different(what is clamp means? ^_^ )

http://en.wikipedia.org/wiki/Clamp_(tool)

.. snip..
>  Xen: 0000000100000000 - 0000000c6ff09000 (usable)
> DMI present.
> AMI BIOS detected: BIOS may corrupt low RAM, working around it.
> last_pfn = 0xc6ff09 max_arch_pfn = 0x400000000
.. snip..
> xen_commandline        : msi=1 iommu=off x2apic=off console=com1,vga com1=115200,8n1 noreboot dom0_mem=max:5G dom0_max_vcpus=4 dom0_vcpus_pin cpuidle=0 cpufreq=none xsave=0

OK, I would have expected your last entry in the E820 to be truncated
to 15fe00000, but it is not with the max:5G parameter. Looks like
you found a bug - but I am not sure if it is the Xen hypervisor or
the E820 parsing code in Linux. Fortunatly for you, I just got my hands on 32G
machine so I can work on this. Can you remind me in a week if I you do
not see any patches from me?

^ permalink raw reply	[flat|nested] 12+ messages in thread

* RE: RE:2Gb Memory lost in 2.6.32.36 - 50G memory, maxmem=50G, 2G used for pagetable, clamping (max:5G) is not helping.
  2011-05-19 16:16             ` RE:2Gb Memory lost in 2.6.32.36 - 50G memory, maxmem=50G, 2G used for pagetable, clamping (max:5G) is not helping Konrad Rzeszutek Wilk
@ 2011-05-25  9:08               ` MaoXiaoyun
  2011-05-31  8:33                 ` MaoXiaoyun
  0 siblings, 1 reply; 12+ messages in thread
From: MaoXiaoyun @ 2011-05-25  9:08 UTC (permalink / raw)
  To: konrad.wilk; +Cc: jeremy, xen devel


[-- Attachment #1.1: Type: text/plain, Size: 4131 bytes --]


Hi Konrad:
 
     I think I've located where the lost memory going. It is in bootmem when called sparse_init(); 
 
    I enabled bootmem_debug=1 in kernel start args, and log every __reserve and __free memory with 'count' taged.
 
    Like ___free & __reserve code(end of mail) :
 
    Attached is the output log. 
    
1) We give dom0 5630M, that is 5630 * 1024 /4 = 1441280 pages
 
2) Line 204-237 is the stage of early reservations. 
Add up memory in *early reservations* except adderss beyond 15ffe0(line 228) : 
     6329(line 225) + 23 + 1508 + 23470 = 31330 pages ( 123M)
 
3) I will caculated the mem reserved after line 237.
 
In line 237 , tot_res_pages is 11631467 and line 1162, its values is  11881636, so 11881636 - 11631467 = 250169 pages are reserved.
In line 203, tot_free_pages is 12776995 and line 1158, its values is 12810787, so 12810787 - 12776995  = 33792 pages are freed
So 250169  - 33792 = 216377 pages (216377 *4 / 1024 =  845M) are still in bootmem, I've been located it is in sparse_init.
 
4) Line 162, 196361 ( 768M )  pages of unused memory are been relesed to Xen.
 
5) Line 1169 ,  Memory is 3717504k =  3630M ,  3630 + 768 + 845 + 123 = 5366.        5630 - 5366 = 264 M (Did I miscaulated? )
   
Questions
 
1) Normally, sparse_init will only reserver about 173M in previous kernel, and in .36 is it meant to reserve so much?
2) where is 264M memory I last caculated, did I make mistake?
 
Many thanks. 
 
 
 
 
 
 
 
 
============================code to log========mm/bootmem.c====
 
253 static void __init __free(bootmem_data_t *bdata,
254 <+++<+++<+++unsigned long sidx, unsigned long eidx)
255 {
256 <+++unsigned long idx;
257     static int count;
258     static int tot_free_pages;
259 
260     tot_free_pages += (eidx - sidx);
261 
262 <+++bdebug("count %d nid=%td start=%lx end=%lx pages %d tot_free_pages %d\n", ++count, bdata - bootmem_node_data,
263 <+++<+++sidx + bdata->node_min_pfn,
264 <+++<+++eidx + bdata->node_min_pfn,
265         eidx - sidx,
266         tot_free_pages
267         );
268 
 
277 static int __init __reserve(bootmem_data_t *bdata, unsigned long sidx,
278  unsigned long eidx, int flags)
279 {
280     unsigned long idx;
281     int exclusive = flags & BOOTMEM_EXCLUSIVE;
282     static int count;
283     static int tot_res_pages;
284 
285     tot_res_pages += (eidx - sidx);
286 <+++bdebug("count %d nid=%td start=%lx end=%lx flags=%x pages=%d, tot_res_pages %d\n",                                                                   
287         ++count,
288 <+++<+++bdata - bootmem_node_data,
289 <+++<+++sidx + bdata->node_min_pfn,
290 <+++<+++eidx + bdata->node_min_pfn,
291 <+++<+++flags,
292         eidx - sidx,
293         tot_res_pages
294         );
     
 

 
> Date: Thu, 19 May 2011 12:16:56 -0400
> From: konrad.wilk@oracle.com
> To: tinnycloud@hotmail.com
> CC: xen-devel@lists.xensource.com; jeremy@goop.org
> Subject: Re: [Xen-devel] RE:2Gb Memory lost in 2.6.32.36 - 50G memory, maxmem=50G, 2G used for pagetable, clamping (max:5G) is not helping.
> 
> > > What happens if you provide dom0_mem=max:5G to clamp on the size?
> > > 
> > 
> > Seems nothing different(what is clamp means? ^_^ )
> 
> http://en.wikipedia.org/wiki/Clamp_(tool)
> 
> .. snip..
> > Xen: 0000000100000000 - 0000000c6ff09000 (usable)
> > DMI present.
> > AMI BIOS detected: BIOS may corrupt low RAM, working around it.
> > last_pfn = 0xc6ff09 max_arch_pfn = 0x400000000
> .. snip..
> > xen_commandline : msi=1 iommu=off x2apic=off console=com1,vga com1=115200,8n1 noreboot dom0_mem=max:5G dom0_max_vcpus=4 dom0_vcpus_pin cpuidle=0 cpufreq=none xsave=0
> 
> OK, I would have expected your last entry in the E820 to be truncated
> to 15fe00000, but it is not with the max:5G parameter. Looks like
> you found a bug - but I am not sure if it is the Xen hypervisor or
> the E820 parsing code in Linux. Fortunatly for you, I just got my hands on 32G
> machine so I can work on this. Can you remind me in a week if I you do
> not see any patches from me?
 		 	   		  

[-- Attachment #1.2: Type: text/html, Size: 6036 bytes --]

[-- Attachment #2: 2.6.32.36.txt --]
[-- Type: text/plain, Size: 129695 bytes --]

root (hd0,0)                                                                    
 Filesystem type is ext2fs, partition type 0x83                                 
kernel /xen-4.0.1.gz msi=1 iommu=off x2apic=off console=com1,vga com1=115200,8n1 noreboot dom0                                                                  
 \ \/ /___ _ __   | || |  / _ \ / |                                        *    
  \  // _ \ '_ \  | || |_| | | || |                                        *    
  /  \  __/ | | | |__   _| |_| || |                                        *    
 /_/\_\___|_| |_|    |_|(_)___(_)_|                                        *    
                                                                           *    
(XEN) Xen version 4.0.1 (root@xmao.com) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-46)) Thu Apr  7 17:17:06 CST 2011           
(XEN) Bootloader: GNU GRUB 0.97********************************************* 
(XEN) Command line: msi=1 iommu=off x2apic=off console=com1,vga com1=115200,8n1 
noreboot dom0_mem=5630M dom0_max_vcpus=4 dom0_vcpus_pin cpuidle=0 =0 cpufreq=none no-xsaveands before booting, 'a' to modify the kernel arguments 
(XEN) Video information: 'c' for a command-line.                                
(XEN)  VGA is text mode 80x25, font 8x16                                        
(XEN)  VBE/DDC methods: none; EDID transfer time: 0 secondsseconds.             
(XEN)  EDID info not retrieved because no DDC retrieval method detected         
(XEN) Disc information:                                                        
(XEN)  Found 12 MBR signatures
(XEN)  Found 6 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 000000000009a400 (usable)
(XEN)  000000000009a400 - 00000000000a0000 (reserved)
(XEN)  00000000000e4b60 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 00000000bf790000 (usable)
(XEN)  00000000bf790000 - 00000000bf79e000 (ACPI data)
(XEN)  00000000bf79e000 - 00000000bf7d0000 (ACPI NVS)
(XEN)  00000000bf7d0000 - 00000000bf7e0000 (reserved)
(XEN)  00000000bf7ec000 - 00000000c0000000 (reserved)
(XEN)  00000000e0000000 - 00000000f0000000 (reserved)
(XEN)  00000000fee00000 - 00000000fee01000 (reserved)
(XEN)  00000000fff00000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 0000000c40000000 (usable)
(XEN) ACPI: RSDP 000FA000, 0024 (r2 ACPIAM)
(XEN) ACPI: XSDT BF790100, 005C (r1 080510 XSDT1021 20100805 MSFT       97)
(XEN) ACPI: FACP BF790290, 00F4 (r4 080510 FACP1021 20100805 MSFT       97)
(XEN) ACPI: DSDT BF7904F0, 4E48 (r2  CTSAV CTSAV031       31 INTL 20051117)
(XEN) ACPI: FACS BF79E000, 0040
(XEN) ACPI: APIC BF790390, 0118 (r2 080510 APIC1021 20100805 MSFT       97)
(XEN) ACPI: MCFG BF7904B0, 003C (r1 080510 OEMMCFG  20100805 MSFT       97)
(XEN) ACPI: OEMB BF79E040, 0082 (r1 080510 OEMB1021 20100805 MSFT       97)
(XEN) ACPI: SRAT BF79A4F0, 01D0 (r2 080510 OEMSRAT         1 INTL        1)
(XEN) ACPI: HPET BF79A6C0, 0038 (r1 080510 OEMHPET  20100805 MSFT       97)
(XEN) ACPI: SSDT BF7A1A10, 0363 (r1 DpgPmm    CpuPm       12 INTL 20051117)
(XEN) System RAM: 49143MB (50322600kB)
(XEN) Domain heap initialised DMA width 32 bits
(XEN) Processor #32 6:12 APIC version 21
(XEN) Processor #34 6:12 APIC version 21
(XEN) Processor #50 6:12 APIC version 21
(XEN) Processor #52 6:12 APIC version 21
(XEN) Processor #0 6:12 APIC version 21
(XEN) Processor #2 6:12 APIC version 21
(XEN) Processor #18 6:12 APIC version 21
(XEN) Processor #20 6:12 APIC version 21
(XEN) Processor #33 6:12 APIC version 21
(XEN) Processor #35 6:12 APIC version 21
(XEN) Processor #51 6:12 APIC version 21
(XEN) Processor #53 6:12 APIC version 21
(XEN) Processor #1 6:12 APIC version 21
(XEN) Processor #3 6:12 APIC version 21
(XEN) Processor #19 6:12 APIC version 21
(XEN) Processor #21 6:12 APIC version 21
(XEN) IOAPIC[0]: apic_id 6, version 32, address 0xfec00000, GSI 0-23
(XEN) IOAPIC[1]: apic_id 7, version 32, address 0xfec8a000, GSI 24-47
(XEN) Enabling APIC mode:  Phys.  Using 2 I/O APICs
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 2400.151 MHz processor.
(XEN) Initing memory sharing.
(XEN) VMX: Supported advanced features:
(XEN)  - APIC MMIO access virtualisation
(XEN)  - APIC TPR shadow
(XEN)  - Extended Page Tables (EPT)
(XEN)  - Virtual-Processor Identifiers (VPID)
(XEN)  - Virtual NMI
(XEN)  - MSR direct-access bitmap
(XEN)  - Unrestricted Guest
(XEN) EPT supports 2MB super page.
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging detected.
(XEN) I/O virtualisation disabled
(XEN) Enabled directed EOI with ioapic_ack_old on!
(XEN) Total of 16 processors activated.
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using old ACK method
(XEN) TSC is reliable, synchronization unnecessary
(XEN) Platform timer is 14.318MHz HPET
???(XEN) Allocated console ring of 32 KiB.
(XEN) Brought up 16 CPUs
(XEN) *** LOADING DOMAIN 0 ***
(XEN)  Xen  kernel: 64-bit, lsb, compat32
(XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x19b7000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   0000000c1c000000->0000000c20000000 (1424896 pages to be allocated)
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: ffffffff81000000->ffffffff819b7000
(XEN)  Init. ramdisk: ffffffff819b7000->ffffffff81ec6e00
(XEN)  Phys-Mach map: ffffffff81ec7000->ffffffff829c6000
(XEN)  Start info:    ffffffff829c6000->ffffffff829c64b4
(XEN)  Page tables:   ffffffff829c7000->ffffffff829e0000
(XEN)  Boot stack:    ffffffff829e0000->ffffffff829e1000
(XEN)  TOTAL:         ffffffff80000000->ffffffff82c00000
(XEN)  ENTRY ADDRESS: ffffffff8172c200
(XEN) Dom0 has maximum 4 VCPUs
(XEN) Scrubbing Free RAM: ......................................................
................................................................................
................................................................................
................................................................................
................................................................................
.......................................................done.
(XEN) Xen trace buffers: disabled
(XEN) Std. Loglevel: Errors and warnings
(XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
(XEN) Freed 168kB init memory
mapping kernel into physical memory
Xen: setup ISA identity maps
about to get started...
Initializing cgroup subsys cpuset
Initializing cgroup subsys cpu
Linux version 2.6.32.36xen (root@xmao.com) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-46)) #1 SMP Wed May 25 00:32:21 CST 2011
Command line: ro root=LABEL=/ hda=noprobe console=hvc0 bootmem_debug=1
KERNEL supported cpus:
  Intel GenuineIntel
  AMD AuthenticAMD
  Centaur CentaurHauls
xen_extra_memstart 15fe00000
start addr 0 size 9a000 end 9a000 type 1, xen_extra_mem_start 15fe00000
end addr 0 size 9a000 end 9a000 type 1, xen_extra_mem_start 15fe00000
start addr 9a400 size 5c00 end a0000 type 2, xen_extra_mem_start 15fe00000
end addr 9a400 size 5c00 end a0000 type 2, xen_extra_mem_start 15fe00000
start addr e4b60 size 1b4a0 end 100000 type 2, xen_extra_mem_start 15fe00000
end addr e4b60 size 1b4a0 end 100000 type 2, xen_extra_mem_start 15fe00000
start addr 100000 size bf690000 end bf790000 type 1, xen_extra_mem_start 15fe00000
end addr 100000 size bf690000 end bf790000 type 1, xen_extra_mem_start 15fe00000
start addr bf790000 size e000 end bf79e000 type 3, xen_extra_mem_start 15fe00000
end addr bf790000 size e000 end bf79e000 type 3, xen_extra_mem_start 15fe00000
start addr bf79e000 size 32000 end bf7d0000 type 4, xen_extra_mem_start 15fe00000
end addr bf79e000 size 32000 end bf7d0000 type 4, xen_extra_mem_start 15fe00000
start addr bf7d0000 size 10000 end bf7e0000 type 2, xen_extra_mem_start 15fe00000
end addr bf7d0000 size 10000 end bf7e0000 type 2, xen_extra_mem_start 15fe00000
start addr bf7ec000 size 814000 end c0000000 type 2, xen_extra_mem_start 15fe00000
end addr bf7ec000 size 814000 end c0000000 type 2, xen_extra_mem_start 15fe00000
start addr e0000000 size 10000000 end f0000000 type 2, xen_extra_mem_start 15fe00000
end addr e0000000 size 10000000 end f0000000 type 2, xen_extra_mem_start 15fe00000
start addr fec00000 size 1000 end fec01000 type 2, xen_extra_mem_start 15fe00000
end addr fec00000 size 1000 end fec01000 type 2, xen_extra_mem_start 15fe00000
start addr fec8a000 size 1000 end fec8b000 type 2, xen_extra_mem_start 15fe00000
end addr fec8a000 size 1000 end fec8b000 type 2, xen_extra_mem_start 15fe00000
start addr fee00000 size 1000 end fee01000 type 2, xen_extra_mem_start 15fe00000
end addr fee00000 size 1000 end fee01000 type 2, xen_extra_mem_start 15fe00000
start addr fff00000 size 100000 end 100000000 type 2, xen_extra_mem_start 15fe00000
end addr fff00000 size 100000 end 100000000 type 2, xen_extra_mem_start 15fe00000
start addr 100000000 size b40000000 end c40000000 type 1, xen_extra_mem_start 15fe00000
end addr 100000000 size 5fe00000 end 15fe00000 type 1, xen_extra_mem_start 15fe00000
xen_release_chunk: looking at area pfn bf7e0-bf7ec: 12 pages freed
xen_release_chunk: looking at area pfn c0000-e0000: 131072 pages freed
xen_release_chunk: looking at area pfn f0000-fec00: 60416 pages freed
xen_release_chunk: looking at area pfn fec01-fec8a: 137 pages freed
xen_release_chunk: looking at area pfn fec8b-fee00: 373 pages freed
xen_release_chunk: looking at area pfn fee01-fff00: 4351 pages freed
released 196361 pages of unused memory
start extra_pages b10109
extra_pages b10109
BIOS-provided physical RAM map:
 Xen: 0000000000000000 - 000000000009a000 (usable)
 Xen: 000000000009a400 - 0000000000100000 (reserved)
 Xen: 0000000000100000 - 00000000bf790000 (usable)
 Xen: 00000000bf790000 - 00000000bf79e000 (ACPI data)
 Xen: 00000000bf79e000 - 00000000bf7d0000 (ACPI NVS)
 Xen: 00000000bf7d0000 - 00000000bf7e0000 (reserved)
 Xen: 00000000bf7ec000 - 00000000c0000000 (reserved)
 Xen: 00000000e0000000 - 00000000f0000000 (reserved)
 Xen: 00000000fec00000 - 00000000fec01000 (reserved)
 Xen: 00000000fec8a000 - 00000000fec8b000 (reserved)
 Xen: 00000000fee00000 - 00000000fee01000 (reserved)
 Xen: 00000000fff00000 - 0000000100000000 (reserved)
 Xen: 0000000100000000 - 0000000c6ff09000 (usable)
DMI present.
AMI BIOS detected: BIOS may corrupt low RAM, working around it.
last_pfn = 0xc6ff09 max_arch_pfn = 0x400000000
last_pfn = 0xbf790 max_arch_pfn = 0x400000000
init_memory_mapping: 0000000000000000-00000000bf790000
init_memory_mapping: 0000000100000000-0000000c6ff09000
RAMDISK: 019b7000 - 01ec6e00
ACPI: RSDP 00000000000fa000 00024 (v02 ACPIAM)
ACPI: XSDT 00000000bf790100 0005C (v01 080510 XSDT1021 20100805 MSFT 00000097)
ACPI: FACP 00000000bf790290 000F4 (v04 080510 FACP1021 20100805 MSFT 00000097)
ACPI: DSDT 00000000bf7904f0 04E48 (v02  CTSAV CTSAV031 00000031 INTL 20051117)
ACPI: FACS 00000000bf79e000 00040
ACPI: APIC 00000000bf790390 00118 (v02 080510 APIC1021 20100805 MSFT 00000097)
ACPI: MCFG 00000000bf7904b0 0003C (v01 080510 OEMMCFG  20100805 MSFT 00000097)
ACPI: OEMB 00000000bf79e040 00082 (v01 080510 OEMB1021 20100805 MSFT 00000097)
ACPI: SRAT 00000000bf79a4f0 001D0 (v02 080510 OEMSRAT  00000001 INTL 00000001)
ACPI: HPET 00000000bf79a6c0 00038 (v01 080510 OEMHPET  20100805 MSFT 00000097)
ACPI: SSDT 00000000bf7a1a10 00363 (v01 DpgPmm    CpuPm 00000012 INTL 20051117)
bootmem::init_bootmem_core nid=0 start=0 map=6e4 end=c6ff09 mapsize=18dfe8
bootmem::mark_bootmem_node nid=0 start=10 end=9a reserve=0 flags=0
bootmem::__free count 1 nid=0 start=10 end=9a pages 138 tot_free_pages 138
bootmem::mark_bootmem_node nid=0 start=100 end=bf790 reserve=0 flags=0
bootmem::__free count 2 nid=0 start=100 end=bf790 pages 784016 tot_free_pages 784154
bootmem::mark_bootmem_node nid=0 start=100000 end=c6ff09 reserve=0 flags=0
bootmem::__free count 3 nid=0 start=100000 end=c6ff09 pages 11992841 tot_free_pages 12776995
(10 early reservations) ==> bootmem [0000000000 - 0c6ff09000]
#0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
bootmem::mark_bootmem_node nid=0 start=0 end=1 reserve=1 flags=0
bootmem::__reserve count 1 nid=0 start=0 end=1 flags=0 pages=1, tot_res_pages 1
bootmem::__reserve silent double reserve of PFN 0
#1 [00029c7000 - 00029e0000]   XEN PAGETABLES ==> [00029c7000 - 00029e0000]
bootmem::mark_bootmem_node nid=0 start=29c7 end=29e0 reserve=1 flags=0
bootmem::__reserve count 2 nid=0 start=29c7 end=29e0 flags=0 pages=25, tot_res_pages 26
#2 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
bootmem::mark_bootmem_node nid=0 start=6 end=8 reserve=1 flags=0
bootmem::__reserve count 3 nid=0 start=6 end=8 flags=0 pages=2, tot_res_pages 28
bootmem::__reserve silent double reserve of PFN 6
bootmem::__reserve silent double reserve of PFN 7
#3 [0001000000 - 000188c3b8]    TEXT DATA BSS ==> [0001000000 - 000188c3b8]
bootmem::mark_bootmem_node nid=0 start=1000 end=188d reserve=1 flags=0
bootmem::__reserve count 4 nid=0 start=1000 end=188d flags=0 pages=2189, tot_res_pages 2217
#4 [00019b7000 - 0001ec6e00]          RAMDISK ==> [00019b7000 - 0001ec6e00]
bootmem::mark_bootmem_node nid=0 start=19b7 end=1ec7 reserve=1 flags=0
bootmem::__reserve count 5 nid=0 start=19b7 end=1ec7 flags=0 pages=1296, tot_res_pages 3513  
#5 [0001ec7000 - 00029c7000]   XEN START INFO ==> [0001ec7000 - 00029c7000]
bootmem::mark_bootmem_node nid=0 start=1ec7 end=29c7 reserve=1 flags=0
bootmem::__reserve count 6 nid=0 start=1ec7 end=29c7 flags=0 pages=2816, tot_res_pages 6329
#6 [015fe00000 - 0c6ff09000]        XEN EXTRA ==> [015fe00000 - 0c6ff09000]
bootmem::mark_bootmem_node nid=0 start=15fe00 end=c6ff09 reserve=1 flags=0
bootmem::__reserve count 7 nid=0 start=15fe00 end=c6ff09 flags=0 pages=11600137, tot_res_pages 11606466
#7 [000188d000 - 00018a31c0]              BRK ==> [000188d000 - 00018a31c0]
bootmem::mark_bootmem_node nid=0 start=188d end=18a4 reserve=1 flags=0
bootmem::__reserve count 8 nid=0 start=188d end=18a4 flags=0 pages=23, tot_res_pages 11606489
#8 [0000100000 - 00006e4000]          PGTABLE ==> [0000100000 - 00006e4000]
bootmem::mark_bootmem_node nid=0 start=100 end=6e4 reserve=1 flags=0
bootmem::__reserve count 9 nid=0 start=100 end=6e4 flags=0 pages=1508, tot_res_pages 11607997
#9 [00029e0000 - 000858e000]          PGTABLE ==> [00029e0000 - 000858e000]
bootmem::mark_bootmem_node nid=0 start=29e0 end=858e reserve=1 flags=0
bootmem::__reserve count 10 nid=0 start=29e0 end=858e flags=0 pages=23470, tot_res_pages 11631467
bootmem::mark_bootmem_node nid=0 start=6e4 end=872 reserve=1 flags=0
bootmem::__reserve count 11 nid=0 start=6e4 end=872 flags=0 pages=398, tot_res_pages 11631865
bootmem::__reserve count 12 nid=0 start=10 end=14 flags=1 pages=4, tot_res_pages 11631869
bootmem::__reserve count 13 nid=0 start=20000 end=28000 flags=1 pages=32768, tot_res_pages 11664637
bootmem::__reserve count 14 nid=0 start=28000 end=28001 flags=1 pages=1, tot_res_pages 11664638
bootmem::__reserve count 15 nid=0 start=28001 end=28002 flags=1 pages=1, tot_res_pages 11664639
bootmem::__reserve count 16 nid=0 start=28002 end=28003 flags=1 pages=1, tot_res_pages 11664640
bootmem::__reserve count 17 nid=0 start=28003 end=28004 flags=1 pages=1, tot_res_pages 11664641
bootmem::__reserve count 18 nid=0 start=28004 end=28404 flags=1 pages=1024, tot_res_pages 11665665
May 25 18:02:35 xmao kernel: bootmem::__reserve count 19 nid=0 start=28404 end=28405 flags=1 pages=1, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 20 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 21 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 22 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 23 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 24 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 25 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 26 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 27 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 28 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 29 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 30 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 31 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 32 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 33 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 34 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 35 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 36 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 37 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 38 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 39 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 40 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 41 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 42 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 43 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 44 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 45 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 46 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 47 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 48 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 49 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 50 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 51 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 52 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 53 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 54 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 55 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 56 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 57 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 58 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 59 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 60 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 61 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 62 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 63 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 64 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 65 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 66 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 67 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 68 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 69 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 70 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 71 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 72 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 73 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 74 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 75 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 76 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 77 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 78 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 79 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 80 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 81 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 82 nid=0 start=28405 end=28405 flags=1 pages=0, tot_res_pages 11665666
May 25 18:02:35 xmao kernel: bootmem::__reserve count 83 nid=0 start=28405 end=28406 flags=1 pages=1, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 84 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 85 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 86 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 87 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 88 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 89 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 90 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 91 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 92 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 93 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 94 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 95 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 96 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 97 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 98 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 99 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 100 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 101 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 102 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 103 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 104 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 105 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 106 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 107 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 108 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 109 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 110 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 111 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 112 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 113 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 114 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 115 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 116 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 117 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 118 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 119 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 120 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 121 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 122 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 123 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 124 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 125 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 126 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 127 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 128 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 129 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 130 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 131 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 132 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 133 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 134 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 135 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 136 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 137 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 138 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 139 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 140 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 141 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 142 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 143 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 144 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 145 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 146 nid=0 start=28406 end=28406 flags=1 pages=0, tot_res_pages 11665667
May 25 18:02:35 xmao kernel: bootmem::__reserve count 147 nid=0 start=28406 end=28407 flags=1 pages=1, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 148 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 149 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 150 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 151 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 152 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 153 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 154 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 155 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 156 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 157 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 158 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 159 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 160 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 161 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 162 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 163 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 164 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 165 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 166 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 167 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 168 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 169 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 170 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 171 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 172 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 173 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 174 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 175 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 176 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 177 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 178 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 179 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 180 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 181 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 182 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 183 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 184 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 185 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 186 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 187 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 188 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 189 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 190 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 191 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 192 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 193 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 194 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 195 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 196 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 197 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 198 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 199 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 200 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 201 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 202 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 203 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 204 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 205 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 206 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 207 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 208 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 209 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 210 nid=0 start=28407 end=28407 flags=1 pages=0, tot_res_pages 11665668
May 25 18:02:35 xmao kernel: bootmem::__reserve count 211 nid=0 start=28407 end=28408 flags=1 pages=1, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 212 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 213 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 214 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 215 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 216 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 217 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 218 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 219 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 220 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 221 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 222 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 223 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 224 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 225 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 226 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 227 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 228 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 229 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 230 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 231 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 232 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 233 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 234 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 235 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 236 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 237 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 238 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 239 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 240 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 241 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 242 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 243 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 244 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 245 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 246 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 247 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 248 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 249 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 250 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 251 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 252 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 253 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 254 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 255 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 256 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 257 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 258 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 259 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 260 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 261 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 262 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 263 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 264 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 265 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 266 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 267 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 268 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 269 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 270 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 271 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 272 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 273 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 274 nid=0 start=28408 end=28408 flags=1 pages=0, tot_res_pages 11665669
May 25 18:02:35 xmao kernel: bootmem::__reserve count 275 nid=0 start=28408 end=28409 flags=1 pages=1, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 276 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 277 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 278 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 279 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 280 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 281 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 282 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 283 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 284 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 285 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 286 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 287 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 288 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 289 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 290 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 291 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 292 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 293 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 294 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 295 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 296 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 297 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 298 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 299 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 300 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 301 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 302 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 303 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 304 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 305 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 306 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 307 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 308 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 309 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 310 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 311 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 312 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 313 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 314 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 315 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 316 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 317 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 318 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 319 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 320 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 321 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 322 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 323 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 324 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 325 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 326 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 327 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 328 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 329 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 330 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 331 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 332 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 333 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 334 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 335 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 336 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 337 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 338 nid=0 start=28409 end=28409 flags=1 pages=0, tot_res_pages 11665670
May 25 18:02:35 xmao kernel: bootmem::__reserve count 339 nid=0 start=28409 end=2840a flags=1 pages=1, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 340 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 341 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 342 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 343 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 344 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 345 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 346 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 347 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 348 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 349 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 350 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 351 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 352 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 353 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 354 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 355 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 356 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 357 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 358 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 359 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 360 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 361 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 362 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 363 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 364 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 365 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 366 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 367 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 368 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 369 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 370 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 371 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 372 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 373 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 374 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 375 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 376 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 377 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 378 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 379 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 380 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 381 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 382 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 383 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 384 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 385 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 386 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 387 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 388 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 389 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 390 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 391 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 392 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 393 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 394 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 395 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 396 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 397 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 398 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 399 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 400 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 401 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 402 nid=0 start=2840a end=2840a flags=1 pages=0, tot_res_pages 11665671
May 25 18:02:35 xmao kernel: bootmem::__reserve count 403 nid=0 start=2840a end=2840b flags=1 pages=1, tot_res_pages 11665672
May 25 18:02:35 xmao kernel: bootmem::__reserve count 404 nid=0 start=2840b end=2840b flags=1 pages=0, tot_res_pages 11665672
May 25 18:02:35 xmao kernel: bootmem::__reserve count 405 nid=0 start=2840b end=2840b flags=1 pages=0, tot_res_pages 11665672
May 25 18:02:35 xmao kernel: bootmem::__reserve count 406 nid=0 start=2840b end=2840b flags=1 pages=0, tot_res_pages 11665672
May 25 18:02:35 xmao kernel: bootmem::__reserve count 407 nid=0 start=2840b end=2840b flags=1 pages=0, tot_res_pages 11665672
May 25 18:02:35 xmao kernel: bootmem::__reserve count 408 nid=0 start=2840b end=2840b flags=1 pages=0, tot_res_pages 11665672
May 25 18:02:35 xmao kernel: bootmem::__reserve count 409 nid=0 start=2840b end=285cb flags=1 pages=448, tot_res_pages 11666120
May 25 18:02:35 xmao kernel: bootmem::__reserve count 410 nid=0 start=285cb end=2878b flags=1 pages=448, tot_res_pages 11666568
May 25 18:02:35 xmao kernel: bootmem::__reserve count 411 nid=0 start=2878b end=2894b flags=1 pages=448, tot_res_pages 11667016
May 25 18:02:35 xmao kernel: bootmem::__reserve count 412 nid=0 start=2894b end=28b0b flags=1 pages=448, tot_res_pages 11667464
May 25 18:02:35 xmao kernel: bootmem::__reserve count 413 nid=0 start=28b0b end=28ccb flags=1 pages=448, tot_res_pages 11667912
May 25 18:02:35 xmao kernel: bootmem::__reserve count 414 nid=0 start=28ccb end=28e8b flags=1 pages=448, tot_res_pages 11668360
May 25 18:02:35 xmao kernel: bootmem::__reserve count 415 nid=0 start=28e8b end=2904b flags=1 pages=448, tot_res_pages 11668808
May 25 18:02:35 xmao kernel: bootmem::__reserve count 416 nid=0 start=2904b end=2920b flags=1 pages=448, tot_res_pages 11669256
May 25 18:02:35 xmao kernel: bootmem::__reserve count 417 nid=0 start=2920b end=293cb flags=1 pages=448, tot_res_pages 11669704
May 25 18:02:35 xmao kernel: bootmem::__reserve count 418 nid=0 start=293cb end=2958b flags=1 pages=448, tot_res_pages 11670152
May 25 18:02:35 xmao kernel: bootmem::__reserve count 419 nid=0 start=2958b end=2974b flags=1 pages=448, tot_res_pages 11670600
May 25 18:02:35 xmao kernel: bootmem::__reserve count 420 nid=0 start=2974b end=2990b flags=1 pages=448, tot_res_pages 11671048
May 25 18:02:35 xmao kernel: bootmem::__reserve count 421 nid=0 start=2990b end=29acb flags=1 pages=448, tot_res_pages 11671496
May 25 18:02:35 xmao kernel: bootmem::__reserve count 422 nid=0 start=29acb end=29c8b flags=1 pages=448, tot_res_pages 11671944
May 25 18:02:35 xmao kernel: bootmem::__reserve count 423 nid=0 start=29c8b end=29e4b flags=1 pages=448, tot_res_pages 11672392
May 25 18:02:35 xmao kernel: bootmem::__reserve count 424 nid=0 start=29e4b end=2a00b flags=1 pages=448, tot_res_pages 11672840
May 25 18:02:35 xmao kernel: bootmem::__reserve count 425 nid=0 start=2a00b end=2a1cb flags=1 pages=448, tot_res_pages 11673288
May 25 18:02:35 xmao kernel: bootmem::__reserve count 426 nid=0 start=2a1cb end=2a38b flags=1 pages=448, tot_res_pages 11673736
May 25 18:02:35 xmao kernel: bootmem::__reserve count 427 nid=0 start=2a38b end=2a54b flags=1 pages=448, tot_res_pages 11674184
May 25 18:02:35 xmao kernel: bootmem::__reserve count 428 nid=0 start=2a54b end=2a70b flags=1 pages=448, tot_res_pages 11674632
May 25 18:02:35 xmao kernel: bootmem::__reserve count 429 nid=0 start=2a70b end=2a8cb flags=1 pages=448, tot_res_pages 11675080
May 25 18:02:35 xmao kernel: bootmem::__reserve count 430 nid=0 start=2a8cb end=2aa8b flags=1 pages=448, tot_res_pages 11675528
May 25 18:02:35 xmao kernel: bootmem::__reserve count 431 nid=0 start=2aa8b end=2ac4b flags=1 pages=448, tot_res_pages 11675976
May 25 18:02:35 xmao kernel: bootmem::__reserve count 432 nid=0 start=2ac4b end=2ae0b flags=1 pages=448, tot_res_pages 11676424
May 25 18:02:35 xmao kernel: bootmem::__reserve count 433 nid=0 start=2ae0b end=2afcb flags=1 pages=448, tot_res_pages 11676872
May 25 18:02:35 xmao kernel: bootmem::__reserve count 434 nid=0 start=2afcb end=2b18b flags=1 pages=448, tot_res_pages 11677320
May 25 18:02:35 xmao kernel: bootmem::__reserve count 435 nid=0 start=2b18b end=2b34b flags=1 pages=448, tot_res_pages 11677768
May 25 18:02:35 xmao kernel: bootmem::__reserve count 436 nid=0 start=2b34b end=2b50b flags=1 pages=448, tot_res_pages 11678216
May 25 18:02:35 xmao kernel: bootmem::__reserve count 437 nid=0 start=2b50b end=2b6cb flags=1 pages=448, tot_res_pages 11678664
May 25 18:02:35 xmao kernel: bootmem::__reserve count 438 nid=0 start=2b6cb end=2b88b flags=1 pages=448, tot_res_pages 11679112
May 25 18:02:35 xmao kernel: bootmem::__reserve count 439 nid=0 start=2b88b end=2ba4b flags=1 pages=448, tot_res_pages 11679560
May 25 18:02:35 xmao kernel: bootmem::__reserve count 440 nid=0 start=2ba4b end=2bc0b flags=1 pages=448, tot_res_pages 11680008
May 25 18:02:35 xmao kernel: bootmem::__reserve count 441 nid=0 start=2bc0b end=2bdcb flags=1 pages=448, tot_res_pages 11680456
May 25 18:02:35 xmao kernel: bootmem::__reserve count 442 nid=0 start=2bdcb end=2bf8b flags=1 pages=448, tot_res_pages 11680904
May 25 18:02:35 xmao kernel: bootmem::__reserve count 443 nid=0 start=2bf8b end=2c14b flags=1 pages=448, tot_res_pages 11681352
May 25 18:02:35 xmao kernel: bootmem::__reserve count 444 nid=0 start=2c14b end=2c30b flags=1 pages=448, tot_res_pages 11681800
May 25 18:02:35 xmao kernel: bootmem::__reserve count 445 nid=0 start=2c30b end=2c4cb flags=1 pages=448, tot_res_pages 11682248
May 25 18:02:35 xmao kernel: bootmem::__reserve count 446 nid=0 start=2c4cb end=2c68b flags=1 pages=448, tot_res_pages 11682696
May 25 18:02:35 xmao kernel: bootmem::__reserve count 447 nid=0 start=2c68b end=2c84b flags=1 pages=448, tot_res_pages 11683144
May 25 18:02:35 xmao kernel: bootmem::__reserve count 448 nid=0 start=2c84b end=2ca0b flags=1 pages=448, tot_res_pages 11683592
May 25 18:02:35 xmao kernel: bootmem::__reserve count 449 nid=0 start=2ca0b end=2cbcb flags=1 pages=448, tot_res_pages 11684040
May 25 18:02:35 xmao kernel: bootmem::__reserve count 450 nid=0 start=2cbcb end=2cd8b flags=1 pages=448, tot_res_pages 11684488
May 25 18:02:35 xmao kernel: bootmem::__reserve count 451 nid=0 start=2cd8b end=2cf4b flags=1 pages=448, tot_res_pages 11684936
May 25 18:02:35 xmao kernel: bootmem::__reserve count 452 nid=0 start=2cf4b end=2d10b flags=1 pages=448, tot_res_pages 11685384
May 25 18:02:35 xmao kernel: bootmem::__reserve count 453 nid=0 start=2d10b end=2d2cb flags=1 pages=448, tot_res_pages 11685832
May 25 18:02:35 xmao kernel: bootmem::__reserve count 454 nid=0 start=2d2cb end=2d48b flags=1 pages=448, tot_res_pages 11686280
May 25 18:02:35 xmao kernel: bootmem::__reserve count 455 nid=0 start=2d48b end=2d64b flags=1 pages=448, tot_res_pages 11686728
May 25 18:02:35 xmao kernel: bootmem::__reserve count 456 nid=0 start=2d64b end=2d80b flags=1 pages=448, tot_res_pages 11687176
May 25 18:02:35 xmao kernel: bootmem::__reserve count 457 nid=0 start=2d80b end=2d9cb flags=1 pages=448, tot_res_pages 11687624
May 25 18:02:35 xmao kernel: bootmem::__reserve count 458 nid=0 start=2d9cb end=2db8b flags=1 pages=448, tot_res_pages 11688072
May 25 18:02:35 xmao kernel: bootmem::__reserve count 459 nid=0 start=2db8b end=2dd4b flags=1 pages=448, tot_res_pages 11688520
May 25 18:02:35 xmao kernel: bootmem::__reserve count 460 nid=0 start=2dd4b end=2df0b flags=1 pages=448, tot_res_pages 11688968
May 25 18:02:35 xmao kernel: bootmem::__reserve count 461 nid=0 start=2df0b end=2e0cb flags=1 pages=448, tot_res_pages 11689416
May 25 18:02:35 xmao kernel: bootmem::__reserve count 462 nid=0 start=2e0cb end=2e28b flags=1 pages=448, tot_res_pages 11689864
May 25 18:02:35 xmao kernel: bootmem::__reserve count 463 nid=0 start=2e28b end=2e44b flags=1 pages=448, tot_res_pages 11690312
May 25 18:02:35 xmao kernel: bootmem::__reserve count 464 nid=0 start=2e44b end=2e60b flags=1 pages=448, tot_res_pages 11690760
May 25 18:02:35 xmao kernel: bootmem::__reserve count 465 nid=0 start=2e60b end=2e7cb flags=1 pages=448, tot_res_pages 11691208
May 25 18:02:35 xmao kernel: bootmem::__reserve count 466 nid=0 start=2e7cb end=2e98b flags=1 pages=448, tot_res_pages 11691656
May 25 18:02:35 xmao kernel: bootmem::__reserve count 467 nid=0 start=2e98b end=2eb4b flags=1 pages=448, tot_res_pages 11692104
May 25 18:02:35 xmao kernel: bootmem::__reserve count 468 nid=0 start=2eb4b end=2ed0b flags=1 pages=448, tot_res_pages 11692552
May 25 18:02:35 xmao kernel: bootmem::__reserve count 469 nid=0 start=2ed0b end=2eecb flags=1 pages=448, tot_res_pages 11693000
May 25 18:02:35 xmao kernel: bootmem::__reserve count 470 nid=0 start=2eecb end=2f08b flags=1 pages=448, tot_res_pages 11693448
May 25 18:02:35 xmao kernel: bootmem::__reserve count 471 nid=0 start=2f08b end=2f24b flags=1 pages=448, tot_res_pages 11693896
May 25 18:02:35 xmao kernel: bootmem::__reserve count 472 nid=0 start=2f24b end=2f40b flags=1 pages=448, tot_res_pages 11694344
May 25 18:02:35 xmao kernel: bootmem::__reserve count 473 nid=0 start=2f40b end=2f5cb flags=1 pages=448, tot_res_pages 11694792
May 25 18:02:35 xmao kernel: bootmem::__reserve count 474 nid=0 start=2f5cb end=2f78b flags=1 pages=448, tot_res_pages 11695240
May 25 18:02:35 xmao kernel: bootmem::__reserve count 475 nid=0 start=2f78b end=2f94b flags=1 pages=448, tot_res_pages 11695688
May 25 18:02:35 xmao kernel: bootmem::__reserve count 476 nid=0 start=2f94b end=2fb0b flags=1 pages=448, tot_res_pages 11696136
May 25 18:02:35 xmao kernel: bootmem::__reserve count 477 nid=0 start=2fb0b end=2fccb flags=1 pages=448, tot_res_pages 11696584
May 25 18:02:35 xmao kernel: bootmem::__reserve count 478 nid=0 start=2fccb end=2fe8b flags=1 pages=448, tot_res_pages 11697032
May 25 18:02:35 xmao kernel: bootmem::__reserve count 479 nid=0 start=2fe8b end=3004b flags=1 pages=448, tot_res_pages 11697480
May 25 18:02:35 xmao kernel: bootmem::__reserve count 480 nid=0 start=3004b end=3020b flags=1 pages=448, tot_res_pages 11697928
May 25 18:02:35 xmao kernel: bootmem::__reserve count 481 nid=0 start=3020b end=303cb flags=1 pages=448, tot_res_pages 11698376
May 25 18:02:35 xmao kernel: bootmem::__reserve count 482 nid=0 start=303cb end=3058b flags=1 pages=448, tot_res_pages 11698824
May 25 18:02:35 xmao kernel: bootmem::__reserve count 483 nid=0 start=3058b end=3074b flags=1 pages=448, tot_res_pages 11699272
May 25 18:02:35 xmao kernel: bootmem::__reserve count 484 nid=0 start=3074b end=3090b flags=1 pages=448, tot_res_pages 11699720
May 25 18:02:35 xmao kernel: bootmem::__reserve count 485 nid=0 start=3090b end=30acb flags=1 pages=448, tot_res_pages 11700168
May 25 18:02:35 xmao kernel: bootmem::__reserve count 486 nid=0 start=30acb end=30c8b flags=1 pages=448, tot_res_pages 11700616
May 25 18:02:35 xmao kernel: bootmem::__reserve count 487 nid=0 start=30c8b end=30e4b flags=1 pages=448, tot_res_pages 11701064
May 25 18:02:35 xmao kernel: bootmem::__reserve count 488 nid=0 start=30e4b end=3100b flags=1 pages=448, tot_res_pages 11701512
May 25 18:02:35 xmao kernel: bootmem::__reserve count 489 nid=0 start=3100b end=311cb flags=1 pages=448, tot_res_pages 11701960
May 25 18:02:35 xmao kernel: bootmem::__reserve count 490 nid=0 start=311cb end=3138b flags=1 pages=448, tot_res_pages 11702408
May 25 18:02:35 xmao kernel: bootmem::__reserve count 491 nid=0 start=3138b end=3154b flags=1 pages=448, tot_res_pages 11702856
May 25 18:02:35 xmao kernel: bootmem::__reserve count 492 nid=0 start=3154b end=3170b flags=1 pages=448, tot_res_pages 11703304
May 25 18:02:35 xmao kernel: bootmem::__reserve count 493 nid=0 start=3170b end=318cb flags=1 pages=448, tot_res_pages 11703752
May 25 18:02:35 xmao kernel: bootmem::__reserve count 494 nid=0 start=318cb end=31a8b flags=1 pages=448, tot_res_pages 11704200
May 25 18:02:35 xmao kernel: bootmem::__reserve count 495 nid=0 start=31a8b end=31c4b flags=1 pages=448, tot_res_pages 11704648
May 25 18:02:35 xmao kernel: bootmem::__reserve count 496 nid=0 start=31c4b end=31e0b flags=1 pages=448, tot_res_pages 11705096
May 25 18:02:35 xmao kernel: bootmem::__reserve count 497 nid=0 start=31e0b end=31fcb flags=1 pages=448, tot_res_pages 11705544
May 25 18:02:35 xmao kernel: bootmem::__reserve count 498 nid=0 start=31fcb end=3218b flags=1 pages=448, tot_res_pages 11705992
May 25 18:02:35 xmao kernel: bootmem::__reserve count 499 nid=0 start=3218b end=3234b flags=1 pages=448, tot_res_pages 11706440
May 25 18:02:35 xmao kernel: bootmem::__reserve count 500 nid=0 start=3234b end=3250b flags=1 pages=448, tot_res_pages 11706888
May 25 18:02:35 xmao kernel: bootmem::__reserve count 501 nid=0 start=3250b end=326cb flags=1 pages=448, tot_res_pages 11707336
May 25 18:02:35 xmao kernel: bootmem::__reserve count 502 nid=0 start=326cb end=3288b flags=1 pages=448, tot_res_pages 11707784
May 25 18:02:35 xmao kernel: bootmem::__reserve count 503 nid=0 start=3288b end=32a4b flags=1 pages=448, tot_res_pages 11708232
May 25 18:02:35 xmao kernel: bootmem::__reserve count 504 nid=0 start=32a4b end=32c0b flags=1 pages=448, tot_res_pages 11708680
May 25 18:02:35 xmao kernel: bootmem::__reserve count 505 nid=0 start=32c0b end=32dcb flags=1 pages=448, tot_res_pages 11709128
May 25 18:02:35 xmao kernel: bootmem::__reserve count 506 nid=0 start=32dcb end=32f8b flags=1 pages=448, tot_res_pages 11709576
May 25 18:02:35 xmao kernel: bootmem::__reserve count 507 nid=0 start=32f8b end=3314b flags=1 pages=448, tot_res_pages 11710024
May 25 18:02:35 xmao kernel: bootmem::__reserve count 508 nid=0 start=3314b end=3330b flags=1 pages=448, tot_res_pages 11710472
May 25 18:02:35 xmao kernel: bootmem::__reserve count 509 nid=0 start=3330b end=334cb flags=1 pages=448, tot_res_pages 11710920
May 25 18:02:35 xmao kernel: bootmem::__reserve count 510 nid=0 start=334cb end=3368b flags=1 pages=448, tot_res_pages 11711368
May 25 18:02:35 xmao kernel: bootmem::__reserve count 511 nid=0 start=3368b end=3384b flags=1 pages=448, tot_res_pages 11711816
May 25 18:02:35 xmao kernel: bootmem::__reserve count 512 nid=0 start=3384b end=33a0b flags=1 pages=448, tot_res_pages 11712264
May 25 18:02:35 xmao kernel: bootmem::__reserve count 513 nid=0 start=33a0b end=33bcb flags=1 pages=448, tot_res_pages 11712712
May 25 18:02:35 xmao kernel: bootmem::__reserve count 514 nid=0 start=33bcb end=33d8b flags=1 pages=448, tot_res_pages 11713160
May 25 18:02:35 xmao kernel: bootmem::__reserve count 515 nid=0 start=33d8b end=33f4b flags=1 pages=448, tot_res_pages 11713608
May 25 18:02:35 xmao kernel: bootmem::__reserve count 516 nid=0 start=33f4b end=3410b flags=1 pages=448, tot_res_pages 11714056
May 25 18:02:35 xmao kernel: bootmem::__reserve count 517 nid=0 start=3410b end=342cb flags=1 pages=448, tot_res_pages 11714504
May 25 18:02:35 xmao kernel: bootmem::__reserve count 518 nid=0 start=342cb end=3448b flags=1 pages=448, tot_res_pages 11714952
May 25 18:02:35 xmao kernel: bootmem::__reserve count 519 nid=0 start=3448b end=3464b flags=1 pages=448, tot_res_pages 11715400
May 25 18:02:35 xmao kernel: bootmem::__reserve count 520 nid=0 start=3464b end=3480b flags=1 pages=448, tot_res_pages 11715848
May 25 18:02:35 xmao kernel: bootmem::__reserve count 521 nid=0 start=3480b end=349cb flags=1 pages=448, tot_res_pages 11716296
May 25 18:02:35 xmao kernel: bootmem::__reserve count 522 nid=0 start=349cb end=34b8b flags=1 pages=448, tot_res_pages 11716744
May 25 18:02:35 xmao kernel: bootmem::__reserve count 523 nid=0 start=34b8b end=34d4b flags=1 pages=448, tot_res_pages 11717192
May 25 18:02:35 xmao kernel: bootmem::__reserve count 524 nid=0 start=34d4b end=34f0b flags=1 pages=448, tot_res_pages 11717640
May 25 18:02:35 xmao kernel: bootmem::__reserve count 525 nid=0 start=34f0b end=350cb flags=1 pages=448, tot_res_pages 11718088
May 25 18:02:35 xmao kernel: bootmem::__reserve count 526 nid=0 start=350cb end=3528b flags=1 pages=448, tot_res_pages 11718536
May 25 18:02:35 xmao kernel: bootmem::__reserve count 527 nid=0 start=3528b end=3544b flags=1 pages=448, tot_res_pages 11718984
May 25 18:02:35 xmao kernel: bootmem::__reserve count 528 nid=0 start=3544b end=3560b flags=1 pages=448, tot_res_pages 11719432
May 25 18:02:35 xmao kernel: bootmem::__reserve count 529 nid=0 start=3560b end=357cb flags=1 pages=448, tot_res_pages 11719880
May 25 18:02:35 xmao kernel: bootmem::__reserve count 530 nid=0 start=357cb end=3598b flags=1 pages=448, tot_res_pages 11720328
May 25 18:02:35 xmao kernel: bootmem::__reserve count 531 nid=0 start=3598b end=35b4b flags=1 pages=448, tot_res_pages 11720776
May 25 18:02:35 xmao kernel: bootmem::__reserve count 532 nid=0 start=35b4b end=35d0b flags=1 pages=448, tot_res_pages 11721224
May 25 18:02:35 xmao kernel: bootmem::__reserve count 533 nid=0 start=35d0b end=35ecb flags=1 pages=448, tot_res_pages 11721672
May 25 18:02:35 xmao kernel: bootmem::__reserve count 534 nid=0 start=35ecb end=3608b flags=1 pages=448, tot_res_pages 11722120
May 25 18:02:35 xmao kernel: bootmem::__reserve count 535 nid=0 start=3608b end=3624b flags=1 pages=448, tot_res_pages 11722568
May 25 18:02:35 xmao kernel: bootmem::__reserve count 536 nid=0 start=3624b end=3640b flags=1 pages=448, tot_res_pages 11723016
May 25 18:02:35 xmao kernel: bootmem::__reserve count 537 nid=0 start=3640b end=365cb flags=1 pages=448, tot_res_pages 11723464
May 25 18:02:35 xmao kernel: bootmem::__reserve count 538 nid=0 start=365cb end=3678b flags=1 pages=448, tot_res_pages 11723912
May 25 18:02:35 xmao kernel: bootmem::__reserve count 539 nid=0 start=3678b end=3694b flags=1 pages=448, tot_res_pages 11724360
May 25 18:02:35 xmao kernel: bootmem::__reserve count 540 nid=0 start=3694b end=36b0b flags=1 pages=448, tot_res_pages 11724808
May 25 18:02:35 xmao kernel: bootmem::__reserve count 541 nid=0 start=36b0b end=36ccb flags=1 pages=448, tot_res_pages 11725256
May 25 18:02:35 xmao kernel: bootmem::__reserve count 542 nid=0 start=36ccb end=36e8b flags=1 pages=448, tot_res_pages 11725704
May 25 18:02:35 xmao kernel: bootmem::__reserve count 543 nid=0 start=36e8b end=3704b flags=1 pages=448, tot_res_pages 11726152
May 25 18:02:35 xmao kernel: bootmem::__reserve count 544 nid=0 start=3704b end=3720b flags=1 pages=448, tot_res_pages 11726600
May 25 18:02:35 xmao kernel: bootmem::__reserve count 545 nid=0 start=3720b end=373cb flags=1 pages=448, tot_res_pages 11727048
May 25 18:02:35 xmao kernel: bootmem::__reserve count 546 nid=0 start=373cb end=3758b flags=1 pages=448, tot_res_pages 11727496
May 25 18:02:35 xmao kernel: bootmem::__reserve count 547 nid=0 start=3758b end=3774b flags=1 pages=448, tot_res_pages 11727944
May 25 18:02:35 xmao kernel: bootmem::__reserve count 548 nid=0 start=3774b end=3790b flags=1 pages=448, tot_res_pages 11728392
May 25 18:02:35 xmao kernel: bootmem::__reserve count 549 nid=0 start=3790b end=37acb flags=1 pages=448, tot_res_pages 11728840
May 25 18:02:35 xmao kernel: bootmem::__reserve count 550 nid=0 start=37acb end=37c8b flags=1 pages=448, tot_res_pages 11729288
May 25 18:02:35 xmao kernel: bootmem::__reserve count 551 nid=0 start=37c8b end=37e4b flags=1 pages=448, tot_res_pages 11729736
May 25 18:02:35 xmao kernel: bootmem::__reserve count 552 nid=0 start=37e4b end=3800b flags=1 pages=448, tot_res_pages 11730184
May 25 18:02:35 xmao kernel: bootmem::__reserve count 553 nid=0 start=3800b end=381cb flags=1 pages=448, tot_res_pages 11730632
May 25 18:02:35 xmao kernel: bootmem::__reserve count 554 nid=0 start=381cb end=3838b flags=1 pages=448, tot_res_pages 11731080
May 25 18:02:35 xmao kernel: bootmem::__reserve count 555 nid=0 start=3838b end=3854b flags=1 pages=448, tot_res_pages 11731528
May 25 18:02:35 xmao kernel: bootmem::__reserve count 556 nid=0 start=3854b end=3870b flags=1 pages=448, tot_res_pages 11731976
May 25 18:02:35 xmao kernel: bootmem::__reserve count 557 nid=0 start=3870b end=388cb flags=1 pages=448, tot_res_pages 11732424
May 25 18:02:35 xmao kernel: bootmem::__reserve count 558 nid=0 start=388cb end=38a8b flags=1 pages=448, tot_res_pages 11732872
May 25 18:02:35 xmao kernel: bootmem::__reserve count 559 nid=0 start=38a8b end=38c4b flags=1 pages=448, tot_res_pages 11733320
May 25 18:02:35 xmao kernel: bootmem::__reserve count 560 nid=0 start=38c4b end=38e0b flags=1 pages=448, tot_res_pages 11733768
May 25 18:02:35 xmao kernel: bootmem::__reserve count 561 nid=0 start=38e0b end=38fcb flags=1 pages=448, tot_res_pages 11734216
May 25 18:02:35 xmao kernel: bootmem::__reserve count 562 nid=0 start=38fcb end=3918b flags=1 pages=448, tot_res_pages 11734664
May 25 18:02:35 xmao kernel: bootmem::__reserve count 563 nid=0 start=3918b end=3934b flags=1 pages=448, tot_res_pages 11735112
May 25 18:02:35 xmao kernel: bootmem::__reserve count 564 nid=0 start=3934b end=3950b flags=1 pages=448, tot_res_pages 11735560
May 25 18:02:35 xmao kernel: bootmem::__reserve count 565 nid=0 start=3950b end=396cb flags=1 pages=448, tot_res_pages 11736008
May 25 18:02:35 xmao kernel: bootmem::__reserve count 566 nid=0 start=396cb end=3988b flags=1 pages=448, tot_res_pages 11736456
May 25 18:02:35 xmao kernel: bootmem::__reserve count 567 nid=0 start=3988b end=39a4b flags=1 pages=448, tot_res_pages 11736904
May 25 18:02:35 xmao kernel: bootmem::__reserve count 568 nid=0 start=39a4b end=39c0b flags=1 pages=448, tot_res_pages 11737352
May 25 18:02:35 xmao kernel: bootmem::__reserve count 569 nid=0 start=39c0b end=39dcb flags=1 pages=448, tot_res_pages 11737800
May 25 18:02:35 xmao kernel: bootmem::__reserve count 570 nid=0 start=39dcb end=39f8b flags=1 pages=448, tot_res_pages 11738248
May 25 18:02:35 xmao kernel: bootmem::__reserve count 571 nid=0 start=39f8b end=3a14b flags=1 pages=448, tot_res_pages 11738696
May 25 18:02:35 xmao kernel: bootmem::__reserve count 572 nid=0 start=3a14b end=3a30b flags=1 pages=448, tot_res_pages 11739144
May 25 18:02:35 xmao kernel: bootmem::__reserve count 573 nid=0 start=3a30b end=3a4cb flags=1 pages=448, tot_res_pages 11739592
May 25 18:02:35 xmao kernel: bootmem::__reserve count 574 nid=0 start=3a4cb end=3a68b flags=1 pages=448, tot_res_pages 11740040
May 25 18:02:35 xmao kernel: bootmem::__reserve count 575 nid=0 start=3a68b end=3a84b flags=1 pages=448, tot_res_pages 11740488
May 25 18:02:35 xmao kernel: bootmem::__reserve count 576 nid=0 start=3a84b end=3aa0b flags=1 pages=448, tot_res_pages 11740936
May 25 18:02:35 xmao kernel: bootmem::__reserve count 577 nid=0 start=3aa0b end=3abcb flags=1 pages=448, tot_res_pages 11741384
May 25 18:02:35 xmao kernel: bootmem::__reserve count 578 nid=0 start=3abcb end=3ad8b flags=1 pages=448, tot_res_pages 11741832
May 25 18:02:35 xmao kernel: bootmem::__reserve count 579 nid=0 start=3ad8b end=3af4b flags=1 pages=448, tot_res_pages 11742280
May 25 18:02:35 xmao kernel: bootmem::__reserve count 580 nid=0 start=3af4b end=3b10b flags=1 pages=448, tot_res_pages 11742728
May 25 18:02:35 xmao kernel: bootmem::__reserve count 581 nid=0 start=3b10b end=3b2cb flags=1 pages=448, tot_res_pages 11743176
May 25 18:02:35 xmao kernel: bootmem::__reserve count 582 nid=0 start=3b2cb end=3b48b flags=1 pages=448, tot_res_pages 11743624
May 25 18:02:35 xmao kernel: bootmem::__reserve count 583 nid=0 start=3b48b end=3b64b flags=1 pages=448, tot_res_pages 11744072
May 25 18:02:35 xmao kernel: bootmem::__reserve count 584 nid=0 start=3b64b end=3b80b flags=1 pages=448, tot_res_pages 11744520
May 25 18:02:35 xmao rpc.statd[3481]: Version 1.0.9 Starting
May 25 18:02:35 xmao kernel: bootmem::__reserve count 585 nid=0 start=3b80b end=3b9cb flags=1 pages=448, tot_res_pages 11744968
May 25 18:02:35 xmao kernel: bootmem::__reserve count 586 nid=0 start=3b9cb end=3bb8b flags=1 pages=448, tot_res_pages 11745416
May 25 18:02:35 xmao kernel: bootmem::__reserve count 587 nid=0 start=3bb8b end=3bd4b flags=1 pages=448, tot_res_pages 11745864
May 25 18:02:35 xmao kernel: bootmem::__reserve count 588 nid=0 start=3bd4b end=3bf0b flags=1 pages=448, tot_res_pages 11746312
May 25 18:02:35 xmao kernel: bootmem::__reserve count 589 nid=0 start=3bf0b end=3c0cb flags=1 pages=448, tot_res_pages 11746760
May 25 18:02:35 xmao kernel: bootmem::__reserve count 590 nid=0 start=3c0cb end=3c28b flags=1 pages=448, tot_res_pages 11747208
May 25 18:02:35 xmao kernel: bootmem::__reserve count 591 nid=0 start=3c28b end=3c44b flags=1 pages=448, tot_res_pages 11747656
May 25 18:02:35 xmao kernel: bootmem::__reserve count 592 nid=0 start=3c44b end=3c60b flags=1 pages=448, tot_res_pages 11748104
May 25 18:02:35 xmao kernel: bootmem::__reserve count 593 nid=0 start=3c60b end=3c7cb flags=1 pages=448, tot_res_pages 11748552
May 25 18:02:35 xmao kernel: bootmem::__reserve count 594 nid=0 start=3c7cb end=3c98b flags=1 pages=448, tot_res_pages 11749000
May 25 18:02:35 xmao kernel: bootmem::__reserve count 595 nid=0 start=3c98b end=3cb4b flags=1 pages=448, tot_res_pages 11749448
May 25 18:02:35 xmao kernel: bootmem::__reserve count 596 nid=0 start=3cb4b end=3cd0b flags=1 pages=448, tot_res_pages 11749896
May 25 18:02:35 xmao kernel: bootmem::__reserve count 597 nid=0 start=3cd0b end=3cecb flags=1 pages=448, tot_res_pages 11750344
May 25 18:02:35 xmao kernel: bootmem::__reserve count 598 nid=0 start=3cecb end=3d08b flags=1 pages=448, tot_res_pages 11750792
May 25 18:02:35 xmao kernel: bootmem::__reserve count 599 nid=0 start=3d08b end=3d24b flags=1 pages=448, tot_res_pages 11751240
May 25 18:02:35 xmao kernel: bootmem::__reserve count 600 nid=0 start=3d24b end=3d40b flags=1 pages=448, tot_res_pages 11751688
May 25 18:02:35 xmao kernel: bootmem::__reserve count 601 nid=0 start=3d40b end=3d5cb flags=1 pages=448, tot_res_pages 11752136
May 25 18:02:35 xmao kernel: bootmem::__reserve count 602 nid=0 start=3d5cb end=3d78b flags=1 pages=448, tot_res_pages 11752584
May 25 18:02:35 xmao kernel: bootmem::__reserve count 603 nid=0 start=3d78b end=3d94b flags=1 pages=448, tot_res_pages 11753032
May 25 18:02:35 xmao kernel: bootmem::__reserve count 604 nid=0 start=3d94b end=3db0b flags=1 pages=448, tot_res_pages 11753480
May 25 18:02:35 xmao kernel: bootmem::__reserve count 605 nid=0 start=3db0b end=3dccb flags=1 pages=448, tot_res_pages 11753928
May 25 18:02:35 xmao kernel: bootmem::__reserve count 606 nid=0 start=3dccb end=3de8b flags=1 pages=448, tot_res_pages 11754376
May 25 18:02:35 xmao kernel: bootmem::__reserve count 607 nid=0 start=3de8b end=3e04b flags=1 pages=448, tot_res_pages 11754824
May 25 18:02:35 xmao kernel: bootmem::__reserve count 608 nid=0 start=3e04b end=3e20b flags=1 pages=448, tot_res_pages 11755272
May 25 18:02:35 xmao kernel: bootmem::__reserve count 609 nid=0 start=3e20b end=3e3cb flags=1 pages=448, tot_res_pages 11755720
May 25 18:02:35 xmao kernel: bootmem::__reserve count 610 nid=0 start=3e3cb end=3e58b flags=1 pages=448, tot_res_pages 11756168
May 25 18:02:35 xmao kernel: bootmem::__reserve count 611 nid=0 start=3e58b end=3e74b flags=1 pages=448, tot_res_pages 11756616
May 25 18:02:35 xmao kernel: bootmem::__reserve count 612 nid=0 start=3e74b end=3e90b flags=1 pages=448, tot_res_pages 11757064
May 25 18:02:35 xmao kernel: bootmem::__reserve count 613 nid=0 start=3e90b end=3eacb flags=1 pages=448, tot_res_pages 11757512
May 25 18:02:35 xmao kernel: bootmem::__reserve count 614 nid=0 start=3eacb end=3ec8b flags=1 pages=448, tot_res_pages 11757960
May 25 18:02:35 xmao kernel: bootmem::__reserve count 615 nid=0 start=3ec8b end=3ee4b flags=1 pages=448, tot_res_pages 11758408
May 25 18:02:35 xmao kernel: bootmem::__reserve count 616 nid=0 start=3ee4b end=3f00b flags=1 pages=448, tot_res_pages 11758856
May 25 18:02:35 xmao kernel: bootmem::__reserve count 617 nid=0 start=3f00b end=3f1cb flags=1 pages=448, tot_res_pages 11759304
May 25 18:02:35 xmao kernel: bootmem::__reserve count 618 nid=0 start=3f1cb end=3f38b flags=1 pages=448, tot_res_pages 11759752
May 25 18:02:35 xmao kernel: bootmem::__reserve count 619 nid=0 start=3f38b end=3f54b flags=1 pages=448, tot_res_pages 11760200
May 25 18:02:35 xmao kernel: bootmem::__reserve count 620 nid=0 start=3f54b end=3f70b flags=1 pages=448, tot_res_pages 11760648
May 25 18:02:35 xmao kernel: bootmem::__reserve count 621 nid=0 start=3f70b end=3f8cb flags=1 pages=448, tot_res_pages 11761096
May 25 18:02:35 xmao kernel: bootmem::__reserve count 622 nid=0 start=3f8cb end=3fa8b flags=1 pages=448, tot_res_pages 11761544
May 25 18:02:35 xmao kernel: bootmem::__reserve count 623 nid=0 start=3fa8b end=3fc4b flags=1 pages=448, tot_res_pages 11761992
May 25 18:02:35 xmao kernel: bootmem::__reserve count 624 nid=0 start=3fc4b end=3fe0b flags=1 pages=448, tot_res_pages 11762440
May 25 18:02:35 xmao kernel: bootmem::__reserve count 625 nid=0 start=3fe0b end=3ffcb flags=1 pages=448, tot_res_pages 11762888
May 25 18:02:35 xmao kernel: bootmem::__reserve count 626 nid=0 start=3ffcb end=4018b flags=1 pages=448, tot_res_pages 11763336
May 25 18:02:35 xmao kernel: bootmem::__reserve count 627 nid=0 start=4018b end=4034b flags=1 pages=448, tot_res_pages 11763784
May 25 18:02:35 xmao kernel: bootmem::__reserve count 628 nid=0 start=4034b end=4050b flags=1 pages=448, tot_res_pages 11764232
May 25 18:02:35 xmao kernel: bootmem::__reserve count 629 nid=0 start=4050b end=406cb flags=1 pages=448, tot_res_pages 11764680
May 25 18:02:35 xmao kernel: bootmem::__reserve count 630 nid=0 start=406cb end=4088b flags=1 pages=448, tot_res_pages 11765128
May 25 18:02:35 xmao kernel: bootmem::__reserve count 631 nid=0 start=4088b end=40a4b flags=1 pages=448, tot_res_pages 11765576
May 25 18:02:35 xmao kernel: bootmem::__reserve count 632 nid=0 start=40a4b end=40c0b flags=1 pages=448, tot_res_pages 11766024
May 25 18:02:35 xmao kernel: bootmem::__reserve count 633 nid=0 start=40c0b end=40dcb flags=1 pages=448, tot_res_pages 11766472
May 25 18:02:35 xmao kernel: bootmem::__reserve count 634 nid=0 start=40dcb end=40f8b flags=1 pages=448, tot_res_pages 11766920
May 25 18:02:35 xmao kernel: bootmem::__reserve count 635 nid=0 start=40f8b end=4114b flags=1 pages=448, tot_res_pages 11767368
May 25 18:02:35 xmao kernel: bootmem::__reserve count 636 nid=0 start=4114b end=4130b flags=1 pages=448, tot_res_pages 11767816
May 25 18:02:35 xmao kernel: bootmem::__reserve count 637 nid=0 start=4130b end=414cb flags=1 pages=448, tot_res_pages 11768264
May 25 18:02:35 xmao kernel: bootmem::__reserve count 638 nid=0 start=414cb end=4168b flags=1 pages=448, tot_res_pages 11768712
May 25 18:02:35 xmao kernel: bootmem::__reserve count 639 nid=0 start=4168b end=4184b flags=1 pages=448, tot_res_pages 11769160
May 25 18:02:35 xmao kernel: bootmem::__reserve count 640 nid=0 start=4184b end=41a0b flags=1 pages=448, tot_res_pages 11769608
May 25 18:02:35 xmao kernel: bootmem::__reserve count 641 nid=0 start=41a0b end=41bcb flags=1 pages=448, tot_res_pages 11770056
May 25 18:02:35 xmao rpc.statd[3481]: statd running as root. chown /var/lib/nfs/statd/sm to choose different user 
May 25 18:02:35 xmao kernel: bootmem::__reserve count 642 nid=0 start=41bcb end=41d8b flags=1 pages=448, tot_res_pages 11770504
May 25 18:02:35 xmao kernel: bootmem::__reserve count 643 nid=0 start=41d8b end=41f4b flags=1 pages=448, tot_res_pages 11770952
May 25 18:02:35 xmao kernel: bootmem::__reserve count 644 nid=0 start=41f4b end=4210b flags=1 pages=448, tot_res_pages 11771400
May 25 18:02:35 xmao kernel: bootmem::__reserve count 645 nid=0 start=4210b end=422cb flags=1 pages=448, tot_res_pages 11771848
May 25 18:02:35 xmao kernel: bootmem::__reserve count 646 nid=0 start=422cb end=4248b flags=1 pages=448, tot_res_pages 11772296
May 25 18:02:35 xmao kernel: bootmem::__reserve count 647 nid=0 start=4248b end=4264b flags=1 pages=448, tot_res_pages 11772744
May 25 18:02:35 xmao kernel: bootmem::__reserve count 648 nid=0 start=4264b end=4280b flags=1 pages=448, tot_res_pages 11773192
May 25 18:02:35 xmao kernel: bootmem::__reserve count 649 nid=0 start=4280b end=429cb flags=1 pages=448, tot_res_pages 11773640
May 25 18:02:35 xmao kernel: bootmem::__reserve count 650 nid=0 start=429cb end=42b8b flags=1 pages=448, tot_res_pages 11774088
May 25 18:02:35 xmao kernel: bootmem::__reserve count 651 nid=0 start=42b8b end=42d4b flags=1 pages=448, tot_res_pages 11774536
May 25 18:02:35 xmao kernel: bootmem::__reserve count 652 nid=0 start=42d4b end=42f0b flags=1 pages=448, tot_res_pages 11774984
May 25 18:02:35 xmao kernel: bootmem::__reserve count 653 nid=0 start=42f0b end=430cb flags=1 pages=448, tot_res_pages 11775432
May 25 18:02:35 xmao kernel: bootmem::__reserve count 654 nid=0 start=430cb end=4328b flags=1 pages=448, tot_res_pages 11775880
May 25 18:02:35 xmao kernel: bootmem::__reserve count 655 nid=0 start=4328b end=4344b flags=1 pages=448, tot_res_pages 11776328
May 25 18:02:35 xmao kernel: bootmem::__reserve count 656 nid=0 start=4344b end=4360b flags=1 pages=448, tot_res_pages 11776776
May 25 18:02:35 xmao kernel: bootmem::__reserve count 657 nid=0 start=4360b end=437cb flags=1 pages=448, tot_res_pages 11777224
May 25 18:02:35 xmao kernel: bootmem::__reserve count 658 nid=0 start=437cb end=4398b flags=1 pages=448, tot_res_pages 11777672
May 25 18:02:35 xmao kernel: bootmem::__reserve count 659 nid=0 start=4398b end=43b4b flags=1 pages=448, tot_res_pages 11778120
May 25 18:02:35 xmao kernel: bootmem::__reserve count 660 nid=0 start=43b4b end=43d0b flags=1 pages=448, tot_res_pages 11778568
May 25 18:02:35 xmao kernel: bootmem::__reserve count 661 nid=0 start=43d0b end=43ecb flags=1 pages=448, tot_res_pages 11779016
May 25 18:02:35 xmao kernel: bootmem::__reserve count 662 nid=0 start=43ecb end=4408b flags=1 pages=448, tot_res_pages 11779464
May 25 18:02:35 xmao kernel: bootmem::__reserve count 663 nid=0 start=4408b end=4424b flags=1 pages=448, tot_res_pages 11779912
May 25 18:02:35 xmao kernel: bootmem::__reserve count 664 nid=0 start=4424b end=4440b flags=1 pages=448, tot_res_pages 11780360
May 25 18:02:35 xmao kernel: bootmem::__reserve count 665 nid=0 start=4440b end=445cb flags=1 pages=448, tot_res_pages 11780808
May 25 18:02:35 xmao kernel: bootmem::__reserve count 666 nid=0 start=445cb end=4478b flags=1 pages=448, tot_res_pages 11781256
May 25 18:02:35 xmao kernel: bootmem::__reserve count 667 nid=0 start=4478b end=4494b flags=1 pages=448, tot_res_pages 11781704
May 25 18:02:35 xmao kernel: bootmem::__reserve count 668 nid=0 start=4494b end=44b0b flags=1 pages=448, tot_res_pages 11782152
May 25 18:02:35 xmao kernel: bootmem::__reserve count 669 nid=0 start=44b0b end=44ccb flags=1 pages=448, tot_res_pages 11782600
May 25 18:02:35 xmao kernel: bootmem::__reserve count 670 nid=0 start=44ccb end=44e8b flags=1 pages=448, tot_res_pages 11783048
May 25 18:02:35 xmao kernel: bootmem::__reserve count 671 nid=0 start=44e8b end=4504b flags=1 pages=448, tot_res_pages 11783496
May 25 18:02:35 xmao kernel: bootmem::__reserve count 672 nid=0 start=4504b end=4520b flags=1 pages=448, tot_res_pages 11783944
May 25 18:02:35 xmao kernel: bootmem::__reserve count 673 nid=0 start=4520b end=453cb flags=1 pages=448, tot_res_pages 11784392
May 25 18:02:35 xmao kernel: bootmem::__reserve count 674 nid=0 start=453cb end=4558b flags=1 pages=448, tot_res_pages 11784840
May 25 18:02:35 xmao kernel: bootmem::__reserve count 675 nid=0 start=4558b end=4574b flags=1 pages=448, tot_res_pages 11785288
May 25 18:02:35 xmao kernel: bootmem::__reserve count 676 nid=0 start=4574b end=4590b flags=1 pages=448, tot_res_pages 11785736
May 25 18:02:35 xmao kernel: bootmem::__reserve count 677 nid=0 start=4590b end=45acb flags=1 pages=448, tot_res_pages 11786184
May 25 18:02:35 xmao kernel: bootmem::__reserve count 678 nid=0 start=45acb end=45c8b flags=1 pages=448, tot_res_pages 11786632
May 25 18:02:35 xmao kernel: bootmem::__reserve count 679 nid=0 start=45c8b end=45e4b flags=1 pages=448, tot_res_pages 11787080
May 25 18:02:35 xmao kernel: bootmem::__reserve count 680 nid=0 start=45e4b end=4600b flags=1 pages=448, tot_res_pages 11787528
May 25 18:02:35 xmao kernel: bootmem::__reserve count 681 nid=0 start=4600b end=461cb flags=1 pages=448, tot_res_pages 11787976
May 25 18:02:35 xmao kernel: bootmem::__reserve count 682 nid=0 start=461cb end=4638b flags=1 pages=448, tot_res_pages 11788424
May 25 18:02:35 xmao kernel: bootmem::__reserve count 683 nid=0 start=4638b end=4654b flags=1 pages=448, tot_res_pages 11788872
May 25 18:02:36 xmao kernel: bootmem::__reserve count 684 nid=0 start=4654b end=4670b flags=1 pages=448, tot_res_pages 11789320
May 25 18:02:36 xmao kernel: bootmem::__reserve count 685 nid=0 start=4670b end=468cb flags=1 pages=448, tot_res_pages 11789768
May 25 18:02:36 xmao kernel: bootmem::__reserve count 686 nid=0 start=468cb end=46a8b flags=1 pages=448, tot_res_pages 11790216
May 25 18:02:36 xmao kernel: bootmem::__reserve count 687 nid=0 start=46a8b end=46c4b flags=1 pages=448, tot_res_pages 11790664
May 25 18:02:36 xmao kernel: bootmem::__reserve count 688 nid=0 start=46c4b end=46e0b flags=1 pages=448, tot_res_pages 11791112
May 25 18:02:36 xmao kernel: bootmem::__reserve count 689 nid=0 start=46e0b end=46fcb flags=1 pages=448, tot_res_pages 11791560
May 25 18:02:36 xmao kernel: bootmem::__reserve count 690 nid=0 start=46fcb end=4718b flags=1 pages=448, tot_res_pages 11792008
May 25 18:02:36 xmao kernel: bootmem::__reserve count 691 nid=0 start=4718b end=4734b flags=1 pages=448, tot_res_pages 11792456
May 25 18:02:36 xmao kernel: bootmem::__reserve count 692 nid=0 start=4734b end=4750b flags=1 pages=448, tot_res_pages 11792904
May 25 18:02:36 xmao kernel: bootmem::__reserve count 693 nid=0 start=4750b end=476cb flags=1 pages=448, tot_res_pages 11793352
May 25 18:02:36 xmao kernel: bootmem::__reserve count 694 nid=0 start=476cb end=4788b flags=1 pages=448, tot_res_pages 11793800
May 25 18:02:36 xmao kernel: bootmem::__reserve count 695 nid=0 start=4788b end=47a4b flags=1 pages=448, tot_res_pages 11794248
May 25 18:02:36 xmao kernel: bootmem::__reserve count 696 nid=0 start=47a4b end=47c0b flags=1 pages=448, tot_res_pages 11794696
May 25 18:02:36 xmao kernel: bootmem::__reserve count 697 nid=0 start=47c0b end=47dcb flags=1 pages=448, tot_res_pages 11795144
May 25 18:02:36 xmao kernel: bootmem::__reserve count 698 nid=0 start=47dcb end=47f8b flags=1 pages=448, tot_res_pages 11795592
May 25 18:02:36 xmao kernel: bootmem::__reserve count 699 nid=0 start=47f8b end=4814b flags=1 pages=448, tot_res_pages 11796040
May 25 18:02:36 xmao kernel: bootmem::__reserve count 700 nid=0 start=4814b end=4830b flags=1 pages=448, tot_res_pages 11796488
May 25 18:02:36 xmao kernel: bootmem::__reserve count 701 nid=0 start=4830b end=484cb flags=1 pages=448, tot_res_pages 11796936
May 25 18:02:36 xmao kernel: bootmem::__reserve count 702 nid=0 start=484cb end=4868b flags=1 pages=448, tot_res_pages 11797384
May 25 18:02:36 xmao kernel: bootmem::__reserve count 703 nid=0 start=4868b end=4884b flags=1 pages=448, tot_res_pages 11797832
May 25 18:02:36 xmao kernel: bootmem::__reserve count 704 nid=0 start=4884b end=48a0b flags=1 pages=448, tot_res_pages 11798280
May 25 18:02:36 xmao kernel: bootmem::__reserve count 705 nid=0 start=48a0b end=48bcb flags=1 pages=448, tot_res_pages 11798728
May 25 18:02:36 xmao kernel: bootmem::__reserve count 706 nid=0 start=48bcb end=48d8b flags=1 pages=448, tot_res_pages 11799176
May 25 18:02:36 xmao kernel: bootmem::__reserve count 707 nid=0 start=48d8b end=48f4b flags=1 pages=448, tot_res_pages 11799624
May 25 18:02:36 xmao kernel: bootmem::__reserve count 708 nid=0 start=48f4b end=4910b flags=1 pages=448, tot_res_pages 11800072
May 25 18:02:36 xmao kernel: bootmem::__reserve count 709 nid=0 start=4910b end=492cb flags=1 pages=448, tot_res_pages 11800520
May 25 18:02:36 xmao kernel: bootmem::__reserve count 710 nid=0 start=492cb end=4948b flags=1 pages=448, tot_res_pages 11800968
May 25 18:02:36 xmao kernel: bootmem::__reserve count 711 nid=0 start=4948b end=4964b flags=1 pages=448, tot_res_pages 11801416
May 25 18:02:36 xmao kernel: bootmem::__reserve count 712 nid=0 start=4964b end=4980b flags=1 pages=448, tot_res_pages 11801864
May 25 18:02:36 xmao kernel: bootmem::__reserve count 713 nid=0 start=4980b end=499cb flags=1 pages=448, tot_res_pages 11802312
May 25 18:02:36 xmao kernel: bootmem::__reserve count 714 nid=0 start=499cb end=49b8b flags=1 pages=448, tot_res_pages 11802760
May 25 18:02:36 xmao kernel: bootmem::__reserve count 715 nid=0 start=49b8b end=49d4b flags=1 pages=448, tot_res_pages 11803208
May 25 18:02:36 xmao kernel: bootmem::__reserve count 716 nid=0 start=49d4b end=49f0b flags=1 pages=448, tot_res_pages 11803656
May 25 18:02:36 xmao kernel: bootmem::__reserve count 717 nid=0 start=49f0b end=4a0cb flags=1 pages=448, tot_res_pages 11804104
May 25 18:02:36 xmao kernel: bootmem::__reserve count 718 nid=0 start=4a0cb end=4a28b flags=1 pages=448, tot_res_pages 11804552
May 25 18:02:36 xmao kernel: bootmem::__reserve count 719 nid=0 start=4a28b end=4a44b flags=1 pages=448, tot_res_pages 11805000
May 25 18:02:36 xmao kernel: bootmem::__reserve count 720 nid=0 start=4a44b end=4a60b flags=1 pages=448, tot_res_pages 11805448
May 25 18:02:36 xmao kernel: bootmem::__reserve count 721 nid=0 start=4a60b end=4a7cb flags=1 pages=448, tot_res_pages 11805896
May 25 18:02:36 xmao kernel: bootmem::__reserve count 722 nid=0 start=4a7cb end=4a98b flags=1 pages=448, tot_res_pages 11806344
May 25 18:02:36 xmao kernel: bootmem::__reserve count 723 nid=0 start=4a98b end=4ab4b flags=1 pages=448, tot_res_pages 11806792
May 25 18:02:36 xmao kernel: bootmem::__reserve count 724 nid=0 start=4ab4b end=4ad0b flags=1 pages=448, tot_res_pages 11807240
May 25 18:02:36 xmao kernel: bootmem::__reserve count 725 nid=0 start=4ad0b end=4aecb flags=1 pages=448, tot_res_pages 11807688
May 25 18:02:36 xmao kernel: bootmem::__reserve count 726 nid=0 start=4aecb end=4b08b flags=1 pages=448, tot_res_pages 11808136
May 25 18:02:36 xmao kernel: bootmem::__reserve count 727 nid=0 start=4b08b end=4b24b flags=1 pages=448, tot_res_pages 11808584
May 25 18:02:36 xmao kernel: bootmem::__reserve count 728 nid=0 start=4b24b end=4b40b flags=1 pages=448, tot_res_pages 11809032
May 25 18:02:36 xmao kernel: bootmem::__reserve count 729 nid=0 start=4b40b end=4b5cb flags=1 pages=448, tot_res_pages 11809480
May 25 18:02:36 xmao kernel: bootmem::__reserve count 730 nid=0 start=4b5cb end=4b78b flags=1 pages=448, tot_res_pages 11809928
May 25 18:02:36 xmao kernel: bootmem::__reserve count 731 nid=0 start=4b78b end=4b94b flags=1 pages=448, tot_res_pages 11810376
May 25 18:02:36 xmao kernel: bootmem::__reserve count 732 nid=0 start=4b94b end=4bb0b flags=1 pages=448, tot_res_pages 11810824
May 25 18:02:36 xmao kernel: bootmem::__reserve count 733 nid=0 start=4bb0b end=4bccb flags=1 pages=448, tot_res_pages 11811272
May 25 18:02:36 xmao kernel: bootmem::__reserve count 734 nid=0 start=4bccb end=4be8b flags=1 pages=448, tot_res_pages 11811720
May 25 18:02:36 xmao kernel: bootmem::__reserve count 735 nid=0 start=4be8b end=4c04b flags=1 pages=448, tot_res_pages 11812168
May 25 18:02:36 xmao kernel: bootmem::__reserve count 736 nid=0 start=4c04b end=4c20b flags=1 pages=448, tot_res_pages 11812616
May 25 18:02:36 xmao kernel: bootmem::__reserve count 737 nid=0 start=4c20b end=4c3cb flags=1 pages=448, tot_res_pages 11813064
May 25 18:02:36 xmao kernel: bootmem::__reserve count 738 nid=0 start=4c3cb end=4c58b flags=1 pages=448, tot_res_pages 11813512
May 25 18:02:36 xmao kernel: bootmem::__reserve count 739 nid=0 start=4c58b end=4c74b flags=1 pages=448, tot_res_pages 11813960
May 25 18:02:36 xmao kernel: bootmem::__reserve count 740 nid=0 start=4c74b end=4c90b flags=1 pages=448, tot_res_pages 11814408
May 25 18:02:36 xmao kernel: bootmem::__reserve count 741 nid=0 start=4c90b end=4cacb flags=1 pages=448, tot_res_pages 11814856
May 25 18:02:36 xmao kernel: bootmem::__reserve count 742 nid=0 start=4cacb end=4cc8b flags=1 pages=448, tot_res_pages 11815304
May 25 18:02:36 xmao kernel: bootmem::__reserve count 743 nid=0 start=4cc8b end=4ce4b flags=1 pages=448, tot_res_pages 11815752
May 25 18:02:36 xmao kernel: bootmem::__reserve count 744 nid=0 start=4ce4b end=4d00b flags=1 pages=448, tot_res_pages 11816200
May 25 18:02:36 xmao kernel: bootmem::__reserve count 745 nid=0 start=4d00b end=4d1cb flags=1 pages=448, tot_res_pages 11816648
May 25 18:02:36 xmao kernel: bootmem::__reserve count 746 nid=0 start=4d1cb end=4d38b flags=1 pages=448, tot_res_pages 11817096
May 25 18:02:36 xmao kernel: bootmem::__reserve count 747 nid=0 start=4d38b end=4d54b flags=1 pages=448, tot_res_pages 11817544
May 25 18:02:36 xmao kernel: bootmem::__reserve count 748 nid=0 start=4d54b end=4d70b flags=1 pages=448, tot_res_pages 11817992
May 25 18:02:36 xmao kernel: bootmem::__reserve count 749 nid=0 start=4d70b end=4d8cb flags=1 pages=448, tot_res_pages 11818440
May 25 18:02:36 xmao kernel: bootmem::__reserve count 750 nid=0 start=4d8cb end=4da8b flags=1 pages=448, tot_res_pages 11818888
May 25 18:02:36 xmao kernel: bootmem::__reserve count 751 nid=0 start=4da8b end=4dc4b flags=1 pages=448, tot_res_pages 11819336
May 25 18:02:36 xmao kernel: bootmem::__reserve count 752 nid=0 start=4dc4b end=4de0b flags=1 pages=448, tot_res_pages 11819784
May 25 18:02:36 xmao kernel: bootmem::__reserve count 753 nid=0 start=4de0b end=4dfcb flags=1 pages=448, tot_res_pages 11820232
May 25 18:02:36 xmao kernel: bootmem::__reserve count 754 nid=0 start=4dfcb end=4e18b flags=1 pages=448, tot_res_pages 11820680
May 25 18:02:36 xmao kernel: bootmem::__reserve count 755 nid=0 start=4e18b end=4e34b flags=1 pages=448, tot_res_pages 11821128
May 25 18:02:36 xmao kernel: bootmem::__reserve count 756 nid=0 start=4e34b end=4e50b flags=1 pages=448, tot_res_pages 11821576
May 25 18:02:36 xmao kernel: bootmem::__reserve count 757 nid=0 start=4e50b end=4e6cb flags=1 pages=448, tot_res_pages 11822024
May 25 18:02:36 xmao kernel: bootmem::__reserve count 758 nid=0 start=4e6cb end=4e88b flags=1 pages=448, tot_res_pages 11822472
May 25 18:02:36 xmao kernel: bootmem::__reserve count 759 nid=0 start=4e88b end=4ea4b flags=1 pages=448, tot_res_pages 11822920
May 25 18:02:36 xmao kernel: bootmem::__reserve count 760 nid=0 start=4ea4b end=4ec0b flags=1 pages=448, tot_res_pages 11823368
May 25 18:02:36 xmao kernel: bootmem::__reserve count 761 nid=0 start=4ec0b end=4edcb flags=1 pages=448, tot_res_pages 11823816
May 25 18:02:36 xmao kernel: bootmem::__reserve count 762 nid=0 start=4edcb end=4ef8b flags=1 pages=448, tot_res_pages 11824264
May 25 18:02:36 xmao kernel: bootmem::__reserve count 763 nid=0 start=4ef8b end=4f14b flags=1 pages=448, tot_res_pages 11824712
May 25 18:02:36 xmao kernel: bootmem::__reserve count 764 nid=0 start=4f14b end=4f30b flags=1 pages=448, tot_res_pages 11825160
May 25 18:02:36 xmao kernel: bootmem::__reserve count 765 nid=0 start=4f30b end=4f4cb flags=1 pages=448, tot_res_pages 11825608
May 25 18:02:36 xmao kernel: bootmem::__reserve count 766 nid=0 start=4f4cb end=4f68b flags=1 pages=448, tot_res_pages 11826056
May 25 18:02:36 xmao kernel: bootmem::__reserve count 767 nid=0 start=4f68b end=4f84b flags=1 pages=448, tot_res_pages 11826504
May 25 18:02:36 xmao kernel: bootmem::__reserve count 768 nid=0 start=4f84b end=4fa0b flags=1 pages=448, tot_res_pages 11826952
May 25 18:02:36 xmao kernel: bootmem::__reserve count 769 nid=0 start=4fa0b end=4fbcb flags=1 pages=448, tot_res_pages 11827400
May 25 18:02:36 xmao kernel: bootmem::__reserve count 770 nid=0 start=4fbcb end=4fd8b flags=1 pages=448, tot_res_pages 11827848
May 25 18:02:36 xmao kernel: bootmem::__reserve count 771 nid=0 start=4fd8b end=4ff4b flags=1 pages=448, tot_res_pages 11828296
May 25 18:02:36 xmao kernel: bootmem::__reserve count 772 nid=0 start=4ff4b end=5010b flags=1 pages=448, tot_res_pages 11828744
May 25 18:02:36 xmao kernel: bootmem::__reserve count 773 nid=0 start=5010b end=502cb flags=1 pages=448, tot_res_pages 11829192
May 25 18:02:36 xmao kernel: bootmem::__reserve count 774 nid=0 start=502cb end=5048b flags=1 pages=448, tot_res_pages 11829640
May 25 18:02:36 xmao kernel: bootmem::__reserve count 775 nid=0 start=5048b end=5064b flags=1 pages=448, tot_res_pages 11830088
May 25 18:02:36 xmao kernel: bootmem::__reserve count 776 nid=0 start=5064b end=5080b flags=1 pages=448, tot_res_pages 11830536
May 25 18:02:36 xmao kernel: bootmem::__reserve count 777 nid=0 start=5080b end=509cb flags=1 pages=448, tot_res_pages 11830984
May 25 18:02:36 xmao kernel: bootmem::__reserve count 778 nid=0 start=509cb end=50b8b flags=1 pages=448, tot_res_pages 11831432
May 25 18:02:36 xmao kernel: bootmem::__reserve count 779 nid=0 start=50b8b end=50d4b flags=1 pages=448, tot_res_pages 11831880
May 25 18:02:36 xmao kernel: bootmem::__reserve count 780 nid=0 start=50d4b end=50f0b flags=1 pages=448, tot_res_pages 11832328
May 25 18:02:36 xmao kernel: bootmem::__reserve count 781 nid=0 start=50f0b end=510cb flags=1 pages=448, tot_res_pages 11832776
May 25 18:02:36 xmao kernel: bootmem::__reserve count 782 nid=0 start=510cb end=5128b flags=1 pages=448, tot_res_pages 11833224
May 25 18:02:36 xmao kernel: bootmem::__reserve count 783 nid=0 start=5128b end=5144b flags=1 pages=448, tot_res_pages 11833672
May 25 18:02:36 xmao kernel: bootmem::__reserve count 784 nid=0 start=5144b end=5160b flags=1 pages=448, tot_res_pages 11834120
May 25 18:02:36 xmao kernel: bootmem::__reserve count 785 nid=0 start=5160b end=517cb flags=1 pages=448, tot_res_pages 11834568
May 25 18:02:36 xmao kernel: bootmem::__reserve count 786 nid=0 start=517cb end=5198b flags=1 pages=448, tot_res_pages 11835016
May 25 18:02:36 xmao kernel: bootmem::__reserve count 787 nid=0 start=5198b end=51b4b flags=1 pages=448, tot_res_pages 11835464
May 25 18:02:36 xmao kernel: bootmem::__reserve count 788 nid=0 start=51b4b end=51d0b flags=1 pages=448, tot_res_pages 11835912
May 25 18:02:36 xmao kernel: bootmem::__reserve count 789 nid=0 start=51d0b end=51ecb flags=1 pages=448, tot_res_pages 11836360
May 25 18:02:36 xmao kernel: bootmem::__reserve count 790 nid=0 start=51ecb end=5208b flags=1 pages=448, tot_res_pages 11836808
May 25 18:02:36 xmao kernel: bootmem::__reserve count 791 nid=0 start=5208b end=5224b flags=1 pages=448, tot_res_pages 11837256
May 25 18:02:36 xmao kernel: bootmem::__reserve count 792 nid=0 start=5224b end=5240b flags=1 pages=448, tot_res_pages 11837704
May 25 18:02:36 xmao kernel: bootmem::__reserve count 793 nid=0 start=5240b end=525cb flags=1 pages=448, tot_res_pages 11838152
May 25 18:02:36 xmao kernel: bootmem::__reserve count 794 nid=0 start=525cb end=5278b flags=1 pages=448, tot_res_pages 11838600
May 25 18:02:36 xmao kernel: bootmem::__reserve count 795 nid=0 start=5278b end=5294b flags=1 pages=448, tot_res_pages 11839048
May 25 18:02:36 xmao kernel: bootmem::__reserve count 796 nid=0 start=5294b end=52b0b flags=1 pages=448, tot_res_pages 11839496
May 25 18:02:36 xmao kernel: bootmem::__reserve count 797 nid=0 start=52b0b end=52ccb flags=1 pages=448, tot_res_pages 11839944
May 25 18:02:36 xmao kernel: bootmem::__reserve count 798 nid=0 start=52ccb end=52e8b flags=1 pages=448, tot_res_pages 11840392
May 25 18:02:36 xmao kernel: bootmem::mark_bootmem_node nid=0 start=28004 end=28404 reserve=0 flags=0
May 25 18:02:36 xmao kernel: bootmem::__free count 4 nid=0 start=28004 end=28404 pages 1024 tot_free_pages 12778019
May 25 18:02:36 xmao kernel: Zone PFN ranges:
May 25 18:02:36 xmao kernel:   DMA      0x00000010 -> 0x00001000
May 25 18:02:36 xmao kernel:   DMA32    0x00001000 -> 0x00100000
May 25 18:02:36 xmao kernel:   Normal   0x00100000 -> 0x00c6ff09
May 25 18:02:36 xmao kernel: Movable zone start PFN for each node
May 25 18:02:36 xmao kernel: early_node_map[3] active PFN ranges
May 25 18:02:36 xmao kernel:     0: 0x00000010 -> 0x0000009a
May 25 18:02:36 xmao kernel:     0: 0x00000100 -> 0x000bf790
May 25 18:02:36 xmao kernel:     0: 0x00100000 -> 0x00c6ff09
May 25 18:02:36 xmao kernel: bootmem::__reserve count 799 nid=0 start=28004 end=28005 flags=1 pages=1, tot_res_pages 11840393
May 25 18:02:36 xmao kernel: bootmem::__reserve count 800 nid=0 start=28005 end=2801d flags=1 pages=24, tot_res_pages 11840417
May 25 18:02:36 xmao kernel: bootmem::__reserve count 801 nid=0 start=2801d end=28035 flags=1 pages=24, tot_res_pages 11840441
May 25 18:02:36 xmao kernel: bootmem::__reserve count 802 nid=0 start=28035 end=28036 flags=1 pages=1, tot_res_pages 11840442
May 25 18:02:36 xmao kernel: bootmem::__reserve count 803 nid=0 start=28036 end=28037 flags=1 pages=1, tot_res_pages 11840443
May 25 18:02:36 xmao kernel: bootmem::__reserve count 804 nid=0 start=28037 end=28038 flags=1 pages=1, tot_res_pages 11840444
May 25 18:02:36 xmao kernel: ACPI: PM-Timer IO Port: 0x808
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x01] lapic_id[0x20] enabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x02] lapic_id[0x22] enabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x03] lapic_id[0x32] enabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x04] lapic_id[0x34] enabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x05] lapic_id[0x00] enabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x06] lapic_id[0x02] enabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x07] lapic_id[0x12] enabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x08] lapic_id[0x14] enabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x09] lapic_id[0x21] enabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x23] enabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x33] enabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x35] enabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x01] enabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x03] enabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x13] enabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x10] lapic_id[0x15] enabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x11] lapic_id[0x90] disabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x12] lapic_id[0x91] disabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x13] lapic_id[0x92] disabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x14] lapic_id[0x93] disabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x15] lapic_id[0x94] disabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x16] lapic_id[0x95] disabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x17] lapic_id[0x96] disabled)
May 25 18:02:36 xmao kernel: ACPI: LAPIC (acpi_id[0x18] lapic_id[0x97] disabled)
May 25 18:02:36 xmao kernel: ACPI: IOAPIC (id[0x06] address[0xfec00000] gsi_base[0])
May 25 18:02:36 xmao kernel: IOAPIC[0]: apic_id 6, version 0, address 0xfec00000, GSI 0-0
May 25 18:02:36 xmao kernel: ACPI: IOAPIC (id[0x07] address[0xfec8a000] gsi_base[24])
May 25 18:02:36 xmao kernel: IOAPIC[1]: apic_id 7, version 0, address 0xfec8a000, GSI 24-24
May 25 18:02:36 xmao kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
May 25 18:02:36 xmao kernel: ERROR: Unable to locate IOAPIC for GSI 2
May 25 18:02:36 xmao kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
May 25 18:02:36 xmao kernel: ERROR: Unable to locate IOAPIC for GSI 9
May 25 18:02:36 xmao kernel: Using ACPI (MADT) for SMP configuration information
May 25 18:02:36 xmao kernel: ACPI: HPET id: 0x8086a301 base: 0xfed00000
May 25 18:02:36 xmao kernel: bootmem::__reserve count 805 nid=0 start=28038 end=28039 flags=1 pages=1, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: SMP: Allowing 4 CPUs, 0 hotplug CPUs
May 25 18:02:36 xmao kernel: bootmem::__reserve count 806 nid=0 start=28039 end=28039 flags=1 pages=0, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: bootmem::__reserve count 807 nid=0 start=28039 end=28039 flags=1 pages=0, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: bootmem::__reserve count 808 nid=0 start=28039 end=28039 flags=1 pages=0, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: bootmem::__reserve count 809 nid=0 start=28039 end=28039 flags=1 pages=0, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: bootmem::__reserve count 810 nid=0 start=28039 end=28039 flags=1 pages=0, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: bootmem::__reserve count 811 nid=0 start=28039 end=28039 flags=1 pages=0, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: bootmem::__reserve count 812 nid=0 start=28039 end=28039 flags=1 pages=0, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: bootmem::__reserve count 813 nid=0 start=28039 end=28039 flags=1 pages=0, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: bootmem::__reserve count 814 nid=0 start=28039 end=28039 flags=1 pages=0, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: bootmem::__reserve count 815 nid=0 start=28039 end=28039 flags=1 pages=0, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: bootmem::__reserve count 816 nid=0 start=28039 end=28039 flags=1 pages=0, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: bootmem::__reserve count 817 nid=0 start=28039 end=28039 flags=1 pages=0, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: bootmem::__reserve count 818 nid=0 start=28039 end=28039 flags=1 pages=0, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: bootmem::__reserve count 819 nid=0 start=28039 end=28039 flags=1 pages=0, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: bootmem::__reserve count 820 nid=0 start=28039 end=28039 flags=1 pages=0, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: bootmem::__reserve count 821 nid=0 start=28039 end=28039 flags=1 pages=0, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: PM: Registered nosave memory: 000000000009a000 - 000000000009b000
May 25 18:02:36 xmao kernel: PM: Registered nosave memory: 000000000009b000 - 0000000000100000
May 25 18:02:36 xmao kernel: bootmem::__reserve count 822 nid=0 start=28039 end=28039 flags=1 pages=0, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: PM: Registered nosave memory: 00000000bf790000 - 00000000bf79e000
May 25 18:02:36 xmao kernel: PM: Registered nosave memory: 00000000bf79e000 - 00000000bf7d0000
May 25 18:02:36 xmao kernel: PM: Registered nosave memory: 00000000bf7d0000 - 00000000bf7e0000
May 25 18:02:36 xmao kernel: PM: Registered nosave memory: 00000000bf7e0000 - 00000000bf7ec000
May 25 18:02:36 xmao kernel: PM: Registered nosave memory: 00000000bf7ec000 - 00000000c0000000
May 25 18:02:36 xmao kernel: PM: Registered nosave memory: 00000000c0000000 - 00000000e0000000
May 25 18:02:36 xmao kernel: PM: Registered nosave memory: 00000000e0000000 - 00000000f0000000
May 25 18:02:36 xmao kernel: PM: Registered nosave memory: 00000000f0000000 - 00000000fec00000
May 25 18:02:36 xmao kernel: PM: Registered nosave memory: 00000000fec00000 - 00000000fec01000
May 25 18:02:36 xmao kernel: PM: Registered nosave memory: 00000000fec01000 - 00000000fec8a000
May 25 18:02:36 xmao kernel: PM: Registered nosave memory: 00000000fec8a000 - 00000000fec8b000
May 25 18:02:36 xmao kernel: PM: Registered nosave memory: 00000000fec8b000 - 00000000fee00000
May 25 18:02:36 xmao kernel: PM: Registered nosave memory: 00000000fee00000 - 00000000fee01000
May 25 18:02:36 xmao kernel: PM: Registered nosave memory: 00000000fee01000 - 00000000fff00000
May 25 18:02:36 xmao kernel: PM: Registered nosave memory: 00000000fff00000 - 0000000100000000
May 25 18:02:36 xmao kernel: Allocating PCI resources starting at c0000000 (gap: c0000000:20000000)
May 25 18:02:36 xmao kernel: Booting paravirtualized kernel on Xen
May 25 18:02:36 xmao kernel: Xen version: 4.0.1 (preserve-AD) (dom0)
May 25 18:02:36 xmao kernel: bootmem::__reserve count 823 nid=0 start=28039 end=28039 flags=1 pages=0, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: bootmem::__reserve count 824 nid=0 start=28039 end=28039 flags=1 pages=0, tot_res_pages 11840445
May 25 18:02:36 xmao kernel: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
May 25 18:02:36 xmao kernel: bootmem::__reserve count 825 nid=0 start=28039 end=2803a flags=1 pages=1, tot_res_pages 11840446
May 25 18:02:36 xmao kernel: bootmem::__reserve count 826 nid=0 start=2803a end=2803b flags=1 pages=1, tot_res_pages 11840447
May 25 18:02:36 xmao kernel: bootmem::__reserve count 827 nid=0 start=2803b end=280af flags=1 pages=116, tot_res_pages 11840563
May 25 18:02:36 xmao kernel: bootmem::mark_bootmem_node nid=0 start=28058 end=28058 reserve=0 flags=0
May 25 18:02:36 xmao kernel: bootmem::__free count 5 nid=0 start=28058 end=28058 pages 0 tot_free_pages 12778019
May 25 18:02:36 xmao kernel: bootmem::mark_bootmem_node nid=0 start=28075 end=28075 reserve=0 flags=0
May 25 18:02:36 xmao kernel: bootmem::__free count 6 nid=0 start=28075 end=28075 pages 0 tot_free_pages 12778019
May 25 18:02:36 xmao kernel: bootmem::mark_bootmem_node nid=0 start=28092 end=28092 reserve=0 flags=0
May 25 18:02:36 xmao kernel: bootmem::__free count 7 nid=0 start=28092 end=28092 pages 0 tot_free_pages 12778019
May 25 18:02:36 xmao kernel: bootmem::mark_bootmem_node nid=0 start=280af end=280af reserve=0 flags=0
May 25 18:02:36 xmao kernel: bootmem::__free count 8 nid=0 start=280af end=280af pages 0 tot_free_pages 12778019
May 25 18:02:36 xmao kernel: PERCPU: Embedded 29 pages/cpu @ffff88002803b000 s90072 r8192 d20520 u118784
May 25 18:02:36 xmao kernel: bootmem::__reserve count 828 nid=0 start=280af end=280b0 flags=1 pages=1, tot_res_pages 11840564
May 25 18:02:36 xmao kernel: bootmem::__reserve count 829 nid=0 start=280b0 end=280b0 flags=1 pages=0, tot_res_pages 11840564
May 25 18:02:36 xmao kernel: bootmem::__reserve count 830 nid=0 start=280b0 end=280b0 flags=1 pages=0, tot_res_pages 11840564
May 25 18:02:36 xmao kernel: bootmem::__reserve count 831 nid=0 start=280b0 end=280b0 flags=1 pages=0, tot_res_pages 11840564
May 25 18:02:36 xmao kernel: pcpu-alloc: s90072 r8192 d20520 u118784 alloc=29*4096
May 25 18:02:36 xmao kernel: pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 
May 25 18:02:36 xmao kernel: bootmem::__reserve count 832 nid=0 start=280b0 end=280b0 flags=1 pages=0, tot_res_pages 11840564
May 25 18:02:36 xmao kernel: bootmem::__reserve count 833 nid=0 start=280b0 end=280b0 flags=1 pages=0, tot_res_pages 11840564
May 25 18:02:36 xmao kernel: bootmem::__reserve count 834 nid=0 start=280b0 end=280b0 flags=1 pages=0, tot_res_pages 11840564
May 25 18:02:36 xmao kernel: bootmem::mark_bootmem_node nid=0 start=28039 end=28039 reserve=0 flags=0
May 25 18:02:36 xmao kernel: bootmem::__free count 9 nid=0 start=28039 end=28039 pages 0 tot_free_pages 12778019
May 25 18:02:36 xmao kernel: bootmem::mark_bootmem_node nid=0 start=2803a end=2803a reserve=0 flags=0
May 25 18:02:36 xmao kernel: bootmem::__free count 10 nid=0 start=2803a end=2803a pages 0 tot_free_pages 12778019
May 25 18:02:36 xmao kernel: Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 12597183
May 25 18:02:36 xmao kernel: Kernel command line: ro root=LABEL=/ hda=noprobe console=hvc0 bootmem_debug=1
May 25 18:02:36 xmao kernel: bootmem::__reserve count 835 nid=0 start=280b0 end=280b8 flags=1 pages=8, tot_res_pages 11840572
May 25 18:02:36 xmao kernel: PID hash table entries: 4096 (order: 3, 32768 bytes)
May 25 18:02:36 xmao kernel: bootmem::__reserve count 836 nid=0 start=52e8b end=56e8b flags=1 pages=16384, tot_res_pages 11856956
May 25 18:02:36 xmao kernel: Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes)
May 25 18:02:36 xmao kernel: bootmem::__reserve count 837 nid=0 start=56e8b end=58e8b flags=1 pages=8192, tot_res_pages 11865148
May 25 18:02:36 xmao kernel: Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes)
May 25 18:02:36 xmao kernel: Initializing CPU#0
May 25 18:02:36 xmao kernel: bootmem::mark_bootmem_node nid=0 start=20000 end=28000 reserve=0 flags=0
May 25 18:02:36 xmao kernel: bootmem::__free count 11 nid=0 start=20000 end=28000 pages 32768 tot_free_pages 12810787
May 25 18:02:36 xmao kernel: bootmem::__reserve count 838 nid=0 start=20000 end=24000 flags=1 pages=16384, tot_res_pages 11881532
May 25 18:02:36 xmao kernel: bootmem::__reserve count 839 nid=0 start=24000 end=24020 flags=1 pages=32, tot_res_pages 11881564
May 25 18:02:36 xmao kernel: bootmem::__reserve count 840 nid=0 start=24020 end=24060 flags=1 pages=64, tot_res_pages 11881628
May 25 18:02:36 xmao kernel: bootmem::__reserve count 841 nid=0 start=24060 end=24068 flags=1 pages=8, tot_res_pages 11881636
May 25 18:02:36 xmao kernel: DMA: Placing 64MB software IO TLB between ffff880020000000 - ffff880024000000
May 25 18:02:36 xmao kernel: DMA: software IO TLB at phys 0x20000000 - 0x24000000
May 25 18:02:36 xmao kernel: xen_swiotlb_fixup: buf=ffff880020000000 size=67108864
May 25 18:02:36 xmao kernel: xen_swiotlb_fixup: buf=ffff880024060000 size=32768
May 25 18:02:36 xmao kernel: bootmem::free_all_bootmem_core nid=0 start=0 end=c6ff09 aligned=1
May 25 18:02:36 xmao kernel: bootmem::free_all_bootmem_core nid=0 released=e2f10
May 25 18:02:36 xmao kernel: Memory: 3717504k/52165668k available (4404k kernel code, 1057688k absent, 47389772k reserved, 2847k data, 732k init)

[-- Attachment #3: Type: text/plain, Size: 138 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

^ permalink raw reply	[flat|nested] 12+ messages in thread

* RE: RE:2Gb Memory lost in 2.6.32.36 - 50G memory, maxmem=50G, 2G used for pagetable, clamping (max:5G) is not helping.
  2011-05-25  9:08               ` MaoXiaoyun
@ 2011-05-31  8:33                 ` MaoXiaoyun
  2011-05-31 14:44                   ` Konrad Rzeszutek Wilk
  0 siblings, 1 reply; 12+ messages in thread
From: MaoXiaoyun @ 2011-05-31  8:33 UTC (permalink / raw)
  To: konrad.wilk; +Cc: jeremy, xen devel


[-- Attachment #1.1: Type: text/plain, Size: 7220 bytes --]


Hi Konrad;
 
      I realized that in 32.36 kernel dom0 can balloon up to use whole memory address, in my case it is 48G. But it consumes 845M memory 
for sparse memory to manage them, Well, my dom0 doesn't need so big flexable,  and I learnt that use "mem=" option in grub can limit 
dom0 memory, I think it works for me now.  
 
Any comments?
 
title Red Hat Enterprise Linux Server (2.6.32.36xen)
        root (hd0,0)
        kernel /xen-4.0.1.gz  iommu=off x2apic=off console=com1,vga com1=115200,8n1 noreboot dom0_mem=6144M dom0_max_vcpus=4 dom0_vcpus_pin cpuidle=0 cpufreq=none 
        module /vmlinuz-2.6.32.36xen ro root=LABEL=/ hda=noprobe console=hvc0 mem=8192M
        module /initrd-2.6.32.36xen.img
 
After dom0 start,
root@xmao# free -m
             total       used       free     shared    buffers     cached
Mem:          4135        508       3626          0         21        166
-/+ buffers/cache:        320       3814
Swap:         1027          0       1027
 
=======================
xen_release_chunk: looking at area pfn bf7e0-bf7ec: 12 pages freed
xen_release_chunk: looking at area pfn c0000-e0000: 131072 pages freed
xen_release_chunk: looking at area pfn f0000-fec00: 60416 pages freed
xen_release_chunk: looking at area pfn fec01-fec8a: 137 pages freed
xen_release_chunk: looking at area pfn fec8b-fee00: 373 pages freed
xen_release_chunk: looking at area pfn fee01-fff00: 4351 pages freed
released 196361 pages of unused memory
BIOS-provided physical RAM map:
 Xen: 0000000000000000 - 000000000009a000 (usable)
 Xen: 000000000009a400 - 0000000000100000 (reserved)
 Xen: 0000000000100000 - 00000000bf790000 (usable)
 Xen: 00000000bf790000 - 00000000bf79e000 (ACPI data)
 Xen: 00000000bf79e000 - 00000000bf7d0000 (ACPI NVS)
 Xen: 00000000bf7d0000 - 00000000bf7e0000 (reserved)
 Xen: 00000000bf7ec000 - 00000000c0000000 (reserved)
 Xen: 00000000e0000000 - 00000000f0000000 (reserved)
 Xen: 00000000fec00000 - 00000000fec01000 (reserved)
 Xen: 00000000fec8a000 - 00000000fec8b000 (reserved)
 Xen: 00000000fee00000 - 00000000fee01000 (reserved)
 Xen: 00000000fff00000 - 0000000100000000 (reserved)
 Xen: 0000000100000000 - 0000000c6ff09000 (usable)
user-defined physical RAM map:
 user: 0000000000000000 - 000000000009a000 (usable)
 user: 000000000009a400 - 0000000000100000 (reserved)
 user: 0000000000100000 - 00000000bf790000 (usable)
 user: 00000000bf790000 - 00000000bf79e000 (ACPI data)
 user: 00000000bf79e000 - 00000000bf7d0000 (ACPI NVS)
 user: 00000000bf7d0000 - 00000000bf7e0000 (reserved)
 user: 00000000bf7ec000 - 00000000c0000000 (reserved)
 user: 00000000e0000000 - 00000000f0000000 (reserved)
 user: 00000000fec00000 - 00000000fec01000 (reserved)
 user: 00000000fec8a000 - 00000000fec8b000 (reserved)
 user: 00000000fee00000 - 00000000fee01000 (reserved)
 user: 00000000fff00000 - 0000000100000000 (reserved)
 user: 0000000100000000 - 0000000200000000 (usable)

 


From: tinnycloud@hotmail.com
To: konrad.wilk@oracle.com
CC: xen-devel@lists.xensource.com; jeremy@goop.org
Subject: RE: [Xen-devel] RE:2Gb Memory lost in 2.6.32.36 - 50G memory, maxmem=50G, 2G used for pagetable, clamping (max:5G) is not helping.
Date: Wed, 25 May 2011 17:08:49 +0800




Hi Konrad:
 
     I think I've located where the lost memory going. It is in bootmem when called sparse_init(); 
 
    I enabled bootmem_debug=1 in kernel start args, and log every __reserve and __free memory with 'count' taged.
 
    Like ___free & __reserve code(end of mail) :
 
    Attached is the output log. 
    
1) We give dom0 5630M, that is 5630 * 1024 /4 = 1441280 pages
 
2) Line 204-237 is the stage of early reservations. 
Add up memory in *early reservations* except adderss beyond 15ffe0(line 228) : 
     6329(line 225) + 23 + 1508 + 23470 = 31330 pages ( 123M)
 
3) I will caculated the mem reserved after line 237.
 
In line 237 , tot_res_pages is 11631467 and line 1162, its values is  11881636, so 11881636 - 11631467 = 250169 pages are reserved.
In line 203, tot_free_pages is 12776995 and line 1158, its values is 12810787, so 12810787 - 12776995  = 33792 pages are freed
So 250169  - 33792 = 216377 pages (216377 *4 / 1024 =  845M) are still in bootmem, I've been located it is in sparse_init.
 
4) Line 162, 196361 ( 768M )  pages of unused memory are been relesed to Xen.
 
5) Line 1169 ,  Memory is 3717504k =  3630M ,  3630 + 768 + 845 + 123 = 5366.        5630 - 5366 = 264 M (Did I miscaulated? )
   
Questions
 
1) Normally, sparse_init will only reserver about 173M in previous kernel, and in .36 is it meant to reserve so much?
2) where is 264M memory I last caculated, did I make mistake?
 
Many thanks. 
 
 
 
 
 
 
 
 
============================code to log========mm/bootmem.c====
 
253 static void __init __free(bootmem_data_t *bdata,
254 <+++<+++<+++unsigned long sidx, unsigned long eidx)
255 {
256 <+++unsigned long idx;
257     static int count;
258     static int tot_free_pages;
259 
260     tot_free_pages += (eidx - sidx);
261 
262 <+++bdebug("count %d nid=%td start=%lx end=%lx pages %d tot_free_pages %d\n", ++count, bdata - bootmem_node_data,
263 <+++<+++sidx + bdata->node_min_pfn,
264 <+++<+++eidx + bdata->node_min_pfn,
265         eidx - sidx,
266         tot_free_pages
267         );
268 
 
277 static int __init __reserve(bootmem_data_t *bdata, unsigned long sidx,
278  unsigned long eidx, int flags)
279 {
280     unsigned long idx;
281     int exclusive = flags & BOOTMEM_EXCLUSIVE;
282     static int count;
283     static int tot_res_pages;
284 
285     tot_res_pages += (eidx - sidx);
286 <+++bdebug("count %d nid=%td start=%lx end=%lx flags=%x pages=%d, tot_res_pages %d\n",                                                                   
287         ++count,
288 <+++<+++bdata - bootmem_node_data,
289 <+++<+++sidx + bdata->node_min_pfn,
290 <+++<+++eidx + bdata->node_min_pfn,
291 <+++<+++flags,
292         eidx - sidx,
293         tot_res_pages
294         );
     
 

 
> Date: Thu, 19 May 2011 12:16:56 -0400
> From: konrad.wilk@oracle.com
> To: tinnycloud@hotmail.com
> CC: xen-devel@lists.xensource.com; jeremy@goop.org
> Subject: Re: [Xen-devel] RE:2Gb Memory lost in 2.6.32.36 - 50G memory, maxmem=50G, 2G used for pagetable, clamping (max:5G) is not helping.
> 
> > > What happens if you provide dom0_mem=max:5G to clamp on the size?
> > > 
> > 
> > Seems nothing different(what is clamp means? ^_^ )
> 
> http://en.wikipedia.org/wiki/Clamp_(tool)
> 
> .. snip..
> > Xen: 0000000100000000 - 0000000c6ff09000 (usable)
> > DMI present.
> > AMI BIOS detected: BIOS may corrupt low RAM, working around it.
> > last_pfn = 0xc6ff09 max_arch_pfn = 0x400000000
> .. snip..
> > xen_commandline : msi=1 iommu=off x2apic=off console=com1,vga com1=115200,8n1 noreboot dom0_mem=max:5G dom0_max_vcpus=4 dom0_vcpus_pin cpuidle=0 cpufreq=none xsave=0
> 
> OK, I would have expected your last entry in the E820 to be truncated
> to 15fe00000, but it is not with the max:5G parameter. Looks like
> you found a bug - but I am not sure if it is the Xen hypervisor or
> the E820 parsing code in Linux. Fortunatly for you, I just got my hands on 32G
> machine so I can work on this. Can you remind me in a week if I you do
> not see any patches from me?
 		 	   		  

[-- Attachment #1.2: Type: text/html, Size: 10563 bytes --]

[-- Attachment #2: Type: text/plain, Size: 138 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: RE:2Gb Memory lost in 2.6.32.36 - 50G memory, maxmem=50G, 2G used for pagetable, clamping (max:5G) is not helping.
  2011-05-31  8:33                 ` MaoXiaoyun
@ 2011-05-31 14:44                   ` Konrad Rzeszutek Wilk
  0 siblings, 0 replies; 12+ messages in thread
From: Konrad Rzeszutek Wilk @ 2011-05-31 14:44 UTC (permalink / raw)
  To: MaoXiaoyun; +Cc: jeremy, xen devel

On Tue, May 31, 2011 at 04:33:52PM +0800, MaoXiaoyun wrote:
> 
> Hi Konrad;
>  
>       I realized that in 32.36 kernel dom0 can balloon up to use whole memory address, in my case it is 48G. But it consumes 845M memory 
> for sparse memory to manage them, Well, my dom0 doesn't need so big flexable,  and I learnt that use "mem=" option in grub can limit 
> dom0 memory, I think it works for me now.  

HA! That does it too.
>  
> Any comments?

>  
> title Red Hat Enterprise Linux Server (2.6.32.36xen)
>         root (hd0,0)
>         kernel /xen-4.0.1.gz  iommu=off x2apic=off console=com1,vga com1=115200,8n1 noreboot dom0_mem=6144M dom0_max_vcpus=4 dom0_vcpus_pin cpuidle=0 cpufreq=none 
>         module /vmlinuz-2.6.32.36xen ro root=LABEL=/ hda=noprobe console=hvc0 mem=8192M
>         module /initrd-2.6.32.36xen.img

That is a good work-around. Still need to fix the bug in the E820 setup code to take
dom0_mem=max: parameter under advisment.

^ permalink raw reply	[flat|nested] 12+ messages in thread

end of thread, other threads:[~2011-05-31 14:44 UTC | newest]

Thread overview: 12+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
     [not found] <SNT0-MC4-F34MpzkUY6002755b8@snt0-mc4-f34.Snt0.hotmail.com>
2011-05-18 14:58 ` Memory missing in 2.6.32.36 MaoXiaoyun
2011-05-19  3:58   ` MaoXiaoyun
2011-05-19  5:30     ` MaoXiaoyun
2011-05-19 13:17       ` RE:2Gb Memory lost " MaoXiaoyun
2011-05-19 14:42         ` RE:2Gb Memory lost in 2.6.32.36 - 50G memory, maxmem=50G, 2G used for pagetable Konrad Rzeszutek Wilk
2011-05-19 15:31           ` MaoXiaoyun
2011-05-19 16:16             ` RE:2Gb Memory lost in 2.6.32.36 - 50G memory, maxmem=50G, 2G used for pagetable, clamping (max:5G) is not helping Konrad Rzeszutek Wilk
2011-05-25  9:08               ` MaoXiaoyun
2011-05-31  8:33                 ` MaoXiaoyun
2011-05-31 14:44                   ` Konrad Rzeszutek Wilk
2011-05-19 14:44         ` 2Gb Memory lost in 2.6.32.36 Konrad Rzeszutek Wilk
2011-05-19 15:32           ` MaoXiaoyun

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).