From: Richard Davies <richard.davies@elastichosts.com>
To: Avi Kivity <avi@redhat.com>
Cc: qemu-devel@nongnu.org, kvm@vger.kernel.org,
Rik van Riel <riel@redhat.com>
Subject: Re: Windows slow boot: contractor wanted
Date: Wed, 22 Aug 2012 16:26:41 +0100 [thread overview]
Message-ID: <20120822152641.GA13770@alpha.arachsys.com> (raw)
In-Reply-To: <5034F24D.1090105@redhat.com>
Avi Kivity wrote:
> Richard Davies wrote:
> > Avi Kivity wrote:
> > > Richard Davies wrote:
> > > > I can trigger the slow boots without KSM and they have the same
> > > > profile, with _raw_spin_lock_irqsave and isolate_freepages_block at
> > > > the top.
> > > >
> > > > I reduced to 3x 20GB 8-core VMs on a 128GB host (rather than 3x 40GB
> > > > 8-core VMs), and haven't managed to get a really slow boot yet (>5
> > > > minutes). I'll post agan when I get one.
> > >
> > > I think you can go higher than that. But 120GB on a 128GB host is
> > > pushing it.
> >
> > I've now triggered a very slow boot at 3x 36GB 8-core VMs on a 128GB
> > host (i.e. 108GB on a 128GB host).
> >
> > It has the same profile with _raw_spin_lock_irqsave and
> > isolate_freepages_block at the top.
>
> Then it's still memory starved.
>
> Please provide /proc/zoneinfo while this is happening.
Here are two copies at /proc/zoneinfo a minute or so apart during a
situation where there are 3x 36GB 8-core VMs on a 128GB host, with two of
the three VMs slow booting.
Node 0, zone DMA
pages free 3968
min 3
low 3
high 4
scanned 0
spanned 4080
present 3904
nr_free_pages 3968
nr_inactive_anon 0
nr_active_anon 0
nr_inactive_file 0
nr_active_file 0
nr_unevictable 0
nr_mlock 0
nr_anon_pages 0
nr_mapped 0
nr_file_pages 0
nr_dirty 0
nr_writeback 0
nr_slab_reclaimable 0
nr_slab_unreclaimable 0
nr_page_table_pages 0
nr_kernel_stack 0
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 0
nr_dirtied 0
nr_written 0
numa_hit 0
numa_miss 0
numa_foreign 0
numa_interleave 0
numa_local 0
numa_other 0
nr_anon_transparent_hugepages 0
protection: (0, 3502, 32230, 32230)
pagesets
cpu: 0
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 1
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 2
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 3
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 4
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 5
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 6
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 7
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 8
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 9
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 10
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 11
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 12
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 13
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 14
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 15
count: 0
high: 0
batch: 1
vm stats threshold: 10
all_unreclaimable: 1
start_pfn: 16
inactive_ratio: 1
Node 0, zone DMA32
pages free 29798
min 917
low 1146
high 1375
scanned 0
spanned 1044480
present 896720
nr_free_pages 29798
nr_inactive_anon 0
nr_active_anon 817152
nr_inactive_file 29243
nr_active_file 574
nr_unevictable 0
nr_mlock 0
nr_anon_pages 0
nr_mapped 1
nr_file_pages 29817
nr_dirty 0
nr_writeback 0
nr_slab_reclaimable 26
nr_slab_unreclaimable 2
nr_page_table_pages 244
nr_kernel_stack 0
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 0
nr_dirtied 30546
nr_written 30546
numa_hit 42617
numa_miss 124755
numa_foreign 0
numa_interleave 0
numa_local 42023
numa_other 125349
nr_anon_transparent_hugepages 1596
protection: (0, 0, 28728, 28728)
pagesets
cpu: 0
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 1
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 2
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 3
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 4
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 5
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 6
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 8
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 9
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 10
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 12
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 13
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 14
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 15
count: 0
high: 186
batch: 31
vm stats threshold: 60
all_unreclaimable: 0
start_pfn: 4096
inactive_ratio: 5
Node 0, zone Normal
pages free 292707
min 7524
low 9405
high 11286
scanned 0
spanned 7471104
present 7354368
nr_free_pages 292707
nr_inactive_anon 281
nr_active_anon 3024092
nr_inactive_file 1824853
nr_active_file 2050217
nr_unevictable 22
nr_mlock 22
nr_anon_pages 5103
nr_mapped 570
nr_file_pages 3875107
nr_dirty 1
nr_writeback 0
nr_slab_reclaimable 99328
nr_slab_unreclaimable 2701
nr_page_table_pages 8153
nr_kernel_stack 127
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 8
nr_dirtied 4910752
nr_written 4910735
numa_hit 11010852
numa_miss 973848
numa_foreign 6137099
numa_interleave 14102
numa_local 11003048
numa_other 981652
nr_anon_transparent_hugepages 5898
protection: (0, 0, 0, 0)
pagesets
cpu: 0
count: 29
high: 186
batch: 31
vm stats threshold: 90
cpu: 1
count: 2
high: 186
batch: 31
vm stats threshold: 90
cpu: 2
count: 46
high: 186
batch: 31
vm stats threshold: 90
cpu: 3
count: 26
high: 186
batch: 31
vm stats threshold: 90
cpu: 4
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 5
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 6
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 8
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 9
count: 18
high: 186
batch: 31
vm stats threshold: 90
cpu: 10
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 12
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 13
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 14
count: 1
high: 186
batch: 31
vm stats threshold: 90
cpu: 15
count: 0
high: 186
batch: 31
vm stats threshold: 90
all_unreclaimable: 0
start_pfn: 1048576
inactive_ratio: 16
Node 1, zone Normal
pages free 23288
min 8448
low 10560
high 12672
scanned 0
spanned 8388608
present 8257536
nr_free_pages 23288
nr_inactive_anon 361430
nr_active_anon 5925377
nr_inactive_file 1779378
nr_active_file 76158
nr_unevictable 444
nr_mlock 444
nr_anon_pages 603
nr_mapped 990
nr_file_pages 1855911
nr_dirty 3
nr_writeback 0
nr_slab_reclaimable 60961
nr_slab_unreclaimable 1404
nr_page_table_pages 10197
nr_kernel_stack 22
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 97
nr_shmem 5
nr_dirtied 5000958
nr_written 5000955
numa_hit 4879358
numa_miss 4315336
numa_foreign 1710349
numa_interleave 14052
numa_local 4860081
numa_other 4334613
nr_anon_transparent_hugepages 12277
protection: (0, 0, 0, 0)
pagesets
cpu: 0
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 1
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 2
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 3
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 4
count: 30
high: 186
batch: 31
vm stats threshold: 90
cpu: 5
count: 88
high: 186
batch: 31
vm stats threshold: 90
cpu: 6
count: 176
high: 186
batch: 31
vm stats threshold: 90
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 8
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 9
count: 179
high: 186
batch: 31
vm stats threshold: 90
cpu: 10
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 12
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 13
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 14
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 15
count: 0
high: 186
batch: 31
vm stats threshold: 90
all_unreclaimable: 0
start_pfn: 8519680
inactive_ratio: 17
Node 2, zone Normal
pages free 11632
min 8448
low 10560
high 12672
scanned 3
spanned 8388608
present 8257536
nr_free_pages 11632
nr_inactive_anon 368719
nr_active_anon 6009871
nr_inactive_file 1721022
nr_active_file 47969
nr_unevictable 74
nr_mlock 74
nr_anon_pages 6741
nr_mapped 1678
nr_file_pages 1769100
nr_dirty 3
nr_writeback 0
nr_slab_reclaimable 31690
nr_slab_unreclaimable 1547
nr_page_table_pages 13178
nr_kernel_stack 52
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 5
nr_dirtied 3264512
nr_written 3264506
numa_hit 3701723
numa_miss 3141775
numa_foreign 768925
numa_interleave 14093
numa_local 3685078
numa_other 3158420
nr_anon_transparent_hugepages 12446
protection: (0, 0, 0, 0)
pagesets
cpu: 0
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 1
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 2
count: 2
high: 186
batch: 31
vm stats threshold: 90
cpu: 3
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 4
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 5
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 6
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 8
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 9
count: 172
high: 186
batch: 31
vm stats threshold: 90
cpu: 10
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 12
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 13
count: 30
high: 186
batch: 31
vm stats threshold: 90
cpu: 14
count: 47
high: 186
batch: 31
vm stats threshold: 90
cpu: 15
count: 30
high: 186
batch: 31
vm stats threshold: 90
all_unreclaimable: 0
start_pfn: 16908288
inactive_ratio: 17
Node 3, zone Normal
pages free 42611
min 8448
low 10560
high 12672
scanned 0
spanned 8388608
present 8257536
nr_free_pages 42611
nr_inactive_anon 273
nr_active_anon 5728983
nr_inactive_file 1787163
nr_active_file 638839
nr_unevictable 79
nr_mlock 79
nr_anon_pages 2091
nr_mapped 670
nr_file_pages 2426028
nr_dirty 0
nr_writeback 0
nr_slab_reclaimable 27949
nr_slab_unreclaimable 1417
nr_page_table_pages 12372
nr_kernel_stack 28
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 1
nr_dirtied 2734460
nr_written 2734448
numa_hit 5026640
numa_miss 1501721
numa_foreign 1441062
numa_interleave 14050
numa_local 5005951
numa_other 1522410
nr_anon_transparent_hugepages 11186
protection: (0, 0, 0, 0)
pagesets
cpu: 0
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 1
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 2
count: 14
high: 186
batch: 31
vm stats threshold: 90
cpu: 3
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 4
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 5
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 6
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 8
count: 31
high: 186
batch: 31
vm stats threshold: 90
cpu: 9
count: 38
high: 186
batch: 31
vm stats threshold: 90
cpu: 10
count: 30
high: 186
batch: 31
vm stats threshold: 90
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 12
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 13
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 14
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 15
count: 0
high: 186
batch: 31
vm stats threshold: 90
all_unreclaimable: 0
start_pfn: 25296896
inactive_ratio: 17
==========================================================================
Node 0, zone DMA
pages free 3968
min 3
low 3
high 4
scanned 0
spanned 4080
present 3904
nr_free_pages 3968
nr_inactive_anon 0
nr_active_anon 0
nr_inactive_file 0
nr_active_file 0
nr_unevictable 0
nr_mlock 0
nr_anon_pages 0
nr_mapped 0
nr_file_pages 0
nr_dirty 0
nr_writeback 0
nr_slab_reclaimable 0
nr_slab_unreclaimable 0
nr_page_table_pages 0
nr_kernel_stack 0
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 0
nr_dirtied 0
nr_written 0
numa_hit 0
numa_miss 0
numa_foreign 0
numa_interleave 0
numa_local 0
numa_other 0
nr_anon_transparent_hugepages 0
protection: (0, 3502, 32230, 32230)
pagesets
cpu: 0
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 1
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 2
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 3
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 4
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 5
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 6
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 7
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 8
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 9
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 10
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 11
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 12
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 13
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 14
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 15
count: 0
high: 0
batch: 1
vm stats threshold: 10
all_unreclaimable: 1
start_pfn: 16
inactive_ratio: 1
Node 0, zone DMA32
pages free 29798
min 917
low 1146
high 1375
scanned 0
spanned 1044480
present 896720
nr_free_pages 29798
nr_inactive_anon 0
nr_active_anon 817152
nr_inactive_file 29243
nr_active_file 574
nr_unevictable 0
nr_mlock 0
nr_anon_pages 0
nr_mapped 1
nr_file_pages 29817
nr_dirty 0
nr_writeback 0
nr_slab_reclaimable 26
nr_slab_unreclaimable 2
nr_page_table_pages 244
nr_kernel_stack 0
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 0
nr_dirtied 30546
nr_written 30546
numa_hit 42617
numa_miss 124755
numa_foreign 0
numa_interleave 0
numa_local 42023
numa_other 125349
nr_anon_transparent_hugepages 1596
protection: (0, 0, 28728, 28728)
pagesets
cpu: 0
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 1
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 2
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 3
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 4
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 5
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 6
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 8
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 9
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 10
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 12
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 13
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 14
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 15
count: 0
high: 186
batch: 31
vm stats threshold: 60
all_unreclaimable: 0
start_pfn: 4096
inactive_ratio: 5
Node 0, zone Normal
pages free 140658
min 7524
low 9405
high 11286
scanned 0
spanned 7471104
present 7354368
nr_free_pages 140658
nr_inactive_anon 281
nr_active_anon 3178381
nr_inactive_file 1824810
nr_active_file 2050331
nr_unevictable 22
nr_mlock 22
nr_anon_pages 5790
nr_mapped 570
nr_file_pages 3875179
nr_dirty 1
nr_writeback 0
nr_slab_reclaimable 97265
nr_slab_unreclaimable 2756
nr_page_table_pages 8369
nr_kernel_stack 127
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 5
nr_shmem 8
nr_dirtied 4911092
nr_written 4911074
numa_hit 11018781
numa_miss 975761
numa_foreign 6137358
numa_interleave 14102
numa_local 11009945
numa_other 984597
nr_anon_transparent_hugepages 6197
protection: (0, 0, 0, 0)
pagesets
cpu: 0
count: 31
high: 186
batch: 31
vm stats threshold: 90
cpu: 1
count: 30
high: 186
batch: 31
vm stats threshold: 90
cpu: 2
count: 48
high: 186
batch: 31
vm stats threshold: 90
cpu: 3
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 4
count: 1
high: 186
batch: 31
vm stats threshold: 90
cpu: 5
count: 17
high: 186
batch: 31
vm stats threshold: 90
cpu: 6
count: 3
high: 186
batch: 31
vm stats threshold: 90
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 8
count: 1
high: 186
batch: 31
vm stats threshold: 90
cpu: 9
count: 1
high: 186
batch: 31
vm stats threshold: 90
cpu: 10
count: 11
high: 186
batch: 31
vm stats threshold: 90
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 12
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 13
count: 30
high: 186
batch: 31
vm stats threshold: 90
cpu: 14
count: 1
high: 186
batch: 31
vm stats threshold: 90
cpu: 15
count: 0
high: 186
batch: 31
vm stats threshold: 90
all_unreclaimable: 0
start_pfn: 1048576
inactive_ratio: 16
Node 1, zone Normal
pages free 25982
min 8448
low 10560
high 12672
scanned 0
spanned 8388608
present 8257536
nr_free_pages 25982
nr_inactive_anon 361430
nr_active_anon 5948303
nr_inactive_file 1757767
nr_active_file 76240
nr_unevictable 444
nr_mlock 444
nr_anon_pages 1001
nr_mapped 990
nr_file_pages 1834319
nr_dirty 2
nr_writeback 0
nr_slab_reclaimable 56778
nr_slab_unreclaimable 1404
nr_page_table_pages 10464
nr_kernel_stack 22
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 5
nr_dirtied 5001855
nr_written 5001853
numa_hit 4882365
numa_miss 4315400
numa_foreign 1711246
numa_interleave 14052
numa_local 4861540
numa_other 4336225
nr_anon_transparent_hugepages 12322
protection: (0, 0, 0, 0)
pagesets
cpu: 0
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 1
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 2
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 3
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 4
count: 29
high: 186
batch: 31
vm stats threshold: 90
cpu: 5
count: 74
high: 186
batch: 31
vm stats threshold: 90
cpu: 6
count: 120
high: 186
batch: 31
vm stats threshold: 90
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 8
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 9
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 10
count: 27
high: 186
batch: 31
vm stats threshold: 90
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 12
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 13
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 14
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 15
count: 0
high: 186
batch: 31
vm stats threshold: 90
all_unreclaimable: 0
start_pfn: 8519680
inactive_ratio: 17
Node 2, zone Normal
pages free 8514
min 8448
low 10560
high 12672
scanned 0
spanned 8388608
present 8257536
nr_free_pages 8514
nr_inactive_anon 385103
nr_active_anon 6307975
nr_inactive_file 1409493
nr_active_file 48031
nr_unevictable 74
nr_mlock 74
nr_anon_pages 6866
nr_mapped 1678
nr_file_pages 1457589
nr_dirty 3
nr_writeback 0
nr_slab_reclaimable 31690
nr_slab_unreclaimable 1537
nr_page_table_pages 13296
nr_kernel_stack 52
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 5
nr_dirtied 3264794
nr_written 3264788
numa_hit 3704905
numa_miss 3143298
numa_foreign 774847
numa_interleave 14093
numa_local 3688103
numa_other 3160100
nr_anon_transparent_hugepages 13051
protection: (0, 0, 0, 0)
pagesets
cpu: 0
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 1
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 2
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 3
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 4
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 5
count: 175
high: 186
batch: 31
vm stats threshold: 90
cpu: 6
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 8
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 9
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 10
count: 170
high: 186
batch: 31
vm stats threshold: 90
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 12
count: 8
high: 186
batch: 31
vm stats threshold: 90
cpu: 13
count: 30
high: 186
batch: 31
vm stats threshold: 90
cpu: 14
count: 4
high: 186
batch: 31
vm stats threshold: 90
cpu: 15
count: 0
high: 186
batch: 31
vm stats threshold: 90
all_unreclaimable: 0
start_pfn: 16908288
inactive_ratio: 17
Node 3, zone Normal
pages free 42068
min 8448
low 10560
high 12672
scanned 0
spanned 8388608
present 8257536
nr_free_pages 42068
nr_inactive_anon 273
nr_active_anon 5729807
nr_inactive_file 1787193
nr_active_file 638901
nr_unevictable 79
nr_mlock 79
nr_anon_pages 2930
nr_mapped 670
nr_file_pages 2426099
nr_dirty 1
nr_writeback 0
nr_slab_reclaimable 27153
nr_slab_unreclaimable 1453
nr_page_table_pages 12710
nr_kernel_stack 27
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 1
nr_dirtied 2734473
nr_written 2734460
numa_hit 5030446
numa_miss 1506319
numa_foreign 1442082
numa_interleave 14050
numa_local 5008209
numa_other 1528556
nr_anon_transparent_hugepages 11186
protection: (0, 0, 0, 0)
pagesets
cpu: 0
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 1
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 2
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 3
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 4
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 5
count: 9
high: 186
batch: 31
vm stats threshold: 90
cpu: 6
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 8
count: 29
high: 186
batch: 31
vm stats threshold: 90
cpu: 9
count: 31
high: 186
batch: 31
vm stats threshold: 90
cpu: 10
count: 33
high: 186
batch: 31
vm stats threshold: 90
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 12
count: 31
high: 186
batch: 31
vm stats threshold: 90
cpu: 13
count: 25
high: 186
batch: 31
vm stats threshold: 90
cpu: 14
count: 50
high: 186
batch: 31
vm stats threshold: 90
cpu: 15
count: 0
high: 186
batch: 31
vm stats threshold: 90
all_unreclaimable: 0
start_pfn: 25296896
inactive_ratio: 17
WARNING: multiple messages have this Message-ID (diff)
From: Richard Davies <richard.davies@elastichosts.com>
To: Avi Kivity <avi@redhat.com>
Cc: qemu-devel@nongnu.org, kvm@vger.kernel.org
Subject: Re: [Qemu-devel] Windows slow boot: contractor wanted
Date: Wed, 22 Aug 2012 16:26:41 +0100 [thread overview]
Message-ID: <20120822152641.GA13770@alpha.arachsys.com> (raw)
In-Reply-To: <5034F24D.1090105@redhat.com>
Avi Kivity wrote:
> Richard Davies wrote:
> > Avi Kivity wrote:
> > > Richard Davies wrote:
> > > > I can trigger the slow boots without KSM and they have the same
> > > > profile, with _raw_spin_lock_irqsave and isolate_freepages_block at
> > > > the top.
> > > >
> > > > I reduced to 3x 20GB 8-core VMs on a 128GB host (rather than 3x 40GB
> > > > 8-core VMs), and haven't managed to get a really slow boot yet (>5
> > > > minutes). I'll post agan when I get one.
> > >
> > > I think you can go higher than that. But 120GB on a 128GB host is
> > > pushing it.
> >
> > I've now triggered a very slow boot at 3x 36GB 8-core VMs on a 128GB
> > host (i.e. 108GB on a 128GB host).
> >
> > It has the same profile with _raw_spin_lock_irqsave and
> > isolate_freepages_block at the top.
>
> Then it's still memory starved.
>
> Please provide /proc/zoneinfo while this is happening.
Here are two copies at /proc/zoneinfo a minute or so apart during a
situation where there are 3x 36GB 8-core VMs on a 128GB host, with two of
the three VMs slow booting.
Node 0, zone DMA
pages free 3968
min 3
low 3
high 4
scanned 0
spanned 4080
present 3904
nr_free_pages 3968
nr_inactive_anon 0
nr_active_anon 0
nr_inactive_file 0
nr_active_file 0
nr_unevictable 0
nr_mlock 0
nr_anon_pages 0
nr_mapped 0
nr_file_pages 0
nr_dirty 0
nr_writeback 0
nr_slab_reclaimable 0
nr_slab_unreclaimable 0
nr_page_table_pages 0
nr_kernel_stack 0
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 0
nr_dirtied 0
nr_written 0
numa_hit 0
numa_miss 0
numa_foreign 0
numa_interleave 0
numa_local 0
numa_other 0
nr_anon_transparent_hugepages 0
protection: (0, 3502, 32230, 32230)
pagesets
cpu: 0
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 1
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 2
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 3
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 4
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 5
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 6
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 7
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 8
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 9
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 10
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 11
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 12
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 13
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 14
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 15
count: 0
high: 0
batch: 1
vm stats threshold: 10
all_unreclaimable: 1
start_pfn: 16
inactive_ratio: 1
Node 0, zone DMA32
pages free 29798
min 917
low 1146
high 1375
scanned 0
spanned 1044480
present 896720
nr_free_pages 29798
nr_inactive_anon 0
nr_active_anon 817152
nr_inactive_file 29243
nr_active_file 574
nr_unevictable 0
nr_mlock 0
nr_anon_pages 0
nr_mapped 1
nr_file_pages 29817
nr_dirty 0
nr_writeback 0
nr_slab_reclaimable 26
nr_slab_unreclaimable 2
nr_page_table_pages 244
nr_kernel_stack 0
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 0
nr_dirtied 30546
nr_written 30546
numa_hit 42617
numa_miss 124755
numa_foreign 0
numa_interleave 0
numa_local 42023
numa_other 125349
nr_anon_transparent_hugepages 1596
protection: (0, 0, 28728, 28728)
pagesets
cpu: 0
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 1
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 2
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 3
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 4
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 5
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 6
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 8
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 9
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 10
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 12
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 13
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 14
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 15
count: 0
high: 186
batch: 31
vm stats threshold: 60
all_unreclaimable: 0
start_pfn: 4096
inactive_ratio: 5
Node 0, zone Normal
pages free 292707
min 7524
low 9405
high 11286
scanned 0
spanned 7471104
present 7354368
nr_free_pages 292707
nr_inactive_anon 281
nr_active_anon 3024092
nr_inactive_file 1824853
nr_active_file 2050217
nr_unevictable 22
nr_mlock 22
nr_anon_pages 5103
nr_mapped 570
nr_file_pages 3875107
nr_dirty 1
nr_writeback 0
nr_slab_reclaimable 99328
nr_slab_unreclaimable 2701
nr_page_table_pages 8153
nr_kernel_stack 127
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 8
nr_dirtied 4910752
nr_written 4910735
numa_hit 11010852
numa_miss 973848
numa_foreign 6137099
numa_interleave 14102
numa_local 11003048
numa_other 981652
nr_anon_transparent_hugepages 5898
protection: (0, 0, 0, 0)
pagesets
cpu: 0
count: 29
high: 186
batch: 31
vm stats threshold: 90
cpu: 1
count: 2
high: 186
batch: 31
vm stats threshold: 90
cpu: 2
count: 46
high: 186
batch: 31
vm stats threshold: 90
cpu: 3
count: 26
high: 186
batch: 31
vm stats threshold: 90
cpu: 4
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 5
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 6
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 8
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 9
count: 18
high: 186
batch: 31
vm stats threshold: 90
cpu: 10
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 12
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 13
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 14
count: 1
high: 186
batch: 31
vm stats threshold: 90
cpu: 15
count: 0
high: 186
batch: 31
vm stats threshold: 90
all_unreclaimable: 0
start_pfn: 1048576
inactive_ratio: 16
Node 1, zone Normal
pages free 23288
min 8448
low 10560
high 12672
scanned 0
spanned 8388608
present 8257536
nr_free_pages 23288
nr_inactive_anon 361430
nr_active_anon 5925377
nr_inactive_file 1779378
nr_active_file 76158
nr_unevictable 444
nr_mlock 444
nr_anon_pages 603
nr_mapped 990
nr_file_pages 1855911
nr_dirty 3
nr_writeback 0
nr_slab_reclaimable 60961
nr_slab_unreclaimable 1404
nr_page_table_pages 10197
nr_kernel_stack 22
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 97
nr_shmem 5
nr_dirtied 5000958
nr_written 5000955
numa_hit 4879358
numa_miss 4315336
numa_foreign 1710349
numa_interleave 14052
numa_local 4860081
numa_other 4334613
nr_anon_transparent_hugepages 12277
protection: (0, 0, 0, 0)
pagesets
cpu: 0
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 1
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 2
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 3
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 4
count: 30
high: 186
batch: 31
vm stats threshold: 90
cpu: 5
count: 88
high: 186
batch: 31
vm stats threshold: 90
cpu: 6
count: 176
high: 186
batch: 31
vm stats threshold: 90
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 8
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 9
count: 179
high: 186
batch: 31
vm stats threshold: 90
cpu: 10
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 12
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 13
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 14
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 15
count: 0
high: 186
batch: 31
vm stats threshold: 90
all_unreclaimable: 0
start_pfn: 8519680
inactive_ratio: 17
Node 2, zone Normal
pages free 11632
min 8448
low 10560
high 12672
scanned 3
spanned 8388608
present 8257536
nr_free_pages 11632
nr_inactive_anon 368719
nr_active_anon 6009871
nr_inactive_file 1721022
nr_active_file 47969
nr_unevictable 74
nr_mlock 74
nr_anon_pages 6741
nr_mapped 1678
nr_file_pages 1769100
nr_dirty 3
nr_writeback 0
nr_slab_reclaimable 31690
nr_slab_unreclaimable 1547
nr_page_table_pages 13178
nr_kernel_stack 52
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 5
nr_dirtied 3264512
nr_written 3264506
numa_hit 3701723
numa_miss 3141775
numa_foreign 768925
numa_interleave 14093
numa_local 3685078
numa_other 3158420
nr_anon_transparent_hugepages 12446
protection: (0, 0, 0, 0)
pagesets
cpu: 0
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 1
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 2
count: 2
high: 186
batch: 31
vm stats threshold: 90
cpu: 3
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 4
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 5
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 6
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 8
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 9
count: 172
high: 186
batch: 31
vm stats threshold: 90
cpu: 10
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 12
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 13
count: 30
high: 186
batch: 31
vm stats threshold: 90
cpu: 14
count: 47
high: 186
batch: 31
vm stats threshold: 90
cpu: 15
count: 30
high: 186
batch: 31
vm stats threshold: 90
all_unreclaimable: 0
start_pfn: 16908288
inactive_ratio: 17
Node 3, zone Normal
pages free 42611
min 8448
low 10560
high 12672
scanned 0
spanned 8388608
present 8257536
nr_free_pages 42611
nr_inactive_anon 273
nr_active_anon 5728983
nr_inactive_file 1787163
nr_active_file 638839
nr_unevictable 79
nr_mlock 79
nr_anon_pages 2091
nr_mapped 670
nr_file_pages 2426028
nr_dirty 0
nr_writeback 0
nr_slab_reclaimable 27949
nr_slab_unreclaimable 1417
nr_page_table_pages 12372
nr_kernel_stack 28
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 1
nr_dirtied 2734460
nr_written 2734448
numa_hit 5026640
numa_miss 1501721
numa_foreign 1441062
numa_interleave 14050
numa_local 5005951
numa_other 1522410
nr_anon_transparent_hugepages 11186
protection: (0, 0, 0, 0)
pagesets
cpu: 0
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 1
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 2
count: 14
high: 186
batch: 31
vm stats threshold: 90
cpu: 3
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 4
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 5
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 6
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 8
count: 31
high: 186
batch: 31
vm stats threshold: 90
cpu: 9
count: 38
high: 186
batch: 31
vm stats threshold: 90
cpu: 10
count: 30
high: 186
batch: 31
vm stats threshold: 90
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 12
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 13
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 14
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 15
count: 0
high: 186
batch: 31
vm stats threshold: 90
all_unreclaimable: 0
start_pfn: 25296896
inactive_ratio: 17
==========================================================================
Node 0, zone DMA
pages free 3968
min 3
low 3
high 4
scanned 0
spanned 4080
present 3904
nr_free_pages 3968
nr_inactive_anon 0
nr_active_anon 0
nr_inactive_file 0
nr_active_file 0
nr_unevictable 0
nr_mlock 0
nr_anon_pages 0
nr_mapped 0
nr_file_pages 0
nr_dirty 0
nr_writeback 0
nr_slab_reclaimable 0
nr_slab_unreclaimable 0
nr_page_table_pages 0
nr_kernel_stack 0
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 0
nr_dirtied 0
nr_written 0
numa_hit 0
numa_miss 0
numa_foreign 0
numa_interleave 0
numa_local 0
numa_other 0
nr_anon_transparent_hugepages 0
protection: (0, 3502, 32230, 32230)
pagesets
cpu: 0
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 1
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 2
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 3
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 4
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 5
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 6
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 7
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 8
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 9
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 10
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 11
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 12
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 13
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 14
count: 0
high: 0
batch: 1
vm stats threshold: 10
cpu: 15
count: 0
high: 0
batch: 1
vm stats threshold: 10
all_unreclaimable: 1
start_pfn: 16
inactive_ratio: 1
Node 0, zone DMA32
pages free 29798
min 917
low 1146
high 1375
scanned 0
spanned 1044480
present 896720
nr_free_pages 29798
nr_inactive_anon 0
nr_active_anon 817152
nr_inactive_file 29243
nr_active_file 574
nr_unevictable 0
nr_mlock 0
nr_anon_pages 0
nr_mapped 1
nr_file_pages 29817
nr_dirty 0
nr_writeback 0
nr_slab_reclaimable 26
nr_slab_unreclaimable 2
nr_page_table_pages 244
nr_kernel_stack 0
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 0
nr_dirtied 30546
nr_written 30546
numa_hit 42617
numa_miss 124755
numa_foreign 0
numa_interleave 0
numa_local 42023
numa_other 125349
nr_anon_transparent_hugepages 1596
protection: (0, 0, 28728, 28728)
pagesets
cpu: 0
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 1
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 2
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 3
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 4
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 5
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 6
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 8
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 9
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 10
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 12
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 13
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 14
count: 0
high: 186
batch: 31
vm stats threshold: 60
cpu: 15
count: 0
high: 186
batch: 31
vm stats threshold: 60
all_unreclaimable: 0
start_pfn: 4096
inactive_ratio: 5
Node 0, zone Normal
pages free 140658
min 7524
low 9405
high 11286
scanned 0
spanned 7471104
present 7354368
nr_free_pages 140658
nr_inactive_anon 281
nr_active_anon 3178381
nr_inactive_file 1824810
nr_active_file 2050331
nr_unevictable 22
nr_mlock 22
nr_anon_pages 5790
nr_mapped 570
nr_file_pages 3875179
nr_dirty 1
nr_writeback 0
nr_slab_reclaimable 97265
nr_slab_unreclaimable 2756
nr_page_table_pages 8369
nr_kernel_stack 127
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 5
nr_shmem 8
nr_dirtied 4911092
nr_written 4911074
numa_hit 11018781
numa_miss 975761
numa_foreign 6137358
numa_interleave 14102
numa_local 11009945
numa_other 984597
nr_anon_transparent_hugepages 6197
protection: (0, 0, 0, 0)
pagesets
cpu: 0
count: 31
high: 186
batch: 31
vm stats threshold: 90
cpu: 1
count: 30
high: 186
batch: 31
vm stats threshold: 90
cpu: 2
count: 48
high: 186
batch: 31
vm stats threshold: 90
cpu: 3
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 4
count: 1
high: 186
batch: 31
vm stats threshold: 90
cpu: 5
count: 17
high: 186
batch: 31
vm stats threshold: 90
cpu: 6
count: 3
high: 186
batch: 31
vm stats threshold: 90
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 8
count: 1
high: 186
batch: 31
vm stats threshold: 90
cpu: 9
count: 1
high: 186
batch: 31
vm stats threshold: 90
cpu: 10
count: 11
high: 186
batch: 31
vm stats threshold: 90
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 12
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 13
count: 30
high: 186
batch: 31
vm stats threshold: 90
cpu: 14
count: 1
high: 186
batch: 31
vm stats threshold: 90
cpu: 15
count: 0
high: 186
batch: 31
vm stats threshold: 90
all_unreclaimable: 0
start_pfn: 1048576
inactive_ratio: 16
Node 1, zone Normal
pages free 25982
min 8448
low 10560
high 12672
scanned 0
spanned 8388608
present 8257536
nr_free_pages 25982
nr_inactive_anon 361430
nr_active_anon 5948303
nr_inactive_file 1757767
nr_active_file 76240
nr_unevictable 444
nr_mlock 444
nr_anon_pages 1001
nr_mapped 990
nr_file_pages 1834319
nr_dirty 2
nr_writeback 0
nr_slab_reclaimable 56778
nr_slab_unreclaimable 1404
nr_page_table_pages 10464
nr_kernel_stack 22
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 5
nr_dirtied 5001855
nr_written 5001853
numa_hit 4882365
numa_miss 4315400
numa_foreign 1711246
numa_interleave 14052
numa_local 4861540
numa_other 4336225
nr_anon_transparent_hugepages 12322
protection: (0, 0, 0, 0)
pagesets
cpu: 0
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 1
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 2
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 3
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 4
count: 29
high: 186
batch: 31
vm stats threshold: 90
cpu: 5
count: 74
high: 186
batch: 31
vm stats threshold: 90
cpu: 6
count: 120
high: 186
batch: 31
vm stats threshold: 90
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 8
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 9
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 10
count: 27
high: 186
batch: 31
vm stats threshold: 90
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 12
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 13
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 14
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 15
count: 0
high: 186
batch: 31
vm stats threshold: 90
all_unreclaimable: 0
start_pfn: 8519680
inactive_ratio: 17
Node 2, zone Normal
pages free 8514
min 8448
low 10560
high 12672
scanned 0
spanned 8388608
present 8257536
nr_free_pages 8514
nr_inactive_anon 385103
nr_active_anon 6307975
nr_inactive_file 1409493
nr_active_file 48031
nr_unevictable 74
nr_mlock 74
nr_anon_pages 6866
nr_mapped 1678
nr_file_pages 1457589
nr_dirty 3
nr_writeback 0
nr_slab_reclaimable 31690
nr_slab_unreclaimable 1537
nr_page_table_pages 13296
nr_kernel_stack 52
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 5
nr_dirtied 3264794
nr_written 3264788
numa_hit 3704905
numa_miss 3143298
numa_foreign 774847
numa_interleave 14093
numa_local 3688103
numa_other 3160100
nr_anon_transparent_hugepages 13051
protection: (0, 0, 0, 0)
pagesets
cpu: 0
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 1
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 2
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 3
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 4
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 5
count: 175
high: 186
batch: 31
vm stats threshold: 90
cpu: 6
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 8
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 9
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 10
count: 170
high: 186
batch: 31
vm stats threshold: 90
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 12
count: 8
high: 186
batch: 31
vm stats threshold: 90
cpu: 13
count: 30
high: 186
batch: 31
vm stats threshold: 90
cpu: 14
count: 4
high: 186
batch: 31
vm stats threshold: 90
cpu: 15
count: 0
high: 186
batch: 31
vm stats threshold: 90
all_unreclaimable: 0
start_pfn: 16908288
inactive_ratio: 17
Node 3, zone Normal
pages free 42068
min 8448
low 10560
high 12672
scanned 0
spanned 8388608
present 8257536
nr_free_pages 42068
nr_inactive_anon 273
nr_active_anon 5729807
nr_inactive_file 1787193
nr_active_file 638901
nr_unevictable 79
nr_mlock 79
nr_anon_pages 2930
nr_mapped 670
nr_file_pages 2426099
nr_dirty 1
nr_writeback 0
nr_slab_reclaimable 27153
nr_slab_unreclaimable 1453
nr_page_table_pages 12710
nr_kernel_stack 27
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_vmscan_immediate_reclaim 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 1
nr_dirtied 2734473
nr_written 2734460
numa_hit 5030446
numa_miss 1506319
numa_foreign 1442082
numa_interleave 14050
numa_local 5008209
numa_other 1528556
nr_anon_transparent_hugepages 11186
protection: (0, 0, 0, 0)
pagesets
cpu: 0
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 1
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 2
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 3
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 4
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 5
count: 9
high: 186
batch: 31
vm stats threshold: 90
cpu: 6
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 7
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 8
count: 29
high: 186
batch: 31
vm stats threshold: 90
cpu: 9
count: 31
high: 186
batch: 31
vm stats threshold: 90
cpu: 10
count: 33
high: 186
batch: 31
vm stats threshold: 90
cpu: 11
count: 0
high: 186
batch: 31
vm stats threshold: 90
cpu: 12
count: 31
high: 186
batch: 31
vm stats threshold: 90
cpu: 13
count: 25
high: 186
batch: 31
vm stats threshold: 90
cpu: 14
count: 50
high: 186
batch: 31
vm stats threshold: 90
cpu: 15
count: 0
high: 186
batch: 31
vm stats threshold: 90
all_unreclaimable: 0
start_pfn: 25296896
inactive_ratio: 17
next prev parent reply other threads:[~2012-08-22 15:26 UTC|newest]
Thread overview: 101+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-08-16 10:47 Windows slow boot: contractor wanted Richard Davies
2012-08-16 10:47 ` [Qemu-devel] " Richard Davies
2012-08-16 11:39 ` Avi Kivity
2012-08-16 11:39 ` [Qemu-devel] " Avi Kivity
2012-08-17 12:36 ` Richard Davies
2012-08-17 12:36 ` [Qemu-devel] " Richard Davies
2012-08-17 13:02 ` Robert Vineyard
2012-08-17 13:02 ` [Qemu-devel] " Robert Vineyard
2012-08-18 14:44 ` Richard Davies
2012-08-18 14:44 ` [Qemu-devel] " Richard Davies
2012-08-19 5:02 ` Brian Jackson
2012-08-19 5:02 ` [Qemu-devel] " Brian Jackson
2012-08-20 8:16 ` Richard Davies
2012-08-20 8:16 ` [Qemu-devel] " Richard Davies
2012-08-19 8:40 ` Avi Kivity
2012-08-19 8:40 ` [Qemu-devel] " Avi Kivity
2012-08-19 8:51 ` Richard Davies
2012-08-19 8:51 ` [Qemu-devel] " Richard Davies
2012-08-19 14:04 ` Avi Kivity
2012-08-19 14:04 ` [Qemu-devel] " Avi Kivity
2012-08-20 13:56 ` Richard Davies
2012-08-20 13:56 ` [Qemu-devel] " Richard Davies
2012-08-21 9:00 ` Avi Kivity
2012-08-21 9:00 ` [Qemu-devel] " Avi Kivity
2012-08-21 15:21 ` Richard Davies
2012-08-21 15:21 ` [Qemu-devel] " Richard Davies
2012-08-21 15:39 ` Troy Benjegerdes
2012-08-21 15:39 ` Troy Benjegerdes
2012-08-22 9:08 ` Avi Kivity
2012-08-22 9:08 ` [Qemu-devel] " Avi Kivity
2012-08-22 12:40 ` Richard Davies
2012-08-22 12:40 ` [Qemu-devel] " Richard Davies
2012-08-22 12:44 ` Avi Kivity
2012-08-22 12:44 ` [Qemu-devel] " Avi Kivity
2012-08-22 14:41 ` Richard Davies
2012-08-22 14:41 ` [Qemu-devel] " Richard Davies
2012-08-22 14:53 ` Avi Kivity
2012-08-22 14:53 ` [Qemu-devel] " Avi Kivity
2012-08-22 15:26 ` Richard Davies [this message]
2012-08-22 15:26 ` Richard Davies
2012-08-22 17:22 ` Troy Benjegerdes
2012-08-22 17:22 ` Troy Benjegerdes
2012-08-25 17:51 ` Richard Davies
2012-08-25 17:51 ` Richard Davies
2012-08-22 15:21 ` Rik van Riel
2012-08-22 15:21 ` [Qemu-devel] " Rik van Riel
2012-08-22 15:34 ` Richard Davies
2012-08-22 15:34 ` [Qemu-devel] " Richard Davies
2012-08-25 17:45 ` Richard Davies
2012-08-25 17:45 ` [Qemu-devel] " Richard Davies
2012-08-25 18:11 ` Rik van Riel
2012-08-25 18:11 ` [Qemu-devel] " Rik van Riel
2012-08-26 10:58 ` Richard Davies
2012-08-26 10:58 ` [Qemu-devel] " Richard Davies
2012-09-06 9:20 ` Richard Davies
2012-09-06 9:20 ` [Qemu-devel] " Richard Davies
2012-09-12 10:56 ` Windows VM slow boot Richard Davies
2012-09-12 10:56 ` [Qemu-devel] " Richard Davies
2012-09-12 10:56 ` Richard Davies
2012-09-12 12:25 ` Mel Gorman
2012-09-12 12:25 ` [Qemu-devel] " Mel Gorman
2012-09-12 12:25 ` Mel Gorman
2012-09-12 16:46 ` Richard Davies
2012-09-12 16:46 ` [Qemu-devel] " Richard Davies
2012-09-12 16:46 ` Richard Davies
2012-09-13 9:50 ` Mel Gorman
2012-09-13 9:50 ` [Qemu-devel] " Mel Gorman
2012-09-13 9:50 ` Mel Gorman
2012-09-13 19:47 ` [PATCH 1/2] Revert "mm: have order > 0 compaction start near a pageblock with free pages" Rik van Riel
2012-09-13 19:47 ` [Qemu-devel] " Rik van Riel
2012-09-13 19:47 ` Rik van Riel
2012-09-13 19:48 ` [PATCH 2/2] make the compaction "skip ahead" logic robust Rik van Riel
2012-09-13 19:48 ` [Qemu-devel] " Rik van Riel
2012-09-13 19:48 ` Rik van Riel
2012-09-13 19:54 ` [PATCH -v2 " Rik van Riel
2012-09-13 19:54 ` [Qemu-devel] " Rik van Riel
2012-09-13 19:54 ` Rik van Riel
2012-09-15 15:55 ` Richard Davies
2012-09-15 15:55 ` [Qemu-devel] " Richard Davies
2012-09-15 15:55 ` Richard Davies
2012-09-16 19:12 ` Richard Davies
2012-09-16 19:12 ` [Qemu-devel] " Richard Davies
2012-09-17 12:26 ` Mel Gorman
2012-09-17 12:26 ` [Qemu-devel] " Mel Gorman
2012-09-18 8:14 ` Richard Davies
2012-09-18 8:14 ` [Qemu-devel] " Richard Davies
2012-09-18 11:21 ` Mel Gorman
2012-09-18 11:21 ` [Qemu-devel] " Mel Gorman
2012-09-18 11:21 ` Mel Gorman
2012-09-18 17:58 ` Richard Davies
2012-09-18 17:58 ` [Qemu-devel] " Richard Davies
2012-09-17 13:50 ` Rik van Riel
2012-09-17 13:50 ` [Qemu-devel] " Rik van Riel
2012-09-17 14:07 ` Mel Gorman
2012-09-17 14:07 ` [Qemu-devel] " Mel Gorman
2012-09-17 14:07 ` Mel Gorman
2012-08-16 14:10 ` Windows slow boot: contractor wanted Benoît Canet
2012-08-16 14:10 ` [Qemu-devel] " Benoît Canet
2012-08-16 15:53 ` Troy Benjegerdes
2012-09-18 15:12 ` Windows slow boot Michael Tokarev
2012-09-18 15:12 ` [Qemu-devel] " Michael Tokarev
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20120822152641.GA13770@alpha.arachsys.com \
--to=richard.davies@elastichosts.com \
--cc=avi@redhat.com \
--cc=kvm@vger.kernel.org \
--cc=qemu-devel@nongnu.org \
--cc=riel@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.