From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail202.messagelabs.com (mail202.messagelabs.com [216.82.254.227]) by kanga.kvack.org (Postfix) with ESMTP id 89A448D0039 for ; Mon, 31 Jan 2011 16:00:01 -0500 (EST) Received: from d03relay01.boulder.ibm.com (d03relay01.boulder.ibm.com [9.17.195.226]) by e39.co.us.ibm.com (8.14.4/8.13.1) with ESMTP id p0VKkV1q011237 for ; Mon, 31 Jan 2011 13:46:31 -0700 Received: from d03av04.boulder.ibm.com (d03av04.boulder.ibm.com [9.17.195.170]) by d03relay01.boulder.ibm.com (8.13.8/8.13.8/NCO v10.0) with ESMTP id p0VKwo8Q176822 for ; Mon, 31 Jan 2011 13:58:51 -0700 Received: from d03av04.boulder.ibm.com (loopback [127.0.0.1]) by d03av04.boulder.ibm.com (8.14.4/8.13.1/NCO v10.0 AVout) with ESMTP id p0VKwoRt012894 for ; Mon, 31 Jan 2011 13:58:50 -0700 Subject: Re: kswapd hung tasks in 2.6.38-rc1 From: Dave Hansen In-Reply-To: <1150342867.83404.1295513748640.JavaMail.root@zmail06.collab.prod.int.phx2.redhat.com> References: <1150342867.83404.1295513748640.JavaMail.root@zmail06.collab.prod.int.phx2.redhat.com> Content-Type: text/plain; charset="ANSI_X3.4-1968" Date: Mon, 31 Jan 2011 12:58:48 -0800 Message-ID: <1296507528.7797.4609.camel@nimitz> Mime-Version: 1.0 Content-Transfer-Encoding: 7bit Sender: owner-linux-mm@kvack.org To: CAI Qian Cc: linux-mm , linux-kernel@vger.kernel.org List-ID: On Thu, 2011-01-20 at 03:55 -0500, CAI Qian wrote: > When running LTP oom01 [1] testing, the allocation process stopped > processing right after starting to swap. I'm seeing the same stuff, but on -rc2. I thought it was transparent-hugepage-related, but I don't see much of a trace of it in the stack dumps. http://sr71.net/~dave/ibm/config-v2.6.38-rc2 It happened to me as well around the time that things started to hit swap. [ 723.702046] INFO: task kswapd0:706 blocked for more than 120 seconds. [ 723.708478] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 723.716289] kswapd0 D 000000010000f58a 0 706 2 0x00000000 [ 723.723358] ffff88083e183920 0000000000000046 0000000000000001 0000000000011c40 [ 723.730815] ffff88083f9af460 ffff88083f9af100 ffffffff81925020 ffffffff00000000 [ 723.738270] ffff88083fac94f0 000000103e183880 ffff88083dfa1d80 ffff88083d891308 [ 723.745727] Call Trace: [ 723.748177] [] ? mempool_alloc+0x47/0x120 [ 723.753825] [] ? cfq_may_queue+0x56/0xe0 [ 723.759388] [] io_schedule+0x44/0x60 [ 723.764603] [] get_request_wait+0xdb/0x170 [ 723.770337] [] ? autoremove_wake_function+0x0/0x40 [ 723.776764] [] ? elv_merge+0x17b/0x1d0 [ 723.782154] [] __make_request+0x6e/0x480 [ 723.787716] [] generic_make_request+0x282/0x3f0 [ 723.793885] [] ? bio_init+0x1d/0x40 [ 723.799013] [] submit_bio+0x67/0xe0 [ 723.804141] [] ? test_set_page_writeback+0xc5/0x180 [ 723.810656] [] swap_writepage+0xa0/0xc0 [ 723.816131] [] shrink_page_list+0x45c/0x800 [ 723.821954] [] shrink_inactive_list+0x11e/0x3c0 [ 723.828120] [] shrink_zone+0x291/0x4c0 [ 723.833509] [] ? zone_watermark_ok_safe+0xb6/0xd0 [ 723.839848] [] kswapd+0x605/0x8a0 [ 723.844802] [] ? kswapd+0x0/0x8a0 [ 723.849756] [] kthread+0x97/0xa0 [ 723.854628] [] kernel_thread_helper+0x4/0x10 [ 723.860533] [] ? kthread+0x0/0xa0 [ 723.865489] [] ? kernel_thread_helper+0x0/0x10 [ 723.871567] INFO: task kswapd1:707 blocked for more than 120 seconds. [ 723.877992] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 723.885800] kswapd1 D 000000010000f4ec 0 707 2 0x00000000 [ 723.892869] ffff88083e145920 0000000000000046 0000000000000001 0000000000011c40 [ 723.900324] ffff88083f9afb60 ffff88083f9af800 ffff88083f80b8c0 ffffffff0000000c [ 723.907781] ffff88083fac94f0 000000103e145880 ffff88103e94c3c0 ffff88083d891308 [ 723.915239] Call Trace: [ 723.917683] [] ? mempool_alloc+0x47/0x120 [ 723.923329] [] ? cfq_may_queue+0x56/0xe0 [ 723.928891] [] io_schedule+0x44/0x60 [ 723.934104] [] get_request_wait+0xdb/0x170 [ 723.939836] [] ? autoremove_wake_function+0x0/0x40 [ 723.946264] [] ? elv_merge+0x17b/0x1d0 [ 723.951651] [] __make_request+0x6e/0x480 [ 723.957212] [] generic_make_request+0x282/0x3f0 [ 723.963378] [] ? bio_init+0x1d/0x40 [ 723.968509] [] submit_bio+0x67/0xe0 [ 723.973636] [] ? test_set_page_writeback+0xc5/0x180 [ 723.980151] [] swap_writepage+0xa0/0xc0 [ 723.985625] [] shrink_page_list+0x45c/0x800 [ 723.991448] [] shrink_inactive_list+0x11e/0x3c0 [ 723.997613] [] ? determine_dirtyable_memory+0x1a/0x40 [ 724.004298] [] shrink_zone+0x291/0x4c0 [ 724.009686] [] ? zone_watermark_ok_safe+0xb6/0xd0 [ 724.016024] [] kswapd+0x605/0x8a0 [ 724.020981] [] ? kswapd+0x0/0x8a0 [ 724.025937] [] kthread+0x97/0xa0 [ 724.030805] [] kernel_thread_helper+0x4/0x10 [ 724.036713] [] ? kthread+0x0/0xa0 [ 724.041667] [] ? kernel_thread_helper+0x0/0x10 [ 724.047748] INFO: task kjournald:1908 blocked for more than 120 seconds. [ 724.054431] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 724.062240] kjournald D 000000010000f8dd 0 1908 2 0x00000000 [ 724.069309] ffff88083e3795d0 0000000000000046 0000000000000000 0000000000011c40 [ 724.076763] ffff88083f93dbe0 ffff88083f93d880 ffff880840350840 ffffea0000000004 [ 724.084214] 0000000000000001 ffff88083e3795f8 0000000000000202 0000000000000000 [ 724.091670] Call Trace: [ 724.094116] [] ? cfq_may_queue+0x2c/0xe0 [ 724.099676] [] io_schedule+0x44/0x60 [ 724.104889] [] get_request_wait+0xdb/0x170 [ 724.110624] [] ? autoremove_wake_function+0x0/0x40 [ 724.117049] [] ? elv_merge+0x17b/0x1d0 [ 724.122437] [] __make_request+0x6e/0x480 [ 724.127999] [] generic_make_request+0x282/0x3f0 [ 724.134164] [] ? bio_init+0x1d/0x40 [ 724.139292] [] submit_bio+0x67/0xe0 [ 724.144418] [] ? test_set_page_writeback+0xc5/0x180 [ 724.150931] [] swap_writepage+0xa0/0xc0 [ 724.156404] [] shrink_page_list+0x45c/0x800 [ 724.162223] [] shrink_inactive_list+0x11e/0x3c0 [ 724.168388] [] shrink_zone+0x291/0x4c0 [ 724.173775] [] do_try_to_free_pages+0x9b/0x300 [ 724.179853] [] try_to_free_pages+0x90/0x110 [ 724.185674] [] __alloc_pages_nodemask+0x355/0x730 [ 724.192015] [] alloc_pages_current+0x8c/0xd0 [ 724.197921] [] __page_cache_alloc+0x10/0x20 [ 724.203740] [] find_or_create_page+0x51/0xb0 [ 724.209650] [] __getblk+0xdf/0x270 [ 724.214693] [] journal_get_descriptor_buffer+0x46/0xa0 [ 724.221467] [] journal_commit_transaction+0xd7a/0xf30 [ 724.228157] [] ? try_to_del_timer_sync+0x49/0xe0 [ 724.234411] [] kjournald+0xe0/0x250 [ 724.239540] [] ? autoremove_wake_function+0x0/0x40 [ 724.245968] [] ? kjournald+0x0/0x250 [ 724.251182] [] kthread+0x97/0xa0 [ 724.256051] [] kernel_thread_helper+0x4/0x10 [ 724.261960] [] ? kthread+0x0/0xa0 [ 724.266913] [] ? kernel_thread_helper+0x0/0x10 [ 724.272993] INFO: task jbd2/sdc3-8:2298 blocked for more than 120 seconds. [ 724.279851] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 724.287660] jbd2/sdc3-8 D 000000010000f9d4 0 2298 2 0x00000000 [ 724.294731] ffff88083ef3d560 0000000000000046 ffff881000000000 0000000000011c40 [ 724.302184] ffff88083e3a7b60 ffff88083e3a7800 ffff880840350840 0000000000000004 [ 724.309637] ffff88103e8c8520 ffff88083d891308 ffff88083ef3d4c0 ffffffff812f52ba [ 724.317092] Call Trace: [ 724.319537] [] ? rb_insert_color+0x8a/0xf0 [ 724.325272] [] ? cfq_may_queue+0x56/0xe0 [ 724.330832] [] io_schedule+0x44/0x60 [ 724.336046] [] get_request_wait+0xdb/0x170 [ 724.341781] [] ? autoremove_wake_function+0x0/0x40 [ 724.348207] [] ? elv_merge+0x17b/0x1d0 [ 724.353597] [] __make_request+0x6e/0x480 [ 724.359156] [] generic_make_request+0x282/0x3f0 [ 724.365324] [] ? bio_init+0x1d/0x40 [ 724.370450] [] submit_bio+0x67/0xe0 [ 724.375579] [] ? test_set_page_writeback+0xc5/0x180 [ 724.382091] [] swap_writepage+0xa0/0xc0 [ 724.387567] [] shrink_page_list+0x45c/0x800 [ 724.393387] [] shrink_inactive_list+0x11e/0x3c0 [ 724.399556] [] ? load_balance+0x1e9/0x1560 [ 724.405293] [] shrink_zone+0x291/0x4c0 [ 724.410681] [] do_try_to_free_pages+0x9b/0x300 [ 724.416762] [] try_to_free_pages+0x90/0x110 [ 724.422582] [] __alloc_pages_nodemask+0x355/0x730 [ 724.428926] [] alloc_pages_current+0x8c/0xd0 [ 724.434832] [] __page_cache_alloc+0x10/0x20 [ 724.440653] [] find_or_create_page+0x51/0xb0 [ 724.446560] [] __getblk+0xdf/0x270 [ 724.451603] [] jbd2_journal_get_descriptor_buffer+0x47/0xa0 [ 724.458809] [] jbd2_journal_commit_transaction+0x1247/0x1400 [ 724.466099] [] ? autoremove_wake_function+0x0/0x40 [ 724.472528] [] kjournald2+0xb7/0x230 [ 724.477743] [] ? autoremove_wake_function+0x0/0x40 [ 724.484172] [] ? kjournald2+0x0/0x230 [ 724.489474] [] kthread+0x97/0xa0 [ 724.494343] [] kernel_thread_helper+0x4/0x10 [ 724.500248] [] ? kthread+0x0/0xa0 [ 724.505206] [] ? kernel_thread_helper+0x0/0x10 [ 724.511286] INFO: task cron:2380 blocked for more than 120 seconds. [ 724.517537] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 724.525346] cron D 00000001000126d4 0 2380 1 0x00000000 [ 724.532418] ffff88083ea235b8 0000000000000082 00e8c03100000000 0000000000011c40 [ 724.539871] ffff88083f86d520 ffff88083f86d1c0 ffff880840350840 90b88d4800000004 [ 724.547327] ffff88083ea23518 0000000000000046 00c7c748c68948da 0000000000000001 [ 724.554782] Call Trace: [ 724.557226] [] ? cfq_may_queue+0x2c/0xe0 [ 724.562789] [] io_schedule+0x44/0x60 [ 724.568006] [] get_request_wait+0xdb/0x170 [ 724.573741] [] ? autoremove_wake_function+0x0/0x40 [ 724.580166] [] ? elv_merge+0x17b/0x1d0 [ 724.585554] [] __make_request+0x6e/0x480 [ 724.591114] [] generic_make_request+0x282/0x3f0 [ 724.597281] [] ? bio_init+0x1d/0x40 [ 724.602409] [] submit_bio+0x67/0xe0 [ 724.607538] [] ? test_set_page_writeback+0xc5/0x180 [ 724.614053] [] swap_writepage+0xa0/0xc0 [ 724.619528] [] shrink_page_list+0x45c/0x800 [ 724.625350] [] shrink_inactive_list+0x11e/0x3c0 [ 724.631515] [] shrink_zone+0x291/0x4c0 [ 724.636903] [] do_try_to_free_pages+0x9b/0x300 [ 724.642985] [] try_to_free_pages+0x90/0x110 [ 724.648805] [] __alloc_pages_nodemask+0x355/0x730 [ 724.655148] [] kmem_getpages+0x6c/0x160 [ 724.660621] [] fallback_alloc+0x119/0x1c0 [ 724.666269] [] ____cache_alloc_node+0x95/0x150 [ 724.672349] [] kmem_cache_alloc+0x103/0x170 [ 724.678170] [] getname+0x3b/0x230 [ 724.683124] [] user_path_at+0x2a/0xa0 [ 724.688425] [] ? timerqueue_add+0x60/0xb0 [ 724.694075] [] ? lock_hrtimer_base+0x31/0x60 [ 724.699983] [] ? hrtimer_try_to_cancel+0x51/0xd0 [ 724.706236] [] ? hrtimer_cancel+0x1d/0x30 [ 724.711887] [] vfs_fstatat+0x4a/0x80 [ 724.717100] [] vfs_stat+0x1b/0x20 [ 724.722055] [] sys_newstat+0x24/0x50 [ 724.727270] [] ? sys_nanosleep+0x77/0x80 [ 724.732832] [] system_call_fastpath+0x16/0x1b [ 724.738829] INFO: task sshd:2536 blocked for more than 120 seconds. [ 724.745080] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 724.752890] sshd D 0000000100010811 0 2536 2508 0x00000000 [ 724.759959] ffff88083ddd9438 0000000000000082 ffff88083ddd9378 0000000000011c40 [ 724.767413] ffff88083fb0ebe0 ffff88083fb0e880 ffff88084039d880 ffff881000000008 [ 724.774870] 0000000000000000 0000000000000000 0000000000000020 0000000000000046 [ 724.782324] Call Trace: [ 724.784769] [] ? alloc_io_context+0x1b/0x80 [ 724.790591] [] ? current_io_context+0x2f/0x40 [ 724.796586] [] io_schedule+0x44/0x60 [ 724.801801] [] get_request_wait+0xdb/0x170 [ 724.807536] [] ? autoremove_wake_function+0x0/0x40 [ 724.813961] [] ? elv_merge+0x17b/0x1d0 [ 724.819351] [] __make_request+0x6e/0x480 [ 724.824914] [] generic_make_request+0x282/0x3f0 [ 724.831080] [] ? bio_init+0x1d/0x40 [ 724.836210] [] submit_bio+0x67/0xe0 [ 724.841337] [] ? test_set_page_writeback+0xc5/0x180 [ 724.847850] [] swap_writepage+0xa0/0xc0 [ 724.853325] [] shrink_page_list+0x45c/0x800 [ 724.859147] [] shrink_inactive_list+0x11e/0x3c0 [ 724.865315] [] ? determine_dirtyable_memory+0x1a/0x40 [ 724.872001] [] shrink_zone+0x291/0x4c0 [ 724.877388] [] do_try_to_free_pages+0x9b/0x300 [ 724.883466] [] try_to_free_pages+0x90/0x110 [ 724.889290] [] __alloc_pages_nodemask+0x355/0x730 [ 724.895632] [] alloc_pages_current+0x8c/0xd0 [ 724.901539] [] pte_alloc_one+0x1b/0x50 [ 724.906926] [] ? pollwake+0x0/0x70 [ 724.911969] [] __pte_alloc+0x27/0x110 [ 724.917270] [] handle_mm_fault+0x10f/0x270 [ 724.923004] [] do_page_fault+0x161/0x480 [ 724.928567] [] ? _raw_spin_unlock_bh+0x14/0x20 [ 724.934646] [] ? release_sock+0xd9/0x110 [ 724.940210] [] ? tcp_sendmsg+0x819/0xb80 [ 724.945770] [] page_fault+0x1f/0x30 [ 724.950897] [] ? copy_user_generic_string+0x2d/0x40 [ 724.957411] [] ? core_sys_select+0x1e3/0x2c0 [ 724.963317] [] ? do_sync_write+0xd5/0x120 [ 724.968968] [] ? fsnotify+0x1d5/0x2e0 [ 724.974272] [] sys_select+0x4b/0x100 [ 724.979485] [] ? sys_write+0x55/0x90 [ 724.984701] [] system_call_fastpath+0x16/0x1b [ 724.990696] INFO: task qemu-system-x86:2731 blocked for more than 120 seconds. [ 724.997900] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 725.005710] qemu-system-x86 D 000000010000f685 0 2731 2692 0x00000000 [ 725.012780] ffff88083fa472c8 0000000000000082 0000000000000001 0000000000011c40 [ 725.020237] ffff88083fa693e0 ffff88083fa69080 ffff88084039d880 ffffffff00000008 [ 725.027692] ffff88083fac94f0 000000103fa47228 ffff88083fb947b0 ffff88083d891308 [ 725.035146] Call Trace: [ 725.037589] [] ? mempool_alloc+0x47/0x120 [ 725.043236] [] ? cfq_may_queue+0x56/0xe0 [ 725.048796] [] io_schedule+0x44/0x60 [ 725.054010] [] get_request_wait+0xdb/0x170 [ 725.059746] [] ? autoremove_wake_function+0x0/0x40 [ 725.066170] [] ? elv_merge+0x17b/0x1d0 [ 725.071560] [] __make_request+0x6e/0x480 [ 725.077123] [] generic_make_request+0x282/0x3f0 [ 725.083289] [] ? bio_init+0x1d/0x40 [ 725.088415] [] submit_bio+0x67/0xe0 [ 725.093545] [] ? test_set_page_writeback+0xc5/0x180 [ 725.100059] [] swap_writepage+0xa0/0xc0 [ 725.105535] [] shrink_page_list+0x45c/0x800 [ 725.111358] [] shrink_inactive_list+0x11e/0x3c0 [ 725.117523] [] ? determine_dirtyable_memory+0x1a/0x40 [ 725.124211] [] shrink_zone+0x291/0x4c0 [ 725.129599] [] do_try_to_free_pages+0x9b/0x300 [ 725.135682] [] try_to_free_pages+0x90/0x110 [ 725.141503] [] __alloc_pages_nodemask+0x355/0x730 [ 725.147841] [] alloc_pages_current+0x8c/0xd0 [ 725.153746] [] __get_free_pages+0xe/0x50 [ 725.159306] [] __pollwait+0xc5/0x100 [ 725.164521] [] tcp_poll+0x28/0x180 [ 725.169564] [] sock_poll+0x1d/0x20 [ 725.174604] [] do_select+0x3b3/0x680 [ 725.179821] [] ? __pollwait+0x0/0x100 [ 725.185125] [] ? pollwake+0x0/0x70 [ 725.190165] [] ? pollwake+0x0/0x70 [ 725.195207] [] ? pollwake+0x0/0x70 [ 725.200250] [] ? pollwake+0x0/0x70 [ 725.205290] [] ? pollwake+0x0/0x70 [ 725.210331] [] ? pollwake+0x0/0x70 [ 725.215371] [] ? pollwake+0x0/0x70 [ 725.220412] [] ? pollwake+0x0/0x70 [ 725.225453] [] ? pollwake+0x0/0x70 [ 725.230495] [] core_sys_select+0x1be/0x2c0 [ 725.236229] [] ? signalfd_read+0xd5/0x500 [ 725.241875] [] ? timerqueue_add+0x60/0xb0 [ 725.247522] [] ? eventfd_ctx_read+0x95/0x190 [ 725.253431] [] ? timespec_add_safe+0x39/0x70 [ 725.259340] [] sys_select+0x4b/0x100 [ 725.264556] [] system_call_fastpath+0x16/0x1b [ 725.270550] INFO: task qemu-system-x86:2733 blocked for more than 120 seconds. [ 725.277755] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 725.285562] qemu-system-x86 D 000000010000fbd6 0 2733 2692 0x00000000 [ 725.292631] ffff88103b95d238 0000000000000082 0000000000000001 0000000000011c40 [ 725.300086] ffff88103ea603a0 ffff88103ea60040 ffff88083f80b8c0 ffffffff0000000c [ 725.307541] ffff88083fac94f0 000000103b95d198 ffff880102069b60 ffff88083d891308 [ 725.314997] Call Trace: [ 725.317441] [] ? mempool_alloc+0x47/0x120 [ 725.323088] [] ? cfq_may_queue+0x56/0xe0 [ 725.328650] [] io_schedule+0x44/0x60 [ 725.333865] [] get_request_wait+0xdb/0x170 [ 725.339601] [] ? autoremove_wake_function+0x0/0x40 [ 725.346026] [] ? elv_merge+0x17b/0x1d0 [ 725.351415] [] __make_request+0x6e/0x480 [ 725.356977] [] generic_make_request+0x282/0x3f0 [ 725.363145] [] ? bio_init+0x1d/0x40 [ 725.368274] [] submit_bio+0x67/0xe0 [ 725.373400] [] ? test_set_page_writeback+0xc5/0x180 [ 725.379914] [] swap_writepage+0xa0/0xc0 [ 725.385386] [] shrink_page_list+0x45c/0x800 [ 725.391208] [] shrink_inactive_list+0x11e/0x3c0 [ 725.397373] [] ? determine_dirtyable_memory+0x1a/0x40 [ 725.404060] [] shrink_zone+0x291/0x4c0 [ 725.409448] [] ? shrink_slab+0x149/0x180 [ 725.415008] [] do_try_to_free_pages+0x9b/0x300 [ 725.421089] [] try_to_free_pages+0x90/0x110 [ 725.426909] [] __alloc_pages_nodemask+0x355/0x730 [ 725.433251] [] alloc_pages_current+0x8c/0xd0 [ 725.439159] [] pte_alloc_one+0x1b/0x50 [ 725.444548] [] __pte_alloc+0x27/0x110 [ 725.449848] [] handle_mm_fault+0x10f/0x270 [ 725.455582] [] __get_user_pages+0x14f/0x490 [ 725.461406] [] ? kvm_read_guest_page+0x39/0x80 [ 725.467487] [] get_user_pages+0x52/0x60 [ 725.472963] [] get_user_pages_fast+0x134/0x160 [ 725.479042] [] hva_to_pfn+0xc1/0x280 [ 725.484257] [] __gfn_to_pfn+0xbf/0xe0 [ 725.489560] [] gfn_to_pfn_async+0x1a/0x20 [ 725.495208] [] try_async_pf+0x4b/0x1e0 [ 725.500598] [] ? gfn_to_memslot+0x12/0x20 [ 725.506244] [] ? gfn_to_hva+0x1f/0x30 [ 725.511543] [] ? kvm_host_page_size+0x86/0x90 [ 725.517538] [] tdp_page_fault+0xef/0x1d0 [ 725.523100] [] ? vmx_set_interrupt_shadow+0x1a/0x50 [ 725.529614] [] kvm_mmu_page_fault+0x2c/0x90 [ 725.535435] [] handle_ept_violation+0x80/0x150 [ 725.541515] [] vmx_handle_exit+0xba/0x4e0 [ 725.547162] [] ? apic_update_ppr+0x3f/0x90 [ 725.552897] [] ? sched_clock_cpu+0x24/0xf0 [ 725.558632] [] kvm_arch_vcpu_ioctl_run+0x4e1/0xe00 [ 725.565057] [] ? kvm_arch_vcpu_load+0x47/0x120 [ 725.571140] [] kvm_vcpu_ioctl+0x4d2/0x5c0 [ 725.576787] [] ? kvm_vm_ioctl+0xa0/0x3c0 [ 725.582346] [] ? sys_sendto+0x137/0x140 [ 725.587819] [] vfs_ioctl+0x1d/0x50 [ 725.592861] [] do_vfs_ioctl+0xa5/0x4e0 [ 725.598251] [] ? sys_futex+0x83/0x140 [ 725.603553] [] sys_ioctl+0x4f/0x80 [ 725.608596] [] system_call_fastpath+0x16/0x1b [ 725.614587] INFO: task qemu-system-x86:2736 blocked for more than 120 seconds. [ 725.621790] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 725.629600] qemu-system-x86 D 000000010000f67d 0 2736 2692 0x00000000 [ 725.636669] ffff88102de7f508 0000000000000082 ffff88083d891308 0000000000011c40 [ 725.644128] ffff88103ea5fc20 ffff88103ea5f8c0 ffff88084039d880 ffff880800000008 [ 725.651584] ffffffff8192d4a0 ffffffff811269b8 ffff88102de7f478 ffff88083faaecc0 [ 725.659040] Call Trace: [ 725.661483] [] ? transfer_objects+0x58/0x80 [ 725.667304] [] ? cache_alloc_refill+0x9f/0x260 [ 725.673383] [] ? cfq_may_queue+0x56/0xe0 [ 725.678944] [] io_schedule+0x44/0x60 [ 725.684159] [] get_request_wait+0xdb/0x170 [ 725.689893] [] ? autoremove_wake_function+0x0/0x40 [ 725.696319] [] ? elv_merge+0x17b/0x1d0 [ 725.701708] [] __make_request+0x6e/0x480 [ 725.707271] [] generic_make_request+0x282/0x3f0 [ 725.713437] [] ? bio_init+0x1d/0x40 [ 725.718568] [] submit_bio+0x67/0xe0 [ 725.723695] [] ? test_set_page_writeback+0xc5/0x180 [ 725.730209] [] swap_writepage+0xa0/0xc0 [ 725.735685] [] shrink_page_list+0x45c/0x800 [ 725.741506] [] shrink_inactive_list+0x11e/0x3c0 [ 725.747673] [] ? determine_dirtyable_memory+0x1a/0x40 [ 725.754360] [] shrink_zone+0x291/0x4c0 [ 725.759750] [] do_try_to_free_pages+0x9b/0x300 [ 725.765831] [] try_to_free_pages+0x90/0x110 [ 725.771653] [] __alloc_pages_nodemask+0x355/0x730 [ 725.778000] [] alloc_pages_current+0x8c/0xd0 [ 725.783906] [] __page_cache_alloc+0x10/0x20 [ 725.789725] [] __do_page_cache_readahead+0xe2/0x220 [ 725.796236] [] ra_submit+0x21/0x30 [ 725.801278] [] ondemand_readahead+0xa8/0x1d0 [ 725.807186] [] page_cache_sync_readahead+0x36/0x50 [ 725.813614] [] generic_file_aio_read+0x57a/0x6f0 [ 725.819865] [] ? __wake_up_common+0x5b/0x90 [ 725.825688] [] do_sync_read+0xd5/0x120 [ 725.831075] [] ? group_send_sig_info+0x52/0x60 [ 725.837157] [] ? kill_pid_info+0x4b/0x70 [ 725.842717] [] ? sys_kill+0x94/0x190 [ 725.847930] [] vfs_read+0xcb/0x170 [ 725.852972] [] sys_pread64+0x8a/0x90 [ 725.858186] [] system_call_fastpath+0x16/0x1b [ 725.864180] INFO: task memknobs:2751 blocked for more than 120 seconds. [ 725.870778] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 725.878588] memknobs D 000000010000f603 0 2751 2617 0x00000000 [ 725.885656] ffff88083e57d6b8 0000000000000082 0000000000000001 0000000000011c40 [ 725.893111] ffff88083fb0ab20 ffff88083fb0a7c0 ffffffff81925020 ffffffff00000000 [ 725.900567] ffff88083fac94f0 000000103e57d618 ffff88083d8a15e0 ffff88083d891308 [ 725.908021] Call Trace: [ 725.910467] [] ? mempool_alloc+0x47/0x120 [ 725.916115] [] ? cfq_may_queue+0x56/0xe0 [ 725.921676] [] io_schedule+0x44/0x60 [ 725.926890] [] get_request_wait+0xdb/0x170 [ 725.932623] [] ? autoremove_wake_function+0x0/0x40 [ 725.939050] [] ? elv_merge+0x17b/0x1d0 [ 725.944437] [] __make_request+0x6e/0x480 [ 725.949998] [] generic_make_request+0x282/0x3f0 [ 725.956165] [] ? bio_init+0x1d/0x40 [ 725.961292] [] submit_bio+0x67/0xe0 [ 725.966418] [] ? test_set_page_writeback+0xc5/0x180 [ 725.972933] [] swap_writepage+0xa0/0xc0 [ 725.978406] [] shrink_page_list+0x45c/0x800 [ 725.984228] [] shrink_inactive_list+0x11e/0x3c0 [ 725.990394] [] ? determine_dirtyable_memory+0x1a/0x40 [ 725.997081] [] shrink_zone+0x291/0x4c0 [ 726.002471] [] do_try_to_free_pages+0x9b/0x300 [ 726.008551] [] try_to_free_pages+0x90/0x110 [ 726.014373] [] __alloc_pages_nodemask+0x355/0x730 [ 726.020714] [] ? sync_page+0x0/0x60 [ 726.025845] [] alloc_pages_current+0x8c/0xd0 [ 726.031751] [] pte_alloc_one+0x1b/0x50 [ 726.037141] [] __pte_alloc+0x27/0x110 [ 726.042445] [] handle_mm_fault+0x10f/0x270 [ 726.048179] [] do_page_fault+0x161/0x480 [ 726.053740] [] ? do_sigaction+0x103/0x1a0 [ 726.059388] [] ? sys_rt_sigaction+0x89/0xc0 [ 726.065207] [] page_fault+0x1f/0x30 -- Dave -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Fight unfair telecom policy in Canada: sign http://dissolvethecrtc.ca/ Don't email: email@kvack.org