From: Konstantinos Skarlatos <k.skarlatos@gmail.com>
To: Dag Nygren <dag@newtech.fi>
Cc: linux-raid@vger.kernel.org
Subject: Re: Hang in Raid-5 code (Old bug back?)
Date: Thu, 16 Feb 2012 15:43:26 +0200 [thread overview]
Message-ID: <4F3D07FE.6010601@gmail.com> (raw)
In-Reply-To: <8881584.REWxvMC81A@eseries>
On Πέμπτη, 9 Φεβρουάριος 2012 4:55:11 πμ, Dag Nygren wrote:
> söndag 05 februari 2012 18:55:58 skrev Dag Nygren:
>> Hi!
>>
>> Using lessfs on top of an XFS on top on a software RAID-5 and see this
>> freeze happening about once a week. Usually during heavy load.
>
> No comments on the stuff below? Nobody else?
I also have frequent freezes on two raid5 arrays on different systems.
kernels tested are 3.1 and 3.2.
system1: raid5-xfs-btrfs loop
system2: raid5-btrfs
when the freezes happen, iostat -xk 1 gives 100% usage on one random
disk.
Here are some kernel messages from the raid5-xfs-loop btrfs system.
[Mon Jan 30 20:07:10 2012] INFO: task rsync:18646 blocked for more than
120 seconds.
[Mon Jan 30 20:07:10 2012] "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Mon Jan 30 20:07:10 2012] rsync D 0000000105d6f258 0
18646 18645 0x00000000
[Mon Jan 30 20:07:10 2012] ffff88013bb39a78 0000000000000086
ffff880100000000 ffffffffa05086ba
[Mon Jan 30 20:07:10 2012] ffff880200e94020 ffff88013bb39fd8
ffff88013bb39fd8 ffff88013bb39fd8
[Mon Jan 30 20:07:10 2012] ffff880202d21c80 ffff880200e94020
ffff8800b14b2900 ffff88013bb39a18
[Mon Jan 30 20:07:10 2012] Call Trace:
[Mon Jan 30 20:07:10 2012] [<ffffffffa05086ba>] ?
btrfs_queue_worker+0x1ea/0x300 [btrfs]
[Mon Jan 30 20:07:10 2012] [<ffffffffa04e70c5>] ?
run_delalloc_range+0x185/0x360 [btrfs]
[Mon Jan 30 20:07:10 2012] [<ffffffff8101d639>] ? read_tsc+0x9/0x20
[Mon Jan 30 20:07:10 2012] [<ffffffff8109271d>] ?
ktime_get_ts+0xad/0xe0
[Mon Jan 30 20:07:10 2012] [<ffffffff8101d639>] ? read_tsc+0x9/0x20
[Mon Jan 30 20:07:10 2012] [<ffffffff811055d0>] ? __lock_page+0x70/0x70
[Mon Jan 30 20:07:10 2012] [<ffffffff814258bf>] schedule+0x3f/0x60
[Mon Jan 30 20:07:10 2012] [<ffffffff8142596f>] io_schedule+0x8f/0xd0
[Mon Jan 30 20:07:10 2012] [<ffffffff811055de>] sleep_on_page+0xe/0x20
[Mon Jan 30 20:07:10 2012] [<ffffffff8142611f>] __wait_on_bit+0x5f/0x90
[Mon Jan 30 20:07:10 2012] [<ffffffff811057c8>]
wait_on_page_bit+0x78/0x80
[Mon Jan 30 20:07:10 2012] [<ffffffff81088cf0>] ?
autoremove_wake_function+0x40/0x40
[Mon Jan 30 20:07:10 2012] [<ffffffffa04fe5e5>]
extent_write_cache_pages.isra.22.constprop.30+0x295/0x3f0 [btrfs]
[Mon Jan 30 20:07:10 2012] [<ffffffff81150d3b>] ?
kmem_cache_free+0x13b/0x150
[Mon Jan 30 20:07:10 2012] [<ffffffffa04fa6e7>] ?
free_extent_state+0x37/0x60 [btrfs]
[Mon Jan 30 20:07:10 2012] [<ffffffffa04fe985>]
extent_writepages+0x45/0x60 [btrfs]
[Mon Jan 30 20:07:10 2012] [<ffffffffa04e3790>] ?
uncompress_inline.isra.47+0x1d0/0x1d0 [btrfs]
[Mon Jan 30 20:07:10 2012] [<ffffffffa04e2a78>]
btrfs_writepages+0x28/0x30 [btrfs]
[Mon Jan 30 20:07:10 2012] [<ffffffff81110ff4>] do_writepages+0x24/0x40
[Mon Jan 30 20:07:10 2012] [<ffffffff8110686b>]
__filemap_fdatawrite_range+0x5b/0x60
[Mon Jan 30 20:07:10 2012] [<ffffffff811077e3>]
filemap_fdatawrite_range+0x13/0x20
[Mon Jan 30 20:07:10 2012] [<ffffffffa04f92e6>]
btrfs_wait_ordered_range+0x66/0x150 [btrfs]
[Mon Jan 30 20:07:10 2012] [<ffffffffa04e8c28>]
btrfs_truncate+0xc8/0x670 [btrfs]
[Mon Jan 30 20:07:10 2012] [<ffffffffa04eaad1>]
btrfs_setattr+0xc1/0x1b0 [btrfs]
[Mon Jan 30 20:07:10 2012] [<ffffffff811827a2>]
notify_change+0x1a2/0x340
[Mon Jan 30 20:07:10 2012] [<ffffffff811656be>] do_truncate+0x5e/0xa0
[Mon Jan 30 20:07:10 2012] [<ffffffff81165985>]
sys_ftruncate+0xd5/0x120
[Mon Jan 30 20:07:10 2012] [<ffffffff814290c2>]
system_call_fastpath+0x16/0x1b
[Mon Jan 30 22:37:10 2012] INFO: task btrfs-delayed-m:24548 blocked for
more than 120 seconds.
[Mon Jan 30 22:37:10 2012] "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Mon Jan 30 22:37:10 2012] btrfs-delayed-m D 0000000106001847 0
24548 2 0x00000000
[Mon Jan 30 22:37:10 2012] ffff8800014f3510 0000000000000046
0000000000000000 0000000000000286
[Mon Jan 30 22:37:10 2012] ffff880201804e60 ffff8800014f3fd8
ffff8800014f3fd8 ffff8800014f3fd8
[Mon Jan 30 22:37:10 2012] ffffffff8180d020 ffff880201804e60
ffffffff811239c9 ffff880201804e60
[Mon Jan 30 22:37:10 2012] Call Trace:
[Mon Jan 30 22:37:10 2012] [<ffffffff811239c9>] ?
zone_statistics+0x99/0xc0
[Mon Jan 30 22:37:10 2012] [<ffffffff81108065>] ?
mempool_alloc_slab+0x15/0x20
[Mon Jan 30 22:37:10 2012] [<ffffffff8104f4b5>] ?
cpuacct_charge+0x65/0x70
[Mon Jan 30 22:37:10 2012] [<ffffffff814258bf>] schedule+0x3f/0x60
[Mon Jan 30 22:37:10 2012] [<ffffffff81427e75>]
rwsem_down_failed_common+0xc5/0x160
[Mon Jan 30 22:37:10 2012] [<ffffffff81427f23>]
rwsem_down_write_failed+0x13/0x20
[Mon Jan 30 22:37:10 2012] [<ffffffff81241fa3>]
call_rwsem_down_write_failed+0x13/0x20
[Mon Jan 30 22:37:10 2012] [<ffffffff81427545>] ? down_write+0x25/0x27
[Mon Jan 30 22:37:10 2012] [<ffffffffa04c74e9>]
cache_block_group+0x229/0x3d0 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffff81088cb0>] ?
abort_exclusive_wait+0xb0/0xb0
[Mon Jan 30 22:37:10 2012] [<ffffffffa04cc2a8>]
find_free_extent.constprop.67+0xab8/0xb20 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffff8109271d>] ?
ktime_get_ts+0xad/0xe0
[Mon Jan 30 22:37:10 2012] [<ffffffffa04cf7b8>]
btrfs_reserve_extent+0xe8/0x220 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04cfe08>]
btrfs_alloc_free_block+0x178/0x350 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04bee62>]
__btrfs_cow_block+0x122/0x430 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04bf266>]
btrfs_cow_block+0xf6/0x250 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa050e2e0>] ?
btrfs_set_lock_blocking_rw+0x50/0xb0 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04c2dde>]
btrfs_search_slot+0x18e/0x8a0 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04c81bb>]
lookup_inline_extent_backref+0x9b/0x460 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04c9073>]
insert_inline_extent_backref+0x63/0xe0 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04c918e>]
__btrfs_inc_extent_ref.isra.57+0x9e/0x1d0 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04ce1c6>]
run_clustered_refs+0x496/0x810 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa051b100>] ?
btrfs_find_ref_cluster+0xe0/0x190 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04ce608>]
btrfs_run_delayed_refs+0xc8/0x220 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04df96e>]
__btrfs_end_transaction+0xbe/0x310 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04dfbd8>]
btrfs_end_transaction_dmeta+0x18/0x20 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa0524b48>]
btrfs_async_run_delayed_node_done+0xd8/0x1a0 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa0508920>]
worker_loop+0x150/0x520 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa05087d0>] ?
btrfs_queue_worker+0x300/0x300 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffff8108836c>] kthread+0x8c/0xa0
[Mon Jan 30 22:37:10 2012] [<ffffffff8142b234>]
kernel_thread_helper+0x4/0x10
[Mon Jan 30 22:37:10 2012] [<ffffffff810882e0>] ?
kthread_worker_fn+0x190/0x190
[Mon Jan 30 22:37:10 2012] [<ffffffff8142b230>] ? gs_change+0x13/0x13
[Mon Jan 30 22:37:10 2012] INFO: task btrfs-delayed-m:24550 blocked for
more than 120 seconds.
[Mon Jan 30 22:37:10 2012] "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Mon Jan 30 22:37:10 2012] btrfs-delayed-m D 000000010600185f 0
24550 2 0x00000000
[Mon Jan 30 22:37:10 2012] ffff88001b521630 0000000000000046
ffff88001b521570 ffffffff8105c001
[Mon Jan 30 22:37:10 2012] ffff8801ce0d23a0 ffff88001b521fd8
ffff88001b521fd8 ffff88001b521fd8
[Mon Jan 30 22:37:10 2012] ffff880202d21c80 ffff8801ce0d23a0
ffff8801ce0d23e8 0000000000000001
[Mon Jan 30 22:37:10 2012] Call Trace:
[Mon Jan 30 22:37:10 2012] [<ffffffff8105c001>] ?
update_curr+0x121/0x1f0
[Mon Jan 30 22:37:10 2012] [<ffffffff81151f13>] ?
kmem_cache_alloc+0x133/0x160
[Mon Jan 30 22:37:10 2012] [<ffffffff81150c2f>] ?
kmem_cache_free+0x2f/0x150
[Mon Jan 30 22:37:10 2012] [<ffffffff81181948>] ? iput+0x48/0x210
[Mon Jan 30 22:37:10 2012] [<ffffffffa051405d>] ?
tree_search_offset.isra.24+0x1ed/0x230 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffff81151d03>] ?
kmem_cache_alloc_trace+0x133/0x160
[Mon Jan 30 22:37:10 2012] [<ffffffff814258bf>] schedule+0x3f/0x60
[Mon Jan 30 22:37:10 2012] [<ffffffffa04c7192>]
wait_block_group_cache_progress+0xe2/0x110 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffff81088cb0>] ?
abort_exclusive_wait+0xb0/0xb0
[Mon Jan 30 22:37:10 2012] [<ffffffff81088cb0>] ?
abort_exclusive_wait+0xb0/0xb0
[Mon Jan 30 22:37:10 2012] [<ffffffffa04cbbbd>]
find_free_extent.constprop.67+0x3cd/0xb20 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffff8109271d>] ?
ktime_get_ts+0xad/0xe0
[Mon Jan 30 22:37:10 2012] [<ffffffffa04cf7b8>]
btrfs_reserve_extent+0xe8/0x220 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04cfe08>]
btrfs_alloc_free_block+0x178/0x350 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04bee62>]
__btrfs_cow_block+0x122/0x430 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04bf266>]
btrfs_cow_block+0xf6/0x250 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa050e2e0>] ?
btrfs_set_lock_blocking_rw+0x50/0xb0 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04c2dde>]
btrfs_search_slot+0x18e/0x8a0 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04c602d>] ?
find_next_key+0xdd/0xf0 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04c45ac>]
btrfs_insert_empty_items+0x7c/0xe0 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04c8845>]
insert_extent_data_ref+0x65/0x2a0 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04c92ad>]
__btrfs_inc_extent_ref.isra.57+0x1bd/0x1d0 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04cdfd2>]
run_clustered_refs+0x2a2/0x810 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa051b100>] ?
btrfs_find_ref_cluster+0xe0/0x190 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04ce608>]
btrfs_run_delayed_refs+0xc8/0x220 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04df96e>]
__btrfs_end_transaction+0xbe/0x310 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa04dfbd8>]
btrfs_end_transaction_dmeta+0x18/0x20 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa0524b48>]
btrfs_async_run_delayed_node_done+0xd8/0x1a0 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa0508920>]
worker_loop+0x150/0x520 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffffa05087d0>] ?
btrfs_queue_worker+0x300/0x300 [btrfs]
[Mon Jan 30 22:37:10 2012] [<ffffffff8108836c>] kthread+0x8c/0xa0
[Mon Jan 30 22:37:10 2012] [<ffffffff8142b234>]
kernel_thread_helper+0x4/0x10
[Mon Jan 30 22:37:10 2012] [<ffffffff810882e0>] ?
kthread_worker_fn+0x190/0x190
[Mon Jan 30 22:37:10 2012] [<ffffffff8142b230>] ? gs_change+0x13/0x13
[Tue Jan 31 12:55:10 2012] INFO: task btrfs-transacti:21407 blocked for
more than 120 seconds.
[Tue Jan 31 12:55:10 2012] "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Tue Jan 31 12:55:10 2012] btrfs-transacti D 0000000106ebce55 0
21407 2 0x00000000
[Tue Jan 31 12:55:10 2012] ffff8801d9573bc0 0000000000000046
ffffffff8142514e ffff880201a88000
[Tue Jan 31 12:55:10 2012] ffff880201f9c740 ffff8801d9573fd8
ffff8801d9573fd8 ffff8801d9573fd8
[Tue Jan 31 12:55:10 2012] ffff880202cb4e60 ffff880201f9c740
ffffffffa04fa601 ffff880071022e70
[Tue Jan 31 12:55:10 2012] Call Trace:
[Tue Jan 31 12:55:10 2012] [<ffffffff8142514e>] ?
__schedule+0x33e/0x980
[Tue Jan 31 12:55:10 2012] [<ffffffffa04fa601>] ?
extent_io_exit+0xd1/0x130 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffff8101d639>] ? read_tsc+0x9/0x20
[Tue Jan 31 12:55:10 2012] [<ffffffff8109271d>] ?
ktime_get_ts+0xad/0xe0
[Tue Jan 31 12:55:10 2012] [<ffffffff8122d436>] ?
throtl_find_tg+0x46/0x60
[Tue Jan 31 12:55:10 2012] [<ffffffff8122dd1a>] ?
blk_throtl_bio+0x1fa/0x5f0
[Tue Jan 31 12:55:10 2012] [<ffffffff811055d0>] ? __lock_page+0x70/0x70
[Tue Jan 31 12:55:10 2012] [<ffffffff810d4934>] ?
__delayacct_blkio_end+0x34/0x60
[Tue Jan 31 12:55:10 2012] [<ffffffff814258bf>] schedule+0x3f/0x60
[Tue Jan 31 12:55:10 2012] [<ffffffff81425fd5>]
schedule_timeout+0x305/0x390
[Tue Jan 31 12:55:10 2012] [<ffffffff8104f373>] ? __wake_up+0x53/0x70
[Tue Jan 31 12:55:10 2012] [<ffffffff81424b48>]
wait_for_common+0xc8/0x160
[Tue Jan 31 12:55:10 2012] [<ffffffff8105f060>] ?
try_to_wake_up+0x290/0x290
[Tue Jan 31 12:55:10 2012] [<ffffffff81424bfd>]
wait_for_completion+0x1d/0x20
[Tue Jan 31 12:55:10 2012] [<ffffffffa04d81db>]
write_dev_flush+0x4b/0x140 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04da1b6>]
write_all_supers+0x6f6/0x800 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04da2d3>]
write_ctree_super+0x13/0x20 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04df63d>]
btrfs_commit_transaction+0x63d/0x880 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffff81088cb0>] ?
abort_exclusive_wait+0xb0/0xb0
[Tue Jan 31 12:55:10 2012] [<ffffffffa04dfcd4>] ?
start_transaction+0x94/0x2b0 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04d7e6d>]
transaction_kthread+0x26d/0x290 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04d7c00>] ?
btrfs_congested_fn+0xd0/0xd0 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffff8108836c>] kthread+0x8c/0xa0
[Tue Jan 31 12:55:10 2012] [<ffffffff8142b234>]
kernel_thread_helper+0x4/0x10
[Tue Jan 31 12:55:10 2012] [<ffffffff810882e0>] ?
kthread_worker_fn+0x190/0x190
[Tue Jan 31 12:55:10 2012] [<ffffffff8142b230>] ? gs_change+0x13/0x13
[Tue Jan 31 12:55:10 2012] INFO: task rsync:13574 blocked for more than
120 seconds.
[Tue Jan 31 12:55:10 2012] "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Tue Jan 31 12:55:10 2012] rsync D 0000000106ebce49 0
13574 12299 0x00000000
[Tue Jan 31 12:55:10 2012] ffff880012c29758 0000000000000082
ffff880000000000 ffffffff8104f373
[Tue Jan 31 12:55:10 2012] ffff880202355ca0 ffff880012c29fd8
ffff880012c29fd8 ffff880012c29fd8
[Tue Jan 31 12:55:10 2012] ffff880202cb7200 ffff880202355ca0
ffff880012c296a8 ffffffffa01a31be
[Tue Jan 31 12:55:10 2012] Call Trace:
[Tue Jan 31 12:55:10 2012] [<ffffffff8104f373>] ? __wake_up+0x53/0x70
[Tue Jan 31 12:55:10 2012] [<ffffffffa01a31be>] ?
loop_make_request+0xde/0x110 [loop]
[Tue Jan 31 12:55:10 2012] [<ffffffff8121d877>] ?
generic_make_request+0xc7/0x100
[Tue Jan 31 12:55:10 2012] [<ffffffff8121d937>] ? submit_bio+0x87/0x110
[Tue Jan 31 12:55:10 2012] [<ffffffff8101d639>] ? read_tsc+0x9/0x20
[Tue Jan 31 12:55:10 2012] [<ffffffff811055d0>] ? __lock_page+0x70/0x70
[Tue Jan 31 12:55:10 2012] [<ffffffff814258bf>] schedule+0x3f/0x60
[Tue Jan 31 12:55:10 2012] [<ffffffff8142596f>] io_schedule+0x8f/0xd0
[Tue Jan 31 12:55:10 2012] [<ffffffff811055de>] sleep_on_page+0xe/0x20
[Tue Jan 31 12:55:10 2012] [<ffffffff8142611f>] __wait_on_bit+0x5f/0x90
[Tue Jan 31 12:55:10 2012] [<ffffffff811057c8>]
wait_on_page_bit+0x78/0x80
[Tue Jan 31 12:55:10 2012] [<ffffffff81088cf0>] ?
autoremove_wake_function+0x40/0x40
[Tue Jan 31 12:55:10 2012] [<ffffffffa04ffe66>]
read_extent_buffer_pages+0x476/0x510 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04d6f90>] ?
verify_parent_transid+0x160/0x160 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04d815a>]
btree_read_extent_buffer_pages.isra.100+0x8a/0xc0 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04d98f1>]
read_tree_block+0x41/0x60 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04c0ca3>]
read_block_for_search.isra.33+0xf3/0x3d0 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04c0577>] ?
generic_bin_search.constprop.35+0xe7/0x160 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04c2fe0>]
btrfs_search_slot+0x390/0x8a0 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04d5eef>]
btrfs_lookup_inode+0x2f/0xa0 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04e9b31>] btrfs_iget+0x101/0x490
[btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffff8117a210>] ? __pollwait+0xf0/0xf0
[Tue Jan 31 12:55:10 2012] [<ffffffff8117d000>] ? d_validate+0x10/0xb0
[Tue Jan 31 12:55:10 2012] [<ffffffffa04ea793>]
btrfs_lookup_dentry+0x453/0x4e0 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffff8117f3e5>] ? __d_lookup+0xb5/0x170
[Tue Jan 31 12:55:10 2012] [<ffffffffa04ea83d>] btrfs_lookup+0x1d/0x60
[btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffff81172e9d>]
d_inode_lookup.isra.12+0x1d/0x50
[Tue Jan 31 12:55:10 2012] [<ffffffff81173292>] do_lookup+0x382/0x3d0
[Tue Jan 31 12:55:10 2012] [<ffffffff81174d0c>]
path_lookupat+0x11c/0x760
[Tue Jan 31 12:55:10 2012] [<ffffffff81175381>]
do_path_lookup+0x31/0xc0
[Tue Jan 31 12:55:10 2012] [<ffffffff811771d9>]
user_path_at_empty+0x59/0xa0
[Tue Jan 31 12:55:10 2012] [<ffffffffa04bac3d>] ?
btrfs_fs_dirty_inode+0x1d/0x80 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffff8118f1ef>] ?
__mark_inode_dirty+0x19f/0x230
[Tue Jan 31 12:55:10 2012] [<ffffffff81177231>] user_path_at+0x11/0x20
[Tue Jan 31 12:55:10 2012] [<ffffffff8116bf4a>] vfs_fstatat+0x3a/0x70
[Tue Jan 31 12:55:10 2012] [<ffffffff811798c0>] ? sys_ioctl+0xa0/0xa0
[Tue Jan 31 12:55:10 2012] [<ffffffff8116bf9e>] vfs_lstat+0x1e/0x20
[Tue Jan 31 12:55:10 2012] [<ffffffff8116c13a>] sys_newlstat+0x1a/0x40
[Tue Jan 31 12:55:10 2012] [<ffffffff81179d1c>] ?
sys_getdents+0xbc/0xf0
[Tue Jan 31 12:55:10 2012] [<ffffffff814290c2>]
system_call_fastpath+0x16/0x1b
[Tue Jan 31 12:55:10 2012] INFO: task rsync:19379 blocked for more than
120 seconds.
[Tue Jan 31 12:55:10 2012] "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Tue Jan 31 12:55:10 2012] rsync D 0000000106ebce5c 0
19379 18859 0x00000000
[Tue Jan 31 12:55:10 2012] ffff88017e46b758 0000000000000086
ffff880100000000 ffffffff8104f373
[Tue Jan 31 12:55:10 2012] ffff88002d35c740 ffff88017e46bfd8
ffff88017e46bfd8 ffff88017e46bfd8
[Tue Jan 31 12:55:10 2012] ffff880202cb4e60 ffff88002d35c740
ffff88017e46b6a8 ffffffffa01a31be
[Tue Jan 31 12:55:10 2012] Call Trace:
[Tue Jan 31 12:55:10 2012] [<ffffffff8104f373>] ? __wake_up+0x53/0x70
[Tue Jan 31 12:55:10 2012] [<ffffffffa01a31be>] ?
loop_make_request+0xde/0x110 [loop]
[Tue Jan 31 12:55:10 2012] [<ffffffff8121d877>] ?
generic_make_request+0xc7/0x100
[Tue Jan 31 12:55:10 2012] [<ffffffff8121d937>] ? submit_bio+0x87/0x110
[Tue Jan 31 12:55:10 2012] [<ffffffff8101d639>] ? read_tsc+0x9/0x20
[Tue Jan 31 12:55:10 2012] [<ffffffff811055d0>] ? __lock_page+0x70/0x70
[Tue Jan 31 12:55:10 2012] [<ffffffff814258bf>] schedule+0x3f/0x60
[Tue Jan 31 12:55:10 2012] [<ffffffff8142596f>] io_schedule+0x8f/0xd0
[Tue Jan 31 12:55:10 2012] [<ffffffff811055de>] sleep_on_page+0xe/0x20
[Tue Jan 31 12:55:10 2012] [<ffffffff8142611f>] __wait_on_bit+0x5f/0x90
[Tue Jan 31 12:55:10 2012] [<ffffffff811057c8>]
wait_on_page_bit+0x78/0x80
[Tue Jan 31 12:55:10 2012] [<ffffffff81088cf0>] ?
autoremove_wake_function+0x40/0x40
[Tue Jan 31 12:55:10 2012] [<ffffffffa04ffe66>]
read_extent_buffer_pages+0x476/0x510 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04d6f90>] ?
verify_parent_transid+0x160/0x160 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04d815a>]
btree_read_extent_buffer_pages.isra.100+0x8a/0xc0 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04d98f1>]
read_tree_block+0x41/0x60 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04c0ca3>]
read_block_for_search.isra.33+0xf3/0x3d0 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04c0577>] ?
generic_bin_search.constprop.35+0xe7/0x160 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04c2fe0>]
btrfs_search_slot+0x390/0x8a0 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04d5eef>]
btrfs_lookup_inode+0x2f/0xa0 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04e9b31>] btrfs_iget+0x101/0x490
[btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04ea7e5>] ?
btrfs_lookup_dentry+0x4a5/0x4e0 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffff8117d000>] ? d_validate+0x10/0xb0
[Tue Jan 31 12:55:10 2012] [<ffffffffa04ea793>]
btrfs_lookup_dentry+0x453/0x4e0 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffff8117f3e5>] ? __d_lookup+0xb5/0x170
[Tue Jan 31 12:55:10 2012] [<ffffffffa04ea83d>] btrfs_lookup+0x1d/0x60
[btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffff81172e9d>]
d_inode_lookup.isra.12+0x1d/0x50
[Tue Jan 31 12:55:10 2012] [<ffffffff81173292>] do_lookup+0x382/0x3d0
[Tue Jan 31 12:55:10 2012] [<ffffffff81172abb>] ?
getname_flags+0x3b/0x260
[Tue Jan 31 12:55:10 2012] [<ffffffff81174d0c>]
path_lookupat+0x11c/0x760
[Tue Jan 31 12:55:10 2012] [<ffffffff81175381>]
do_path_lookup+0x31/0xc0
[Tue Jan 31 12:55:10 2012] [<ffffffff811771d9>]
user_path_at_empty+0x59/0xa0
[Tue Jan 31 12:55:10 2012] [<ffffffff811798c0>] ? sys_ioctl+0xa0/0xa0
[Tue Jan 31 12:55:10 2012] [<ffffffff8116bb94>] ?
inode_get_bytes+0x44/0x60
[Tue Jan 31 12:55:10 2012] [<ffffffffa04e0df6>] ?
btrfs_getattr+0x56/0x90 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffff8116bd34>] ? cp_new_stat+0xe4/0xf0
[Tue Jan 31 12:55:10 2012] [<ffffffff81177231>] user_path_at+0x11/0x20
[Tue Jan 31 12:55:10 2012] [<ffffffff8116bf4a>] vfs_fstatat+0x3a/0x70
[Tue Jan 31 12:55:10 2012] [<ffffffff8116bf9e>] vfs_lstat+0x1e/0x20
[Tue Jan 31 12:55:10 2012] [<ffffffff8116c13a>] sys_newlstat+0x1a/0x40
[Tue Jan 31 12:55:10 2012] [<ffffffff814290c2>]
system_call_fastpath+0x16/0x1b
[Tue Jan 31 12:55:10 2012] INFO: task rsync:16598 blocked for more than
120 seconds.
[Tue Jan 31 12:55:10 2012] "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Tue Jan 31 12:55:10 2012] rsync D 0000000106ebce55 0
16598 16597 0x00000000
[Tue Jan 31 12:55:10 2012] ffff88000236f758 0000000000000086
ffff88000236f678 ffffffff8104f373
[Tue Jan 31 12:55:10 2012] ffff880025859560 ffff88000236ffd8
ffff88000236ffd8 ffff88000236ffd8
[Tue Jan 31 12:55:10 2012] ffff880202d21c80 ffff880025859560
ffff88000236f6a8 ffffffffa01a31be
[Tue Jan 31 12:55:10 2012] Call Trace:
[Tue Jan 31 12:55:10 2012] [<ffffffff8104f373>] ? __wake_up+0x53/0x70
[Tue Jan 31 12:55:10 2012] [<ffffffffa01a31be>] ?
loop_make_request+0xde/0x110 [loop]
[Tue Jan 31 12:55:10 2012] [<ffffffff8121d877>] ?
generic_make_request+0xc7/0x100
[Tue Jan 31 12:55:10 2012] [<ffffffff8121d937>] ? submit_bio+0x87/0x110
[Tue Jan 31 12:55:10 2012] [<ffffffff8101d639>] ? read_tsc+0x9/0x20
[Tue Jan 31 12:55:10 2012] [<ffffffff8109271d>] ?
ktime_get_ts+0xad/0xe0
[Tue Jan 31 12:55:10 2012] [<ffffffff811055d0>] ? __lock_page+0x70/0x70
[Tue Jan 31 12:55:10 2012] [<ffffffff814258bf>] schedule+0x3f/0x60
[Tue Jan 31 12:55:10 2012] [<ffffffff8142596f>] io_schedule+0x8f/0xd0
[Tue Jan 31 12:55:10 2012] [<ffffffff811055de>] sleep_on_page+0xe/0x20
[Tue Jan 31 12:55:10 2012] [<ffffffff8142611f>] __wait_on_bit+0x5f/0x90
[Tue Jan 31 12:55:10 2012] [<ffffffff811057c8>]
wait_on_page_bit+0x78/0x80
[Tue Jan 31 12:55:10 2012] [<ffffffff81088cf0>] ?
autoremove_wake_function+0x40/0x40
[Tue Jan 31 12:55:10 2012] [<ffffffffa04ffe66>]
read_extent_buffer_pages+0x476/0x510 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04d6f90>] ?
verify_parent_transid+0x160/0x160 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04d815a>]
btree_read_extent_buffer_pages.isra.100+0x8a/0xc0 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04d98f1>]
read_tree_block+0x41/0x60 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04c0ca3>]
read_block_for_search.isra.33+0xf3/0x3d0 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04c0577>] ?
generic_bin_search.constprop.35+0xe7/0x160 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04c2fe0>]
btrfs_search_slot+0x390/0x8a0 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04d5eef>]
btrfs_lookup_inode+0x2f/0xa0 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04e9b31>] btrfs_iget+0x101/0x490
[btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffffa04ea7e5>] ?
btrfs_lookup_dentry+0x4a5/0x4e0 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffff8117d000>] ? d_validate+0x10/0xb0
[Tue Jan 31 12:55:10 2012] [<ffffffffa04ea793>]
btrfs_lookup_dentry+0x453/0x4e0 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffff8107150a>] ? ns_capable+0x2a/0x60
[Tue Jan 31 12:55:10 2012] [<ffffffff811735e9>] ?
generic_permission+0x149/0x280
[Tue Jan 31 12:55:10 2012] [<ffffffff8117f3e5>] ? __d_lookup+0xb5/0x170
[Tue Jan 31 12:55:10 2012] [<ffffffffa04ea83d>] btrfs_lookup+0x1d/0x60
[btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffff81172e9d>]
d_inode_lookup.isra.12+0x1d/0x50
[Tue Jan 31 12:55:10 2012] [<ffffffff81173292>] do_lookup+0x382/0x3d0
[Tue Jan 31 12:55:10 2012] [<ffffffff81172abb>] ?
getname_flags+0x3b/0x260
[Tue Jan 31 12:55:10 2012] [<ffffffff81174d0c>]
path_lookupat+0x11c/0x760
[Tue Jan 31 12:55:10 2012] [<ffffffff81175381>]
do_path_lookup+0x31/0xc0
[Tue Jan 31 12:55:10 2012] [<ffffffff811771d9>]
user_path_at_empty+0x59/0xa0
[Tue Jan 31 12:55:10 2012] [<ffffffff8116bb94>] ?
inode_get_bytes+0x44/0x60
[Tue Jan 31 12:55:10 2012] [<ffffffffa04e0df6>] ?
btrfs_getattr+0x56/0x90 [btrfs]
[Tue Jan 31 12:55:10 2012] [<ffffffff8116bd34>] ? cp_new_stat+0xe4/0xf0
[Tue Jan 31 12:55:10 2012] [<ffffffff81177231>] user_path_at+0x11/0x20
[Tue Jan 31 12:55:10 2012] [<ffffffff8116bf4a>] vfs_fstatat+0x3a/0x70
[Tue Jan 31 12:55:10 2012] [<ffffffff8116bf9e>] vfs_lstat+0x1e/0x20
[Tue Jan 31 12:55:10 2012] [<ffffffff8116c13a>] sys_newlstat+0x1a/0x40
[Tue Jan 31 12:55:10 2012] [<ffffffff814290c2>]
system_call_fastpath+0x16/0x1b
[Tue Jan 31 13:02:52 2012] device-mapper: uevent: version 1.0.3
[Tue Jan 31 13:02:52 2012] device-mapper: ioctl: 4.22.0-ioctl
(2011-10-19) initialised: dm-devel@redhat.com
[Tue Jan 31 13:23:10 2012] INFO: task rsync:13574 blocked for more than
120 seconds.
[Tue Jan 31 13:23:10 2012] "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Tue Jan 31 13:23:10 2012] rsync D 0000000106f37614 0
13574 12299 0x00000000
[Tue Jan 31 13:23:10 2012] ffff880012c29a88 0000000000000082
ffff880012c299a8 ffffffff8104f373
[Tue Jan 31 13:23:10 2012] ffff880202355ca0 ffff880012c29fd8
ffff880012c29fd8 ffff880012c29fd8
[Tue Jan 31 13:23:10 2012] ffff880202d21c80 ffff880202355ca0
ffff880012c299d8 ffffffffa01a31be
[Tue Jan 31 13:23:10 2012] Call Trace:
[Tue Jan 31 13:23:10 2012] [<ffffffff8104f373>] ? __wake_up+0x53/0x70
[Tue Jan 31 13:23:10 2012] [<ffffffffa01a31be>] ?
loop_make_request+0xde/0x110 [loop]
[Tue Jan 31 13:23:10 2012] [<ffffffff8121d877>] ?
generic_make_request+0xc7/0x100
[Tue Jan 31 13:23:10 2012] [<ffffffff8121d937>] ? submit_bio+0x87/0x110
[Tue Jan 31 13:23:10 2012] [<ffffffff8101d639>] ? read_tsc+0x9/0x20
[Tue Jan 31 13:23:10 2012] [<ffffffff8109271d>] ?
ktime_get_ts+0xad/0xe0
[Tue Jan 31 13:23:10 2012] [<ffffffff811055d0>] ? __lock_page+0x70/0x70
[Tue Jan 31 13:23:10 2012] [<ffffffff814258bf>] schedule+0x3f/0x60
[Tue Jan 31 13:23:10 2012] [<ffffffff8142596f>] io_schedule+0x8f/0xd0
[Tue Jan 31 13:23:10 2012] [<ffffffff811055de>] sleep_on_page+0xe/0x20
[Tue Jan 31 13:23:10 2012] [<ffffffff8142611f>] __wait_on_bit+0x5f/0x90
[Tue Jan 31 13:23:10 2012] [<ffffffff811057c8>]
wait_on_page_bit+0x78/0x80
[Tue Jan 31 13:23:10 2012] [<ffffffff81088cf0>] ?
autoremove_wake_function+0x40/0x40
[Tue Jan 31 13:23:10 2012] [<ffffffffa04ffe66>]
read_extent_buffer_pages+0x476/0x510 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04d6f90>] ?
verify_parent_transid+0x160/0x160 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04d815a>]
btree_read_extent_buffer_pages.isra.100+0x8a/0xc0 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04d98f1>]
read_tree_block+0x41/0x60 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04c0ca3>]
read_block_for_search.isra.33+0xf3/0x3d0 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04c2fe0>]
btrfs_search_slot+0x390/0x8a0 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffff8123a8bb>] ?
radix_tree_lookup+0xb/0x10
[Tue Jan 31 13:23:10 2012] [<ffffffffa04e0837>]
btrfs_real_readdir+0x1b7/0x720 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffff811798c0>] ? sys_ioctl+0xa0/0xa0
[Tue Jan 31 13:23:10 2012] [<ffffffff81426703>] ?
__mutex_lock_killable_slowpath+0x273/0x400
[Tue Jan 31 13:23:10 2012] [<ffffffff811798c0>] ? sys_ioctl+0xa0/0xa0
[Tue Jan 31 13:23:10 2012] [<ffffffff81179bc0>] vfs_readdir+0xb0/0xe0
[Tue Jan 31 13:23:10 2012] [<ffffffff81179ce9>] sys_getdents+0x89/0xf0
[Tue Jan 31 13:23:10 2012] [<ffffffff814290c2>]
system_call_fastpath+0x16/0x1b
[Tue Jan 31 13:23:10 2012] INFO: task rsync:19880 blocked for more than
120 seconds.
[Tue Jan 31 13:23:10 2012] "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Tue Jan 31 13:23:10 2012] rsync D 0000000106f37616 0
19880 19818 0x00000000
[Tue Jan 31 13:23:10 2012] ffff88019f8a3758 0000000000000086
ffff880100000000 ffffffff8104f373
[Tue Jan 31 13:23:10 2012] ffff8801e3e0b900 ffff88019f8a3fd8
ffff88019f8a3fd8 ffff88019f8a3fd8
[Tue Jan 31 13:23:10 2012] ffff880202cb4e60 ffff8801e3e0b900
ffff88019f8a36a8 ffffffffa01a31be
[Tue Jan 31 13:23:10 2012] Call Trace:
[Tue Jan 31 13:23:10 2012] [<ffffffff8104f373>] ? __wake_up+0x53/0x70
[Tue Jan 31 13:23:10 2012] [<ffffffffa01a31be>] ?
loop_make_request+0xde/0x110 [loop]
[Tue Jan 31 13:23:10 2012] [<ffffffff8121d877>] ?
generic_make_request+0xc7/0x100
[Tue Jan 31 13:23:10 2012] [<ffffffff8121d937>] ? submit_bio+0x87/0x110
[Tue Jan 31 13:23:10 2012] [<ffffffff8101d639>] ? read_tsc+0x9/0x20
[Tue Jan 31 13:23:10 2012] [<ffffffff811055d0>] ? __lock_page+0x70/0x70
[Tue Jan 31 13:23:10 2012] [<ffffffff814258bf>] schedule+0x3f/0x60
[Tue Jan 31 13:23:10 2012] [<ffffffff8142596f>] io_schedule+0x8f/0xd0
[Tue Jan 31 13:23:10 2012] [<ffffffff811055de>] sleep_on_page+0xe/0x20
[Tue Jan 31 13:23:10 2012] [<ffffffff8142611f>] __wait_on_bit+0x5f/0x90
[Tue Jan 31 13:23:10 2012] [<ffffffff811057c8>]
wait_on_page_bit+0x78/0x80
[Tue Jan 31 13:23:10 2012] [<ffffffff81088cf0>] ?
autoremove_wake_function+0x40/0x40
[Tue Jan 31 13:23:10 2012] [<ffffffffa04ffe66>]
read_extent_buffer_pages+0x476/0x510 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04d6f90>] ?
verify_parent_transid+0x160/0x160 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04d815a>]
btree_read_extent_buffer_pages.isra.100+0x8a/0xc0 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04d98f1>]
read_tree_block+0x41/0x60 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04c0ca3>]
read_block_for_search.isra.33+0xf3/0x3d0 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04c0577>] ?
generic_bin_search.constprop.35+0xe7/0x160 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04c2fe0>]
btrfs_search_slot+0x390/0x8a0 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04d5eef>]
btrfs_lookup_inode+0x2f/0xa0 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04e9b31>] btrfs_iget+0x101/0x490
[btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04ea7e5>] ?
btrfs_lookup_dentry+0x4a5/0x4e0 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffff8117d000>] ? d_validate+0x10/0xb0
[Tue Jan 31 13:23:10 2012] [<ffffffffa04ea793>]
btrfs_lookup_dentry+0x453/0x4e0 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffff8117f3e5>] ? __d_lookup+0xb5/0x170
[Tue Jan 31 13:23:10 2012] [<ffffffffa04ea83d>] btrfs_lookup+0x1d/0x60
[btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffff81172e9d>]
d_inode_lookup.isra.12+0x1d/0x50
[Tue Jan 31 13:23:10 2012] [<ffffffff81173292>] do_lookup+0x382/0x3d0
[Tue Jan 31 13:23:10 2012] [<ffffffff81174d0c>]
path_lookupat+0x11c/0x760
[Tue Jan 31 13:23:10 2012] [<ffffffff81175381>]
do_path_lookup+0x31/0xc0
[Tue Jan 31 13:23:10 2012] [<ffffffff811771d9>]
user_path_at_empty+0x59/0xa0
[Tue Jan 31 13:23:10 2012] [<ffffffff811798c0>] ? sys_ioctl+0xa0/0xa0
[Tue Jan 31 13:23:10 2012] [<ffffffff8116bb94>] ?
inode_get_bytes+0x44/0x60
[Tue Jan 31 13:23:10 2012] [<ffffffffa04e0df6>] ?
btrfs_getattr+0x56/0x90 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffff8116bd34>] ? cp_new_stat+0xe4/0xf0
[Tue Jan 31 13:23:10 2012] [<ffffffff81177231>] user_path_at+0x11/0x20
[Tue Jan 31 13:23:10 2012] [<ffffffff8116bf4a>] vfs_fstatat+0x3a/0x70
[Tue Jan 31 13:23:10 2012] [<ffffffff8116bf9e>] vfs_lstat+0x1e/0x20
[Tue Jan 31 13:23:10 2012] [<ffffffff8116c13a>] sys_newlstat+0x1a/0x40
[Tue Jan 31 13:23:10 2012] [<ffffffff814290c2>]
system_call_fastpath+0x16/0x1b
[Tue Jan 31 13:23:10 2012] INFO: task rsync:20089 blocked for more than
120 seconds.
[Tue Jan 31 13:23:10 2012] "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Tue Jan 31 13:23:10 2012] rsync D 0000000106f37615 0
20089 20088 0x00000000
[Tue Jan 31 13:23:10 2012] ffff880046403758 0000000000000086
ffff880000000000 ffffffff8104f373
[Tue Jan 31 13:23:10 2012] ffff8801e3e0c020 ffff880046403fd8
ffff880046403fd8 ffff880046403fd8
[Tue Jan 31 13:23:10 2012] ffff880202cb4e60 ffff8801e3e0c020
ffff8800464036a8 ffffffffa01a31be
[Tue Jan 31 13:23:10 2012] Call Trace:
[Tue Jan 31 13:23:10 2012] [<ffffffff8104f373>] ? __wake_up+0x53/0x70
[Tue Jan 31 13:23:10 2012] [<ffffffffa01a31be>] ?
loop_make_request+0xde/0x110 [loop]
[Tue Jan 31 13:23:10 2012] [<ffffffff8121d877>] ?
generic_make_request+0xc7/0x100
[Tue Jan 31 13:23:10 2012] [<ffffffff8121d937>] ? submit_bio+0x87/0x110
[Tue Jan 31 13:23:10 2012] [<ffffffff8101d639>] ? read_tsc+0x9/0x20
[Tue Jan 31 13:23:10 2012] [<ffffffff811055d0>] ? __lock_page+0x70/0x70
[Tue Jan 31 13:23:10 2012] [<ffffffff814258bf>] schedule+0x3f/0x60
[Tue Jan 31 13:23:10 2012] [<ffffffff8142596f>] io_schedule+0x8f/0xd0
[Tue Jan 31 13:23:10 2012] [<ffffffff811055de>] sleep_on_page+0xe/0x20
[Tue Jan 31 13:23:10 2012] [<ffffffff8142611f>] __wait_on_bit+0x5f/0x90
[Tue Jan 31 13:23:10 2012] [<ffffffff811057c8>]
wait_on_page_bit+0x78/0x80
[Tue Jan 31 13:23:10 2012] [<ffffffff81088cf0>] ?
autoremove_wake_function+0x40/0x40
[Tue Jan 31 13:23:10 2012] [<ffffffffa04ffe66>]
read_extent_buffer_pages+0x476/0x510 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04d6f90>] ?
verify_parent_transid+0x160/0x160 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04d815a>]
btree_read_extent_buffer_pages.isra.100+0x8a/0xc0 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04d98f1>]
read_tree_block+0x41/0x60 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04c0ca3>]
read_block_for_search.isra.33+0xf3/0x3d0 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04c0577>] ?
generic_bin_search.constprop.35+0xe7/0x160 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04c2fe0>]
btrfs_search_slot+0x390/0x8a0 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04d5eef>]
btrfs_lookup_inode+0x2f/0xa0 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04e9b31>] btrfs_iget+0x101/0x490
[btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffffa04ea7e5>] ?
btrfs_lookup_dentry+0x4a5/0x4e0 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffff8117d000>] ? d_validate+0x10/0xb0
[Tue Jan 31 13:23:10 2012] [<ffffffff81354f9b>] ?
__alloc_skb+0x4b/0x240
[Tue Jan 31 13:23:10 2012] [<ffffffffa04ea793>]
btrfs_lookup_dentry+0x453/0x4e0 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffff81090bc4>] ? in_group_p+0x34/0x40
[Tue Jan 31 13:23:10 2012] [<ffffffff81173622>] ?
generic_permission+0x182/0x280
[Tue Jan 31 13:23:10 2012] [<ffffffff8117f3e5>] ? __d_lookup+0xb5/0x170
[Tue Jan 31 13:23:10 2012] [<ffffffffa04ea83d>] btrfs_lookup+0x1d/0x60
[btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffff81172e9d>]
d_inode_lookup.isra.12+0x1d/0x50
[Tue Jan 31 13:23:10 2012] [<ffffffff81173292>] do_lookup+0x382/0x3d0
[Tue Jan 31 13:23:10 2012] [<ffffffff81174d0c>]
path_lookupat+0x11c/0x760
[Tue Jan 31 13:23:10 2012] [<ffffffff81175381>]
do_path_lookup+0x31/0xc0
[Tue Jan 31 13:23:10 2012] [<ffffffff811771d9>]
user_path_at_empty+0x59/0xa0
[Tue Jan 31 13:23:10 2012] [<ffffffff8116bb94>] ?
inode_get_bytes+0x44/0x60
[Tue Jan 31 13:23:10 2012] [<ffffffffa04e0df6>] ?
btrfs_getattr+0x56/0x90 [btrfs]
[Tue Jan 31 13:23:10 2012] [<ffffffff8116bd34>] ? cp_new_stat+0xe4/0xf0
[Tue Jan 31 13:23:10 2012] [<ffffffff81177231>] user_path_at+0x11/0x20
[Tue Jan 31 13:23:10 2012] [<ffffffff8116bf4a>] vfs_fstatat+0x3a/0x70
[Tue Jan 31 13:23:10 2012] [<ffffffff8116bf9e>] vfs_lstat+0x1e/0x20
[Tue Jan 31 13:23:10 2012] [<ffffffff8116c13a>] sys_newlstat+0x1a/0x40
[Tue Jan 31 13:23:10 2012] [<ffffffff814290c2>]
system_call_fastpath+0x16/0x1b
> Increased the stripe_cache_size to 4096 according to the workaround for ths
> old similiar bug. Is the bug back in the recent kernels?
>
> Has not seen any freezes since that workaround but oth they weren't that
> frequent earlier either.
>
>
>> Feb 5 02:51:04 mythserv kernel: INFO: task lessfs:2687 blocked for more than
>> 120 seconds.
>> Feb 5 02:51:04 mythserv kernel: “echo 0>
>> /proc/sys/kernel/hung_task_timeout_secs” disables this message.
>> Feb 5 02:51:04 mythserv kernel: lessfs D ffff88006faf1998 0 2687 1
>> 0×00000000 Feb 5 02:51:04 mythserv kernel: ffff880066579828
>> 0000000000000086 ffff8800665797b8 ffffffff00000000
>> Feb 5 02:51:04 mythserv kernel: ffff88006faf1620 0000000000013300
>> ffff880066579fd8 ffff880066578010
>> Feb 5 02:51:04 mythserv kernel: ffff880066579fd8 0000000000013300
>> ffffffff81655020 ffff88006faf1620
>> Feb 5 02:51:04 mythserv kernel: Call Trace:
>> Feb 5 02:51:04 mythserv kernel: [] schedule+0x3f/0×60
>> Feb 5 02:51:04 mythserv kernel: [] get_active_stripe+0x2ea/0×790 [raid456]
>> Feb 5 02:51:04 mythserv kernel: [] ? try_to_wake_up+0x2b0/0x2b0
>> Feb 5 02:51:04 mythserv kernel: [] make_request+0x1ae/0×460 [raid456]
>> Feb 5 02:51:04 mythserv kernel: [] ? wake_up_bit+0×40/0×40
>> Feb 5 02:51:04 mythserv kernel: [] md_make_request+0xd5/0×200
>> Feb 5 02:51:04 mythserv kernel: [] generic_make_request+0xbf/0xf0
>> Feb 5 02:51:04 mythserv kernel: [] submit_bio+0×85/0×110
>> Feb 5 02:51:04 mythserv kernel: [] ? __bio_add_page+0×110/0×250
>> Feb 5 02:51:04 mythserv kernel: [] xfs_submit_ioend_bio+0×57/0×80 [xfs]
>> Feb 5 02:51:04 mythserv kernel: [] xfs_submit_ioend+0xf6/0×110 [xfs]
>> Feb 5 02:51:04 mythserv kernel: [] xfs_vm_writepage+0×230/0×500 [xfs]
>> Feb 5 02:51:04 mythserv kernel: [] __writepage+0×17/0×40
>> Feb 5 02:51:04 mythserv kernel: [] write_cache_pages+0×221/0x4a0
>> Feb 5 02:51:04 mythserv kernel: [] ? tomoyo_init_request_info+0x3f/0×70
>> Feb 5 02:51:04 mythserv kernel: [] ? set_page_dirty+0×70/0×70
>> Feb 5 02:51:04 mythserv kernel: [] generic_writepages+0×51/0×80
>> Feb 5 02:51:04 mythserv kernel: [] xfs_vm_writepages+0×53/0×70 [xfs]
>> Feb 5 02:51:04 mythserv kernel: [] do_writepages+0×21/0×40
>> Feb 5 02:51:04 mythserv kernel: [] __filemap_fdatawrite_range+0x5b/0×60
>> Feb 5 02:51:04 mythserv kernel: [] filemap_write_and_wait_range+0x5a/0×80
>> Feb 5 02:51:04 mythserv kernel: [] xfs_file_fsync+0×68/0x2d0 [xfs]
>> Feb 5 02:51:04 mythserv kernel: [] vfs_fsync_range+0x2b/0×40
>> Feb 5 02:51:04 mythserv kernel: [] vfs_fsync+0x1c/0×20
>> Feb 5 02:51:04 mythserv kernel: [] do_fsync+0x3a/0×60
>> Feb 5 02:51:04 mythserv kernel: [] sys_fsync+0×10/0×20
>> Feb 5 02:51:04 mythserv kernel: [] system_call_fastpath+0×16/0x1b
>>
>> Any hints? Or any debugging I can do to help? I did find a similar cas from
>> 2008, but that is supposed to be fixed now.
>> This also started after updating the kernel to the 3.x series. At the moment
>> using 3.2.2 and still seeing it.
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
prev parent reply other threads:[~2012-02-16 13:43 UTC|newest]
Thread overview: 3+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-02-05 16:55 Hand in Raid-5 code Dag Nygren
2012-02-09 2:55 ` Hang in Raid-5 code (Old bug back?) Dag Nygren
2012-02-16 13:43 ` Konstantinos Skarlatos [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=4F3D07FE.6010601@gmail.com \
--to=k.skarlatos@gmail.com \
--cc=dag@newtech.fi \
--cc=linux-raid@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).