From mboxrd@z Thu Jan 1 00:00:00 1970 From: Stephane Chazelas Subject: Re: btrfs hung tasks Date: Thu, 28 Jul 2011 09:46:47 +0100 Message-ID: References: <20110728062343.GA4656@yahoo.fr> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii To: linux-btrfs@vger.kernel.org Return-path: In-Reply-To: <20110728062343.GA4656@yahoo.fr> List-ID: 2011-07-28 07:23:43 +0100, Stephane Chazelas: > Hiya, I got below those last night. That was 3 minutes after a > bunch of rsync and ntfsclone processes started. > > It's the first time it happens. I upgraded from 3.0rc6 to 3.0 > yesterday. [...] And again this morning, though at that point only one ntfsclone process was actively writing to the FS. At this point, I can read directories and stat(2) files on that FS, but reading or writing files hangs. I'll try and revert to 3.0rc6 to see if that makes a difference. call traces for some processes trying to read from the FS: cat D ffff8801424ee240 0 3478 1 0x00000005 ffff8801424ee240 0000000000000086 ffff8801080497e8 ffff8800494322e0 ffff8801461908b0 0000000000012800 ffff880108049fd8 ffff880108049fd8 0000000000012800 ffff8801424ee240 0000000000012800 0000000000012800 Call Trace: [] ? _raw_spin_lock_irqsave+0x9/0x25 [] ? btrfs_tree_lock+0x9a/0xa7 [btrfs] [] ? btrfs_spin_on_block+0x49/0x49 [btrfs] [] ? btrfs_set_path_blocking+0x21/0x32 [btrfs] [] ? btrfs_search_slot+0x3c6/0x4d6 [btrfs] [] ? btrfs_lookup_csum+0x65/0x105 [btrfs] [] ? btrfs_lookup_ordered_extent+0x2b/0x69 [btrfs] [] ? btrfs_find_ordered_sum+0x34/0xcc [btrfs] [] ? __btrfs_lookup_bio_sums+0x16f/0x2ed [btrfs] [] ? btrfs_submit_compressed_read+0x3b7/0x42e [btrfs] [] ? submit_one_bio+0x85/0xbc [btrfs] [] ? submit_extent_page.clone.16+0x118/0x1b9 [btrfs] [] ? check_page_uptodate+0x36/0x36 [btrfs] [] ? __extent_read_full_page+0x463/0x4cc [btrfs] [] ? check_page_uptodate+0x36/0x36 [btrfs] [] ? uncompress_inline.clone.32+0x117/0x117 [btrfs] [] ? extent_readpages+0xb1/0xf6 [btrfs] [] ? uncompress_inline.clone.32+0x117/0x117 [btrfs] [] ? __do_page_cache_readahead+0x124/0x1c8 [] ? ra_submit+0x1c/0x23 [] ? generic_file_aio_read+0x2a7/0x5c7 [] ? do_sync_read+0xb1/0xea [] ? _raw_spin_lock_irq+0xd/0x1a [] ? vfs_read+0x9f/0xf2 [] ? syscall_trace_enter+0xb5/0x15d [] ? sys_read+0x45/0x6b [] ? tracesys+0xd9/0xde wc D ffff8801424ef710 0 3495 1 0x00000005 ffff8801424ef710 0000000000000086 ffffffff811ab802 ffff88014951f5c0 ffffffff8160b020 0000000000012800 ffff880109617fd8 ffff880109617fd8 0000000000012800 ffff8801424ef710 0000000000012800 0000000000012800 Call Trace: [] ? delay_tsc+0x2b/0x68 [] ? _raw_spin_lock_irqsave+0x9/0x25 [] ? btrfs_tree_lock+0x9a/0xa7 [btrfs] [] ? btrfs_spin_on_block+0x49/0x49 [btrfs] [] ? map_private_extent_buffer+0xa3/0xc4 [btrfs] [] ? btrfs_lock_root_node+0x1d/0x3f [btrfs] [] ? btrfs_search_slot+0xe6/0x4d6 [btrfs] [] ? btrfs_header_generation.clone.17+0xf/0x14 [btrfs] [] ? btrfs_lookup_csum+0x65/0x105 [btrfs] [] ? btrfs_lookup_ordered_extent+0x2b/0x69 [btrfs] [] ? btrfs_find_ordered_sum+0x34/0xcc [btrfs] [] ? __btrfs_lookup_bio_sums+0x16f/0x2ed [btrfs] [] ? btrfs_submit_bio_hook+0xa4/0x129 [btrfs] [] ? submit_one_bio+0x85/0xbc [btrfs] [] ? submit_extent_page.clone.16+0x118/0x1b9 [btrfs] [] ? check_page_uptodate+0x36/0x36 [btrfs] [] ? __extent_read_full_page+0x463/0x4cc [btrfs] [] ? check_page_uptodate+0x36/0x36 [btrfs] [] ? uncompress_inline.clone.32+0x117/0x117 [btrfs] [] ? extent_readpages+0xb1/0xf6 [btrfs] [] ? uncompress_inline.clone.32+0x117/0x117 [btrfs] [] ? __do_page_cache_readahead+0x124/0x1c8 [] ? ra_submit+0x1c/0x23 [] ? generic_file_aio_read+0x26b/0x5c7 [] ? do_sync_read+0xb1/0xea [] ? _raw_spin_lock_irq+0xd/0x1a [] ? vfs_read+0x9f/0xf2 [] ? syscall_trace_enter+0xb5/0x15d [] ? sys_read+0x45/0x6b [] ? tracesys+0xd9/0xde tail D ffff88014651b750 0 3442 1844 0x00000004 ffff88014651b750 0000000000000082 ffff880147b06508 ffffffff00000000 ffff8801495660c0 0000000000012800 ffff88010e05dfd8 ffff88010e05dfd8 0000000000012800 ffff88014651b750 0000000000012800 0000000000012800 Call Trace: [] ? __mutex_lock_common.clone.5+0x114/0x179 [] ? mutex_lock+0x1a/0x2d [] ? generic_file_llseek+0x21/0x52 [] ? sys_lseek+0x3c/0x59 [] ? system_call_fastpath+0x16/0x1b rm D ffff8801424bd060 0 3504 1 0x00000005 ffff8801424bd060 0000000000000086 0000000000000000 0000000000000001 ffff8801495660c0 0000000000012800 ffff880118b21fd8 ffff880118b21fd8 0000000000012800 ffff8801424bd060 0000000000012800 0000000000012800 Call Trace: [] ? _raw_spin_lock_irqsave+0x9/0x25 [] ? wait_current_trans.clone.22+0xa1/0xd0 [btrfs] [] ? wake_up_bit+0x23/0x23 [] ? start_transaction+0xd9/0x227 [btrfs] [] ? __unlink_start_trans+0x52/0x399 [btrfs] [] ? should_resched+0x5/0x24 [] ? _cond_resched+0x9/0x20 [] ? generic_permission+0xe/0x9b [] ? btrfs_unlink+0x1e/0xa4 [btrfs] [] ? vfs_unlink+0x65/0xbe [] ? do_unlinkat+0xc6/0x14d [] ? ptrace_report_syscall.clone.8+0x27/0x4f [] ? syscall_trace_enter+0xb5/0x15d [] ? tracesys+0xd9/0xde tee D ffff88013d9d4140 0 3506 1 0x00000005 ffff88013d9d4140 0000000000000082 ffff880142634c40 ffff880142634730 ffffffff8160b020 0000000000012800 ffff88007e18bfd8 ffff88007e18bfd8 0000000000012800 ffff88013d9d4140 0000000000012800 0000000000012800 Call Trace: [] ? perf_event_task_sched_out+0x48/0x54 [] ? __mutex_lock_common.clone.5+0x114/0x179 [] ? exec_permission+0x1f/0x7d [] ? mutex_lock+0x1a/0x2d [] ? do_last+0x19b/0x584 [] ? path_openat+0xc7/0x349 [] ? _raw_spin_lock_irq+0xd/0x1a [] ? do_filp_open+0x2c/0x72 [] ? _cond_resched+0x9/0x20 [] ? __strncpy_from_user+0x19/0x4a [] ? alloc_fd+0x69/0x110 [] ? do_sys_open+0x5f/0xe6 [] ? tracesys+0xd9/0xde ntfsclone D ffff88013e4fd160 0 2757 2601 0x00000004 ffff88013e4fd160 0000000000000082 ffff88013f390710 ffffffff81023145 ffff8801495660c0 0000000000012800 ffff8801094f1fd8 ffff8801094f1fd8 0000000000012800 ffff88013e4fd160 0000000000012800 0000000000012800 Call Trace: [] ? _flat_send_IPI_mask+0x6a/0x7c [] ? read_tsc+0x5/0x14 [] ? timekeeping_get_ns+0xd/0x2a [] ? lock_page+0x20/0x20 [] ? io_schedule+0x5b/0x75 [] ? sleep_on_page+0x9/0x10 [] ? __wait_on_bit+0x3e/0x71 [] ? should_resched+0x5/0x24 [] ? _cond_resched+0x9/0x20 [] ? wait_on_page_bit+0x6a/0x70 [] ? autoremove_wake_function+0x2a/0x2a [] ? prepare_pages.clone.12+0x15b/0x2fd [btrfs] [] ? __btrfs_buffered_write.clone.14+0x132/0x29a [btrfs] [] ? inode_to_bdi+0x20/0x42 [] ? btrfs_file_aio_write+0x39b/0x435 [btrfs] [] ? do_sync_write+0xb1/0xea [] ? fsnotify+0x23d/0x24f [] ? security_file_permission+0x18/0x33 [] ? vfs_write+0xa6/0xf9 [] ? sys_write+0x45/0x6b [] ? system_call_fastpath+0x16/0x1b Best regards, Stephane