From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from [173.234.39.99] ([173.234.39.99]:54940 "EHLO mail.mystoragebox.com" rhost-flags-FAIL-FAIL-OK-OK) by vger.kernel.org with ESMTP id S1751914AbaCIUuZ (ORCPT ); Sun, 9 Mar 2014 16:50:25 -0400 Received: from cpe-67-240-76-244.nycap.res.rr.com ([67.240.76.244] helo=[192.168.5.80]) by mail.mystoragebox.com with esmtpsa (TLS1.0:DHE_RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from ) id 1WMkfL-00023p-Jo for linux-btrfs@vger.kernel.org; Sun, 09 Mar 2014 16:49:47 -0400 Message-ID: <531CD3EB.1090401@intellasoft.net> Date: Sun, 09 Mar 2014 16:49:47 -0400 From: Mark Murawski MIME-Version: 1.0 To: linux-btrfs@vger.kernel.org Subject: Re: Task Hang References: <5315E105.3000003@intellasoft.net> <5315EA04.5010303@fb.com> <5318A6C5.8040309@intellasoft.net> In-Reply-To: <5318A6C5.8040309@intellasoft.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Sender: linux-btrfs-owner@vger.kernel.org List-ID: Soooo... was this a help to anyone? On 03/06/14 11:48, Mark Murawski wrote: > Not the same problem, but I do have a lockup with another situation. > > I tried adding some new devices... but accidentally screwed up the > syntax (not sure if this had anything to do with the lockup) > > btrfs device add / /dev/sdb > probe of / failed, cannot detect existing filesystem. > Use the -f option to force overwrite. > > office-backup {~} root# btrfs device add /dev/sdb /dev/sdd > ERROR: error adding the device '/dev/sdb' - Inappropriate ioctl for device > > > D 1772 [btrfs-transacti] > D 6530 [btrfs-submit-2] > D 7301 /usr/bin/perl /usr/share/backuppc/bin/BackupPC_link demo3 > D 7471 fdisk /dev/sdb > D 7523 [btrfs-submit-2] > D 7526 -bash > D 7527 -bash > D 28611 /usr/bin/perl /usr/share/backuppc/bin/BackupPC_trashClean > > Attached is output from w to sysrq > > > > On 03/04/2014 09:58 AM, Josef Bacik wrote: >> -----BEGIN PGP SIGNED MESSAGE----- >> Hash: SHA1 >> >> On 03/04/2014 09:19 AM, Mark Murawski wrote: >>> I have btrfs as the fs for a backuppc box. updatedb was running at >>> the same time as a massive rsync. >>> >>> Mar 4 08:31:00 office-backup kernel: INFO: task >>> updatedb.mlocat:903 blocked for more than 120 seconds. Mar 4 >>> 08:31:00 office-backup kernel: Not tainted 3.13.2 #3 Mar 4 >>> 08:31:00 office-backup kernel: "echo 0 > >>> /proc/sys/kernel/hung_task_timeout_secs" disables this message. Mar >>> 4 08:31:00 office-backup kernel: updatedb.mlocat D >>> 0000000000000000 0 903 899 0x00000000 Mar 4 08:31:00 >>> office-backup kernel: ffff88007cad6270 0000000000000086 >>> ffff88007c0ee900 0000000000004000 Mar 4 08:31:00 office-backup >>> kernel: ffff88005a705fd8 ffff88007cad6270 000000541a6be000 >>> ffff88007b9ac000 Mar 4 08:31:00 office-backup kernel: >>> ffff88001ad2ef68 ffff880001f97000 ffff8800452d4480 >>> ffffffff812c3e5c Mar 4 08:31:00 office-backup kernel: Call Trace: >>> Mar 4 08:31:00 office-backup kernel: [] ? >>> btrfs_map_bio+0x4ac/0x5a0 Mar 4 08:31:00 office-backup kernel: >>> [] ? repair_io_failure+0x210/0x210 Mar 4 >>> 08:31:00 office-backup kernel: [] ? >>> __lock_page+0x70/0x70 Mar 4 08:31:00 office-backup kernel: >>> [] ? io_schedule+0x87/0xd0 Mar 4 08:31:00 >>> office-backup kernel: [] ? >>> sleep_on_page+0x9/0x10 Mar 4 08:31:00 office-backup kernel: >>> [] ? __wait_on_bit+0x52/0x80 Mar 4 08:31:00 >>> office-backup kernel: [] ? >>> btree_submit_bio_hook+0xe1/0x110 Mar 4 08:31:00 office-backup >>> kernel: [] ? wait_on_page_bit+0x73/0x80 Mar 4 >>> 08:31:00 office-backup kernel: [] ? >>> wake_atomic_t_function+0x30/0x30 Mar 4 08:31:00 office-backup >>> kernel: [] ? >>> read_extent_buffer_pages+0x2aa/0x2e0 Mar 4 08:31:00 office-backup >>> kernel: [] ? add_to_page_cache_lru+0x25/0x40 Mar >>> 4 08:31:00 office-backup kernel: [] ? >>> radix_tree_insert+0x91/0x250 Mar 4 08:31:00 office-backup kernel: >>> [] ? verify_parent_transid+0x170/0x170 Mar 4 >>> 08:31:00 office-backup kernel: [] ? >>> btree_read_extent_buffer_pages.constprop.126+0xa9/0x110 Mar 4 >>> 08:31:00 office-backup kernel: [] ? >>> read_tree_block+0x33/0x60 Mar 4 08:31:00 office-backup kernel: >>> [] ? read_block_for_search.isra.45+0x18c/0x3b0 >>> Mar 4 08:31:00 office-backup kernel: [] ? >>> comp_keys+0x27/0x30 Mar 4 08:31:00 office-backup kernel: >>> [] ? btrfs_search_slot+0x41c/0x920 Mar 4 >>> 08:31:00 office-backup kernel: [] ? >>> btrfs_get_token_16+0x61/0xf0 Mar 4 08:31:00 office-backup kernel: >>> [] ? btrfs_lookup_inode+0x25/0xa0 Mar 4 08:31:00 >>> office-backup kernel: [] ? >>> kmem_cache_alloc+0xc0/0xe0 Mar 4 08:31:00 office-backup kernel: >>> [] ? btrfs_iget+0x103/0x520 Mar 4 08:31:00 >>> office-backup kernel: [] ? >>> btrfs_lookup_dir_item+0x9f/0xd0 Mar 4 08:31:00 office-backup >>> kernel: [] ? btrfs_lookup_dentry+0x3db/0x4c0 Mar >>> 4 08:31:00 office-backup kernel: [] ? >>> btrfs_lookup+0x9/0x20 Mar 4 08:31:00 office-backup kernel: >>> [] ? lookup_real+0x14/0x50 Mar 4 08:31:00 >>> office-backup kernel: [] ? >>> __lookup_hash+0x32/0x50 Mar 4 08:31:00 office-backup kernel: >>> [] ? lookup_slow+0x48/0xc0 Mar 4 08:31:00 >>> office-backup kernel: [] ? >>> path_lookupat+0x711/0x760 Mar 4 08:31:00 office-backup kernel: >>> [] ? filename_lookup+0x2f/0xd0 Mar 4 08:31:00 >>> office-backup kernel: [] ? >>> getname_flags+0xb7/0x190 Mar 4 08:31:00 office-backup kernel: >>> [] ? user_path_at_empty+0x5e/0xb0 Mar 4 08:31:00 >>> office-backup kernel: [] ? >>> cp_new_stat+0x10d/0x120 Mar 4 08:31:00 office-backup kernel: >>> [] ? vfs_fstatat+0x41/0x90 Mar 4 08:31:00 >>> office-backup kernel: [] ? >>> SyS_newlstat+0x12/0x30 Mar 4 08:31:00 office-backup kernel: >>> [] ? system_call_fastpath+0x16/0x1b Mar 4 >>> 08:55:01 office-backup kernel: INFO: task updatedb.mlocat:903 >>> blocked for more than 120 seconds. Mar 4 08:55:01 office-backup >>> kernel: Not tainted 3.13.2 #3 Mar 4 08:55:01 office-backup >>> kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables >>> this message. Mar 4 08:55:01 office-backup kernel: updatedb.mlocat >>> D 0000000000000000 0 903 899 0x00000000 Mar 4 08:55:01 >>> office-backup kernel: ffff88007cad6270 0000000000000086 >>> ffff88007bb020d0 0000000000004000 Mar 4 08:55:01 office-backup >>> kernel: ffff88005a705fd8 ffff88007cad6270 00000055b6aee000 >>> ffff88007b9ac000 Mar 4 08:55:01 office-backup kernel: >>> ffff8800048282e8 ffff880076f80000 ffff8800272a09c0 >>> ffffffff812c3e5c Mar 4 08:55:01 office-backup kernel: Call Trace: >>> Mar 4 08:55:01 office-backup kernel: [] ? >>> btrfs_map_bio+0x4ac/0x5a0 Mar 4 08:55:01 office-backup kernel: >>> [] ? repair_io_failure+0x210/0x210 Mar 4 >>> 08:55:01 office-backup kernel: [] ? >>> __lock_page+0x70/0x70 Mar 4 08:55:01 office-backup kernel: >>> [] ? io_schedule+0x87/0xd0 Mar 4 08:55:01 >>> office-backup kernel: [] ? >>> sleep_on_page+0x9/0x10 Mar 4 08:55:01 office-backup kernel: >>> [] ? __wait_on_bit+0x52/0x80 Mar 4 08:55:01 >>> office-backup kernel: [] ? >>> btree_submit_bio_hook+0xe1/0x110 Mar 4 08:55:01 office-backup >>> kernel: [] ? wait_on_page_bit+0x73/0x80 Mar 4 >>> 08:55:01 office-backup kernel: [] ? >>> wake_atomic_t_function+0x30/0x30 Mar 4 08:55:01 office-backup >>> kernel: [] ? >>> read_extent_buffer_pages+0x2aa/0x2e0 Mar 4 08:55:01 office-backup >>> kernel: [] ? add_to_page_cache_lru+0x25/0x40 Mar >>> 4 08:55:01 office-backup kernel: [] ? >>> verify_parent_transid+0x170/0x170 Mar 4 08:55:01 office-backup >>> kernel: [] ? >>> btree_read_extent_buffer_pages.constprop.126+0xa9/0x110 Mar 4 >>> 08:55:01 office-backup kernel: [] ? >>> read_tree_block+0x33/0x60 Mar 4 08:55:01 office-backup kernel: >>> [] ? read_block_for_search.isra.45+0x18c/0x3b0 >>> Mar 4 08:55:01 office-backup kernel: [] ? >>> comp_keys+0x27/0x30 Mar 4 08:55:01 office-backup kernel: >>> [] ? btrfs_search_slot+0x41c/0x920 Mar 4 >>> 08:55:01 office-backup kernel: [] ? >>> btrfs_get_token_16+0x61/0xf0 Mar 4 08:55:01 office-backup kernel: >>> [] ? btrfs_lookup_inode+0x25/0xa0 Mar 4 08:55:01 >>> office-backup kernel: [] ? >>> kmem_cache_alloc+0xc0/0xe0 Mar 4 08:55:01 office-backup kernel: >>> [] ? btrfs_iget+0x103/0x520 Mar 4 08:55:01 >>> office-backup kernel: [] ? >>> btrfs_lookup_dir_item+0x9f/0xd0 Mar 4 08:55:01 office-backup >>> kernel: [] ? btrfs_lookup_dentry+0x3db/0x4c0 Mar >>> 4 08:55:01 office-backup kernel: [] ? >>> btrfs_lookup+0x9/0x20 Mar 4 08:55:01 office-backup kernel: >>> [] ? lookup_real+0x14/0x50 Mar 4 08:55:01 >>> office-backup kernel: [] ? >>> __lookup_hash+0x32/0x50 Mar 4 08:55:01 office-backup kernel: >>> [] ? lookup_slow+0x48/0xc0 Mar 4 08:55:01 >>> office-backup kernel: [] ? >>> path_lookupat+0x711/0x760 Mar 4 08:55:01 office-backup kernel: >>> [] ? filename_lookup+0x2f/0xd0 Mar 4 08:55:01 >>> office-backup kernel: [] ? >>> getname_flags+0xb7/0x190 Mar 4 08:55:01 office-backup kernel: >>> [] ? user_path_at_empty+0x5e/0xb0 Mar 4 08:55:01 >>> office-backup kernel: [] ? >>> cp_new_stat+0x10d/0x120 Mar 4 08:55:01 office-backup kernel: >>> [] ? vfs_fstatat+0x41/0x90 Mar 4 08:55:01 >>> office-backup kernel: [] ? >>> SyS_newlstat+0x12/0x30 Mar 4 08:55:01 office-backup kernel: >>> [] ? system_call_fastpath+0x16/0x1b >>> >> When this happens again do >> >> echo w > /proc/sysrq-trigger >> >> and then capture dmesg. Thanks, >> >> Josef >> >> -----BEGIN PGP SIGNATURE----- >> Version: GnuPG v1 >> Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ >> >> iQIcBAEBAgAGBQJTFen4AAoJEANb+wAKly3Ba6IP/1msfu3BEPbr4WmX85WHcdL1 >> MM+WHuDKCgt8hJwqiGZP3qjv+smjzDMMBeyRToAlm2f7MA9shmgE4gvwb1nMQQoG >> xfp7ZKPHAypRuYjiq1kmHanQf/vcv4iTCMba0PTBtg2VhMKxH9j9Cdp8/6nqrtRT >> QpZXh/1n8MLNBuaYkQ+SXGwqMT3Cgt2zC+NI2YuMtWJNvKpoqsF2IoFCcB8Uy7uX >> gG3zDeRyxJESVDMRGmzQOhNI+GW/vZ7EPSK8tjfqWwJJ0ilPhW+iAX7iqZPFr5iU >> WhpuQabw75bOcmEp06sk7RXz6EdLhuyTk1zeSZHmgFd9eqaAanfx93mdIk2VM/yC >> 7kOXrjq4k0QYSEvj11acB5pRB4WBwmELRpWmBa9Gqg31JTj4uScmkI4Gau9TKpwN >> qzx+xdNVdUE+W8vtdlvhL+UxEguqMrTLrvMS8wT2npgmylN9QT2jcVmeo+jdCm88 >> 7XI2fP6sP2d7QHhkGpH9bTJouBpH8Rfb2Erow1B+q67DBIHT6x9/RApIiczldX3D >> N6/vkbL4Ype8mp4oFUo5Tk0D9sTwAtxRoSDzYpD49u8AwLuloC42ielG85kctaBR >> GUhRpEurGY/w0vNlRzJBmkZGvEpq6IWSJaRe9eiMivCh8wsGAGdSf2Jtgg9q4oMS >> hMZI04MgEEfMs+6pwfeR >> =7EiY >> -----END PGP SIGNATURE----- >