From: "Stephen R. van den Berg" <srb@cuci.nl>
To: Qu Wenruo <quwenruo.btrfs@gmx.com>
Cc: Btrfs BTRFS <linux-btrfs@vger.kernel.org>
Subject: Re: Kernel traces
Date: Wed, 23 Jan 2019 16:50:46 +0100 [thread overview]
Message-ID: <20190123155046.GA8995@cuci.nl> (raw)
In-Reply-To: <20181228150016.GB13717@cuci.nl>
Stephen R. van den Berg wrote:
>Qu Wenruo wrote:
>>On 2018/12/28 ??????9:40, Stephen R. van den Berg wrote:
>>>> It's caused by qgroup, and a dead lock on btrfs_drop_snapshot().
>>>> This is one of the easiest way to trigger an ABBA deadlock.
>>>> Please either disable qgroup or apply this patch to solve it:
>>>> https://patchwork.kernel.org/patch/10725371/
>Ok, booting the system in v4.20 with this patch. I'll report back if
>it does not resolve the problem.
I now have a stuck btrfs receive again:
[ 0.000000] INFO: task btrfs:1850 blocked for more than 120 seconds.
[ 0.000000] Not tainted 94.20.0-srb-asrock-00002-gfb1bd063cc72 #141
[ 0.000000] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 0.000000] btrfs D 0 1850 1845 0x00000000
[ 0.000000] Call Trace:
[ 0.000000] ? __schedule+0x4db/0x524
[ 0.000000] ? schedule+0x60/0x71
[ 0.000000] ? btrfs_start_ordered_extent+0xd3/0x105
[ 0.000000] ? finish_wait+0x60/0x60
[ 0.000000] ? btrfs_wait_ordered_range+0xa4/0x100
[ 0.000000] ? unmap_mapping_pages+0x64/0x113
[ 0.000000] ? btrfs_setattr+0x20b/0x499
[ 0.000000] ? notify_change+0x268/0x347
[ 0.000000] ? do_truncate+0x82/0xb6
[ 0.000000] ? kmem_cache_alloc+0x9a/0x100
[ 0.000000] ? vfs_truncate+0xbc/0xda
[ 0.000000] ? do_sys_truncate+0x60/0xa9
[ 0.000000] ? do_syscall_64+0x4e/0x5b
[ 0.000000] ? entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 0.000000] INFO: task btrfs:1850 blocked for more than 120 seconds.
[ 0.000000] Not tainted 94.20.0-srb-asrock-00002-gfb1bd063cc72 #141
[ 0.000000] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 0.000000] btrfs D 0 1850 1845 0x00000000
[ 0.000000] Call Trace:
[ 0.000000] ? __schedule+0x4db/0x524
[ 0.000000] ? schedule+0x60/0x71
[ 0.000000] ? btrfs_start_ordered_extent+0xd3/0x105
[ 0.000000] ? finish_wait+0x60/0x60
[ 0.000000] ? btrfs_wait_ordered_range+0xa4/0x100
[ 0.000000] ? unmap_mapping_pages+0x64/0x113
[ 0.000000] ? btrfs_setattr+0x20b/0x499
[ 0.000000] ? notify_change+0x268/0x347
[ 0.000000] ? do_truncate+0x82/0xb6
[ 0.000000] ? kmem_cache_alloc+0x9a/0x100
[ 0.000000] ? vfs_truncate+0xbc/0xda
[ 0.000000] ? do_sys_truncate+0x60/0xa9
[ 0.000000] ? do_syscall_64+0x4e/0x5b
[ 0.000000] ? entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 0.000000] conftest[24422]: segfault at 7ffe21547e90 ip 000055ebaef881c4 sp 00007ffe21547e90 error 6 in conftest[55ebaef88000+1000]
[ 0.000000] Code: 1f 80 00 00 00 00 e9 7b ff ff ff 66 2e 0f 1f 84 00 00 00 00 00 90 48 81 ec f8 ff 00 00 8b 05 8f 2e 00 00 48 8d 35 40 0e 00 00 <48> 89 3c 24 48 8b 3d 81 2e 00 00 8d 90 00 00 01 00 31 c0 89 15 6f
[ 0.000000] perf: interrupt took too long (3977 > 3961), lowering kernel.perf_event_max_sample_rate to 50200
[ 0.000000] perf: interrupt took too long (4975 > 4971), lowering kernel.perf_event_max_sample_rate to 40200
[ 0.000000] conftest[4747]: segfault at 7ffd0e0fb540 ip 00005567d53c61c4 sp 00007ffd0e0fb540 error 6 in conftest[5567d53c6000+1000]
[ 0.000000] Code: 1f 80 00 00 00 00 e9 7b ff ff ff 66 2e 0f 1f 84 00 00 00 00 00 90 48 81 ec f8 ff 00 00 8b 05 8f 2e 00 00 48 8d 35 40 0e 00 00 <48> 89 3c 24 48 8b 3d 81 2e 00 00 8d 90 00 00 01 00 31 c0 89 15 6f
[ 0.000000] perf: interrupt took too long (6222 > 6218), lowering kernel.perf_event_max_sample_rate to 32100
[ 0.000000] INFO: task btrfs:16752 blocked for more than 120 seconds.
[ 0.000000] Not tainted 94.20.0-srb-asrock-00002-gfb1bd063cc72 #141
[ 0.000000] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 0.000000] btrfs D 0 16752 16745 0x00000000
[ 0.000000] Call Trace:
[ 0.000000] ? __schedule+0x4db/0x524
[ 0.000000] ? schedule+0x60/0x71
[ 0.000000] ? btrfs_start_ordered_extent+0xd3/0x105
[ 0.000000] ? finish_wait+0x60/0x60
[ 0.000000] ? btrfs_wait_ordered_range+0xa4/0x100
[ 0.000000] ? unmap_mapping_pages+0x64/0x113
[ 0.000000] ? btrfs_setattr+0x20b/0x499
[ 0.000000] ? notify_change+0x268/0x347
[ 0.000000] ? do_truncate+0x82/0xb6
[ 0.000000] ? kmem_cache_alloc+0x9a/0x100
[ 0.000000] ? vfs_truncate+0xbc/0xda
[ 0.000000] ? do_sys_truncate+0x60/0xa9
[ 0.000000] ? do_syscall_64+0x4e/0x5b
[ 0.000000] ? entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 0.000000] INFO: task btrfs:16752 blocked for more than 120 seconds.
[ 0.000000] Not tainted 94.20.0-srb-asrock-00002-gfb1bd063cc72 #141
[ 0.000000] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 0.000000] btrfs D 0 16752 16745 0x00000000
[ 0.000000] Call Trace:
[ 0.000000] ? __schedule+0x4db/0x524
[ 0.000000] ? schedule+0x60/0x71
[ 0.000000] ? btrfs_start_ordered_extent+0xd3/0x105
[ 0.000000] ? finish_wait+0x60/0x60
[ 0.000000] ? btrfs_wait_ordered_range+0xa4/0x100
[ 0.000000] ? unmap_mapping_pages+0x64/0x113
[ 0.000000] ? btrfs_setattr+0x20b/0x499
[ 0.000000] ? notify_change+0x268/0x347
[ 0.000000] ? do_truncate+0x82/0xb6
[ 0.000000] ? kmem_cache_alloc+0x9a/0x100
[ 0.000000] ? vfs_truncate+0xbc/0xda
[ 0.000000] ? do_sys_truncate+0x60/0xa9
[ 0.000000] ? do_syscall_64+0x4e/0x5b
[ 0.000000] ? entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 0.000000] INFO: task btrfs:16752 blocked for more than 120 seconds.
[ 0.000000] Not tainted 94.20.0-srb-asrock-00002-gfb1bd063cc72 #141
[ 0.000000] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 0.000000] btrfs D 0 16752 16745 0x00000000
[ 0.000000] Call Trace:
[ 0.000000] ? __schedule+0x4db/0x524
[ 0.000000] ? schedule+0x60/0x71
[ 0.000000] ? btrfs_start_ordered_extent+0xd3/0x105
[ 0.000000] ? finish_wait+0x60/0x60
[ 0.000000] ? btrfs_wait_ordered_range+0xa4/0x100
[ 0.000000] ? unmap_mapping_pages+0x64/0x113
[ 0.000000] ? btrfs_setattr+0x20b/0x499
[ 0.000000] ? notify_change+0x268/0x347
[ 0.000000] ? do_truncate+0x82/0xb6
[ 0.000000] ? kmem_cache_alloc+0x9a/0x100
[ 0.000000] ? vfs_truncate+0xbc/0xda
[ 0.000000] ? do_sys_truncate+0x60/0xa9
[ 0.000000] ? do_syscall_64+0x4e/0x5b
[ 0.000000] ? entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 0.000000] INFO: task btrfs:16752 blocked for more than 120 seconds.
[ 0.000000] Not tainted 94.20.0-srb-asrock-00002-gfb1bd063cc72 #141
[ 0.000000] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 0.000000] btrfs D 0 16752 16745 0x00000000
[ 0.000000] Call Trace:
[ 0.000000] ? __schedule+0x4db/0x524
[ 0.000000] ? schedule+0x60/0x71
[ 0.000000] ? btrfs_start_ordered_extent+0xd3/0x105
[ 0.000000] ? finish_wait+0x60/0x60
[ 0.000000] ? btrfs_wait_ordered_range+0xa4/0x100
[ 0.000000] ? unmap_mapping_pages+0x64/0x113
[ 0.000000] ? btrfs_setattr+0x20b/0x499
[ 0.000000] ? notify_change+0x268/0x347
[ 0.000000] ? do_truncate+0x82/0xb6
[ 0.000000] ? kmem_cache_alloc+0x9a/0x100
[ 0.000000] ? vfs_truncate+0xbc/0xda
[ 0.000000] ? do_sys_truncate+0x60/0xa9
[ 0.000000] ? do_syscall_64+0x4e/0x5b
[ 0.000000] ? entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 0.000000] INFO: task btrfs:16752 blocked for more than 120 seconds.
[ 0.000000] Not tainted 94.20.0-srb-asrock-00002-gfb1bd063cc72 #141
[ 0.000000] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 0.000000] btrfs D 0 16752 16745 0x00000000
[ 0.000000] Call Trace:
[ 0.000000] ? __schedule+0x4db/0x524
[ 0.000000] ? schedule+0x60/0x71
[ 0.000000] ? btrfs_start_ordered_extent+0xd3/0x105
[ 0.000000] ? finish_wait+0x60/0x60
[ 0.000000] ? btrfs_wait_ordered_range+0xa4/0x100
[ 0.000000] ? unmap_mapping_pages+0x64/0x113
[ 0.000000] ? btrfs_setattr+0x20b/0x499
[ 0.000000] ? notify_change+0x268/0x347
[ 0.000000] ? do_truncate+0x82/0xb6
[ 0.000000] ? kmem_cache_alloc+0x9a/0x100
[ 0.000000] ? vfs_truncate+0xbc/0xda
[ 0.000000] ? do_sys_truncate+0x60/0xa9
[ 0.000000] ? do_syscall_64+0x4e/0x5b
[ 0.000000] ? entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 0.000000] INFO: task btrfs:16752 blocked for more than 120 seconds.
[ 0.000000] Not tainted 94.20.0-srb-asrock-00002-gfb1bd063cc72 #141
[ 0.000000] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 0.000000] btrfs D 0 16752 16745 0x00000000
[ 0.000000] Call Trace:
[ 0.000000] ? __schedule+0x4db/0x524
[ 0.000000] ? schedule+0x60/0x71
[ 0.000000] ? btrfs_start_ordered_extent+0xd3/0x105
[ 0.000000] ? finish_wait+0x60/0x60
[ 0.000000] ? btrfs_wait_ordered_range+0xa4/0x100
[ 0.000000] ? unmap_mapping_pages+0x64/0x113
[ 0.000000] ? btrfs_setattr+0x20b/0x499
[ 0.000000] ? notify_change+0x268/0x347
[ 0.000000] ? do_truncate+0x82/0xb6
[ 0.000000] ? kmem_cache_alloc+0x9a/0x100
[ 0.000000] ? vfs_truncate+0xbc/0xda
[ 0.000000] ? do_sys_truncate+0x60/0xa9
[ 0.000000] ? do_syscall_64+0x4e/0x5b
[ 0.000000] ? entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 0.000000] INFO: task btrfs:16752 blocked for more than 120 seconds.
[ 0.000000] Not tainted 94.20.0-srb-asrock-00002-gfb1bd063cc72 #141
[ 0.000000] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 0.000000] btrfs D 0 16752 16745 0x00000000
[ 0.000000] Call Trace:
[ 0.000000] ? __schedule+0x4db/0x524
[ 0.000000] ? schedule+0x60/0x71
[ 0.000000] ? btrfs_start_ordered_extent+0xd3/0x105
[ 0.000000] ? finish_wait+0x60/0x60
[ 0.000000] ? btrfs_wait_ordered_range+0xa4/0x100
[ 0.000000] ? unmap_mapping_pages+0x64/0x113
[ 0.000000] ? btrfs_setattr+0x20b/0x499
[ 0.000000] ? notify_change+0x268/0x347
[ 0.000000] ? do_truncate+0x82/0xb6
[ 0.000000] ? kmem_cache_alloc+0x9a/0x100
[ 0.000000] ? vfs_truncate+0xbc/0xda
[ 0.000000] ? do_sys_truncate+0x60/0xa9
[ 0.000000] ? do_syscall_64+0x4e/0x5b
[ 0.000000] ? entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 0.000000] INFO: task btrfs:16752 blocked for more than 120 seconds.
[ 0.000000] Not tainted 94.20.0-srb-asrock-00002-gfb1bd063cc72 #141
[ 0.000000] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 0.000000] btrfs D 0 16752 16745 0x00000000
[ 0.000000] Call Trace:
[ 0.000000] ? __schedule+0x4db/0x524
[ 0.000000] ? schedule+0x60/0x71
[ 0.000000] ? btrfs_start_ordered_extent+0xd3/0x105
[ 0.000000] ? finish_wait+0x60/0x60
[ 0.000000] ? btrfs_wait_ordered_range+0xa4/0x100
[ 0.000000] ? unmap_mapping_pages+0x64/0x113
[ 0.000000] ? btrfs_setattr+0x20b/0x499
[ 0.000000] ? notify_change+0x268/0x347
[ 0.000000] ? do_truncate+0x82/0xb6
[ 0.000000] ? kmem_cache_alloc+0x9a/0x100
[ 0.000000] ? vfs_truncate+0xbc/0xda
[ 0.000000] ? do_sys_truncate+0x60/0xa9
[ 0.000000] ? do_syscall_64+0x4e/0x5b
[ 0.000000] ? entry_SYSCALL_64_after_hwframe+0x44/0xa9
Running 4.20.0 including the special patch mentioned earlier in this
thread.
--
Stephen.
next prev parent reply other threads:[~2019-01-23 15:50 UTC|newest]
Thread overview: 20+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-12-10 12:05 Kernel traces Stephen R. van den Berg
2018-12-10 16:54 ` Chris Murphy
2018-12-11 11:52 ` Stephen R. van den Berg
2018-12-12 6:16 ` Chris Murphy
2018-12-12 7:26 ` Stephen R. van den Berg
2018-12-12 21:01 ` Chris Murphy
2018-12-28 9:20 ` Stephen R. van den Berg
2018-12-28 10:10 ` Qu Wenruo
2018-12-28 13:40 ` Stephen R. van den Berg
2018-12-28 13:46 ` Qu Wenruo
2018-12-28 15:00 ` Stephen R. van den Berg
2019-01-23 15:50 ` Stephen R. van den Berg [this message]
2019-01-25 8:01 ` New hang (Re: Kernel traces), sysreq+w output Stephen R. van den Berg
2019-01-25 8:04 ` Stephen R. van den Berg
2019-02-05 22:18 ` Stephen R. van den Berg
2019-02-06 0:22 ` Qu Wenruo
2019-02-06 0:36 ` Martin Raiber
2019-07-26 16:31 ` qgroup: Don't trigger backref walk at delayed ref insert time (Re: Kernel traces) Stephen R. van den Berg
2019-07-26 23:24 ` Qu Wenruo
-- strict thread matches above, loose matches on Subject: below --
2018-12-11 15:21 Kernel traces Tomasz Chmielewski
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20190123155046.GA8995@cuci.nl \
--to=srb@cuci.nl \
--cc=linux-btrfs@vger.kernel.org \
--cc=quwenruo.btrfs@gmx.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox