From: Stefan Priebe <s.priebe@profihost.ag>
To: linux-btrfs@vger.kernel.org
Subject: btrfs deadlock in 3.5-rc3
Date: Sat, 23 Jun 2012 10:50:46 +0200 [thread overview]
Message-ID: <4FE58366.8000302@profihost.ag> (raw)
Hello list,
i've seen this deadlock today and can reproduce it while using ceph.
Is this a known bug?
[ 599.514534] INFO: task kworker/6:0:29 blocked for more than 120 seconds.
[ 599.530394] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs"
disables this message.
[ 599.546832] kworker/6:0 D ffffffff8180ebc0 0 29 2
0x00000000
[ 599.563725] ffff880e78f4dc90 0000000000000046 ffff880e78f4a180
0000000000012280
[ 599.580812] ffff880e78f4dfd8 ffff880e78f4c010 0000000000012280
0000000000012280
[ 599.580813] ffff880e78f4dfd8 0000000000012280 ffff880e78e8c340
ffff880e78f4a180
[ 599.580814] Call Trace:
[ 599.580820] [<ffffffff81620334>] schedule+0x24/0x70
[ 599.580832] [<ffffffffa009b4c5>] wait_for_commit+0x55/0x90 [btrfs]
[ 599.580836] [<ffffffff81060140>] ? wake_up_bit+0x40/0x40
[ 599.580844] [<ffffffffa009d095>]
btrfs_commit_transaction+0x655/0xab0 [btrfs]
[ 599.580846] [<ffffffff81076058>] ? idle_balance+0x108/0x130
[ 599.580847] [<ffffffff81060140>] ? wake_up_bit+0x40/0x40
[ 599.580853] [<ffffffffa009d7f0>] ? btrfs_end_transaction+0x20/0x20
[btrfs]
[ 599.580859] [<ffffffffa009d80a>] do_async_commit+0x1a/0x30 [btrfs]
[ 599.580861] [<ffffffff81058eff>] process_one_work+0x11f/0x470
[ 599.580862] [<ffffffff8105b128>] worker_thread+0x178/0x400
[ 599.580863] [<ffffffff8105afb0>] ? manage_workers+0x210/0x210
[ 599.580865] [<ffffffff8105fc46>] kthread+0x96/0xa0
[ 599.580866] [<ffffffff81622dd4>] kernel_thread_helper+0x4/0x10
[ 599.580868] [<ffffffff8105fbb0>] ? kthread_worker_fn+0x130/0x130
[ 599.580869] [<ffffffff81622dd0>] ? gs_change+0xb/0xb
[ 599.580872] INFO: task kworker/2:1:1184 blocked for more than 120
seconds.
[ 599.580872] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs"
disables this message.
[ 599.580873] kworker/2:1 D ffffffff8180ebc0 0 1184 2
0x00000000
[ 599.580874] ffff880e448cfc90 0000000000000046 ffff880e46cce380
0000000000012280
[ 599.580875] ffff880e448cffd8 ffff880e448ce010 0000000000012280
0000000000012280
[ 599.580876] ffff880e448cffd8 0000000000012280 ffff880e78e5a240
ffff880e46cce380
[ 599.580877] Call Trace:
[ 599.580879] [<ffffffff81620334>] schedule+0x24/0x70
[ 599.580884] [<ffffffffa009b4c5>] wait_for_commit+0x55/0x90 [btrfs]
[ 599.580886] [<ffffffff81060140>] ? wake_up_bit+0x40/0x40
[ 599.580891] [<ffffffffa009d095>]
btrfs_commit_transaction+0x655/0xab0 [btrfs]
[ 599.580893] [<ffffffff81076058>] ? idle_balance+0x108/0x130
[ 599.580894] [<ffffffff81060140>] ? wake_up_bit+0x40/0x40
[ 599.580899] [<ffffffffa009d7f0>] ? btrfs_end_transaction+0x20/0x20
[btrfs]
[ 599.580905] [<ffffffffa009d80a>] do_async_commit+0x1a/0x30 [btrfs]
[ 599.580906] [<ffffffff81058eff>] process_one_work+0x11f/0x470
[ 599.580907] [<ffffffff8105b128>] worker_thread+0x178/0x400
[ 599.580908] [<ffffffff8105afb0>] ? manage_workers+0x210/0x210
[ 599.580910] [<ffffffff8105fc46>] kthread+0x96/0xa0
[ 599.580911] [<ffffffff81622dd4>] kernel_thread_helper+0x4/0x10
[ 599.580913] [<ffffffff8105fbb0>] ? kthread_worker_fn+0x130/0x130
[ 599.580914] [<ffffffff81622dd0>] ? gs_change+0xb/0xb
[ 599.580915] INFO: task kworker/5:1:1186 blocked for more than 120
seconds.
[ 599.580915] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs"
disables this message.
[ 599.580916] kworker/5:1 D ffffffff8180ebc0 0 1186 2
0x00000000
[ 599.580917] ffff880e448a3c90 0000000000000046 ffff880e46d36600
0000000000012280
[ 599.580919] ffff880e448a3fd8 ffff880e448a2010 0000000000012280
0000000000012280
[ 599.580920] ffff880e448a3fd8 0000000000012280 ffff880e78e88300
ffff880e46d36600
[ 599.580920] Call Trace:
[ 599.580922] [<ffffffff81620334>] schedule+0x24/0x70
[ 599.580927] [<ffffffffa009b4c5>] wait_for_commit+0x55/0x90 [btrfs]
[ 599.580929] [<ffffffff81060140>] ? wake_up_bit+0x40/0x40
[ 599.580934] [<ffffffffa009d095>]
btrfs_commit_transaction+0x655/0xab0 [btrfs]
[ 599.580936] [<ffffffff81076058>] ? idle_balance+0x108/0x130
[ 599.580937] [<ffffffff81060140>] ? wake_up_bit+0x40/0x40
[ 599.580942] [<ffffffffa009d7f0>] ? btrfs_end_transaction+0x20/0x20
[btrfs]
[ 599.580948] [<ffffffffa009d80a>] do_async_commit+0x1a/0x30 [btrfs]
[ 599.580949] [<ffffffff81058eff>] process_one_work+0x11f/0x470
[ 599.580950] [<ffffffff8105b128>] worker_thread+0x178/0x400
[ 599.580951] [<ffffffff8105afb0>] ? manage_workers+0x210/0x210
[ 599.580952] [<ffffffff8105fc46>] kthread+0x96/0xa0
[ 599.580954] [<ffffffff81622dd4>] kernel_thread_helper+0x4/0x10
[ 599.580955] [<ffffffff8105fbb0>] ? kthread_worker_fn+0x130/0x130
[ 599.580957] [<ffffffff81622dd0>] ? gs_change+0xb/0xb
[ 599.580966] INFO: task ceph-osd:3248 blocked for more than 120 seconds.
[ 599.580966] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs"
disables this message.
[ 599.580967] ceph-osd D 0000000000000006 0 3248 1
0x00000000
[ 599.580968] ffff880bc4201c38 0000000000000082 ffff880e3efc4480
0000000000012280
[ 599.580970] ffff880bc4201fd8 ffff880bc4200010 0000000000012280
0000000000012280
[ 599.580971] ffff880bc4201fd8 0000000000012280 ffff880e78f4a180
ffff880e3efc4480
[ 599.580971] Call Trace:
[ 599.580972] [<ffffffff81620334>] schedule+0x24/0x70
[ 599.580978] [<ffffffffa009dd65>]
btrfs_commit_transaction_async+0x1d5/0x240 [btrfs]
[ 599.580983] [<ffffffffa0081eb6>] ? block_rsv_add_bytes+0x26/0x60 [btrfs]
[ 599.580985] [<ffffffff81060140>] ? wake_up_bit+0x40/0x40
[ 599.580990] [<ffffffffa0081f25>] ? block_rsv_migrate_bytes+0x35/0x50
[btrfs]
[ 599.580997] [<ffffffffa00ced2e>] btrfs_mksubvol+0x2be/0x350 [btrfs]
[ 599.581004] [<ffffffffa00ceec9>]
btrfs_ioctl_snap_create_transid+0x109/0x1a0 [btrfs]
[ 599.581010] [<ffffffffa00d0bc4>]
btrfs_ioctl_snap_create_v2+0x84/0xf0 [btrfs]
[ 599.581016] [<ffffffffa00d353f>] btrfs_ioctl+0x76f/0x12d0 [btrfs]
[ 599.581019] [<ffffffff8114459a>] ? fsnotify+0x1ba/0x2e0
[ 599.581021] [<ffffffff8111ade3>] do_vfs_ioctl+0x93/0x4f0
[ 599.581022] [<ffffffff8111b28a>] sys_ioctl+0x4a/0x80
[ 599.581024] [<ffffffff81621ba2>] system_call_fastpath+0x16/0x1b
[ 599.581035] INFO: task ceph-osd:3278 blocked for more than 120 seconds.
[ 599.581035] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs"
disables this message.
[ 599.581036] ceph-osd D 0000000000000002 0 3278 1
0x00000000
[ 599.581038] ffff880bc41fbc38 0000000000000082 ffff880e412283c0
0000000000012280
[ 599.581039] ffff880bc41fbfd8 ffff880bc41fa010 0000000000012280
0000000000012280
[ 599.581040] ffff880bc41fbfd8 0000000000012280 ffff880e46cce380
ffff880e412283c0
[ 599.581040] Call Trace:
[ 599.581042] [<ffffffff81620334>] schedule+0x24/0x70
[ 599.581048] [<ffffffffa009dd65>]
btrfs_commit_transaction_async+0x1d5/0x240 [btrfs]
[ 599.581053] [<ffffffffa0081eb6>] ? block_rsv_add_bytes+0x26/0x60 [btrfs]
[ 599.581055] [<ffffffff81060140>] ? wake_up_bit+0x40/0x40
[ 599.581059] [<ffffffffa0081f25>] ? block_rsv_migrate_bytes+0x35/0x50
[btrfs]
[ 599.581066] [<ffffffffa00ced2e>] btrfs_mksubvol+0x2be/0x350 [btrfs]
[ 599.581071] [<ffffffffa00ceec9>]
btrfs_ioctl_snap_create_transid+0x109/0x1a0 [btrfs]
[ 599.581077] [<ffffffffa00d0bc4>]
btrfs_ioctl_snap_create_v2+0x84/0xf0 [btrfs]
[ 599.581082] [<ffffffffa00d353f>] btrfs_ioctl+0x76f/0x12d0 [btrfs]
[ 599.581084] [<ffffffff8114459a>] ? fsnotify+0x1ba/0x2e0
[ 599.581085] [<ffffffff8111ade3>] do_vfs_ioctl+0x93/0x4f0
[ 599.581086] [<ffffffff8111b28a>] sys_ioctl+0x4a/0x80
[ 599.581088] [<ffffffff81621ba2>] system_call_fastpath+0x16/0x1b
[ 599.581094] INFO: task ceph-osd:3330 blocked for more than 120 seconds.
[ 599.581094] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs"
disables this message.
[ 599.581095] ceph-osd D 0000000000000005 0 3330 1
0x00000000
[ 599.581096] ffff880bc3bf9c38 0000000000000086 ffff880bc3bd4740
0000000000012280
[ 599.581098] ffff880bc3bf9fd8 ffff880bc3bf8010 0000000000012280
0000000000012280
[ 599.581099] ffff880bc3bf9fd8 0000000000012280 ffff880e46d36600
ffff880bc3bd4740
[ 599.581099] Call Trace:
[ 599.581101] [<ffffffff81620334>] schedule+0x24/0x70
[ 599.581106] [<ffffffffa009dd65>]
btrfs_commit_transaction_async+0x1d5/0x240 [btrfs]
[ 599.581111] [<ffffffffa0081eb6>] ? block_rsv_add_bytes+0x26/0x60 [btrfs]
[ 599.581113] [<ffffffff81060140>] ? wake_up_bit+0x40/0x40
[ 599.581118] [<ffffffffa0081f25>] ? block_rsv_migrate_bytes+0x35/0x50
[btrfs]
[ 599.581123] [<ffffffffa00ced2e>] btrfs_mksubvol+0x2be/0x350 [btrfs]
[ 599.581129] [<ffffffffa00ceec9>]
btrfs_ioctl_snap_create_transid+0x109/0x1a0 [btrfs]
[ 599.581134] [<ffffffffa00d0bc4>]
btrfs_ioctl_snap_create_v2+0x84/0xf0 [btrfs]
[ 599.581139] [<ffffffffa00d353f>] btrfs_ioctl+0x76f/0x12d0 [btrfs]
[ 599.581141] [<ffffffff8114459a>] ? fsnotify+0x1ba/0x2e0
[ 599.581142] [<ffffffff8111ade3>] do_vfs_ioctl+0x93/0x4f0
[ 599.581143] [<ffffffff8111b28a>] sys_ioctl+0x4a/0x80
[ 599.581145] [<ffffffff81621ba2>] system_call_fastpath+0x16/0x1b
[ 719.395814] INFO: task kworker/6:0:29 blocked for more than 120 seconds.
[ 719.417426] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs"
disables this message.
[ 719.439537] kworker/6:0 D ffffffff8180ebc0 0 29 2
0x00000000
[ 719.461937] ffff880e78f4dc90 0000000000000046 ffff880e78f4a180
0000000000012280
[ 719.484547] ffff880e78f4dfd8 ffff880e78f4c010 0000000000012280
0000000000012280
[ 719.507211] ffff880e78f4dfd8 0000000000012280 ffff880e78e8c340
ffff880e78f4a180
[ 719.530071] Call Trace:
[ 719.552729] [<ffffffff81620334>] schedule+0x24/0x70
[ 719.552741] [<ffffffffa009b4c5>] wait_for_commit+0x55/0x90 [btrfs]
[ 719.552744] [<ffffffff81060140>] ? wake_up_bit+0x40/0x40
[ 719.552752] [<ffffffffa009d095>]
btrfs_commit_transaction+0x655/0xab0 [btrfs]
[ 719.552755] [<ffffffff81076058>] ? idle_balance+0x108/0x130
[ 719.552756] [<ffffffff81060140>] ? wake_up_bit+0x40/0x40
[ 719.552762] [<ffffffffa009d7f0>] ? btrfs_end_transaction+0x20/0x20
[btrfs]
[ 719.552768] [<ffffffffa009d80a>] do_async_commit+0x1a/0x30 [btrfs]
[ 719.552770] [<ffffffff81058eff>] process_one_work+0x11f/0x470
[ 719.552771] [<ffffffff8105b128>] worker_thread+0x178/0x400
[ 719.552772] [<ffffffff8105afb0>] ? manage_workers+0x210/0x210
[ 719.552774] [<ffffffff8105fc46>] kthread+0x96/0xa0
[ 719.552776] [<ffffffff81622dd4>] kernel_thread_helper+0x4/0x10
[ 719.552777] [<ffffffff8105fbb0>] ? kthread_worker_fn+0x130/0x130
[ 719.552779] [<ffffffff81622dd0>] ? gs_change+0xb/0xb
[ 719.552781] INFO: task kworker/3:1:578 blocked for more than 120 seconds.
[ 719.552781] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs"
disables this message.
[ 719.552783] kworker/3:1 D ffffffff8180ebc0 0 578 2
0x00000000
[ 719.552784] ffff880e45dd3c90 0000000000000046 ffff880e7890e080
0000000000012280
[ 719.552786] ffff880e45dd3fd8 ffff880e45dd2010 0000000000012280
0000000000012280
[ 719.552787] ffff880e45dd3fd8 0000000000012280 ffff880e78e7e280
ffff880e7890e080
[ 719.552787] Call Trace:
[ 719.552789] [<ffffffff81620334>] schedule+0x24/0x70
[ 719.552795] [<ffffffffa009b4c5>] wait_for_commit+0x55/0x90 [btrfs]
[ 719.552797] [<ffffffff81060140>] ? wake_up_bit+0x40/0x40
[ 719.552802] [<ffffffffa009d095>]
btrfs_commit_transaction+0x655/0xab0 [btrfs]
[ 719.552804] [<ffffffff81076058>] ? idle_balance+0x108/0x130
[ 719.552805] [<ffffffff81060140>] ? wake_up_bit+0x40/0x40
[ 719.552810] [<ffffffffa009d7f0>] ? btrfs_end_transaction+0x20/0x20
[btrfs]
[ 719.552816] [<ffffffffa009d80a>] do_async_commit+0x1a/0x30 [btrfs]
[ 719.552817] [<ffffffff81058eff>] process_one_work+0x11f/0x470
[ 719.552818] [<ffffffff8105b128>] worker_thread+0x178/0x400
[ 719.552819] [<ffffffff8105afb0>] ? manage_workers+0x210/0x210
[ 719.552820] [<ffffffff8105fc46>] kthread+0x96/0xa0
[ 719.552822] [<ffffffff81622dd4>] kernel_thread_helper+0x4/0x10
[ 719.552824] [<ffffffff8105fbb0>] ? kthread_worker_fn+0x130/0x130
[ 719.552825] [<ffffffff81622dd0>] ? gs_change+0xb/0xb
[ 719.552827] INFO: task kworker/2:1:1184 blocked for more than 120
seconds.
[ 719.552827] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs"
disables this message.
[ 719.552828] kworker/2:1 D ffffffff8180ebc0 0 1184 2
0x00000000
[ 719.552830] ffff880e448cfc90 0000000000000046 ffff880e46cce380
0000000000012280
[ 719.552831] ffff880e448cffd8 ffff880e448ce010 0000000000012280
0000000000012280
[ 719.552832] ffff880e448cffd8 0000000000012280 ffff880e78e5a240
ffff880e46cce380
[ 719.552832] Call Trace:
[ 719.552834] [<ffffffff81620334>] schedule+0x24/0x70
[ 719.552839] [<ffffffffa009b4c5>] wait_for_commit+0x55/0x90 [btrfs]
[ 719.552841] [<ffffffff81060140>] ? wake_up_bit+0x40/0x40
[ 719.552846] [<ffffffffa009d095>]
btrfs_commit_transaction+0x655/0xab0 [btrfs]
[ 719.552848] [<ffffffff81076058>] ? idle_balance+0x108/0x130
[ 719.552849] [<ffffffff81060140>] ? wake_up_bit+0x40/0x40
[ 719.552854] [<ffffffffa009d7f0>] ? btrfs_end_transaction+0x20/0x20
[btrfs]
[ 719.552859] [<ffffffffa009d80a>] do_async_commit+0x1a/0x30 [btrfs]
[ 719.552861] [<ffffffff81058eff>] process_one_work+0x11f/0x470
[ 719.552862] [<ffffffff8105b128>] worker_thread+0x178/0x400
[ 719.552863] [<ffffffff8105afb0>] ? manage_workers+0x210/0x210
[ 719.552864] [<ffffffff8105fc46>] kthread+0x96/0xa0
[ 719.552866] [<ffffffff81622dd4>] kernel_thread_helper+0x4/0x10
[ 719.552867] [<ffffffff8105fbb0>] ? kthread_worker_fn+0x130/0x130
[ 719.552868] [<ffffffff81622dd0>] ? gs_change+0xb/0xb
[ 719.552869] INFO: task kworker/5:1:1186 blocked for more than 120
seconds.
[ 719.552869] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs"
disables this message.
[ 719.552870] kworker/5:1 D ffffffff8180ebc0 0 1186 2
0x00000000
[ 719.552872] ffff880e448a3c90 0000000000000046 ffff880e46d36600
0000000000012280
[ 719.552873] ffff880e448a3fd8 ffff880e448a2010 0000000000012280
0000000000012280
[ 719.552874] ffff880e448a3fd8 0000000000012280 ffff880e78e88300
ffff880e46d36600
[ 719.552874] Call Trace:
[ 719.552876] [<ffffffff81620334>] schedule+0x24/0x70
[ 719.552881] [<ffffffffa009b4c5>] wait_for_commit+0x55/0x90 [btrfs]
[ 719.552883] [<ffffffff81060140>] ? wake_up_bit+0x40/0x40
[ 719.552888] [<ffffffffa009d095>]
btrfs_commit_transaction+0x655/0xab0 [btrfs]
[ 719.552890] [<ffffffff81076058>] ? idle_balance+0x108/0x130
[ 719.552891] [<ffffffff81060140>] ? wake_up_bit+0x40/0x40
[ 719.552896] [<ffffffffa009d7f0>] ? btrfs_end_transaction+0x20/0x20
[btrfs]
[ 719.552901] [<ffffffffa009d80a>] do_async_commit+0x1a/0x30 [btrfs]
[ 719.552902] [<ffffffff81058eff>] process_one_work+0x11f/0x470
[ 719.552903] [<ffffffff8105b128>] worker_thread+0x178/0x400
[ 719.552904] [<ffffffff8105afb0>] ? manage_workers+0x210/0x210
[ 719.552906] [<ffffffff8105fc46>] kthread+0x96/0xa0
[ 719.552907] [<ffffffff81622dd4>] kernel_thread_helper+0x4/0x10
[ 719.552909] [<ffffffff8105fbb0>] ? kthread_worker_fn+0x130/0x130
[ 719.552910] [<ffffffff81622dd0>] ? gs_change+0xb/0xb
Stefan
next reply other threads:[~2012-06-23 8:57 UTC|newest]
Thread overview: 23+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-06-23 8:50 Stefan Priebe [this message]
2012-06-23 13:46 ` btrfs deadlock in 3.5-rc3 Michael
2012-06-23 14:55 ` Stefan Priebe
2012-06-25 13:08 ` Josef Bacik
2012-06-25 14:08 ` Stefan Priebe - Profihost AG
2012-06-25 14:20 ` Josef Bacik
2012-06-25 14:45 ` Stefan Priebe - Profihost AG
2012-06-25 14:48 ` Josef Bacik
2012-06-25 17:38 ` Stefan Priebe
2012-06-25 18:02 ` Josef Bacik
2012-06-25 18:28 ` Stefan Priebe
2012-06-25 19:33 ` Stefan Priebe
2012-06-25 20:11 ` Josef Bacik
2012-06-25 20:20 ` Stefan Priebe
2012-06-25 20:23 ` Josef Bacik
2012-06-25 20:33 ` Stefan Priebe
2012-06-26 16:47 ` Stefan Priebe
2012-06-26 20:14 ` Josef Bacik
2012-06-26 20:19 ` Stefan Priebe
2012-06-26 20:48 ` Josef Bacik
2012-06-27 5:47 ` Stefan Priebe - Profihost AG
2012-06-27 13:30 ` Josef Bacik
2012-06-27 21:17 ` Josef Bacik
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=4FE58366.8000302@profihost.ag \
--to=s.priebe@profihost.ag \
--cc=linux-btrfs@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.