3.0.1: xfs hang

3.0.1: xfs hang

[Justin Piszcz]

Hi,

Forgot to remove 'delaylog' from my fstab on one of my machines, while rm 
-rf a large directory with many files:

[ 2880.313073] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 2880.313147] rm              D 0000000100255dc1     0  2270   2253 0x00000000
[ 2880.313198]  ffff88012b4f9810 0000000000000086 ffff8800bd632010 0000000000004000
[ 2880.313276]  ffff88012b4f9810 ffff8800bd633fd8 ffff8800bd633fd8 0000000000000001
[ 2880.313352]  ffff88012b4bf790 ffff88012b4f9a78 0000000412eec110 00000008bd633a58
[ 2880.313428] Call Trace:
[ 2880.313467]  [<ffffffff810ceeb0>] ? mempool_alloc+0x60/0x140
[ 2880.313513]  [<ffffffff812d272e>] ? submit_bio+0x5e/0xe0
[ 2880.313557]  [<ffffffff815ded05>] ? schedule_timeout+0x1f5/0x250
[ 2880.313603]  [<ffffffff812ab174>] ? xfs_buf_rele+0x74/0x110
[ 2880.313645]  [<ffffffff815dfbd1>] ? __down+0x61/0xa0
[ 2880.313688]  [<ffffffff812abf73>] ? _xfs_buf_find+0x163/0x260
[ 2880.313733]  [<ffffffff81092666>] ? down+0x46/0x50
[ 2880.313775]  [<ffffffff812aa459>] ? xfs_buf_lock+0x59/0xc0
[ 2880.313817]  [<ffffffff812abf73>] ? _xfs_buf_find+0x163/0x260
[ 2880.313861]  [<ffffffff812ac0da>] ? xfs_buf_get+0x6a/0x1b0
[ 2880.313906]  [<ffffffff812ac244>] ? xfs_buf_read+0x24/0x110
[ 2880.313951]  [<ffffffff812a2366>] ? xfs_trans_read_buf+0x206/0x400
[ 2880.313999]  [<ffffffff8127577f>] ? xfs_da_do_buf+0x2af/0x770
[ 2880.314057]  [<ffffffff81117869>] ? dput+0x39/0x310
[ 2880.314100]  [<ffffffff81275cb4>] ? xfs_da_read_buf+0x24/0x30
[ 2880.314145]  [<ffffffff8127a5db>] ? xfs_dir2_block_getdents+0xab/0x220
[ 2880.314193]  [<ffffffff8127a5db>] ? xfs_dir2_block_getdents+0xab/0x220
[ 2880.314240]  [<ffffffff81113e50>] ? filldir64+0xe0/0xe0
[ 2880.314283]  [<ffffffff81113e50>] ? filldir64+0xe0/0xe0
[ 2880.314324]  [<ffffffff81113e50>] ? filldir64+0xe0/0xe0
[ 2880.314366]  [<ffffffff81278eea>] ? xfs_readdir+0xca/0x130
[ 2880.314410]  [<ffffffff81113e50>] ? filldir64+0xe0/0xe0
[ 2880.314452]  [<ffffffff812acfa4>] ? xfs_file_readdir+0x34/0x50
[ 2880.314497]  [<ffffffff811140c8>] ? vfs_readdir+0xb8/0xd0
[ 2880.314542]  [<ffffffff81114244>] ? sys_getdents+0x84/0xe0
[ 2880.314586]  [<ffffffff815e0cbb>] ? system_call_fastpath+0x16/0x1b

(will remove delaylog, (but FYI))

Justin.

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

Re: 3.0.1: xfs hang

[Christoph Hellwig]

On Sat, Aug 20, 2011 at 03:38:21PM -0400, Justin Piszcz wrote:
> Hi,
> 
> Forgot to remove 'delaylog' from my fstab on one of my machines,
> while rm -rf a large directory with many files:

Does it actually hand the machine, or do you get the warning and then
work continues?

Unfortunately your backtrace doesn't seem overly reliable, so it's kinda
hard to figure out what is going on.  There is nothing delaylog related
in the provided one though.  If it halfway matches what is going on it
seems to be block I/O related.

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

Re: 3.0.1: xfs hang

[Justin Piszcz]

On Thu, 25 Aug 2011, Christoph Hellwig wrote:

> On Sat, Aug 20, 2011 at 03:38:21PM -0400, Justin Piszcz wrote:
>> Hi,
>>
>> Forgot to remove 'delaylog' from my fstab on one of my machines,
>> while rm -rf a large directory with many files:
>
> Does it actually hand the machine, or do you get the warning and then
> work continues?
Hi,

Normally the work continues but delaylog's effect varies on different hardware.
For example on server HW it actually kills all network connections (ssh,etc)
if delaylog is set and you remove lots of files.
>
> Unfortunately your backtrace doesn't seem overly reliable
Would compiling with frame pointers help for future XFS/related items?
> , so it's kinda
> hard to figure out what is going on.  There is nothing delaylog related
> in the provided one though.  If it halfway matches what is going on it
> seems to be block I/O related.

Justin.

>

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs