From: Christoph Hellwig <hch@infradead.org>
To: Trond Myklebust <trond.myklebust@primarydata.com>
Cc: linux-nfs@vger.kernel.org
Subject: Re: xfstests generic/075 failure on recent Linus' tree
Date: Wed, 22 Oct 2014 06:08:14 -0700 [thread overview]
Message-ID: <20141022130814.GA26501@infradead.org> (raw)
In-Reply-To: <CAABAsM44E-Ly=qPFBA2iBvgkCvA3GE5NRGi=d1hD+Pvk1xzevA@mail.gmail.com>
On Wed, Oct 22, 2014 at 03:00:27PM +0300, Trond Myklebust wrote:
> Does the NFS client show a TCP connection to port 2049 on 127.0.0.1?
>From netstat -a
tcp 0 262352 localhost:nfs localhost:684 ESTABLISHED
tcp 0 0 localhost:684 localhost:nfs ESTABLISHED
Note that about 1/4 to 1/3 of the hangs show a backtrace like:
[ 480.293522] INFO: task fsx:14631 blocked for more than 120 seconds.
[ 480.296181] Not tainted 3.18.0-rc1+ #1519
[ 480.299073] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 480.304028] fsx D ffffffff81dcbd90 0 14631 14430 0x00000004
[ 480.307132] ffff88007a457b08 0000000000000046 ffff880072db0b50 0000000000013dc0
[ 480.310401] ffff88007a457fd8 0000000000013dc0 ffff88007d524310 ffff880072db0b50
[ 480.312772] 0000000000000000 0000000000000002 0000000000000001 0000000000000001
[ 480.315200] Call Trace:
[ 480.315946] [<ffffffff81dcbd90>] ? bit_wait_timeout+0x60/0x60
[ 480.317358] [<ffffffff810f906a>] ? mark_held_locks+0x6a/0x90
[ 480.318818] [<ffffffff8111ef25>] ? ktime_get+0x105/0x140
[ 480.320167] [<ffffffff810830af>] ? kvm_clock_read+0x1f/0x30
[ 480.321537] [<ffffffff810830c9>] ? kvm_clock_get_cycles+0x9/0x10
[ 480.322871] [<ffffffff8111eec5>] ? ktime_get+0xa5/0x140
[ 480.324360] [<ffffffff811405ee>] ? __delayacct_blkio_start+0x1e/0x30
[ 480.325829] [<ffffffff81dcbd90>] ? bit_wait_timeout+0x60/0x60
[ 480.327252] [<ffffffff81dcb7a4>] schedule+0x24/0x70
[ 480.328471] [<ffffffff81dcb87a>] io_schedule+0x8a/0xd0
[ 480.329683] [<ffffffff81dcbdb6>] bit_wait_io+0x26/0x40
[ 480.330902] [<ffffffff81dcbe7e>] __wait_on_bit_lock+0x6e/0xb0
[ 480.332189] [<ffffffff81178de2>] ? find_get_entries+0x22/0x160
[ 480.336273] [<ffffffff8117653c>] ? find_get_entry+0x8c/0xc0
[ 480.337719] [<ffffffff811764b0>] ? find_get_pages_contig+0x1a0/0x1a0
[ 480.339280] [<ffffffff81176755>] __lock_page+0x95/0xa0
[ 480.340518] [<ffffffff810ee160>] ? wake_atomic_t_function+0x30/0x30
[ 480.342066] [<ffffffff81184e66>] truncate_inode_pages_range+0x3c6/0x710
[ 480.343853] [<ffffffff81185230>] truncate_inode_pages+0x10/0x20
[ 480.345306] [<ffffffff81185286>] truncate_pagecache+0x46/0x70
[ 480.346481] [<ffffffff81345e5e>] nfs_setattr_update_inode+0x9e/0x120
[ 480.348372] [<ffffffff813682f8>] nfs4_proc_setattr+0xb8/0x100
[ 480.349751] [<ffffffff813477b6>] nfs_setattr+0xd6/0x1d0
[ 480.350741] [<ffffffff811deb10>] notify_change+0x160/0x3c0
[ 480.351748] [<ffffffff81200afb>] ? fsnotify+0x7b/0x310
[ 480.353260] [<ffffffff811c0671>] do_truncate+0x61/0xa0
[ 480.354829] [<ffffffff811c09f4>] do_sys_ftruncate.constprop.16+0x104/0x160
[ 480.356754] [<ffffffff8178760e>] ? trace_hardirqs_on_thunk+0x3a/0x3f
[ 480.358561] [<ffffffff811c0a79>] SyS_ftruncate+0x9/0x10
[ 480.360054] [<ffffffff81dd0fe9>] system_call_fastpath+0x12/0x17
[ 480.361744] 2 locks held by fsx/14631:
[ 480.362844] #0: (sb_writers#9){.+.+.+}, at: [<ffffffff811c09bf>] do_sys_ftruncate.constprop.16+0xcf/0x160
[ 480.366248] #1: (&sb->s_type->i_mutex_key#11){+.+.+.}, at: [<ffffffff811c0663>] do_truncate+0x53/0xa0
next prev parent reply other threads:[~2014-10-22 13:08 UTC|newest]
Thread overview: 16+ messages / expand[flat|nested] mbox.gz Atom feed top
2014-10-20 17:36 xfstests generic/075 failure on recent Linus' tree Christoph Hellwig
2014-10-21 13:12 ` Boaz Harrosh
2014-10-22 11:46 ` Christoph Hellwig
2014-10-22 12:00 ` Trond Myklebust
2014-10-22 13:08 ` Christoph Hellwig [this message]
2014-10-24 8:14 ` Trond Myklebust
2014-10-24 10:08 ` [PATCH] nfsd: Ensure that NFSv4 always drops the connection when dropping a request Trond Myklebust
2014-10-24 11:26 ` Jeff Layton
2014-10-24 13:34 ` Jeff Layton
2014-10-24 14:30 ` Trond Myklebust
2014-10-24 14:57 ` Jeff Layton
2014-10-24 15:59 ` Trond Myklebust
2014-10-24 17:08 ` Jeff Layton
2014-10-27 19:00 ` Jeff Layton
2014-10-24 13:42 ` Christoph Hellwig
2015-01-16 13:39 ` xfstests generic/075 failure on recent Linus' tree Christoph Hellwig
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20141022130814.GA26501@infradead.org \
--to=hch@infradead.org \
--cc=linux-nfs@vger.kernel.org \
--cc=trond.myklebust@primarydata.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox