From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: linux-nfs-owner@vger.kernel.org Received: from mx2.netapp.com ([216.240.18.37]:25416 "EHLO mx2.netapp.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753966Ab1JXJkF convert rfc822-to-8bit (ORCPT ); Mon, 24 Oct 2011 05:40:05 -0400 Subject: Re: NFS4 client blocked (kernel 3.0.4) From: Trond Myklebust To: David Flynn Cc: linux-nfs@vger.kernel.org Date: Mon, 24 Oct 2011 11:39:45 +0200 In-Reply-To: <20111022082838.GB32587@rd.bbc.co.uk> References: <20111022082838.GB32587@rd.bbc.co.uk> Content-Type: text/plain; charset="UTF-8" Message-ID: <1319449185.2785.6.camel@lade.trondhjem.org> Mime-Version: 1.0 Sender: linux-nfs-owner@vger.kernel.org List-ID: On Sat, 2011-10-22 at 08:28 +0000, David Flynn wrote: > Dear all, > > When mounting a solaris NFS4 export on a v3.0.4 client, we've experienced > processes becoming blocked. Any further attempt to access the mountpoint > from another process also blocks. Other mountpoints are unaffected. > I have not identified a test case to reproduce the behaviour. > > Any thoughts on the matter would be most welcome, > > Kind regards, > > ..david > > from /proc/mounts: > home:/home/ /home nfs4 rw,relatime,vers=4,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,port=0,timeo=600,retrans=2,sec=sys,clientaddr=172.29.190.20,minorversion=0,local_lock=none,addr=172.29.120.140 0 0 > > [105121.204200] INFO: task bash:4457 blocked for more than 120 seconds. > [105121.247424] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > [105121.299955] bash D ffffffff818050a0 0 4457 1 0x00000000 > [105121.347840] ffff8802954b5c28 0000000000000082 ffff8802954b5db8 0000000000012a40 > [105121.397793] ffff8802954b5fd8 0000000000012a40 ffff8802954b4000 0000000000012a40 > [105121.441724] 0000000000012a40 0000000000012a40 ffff8802954b5fd8 0000000000012a40 > [105121.441728] Call Trace: > [105121.441740] [] ? __lock_page+0x70/0x70 > [105121.441744] [] io_schedule+0x8c/0xd0 > [105121.441746] [] sleep_on_page+0xe/0x20 > [105121.441749] [] __wait_on_bit+0x5f/0x90 > [105121.441751] [] wait_on_page_bit+0x73/0x80 > [105121.441756] [] ? autoremove_wake_function+0x40/0x40 > [105121.441759] [] ? pagevec_lookup_tag+0x25/0x40 > [105121.441761] [] filemap_fdatawait_range+0xf6/0x1a0 > [105121.441786] [] ? nfs_destroy_directcache+0x20/0x20 [nfs] > [105121.441789] [] ? do_writepages+0x21/0x40 > [105121.441791] [] ? __filemap_fdatawrite_range+0x5b/0x60 > [105121.441793] [] filemap_fdatawait+0x2b/0x30 > [105121.441795] [] filemap_write_and_wait+0x44/0x60 > [105121.441803] [] nfs_getattr+0x105/0x120 [nfs] > [105121.441806] [] ? do_page_fault+0x258/0x550 > [105121.441810] [] vfs_getattr+0x51/0x120 > [105121.441812] [] vfs_fstatat+0x70/0x90 > [105121.441814] [] vfs_stat+0x1b/0x20 > [105121.441816] [] sys_newstat+0x24/0x40 > [105121.441820] [] ? init_fpu+0x4a/0x150 > [105121.441822] [] ? page_fault+0x25/0x30 > [105121.441825] [] system_call_fastpath+0x16/0x1b > [105121.441837] INFO: task bash:5612 blocked for more than 120 seconds. > [105121.441838] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > [105121.441840] bash D 0000000000000005 0 5612 1 0x00000000 > [105121.441843] ffff8801f25d5ca8 0000000000000086 ffff8800163e9b08 0000000000012a40 > [105121.441845] ffff8801f25d5fd8 0000000000012a40 ffff8801f25d4000 0000000000012a40 > [105121.441848] 0000000000012a40 0000000000012a40 ffff8801f25d5fd8 0000000000012a40 > [105121.441850] Call Trace: > [105121.441853] [] ? __lock_page+0x70/0x70 > [105121.441855] [] io_schedule+0x8c/0xd0 > [105121.441857] [] sleep_on_page+0xe/0x20 > [105121.441859] [] __wait_on_bit+0x5f/0x90 > [105121.441861] [] wait_on_page_bit+0x73/0x80 > [105121.441863] [] ? autoremove_wake_function+0x40/0x40 > [105121.441866] [] ? pagevec_lookup_tag+0x25/0x40 > [105121.441868] [] filemap_fdatawait_range+0xf6/0x1a0 > [105121.441876] [] ? nfs_destroy_directcache+0x20/0x20 [nfs] > [105121.441878] [] ? do_writepages+0x21/0x40 > [105121.441880] [] ? __filemap_fdatawrite_range+0x5b/0x60 > [105121.441882] [] filemap_write_and_wait_range+0x70/0x80 > [105121.441886] [] vfs_fsync_range+0x5a/0x90 > [105121.441888] [] vfs_fsync+0x1c/0x20 > [105121.441894] [] nfs_file_flush+0x54/0x80 [nfs] > [105121.441898] [] filp_close+0x3f/0x90 > [105121.441900] [] sys_close+0xb7/0x120 > [105121.441902] [] system_call_fastpath+0x16/0x1b Does 'echo 0 >/proc/sys/sunrpc/rpc_debug' show anything being stuck in the RPC layer? Cheers Trond -- Trond Myklebust Linux NFS client maintainer NetApp Trond.Myklebust@netapp.com www.netapp.com