From mboxrd@z Thu Jan 1 00:00:00 1970 From: Anna Langley Subject: PROBLEM: slow NFS locking "lockd: failed to monitor xxxxx" Date: Thu, 26 Jul 2007 16:40:08 +0100 Message-ID: <46A8C058.40709@cam.ac.uk> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-15 Content-Transfer-Encoding: 7bit To: linux-fsdevel@vger.kernel.org Return-path: Received: from ppsw-3.csi.cam.ac.uk ([131.111.8.133]:46217 "EHLO ppsw-3.csi.cam.ac.uk" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1757226AbXGZQL6 (ORCPT ); Thu, 26 Jul 2007 12:11:58 -0400 Received: from xena.eng.cam.ac.uk ([129.169.81.64]:51468) by ppsw-3.csi.cam.ac.uk (smtp.hermes.cam.ac.uk [131.111.8.153]:25) with esmtpsa (PLAIN:jal58) (TLSv1:DHE-RSA-AES256-SHA:256) id 1IE5Rg-0002LY-BA (Exim 4.63) for linux-fsdevel@vger.kernel.org (return-path ); Thu, 26 Jul 2007 16:40:08 +0100 Sender: linux-fsdevel-owner@vger.kernel.org List-Id: linux-fsdevel.vger.kernel.org [1] slow NFS locking, dmesg reports "lockd: failed to monitor xxxxx" [2] Applications which set locks in NFS mounted home directories start very slowly. dmesg shows the following, repeated over and over: lockd: cannot monitor cabinet lockd: failed to monitor cabinet (cabinet is running Solaris 7 with standard NFS server) When the problem manifests itself the client machine does not show any unusual loading. [3] Keywords: kernel, lockd, nfs [4] Kernel version: Linux version 2.6.22-intel965 (root@wolf) (gcc version 4.1.0 (SUSE Linux)) #1 SMP Tue Jul 10 11:59:15 BST 2007 [5] No Oops [6] Problem repeatable by logging on to KDE where the user has an NFS mounted home directory. [7.1] Software: Linux wolf 2.6.22-intel965 #1 SMP Tue Jul 10 11:59:15 BST 2007 x86_64 x86_64 x86_64 GNU/Linux Gnu C 4.1.0 Gnu make 3.80 binutils 2.16.91.0.5 util-linux 2.12r mount 2.12r module-init-tools 3.2.2 e2fsprogs 1.38 jfsutils 1.1.10 reiserfsprogs 3.6.19 xfsprogs 2.7.11 PPP 2.4.3 nfs-utils 1.0.7 Linux C Library > libc.2.4 Dynamic linker (ldd) 2.4 Linux C++ Library 6.0.8 Procps 3.2.6 Net-tools 1.60 Kbd 1.12 Sh-utils 5.93 udev 085 wireless-tools 28 Modules Loaded snd_pcm_oss snd_mixer_oss snd_seq snd_seq_device snd_hda_intel snd_pcm snd_timer snd iptable_filter ip_tables x_tables nfs nfsd exportfs lockd nfs_acl sunrpc autofs4 cpufreq_ondemand cpufreq_userspace cpufreq_powersave acpi_cpufreq freq_table ipv6 af_packet edd button battery ac loop dm_mod e1000 soundcore snd_page_alloc parport_pc lp parport reiserfs fan thermal processor generic sg sr_mod cdrom ata_piix libata sd_mod scsi_mod ide_disk ide_core [7.2] Processor info processor : 0 vendor_id : GenuineIntel cpu family : 6 model : 15 model name : Intel(R) Core(TM)2 CPU 6420 @ 2.13GHz stepping : 6 cpu MHz : 1596.000 cache size : 4096 KB physical id : 0 siblings : 2 core id : 0 cpu cores : 2 fpu : yes fpu_exception : yes cpuid level : 10 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr lahf_lm bogomips : 4265.61 clflush size : 64 cache_alignment : 64 address sizes : 36 bits physical, 48 bits virtual power management: processor : 1 vendor_id : GenuineIntel cpu family : 6 model : 15 model name : Intel(R) Core(TM)2 CPU 6420 @ 2.13GHz stepping : 6 cpu MHz : 1596.000 cache size : 4096 KB physical id : 0 siblings : 2 core id : 1 cpu cores : 2 fpu : yes fpu_exception : yes cpuid level : 10 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr lahf_lm bogomips : 4262.77 clflush size : 64 cache_alignment : 64 address sizes : 36 bits physical, 48 bits virtual power management: [7.3] Module info: snd_pcm_oss 67968 0 - Live 0xffffffff88290000 snd_mixer_oss 34560 1 snd_pcm_oss, Live 0xffffffff88286000 snd_seq 75680 0 - Live 0xffffffff88272000 snd_seq_device 25876 1 snd_seq, Live 0xffffffff8826a000 snd_hda_intel 346784 2 - Live 0xffffffff881a4000 snd_pcm 109448 2 snd_pcm_oss,snd_hda_intel, Live 0xffffffff88188000 snd_timer 42760 2 snd_seq,snd_pcm, Live 0xffffffff8817c000 snd 85544 11 snd_pcm_oss,snd_mixer_oss,snd_seq,snd_seq_device,snd_hda_intel,snd_pcm,snd_timer, Live 0xffffffff88166000 iptable_filter 20096 0 - Live 0xffffffff8841e000 ip_tables 37992 1 iptable_filter, Live 0xffffffff88413000 x_tables 37384 1 ip_tables, Live 0xffffffff88408000 nfs 269528 10 - Live 0xffffffff883c5000 nfsd 273192 9 - Live 0xffffffff88381000 exportfs 22912 1 nfsd, Live 0xffffffff8837a000 lockd 85808 3 nfs,nfsd, Live 0xffffffff88364000 nfs_acl 20608 2 nfs,nfsd, Live 0xffffffff8835d000 sunrpc 199816 11 nfs,nfsd,lockd,nfs_acl, Live 0xffffffff8832b000 autofs4 41224 6 - Live 0xffffffff8831f000 cpufreq_ondemand 25744 2 - Live 0xffffffff88317000 cpufreq_userspace 23936 0 - Live 0xffffffff88310000 cpufreq_powersave 18816 0 - Live 0xffffffff8830a000 acpi_cpufreq 28296 0 - Live 0xffffffff88302000 freq_table 22912 2 cpufreq_ondemand,acpi_cpufreq, Live 0xffffffff882fb000 ipv6 357864 20 - Live 0xffffffff882a2000 af_packet 57100 2 - Live 0xffffffff8825b000 edd 27144 0 - Live 0xffffffff88253000 button 26016 0 - Live 0xffffffff8824b000 battery 28040 0 - Live 0xffffffff88243000 ac 22920 0 - Live 0xffffffff8823c000 loop 35844 0 - Live 0xffffffff88232000 dm_mod 77040 0 - Live 0xffffffff8821e000 e1000 140224 0 - Live 0xffffffff881fa000 soundcore 25632 1 snd, Live 0xffffffff8815e000 snd_page_alloc 27536 2 snd_hda_intel,snd_pcm, Live 0xffffffff88156000 parport_pc 59368 1 - Live 0xffffffff88146000 lp 30024 0 - Live 0xffffffff8813d000 parport 57228 2 parport_pc,lp, Live 0xffffffff8812e000 reiserfs 246016 1 - Live 0xffffffff880f0000 fan 22536 0 - Live 0xffffffff880e9000 thermal 32144 0 - Live 0xffffffff880e0000 processor 54376 2 acpi_cpufreq,thermal, Live 0xffffffff880d1000 generic 22916 0 [permanent], Live 0xffffffff880ca000 sg 53800 0 - Live 0xffffffff880bb000 sr_mod 33828 0 - Live 0xffffffff880af000 cdrom 52520 1 sr_mod, Live 0xffffffff880a1000 ata_piix 33796 2 - Live 0xffffffff88095000 libata 144912 1 ata_piix, Live 0xffffffff88070000 sd_mod 45952 3 - Live 0xffffffff88063000 scsi_mod 177336 4 sg,sr_mod,libata,sd_mod, Live 0xffffffff88036000 ide_disk 34560 0 - Live 0xffffffff8802c000 ide_core 166160 2 generic,ide_disk, Live 0xffffffff88002000 [7.4] Loaded driver and hardware information 0000-001f : dma1 0020-0021 : pic1 0040-0043 : timer0 0050-0053 : timer1 0060-006f : keyboard 0070-0077 : rtc 0080-008f : dma page reg 00a0-00a1 : pic2 00c0-00df : dma2 00f0-00ff : fpu 0378-037a : parport0 03c0-03df : vesafb 03f8-03ff : serial 0400-047f : 0000:00:1f.0 0400-047f : pnp 00:06 0400-0403 : ACPI PM1a_EVT_BLK 0404-0405 : ACPI PM1a_CNT_BLK 0408-040b : ACPI PM_TMR 0410-0415 : ACPI CPU throttle 0420-0420 : ACPI PM2_CNT_BLK 0428-042f : ACPI GPE0_BLK 0500-053f : 0000:00:1f.0 0500-053f : pnp 00:06 0680-06ff : pnp 00:06 0778-077a : parport0 0cf8-0cff : PCI conf1 1000-1fff : PCI Bus #02 1000-100f : 0000:02:00.0 1010-1017 : 0000:02:00.0 1018-101f : 0000:02:00.0 1020-1023 : 0000:02:00.0 1024-1027 : 0000:02:00.0 2000-201f : 0000:00:1f.3 2020-203f : 0000:00:1d.2 2040-205f : 0000:00:1d.1 2060-207f : 0000:00:1d.0 2080-209f : 0000:00:1a.1 20a0-20bf : 0000:00:1a.0 20c0-20df : 0000:00:19.0 20c0-20df : e1000 20e0-20ef : 0000:00:1f.5 20f0-20ff : 0000:00:1f.5 20f0-20ff : libata 2400-240f : 0000:00:1f.2 2410-241f : 0000:00:1f.2 2410-241f : libata 2420-2427 : 0000:00:1f.5 2420-2427 : libata 2428-242f : 0000:00:1f.5 2428-242f : libata 2430-2437 : 0000:00:1f.2 2430-2437 : libata 2438-243f : 0000:00:1f.2 2438-243f : libata 2440-2447 : 0000:00:02.0 2448-244b : 0000:00:1f.5 2448-244b : libata 244c-244f : 0000:00:1f.5 244c-244f : libata 2450-2453 : 0000:00:1f.2 2450-2453 : libata 2454-2457 : 0000:00:1f.2 2454-2457 : libata 00000000-0008efff : System RAM 00000000-00000000 : Crash kernel 0008f000-0009ffff : reserved 000e0000-000fffff : reserved 00100000-7e598fff : System RAM 00200000-003fb2f5 : Kernel code 003fb2f6-004f3d5f : Kernel data 7e599000-7e5a5fff : reserved 7e5a6000-7e621fff : System RAM 7e622000-7e6a5fff : ACPI Non-volatile Storage 7e6a6000-7e6aafff : ACPI Tables 7e6ab000-7e6f1fff : ACPI Non-volatile Storage 7e6f2000-7e6f2fff : System RAM 7e6f3000-7e6fefff : ACPI Tables 7e6ff000-7e6fffff : System RAM 7e700000-7effffff : reserved 80000000-8fffffff : 0000:00:02.0 80000000-8076ffff : vesafb 90000000-900fffff : PCI Bus #06 90000000-90003fff : 0000:06:03.0 90004000-900047ff : 0000:06:03.0 90100000-901fffff : PCI Bus #02 90100000-901001ff : 0000:02:00.0 90200000-902fffff : 0000:00:02.0 90300000-9031ffff : 0000:00:19.0 90300000-9031ffff : e1000 90320000-90323fff : 0000:00:1b.0 90320000-90323fff : ICH HD audio 90324000-90324fff : 0000:00:19.0 90324000-90324fff : e1000 90325000-903253ff : 0000:00:1d.7 90325400-903257ff : 0000:00:1a.7 90325800-903258ff : 0000:00:1f.3 90325900-9032590f : 0000:00:03.0 f0000000-f7ffffff : pnp 00:01 fec00000-fec00fff : IOAPIC 0 fed13000-fed13fff : pnp 00:01 fed14000-fed17fff : pnp 00:01 fed18000-fed18fff : pnp 00:01 fee00000-fee00fff : Local APIC fff00000-ffffffff : reserved [7.5] PCI information: 00:00.0 Host bridge: Intel Corp. Memory Controller Hub (rev 02) Subsystem: Intel Corp. Unknown device 514d Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=fast >TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- Reset- FastB2B- Capabilities: [40] Express Root Port (Slot+) IRQ 0 Device: Supported: MaxPayload 128 bytes, PhantFunc 0, ExtTag- Device: Latency L0s unlimited, L1 unlimited Device: Errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+ Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop- Device: MaxPayload 128 bytes, MaxReadReq 128 bytes Link: Supported Speed 2.5Gb/s, Width x1, ASPM L0s L1, Port 1 Link: Latency L0s <1us, L1 <4us Link: ASPM Disabled RCB 64 bytes CommClk- ExtSynch- Link: Speed 2.5Gb/s, Width x1 Slot: AtnBtn- PwrCtrl- MRL- AtnInd- PwrInd- HotPlug+ Surpise+ Slot: Number 1, PowerLimit 10.000000 Slot: Enabled AtnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- Slot: AttnInd Unknown, PwrInd Unknown, Power- Root: Correctable- Non-Fatal- Fatal- PME- Capabilities: [80] Message Signalled Interrupts: 64bit- Queue=0/0 Enable+ Address: fee0300c Data: 4169 Capabilities: [90] #0d [0000] Capabilities: [a0] Power Management version 2 Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+) Status: D0 PME-Enable- DSel=0 DScale=0 PME- 00:1c.1 PCI bridge: Intel Corp. PCI Express Port 2 (rev 02) (prog-if 00 [Normal decode]) Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- SERR- TAbort- Reset- FastB2B- Capabilities: [40] Express Root Port (Slot+) IRQ 0 Device: Supported: MaxPayload 128 bytes, PhantFunc 0, ExtTag- Device: Latency L0s unlimited, L1 unlimited Device: Errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+ Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop- Device: MaxPayload 128 bytes, MaxReadReq 128 bytes Link: Supported Speed 2.5Gb/s, Width x1, ASPM L0s L1, Port 2 Link: Latency L0s <256ns, L1 <4us Link: ASPM Disabled RCB 64 bytes CommClk+ ExtSynch- Link: Speed 2.5Gb/s, Width x1 Slot: AtnBtn- PwrCtrl- MRL- AtnInd- PwrInd- HotPlug+ Surpise+ Slot: Number 2, PowerLimit 10.000000 Slot: Enabled AtnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- Slot: AttnInd Unknown, PwrInd Unknown, Power- Root: Correctable- Non-Fatal- Fatal- PME- Capabilities: [80] Message Signalled Interrupts: 64bit- Queue=0/0 Enable+ Address: fee0300c Data: 4171 Capabilities: [90] #0d [0000] Capabilities: [a0] Power Management version 2 Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+) Status: D0 PME-Enable- DSel=0 DScale=0 PME- 00:1c.2 PCI bridge: Intel Corp. PCI Express Port 3 (rev 02) (prog-if 00 [Normal decode]) Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- SERR- TAbort- Reset- FastB2B- Capabilities: [40] Express Root Port (Slot+) IRQ 0 Device: Supported: MaxPayload 128 bytes, PhantFunc 0, ExtTag- Device: Latency L0s unlimited, L1 unlimited Device: Errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+ Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop- Device: MaxPayload 128 bytes, MaxReadReq 128 bytes Link: Supported Speed 2.5Gb/s, Width x1, ASPM L0s L1, Port 3 Link: Latency L0s <1us, L1 <4us Link: ASPM Disabled RCB 64 bytes CommClk- ExtSynch- Link: Speed 2.5Gb/s, Width x1 Slot: AtnBtn- PwrCtrl- MRL- AtnInd- PwrInd- HotPlug+ Surpise+ Slot: Number 3, PowerLimit 10.000000 Slot: Enabled AtnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- Slot: AttnInd Unknown, PwrInd Unknown, Power- Root: Correctable- Non-Fatal- Fatal- PME- Capabilities: [80] Message Signalled Interrupts: 64bit- Queue=0/0 Enable+ Address: fee0300c Data: 4179 Capabilities: [90] #0d [0000] Capabilities: [a0] Power Management version 2 Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+) Status: D0 PME-Enable- DSel=0 DScale=0 PME- 00:1c.3 PCI bridge: Intel Corp. PCI Express Port 4 (rev 02) (prog-if 00 [Normal decode]) Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- SERR- TAbort- Reset- FastB2B- Capabilities: [40] Express Root Port (Slot+) IRQ 0 Device: Supported: MaxPayload 128 bytes, PhantFunc 0, ExtTag- Device: Latency L0s unlimited, L1 unlimited Device: Errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+ Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop- Device: MaxPayload 128 bytes, MaxReadReq 128 bytes Link: Supported Speed 2.5Gb/s, Width x1, ASPM L0s L1, Port 4 Link: Latency L0s <1us, L1 <4us Link: ASPM Disabled RCB 64 bytes CommClk- ExtSynch- Link: Speed 2.5Gb/s, Width x1 Slot: AtnBtn- PwrCtrl- MRL- AtnInd- PwrInd- HotPlug+ Surpise+ Slot: Number 4, PowerLimit 10.000000 Slot: Enabled AtnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- Slot: AttnInd Unknown, PwrInd Unknown, Power- Root: Correctable- Non-Fatal- Fatal- PME- Capabilities: [80] Message Signalled Interrupts: 64bit- Queue=0/0 Enable+ Address: fee0300c Data: 4181 Capabilities: [90] #0d [0000] Capabilities: [a0] Power Management version 2 Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+) Status: D0 PME-Enable- DSel=0 DScale=0 PME- 00:1c.4 PCI bridge: Intel Corp. PCI Express Port 5 (rev 02) (prog-if 00 [Normal decode]) Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- SERR- TAbort- Reset- FastB2B- Capabilities: [40] Express Root Port (Slot+) IRQ 0 Device: Supported: MaxPayload 128 bytes, PhantFunc 0, ExtTag- Device: Latency L0s unlimited, L1 unlimited Device: Errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+ Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop- Device: MaxPayload 128 bytes, MaxReadReq 128 bytes Link: Supported Speed 2.5Gb/s, Width x1, ASPM L0s L1, Port 5 Link: Latency L0s <1us, L1 <4us Link: ASPM Disabled RCB 64 bytes CommClk- ExtSynch- Link: Speed 2.5Gb/s, Width x1 Slot: AtnBtn- PwrCtrl- MRL- AtnInd- PwrInd- HotPlug+ Surpise+ Slot: Number 5, PowerLimit 10.000000 Slot: Enabled AtnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- Slot: AttnInd Unknown, PwrInd Unknown, Power- Root: Correctable- Non-Fatal- Fatal- PME- Capabilities: [80] Message Signalled Interrupts: 64bit- Queue=0/0 Enable+ Address: fee0300c Data: 4189 Capabilities: [90] #0d [0000] Capabilities: [a0] Power Management version 2 Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+) Status: D0 PME-Enable- DSel=0 DScale=0 PME- 00:1d.0 USB Controller: Intel Corp. USB UHCI Controller #1 (rev 02) (prog-if 00 [UHCI]) Subsystem: Intel Corp. Unknown device 514d Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- Status: Cap- 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- Reset- FastB2B- Capabilities: [50] #0d [0000] 00:1f.0 ISA bridge: Intel Corp. LPC Interface Controller (rev 02) Subsystem: Intel Corp. Unknown device 514d Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR-