* 2.6.37-rc1 krash
@ 2010-11-18 15:21 Tigran Mkrtchyan
2010-11-18 16:59 ` Benny Halevy
0 siblings, 1 reply; 6+ messages in thread
From: Tigran Mkrtchyan @ 2010-11-18 15:21 UTC (permalink / raw)
To: NFS list
During dead client recovery procedure you client crashed in did.
The procedure was: during IO disconnect network cable. We was testing
server cleanup sequence. Then we have connected client back. After some
time client reconnected...and crashed. The last thing I have seen was
BAD_SESSION
from the server on READ call:
Nov 18 16:04:29 slinux kernel: [ 555.385877] Got error -10052 from the
server on DESTROY_SESSION. Session has been destroyed regardless...
Nov 18 16:04:29 slinux kernel: [ 555.395300] ------------[ cut here
]------------
Nov 18 16:04:29 slinux kernel: [ 555.395321] WARNING: at
fs/nfs/pnfs.c:477 pnfs_destroy_layout+0xd6/0x100 [nfs]()
Nov 18 16:04:29 slinux kernel: [ 555.395323] Hardware name: VirtualBox
Nov 18 16:04:29 slinux kernel: [ 555.395324] Modules linked in:
nfs_layout_nfsv41_files nfs lockd fscache nfs_acl auth_rpcgss sunrpc
ipv6 af_packet binfmt_misc dm_mirror dm_multipath scsi_dh video output
thermal sbs sbshc pci_slot fan container battery lp sg ac option
usb_wwan usbserial thermal_sys button parport_pc tpm_tis tpm serio_raw
tpm_bios parport e1000 i2c_piix4 pata_mpiix dm_region_hash dm_log dm_mod
[last unloaded: mperf]
Nov 18 16:04:29 slinux kernel: [ 555.395425] Pid: 2259, comm:
131.169.40.35-m Not tainted 2.6.37-rc1.pnfs.1 #1
Nov 18 16:04:29 slinux kernel: [ 555.395427] Call Trace:
Nov 18 16:04:29 slinux kernel: [ 555.395434] [<ffffffffa024a256>] ?
pnfs_destroy_layout+0xd6/0x100 [nfs]
Nov 18 16:04:29 slinux kernel: [ 555.395440] [<ffffffffa024a256>] ?
pnfs_destroy_layout+0xd6/0x100 [nfs]
Nov 18 16:04:29 slinux kernel: [ 555.395444] [<ffffffff81041fbc>] ?
warn_slowpath_common+0x8c/0xc0
Nov 18 16:04:29 slinux kernel: [ 555.395450] [<ffffffffa024a256>] ?
pnfs_destroy_layout+0xd6/0x100 [nfs]
Nov 18 16:04:29 slinux kernel: [ 555.395456] [<ffffffffa024a302>] ?
pnfs_destroy_all_layouts+0x82/0xc0 [nfs]
Nov 18 16:04:29 slinux kernel: [ 555.395462] [<ffffffffa0242b93>] ?
nfs4_run_state_manager+0x4e3/0x540 [nfs]
Nov 18 16:04:29 slinux kernel: [ 555.395469] [<ffffffffa02426b0>] ?
nfs4_run_state_manager+0x0/0x540 [nfs]
Nov 18 16:04:29 slinux kernel: [ 555.395471] [<ffffffff8105b466>] ?
kthread+0x96/0xa0
Nov 18 16:04:29 slinux kernel: [ 555.395474] [<ffffffff81003a14>] ?
kernel_thread_helper+0x4/0x10
Nov 18 16:04:29 slinux kernel: [ 555.395476] [<ffffffff8105b3d0>] ?
kthread+0x0/0xa0
Nov 18 16:04:29 slinux kernel: [ 555.395478] [<ffffffff81003a10>] ?
kernel_thread_helper+0x0/0x10
Nov 18 16:04:29 slinux kernel: [ 555.395479] ---[ end trace
8f55223a1de06cc6 ]---
Nov 18 16:04:29 slinux kernel: [ 555.395480] ------------[ cut here
]------------
Nov 18 16:04:29 slinux kernel: [ 555.395486] WARNING: at
fs/nfs/pnfs.c:478 pnfs_destroy_layout+0xfc/0x100 [nfs]()
Nov 18 16:04:29 slinux kernel: [ 555.395487] Hardware name: VirtualBox
Nov 18 16:04:29 slinux kernel: [ 555.395488] Modules linked in:
nfs_layout_nfsv41_files nfs lockd fscache nfs_acl auth_rpcgss sunrpc
ipv6 af_packet binfmt_misc dm_mirror dm_multipath scsi_dh video output
thermal sbs sbshc pci_slot fan container battery lp sg ac option
usb_wwan usbserial thermal_sys button parport_pc tpm_tis tpm serio_raw
tpm_bios parport e1000 i2c_piix4 pata_mpiix dm_region_hash dm_log dm_mod
[last unloaded: mperf]
Nov 18 16:04:29 slinux kernel: [ 555.395503] Pid: 2259, comm:
131.169.40.35-m Tainted: G W 2.6.37-rc1.pnfs.1 #1
Nov 18 16:04:29 slinux kernel: [ 555.395504] Call Trace:
Nov 18 16:04:29 slinux kernel: [ 555.395510] [<ffffffffa024a27c>] ?
pnfs_destroy_layout+0xfc/0x100 [nfs]
Nov 18 16:04:29 slinux kernel: [ 555.395516] [<ffffffffa024a27c>] ?
pnfs_destroy_layout+0xfc/0x100 [nfs]
Nov 18 16:04:29 slinux kernel: [ 555.395518] [<ffffffff81041fbc>] ?
warn_slowpath_common+0x8c/0xc0
Nov 18 16:04:29 slinux kernel: [ 555.395523] [<ffffffffa024a27c>] ?
pnfs_destroy_layout+0xfc/0x100 [nfs]
Nov 18 16:04:29 slinux kernel: [ 555.395529] [<ffffffffa024a302>] ?
pnfs_destroy_all_layouts+0x82/0xc0 [nfs]
Nov 18 16:04:29 slinux kernel: [ 555.395536] [<ffffffffa0242b93>] ?
nfs4_run_state_manager+0x4e3/0x540 [nfs]
Nov 18 16:04:29 slinux kernel: [ 555.395542] [<ffffffffa02426b0>] ?
nfs4_run_state_manager+0x0/0x540 [nfs]
Nov 18 16:04:29 slinux kernel: [ 555.395544] [<ffffffff8105b466>] ?
kthread+0x96/0xa0
Nov 18 16:04:29 slinux kernel: [ 555.395546] [<ffffffff81003a14>] ?
kernel_thread_helper+0x4/0x10
Nov 18 16:04:29 slinux kernel: [ 555.395548] [<ffffffff8105b3d0>] ?
kthread+0x0/0xa0
Nov 18 16:04:29 slinux kernel: [ 555.395550] [<ffffffff81003a10>] ?
kernel_thread_helper+0x0/0x10
Nov 18 16:04:29 slinux kernel: [ 555.395551] ---[ end trace
8f55223a1de06cc7 ]---
Nov 18 16:04:29 slinux kernel: [ 555.395552] ------------[ cut here
]------------
Nov 18 16:04:29 slinux kernel: [ 555.395558] WARNING: at
fs/nfs/pnfs.c:479 pnfs_destroy_layout+0xe9/0x100 [nfs]()
Nov 18 16:04:29 slinux kernel: [ 555.395559] Hardware name: VirtualBox
Nov 18 16:04:29 slinux kernel: [ 555.395560] Modules linked in:
nfs_layout_nfsv41_files nfs lockd fscache nfs_acl auth_rpcgss sunrpc
ipv6 af_packet binfmt_misc dm_mirror dm_multipath scsi_dh video output
thermal sbs sbshc pci_slot fan container battery lp sg ac option
usb_wwan usbserial thermal_sys button parport_pc tpm_tis tpm serio_raw
tpm_bios parport e1000 i2c_piix4 pata_mpiix dm_region_hash dm_log dm_mod
[last unloaded: mperf]
Nov 18 16:04:29 slinux kernel: [ 555.395575] Pid: 2259, comm:
131.169.40.35-m Tainted: G W 2.6.37-rc1.pnfs.1 #1
Nov 18 16:04:29 slinux kernel: [ 555.395576] Call Trace:
this is
pnfs-all-2.6.37-rc1-2010-11-03 from Banny's tree (git
6a1df873544d146fcdc493034b170879985909e8) +
http://git.kernel.org/?p=linux/kernel/git/torvalds/linux-2.6.git;a=blobdiff;f=mm/vmstat.c;h=42eac4d33216b81c307a87016e821051bc86146e;hp=cd2e42be7b68f73dc60f40631f2b9f87708d3b47;hb=ff8b16d7e15a8ba2a6086645614a483e048e3fbf;hpb=81a6cff678ecee7cdc0658285d3150660c07cfce
Regards,
Tigran.
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: 2.6.37-rc1 krash
2010-11-18 15:21 2.6.37-rc1 krash Tigran Mkrtchyan
@ 2010-11-18 16:59 ` Benny Halevy
2010-11-19 11:27 ` Tigran Mkrtchyan
0 siblings, 1 reply; 6+ messages in thread
From: Benny Halevy @ 2010-11-18 16:59 UTC (permalink / raw)
To: Tigran Mkrtchyan; +Cc: NFS list
Hi Tigran, Can you please gdb your nfs.ko module to get the line number of the warning?
(gdb) list *(pnfs_destroy_layout+0xd6)
I'm not sure what arch you're using but these offsets don't make sense on
my x86_64 machine...
By "crashed", you mean these warnings, or is there anything else?
Benny
On 2010-11-18 17:21, Tigran Mkrtchyan wrote:
>
> During dead client recovery procedure you client crashed in did.
>
> The procedure was: during IO disconnect network cable. We was testing
> server cleanup sequence. Then we have connected client back. After some
> time client reconnected...and crashed. The last thing I have seen was
> BAD_SESSION
> from the server on READ call:
>
>
>
> Nov 18 16:04:29 slinux kernel: [ 555.385877] Got error -10052 from the
> server on DESTROY_SESSION. Session has been destroyed regardless...
> Nov 18 16:04:29 slinux kernel: [ 555.395300] ------------[ cut here
> ]------------
> Nov 18 16:04:29 slinux kernel: [ 555.395321] WARNING: at
> fs/nfs/pnfs.c:477 pnfs_destroy_layout+0xd6/0x100 [nfs]()
> Nov 18 16:04:29 slinux kernel: [ 555.395323] Hardware name: VirtualBox
> Nov 18 16:04:29 slinux kernel: [ 555.395324] Modules linked in:
> nfs_layout_nfsv41_files nfs lockd fscache nfs_acl auth_rpcgss sunrpc
> ipv6 af_packet binfmt_misc dm_mirror dm_multipath scsi_dh video output
> thermal sbs sbshc pci_slot fan container battery lp sg ac option
> usb_wwan usbserial thermal_sys button parport_pc tpm_tis tpm serio_raw
> tpm_bios parport e1000 i2c_piix4 pata_mpiix dm_region_hash dm_log dm_mod
> [last unloaded: mperf]
> Nov 18 16:04:29 slinux kernel: [ 555.395425] Pid: 2259, comm:
> 131.169.40.35-m Not tainted 2.6.37-rc1.pnfs.1 #1
> Nov 18 16:04:29 slinux kernel: [ 555.395427] Call Trace:
> Nov 18 16:04:29 slinux kernel: [ 555.395434] [<ffffffffa024a256>] ?
> pnfs_destroy_layout+0xd6/0x100 [nfs]
> Nov 18 16:04:29 slinux kernel: [ 555.395440] [<ffffffffa024a256>] ?
> pnfs_destroy_layout+0xd6/0x100 [nfs]
> Nov 18 16:04:29 slinux kernel: [ 555.395444] [<ffffffff81041fbc>] ?
> warn_slowpath_common+0x8c/0xc0
> Nov 18 16:04:29 slinux kernel: [ 555.395450] [<ffffffffa024a256>] ?
> pnfs_destroy_layout+0xd6/0x100 [nfs]
> Nov 18 16:04:29 slinux kernel: [ 555.395456] [<ffffffffa024a302>] ?
> pnfs_destroy_all_layouts+0x82/0xc0 [nfs]
> Nov 18 16:04:29 slinux kernel: [ 555.395462] [<ffffffffa0242b93>] ?
> nfs4_run_state_manager+0x4e3/0x540 [nfs]
> Nov 18 16:04:29 slinux kernel: [ 555.395469] [<ffffffffa02426b0>] ?
> nfs4_run_state_manager+0x0/0x540 [nfs]
> Nov 18 16:04:29 slinux kernel: [ 555.395471] [<ffffffff8105b466>] ?
> kthread+0x96/0xa0
> Nov 18 16:04:29 slinux kernel: [ 555.395474] [<ffffffff81003a14>] ?
> kernel_thread_helper+0x4/0x10
> Nov 18 16:04:29 slinux kernel: [ 555.395476] [<ffffffff8105b3d0>] ?
> kthread+0x0/0xa0
> Nov 18 16:04:29 slinux kernel: [ 555.395478] [<ffffffff81003a10>] ?
> kernel_thread_helper+0x0/0x10
> Nov 18 16:04:29 slinux kernel: [ 555.395479] ---[ end trace
> 8f55223a1de06cc6 ]---
> Nov 18 16:04:29 slinux kernel: [ 555.395480] ------------[ cut here
> ]------------
> Nov 18 16:04:29 slinux kernel: [ 555.395486] WARNING: at
> fs/nfs/pnfs.c:478 pnfs_destroy_layout+0xfc/0x100 [nfs]()
> Nov 18 16:04:29 slinux kernel: [ 555.395487] Hardware name: VirtualBox
> Nov 18 16:04:29 slinux kernel: [ 555.395488] Modules linked in:
> nfs_layout_nfsv41_files nfs lockd fscache nfs_acl auth_rpcgss sunrpc
> ipv6 af_packet binfmt_misc dm_mirror dm_multipath scsi_dh video output
> thermal sbs sbshc pci_slot fan container battery lp sg ac option
> usb_wwan usbserial thermal_sys button parport_pc tpm_tis tpm serio_raw
> tpm_bios parport e1000 i2c_piix4 pata_mpiix dm_region_hash dm_log dm_mod
> [last unloaded: mperf]
> Nov 18 16:04:29 slinux kernel: [ 555.395503] Pid: 2259, comm:
> 131.169.40.35-m Tainted: G W 2.6.37-rc1.pnfs.1 #1
> Nov 18 16:04:29 slinux kernel: [ 555.395504] Call Trace:
> Nov 18 16:04:29 slinux kernel: [ 555.395510] [<ffffffffa024a27c>] ?
> pnfs_destroy_layout+0xfc/0x100 [nfs]
> Nov 18 16:04:29 slinux kernel: [ 555.395516] [<ffffffffa024a27c>] ?
> pnfs_destroy_layout+0xfc/0x100 [nfs]
> Nov 18 16:04:29 slinux kernel: [ 555.395518] [<ffffffff81041fbc>] ?
> warn_slowpath_common+0x8c/0xc0
> Nov 18 16:04:29 slinux kernel: [ 555.395523] [<ffffffffa024a27c>] ?
> pnfs_destroy_layout+0xfc/0x100 [nfs]
> Nov 18 16:04:29 slinux kernel: [ 555.395529] [<ffffffffa024a302>] ?
> pnfs_destroy_all_layouts+0x82/0xc0 [nfs]
> Nov 18 16:04:29 slinux kernel: [ 555.395536] [<ffffffffa0242b93>] ?
> nfs4_run_state_manager+0x4e3/0x540 [nfs]
> Nov 18 16:04:29 slinux kernel: [ 555.395542] [<ffffffffa02426b0>] ?
> nfs4_run_state_manager+0x0/0x540 [nfs]
> Nov 18 16:04:29 slinux kernel: [ 555.395544] [<ffffffff8105b466>] ?
> kthread+0x96/0xa0
> Nov 18 16:04:29 slinux kernel: [ 555.395546] [<ffffffff81003a14>] ?
> kernel_thread_helper+0x4/0x10
> Nov 18 16:04:29 slinux kernel: [ 555.395548] [<ffffffff8105b3d0>] ?
> kthread+0x0/0xa0
> Nov 18 16:04:29 slinux kernel: [ 555.395550] [<ffffffff81003a10>] ?
> kernel_thread_helper+0x0/0x10
> Nov 18 16:04:29 slinux kernel: [ 555.395551] ---[ end trace
> 8f55223a1de06cc7 ]---
> Nov 18 16:04:29 slinux kernel: [ 555.395552] ------------[ cut here
> ]------------
> Nov 18 16:04:29 slinux kernel: [ 555.395558] WARNING: at
> fs/nfs/pnfs.c:479 pnfs_destroy_layout+0xe9/0x100 [nfs]()
> Nov 18 16:04:29 slinux kernel: [ 555.395559] Hardware name: VirtualBox
> Nov 18 16:04:29 slinux kernel: [ 555.395560] Modules linked in:
> nfs_layout_nfsv41_files nfs lockd fscache nfs_acl auth_rpcgss sunrpc
> ipv6 af_packet binfmt_misc dm_mirror dm_multipath scsi_dh video output
> thermal sbs sbshc pci_slot fan container battery lp sg ac option
> usb_wwan usbserial thermal_sys button parport_pc tpm_tis tpm serio_raw
> tpm_bios parport e1000 i2c_piix4 pata_mpiix dm_region_hash dm_log dm_mod
> [last unloaded: mperf]
> Nov 18 16:04:29 slinux kernel: [ 555.395575] Pid: 2259, comm:
> 131.169.40.35-m Tainted: G W 2.6.37-rc1.pnfs.1 #1
> Nov 18 16:04:29 slinux kernel: [ 555.395576] Call Trace:
>
> this is
>
> pnfs-all-2.6.37-rc1-2010-11-03 from Banny's tree (git
> 6a1df873544d146fcdc493034b170879985909e8) +
> http://git.kernel.org/?p=linux/kernel/git/torvalds/linux-2.6.git;a=blobdiff;f=mm/vmstat.c;h=42eac4d33216b81c307a87016e821051bc86146e;hp=cd2e42be7b68f73dc60f40631f2b9f87708d3b47;hb=ff8b16d7e15a8ba2a6086645614a483e048e3fbf;hpb=81a6cff678ecee7cdc0658285d3150660c07cfce
>
>
>
> Regards,
> Tigran.
> --
> To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: 2.6.37-rc1 krash
2010-11-18 16:59 ` Benny Halevy
@ 2010-11-19 11:27 ` Tigran Mkrtchyan
2010-11-23 9:56 ` Benny Halevy
0 siblings, 1 reply; 6+ messages in thread
From: Tigran Mkrtchyan @ 2010-11-19 11:27 UTC (permalink / raw)
To: NFS list; +Cc: Benny Halevy
Hi Benny,
On 11/18/2010 05:59 PM, Benny Halevy wrote:
> Hi Tigran, Can you please gdb your nfs.ko module to get the line number of the warning?
> (gdb) list *(pnfs_destroy_layout+0xd6)
> I'm not sure what arch you're using but these offsets don't make sense on
> my x86_64 machine...
here is the corresponding lines:
if (lo) {
pnfs_clear_lseg_list(lo, &tmp_list, &range);
WARN_ON(!list_empty(&nfsi->layout->segs));
WARN_ON(!list_empty(&nfsi->layout->layouts));
WARN_ON(nfsi->layout->refcount != 1);
/* Matched by refcount set to 1 in alloc_init_layout_hdr */
put_layout_hdr_locked(lo);
}
> By "crashed", you mean these warnings, or is there anything else?
>
after that machine was dead and I have to reset it. This messages I got
from
/var/log/messages and they was the last entries before new boot sequence.
I will do the same exercise with -rc2 next week.
Regards,
Tigran.
> Benny
>
> On 2010-11-18 17:21, Tigran Mkrtchyan wrote:
>> During dead client recovery procedure you client crashed in did.
>>
>> The procedure was: during IO disconnect network cable. We was testing
>> server cleanup sequence. Then we have connected client back. After some
>> time client reconnected...and crashed. The last thing I have seen was
>> BAD_SESSION
>> from the server on READ call:
>>
>>
>>
>> Nov 18 16:04:29 slinux kernel: [ 555.385877] Got error -10052 from the
>> server on DESTROY_SESSION. Session has been destroyed regardless...
>> Nov 18 16:04:29 slinux kernel: [ 555.395300] ------------[ cut here
>> ]------------
>> Nov 18 16:04:29 slinux kernel: [ 555.395321] WARNING: at
>> fs/nfs/pnfs.c:477 pnfs_destroy_layout+0xd6/0x100 [nfs]()
>> Nov 18 16:04:29 slinux kernel: [ 555.395323] Hardware name: VirtualBox
>> Nov 18 16:04:29 slinux kernel: [ 555.395324] Modules linked in:
>> nfs_layout_nfsv41_files nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>> ipv6 af_packet binfmt_misc dm_mirror dm_multipath scsi_dh video output
>> thermal sbs sbshc pci_slot fan container battery lp sg ac option
>> usb_wwan usbserial thermal_sys button parport_pc tpm_tis tpm serio_raw
>> tpm_bios parport e1000 i2c_piix4 pata_mpiix dm_region_hash dm_log dm_mod
>> [last unloaded: mperf]
>> Nov 18 16:04:29 slinux kernel: [ 555.395425] Pid: 2259, comm:
>> 131.169.40.35-m Not tainted 2.6.37-rc1.pnfs.1 #1
>> Nov 18 16:04:29 slinux kernel: [ 555.395427] Call Trace:
>> Nov 18 16:04:29 slinux kernel: [ 555.395434] [<ffffffffa024a256>] ?
>> pnfs_destroy_layout+0xd6/0x100 [nfs]
>> Nov 18 16:04:29 slinux kernel: [ 555.395440] [<ffffffffa024a256>] ?
>> pnfs_destroy_layout+0xd6/0x100 [nfs]
>> Nov 18 16:04:29 slinux kernel: [ 555.395444] [<ffffffff81041fbc>] ?
>> warn_slowpath_common+0x8c/0xc0
>> Nov 18 16:04:29 slinux kernel: [ 555.395450] [<ffffffffa024a256>] ?
>> pnfs_destroy_layout+0xd6/0x100 [nfs]
>> Nov 18 16:04:29 slinux kernel: [ 555.395456] [<ffffffffa024a302>] ?
>> pnfs_destroy_all_layouts+0x82/0xc0 [nfs]
>> Nov 18 16:04:29 slinux kernel: [ 555.395462] [<ffffffffa0242b93>] ?
>> nfs4_run_state_manager+0x4e3/0x540 [nfs]
>> Nov 18 16:04:29 slinux kernel: [ 555.395469] [<ffffffffa02426b0>] ?
>> nfs4_run_state_manager+0x0/0x540 [nfs]
>> Nov 18 16:04:29 slinux kernel: [ 555.395471] [<ffffffff8105b466>] ?
>> kthread+0x96/0xa0
>> Nov 18 16:04:29 slinux kernel: [ 555.395474] [<ffffffff81003a14>] ?
>> kernel_thread_helper+0x4/0x10
>> Nov 18 16:04:29 slinux kernel: [ 555.395476] [<ffffffff8105b3d0>] ?
>> kthread+0x0/0xa0
>> Nov 18 16:04:29 slinux kernel: [ 555.395478] [<ffffffff81003a10>] ?
>> kernel_thread_helper+0x0/0x10
>> Nov 18 16:04:29 slinux kernel: [ 555.395479] ---[ end trace
>> 8f55223a1de06cc6 ]---
>> Nov 18 16:04:29 slinux kernel: [ 555.395480] ------------[ cut here
>> ]------------
>> Nov 18 16:04:29 slinux kernel: [ 555.395486] WARNING: at
>> fs/nfs/pnfs.c:478 pnfs_destroy_layout+0xfc/0x100 [nfs]()
>> Nov 18 16:04:29 slinux kernel: [ 555.395487] Hardware name: VirtualBox
>> Nov 18 16:04:29 slinux kernel: [ 555.395488] Modules linked in:
>> nfs_layout_nfsv41_files nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>> ipv6 af_packet binfmt_misc dm_mirror dm_multipath scsi_dh video output
>> thermal sbs sbshc pci_slot fan container battery lp sg ac option
>> usb_wwan usbserial thermal_sys button parport_pc tpm_tis tpm serio_raw
>> tpm_bios parport e1000 i2c_piix4 pata_mpiix dm_region_hash dm_log dm_mod
>> [last unloaded: mperf]
>> Nov 18 16:04:29 slinux kernel: [ 555.395503] Pid: 2259, comm:
>> 131.169.40.35-m Tainted: G W 2.6.37-rc1.pnfs.1 #1
>> Nov 18 16:04:29 slinux kernel: [ 555.395504] Call Trace:
>> Nov 18 16:04:29 slinux kernel: [ 555.395510] [<ffffffffa024a27c>] ?
>> pnfs_destroy_layout+0xfc/0x100 [nfs]
>> Nov 18 16:04:29 slinux kernel: [ 555.395516] [<ffffffffa024a27c>] ?
>> pnfs_destroy_layout+0xfc/0x100 [nfs]
>> Nov 18 16:04:29 slinux kernel: [ 555.395518] [<ffffffff81041fbc>] ?
>> warn_slowpath_common+0x8c/0xc0
>> Nov 18 16:04:29 slinux kernel: [ 555.395523] [<ffffffffa024a27c>] ?
>> pnfs_destroy_layout+0xfc/0x100 [nfs]
>> Nov 18 16:04:29 slinux kernel: [ 555.395529] [<ffffffffa024a302>] ?
>> pnfs_destroy_all_layouts+0x82/0xc0 [nfs]
>> Nov 18 16:04:29 slinux kernel: [ 555.395536] [<ffffffffa0242b93>] ?
>> nfs4_run_state_manager+0x4e3/0x540 [nfs]
>> Nov 18 16:04:29 slinux kernel: [ 555.395542] [<ffffffffa02426b0>] ?
>> nfs4_run_state_manager+0x0/0x540 [nfs]
>> Nov 18 16:04:29 slinux kernel: [ 555.395544] [<ffffffff8105b466>] ?
>> kthread+0x96/0xa0
>> Nov 18 16:04:29 slinux kernel: [ 555.395546] [<ffffffff81003a14>] ?
>> kernel_thread_helper+0x4/0x10
>> Nov 18 16:04:29 slinux kernel: [ 555.395548] [<ffffffff8105b3d0>] ?
>> kthread+0x0/0xa0
>> Nov 18 16:04:29 slinux kernel: [ 555.395550] [<ffffffff81003a10>] ?
>> kernel_thread_helper+0x0/0x10
>> Nov 18 16:04:29 slinux kernel: [ 555.395551] ---[ end trace
>> 8f55223a1de06cc7 ]---
>> Nov 18 16:04:29 slinux kernel: [ 555.395552] ------------[ cut here
>> ]------------
>> Nov 18 16:04:29 slinux kernel: [ 555.395558] WARNING: at
>> fs/nfs/pnfs.c:479 pnfs_destroy_layout+0xe9/0x100 [nfs]()
>> Nov 18 16:04:29 slinux kernel: [ 555.395559] Hardware name: VirtualBox
>> Nov 18 16:04:29 slinux kernel: [ 555.395560] Modules linked in:
>> nfs_layout_nfsv41_files nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>> ipv6 af_packet binfmt_misc dm_mirror dm_multipath scsi_dh video output
>> thermal sbs sbshc pci_slot fan container battery lp sg ac option
>> usb_wwan usbserial thermal_sys button parport_pc tpm_tis tpm serio_raw
>> tpm_bios parport e1000 i2c_piix4 pata_mpiix dm_region_hash dm_log dm_mod
>> [last unloaded: mperf]
>> Nov 18 16:04:29 slinux kernel: [ 555.395575] Pid: 2259, comm:
>> 131.169.40.35-m Tainted: G W 2.6.37-rc1.pnfs.1 #1
>> Nov 18 16:04:29 slinux kernel: [ 555.395576] Call Trace:
>>
>> this is
>>
>> pnfs-all-2.6.37-rc1-2010-11-03 from Banny's tree (git
>> 6a1df873544d146fcdc493034b170879985909e8) +
>> http://git.kernel.org/?p=linux/kernel/git/torvalds/linux-2.6.git;a=blobdiff;f=mm/vmstat.c;h=42eac4d33216b81c307a87016e821051bc86146e;hp=cd2e42be7b68f73dc60f40631f2b9f87708d3b47;hb=ff8b16d7e15a8ba2a6086645614a483e048e3fbf;hpb=81a6cff678ecee7cdc0658285d3150660c07cfce
>>
>>
>>
>> Regards,
>> Tigran.
>> --
>> To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: 2.6.37-rc1 krash
2010-11-19 11:27 ` Tigran Mkrtchyan
@ 2010-11-23 9:56 ` Benny Halevy
2010-11-25 16:17 ` Tigran Mkrtchyan
0 siblings, 1 reply; 6+ messages in thread
From: Benny Halevy @ 2010-11-23 9:56 UTC (permalink / raw)
To: Tigran Mkrtchyan; +Cc: NFS list
On 2010-11-19 13:27, Tigran Mkrtchyan wrote:
> Hi Benny,
>
>
> On 11/18/2010 05:59 PM, Benny Halevy wrote:
>> Hi Tigran, Can you please gdb your nfs.ko module to get the line number of the warning?
>> (gdb) list *(pnfs_destroy_layout+0xd6)
>> I'm not sure what arch you're using but these offsets don't make sense on
>> my x86_64 machine...
> here is the corresponding lines:
>
> if (lo) {
> pnfs_clear_lseg_list(lo, &tmp_list, &range);
> WARN_ON(!list_empty(&nfsi->layout->segs));
> WARN_ON(!list_empty(&nfsi->layout->layouts));
> WARN_ON(nfsi->layout->refcount != 1);
>
> /* Matched by refcount set to 1 in alloc_init_layout_hdr */
> put_layout_hdr_locked(lo);
> }
and what line in particular? :)
>
>> By "crashed", you mean these warnings, or is there anything else?
>>
>
> after that machine was dead and I have to reset it. This messages I got
> from
> /var/log/messages and they was the last entries before new boot sequence.
>
> I will do the same exercise with -rc2 next week.
Thanks!
>
> Regards,
> Tigran.
>
>> Benny
>>
>> On 2010-11-18 17:21, Tigran Mkrtchyan wrote:
>>> During dead client recovery procedure you client crashed in did.
>>>
>>> The procedure was: during IO disconnect network cable. We was testing
>>> server cleanup sequence. Then we have connected client back. After some
>>> time client reconnected...and crashed. The last thing I have seen was
>>> BAD_SESSION
>>> from the server on READ call:
>>>
>>>
>>>
>>> Nov 18 16:04:29 slinux kernel: [ 555.385877] Got error -10052 from the
>>> server on DESTROY_SESSION. Session has been destroyed regardless...
>>> Nov 18 16:04:29 slinux kernel: [ 555.395300] ------------[ cut here
>>> ]------------
>>> Nov 18 16:04:29 slinux kernel: [ 555.395321] WARNING: at
>>> fs/nfs/pnfs.c:477 pnfs_destroy_layout+0xd6/0x100 [nfs]()
>>> Nov 18 16:04:29 slinux kernel: [ 555.395323] Hardware name: VirtualBox
>>> Nov 18 16:04:29 slinux kernel: [ 555.395324] Modules linked in:
>>> nfs_layout_nfsv41_files nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>>> ipv6 af_packet binfmt_misc dm_mirror dm_multipath scsi_dh video output
>>> thermal sbs sbshc pci_slot fan container battery lp sg ac option
>>> usb_wwan usbserial thermal_sys button parport_pc tpm_tis tpm serio_raw
>>> tpm_bios parport e1000 i2c_piix4 pata_mpiix dm_region_hash dm_log dm_mod
>>> [last unloaded: mperf]
>>> Nov 18 16:04:29 slinux kernel: [ 555.395425] Pid: 2259, comm:
>>> 131.169.40.35-m Not tainted 2.6.37-rc1.pnfs.1 #1
>>> Nov 18 16:04:29 slinux kernel: [ 555.395427] Call Trace:
>>> Nov 18 16:04:29 slinux kernel: [ 555.395434] [<ffffffffa024a256>] ?
>>> pnfs_destroy_layout+0xd6/0x100 [nfs]
>>> Nov 18 16:04:29 slinux kernel: [ 555.395440] [<ffffffffa024a256>] ?
>>> pnfs_destroy_layout+0xd6/0x100 [nfs]
>>> Nov 18 16:04:29 slinux kernel: [ 555.395444] [<ffffffff81041fbc>] ?
>>> warn_slowpath_common+0x8c/0xc0
>>> Nov 18 16:04:29 slinux kernel: [ 555.395450] [<ffffffffa024a256>] ?
>>> pnfs_destroy_layout+0xd6/0x100 [nfs]
>>> Nov 18 16:04:29 slinux kernel: [ 555.395456] [<ffffffffa024a302>] ?
>>> pnfs_destroy_all_layouts+0x82/0xc0 [nfs]
>>> Nov 18 16:04:29 slinux kernel: [ 555.395462] [<ffffffffa0242b93>] ?
>>> nfs4_run_state_manager+0x4e3/0x540 [nfs]
>>> Nov 18 16:04:29 slinux kernel: [ 555.395469] [<ffffffffa02426b0>] ?
>>> nfs4_run_state_manager+0x0/0x540 [nfs]
>>> Nov 18 16:04:29 slinux kernel: [ 555.395471] [<ffffffff8105b466>] ?
>>> kthread+0x96/0xa0
>>> Nov 18 16:04:29 slinux kernel: [ 555.395474] [<ffffffff81003a14>] ?
>>> kernel_thread_helper+0x4/0x10
>>> Nov 18 16:04:29 slinux kernel: [ 555.395476] [<ffffffff8105b3d0>] ?
>>> kthread+0x0/0xa0
>>> Nov 18 16:04:29 slinux kernel: [ 555.395478] [<ffffffff81003a10>] ?
>>> kernel_thread_helper+0x0/0x10
>>> Nov 18 16:04:29 slinux kernel: [ 555.395479] ---[ end trace
>>> 8f55223a1de06cc6 ]---
>>> Nov 18 16:04:29 slinux kernel: [ 555.395480] ------------[ cut here
>>> ]------------
>>> Nov 18 16:04:29 slinux kernel: [ 555.395486] WARNING: at
>>> fs/nfs/pnfs.c:478 pnfs_destroy_layout+0xfc/0x100 [nfs]()
>>> Nov 18 16:04:29 slinux kernel: [ 555.395487] Hardware name: VirtualBox
>>> Nov 18 16:04:29 slinux kernel: [ 555.395488] Modules linked in:
>>> nfs_layout_nfsv41_files nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>>> ipv6 af_packet binfmt_misc dm_mirror dm_multipath scsi_dh video output
>>> thermal sbs sbshc pci_slot fan container battery lp sg ac option
>>> usb_wwan usbserial thermal_sys button parport_pc tpm_tis tpm serio_raw
>>> tpm_bios parport e1000 i2c_piix4 pata_mpiix dm_region_hash dm_log dm_mod
>>> [last unloaded: mperf]
>>> Nov 18 16:04:29 slinux kernel: [ 555.395503] Pid: 2259, comm:
>>> 131.169.40.35-m Tainted: G W 2.6.37-rc1.pnfs.1 #1
>>> Nov 18 16:04:29 slinux kernel: [ 555.395504] Call Trace:
>>> Nov 18 16:04:29 slinux kernel: [ 555.395510] [<ffffffffa024a27c>] ?
>>> pnfs_destroy_layout+0xfc/0x100 [nfs]
>>> Nov 18 16:04:29 slinux kernel: [ 555.395516] [<ffffffffa024a27c>] ?
>>> pnfs_destroy_layout+0xfc/0x100 [nfs]
>>> Nov 18 16:04:29 slinux kernel: [ 555.395518] [<ffffffff81041fbc>] ?
>>> warn_slowpath_common+0x8c/0xc0
>>> Nov 18 16:04:29 slinux kernel: [ 555.395523] [<ffffffffa024a27c>] ?
>>> pnfs_destroy_layout+0xfc/0x100 [nfs]
>>> Nov 18 16:04:29 slinux kernel: [ 555.395529] [<ffffffffa024a302>] ?
>>> pnfs_destroy_all_layouts+0x82/0xc0 [nfs]
>>> Nov 18 16:04:29 slinux kernel: [ 555.395536] [<ffffffffa0242b93>] ?
>>> nfs4_run_state_manager+0x4e3/0x540 [nfs]
>>> Nov 18 16:04:29 slinux kernel: [ 555.395542] [<ffffffffa02426b0>] ?
>>> nfs4_run_state_manager+0x0/0x540 [nfs]
>>> Nov 18 16:04:29 slinux kernel: [ 555.395544] [<ffffffff8105b466>] ?
>>> kthread+0x96/0xa0
>>> Nov 18 16:04:29 slinux kernel: [ 555.395546] [<ffffffff81003a14>] ?
>>> kernel_thread_helper+0x4/0x10
>>> Nov 18 16:04:29 slinux kernel: [ 555.395548] [<ffffffff8105b3d0>] ?
>>> kthread+0x0/0xa0
>>> Nov 18 16:04:29 slinux kernel: [ 555.395550] [<ffffffff81003a10>] ?
>>> kernel_thread_helper+0x0/0x10
>>> Nov 18 16:04:29 slinux kernel: [ 555.395551] ---[ end trace
>>> 8f55223a1de06cc7 ]---
>>> Nov 18 16:04:29 slinux kernel: [ 555.395552] ------------[ cut here
>>> ]------------
>>> Nov 18 16:04:29 slinux kernel: [ 555.395558] WARNING: at
>>> fs/nfs/pnfs.c:479 pnfs_destroy_layout+0xe9/0x100 [nfs]()
>>> Nov 18 16:04:29 slinux kernel: [ 555.395559] Hardware name: VirtualBox
>>> Nov 18 16:04:29 slinux kernel: [ 555.395560] Modules linked in:
>>> nfs_layout_nfsv41_files nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>>> ipv6 af_packet binfmt_misc dm_mirror dm_multipath scsi_dh video output
>>> thermal sbs sbshc pci_slot fan container battery lp sg ac option
>>> usb_wwan usbserial thermal_sys button parport_pc tpm_tis tpm serio_raw
>>> tpm_bios parport e1000 i2c_piix4 pata_mpiix dm_region_hash dm_log dm_mod
>>> [last unloaded: mperf]
>>> Nov 18 16:04:29 slinux kernel: [ 555.395575] Pid: 2259, comm:
>>> 131.169.40.35-m Tainted: G W 2.6.37-rc1.pnfs.1 #1
>>> Nov 18 16:04:29 slinux kernel: [ 555.395576] Call Trace:
>>>
>>> this is
>>>
>>> pnfs-all-2.6.37-rc1-2010-11-03 from Banny's tree (git
>>> 6a1df873544d146fcdc493034b170879985909e8) +
>>> http://git.kernel.org/?p=linux/kernel/git/torvalds/linux-2.6.git;a=blobdiff;f=mm/vmstat.c;h=42eac4d33216b81c307a87016e821051bc86146e;hp=cd2e42be7b68f73dc60f40631f2b9f87708d3b47;hb=ff8b16d7e15a8ba2a6086645614a483e048e3fbf;hpb=81a6cff678ecee7cdc0658285d3150660c07cfce
>>>
>>>
>>>
>>> Regards,
>>> Tigran.
>>> --
>>> To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
>>> the body of a message to majordomo@vger.kernel.org
>>> More majordomo info at http://vger.kernel.org/majordomo-info.html
>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: 2.6.37-rc1 krash
2010-11-23 9:56 ` Benny Halevy
@ 2010-11-25 16:17 ` Tigran Mkrtchyan
2010-11-28 12:14 ` Benny Halevy
0 siblings, 1 reply; 6+ messages in thread
From: Tigran Mkrtchyan @ 2010-11-25 16:17 UTC (permalink / raw)
To: NFS list; +Cc: Benny Halevy
On 11/23/2010 10:56 AM, Benny Halevy wrote:
> On 2010-11-19 13:27, Tigran Mkrtchyan wrote:
>> Hi Benny,
>>
>>
>> On 11/18/2010 05:59 PM, Benny Halevy wrote:
>>> Hi Tigran, Can you please gdb your nfs.ko module to get the line number of the warning?
>>> (gdb) list *(pnfs_destroy_layout+0xd6)
>>> I'm not sure what arch you're using but these offsets don't make sense on
>>> my x86_64 machine...
>> here is the corresponding lines:
>>
>> if (lo) {
>> pnfs_clear_lseg_list(lo,&tmp_list,&range);
>> WARN_ON(!list_empty(&nfsi->layout->segs));
>> WARN_ON(!list_empty(&nfsi->layout->layouts));
>> WARN_ON(nfsi->layout->refcount != 1);
>>
>> /* Matched by refcount set to 1 in alloc_init_layout_hdr */
>> put_layout_hdr_locked(lo);
>> }
> and what line in particular? :)
>
>>> By "crashed", you mean these warnings, or is there anything else?
>>>
>> after that machine was dead and I have to reset it. This messages I got
>> from
>> /var/log/messages and they was the last entries before new boot sequence.
>>
>> I will do the same exercise with -rc2 next week.
Hi Benny,
I can't reproduce it with -rc3. Shall I rollback to -rc1?
Regards,
Tigran.
> Thanks!
>
>> Regards,
>> Tigran.
>>
>>> Benny
>>>
>>> On 2010-11-18 17:21, Tigran Mkrtchyan wrote:
>>>> During dead client recovery procedure you client crashed in did.
>>>>
>>>> The procedure was: during IO disconnect network cable. We was testing
>>>> server cleanup sequence. Then we have connected client back. After some
>>>> time client reconnected...and crashed. The last thing I have seen was
>>>> BAD_SESSION
>>>> from the server on READ call:
>>>>
>>>>
>>>>
>>>> Nov 18 16:04:29 slinux kernel: [ 555.385877] Got error -10052 from the
>>>> server on DESTROY_SESSION. Session has been destroyed regardless...
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395300] ------------[ cut here
>>>> ]------------
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395321] WARNING: at
>>>> fs/nfs/pnfs.c:477 pnfs_destroy_layout+0xd6/0x100 [nfs]()
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395323] Hardware name: VirtualBox
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395324] Modules linked in:
>>>> nfs_layout_nfsv41_files nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>>>> ipv6 af_packet binfmt_misc dm_mirror dm_multipath scsi_dh video output
>>>> thermal sbs sbshc pci_slot fan container battery lp sg ac option
>>>> usb_wwan usbserial thermal_sys button parport_pc tpm_tis tpm serio_raw
>>>> tpm_bios parport e1000 i2c_piix4 pata_mpiix dm_region_hash dm_log dm_mod
>>>> [last unloaded: mperf]
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395425] Pid: 2259, comm:
>>>> 131.169.40.35-m Not tainted 2.6.37-rc1.pnfs.1 #1
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395427] Call Trace:
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395434] [<ffffffffa024a256>] ?
>>>> pnfs_destroy_layout+0xd6/0x100 [nfs]
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395440] [<ffffffffa024a256>] ?
>>>> pnfs_destroy_layout+0xd6/0x100 [nfs]
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395444] [<ffffffff81041fbc>] ?
>>>> warn_slowpath_common+0x8c/0xc0
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395450] [<ffffffffa024a256>] ?
>>>> pnfs_destroy_layout+0xd6/0x100 [nfs]
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395456] [<ffffffffa024a302>] ?
>>>> pnfs_destroy_all_layouts+0x82/0xc0 [nfs]
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395462] [<ffffffffa0242b93>] ?
>>>> nfs4_run_state_manager+0x4e3/0x540 [nfs]
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395469] [<ffffffffa02426b0>] ?
>>>> nfs4_run_state_manager+0x0/0x540 [nfs]
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395471] [<ffffffff8105b466>] ?
>>>> kthread+0x96/0xa0
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395474] [<ffffffff81003a14>] ?
>>>> kernel_thread_helper+0x4/0x10
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395476] [<ffffffff8105b3d0>] ?
>>>> kthread+0x0/0xa0
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395478] [<ffffffff81003a10>] ?
>>>> kernel_thread_helper+0x0/0x10
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395479] ---[ end trace
>>>> 8f55223a1de06cc6 ]---
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395480] ------------[ cut here
>>>> ]------------
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395486] WARNING: at
>>>> fs/nfs/pnfs.c:478 pnfs_destroy_layout+0xfc/0x100 [nfs]()
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395487] Hardware name: VirtualBox
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395488] Modules linked in:
>>>> nfs_layout_nfsv41_files nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>>>> ipv6 af_packet binfmt_misc dm_mirror dm_multipath scsi_dh video output
>>>> thermal sbs sbshc pci_slot fan container battery lp sg ac option
>>>> usb_wwan usbserial thermal_sys button parport_pc tpm_tis tpm serio_raw
>>>> tpm_bios parport e1000 i2c_piix4 pata_mpiix dm_region_hash dm_log dm_mod
>>>> [last unloaded: mperf]
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395503] Pid: 2259, comm:
>>>> 131.169.40.35-m Tainted: G W 2.6.37-rc1.pnfs.1 #1
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395504] Call Trace:
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395510] [<ffffffffa024a27c>] ?
>>>> pnfs_destroy_layout+0xfc/0x100 [nfs]
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395516] [<ffffffffa024a27c>] ?
>>>> pnfs_destroy_layout+0xfc/0x100 [nfs]
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395518] [<ffffffff81041fbc>] ?
>>>> warn_slowpath_common+0x8c/0xc0
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395523] [<ffffffffa024a27c>] ?
>>>> pnfs_destroy_layout+0xfc/0x100 [nfs]
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395529] [<ffffffffa024a302>] ?
>>>> pnfs_destroy_all_layouts+0x82/0xc0 [nfs]
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395536] [<ffffffffa0242b93>] ?
>>>> nfs4_run_state_manager+0x4e3/0x540 [nfs]
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395542] [<ffffffffa02426b0>] ?
>>>> nfs4_run_state_manager+0x0/0x540 [nfs]
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395544] [<ffffffff8105b466>] ?
>>>> kthread+0x96/0xa0
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395546] [<ffffffff81003a14>] ?
>>>> kernel_thread_helper+0x4/0x10
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395548] [<ffffffff8105b3d0>] ?
>>>> kthread+0x0/0xa0
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395550] [<ffffffff81003a10>] ?
>>>> kernel_thread_helper+0x0/0x10
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395551] ---[ end trace
>>>> 8f55223a1de06cc7 ]---
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395552] ------------[ cut here
>>>> ]------------
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395558] WARNING: at
>>>> fs/nfs/pnfs.c:479 pnfs_destroy_layout+0xe9/0x100 [nfs]()
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395559] Hardware name: VirtualBox
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395560] Modules linked in:
>>>> nfs_layout_nfsv41_files nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>>>> ipv6 af_packet binfmt_misc dm_mirror dm_multipath scsi_dh video output
>>>> thermal sbs sbshc pci_slot fan container battery lp sg ac option
>>>> usb_wwan usbserial thermal_sys button parport_pc tpm_tis tpm serio_raw
>>>> tpm_bios parport e1000 i2c_piix4 pata_mpiix dm_region_hash dm_log dm_mod
>>>> [last unloaded: mperf]
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395575] Pid: 2259, comm:
>>>> 131.169.40.35-m Tainted: G W 2.6.37-rc1.pnfs.1 #1
>>>> Nov 18 16:04:29 slinux kernel: [ 555.395576] Call Trace:
>>>>
>>>> this is
>>>>
>>>> pnfs-all-2.6.37-rc1-2010-11-03 from Banny's tree (git
>>>> 6a1df873544d146fcdc493034b170879985909e8) +
>>>> http://git.kernel.org/?p=linux/kernel/git/torvalds/linux-2.6.git;a=blobdiff;f=mm/vmstat.c;h=42eac4d33216b81c307a87016e821051bc86146e;hp=cd2e42be7b68f73dc60f40631f2b9f87708d3b47;hb=ff8b16d7e15a8ba2a6086645614a483e048e3fbf;hpb=81a6cff678ecee7cdc0658285d3150660c07cfce
>>>>
>>>>
>>>>
>>>> Regards,
>>>> Tigran.
>>>> --
>>>> To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
>>>> the body of a message to majordomo@vger.kernel.org
>>>> More majordomo info at http://vger.kernel.org/majordomo-info.html
>> --
>> To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: 2.6.37-rc1 krash
2010-11-25 16:17 ` Tigran Mkrtchyan
@ 2010-11-28 12:14 ` Benny Halevy
0 siblings, 0 replies; 6+ messages in thread
From: Benny Halevy @ 2010-11-28 12:14 UTC (permalink / raw)
To: Tigran Mkrtchyan; +Cc: NFS list
On 2010-11-25 18:17, Tigran Mkrtchyan wrote:
> On 11/23/2010 10:56 AM, Benny Halevy wrote:
>> On 2010-11-19 13:27, Tigran Mkrtchyan wrote:
>>> Hi Benny,
>>>
>>>
>>> On 11/18/2010 05:59 PM, Benny Halevy wrote:
>>>> Hi Tigran, Can you please gdb your nfs.ko module to get the line number of the warning?
>>>> (gdb) list *(pnfs_destroy_layout+0xd6)
>>>> I'm not sure what arch you're using but these offsets don't make sense on
>>>> my x86_64 machine...
>>> here is the corresponding lines:
>>>
>>> if (lo) {
>>> pnfs_clear_lseg_list(lo,&tmp_list,&range);
>>> WARN_ON(!list_empty(&nfsi->layout->segs));
>>> WARN_ON(!list_empty(&nfsi->layout->layouts));
>>> WARN_ON(nfsi->layout->refcount != 1);
>>>
>>> /* Matched by refcount set to 1 in alloc_init_layout_hdr */
>>> put_layout_hdr_locked(lo);
>>> }
>> and what line in particular? :)
>>
>>>> By "crashed", you mean these warnings, or is there anything else?
>>>>
>>> after that machine was dead and I have to reset it. This messages I got
>>> from
>>> /var/log/messages and they was the last entries before new boot sequence.
>>>
>>> I will do the same exercise with -rc2 next week.
> Hi Benny,
>
> I can't reproduce it with -rc3. Shall I rollback to -rc1?
Hmm, I guess it's just a matter of time until we hit it with the
latest bits...
Benny
>
> Regards,
> Tigran.
>
>> Thanks!
>>
>>> Regards,
>>> Tigran.
>>>
>>>> Benny
>>>>
>>>> On 2010-11-18 17:21, Tigran Mkrtchyan wrote:
>>>>> During dead client recovery procedure you client crashed in did.
>>>>>
>>>>> The procedure was: during IO disconnect network cable. We was testing
>>>>> server cleanup sequence. Then we have connected client back. After some
>>>>> time client reconnected...and crashed. The last thing I have seen was
>>>>> BAD_SESSION
>>>>> from the server on READ call:
>>>>>
>>>>>
>>>>>
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.385877] Got error -10052 from the
>>>>> server on DESTROY_SESSION. Session has been destroyed regardless...
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395300] ------------[ cut here
>>>>> ]------------
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395321] WARNING: at
>>>>> fs/nfs/pnfs.c:477 pnfs_destroy_layout+0xd6/0x100 [nfs]()
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395323] Hardware name: VirtualBox
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395324] Modules linked in:
>>>>> nfs_layout_nfsv41_files nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>>>>> ipv6 af_packet binfmt_misc dm_mirror dm_multipath scsi_dh video output
>>>>> thermal sbs sbshc pci_slot fan container battery lp sg ac option
>>>>> usb_wwan usbserial thermal_sys button parport_pc tpm_tis tpm serio_raw
>>>>> tpm_bios parport e1000 i2c_piix4 pata_mpiix dm_region_hash dm_log dm_mod
>>>>> [last unloaded: mperf]
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395425] Pid: 2259, comm:
>>>>> 131.169.40.35-m Not tainted 2.6.37-rc1.pnfs.1 #1
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395427] Call Trace:
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395434] [<ffffffffa024a256>] ?
>>>>> pnfs_destroy_layout+0xd6/0x100 [nfs]
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395440] [<ffffffffa024a256>] ?
>>>>> pnfs_destroy_layout+0xd6/0x100 [nfs]
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395444] [<ffffffff81041fbc>] ?
>>>>> warn_slowpath_common+0x8c/0xc0
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395450] [<ffffffffa024a256>] ?
>>>>> pnfs_destroy_layout+0xd6/0x100 [nfs]
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395456] [<ffffffffa024a302>] ?
>>>>> pnfs_destroy_all_layouts+0x82/0xc0 [nfs]
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395462] [<ffffffffa0242b93>] ?
>>>>> nfs4_run_state_manager+0x4e3/0x540 [nfs]
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395469] [<ffffffffa02426b0>] ?
>>>>> nfs4_run_state_manager+0x0/0x540 [nfs]
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395471] [<ffffffff8105b466>] ?
>>>>> kthread+0x96/0xa0
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395474] [<ffffffff81003a14>] ?
>>>>> kernel_thread_helper+0x4/0x10
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395476] [<ffffffff8105b3d0>] ?
>>>>> kthread+0x0/0xa0
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395478] [<ffffffff81003a10>] ?
>>>>> kernel_thread_helper+0x0/0x10
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395479] ---[ end trace
>>>>> 8f55223a1de06cc6 ]---
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395480] ------------[ cut here
>>>>> ]------------
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395486] WARNING: at
>>>>> fs/nfs/pnfs.c:478 pnfs_destroy_layout+0xfc/0x100 [nfs]()
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395487] Hardware name: VirtualBox
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395488] Modules linked in:
>>>>> nfs_layout_nfsv41_files nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>>>>> ipv6 af_packet binfmt_misc dm_mirror dm_multipath scsi_dh video output
>>>>> thermal sbs sbshc pci_slot fan container battery lp sg ac option
>>>>> usb_wwan usbserial thermal_sys button parport_pc tpm_tis tpm serio_raw
>>>>> tpm_bios parport e1000 i2c_piix4 pata_mpiix dm_region_hash dm_log dm_mod
>>>>> [last unloaded: mperf]
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395503] Pid: 2259, comm:
>>>>> 131.169.40.35-m Tainted: G W 2.6.37-rc1.pnfs.1 #1
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395504] Call Trace:
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395510] [<ffffffffa024a27c>] ?
>>>>> pnfs_destroy_layout+0xfc/0x100 [nfs]
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395516] [<ffffffffa024a27c>] ?
>>>>> pnfs_destroy_layout+0xfc/0x100 [nfs]
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395518] [<ffffffff81041fbc>] ?
>>>>> warn_slowpath_common+0x8c/0xc0
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395523] [<ffffffffa024a27c>] ?
>>>>> pnfs_destroy_layout+0xfc/0x100 [nfs]
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395529] [<ffffffffa024a302>] ?
>>>>> pnfs_destroy_all_layouts+0x82/0xc0 [nfs]
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395536] [<ffffffffa0242b93>] ?
>>>>> nfs4_run_state_manager+0x4e3/0x540 [nfs]
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395542] [<ffffffffa02426b0>] ?
>>>>> nfs4_run_state_manager+0x0/0x540 [nfs]
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395544] [<ffffffff8105b466>] ?
>>>>> kthread+0x96/0xa0
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395546] [<ffffffff81003a14>] ?
>>>>> kernel_thread_helper+0x4/0x10
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395548] [<ffffffff8105b3d0>] ?
>>>>> kthread+0x0/0xa0
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395550] [<ffffffff81003a10>] ?
>>>>> kernel_thread_helper+0x0/0x10
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395551] ---[ end trace
>>>>> 8f55223a1de06cc7 ]---
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395552] ------------[ cut here
>>>>> ]------------
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395558] WARNING: at
>>>>> fs/nfs/pnfs.c:479 pnfs_destroy_layout+0xe9/0x100 [nfs]()
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395559] Hardware name: VirtualBox
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395560] Modules linked in:
>>>>> nfs_layout_nfsv41_files nfs lockd fscache nfs_acl auth_rpcgss sunrpc
>>>>> ipv6 af_packet binfmt_misc dm_mirror dm_multipath scsi_dh video output
>>>>> thermal sbs sbshc pci_slot fan container battery lp sg ac option
>>>>> usb_wwan usbserial thermal_sys button parport_pc tpm_tis tpm serio_raw
>>>>> tpm_bios parport e1000 i2c_piix4 pata_mpiix dm_region_hash dm_log dm_mod
>>>>> [last unloaded: mperf]
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395575] Pid: 2259, comm:
>>>>> 131.169.40.35-m Tainted: G W 2.6.37-rc1.pnfs.1 #1
>>>>> Nov 18 16:04:29 slinux kernel: [ 555.395576] Call Trace:
>>>>>
>>>>> this is
>>>>>
>>>>> pnfs-all-2.6.37-rc1-2010-11-03 from Banny's tree (git
>>>>> 6a1df873544d146fcdc493034b170879985909e8) +
>>>>> http://git.kernel.org/?p=linux/kernel/git/torvalds/linux-2.6.git;a=blobdiff;f=mm/vmstat.c;h=42eac4d33216b81c307a87016e821051bc86146e;hp=cd2e42be7b68f73dc60f40631f2b9f87708d3b47;hb=ff8b16d7e15a8ba2a6086645614a483e048e3fbf;hpb=81a6cff678ecee7cdc0658285d3150660c07cfce
>>>>>
>>>>>
>>>>>
>>>>> Regards,
>>>>> Tigran.
>>>>> --
>>>>> To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
>>>>> the body of a message to majordomo@vger.kernel.org
>>>>> More majordomo info at http://vger.kernel.org/majordomo-info.html
>>> --
>>> To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
>>> the body of a message to majordomo@vger.kernel.org
>>> More majordomo info at http://vger.kernel.org/majordomo-info.html
>
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2010-11-28 12:14 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2010-11-18 15:21 2.6.37-rc1 krash Tigran Mkrtchyan
2010-11-18 16:59 ` Benny Halevy
2010-11-19 11:27 ` Tigran Mkrtchyan
2010-11-23 9:56 ` Benny Halevy
2010-11-25 16:17 ` Tigran Mkrtchyan
2010-11-28 12:14 ` Benny Halevy
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).