issues with Linux client pNFS

All of lore.kernel.org
 help / color / mirror / Atom feed

* issues with Linux client pNFS
@ 2024-09-16 20:27 marc eshel
  2024-09-16 20:33 ` Anna Schumaker
  0 siblings, 1 reply; 3+ messages in thread
From: marc eshel @ 2024-09-16 20:27 UTC (permalink / raw)
  To: Olga Kornievskaia, schumaker anna; +Cc: linux-nfs

Hi,

Who is the current maintainer of the Linux NFS client?

I have an issue with the way pNFS client is distributing the reads among 
the DSs and I can provide the traces if anyone cares.

Thanks, Marc.

^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: issues with Linux client pNFS
  2024-09-16 20:27 issues with Linux client pNFS marc eshel
@ 2024-09-16 20:33 ` Anna Schumaker
  2024-09-16 21:51   ` marc eshel
  0 siblings, 1 reply; 3+ messages in thread
From: Anna Schumaker @ 2024-09-16 20:33 UTC (permalink / raw)
  To: marc eshel, Olga Kornievskaia, schumaker anna; +Cc: linux-nfs

Hi Marc,

On 9/16/24 4:27 PM, marc eshel wrote:
> Hi,
> 
> Who is the current maintainer of the Linux NFS client?

That would be me and Trond.

> 
> I have an issue with the way pNFS client is distributing the reads among the DSs and I can provide the traces if anyone cares.

What is the problem? And sure, send along the traces! I'll try to take a look as soon as I can.

Anna

> 
> Thanks, Marc.
> 


^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: issues with Linux client pNFS
  2024-09-16 20:33 ` Anna Schumaker
@ 2024-09-16 21:51   ` marc eshel
  0 siblings, 0 replies; 3+ messages in thread
From: marc eshel @ 2024-09-16 21:51 UTC (permalink / raw)
  To: Anna Schumaker, Olga Kornievskaia, schumaker anna; +Cc: linux-nfs

Hi Anna,

This trace on the client shows that it was requested to use *nfl_util 
0x400000*

filelayout_decode_layout: set_layout_map Begin

Sep 13 09:20:10 svl-marcrh-node-1 kernel: nfs4_print_deviceid: device 
id= [3000035a0b38c07df0465]

Sep 13 09:20:10 svl-marcrh-node-1 kernel: filelayout_decode_layout: 
*nfl_util 0x400000* num_fh 1 fsi 0 po 0

Sep 13 09:20:10 svl-marcrh-node-1 kernel: DEBUG: 
filelayout_decode_layout: fh len 61

Sep 13 09:20:10 svl-marcrh-node-1 kernel: --> filelayout_check_layout

Sep 13 09:20:10 svl-marcrh-node-1 kernel: --> filelayout_check_layout 
returns 0


This trace on the DS show that it reads 0x48000 before skipping to 0x880000
as you can see it reads 0x48000 from DS 10.11.56.194 before starting to 
read from 10.11.56.195
and I also show it on the server side that revived those reads.


Sep 13 09:20:10 svl-marcrh-node-1 kernel: 
pnfs_generic_layout_insert_lseg:Begin
Sep 13 09:20:10 svl-marcrh-node-1 kernel: 
pnfs_generic_layout_insert_lseg: inserted lseg 00000000867a0461 iomode 1 
offset 0 length 18446744073709551615 at tail
Sep 13 09:20:10 svl-marcrh-node-1 kernel: 
pnfs_generic_layout_insert_lseg:Return
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_find_alloc_layout Begin 
ino=000000003c8009bb layout=00000000f5222588
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_update_layout: inode 
0:51/88064 pNFS layout segment found for (read-only, offset: 0, length: 
18446744073709551615)
Sep 13 09:20:10 svl-marcrh-node-1 kernel: --> filelayout_read_pagelist 
ino 88064 pgbase 0 req 1048576@0
Sep 13 09:20:10 svl-marcrh-node-1 kernel: filelayout_read_pagelist USE 
DS: {10.11.56.194:2049,} cl_count 2
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_find_alloc_layout Begin 
ino=000000003c8009bb layout=00000000f5222588
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_update_layout: inode 
0:51/88064 pNFS layout segment found for (read-only, offset: 0, length: 
18446744073709551615)
Sep 13 09:20:10 svl-marcrh-node-1 kernel: --> filelayout_read_pagelist 
ino 88064 pgbase 0 req 524288@1048576
Sep 13 09:20:10 svl-marcrh-node-1 kernel: filelayout_read_pagelist USE 
DS: {10.11.56.194:2049,} cl_count 1
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_find_alloc_layout Begin 
ino=000000003c8009bb layout=00000000f5222588
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_update_layout: inode 
0:51/88064 pNFS layout segment found for (read-only, offset: 0, length: 
18446744073709551615)
Sep 13 09:20:10 svl-marcrh-node-1 kernel: --> filelayout_read_pagelist 
ino 88064 pgbase 0 req 1048576@1572864
Sep 13 09:20:10 svl-marcrh-node-1 kernel: filelayout_read_pagelist USE 
DS: {10.11.56.194:2049,} cl_count 2
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_find_alloc_layout Begin 
ino=000000003c8009bb layout=00000000f5222588
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_update_layout: inode 
0:51/88064 pNFS layout segment found for (read-only, offset: 0, length: 
18446744073709551615)
Sep 13 09:20:10 svl-marcrh-node-1 kernel: --> filelayout_read_pagelist 
ino 88064 pgbase 0 req 524288@2621440
Sep 13 09:20:10 svl-marcrh-node-1 kernel: filelayout_read_pagelist USE 
DS: {10.11.56.194:2049,} cl_count 1
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_find_alloc_layout Begin 
ino=000000003c8009bb layout=00000000f5222588
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_update_layout: inode 
0:51/88064 pNFS layout segment found for (read-only, offset: 0, length: 
18446744073709551615)
Sep 13 09:20:10 svl-marcrh-node-1 kernel: --> filelayout_read_pagelist 
ino 88064 pgbase 0 req 524288@3145728
Sep 13 09:20:10 svl-marcrh-node-1 kernel: filelayout_read_pagelist USE 
DS: {10.11.56.194:2049,} cl_count 2
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_find_alloc_layout Begin 
ino=000000003c8009bb layout=00000000f5222588
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_update_layout: inode 
0:51/88064 pNFS layout segment found for (read-only, offset: 0, length: 
18446744073709551615)
Sep 13 09:20:10 svl-marcrh-node-1 kernel: --> filelayout_read_pagelist 
ino 88064 pgbase 0 req 1048576@3670016
Sep 13 09:20:10 svl-marcrh-node-1 kernel: filelayout_read_pagelist USE 
DS: {10.11.56.194:2049,} cl_count 1
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_find_alloc_layout Begin 
ino=000000003c8009bb layout=00000000f5222588
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_update_layout: inode 
0:51/88064 pNFS layout segment found for (read-only, offset: 0, length: 
18446744073709551615)
Sep 13 09:20:10 svl-marcrh-node-1 kernel: --> filelayout_read_pagelist 
ino 88064 pgbase 0 req 524288@4718592
Sep 13 09:20:10 svl-marcrh-node-1 kernel: filelayout_read_pagelist USE 
DS: {10.11.56.195:2049,} cl_count 2
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_find_alloc_layout Begin 
ino=000000003c8009bb layout=00000000f5222588


So it is skipping *0x400000 *but why was the first chuck 0x48000

Also way some read are 1048576 and most are 524288

And this is on the server side.

gpfsRead enter: gnP 0xFFFF91F810942688 flags 0x1 uioP 0xFFFFAED0C47878B0 
vinfoP 0xFFFF91F81352FA30 off 0 len 1048576

gpfsRead enter: gnP 0xFFFF91F810942688 flags 0x1 uioP 0xFFFFAED0C47878B0 
vinfoP 0xFFFF91F81352FA30 off 1048576 len 524288

gpfsRead enter: gnP 0xFFFF91F810942688 flags 0x1 uioP 0xFFFFAED0CA01F8B0 
vinfoP 0xFFFF91F81352FA30 off 1572864 len 1048576

gpfsRead enter: gnP 0xFFFF91F810942688 flags 0x1 uioP 0xFFFFAED0CA5FB8B0 
vinfoP 0xFFFF91F81352FA30 off 2621440 len 524288

gpfsRead enter: gnP 0xFFFF91F810942688 flags 0x1 uioP 0xFFFFAED0CA01F8B0 
vinfoP 0xFFFF91F81352FA30 off 3145728 len 524288

gpfsRead enter: gnP 0xFFFF91F810942688 flags 0x1 uioP 0xFFFFAED0C47878B0 
vinfoP 0xFFFF91F81352FA30 off 3670016 len 1048576

gpfsRead enter: gnP 0xFFFF91F810942688 flags 0x1 uioP 0xFFFFAED0CA01F8B0 
vinfoP 0xFFFF91F81352FA30 off 8912896 len 524288


Thanks, Marc.


On 9/16/24 1:33 PM, Anna Schumaker wrote:
> Hi Marc,
>
> On 9/16/24 4:27 PM, marc eshel wrote:
>> Hi,
>>
>> Who is the current maintainer of the Linux NFS client?
> That would be me and Trond.
>
>> I have an issue with the way pNFS client is distributing the reads among the DSs and I can provide the traces if anyone cares.
> What is the problem? And sure, send along the traces! I'll try to take a look as soon as I can.
>
> Anna
>
>> Thanks, Marc.
>>

^ permalink raw reply	[flat|nested] 3+ messages in thread

end of thread, other threads:[~2024-09-16 21:51 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2024-09-16 20:27 issues with Linux client pNFS marc eshel
2024-09-16 20:33 ` Anna Schumaker
2024-09-16 21:51   ` marc eshel

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.