* issues with Linux client pNFS
@ 2024-09-16 20:27 marc eshel
2024-09-16 20:33 ` Anna Schumaker
0 siblings, 1 reply; 3+ messages in thread
From: marc eshel @ 2024-09-16 20:27 UTC (permalink / raw)
To: Olga Kornievskaia, schumaker anna; +Cc: linux-nfs
Hi,
Who is the current maintainer of the Linux NFS client?
I have an issue with the way pNFS client is distributing the reads among
the DSs and I can provide the traces if anyone cares.
Thanks, Marc.
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: issues with Linux client pNFS
2024-09-16 20:27 issues with Linux client pNFS marc eshel
@ 2024-09-16 20:33 ` Anna Schumaker
2024-09-16 21:51 ` marc eshel
0 siblings, 1 reply; 3+ messages in thread
From: Anna Schumaker @ 2024-09-16 20:33 UTC (permalink / raw)
To: marc eshel, Olga Kornievskaia, schumaker anna; +Cc: linux-nfs
Hi Marc,
On 9/16/24 4:27 PM, marc eshel wrote:
> Hi,
>
> Who is the current maintainer of the Linux NFS client?
That would be me and Trond.
>
> I have an issue with the way pNFS client is distributing the reads among the DSs and I can provide the traces if anyone cares.
What is the problem? And sure, send along the traces! I'll try to take a look as soon as I can.
Anna
>
> Thanks, Marc.
>
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: issues with Linux client pNFS
2024-09-16 20:33 ` Anna Schumaker
@ 2024-09-16 21:51 ` marc eshel
0 siblings, 0 replies; 3+ messages in thread
From: marc eshel @ 2024-09-16 21:51 UTC (permalink / raw)
To: Anna Schumaker, Olga Kornievskaia, schumaker anna; +Cc: linux-nfs
Hi Anna,
This trace on the client shows that it was requested to use *nfl_util
0x400000*
filelayout_decode_layout: set_layout_map Begin
Sep 13 09:20:10 svl-marcrh-node-1 kernel: nfs4_print_deviceid: device
id= [3000035a0b38c07df0465]
Sep 13 09:20:10 svl-marcrh-node-1 kernel: filelayout_decode_layout:
*nfl_util 0x400000* num_fh 1 fsi 0 po 0
Sep 13 09:20:10 svl-marcrh-node-1 kernel: DEBUG:
filelayout_decode_layout: fh len 61
Sep 13 09:20:10 svl-marcrh-node-1 kernel: --> filelayout_check_layout
Sep 13 09:20:10 svl-marcrh-node-1 kernel: --> filelayout_check_layout
returns 0
This trace on the DS show that it reads 0x48000 before skipping to 0x880000
as you can see it reads 0x48000 from DS 10.11.56.194 before starting to
read from 10.11.56.195
and I also show it on the server side that revived those reads.
Sep 13 09:20:10 svl-marcrh-node-1 kernel:
pnfs_generic_layout_insert_lseg:Begin
Sep 13 09:20:10 svl-marcrh-node-1 kernel:
pnfs_generic_layout_insert_lseg: inserted lseg 00000000867a0461 iomode 1
offset 0 length 18446744073709551615 at tail
Sep 13 09:20:10 svl-marcrh-node-1 kernel:
pnfs_generic_layout_insert_lseg:Return
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_find_alloc_layout Begin
ino=000000003c8009bb layout=00000000f5222588
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_update_layout: inode
0:51/88064 pNFS layout segment found for (read-only, offset: 0, length:
18446744073709551615)
Sep 13 09:20:10 svl-marcrh-node-1 kernel: --> filelayout_read_pagelist
ino 88064 pgbase 0 req 1048576@0
Sep 13 09:20:10 svl-marcrh-node-1 kernel: filelayout_read_pagelist USE
DS: {10.11.56.194:2049,} cl_count 2
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_find_alloc_layout Begin
ino=000000003c8009bb layout=00000000f5222588
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_update_layout: inode
0:51/88064 pNFS layout segment found for (read-only, offset: 0, length:
18446744073709551615)
Sep 13 09:20:10 svl-marcrh-node-1 kernel: --> filelayout_read_pagelist
ino 88064 pgbase 0 req 524288@1048576
Sep 13 09:20:10 svl-marcrh-node-1 kernel: filelayout_read_pagelist USE
DS: {10.11.56.194:2049,} cl_count 1
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_find_alloc_layout Begin
ino=000000003c8009bb layout=00000000f5222588
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_update_layout: inode
0:51/88064 pNFS layout segment found for (read-only, offset: 0, length:
18446744073709551615)
Sep 13 09:20:10 svl-marcrh-node-1 kernel: --> filelayout_read_pagelist
ino 88064 pgbase 0 req 1048576@1572864
Sep 13 09:20:10 svl-marcrh-node-1 kernel: filelayout_read_pagelist USE
DS: {10.11.56.194:2049,} cl_count 2
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_find_alloc_layout Begin
ino=000000003c8009bb layout=00000000f5222588
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_update_layout: inode
0:51/88064 pNFS layout segment found for (read-only, offset: 0, length:
18446744073709551615)
Sep 13 09:20:10 svl-marcrh-node-1 kernel: --> filelayout_read_pagelist
ino 88064 pgbase 0 req 524288@2621440
Sep 13 09:20:10 svl-marcrh-node-1 kernel: filelayout_read_pagelist USE
DS: {10.11.56.194:2049,} cl_count 1
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_find_alloc_layout Begin
ino=000000003c8009bb layout=00000000f5222588
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_update_layout: inode
0:51/88064 pNFS layout segment found for (read-only, offset: 0, length:
18446744073709551615)
Sep 13 09:20:10 svl-marcrh-node-1 kernel: --> filelayout_read_pagelist
ino 88064 pgbase 0 req 524288@3145728
Sep 13 09:20:10 svl-marcrh-node-1 kernel: filelayout_read_pagelist USE
DS: {10.11.56.194:2049,} cl_count 2
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_find_alloc_layout Begin
ino=000000003c8009bb layout=00000000f5222588
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_update_layout: inode
0:51/88064 pNFS layout segment found for (read-only, offset: 0, length:
18446744073709551615)
Sep 13 09:20:10 svl-marcrh-node-1 kernel: --> filelayout_read_pagelist
ino 88064 pgbase 0 req 1048576@3670016
Sep 13 09:20:10 svl-marcrh-node-1 kernel: filelayout_read_pagelist USE
DS: {10.11.56.194:2049,} cl_count 1
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_find_alloc_layout Begin
ino=000000003c8009bb layout=00000000f5222588
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_update_layout: inode
0:51/88064 pNFS layout segment found for (read-only, offset: 0, length:
18446744073709551615)
Sep 13 09:20:10 svl-marcrh-node-1 kernel: --> filelayout_read_pagelist
ino 88064 pgbase 0 req 524288@4718592
Sep 13 09:20:10 svl-marcrh-node-1 kernel: filelayout_read_pagelist USE
DS: {10.11.56.195:2049,} cl_count 2
Sep 13 09:20:10 svl-marcrh-node-1 kernel: pnfs_find_alloc_layout Begin
ino=000000003c8009bb layout=00000000f5222588
So it is skipping *0x400000 *but why was the first chuck 0x48000
Also way some read are 1048576 and most are 524288
And this is on the server side.
gpfsRead enter: gnP 0xFFFF91F810942688 flags 0x1 uioP 0xFFFFAED0C47878B0
vinfoP 0xFFFF91F81352FA30 off 0 len 1048576
gpfsRead enter: gnP 0xFFFF91F810942688 flags 0x1 uioP 0xFFFFAED0C47878B0
vinfoP 0xFFFF91F81352FA30 off 1048576 len 524288
gpfsRead enter: gnP 0xFFFF91F810942688 flags 0x1 uioP 0xFFFFAED0CA01F8B0
vinfoP 0xFFFF91F81352FA30 off 1572864 len 1048576
gpfsRead enter: gnP 0xFFFF91F810942688 flags 0x1 uioP 0xFFFFAED0CA5FB8B0
vinfoP 0xFFFF91F81352FA30 off 2621440 len 524288
gpfsRead enter: gnP 0xFFFF91F810942688 flags 0x1 uioP 0xFFFFAED0CA01F8B0
vinfoP 0xFFFF91F81352FA30 off 3145728 len 524288
gpfsRead enter: gnP 0xFFFF91F810942688 flags 0x1 uioP 0xFFFFAED0C47878B0
vinfoP 0xFFFF91F81352FA30 off 3670016 len 1048576
gpfsRead enter: gnP 0xFFFF91F810942688 flags 0x1 uioP 0xFFFFAED0CA01F8B0
vinfoP 0xFFFF91F81352FA30 off 8912896 len 524288
Thanks, Marc.
On 9/16/24 1:33 PM, Anna Schumaker wrote:
> Hi Marc,
>
> On 9/16/24 4:27 PM, marc eshel wrote:
>> Hi,
>>
>> Who is the current maintainer of the Linux NFS client?
> That would be me and Trond.
>
>> I have an issue with the way pNFS client is distributing the reads among the DSs and I can provide the traces if anyone cares.
> What is the problem? And sure, send along the traces! I'll try to take a look as soon as I can.
>
> Anna
>
>> Thanks, Marc.
>>
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2024-09-16 21:51 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2024-09-16 20:27 issues with Linux client pNFS marc eshel
2024-09-16 20:33 ` Anna Schumaker
2024-09-16 21:51 ` marc eshel
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.