* quota mismatch for NFS mount of XFS filesystem
@ 2011-11-08 18:31 Liam Forbes
2011-11-08 22:55 ` Dave Chinner
0 siblings, 1 reply; 4+ messages in thread
From: Liam Forbes @ 2011-11-08 18:31 UTC (permalink / raw)
To: xfs
I searched the archives, but didn't find anything about incorrect
quota information for an NFS mounted XFS filesystem. I hope somebody
might have an idea.
We have a RHEL 5.7 server mounting a 15T XFS filesystem and exporting
it to RHEL 5.6 and 5.7 clients. quota and xfs_quota on the server
show a user using ~5.8T, but quota on a client only shows ~1.8T.
Server:
nfs2:~$ cat /etc/redhat-release
Red Hat Enterprise Linux Server release 5.7 (Tikanga)
nfs2:~$ uname -a
Linux nfs2 2.6.18-274.3.1.el5 #1 SMP Fri Aug 26 18:49:02 EDT 2011 x86_64 x86_64
nfs2:~$ rpm -qa | grep xfsprogs
xfsprogs-2.9.4-1.el5.centos
nfs2:~$ sudo quota -s -v -u krieger
Disk quotas for user krieger (uid 3105):
Filesystem blocks quota limit grace files quota limit grace
/dev/mapper/primaryfs_vg-primaryfs
5901G 0 0 310k 0 0
nfs2:~$ sudo /usr/sbin/xfs_quota
xfs_quota> quota -u -h krieger
Disk quotas for User krieger (3105)
Filesystem Blocks Quota Limit Warn/Time Mounted on
/dev/primaryfs_vg/primaryfs
5.8T 0 0 00 [------] /export/wrkdir20
xfs_quota> quit
Client:
pacman1:~$ cat /etc/redhat-release
Red Hat Enterprise Linux Server release 5.6 (Tikanga)
pacman1:~$ uname -a
Linux pacman1 2.6.18-238.19.1.563g0000.el5 #1 SMP Fri Jul 15 20:26:36
EDT 2011 x86_64 x86_64 x86_64 GNU/Linux
pacman1:~$ sudo quota -s -v -u krieger
Disk quotas for user krieger (uid 3105):
Filesystem blocks quota limit grace files quota limit grace
nfs2:/export/wrkdir20
1806G 0 0 310k 0 0
Could there be a miscalculation due to differing block sizes? Other
suggestions of what to look at? I'm not seeing any errors in logs
(which doesn't surprise me).
--
Regards,
-liam
-There are uncountably more irrational fears than rational ones. -P. Dolan
Liam Forbes HPC Systems Analyst, HPC&S Group Leader, CISSP
ARSC, U of AK, Fairbanks lforbes@arsc.edu 907-450-8618 fax: 907-450-8605
_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs
^ permalink raw reply [flat|nested] 4+ messages in thread* Re: quota mismatch for NFS mount of XFS filesystem
2011-11-08 18:31 quota mismatch for NFS mount of XFS filesystem Liam Forbes
@ 2011-11-08 22:55 ` Dave Chinner
2011-11-08 23:49 ` Liam Forbes
2011-11-09 9:52 ` Burbidge, Simon A
0 siblings, 2 replies; 4+ messages in thread
From: Dave Chinner @ 2011-11-08 22:55 UTC (permalink / raw)
To: Liam Forbes; +Cc: xfs
On Tue, Nov 08, 2011 at 09:31:05AM -0900, Liam Forbes wrote:
> I searched the archives, but didn't find anything about incorrect
> quota information for an NFS mounted XFS filesystem. I hope somebody
> might have an idea.
>
> We have a RHEL 5.7 server mounting a 15T XFS filesystem and exporting
> it to RHEL 5.6 and 5.7 clients. quota and xfs_quota on the server
> show a user using ~5.8T, but quota on a client only shows ~1.8T.
>
> Server:
> nfs2:~$ cat /etc/redhat-release
> Red Hat Enterprise Linux Server release 5.7 (Tikanga)
> nfs2:~$ uname -a
> Linux nfs2 2.6.18-274.3.1.el5 #1 SMP Fri Aug 26 18:49:02 EDT 2011 x86_64 x86_64
> nfs2:~$ rpm -qa | grep xfsprogs
> xfsprogs-2.9.4-1.el5.centos
> nfs2:~$ sudo quota -s -v -u krieger
> Disk quotas for user krieger (uid 3105):
> Filesystem blocks quota limit grace files quota limit grace
> /dev/mapper/primaryfs_vg-primaryfs
> 5901G 0 0 310k 0 0
> nfs2:~$ sudo /usr/sbin/xfs_quota
> xfs_quota> quota -u -h krieger
> Disk quotas for User krieger (3105)
> Filesystem Blocks Quota Limit Warn/Time Mounted on
> /dev/primaryfs_vg/primaryfs
> 5.8T 0 0 00 [------] /export/wrkdir20
> xfs_quota> quit
>
> Client:
> pacman1:~$ cat /etc/redhat-release
> Red Hat Enterprise Linux Server release 5.6 (Tikanga)
> pacman1:~$ uname -a
> Linux pacman1 2.6.18-238.19.1.563g0000.el5 #1 SMP Fri Jul 15 20:26:36
> EDT 2011 x86_64 x86_64 x86_64 GNU/Linux
> pacman1:~$ sudo quota -s -v -u krieger
> Disk quotas for user krieger (uid 3105):
> Filesystem blocks quota limit grace files quota limit grace
> nfs2:/export/wrkdir20
> 1806G 0 0 310k 0 0
That looks like a 32bit variable overflow. In 512 byte blocks
(sectors), 2^32 sectors overflows at 2T. And 5.8T ~= 2T + 2T + 1.8T.
This is most likely to be an NFS issue - I'm not familiar with the
Linux NFS quota protocol implementation, so I can't really say much
more than that.
Cheers,
Dave.
--
Dave Chinner
david@fromorbit.com
_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: quota mismatch for NFS mount of XFS filesystem
2011-11-08 22:55 ` Dave Chinner
@ 2011-11-08 23:49 ` Liam Forbes
2011-11-09 9:52 ` Burbidge, Simon A
1 sibling, 0 replies; 4+ messages in thread
From: Liam Forbes @ 2011-11-08 23:49 UTC (permalink / raw)
To: Dave Chinner; +Cc: xfs
On Tue, Nov 8, 2011 at 1:55 PM, Dave Chinner <david@fromorbit.com> wrote:
>
> That looks like a 32bit variable overflow. In 512 byte blocks
> (sectors), 2^32 sectors overflows at 2T. And 5.8T ~= 2T + 2T + 1.8T.
>
> This is most likely to be an NFS issue - I'm not familiar with the
> Linux NFS quota protocol implementation, so I can't really say much
> more than that.
Additional ad hoc testing seems to bear this out. Thanks! I'll take
the problem to Red Hat.
--
Regards,
-liam
-There are uncountably more irrational fears than rational ones. -P. Dolan
Liam Forbes HPC Systems Analyst, HPC&S Group Leader, CISSP
ARSC, U of AK, Fairbanks lforbes@arsc.edu 907-450-8618 fax: 907-450-8605
_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs
^ permalink raw reply [flat|nested] 4+ messages in thread
* RE: quota mismatch for NFS mount of XFS filesystem
2011-11-08 22:55 ` Dave Chinner
2011-11-08 23:49 ` Liam Forbes
@ 2011-11-09 9:52 ` Burbidge, Simon A
1 sibling, 0 replies; 4+ messages in thread
From: Burbidge, Simon A @ 2011-11-09 9:52 UTC (permalink / raw)
To: Dave Chinner, Liam Forbes; +Cc: xfs@oss.sgi.com
Hi Liam,
I believe we've encountered this exact same problem.
There is a 32 bit size field in the protocol used by rpcquota . What you are seeing is overflow of that field.
I figure that this should be classed as a classic "not 64-bit ready" bug - but the support people from the Linux distros seem to believe
that it is working according to specification.
I'm not even sure that NFS v4 addresses the issue!
Best Regards
Simon Burbidge
Imperial College London
________________________________________
From: xfs-bounces@oss.sgi.com [xfs-bounces@oss.sgi.com] on behalf of Dave Chinner [david@fromorbit.com]
Sent: 08 November 2011 22:55
To: Liam Forbes
Cc: xfs@oss.sgi.com
Subject: Re: quota mismatch for NFS mount of XFS filesystem
On Tue, Nov 08, 2011 at 09:31:05AM -0900, Liam Forbes wrote:
> I searched the archives, but didn't find anything about incorrect
> quota information for an NFS mounted XFS filesystem. I hope somebody
> might have an idea.
>
> We have a RHEL 5.7 server mounting a 15T XFS filesystem and exporting
> it to RHEL 5.6 and 5.7 clients. quota and xfs_quota on the server
> show a user using ~5.8T, but quota on a client only shows ~1.8T.
>
> Server:
> nfs2:~$ cat /etc/redhat-release
> Red Hat Enterprise Linux Server release 5.7 (Tikanga)
> nfs2:~$ uname -a
> Linux nfs2 2.6.18-274.3.1.el5 #1 SMP Fri Aug 26 18:49:02 EDT 2011 x86_64 x86_64
> nfs2:~$ rpm -qa | grep xfsprogs
> xfsprogs-2.9.4-1.el5.centos
> nfs2:~$ sudo quota -s -v -u krieger
> Disk quotas for user krieger (uid 3105):
> Filesystem blocks quota limit grace files quota limit grace
> /dev/mapper/primaryfs_vg-primaryfs
> 5901G 0 0 310k 0 0
> nfs2:~$ sudo /usr/sbin/xfs_quota
> xfs_quota> quota -u -h krieger
> Disk quotas for User krieger (3105)
> Filesystem Blocks Quota Limit Warn/Time Mounted on
> /dev/primaryfs_vg/primaryfs
> 5.8T 0 0 00 [------] /export/wrkdir20
> xfs_quota> quit
>
> Client:
> pacman1:~$ cat /etc/redhat-release
> Red Hat Enterprise Linux Server release 5.6 (Tikanga)
> pacman1:~$ uname -a
> Linux pacman1 2.6.18-238.19.1.563g0000.el5 #1 SMP Fri Jul 15 20:26:36
> EDT 2011 x86_64 x86_64 x86_64 GNU/Linux
> pacman1:~$ sudo quota -s -v -u krieger
> Disk quotas for user krieger (uid 3105):
> Filesystem blocks quota limit grace files quota limit grace
> nfs2:/export/wrkdir20
> 1806G 0 0 310k 0 0
That looks like a 32bit variable overflow. In 512 byte blocks
(sectors), 2^32 sectors overflows at 2T. And 5.8T ~= 2T + 2T + 1.8T.
This is most likely to be an NFS issue - I'm not familiar with the
Linux NFS quota protocol implementation, so I can't really say much
more than that.
Cheers,
Dave.
--
Dave Chinner
david@fromorbit.com
_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs
_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs
^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2011-11-09 9:53 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2011-11-08 18:31 quota mismatch for NFS mount of XFS filesystem Liam Forbes
2011-11-08 22:55 ` Dave Chinner
2011-11-08 23:49 ` Liam Forbes
2011-11-09 9:52 ` Burbidge, Simon A
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox