* Switching from group to project quota's @ 2016-12-19 1:03 ncoulson-ml 2016-12-19 14:07 ` Eric Sandeen 0 siblings, 1 reply; 6+ messages in thread From: ncoulson-ml @ 2016-12-19 1:03 UTC (permalink / raw) To: linux-xfs We are currently using user and group quota's on multiple xfs filesystem. When trying to switch to Project Quota's, it attempts to perform a quotacheck. Tested on a lvm snapshot of a live volume, it was still not mounted after about a week (and couldn't find a way to cancel the attempted mount. dmesg did mention quotacheck, but I can't say it was doing the quotacheck for the full week). Is there a way to convert from Group Quota's to Project Quota's while avoiding the quotacheck? (There are currently no project quota's defined). Outside of that, I was curious what scenario's would cause quotacalc to recalculate. Thank You 1TB Volumes, Reviewing one of them, we are using 67G of 934GB (they vary from 400GB free to 50GB Free). Inode usage seems to range from 5000000 to 8000000. Using the 2.6.32 kernel from Centos 6.8, but was doing my tests with a snapshot of the volume on a centos 7.2 host (kernel 3.10) I thought I may be able to work around this by removing the group quota information, but xfs_quota -x, remove -g with and without group quota's on failed to work. Everytime I received XFS_QUOTARM: Invalid argument User quota state on /test (/dev/sda) Accounting: ON Enforcement: OFF Inode: #131 (1663 blocks, 1639 extents) Group quota state on /test (/dev/sda) Accounting: ON Enforcement: OFF Inode: #132 (1664 blocks, 1648 extents) Project quota state on /test (/dev/sda) Accounting: OFF Enforcement: OFF Inode: #132 (1664 blocks, 1648 extents) Blocks grace time: [7 days 00:00:30] Inodes grace time: [7 days 00:00:30] Realtime Blocks grace time: [7 days 00:00:30] Nathan Coulson. ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Switching from group to project quota's 2016-12-19 1:03 Switching from group to project quota's ncoulson-ml @ 2016-12-19 14:07 ` Eric Sandeen 2016-12-19 19:23 ` Nathan Coulson 0 siblings, 1 reply; 6+ messages in thread From: Eric Sandeen @ 2016-12-19 14:07 UTC (permalink / raw) To: ncoulson-ml, linux-xfs On 12/18/16 7:03 PM, ncoulson-ml@ncoulson.com wrote: > We are currently using user and group quota's on multiple xfs > filesystem. When trying to switch to Project Quota's, it attempts to > perform a quotacheck. I assume that you mean you switched mount -o uquota,gquota for mount -o uquota,pquota or something like that? > Tested on a lvm snapshot of a live volume, it was still not mounted > after about a week (and couldn't find a way to cancel the attempted > mount. dmesg did mention quotacheck, but I can't say it was doing > the quotacheck for the full week). > > Is there a way to convert from Group Quota's to Project Quota's while > avoiding the quotacheck? (There are currently no project quota's > defined). Outside of that, I was curious what scenario's would cause > quotacalc to recalculate. If any quota is on at mount time, and the "checked" flag is not present in the on-disk superblock, then quotacheck gets run. In general, we do accounting even if we don't do enforcement; i.e. having no quotas defined does not man that quota activity isn't happening - it is, because accounting happens regardless. > Thank You > > > > 1TB Volumes, Reviewing one of them, we are using 67G of 934GB (they > vary from 400GB free to 50GB Free). > > Inode usage seems to range from 5000000 to 8000000. > > Using the 2.6.32 kernel from Centos 6.8, but was doing my tests with > a snapshot of the volume on a centos 7.2 host (kernel 3.10) > I thought I may be able to work around this by removing the group > quota information, but xfs_quota -x, remove -g with and without > group quota's on failed to work. Everytime I received XFS_QUOTARM: > Invalid argument This was likely fixed upstream in 3.16 commit 9da93f9b7cdf8ab28da6b364cdc1fafc8670b4dc Author: Eric Sandeen <sandeen@sandeen.net> Date: Mon May 5 17:25:50 2014 +1000 xfs: fix Q_XQUOTARM ioctl and should be fixed in sufficiently up to date centos7 as well. but removing quota inodes won't obviate the need for a quotacheck, I'm afraid. -Eric > > User quota state on /test (/dev/sda) Accounting: ON Enforcement: OFF > Inode: #131 (1663 blocks, 1639 extents) Group quota state on /test > (/dev/sda) Accounting: ON Enforcement: OFF Inode: #132 (1664 blocks, > 1648 extents) Project quota state on /test (/dev/sda) Accounting: > OFF Enforcement: OFF Inode: #132 (1664 blocks, 1648 extents) Blocks > grace time: [7 days 00:00:30] Inodes grace time: [7 days 00:00:30] > Realtime Blocks grace time: [7 days 00:00:30] > > > Nathan Coulson. -- To unsubscribe from this list: send the line > "unsubscribe linux-xfs" in the body of a message to > majordomo@vger.kernel.org More majordomo info at > http://vger.kernel.org/majordomo-info.html > ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Switching from group to project quota's 2016-12-19 14:07 ` Eric Sandeen @ 2016-12-19 19:23 ` Nathan Coulson 2016-12-19 21:26 ` Dave Chinner 0 siblings, 1 reply; 6+ messages in thread From: Nathan Coulson @ 2016-12-19 19:23 UTC (permalink / raw) To: Eric Sandeen, linux-xfs On 2016-12-19 06:07 AM, Eric Sandeen wrote: > On 12/18/16 7:03 PM, ncoulson-ml@ncoulson.com wrote: >> We are currently using user and group quota's on multiple xfs >> filesystem. When trying to switch to Project Quota's, it attempts to >> perform a quotacheck. > I assume that you mean you switched mount -o uquota,gquota for > mount -o uquota,pquota or something like that? We are, (that or alternatively in testing were using xfs_quota -x, off -g). >> Tested on a lvm snapshot of a live volume, it was still not mounted >> after about a week (and couldn't find a way to cancel the attempted >> mount. dmesg did mention quotacheck, but I can't say it was doing >> the quotacheck for the full week). >> >> Is there a way to convert from Group Quota's to Project Quota's while >> avoiding the quotacheck? (There are currently no project quota's >> defined). Outside of that, I was curious what scenario's would cause >> quotacalc to recalculate. > If any quota is on at mount time, and the "checked" flag is not present > in the on-disk superblock, then quotacheck gets run. > > In general, we do accounting even if we don't do enforcement; i.e. > having no quotas defined does not man that quota activity isn't > happening - it is, because accounting happens regardless. > >> Thank You >> >> >> >> 1TB Volumes, Reviewing one of them, we are using 67G of 934GB (they >> vary from 400GB free to 50GB Free). >> >> Inode usage seems to range from 5000000 to 8000000. >> >> Using the 2.6.32 kernel from Centos 6.8, but was doing my tests with >> a snapshot of the volume on a centos 7.2 host (kernel 3.10) > > >> I thought I may be able to work around this by removing the group >> quota information, but xfs_quota -x, remove -g with and without >> group quota's on failed to work. Everytime I received XFS_QUOTARM: >> Invalid argument > This was likely fixed upstream in 3.16 > > commit 9da93f9b7cdf8ab28da6b364cdc1fafc8670b4dc > Author: Eric Sandeen <sandeen@sandeen.net> > Date: Mon May 5 17:25:50 2014 +1000 > > xfs: fix Q_XQUOTARM ioctl > > and should be fixed in sufficiently up to date centos7 as well. > > but removing quota inodes won't obviate the need for a quotacheck, > I'm afraid. > > -Eric With the long quotacheck time (+1wk, I think one test I left running for a few weeks) with our filesystem (not sure if that is due to the number of files we have, or if something else is at play), I was hoping to find an alternative. Best idea I have so far is to rsync to a 2nd volume with project quota's enabled (a few days per server most likely), and some symlink magic to keep things appearing in the same location. In testing, it looks like disabling group quota support will not cause a QuotaCheck. In the case of mounting a filesystem with pquotas, that previously used gquotas does certainly seem to trigger it. What I was hoping (falsely), was mounting a volume with pquotas where there is no group quota information would not need a quotacheck (or at least not one that goes on as long as our tests have since there would be no projects setup yet). I noticed it says in dmesg when it does a quotacheck, and the following certainly points to it being triggered. root@test [/mnt]# mount /dev/sys.vg/test.lv z -o uqnoenforce XFS (dm-8): Mounting Filesystem XFS (dm-8): Ending clean mount root@test [/mnt]# mount /dev/sys.vg/test.lv z -o uqnoenforce,pquota XFS (dm-8): Mounting Filesystem XFS (dm-8): Ending clean mount XFS (dm-8): Quotacheck needed: Please wait. XFS (dm-8): Quotacheck: Done. But thank you Eric for your time. Nathan Coulson > >> User quota state on /test (/dev/sda) Accounting: ON Enforcement: OFF >> Inode: #131 (1663 blocks, 1639 extents) Group quota state on /test >> (/dev/sda) Accounting: ON Enforcement: OFF Inode: #132 (1664 blocks, >> 1648 extents) Project quota state on /test (/dev/sda) Accounting: >> OFF Enforcement: OFF Inode: #132 (1664 blocks, 1648 extents) Blocks >> grace time: [7 days 00:00:30] Inodes grace time: [7 days 00:00:30] >> Realtime Blocks grace time: [7 days 00:00:30] >> >> >> Nathan Coulson. -- To unsubscribe from this list: send the line >> "unsubscribe linux-xfs" in the body of a message to >> majordomo@vger.kernel.org More majordomo info at >> http://vger.kernel.org/majordomo-info.html >> ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Switching from group to project quota's 2016-12-19 19:23 ` Nathan Coulson @ 2016-12-19 21:26 ` Dave Chinner 2016-12-19 23:52 ` Nathan Coulson 0 siblings, 1 reply; 6+ messages in thread From: Dave Chinner @ 2016-12-19 21:26 UTC (permalink / raw) To: Nathan Coulson; +Cc: Eric Sandeen, linux-xfs On Mon, Dec 19, 2016 at 11:23:19AM -0800, Nathan Coulson wrote: > With the long quotacheck time (+1wk, I think one test I left > running for a few weeks) with our filesystem (not sure if that is > due to the number of files we have, or if something else is at > play), I was hoping to find an alternative. It's hung. output of sysrq-w please. Cheers, Dave. -- Dave Chinner david@fromorbit.com ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Switching from group to project quota's 2016-12-19 21:26 ` Dave Chinner @ 2016-12-19 23:52 ` Nathan Coulson 2016-12-23 22:02 ` Nathan Coulson 0 siblings, 1 reply; 6+ messages in thread From: Nathan Coulson @ 2016-12-19 23:52 UTC (permalink / raw) To: Dave Chinner; +Cc: Eric Sandeen, linux-xfs On 2016-12-19 01:26 PM, Dave Chinner wrote: > On Mon, Dec 19, 2016 at 11:23:19AM -0800, Nathan Coulson wrote: >> With the long quotacheck time (+1wk, I think one test I left >> running for a few weeks) with our filesystem (not sure if that is >> due to the number of files we have, or if something else is at >> play), I was hoping to find an alternative. > It's hung. output of sysrq-w please. > > Cheers, > > Dave. I will need to setup the test again, (machine has since been rebooted). I should be able to get resetup again tomorrow. ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Switching from group to project quota's 2016-12-19 23:52 ` Nathan Coulson @ 2016-12-23 22:02 ` Nathan Coulson 0 siblings, 0 replies; 6+ messages in thread From: Nathan Coulson @ 2016-12-23 22:02 UTC (permalink / raw) To: linux-xfs On 2016-12-19 03:52 PM, Nathan Coulson wrote: > On 2016-12-19 01:26 PM, Dave Chinner wrote: >> On Mon, Dec 19, 2016 at 11:23:19AM -0800, Nathan Coulson wrote: >>> With the long quotacheck time (+1wk, I think one test I left >>> running for a few weeks) with our filesystem (not sure if that is >>> due to the number of files we have, or if something else is at >>> play), I was hoping to find an alternative. >> It's hung. output of sysrq-w please. >> >> Cheers, >> >> Dave. > > I will need to setup the test again, (machine has since been > rebooted). I should be able to get resetup again tomorrow. Got it resetup. Ran as time mount /dev/medusa.32.vg/customers.lv z -o nosuid,nodev,noexec,uqnoenforce,pquota,logbufs=8,logbsize=256k,rw. (Snapshot made on a equallogic unit, copy on write based iscsi) (state ran off our live vm, but probably similar to the snapshot I wrote). xfs_quota> state User quota state on /medusa (/dev/sda) Accounting: ON Enforcement: OFF Inode: #131 (1663 blocks, 1639 extents) Group quota state on /medusa (/dev/sda) Accounting: ON Enforcement: OFF Inode: #132 (1664 blocks, 1648 extents) Project quota state on /medusa (/dev/sda) Accounting: OFF Enforcement: OFF Inode: #132 (1664 blocks, 1648 extents) Blocks grace time: [7 days 00:00:30] Inodes grace time: [7 days 00:00:30] Realtime Blocks grace time: [7 days 00:00:30] root@medusa32 [/root]# df -i Filesystem Inodes IUsed IFree IUse% Mounted on /dev/sda 279209456 7732832 271476624 3% /medusa root@medusa32 [/root]# df -h Filesystem Size Used Avail Use% Mounted on /dev/sda 1000G 936G 65G 94% /medusa Mount started on Dec 21 at 4:29 PM PST, and this email was posted as of Dec 23, 1:47pm PST. The mount is still in progress. Nathan Coulson Bravenet Web Services ^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2016-12-23 22:02 UTC | newest] Thread overview: 6+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2016-12-19 1:03 Switching from group to project quota's ncoulson-ml 2016-12-19 14:07 ` Eric Sandeen 2016-12-19 19:23 ` Nathan Coulson 2016-12-19 21:26 ` Dave Chinner 2016-12-19 23:52 ` Nathan Coulson 2016-12-23 22:02 ` Nathan Coulson
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).