Slightly Urgent: XFS No Space Left On Device

Dave Hall
2015-03-30T18:20:06Z

[-- Attachment #1.1: Type: text/plain, Size: 2538 bytes --]

Hello,

I have an XFS file system that's getting 'No space left on device'
errors. xfs_fsr also complains of 'No space left'. The XFS Info is:

# xfs_info /data
meta-data=/dev/sdb1 isize=256 agcount=19,
agsize=268435440 blks
= sectsz=512 attr=2
data = bsize=4096 blocks=4882431488, imaxpct=5
= sunit=16 swidth=160 blks
naming =version 2 bsize=4096 ascii-ci=0
log =internal bsize=4096 blocks=521728, version=2
= sectsz=512 sunit=16 blks,
lazy-count=1
realtime =none extsz=4096 blocks=0, rtextents=0

# df -h .
Filesystem Size Used Avail Use% Mounted on
/dev/sdb1 19T 12T 7.0T 62% /data
# df -ih .
Filesystem Inodes IUsed IFree IUse% Mounted on
/dev/sdb1 3.7G 4.7M 3.7G 1% /data

xfs_db freesp shows that AG 0 seems to be full. I've included the
freesp for the first few AGs, but the rest seem pretty consistent with
AGs 1 - 4 that I've included below.

xfs_db> freesp -s -e 1000000000 -a 0
from to extents blocks pct
1 268435440 1930 3795 100.00
total free extents 1930
total free blocks 3795
average free extent size 1.96632
xfs_db> freesp -s -e 1000000000 -a 1
from to extents blocks pct
1 268435440 287006 173832255 100.00
total free extents 287006
total free blocks 173832255
average free extent size 605.675
xfs_db> freesp -s -e 1000000000 -a 2
from to extents blocks pct
1 268435440 272425 94291252 100.00
total free extents 272425
total free blocks 94291252
average free extent size 346.118
xfs_db> freesp -s -e 1000000000 -a 3
from to extents blocks pct
1 268435440 286421 110208404 100.00
total free extents 286421
total free blocks 110208404
average free extent size 384.778
xfs_db> freesp -s -e 1000000000 -a 4
from to extents blocks pct
1 268435440 277220 107118347 100.00
total free extents 277220
total free blocks 107118347
average free extent size 386.402
xfs_db>

Is there any way to figure out which files/directories are clogging up
AG 0? Any other ways to abate this issue? Any way to assure
proportional usage of AGs?

Thanks.

-Dave

[-- Attachment #1.2: Type: text/html, Size: 3907 bytes --]

[-- Attachment #2: Type: text/plain, Size: 121 bytes --]