xfsdump -- not enough memory to dump attributes? w/>20G free -- how much does it need?

xfsdump -- not enough memory to dump attributes? w/>20G free -- how much does it need?

[Linda A. Walsh]

I've seen the problem in the dump below and was wondering what could 
possibly cause this -- because
shows loads of free memory (>20G)...  how much memory do non-root 
attributes take to dump?


 
Dump fsname home, Mountpoint /home, Dumplevel=0
Notice: "-e" used in Xfsdump_options to allow exclusions
xfsdump -b 1m -l 0 -L home -e - /home | ( su -f -m backup -c " umask 
027;nice -19 ionice -c3 lzop > home/home-100522-0-0349.dump.lzo  " )
xfsdump: using file dump (drive_simple) strategy
xfsdump: version 3.0.1 (dump format 3.0) - Running single-threaded
xfsdump: level 0 dump of Ishtar:/home
xfsdump: dump date: Sat May 22 03:49:45 2010
xfsdump: session id: 5132d03a-d58f-4899-8a3c-a2dc86efe915
xfsdump: session label: "home"
xfsdump: ino map phase 1: constructing initial dump list
xfsdump: ino map phase 2: skipping (no pruning necessary)
xfsdump: ino map phase 3: skipping (only one dump stream)
xfsdump: ino map construction complete
xfsdump: estimated dump size: 537916877696 bytes
xfsdump: creating dump session media file 0 (media 0, file 0)
xfsdump: dumping ino map
xfsdump: dumping directories
xfsdump: dumping non-directory files
xfsdump: WARNING: could not get list of non-root attributes for nondir 
ino 75466: Cannot allocate memory (12)
xfsdump: WARNING: could not get list of non-root attributes for nondir 
ino 75468: Cannot allocate memory (12)
xfsdump: WARNING: could not get list of root attributes for nondir ino 
75468: Cannot allocate memory (12)
xfsdump: WARNING: could not get list of non-root attributes for nondir 
ino 75470: Cannot allocate memory (12)
xfsdump: WARNING: could not get list of root attributes for nondir ino 
75470: Cannot allocate memory (12)
xfsdump: WARNING: could not get list of non-root attributes for nondir 
ino 75497: Cannot allocate memory (12)

kernel = 2.6.34-Vanilla
xfsdump from package numberd 3.0.1-2.1
(x86_64)


_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

Re: xfsdump -- not enough memory to dump attributes? w/>20G free -- how much does it need?

[Christoph Hellwig]

On Sat, May 22, 2010 at 06:09:27AM -0700, Linda A. Walsh wrote:
> I've seen the problem in the dump below and was wondering what could  
> possibly cause this -- because
> shows loads of free memory (>20G)...  how much memory do non-root  
> attributes take to dump?

The error comes directly from the libhandle listing routine, which
is a straight forward wrapper around the kernel syscall in current
xfsprogs.

What xfsprogs version are you using?  I noticed your xfsdump is
rather old, so making sure you have recent XFS userspace and
possibly also the kernel would help debugging this.

Also can you check using strace if the ENOMEM comes directly from
the attr_list_by_handle ioctl?

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

Re: xfsdump -- not enough memory to dump attributes? w/>20G free -- how much does it need?

[Stewart Smith]

On Tue, 25 May 2010 12:42:44 -0400, Christoph Hellwig <hch@infradead.org> wrote:
> On Sat, May 22, 2010 at 06:09:27AM -0700, Linda A. Walsh wrote:
> > I've seen the problem in the dump below and was wondering what could  
> > possibly cause this -- because
> > shows loads of free memory (>20G)...  how much memory do non-root  
> > attributes take to dump?
> 
> The error comes directly from the libhandle listing routine, which
> is a straight forward wrapper around the kernel syscall in current
> xfsprogs.
> 
> What xfsprogs version are you using?  I noticed your xfsdump is
> rather old, so making sure you have recent XFS userspace and
> possibly also the kernel would help debugging this.

I just saw this last night. All from ubuntu lucid:
xfsdump 3.0.4
Linux willster 2.6.32-22-generic #33-Ubuntu SMP Wed Apr 28 13:28:05 UTC 2010 x86_64 GNU/Linux

> Also can you check using strace if the ENOMEM comes directly from
> the attr_list_by_handle ioctl?

Will try another dump tonight with strace on and see if i get it.

-- 
Stewart Smith

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

Re: xfsdump -- not enough memory to dump attributes? w/>20G free -- how much does it need?

[Linda A. Walsh]

 

Christoph Hellwig wrote:
> The error comes directly from the libhandle listing routine, which
> is a straight forward wrapper around the kernel syscall in current
> xfsprogs.
> 
> What xfsprogs version are you using?  I noticed your xfsdump is
> rather old, so making sure you have recent XFS userspace and
> possibly also the kernel would help debugging this.
> 
> Also can you check using strace if the ENOMEM comes directly from
> the attr_list_by_handle ioctl?
---
versions:
xfsprogs/xfsdump both at 3.0.1-2.1 from suse11.2 which would 
likely be 3.0.1 with some patchlevel from suse.
kernel is 2.6.34 (vanilla).

strace would be pretty difficult considering how far it is into a dump
before it is triggered.

Maybe I should try getting updated tools and see
if it "goes away"...

looks like I need to build xfsprogs before xfsdump?

looks like best way to pull current ver is from .git.

will try rebuilding and see if I have any luck...


BTW -- how do you tell the version of the xfs progs from 
the individual progs -- I'm going from the installed rpm
name, but if I build from the git, that won't be helpful.
I don't see a VERSION command in xfsdump/restore?

Is there one with any of the xfs tools? 

tnx,
-linda

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

Re: xfsdump -- not enough memory to dump attributes? w/>20G free -- how much does it need?

[Linda A. Walsh]

FWIF -- upgrading to the latest tool set seems to have caused
these messages to "go away"...


Christoph Hellwig wrote:
> On Sat, May 22, 2010 at 06:09:27AM -0700, Linda A. Walsh wrote:
>> I've seen the problem in the dump below and was wondering what could  
>> possibly cause this -- because
>> shows loads of free memory (>20G)...  how much memory do non-root  
>> attributes take to dump?
> 
> The error comes directly from the libhandle listing routine, which
> is a straight forward wrapper around the kernel syscall in current
> xfsprogs.
> 
> What xfsprogs version are you using?  I noticed your xfsdump is
> rather old, so making sure you have recent XFS userspace and
> possibly also the kernel would help debugging this.
> 
> Also can you check using strace if the ENOMEM comes directly from
> the attr_list_by_handle ioctl?
> 

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

Re: xfsdump -- not enough memory to dump attributes? w/>20G free -- how much does it need?

[Michael Lueck]

Greetings Linda-

I had not seen this message until this evening, and we too are running Ubuntu Lucid (10.04.1) with all updates.

/usr/sbin/xfsdump: creating dump session media file 0 (media 0, file 0)
/usr/sbin/xfsdump: dumping ino map
/usr/sbin/xfsdump: dumping directories
/usr/sbin/xfsdump: dumping non-directory files
/usr/sbin/xfsdump: WARNING: could not get list of non-root attributes for nondir ino 235386: Cannot allocate memory (12)
/usr/sbin/xfsdump: ending media file
/usr/sbin/xfsdump: media file size 98262032976 bytes
/usr/sbin/xfsdump: dump size (non-dir files) : 98162141360 bytes
/usr/sbin/xfsdump: dump complete: 3481 seconds elapsed
/usr/sbin/xfsdump: Dump Status: SUCCESS

$ uname -a
Linux ldslnx01 2.6.32-25-generic-pae #44-Ubuntu SMP Fri Sep 17 21:57:48 UTC 2010 i686 GNU/Linux

$ free -m
              total       used       free     shared    buffers     cached
Mem:          2003       1104        899          0          0       1012
-/+ buffers/cache:         92       1911
Swap:            0          0          0

Which that memory count is after the backup just completed. Usually this server draws under 512M.

Linda A. Walsh wrote:
> FWIF -- upgrading to the latest tool set seems to have caused
> these messages to "go away"...

Where did you get a newer set of xfs tools than what comes from the Ubuntu repo?

I show the following versions: $ dpkg -l|grep xfs
ii  xfsdump                                   3.0.4                             Administrative utilities for the XFS filesys
ii  xfsprogs                                  3.1.0ubuntu1                      Utilities for managing the XFS filesystem

Sincerely,

-- 
Michael Lueck
Lueck Data Systems
http://www.lueckdatasystems.com/

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs