public inbox for linux-xfs@vger.kernel.org
 help / color / mirror / Atom feed
* Probems with xfs_repair on large filesystem and 32bit OS.
@ 2008-06-10 11:28 Lance Reed
       [not found] ` <20080610115038.GD3005@sillage.bis.pasteur.fr>
  0 siblings, 1 reply; 7+ messages in thread
From: Lance Reed @ 2008-06-10 11:28 UTC (permalink / raw)
  To: 'xfs@oss.sgi.com'

So I am having trouble fixing a corrupted <16 TB file system on a 32bit Linux system:


The problem is that xfs_repair dies due to xfs_repair: libxfs_initbuf can't memalign 4096 bytes: Cannot allocate memory:

I found the below post, but the links are dead.

I tried upping the system RAM to 12 GB, but the problem still exists, which I assume is the per process limit of 1-4 GB.


So I am looking for advice on how to fix a large 32bit filesystem.  I see options about running on a 64bit host.
Can I do this with a newer version of xfs and kernel?
We have many hosts that run 64bit Linux (2.6.18-8.1.15.el5  x86_64) and updated xfs progs.
Is it possible to mount the existing LVM volumes on a new 64bit host with a newer OS and xfs progs and not risk losing data.
Os details for old and possible new host below:

Thanks in advance for any possible ideas.
Really, THANKS!
Lance

Basic Os details: (Problem host used to mount XFS filesystem).
CentOS release 4.4 (Final)
2.6.9-42.ELsmp  i686 i686 i386 GNU/Linux

XFS info:

xfsprogs-2.8.11-1.c4
xfsdump-2.2.42-1.c4
kernel-module-xfs-2.6.9-42.ELsmp-0.1-3

Possible new host.:

CentOS release 5 (Final)
2.6.18-8.1.15.el5  x86_64
xfsprogs-2.9.4-1.el5.centos
xfsdump-2.2.46-1.el5.centos
kmod-xfs-0.4-1.2.6.18_8.1.15.el5


Previous posts on list:




#> I had 2GB RAM and a 300GB swap partition and was monitoring

#> memory consumption with "top": it never went over 3BG before

#> failing.

#

#The default 3GiB address space limit per process on a 32 bit

#system is rather well documented, for a summary:

#

#  http://WWW.sabi.co.UK/Notes/#060821c

#

#Let's mention this classic entry again:

#

#  http://OSS.SGI.com/archives/linux-xfs/2005-08/msg00045.html

#

#   <> > Your filesystem (8TiB) may simply bee too large for your

#    > > system to be able to repair. Try mounting it on a 64bit

#    > > system with more RAM in it and repairing it from there.

#

#    Now that linux supports larger than 2TiB filesystems on 32

#    bit systems, this is true for Linux as well.>

#

#A previous entry in the same thread might help too:

#

#  http://OSS.SGI.com/archives/linux-xfs/2005-08/msg00037.html

#

#   <> I try xfs_check and xfs_ncheck (and more progs) with

#    > +200GB swap, but no different! less than 1 second and get

#    > out of memory.

#

#    Swap won't help if you're running an ia32 (32bit) kernel -

#    you have a per-process memory limit of 1-4GiB (depending on

#    kernel and config). The amount of physical memory and swap

#    does not change this limitation.>

#

#Trying hard to avoid looking at what <has been discussed many

#times previously> is a great time saving strategy! :-)
#












[[HTML alternate version deleted]]

^ permalink raw reply	[flat|nested] 7+ messages in thread
* Re: Probems with xfs_repair on large filesystem and 32bit OS.
@ 2008-06-10 12:50 Lance Reed
  2008-06-10 13:01 ` 'hch@infradead.org'
  0 siblings, 1 reply; 7+ messages in thread
From: Lance Reed @ 2008-06-10 12:50 UTC (permalink / raw)
  To: 'hch@infradead.org'; +Cc: 'xfs@oss.sgi.com'

Thanks!

Yes the log died and was zeroed already with xfs_repair already.

So I plan to put a 64bit head on the volumes and leave it that way.

I asuume I need to still keep it under 16 tb since the fs datastuctures are 32bit?

Thanks again for the help!!!

----- Original Message -----
From: Christoph Hellwig <hch@infradead.org>
To: Lance Reed
Cc: Tru Huynh <tru@pasteur.fr>; 'xfs@oss.sgi.com' <xfs@oss.sgi.com>
Sent: Tue Jun 10 08:28:11 2008
Subject: Re: Probems with xfs_repair on large filesystem and 32bit OS.

On Tue, Jun 10, 2008 at 08:07:18AM -0400, Lance Reed wrote:
> SO, I take it from what you say that that I can running any newer version of xfs progs and a 64bit host (fiber attached, easy to do this), and run xfs_repair on the 32bit XFS volumes without fear of data corruption?
> Is this because XFS is not version specific, and xfs_repair will honor the 32bit file data structures?

Yes, this is fine.  All the actual filesystem structures are endian and
32/64bit clean.  The log needs to be in the same endianess and had 32bit
vs 64bit problems on x86 for a while, but it needs to be recovered
before you run xfs_repair anyway.

^ permalink raw reply	[flat|nested] 7+ messages in thread
end of thread, other threads:[~2008-06-11  0:00 UTC | newest]

Thread overview: 7+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2008-06-10 11:28 Probems with xfs_repair on large filesystem and 32bit OS Lance Reed
     [not found] ` <20080610115038.GD3005@sillage.bis.pasteur.fr>
2008-06-10 12:07   ` Lance Reed
2008-06-10 12:28     ` Christoph Hellwig
2008-06-10 17:07       ` Andi Kleen
2008-06-11  0:01     ` Barry Naujok
  -- strict thread matches above, loose matches on Subject: below --
2008-06-10 12:50 Lance Reed
2008-06-10 13:01 ` 'hch@infradead.org'

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox