From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mx1.redhat.com (mx1.redhat.com [172.16.48.31]) by int-mx1.corp.redhat.com (8.12.11.20060308/8.11.6) with ESMTP id k2SLOs1n025373 for ; Tue, 28 Mar 2006 16:24:54 -0500 Received: from ms-smtp-01.nyroc.rr.com (ms-smtp-01.nyroc.rr.com [24.24.2.55]) by mx1.redhat.com (8.12.11.20060308/8.12.11) with ESMTP id k2SLOrV7011409 for ; Tue, 28 Mar 2006 16:24:54 -0500 Received: from dancampbell.org (cpe-24-195-214-80.nycap.res.rr.com [24.195.214.80]) by ms-smtp-01.nyroc.rr.com (8.13.4/8.13.4) with ESMTP id k2SLOqhv028471 for ; Tue, 28 Mar 2006 16:24:53 -0500 (EST) Message-ID: <4429A9A2.6040907@the-rusty-nail.com> Date: Tue, 28 Mar 2006 16:24:50 -0500 From: Dan MIME-Version: 1.0 Subject: Re: [linux-lvm] LVM2 with disks greater than 2TB References: <44286D9D.405@the-rusty-nail.com> <442885D1.5070509@volved.com> <44297A4A.7070909@the-rusty-nail.com> <44298C92.90206@ist.ucf.edu> In-Reply-To: <44298C92.90206@ist.ucf.edu> Content-Transfer-Encoding: 7bit Reply-To: LVM general discussion and development List-Id: LVM general discussion and development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , List-Id: Content-Type: text/plain; charset="us-ascii"; format="flowed" To: LVM general discussion and development It was indeed a partition problem. Thanks. fdisk does not support partitions over 2TB so I had to use GNU Parted to setup the partition with a GPT label that supports over 2TB. I could then create reiserfs filesystems and got two 4.6TB partitions. Unfortunately Parted and GPT do not support LVM so I could not raid the two partitions into one giant one unless I am missing something. But the 2 partitions will work fine for what I need. For anyone who might be interested I found the info I needed at the links below: http://www.coraid.com/support/linux/contrib/chernow/gpt.html http://www.gnu.org/software/parted/manual/html_chapter/ http://www.wlug.org.nz/GPT Judd Tracy wrote: > I recall having a similar problem when I setup a large array a long > time ago and it was related to the partition table if I remember > correctly. I wish I could remember more, but that was atleast 2 years > ago. Hopefully it can lead you in the right direction. I think I > ended up using and EFI partion table if I remember correctly. > > Judd > > Dan wrote: > >> What concerns me is if I just try and make a single 4.54TB partition >> as reiserfs without using LVM2 and mount it, it still only shows up >> as ~560GB using df -h. This makes me think it maybe an os issue. >> Any thoughts? >> >> Barnaby Claydon wrote: >> >>> Dan wrote: >>> >>>> I have 24 - 500GB drives raided such that 11 drives + 1 hot spare >>>> per raid to get 4.54TB times 2. I want to use LVM2 to make this >>>> into one ~9TB disk, but when I create the partitions and do a df -h >>>> they show up as about 560GB each instead of 4.5TB each. I do an >>>> fdisk -l and they show up correctly. I am using Slackware 10.0. I >>>> have device-mapper and LVM2 correctly installed. I am obviously >>>> hitting a 2TB limit from what I have read, but does anyone know if >>>> it is possible to even do what I want? If so, any suggestions on >>>> what I need to install to get this to work? I am running the >>>> 2.6.15.4 kernel. Thanks >>>> >>> Dan, from the LVM2 FAQ ( >>> http://www.tldp.org/HOWTO/LVM-HOWTO/lvm2faq.html ) it mentions: >>> >>> * For 32-bit CPUs on 2.6 kernels, the maximum LV size is 16TB. >>> * For 64-bit CPUs on 2.6 kernels, the maximum LV size is 8EB. (Yes, >>> that is a very large number.) >>> >>> From what I recall when I built my last LVM, it's a matter of >>> setting the PE size during creation (hopefully you haven't started >>> filling with data yet). I think the default causes you to hit the >>> 2TB limit, but it can definitely be set higher. The default PE Size >>> seems to depend on Linux distribution, but mine is at 4MB and I'm at >>> 1.5TB right now so the references to a 32MB default would definitely >>> get you to 9TB. >>> >>> Sorry I can't offer any other specifics - hope that helps. >>> >>> -Barnaby >>> >>> >>> _______________________________________________ >>> linux-lvm mailing list >>> linux-lvm@redhat.com >>> https://www.redhat.com/mailman/listinfo/linux-lvm >>> read the LVM HOW-TO at http://tldp.org/HOWTO/LVM-HOWTO/ >> >> >> _______________________________________________ >> linux-lvm mailing list >> linux-lvm@redhat.com >> https://www.redhat.com/mailman/listinfo/linux-lvm >> read the LVM HOW-TO at http://tldp.org/HOWTO/LVM-HOWTO/ > > >