* Removing devices from RAID-5
@ 2007-06-14 18:13 Rich Walker
2007-06-14 18:23 ` Justin Piszcz
2007-06-14 19:27 ` Jon Nelson
0 siblings, 2 replies; 6+ messages in thread
From: Rich Walker @ 2007-06-14 18:13 UTC (permalink / raw)
To: linux-raid
Hi,
I've been having some problems with a machine, and now want to reduce
the number of drives in the array.
It started out as an array of 160GB drives, but over time they have
mostly been replaced by 250GB drives:
/dev/md1:
Version : 00.90.03
Creation Time : Thu Jan 20 21:01:23 2005
Raid Level : raid5
Array Size : 638904576 (609.31 GiB 654.24 GB)
Device Size : 159726144 (152.33 GiB 163.56 GB)
Raid Devices : 5
Total Devices : 5
Preferred Minor : 1
Persistence : Superblock is persistent
Intent Bitmap : Internal
Update Time : Thu Jun 14 19:07:11 2007
State : active
Active Devices : 5
Working Devices : 5
Failed Devices : 0
Spare Devices : 0
Layout : left-symmetric
Chunk Size : 32K
UUID : 6b8b4567:327b23c6:643c9869:66334873
Events : 0.26772242
Number Major Minor RaidDevice State
0 8 2 0 active sync /dev/sda2
1 34 2 1 active sync /dev/hdg2
2 33 2 2 active sync /dev/hde2
3 57 2 3 active sync /dev/hdk2
4 56 2 4 active sync /dev/hdi2
The array is used as a single PV/VG for LVM.
What I want to do is to
(a) reduce the PV/VG so it would fit in 160*3 rather than 160*4
(b) remove the last 160GB drive, (hdi), taking the array from 4+1 to 4+0
(c) rearrange the array from 4+0 to 3+1
(d) grow the array to 250*3
(e) enlarge the PV/VG again.
I would think that
mdadm --grow --raid-devices=4 -z max /dev/md1 /dev/hdg2 /dev/hde2 /dev/sda2 /dev/hdk2
would do steps (b),(c),(d) in one go - is this correct?
The linux kernel version running is 2.6.21.3 SMP.
cheers, Rich.
--
rich walker | Shadow Robot Company | rw@shadow.org.uk
technical director 251 Liverpool Road |
need a Hand? London N1 1LX | +UK 20 7700 2487
www.shadowrobot.com/hand/overview.shtml
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Removing devices from RAID-5
2007-06-14 18:13 Removing devices from RAID-5 Rich Walker
@ 2007-06-14 18:23 ` Justin Piszcz
2007-06-14 18:56 ` Rich Walker
2007-06-14 19:27 ` Jon Nelson
1 sibling, 1 reply; 6+ messages in thread
From: Justin Piszcz @ 2007-06-14 18:23 UTC (permalink / raw)
To: Rich Walker; +Cc: linux-raid
On Thu, 14 Jun 2007, Rich Walker wrote:
>
> Hi,
>
> I've been having some problems with a machine, and now want to reduce
> the number of drives in the array.
>
> It started out as an array of 160GB drives, but over time they have
> mostly been replaced by 250GB drives:
>
> /dev/md1:
> Version : 00.90.03
> Creation Time : Thu Jan 20 21:01:23 2005
> Raid Level : raid5
> Array Size : 638904576 (609.31 GiB 654.24 GB)
> Device Size : 159726144 (152.33 GiB 163.56 GB)
> Raid Devices : 5
> Total Devices : 5
> Preferred Minor : 1
> Persistence : Superblock is persistent
>
> Intent Bitmap : Internal
>
> Update Time : Thu Jun 14 19:07:11 2007
> State : active
> Active Devices : 5
> Working Devices : 5
> Failed Devices : 0
> Spare Devices : 0
>
> Layout : left-symmetric
> Chunk Size : 32K
>
> UUID : 6b8b4567:327b23c6:643c9869:66334873
> Events : 0.26772242
>
> Number Major Minor RaidDevice State
> 0 8 2 0 active sync /dev/sda2
> 1 34 2 1 active sync /dev/hdg2
> 2 33 2 2 active sync /dev/hde2
> 3 57 2 3 active sync /dev/hdk2
> 4 56 2 4 active sync /dev/hdi2
>
> The array is used as a single PV/VG for LVM.
>
> What I want to do is to
> (a) reduce the PV/VG so it would fit in 160*3 rather than 160*4
> (b) remove the last 160GB drive, (hdi), taking the array from 4+1 to 4+0
> (c) rearrange the array from 4+0 to 3+1
> (d) grow the array to 250*3
> (e) enlarge the PV/VG again.
>
> I would think that
> mdadm --grow --raid-devices=4 -z max /dev/md1 /dev/hdg2 /dev/hde2 /dev/sda2 /dev/hdk2
> would do steps (b),(c),(d) in one go - is this correct?
>
> The linux kernel version running is 2.6.21.3 SMP.
>
>
> cheers, Rich.
>
>
>
>
> --
> rich walker | Shadow Robot Company | rw@shadow.org.uk
> technical director 251 Liverpool Road |
> need a Hand? London N1 1LX | +UK 20 7700 2487
> www.shadowrobot.com/hand/overview.shtml
>
> -
> To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
>
As far as I know you cannot shrink any md raid in Linux.
Justin.
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Removing devices from RAID-5
2007-06-14 18:23 ` Justin Piszcz
@ 2007-06-14 18:56 ` Rich Walker
2007-06-14 19:15 ` Justin Piszcz
0 siblings, 1 reply; 6+ messages in thread
From: Rich Walker @ 2007-06-14 18:56 UTC (permalink / raw)
To: linux-raid
Justin Piszcz <jpiszcz@lucidpixels.com> writes:
> On Thu, 14 Jun 2007, Rich Walker wrote:
[snip]
>>
>> The array is used as a single PV/VG for LVM.
>>
>> What I want to do is to
>> (a) reduce the PV/VG so it would fit in 160*3 rather than 160*4
>> (b) remove the last 160GB drive, (hdi), taking the array from 4+1 to 4+0
>> (c) rearrange the array from 4+0 to 3+1
>> (d) grow the array to 250*3
>> (e) enlarge the PV/VG again.
>>
>> I would think that
>> mdadm --grow --raid-devices=4 -z max /dev/md1 /dev/hdg2 /dev/hde2 /dev/sda2 /dev/hdk2
>> would do steps (b),(c),(d) in one go - is this correct?
>>
>> The linux kernel version running is 2.6.21.3 SMP.
>
> As far as I know you cannot shrink any md raid in Linux.
>
> Justin.
Step (c) shrinks the array, which would be a problem.
But the mdadm command given *should* actually grow the array (from 640GB
to 750GB) whilst reducing the number of disks...
Is this likely to work?
mdadm says:
thoth:/--# mdadm --grow --help
Usage: mdadm --grow device options
This usage causes mdadm to attempt to reconfigure a running array.
This is only possibly if the kernel being used supports a particular
reconfiguration. This version only supports changing the number of
devices in a RAID1, and changing the active size of all devices in
a RAID1/4/5/6.
Options that are valid with the grow (-G --grow) mode are:
--size= -z : Change the active size of devices in an array.
: This is useful if all devices have been replaced
: with larger devices.
--raid-disks= -n : Change the number of active devices in a RAID1
: array.
thoth:/--# mdadm -V
mdadm - v2.5.6 - 9 November 2006
thoth:/--#
which makes me think it wouldn't...
cheers, Rich.
--
rich walker | Shadow Robot Company | rw@shadow.org.uk
technical director 251 Liverpool Road |
need a Hand? London N1 1LX | +UK 20 7700 2487
www.shadowrobot.com/hand/overview.shtml
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Removing devices from RAID-5
2007-06-14 18:56 ` Rich Walker
@ 2007-06-14 19:15 ` Justin Piszcz
2007-06-14 19:33 ` Justin Piszcz
0 siblings, 1 reply; 6+ messages in thread
From: Justin Piszcz @ 2007-06-14 19:15 UTC (permalink / raw)
To: Rich Walker; +Cc: linux-raid
On Thu, 14 Jun 2007, Rich Walker wrote:
> Justin Piszcz <jpiszcz@lucidpixels.com> writes:
>
>> On Thu, 14 Jun 2007, Rich Walker wrote:
>
> [snip]
>>>
>>> The array is used as a single PV/VG for LVM.
>>>
>>> What I want to do is to
>>> (a) reduce the PV/VG so it would fit in 160*3 rather than 160*4
>>> (b) remove the last 160GB drive, (hdi), taking the array from 4+1 to 4+0
>>> (c) rearrange the array from 4+0 to 3+1
>>> (d) grow the array to 250*3
>>> (e) enlarge the PV/VG again.
>>>
>>> I would think that
>>> mdadm --grow --raid-devices=4 -z max /dev/md1 /dev/hdg2 /dev/hde2 /dev/sda2 /dev/hdk2
>>> would do steps (b),(c),(d) in one go - is this correct?
>>>
>>> The linux kernel version running is 2.6.21.3 SMP.
>>
>> As far as I know you cannot shrink any md raid in Linux.
>>
>> Justin.
>
> Step (c) shrinks the array, which would be a problem.
>
> But the mdadm command given *should* actually grow the array (from 640GB
> to 750GB) whilst reducing the number of disks...
>
> Is this likely to work?
>
> mdadm says:
>
> thoth:/--# mdadm --grow --help
> Usage: mdadm --grow device options
>
> This usage causes mdadm to attempt to reconfigure a running array.
> This is only possibly if the kernel being used supports a particular
> reconfiguration. This version only supports changing the number of
> devices in a RAID1, and changing the active size of all devices in
> a RAID1/4/5/6.
>
> Options that are valid with the grow (-G --grow) mode are:
> --size= -z : Change the active size of devices in an array.
> : This is useful if all devices have been replaced
> : with larger devices.
> --raid-disks= -n : Change the number of active devices in a RAID1
> : array.
> thoth:/--# mdadm -V
> mdadm - v2.5.6 - 9 November 2006
> thoth:/--#
>
> which makes me think it wouldn't...
>
> cheers, Rich.
>
> --
> rich walker | Shadow Robot Company | rw@shadow.org.uk
> technical director 251 Liverpool Road |
> need a Hand? London N1 1LX | +UK 20 7700 2487
> www.shadowrobot.com/hand/overview.shtml
>
> -
> To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
>
You can try it, otherwise grab the latest version of mdadm and go ahead
and grow it. I have grown a 1.8TB array to 3.3TB and it was a pretty old
version of mdadm.
Justin.
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Removing devices from RAID-5
2007-06-14 18:13 Removing devices from RAID-5 Rich Walker
2007-06-14 18:23 ` Justin Piszcz
@ 2007-06-14 19:27 ` Jon Nelson
1 sibling, 0 replies; 6+ messages in thread
From: Jon Nelson @ 2007-06-14 19:27 UTC (permalink / raw)
Cc: linux-raid
On Thu, 14 Jun 2007, Rich Walker wrote:
>
> Hi,
>
> I've been having some problems with a machine, and now want to reduce
> the number of drives in the array.
>
> It started out as an array of 160GB drives, but over time they have
> mostly been replaced by 250GB drives:
If you've been having trouble with a machine, doing risky stuff like
restructuring raids and/or putting them in degraded mode (even
temporarily) is a bad idea. That said, ...
If you had another 250G disk available you could do it, but it would
involve the creation of a new array and use of pvmove. You said you
could knock the space down to just 3x160 which is 480G which 2x250
should be able to cover.
Assuming you had another 250G to play with (you only need it
temporarily):
1. remove one 250G from array
2. make new array from second drive and the one you just removed
(/dev/mdNEW) (degraded 2/3 raid5)
3. add new array to volume group
4. use pvmove or whatever to move all physical extents from /dev/md1 to
/dev/mdNEW
5. When complete, disable /dev/md1, remove /dev/md1 from LVM
(don't forget to zero the superblocks, that one always bites me)
6. take one of the now-available 250's and add it to /dev/mdNEW,
allowing it to reconstruct
7. You now have a 3x250 RAID5 and 2 unused drives, with no
downtime (except adding a new 250G)
8. Update mdadm.conf and other files as necessary.
9. Since you only needed a 250G drive temporarily, you could play games
with fault+remove of the "borrowed" drive and replace it or whatever
you want to do...
Otherwise, I don't think you can use mdadm to accomplish this.
--
Jon Nelson <jnelson-linux-raid@jamponi.net>
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Removing devices from RAID-5
2007-06-14 19:15 ` Justin Piszcz
@ 2007-06-14 19:33 ` Justin Piszcz
0 siblings, 0 replies; 6+ messages in thread
From: Justin Piszcz @ 2007-06-14 19:33 UTC (permalink / raw)
To: Rich Walker; +Cc: linux-raid
> > > I would think that
> > > mdadm --grow --raid-devices=4 -z max /dev/md1 /dev/hdg2 /dev/hde2
> > > /dev/sda2 /dev/hdk2
Make sure the new device is added as a spare first the -z should not be
needed, by default it should use all space on the new drive.
On Thu, 14 Jun 2007, Justin Piszcz wrote:
>
>
> On Thu, 14 Jun 2007, Rich Walker wrote:
>
>> Justin Piszcz <jpiszcz@lucidpixels.com> writes:
>>
>>> On Thu, 14 Jun 2007, Rich Walker wrote:
>>
>> [snip]
>>>>
>>>> The array is used as a single PV/VG for LVM.
>>>>
>>>> What I want to do is to
>>>> (a) reduce the PV/VG so it would fit in 160*3 rather than 160*4
>>>> (b) remove the last 160GB drive, (hdi), taking the array from 4+1 to 4+0
>>>> (c) rearrange the array from 4+0 to 3+1
>>>> (d) grow the array to 250*3
>>>> (e) enlarge the PV/VG again.
>>>>
>>>> I would think that
>>>> mdadm --grow --raid-devices=4 -z max /dev/md1 /dev/hdg2 /dev/hde2
>>>> /dev/sda2 /dev/hdk2
>>>> would do steps (b),(c),(d) in one go - is this correct?
>>>>
>>>> The linux kernel version running is 2.6.21.3 SMP.
>>>
>>> As far as I know you cannot shrink any md raid in Linux.
>>>
>>> Justin.
>>
>> Step (c) shrinks the array, which would be a problem.
>>
>> But the mdadm command given *should* actually grow the array (from 640GB
>> to 750GB) whilst reducing the number of disks...
>>
>> Is this likely to work?
>>
>> mdadm says:
>>
>> thoth:/--# mdadm --grow --help
>> Usage: mdadm --grow device options
>>
>> This usage causes mdadm to attempt to reconfigure a running array.
>> This is only possibly if the kernel being used supports a particular
>> reconfiguration. This version only supports changing the number of
>> devices in a RAID1, and changing the active size of all devices in
>> a RAID1/4/5/6.
>>
>> Options that are valid with the grow (-G --grow) mode are:
>> --size= -z : Change the active size of devices in an array.
>> : This is useful if all devices have been replaced
>> : with larger devices.
>> --raid-disks= -n : Change the number of active devices in a RAID1
>> : array.
>> thoth:/--# mdadm -V
>> mdadm - v2.5.6 - 9 November 2006
>> thoth:/--#
>>
>> which makes me think it wouldn't...
>>
>> cheers, Rich.
>>
>> --
>> rich walker | Shadow Robot Company | rw@shadow.org.uk
>> technical director 251 Liverpool Road |
>> need a Hand? London N1 1LX | +UK 20 7700 2487
>> www.shadowrobot.com/hand/overview.shtml
>>
>> -
>> To unsubscribe from this list: send the line "unsubscribe linux-raid" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at http://vger.kernel.org/majordomo-info.html
>>
>
> You can try it, otherwise grab the latest version of mdadm and go ahead and
> grow it. I have grown a 1.8TB array to 3.3TB and it was a pretty old version
> of mdadm.
>
> Justin.
> -
> To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
>
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2007-06-14 19:33 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2007-06-14 18:13 Removing devices from RAID-5 Rich Walker
2007-06-14 18:23 ` Justin Piszcz
2007-06-14 18:56 ` Rich Walker
2007-06-14 19:15 ` Justin Piszcz
2007-06-14 19:33 ` Justin Piszcz
2007-06-14 19:27 ` Jon Nelson
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).