* [linux-lvm] *** ANNOUNCEMENT *** LVM 1.0.3 available at www.sistina.com @ 2002-02-19 13:54 Heinz J . Mauelshagen 2002-02-19 14:15 ` tim 2002-02-19 20:54 ` [linux-lvm] lvm and 'poor mans raid' on heterogenous hard drives! Steve Wray 0 siblings, 2 replies; 13+ messages in thread From: Heinz J . Mauelshagen @ 2002-02-19 13:54 UTC (permalink / raw) To: linux-lvm *** ANNOUNCEMENT *** LVM 1.0.3 available at www.sistina.com Hi all, LVM 1.0.3 supports both version 1 and 2 of the metadata. There's *no* need to run any metadata update tools. A tarball is available now at <http://www.sistina.com/> for download (Follow the "LVM 1.0" link). Changes to LVM 1.0.2 include: o vgcfgrestore supports restores to different sized physical volumes; useful in cases where a replacement disk is a little bit to large or for test purposes; option enhancements; physical volume UUID restore fix o vgchange removes failed snapshots and activates the volume group rather than failing on it. Optionally forces device number changes in cases where it finds clashes so that the volume group can be activated o vgexport exports volume groups not showing up in /etc/lvmtab* o vgscan can drop all snapshots or those in a particular volume group now o "pvmove -i" ignores read errors while moving and supports moves in inactive volume groups o > 1 TB fixes for physical and logical volumes (2 TB limitation on 2.4 persists) o more... See the CHANGELOG file contained in the tarball for further information. Feed back LVM related information to <linux-lvm@sistina.com>. Thanks a lot for your support of LVM. ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [linux-lvm] *** ANNOUNCEMENT *** LVM 1.0.3 available at www.sistina.com 2002-02-19 13:54 [linux-lvm] *** ANNOUNCEMENT *** LVM 1.0.3 available at www.sistina.com Heinz J . Mauelshagen @ 2002-02-19 14:15 ` tim 2002-02-19 18:11 ` Heinz J . Mauelshagen 2002-02-19 20:54 ` [linux-lvm] lvm and 'poor mans raid' on heterogenous hard drives! Steve Wray 1 sibling, 1 reply; 13+ messages in thread From: tim @ 2002-02-19 14:15 UTC (permalink / raw) To: linux-lvm Awesome! The new vgchange behavior is precisely what I needed to save my ass from the apocalyptic corruption problems between bad-VM and snapshots.. very happy to see this in release. Quoth Heinz J . Mauelshagen: > > *** ANNOUNCEMENT *** LVM 1.0.3 available at www.sistina.com > > Hi all, > > LVM 1.0.3 supports both version 1 and 2 of the metadata. > > There's *no* need to run any metadata update tools. > > A tarball is available now at > > <http://www.sistina.com/> > > for download (Follow the "LVM 1.0" link). > > > Changes to LVM 1.0.2 include: > > o vgcfgrestore supports restores to different sized physical volumes; > useful in cases where a replacement disk is a little bit to large or > for test purposes; option enhancements; physical volume UUID restore fix > > o vgchange removes failed snapshots and activates the volume group rather > than failing on it. Optionally forces device number changes in cases > where it finds clashes so that the volume group can be activated > > o vgexport exports volume groups not showing up in /etc/lvmtab* > > o vgscan can drop all snapshots or those in a particular volume group now > > o "pvmove -i" ignores read errors while moving and supports moves in > inactive volume groups > > o > 1 TB fixes for physical and logical volumes (2 TB limitation > on 2.4 persists) > > o more... > > > See the CHANGELOG file contained in the tarball for further information. > > Feed back LVM related information to <linux-lvm@sistina.com>. > > Thanks a lot for your support of LVM. > > > _______________________________________________ > linux-lvm mailing list > linux-lvm@sistina.com > http://lists.sistina.com/mailman/listinfo/linux-lvm > read the LVM HOW-TO at http://www.sistina.com/lvm/Pages/howto.html -- Don't hate me because I'm beautiful. Hate me because I run your IT department. ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [linux-lvm] *** ANNOUNCEMENT *** LVM 1.0.3 available at www.sistina.com 2002-02-19 14:15 ` tim @ 2002-02-19 18:11 ` Heinz J . Mauelshagen 0 siblings, 0 replies; 13+ messages in thread From: Heinz J . Mauelshagen @ 2002-02-19 18:11 UTC (permalink / raw) To: linux-lvm On Tue, Feb 19, 2002 at 12:14:53PM -0800, tim@connectlive.com wrote: > > Awesome! The new vgchange behavior is precisely what I needed to save > my ass from the apocalyptic corruption problems between bad-VM and > snapshots.. very happy to see this in release. Happy to hear that it helps someone in these hard VM days ;-) Kind reagrds, Heinz -- The LVM Guy -- > > > Quoth Heinz J . Mauelshagen: > > > > *** ANNOUNCEMENT *** LVM 1.0.3 available at www.sistina.com > > > > Hi all, > > > > LVM 1.0.3 supports both version 1 and 2 of the metadata. > > > > There's *no* need to run any metadata update tools. > > > > A tarball is available now at > > > > <http://www.sistina.com/> > > > > for download (Follow the "LVM 1.0" link). > > > > > > Changes to LVM 1.0.2 include: > > > > o vgcfgrestore supports restores to different sized physical volumes; > > useful in cases where a replacement disk is a little bit to large or > > for test purposes; option enhancements; physical volume UUID restore fix > > > > o vgchange removes failed snapshots and activates the volume group rather > > than failing on it. Optionally forces device number changes in cases > > where it finds clashes so that the volume group can be activated > > > > o vgexport exports volume groups not showing up in /etc/lvmtab* > > > > o vgscan can drop all snapshots or those in a particular volume group now > > > > o "pvmove -i" ignores read errors while moving and supports moves in > > inactive volume groups > > > > o > 1 TB fixes for physical and logical volumes (2 TB limitation > > on 2.4 persists) > > > > o more... > > > > > > See the CHANGELOG file contained in the tarball for further information. > > > > Feed back LVM related information to <linux-lvm@sistina.com>. > > > > Thanks a lot for your support of LVM. > > > > > > _______________________________________________ > > linux-lvm mailing list > > linux-lvm@sistina.com > > http://lists.sistina.com/mailman/listinfo/linux-lvm > > read the LVM HOW-TO at http://www.sistina.com/lvm/Pages/howto.html > > -- > Don't hate me because I'm beautiful. > Hate me because I run your IT department. > > _______________________________________________ > linux-lvm mailing list > linux-lvm@sistina.com > http://lists.sistina.com/mailman/listinfo/linux-lvm > read the LVM HOW-TO at http://www.sistina.com/lvm/Pages/howto.html *** Software bugs are stupid. Nevertheless it needs not so stupid people to solve them *** =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Heinz Mauelshagen Sistina Software Inc. Senior Consultant/Developer Am Sonnenhang 11 56242 Marienrachdorf Germany Mauelshagen@Sistina.com +49 2626 141200 FAX 924446 =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- ^ permalink raw reply [flat|nested] 13+ messages in thread
* [linux-lvm] lvm and 'poor mans raid' on heterogenous hard drives! 2002-02-19 13:54 [linux-lvm] *** ANNOUNCEMENT *** LVM 1.0.3 available at www.sistina.com Heinz J . Mauelshagen 2002-02-19 14:15 ` tim @ 2002-02-19 20:54 ` Steve Wray 2002-02-19 23:20 ` Andreas Dilger 1 sibling, 1 reply; 13+ messages in thread From: Steve Wray @ 2002-02-19 20:54 UTC (permalink / raw) To: linux-lvm Hmmmm, Ok so I have 4 hard drives of very varying capacity (20G,12G,5G,4G) I have an off-board IDE controller (Promise 66) I think 'maybe I can take advantage of the IDE system and put a drive on each master and stripe them.' A hardware RAID card would be suboptimal because (as I understand it) the striped volume could only be as big as the smallest drive. So, I set up the drives as; hda = 20G hda1 = 64M and is /boot hda2 = 1G hdc = 12G hdc1 = 1G hde = 5G hde1 = 1G hdg = 4G hdg1 = 1G The other partitions are set up for various other volume groups and non LVM system partitions. hda2, hdc1, hde1, hdg1 are added to a VG 'fast' The other LVM partitions on hdc-g are in a volume group that doesn't see much traffic, just storage. I make logical volumes on fast striped across 4 drives. So thats 4 partitions at the beginning of the drives, with volumes striped across them. I expected some performance improvements. So I get the iozone benchmark and start running it on the system. I compare performance of striped volumes with performance of a volume purely on hda. Interestingly, the performance improvement is not dramatic, I expected better. The main improvement seems to be that the striped volumes do better with larger file sizes and as file size increases the striped volume keeps its performance up better. I'm a newbie at this benchmarking lark, so if anyone wants the excel spreadsheets generated from iozone just ask, I'd like a second opinion! There are some strange things, like when file size gets above 16M performance drops dramatically regardless of striped or linear volumes... Maybe its something to do with extents? ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [linux-lvm] lvm and 'poor mans raid' on heterogenous hard drives! 2002-02-19 20:54 ` [linux-lvm] lvm and 'poor mans raid' on heterogenous hard drives! Steve Wray @ 2002-02-19 23:20 ` Andreas Dilger 2002-02-19 23:47 ` Steve Wray 0 siblings, 1 reply; 13+ messages in thread From: Andreas Dilger @ 2002-02-19 23:20 UTC (permalink / raw) To: Steve Wray; +Cc: linux-lvm On Feb 20, 2002 15:54 +1300, Steve Wray wrote: > Ok so I have 4 hard drives of very varying capacity > I think 'maybe I can take advantage of the IDE > system and put a drive on each master and stripe them.' > > I expected some performance improvements. Interestingly, > the performance improvement is not dramatic, I expected better. Well, basically you cannot get performace much better than 4x the slowest disk. The reason would be that because it is striped across all 4 disks, no matter how fast the other disks run you will always have to end up waiting for the slowest disk to complete every 4th block I/O. I think you will find that the performance of modern UDMA disks is far better than any of the older disks, so you are better off just using the single large disk for best performance & reliability. > The main improvement seems to be that the striped volumes > do better with larger file sizes and as file size increases > the striped volume keeps its performance up better. The other problem (as I always complain about whenever people try striping and it doesn't work) is that unless you do large file I/O (as you have seen) you don't get much performance gains. This is because for each small* read you basically have to wait for the maxiumu seek time of all of the disks to do a read. For normal I/O patterns this is really bad. (*) small means larger than the stripe size and less than maybe 8-12 stripes. You also have the problem that you are 4x as likely to lose all of your data in this case. Cheers, Andreas -- Andreas Dilger http://sourceforge.net/projects/ext2resize/ http://www-mddsp.enel.ucalgary.ca/People/adilger/ ^ permalink raw reply [flat|nested] 13+ messages in thread
* RE: [linux-lvm] lvm and 'poor mans raid' on heterogenous hard drives! 2002-02-19 23:20 ` Andreas Dilger @ 2002-02-19 23:47 ` Steve Wray 2002-02-20 11:32 ` Andreas Dilger 0 siblings, 1 reply; 13+ messages in thread From: Steve Wray @ 2002-02-19 23:47 UTC (permalink / raw) To: Andreas Dilger; +Cc: linux-lvm > From: Andreas Dilger [mailto:adilger@turbolabs.com] > > On Feb 20, 2002 15:54 +1300, Steve Wray wrote: > > Ok so I have 4 hard drives of very varying capacity > > I think 'maybe I can take advantage of the IDE > > system and put a drive on each master and stripe them.' > > > > I expected some performance improvements. Interestingly, > > the performance improvement is not dramatic, I expected better. > > Well, basically you cannot get performace much better than 4x > the slowest disk. The reason would be that because it is striped > across all 4 disks, no matter how fast the other disks run you > will always have to end up waiting for the slowest disk to complete > every 4th block I/O. Yes, I think I've factored that in; While the disks are very heterogenous, the motherboard is an old VIA chipset, from TMI. Its onboard controller is UDMA33. The 2 drives that are plugged into it are both capable of UDMA66. Sometime I'll get a newer muthaboard :) Meanwhile, the promise card is at UDMA66, only one of the drives plugged into it is capable of 66 and its only on 40 cable, so its working at 33 as well. The other drive only goes at 33 too. So, overall, the system is UDMA33 which I figured would be minimising the impact of a heterogenous architecture. But obviously all this DOES introduce piles of other variables! Differing cache in the drives for one thing. > I think you will find that the performance of modern UDMA disks > is far better than any of the older disks, so you are better off > just using the single large disk for best performance & reliability. yeah but the m/board won't help the new drive. I think that the 20G drive is quite a bit newer than the MB (which I think was one of the first ATX boards out. The bios even crashes at the chipset screen 8) Yes, and I'm trying to benchmark this mongrel. Ah well I'm learning! > > The main improvement seems to be that the striped volumes > > do better with larger file sizes and as file size increases > > the striped volume keeps its performance up better. > > The other problem (as I always complain about whenever people try > striping and it doesn't work) is that unless you do large file > I/O (as you have seen) you don't get much performance gains. This > is because for each small* read you basically have to wait for the > maxiumu seek time of all of the disks to do a read. For normal I/O > patterns this is really bad. This is very very true. I'm having second thoughts about having all of /var on it. Maybe seperate some of the /var directories into their own striped volumes. But what do you think of the huge drop in performance at file sizes of 16M and up (at all block sizes)? It goes from 50Mps down to less than 20Mps starting when the file size hits 16M? Looking at the figures, it virtually halves. Read is even more dramatic from 108213Kps at 8192K files down to 14796Kps at 16384K files! Now this is the same, striped or non striped; striping just smoothes things out on either side of the step! All the filesystems are LVM at standard extent size with ext3 filesystems and default journalling. Uh oh, this is getting off topic! (LVM) > (*) small means larger than the stripe size and less than maybe 8-12 > stripes. > > You also have the problem that you are 4x as likely to lose all of > your data in this case. yeah but its only /var, /usr/lib, /usr/share, /tmp, swap that sort of thing. I think swap may have been a mistake looking at the benchmark! ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [linux-lvm] lvm and 'poor mans raid' on heterogenous hard drives! 2002-02-19 23:47 ` Steve Wray @ 2002-02-20 11:32 ` Andreas Dilger 2002-02-20 16:02 ` Steve Wray 2002-02-20 18:41 ` [linux-lvm] lvm and 'poor mans raid' on heterogenous hard drives! Rupa Schomaker 0 siblings, 2 replies; 13+ messages in thread From: Andreas Dilger @ 2002-02-20 11:32 UTC (permalink / raw) To: Steve Wray; +Cc: linux-lvm On Feb 20, 2002 18:47 +1300, Steve Wray wrote: > > The other problem (as I always complain about whenever people try > > striping and it doesn't work) is that unless you do large file > > I/O (as you have seen) you don't get much performance gains. This > > is because for each small* read you basically have to wait for the > > maxiumu seek time of all of the disks to do a read. For normal I/O > > patterns this is really bad. > > This is very very true. I'm having second thoughts about having > all of /var on it. Maybe seperate some of the /var directories > into their own striped volumes. In most applications, you are better off to put separate trees each on their own drive. Usually you only have a single application writing into each tree (e.g. sendmail writing to /var/spool/{mail,mqueue}, other programs writing to /var/tmp, lpd writing to /var/spool/lpd, etc). If you have each of the high-volume trees on a separate drive it means that each app can write at the full disk bandwidth without much seeking, instead of the striped case where each app needs to seek every drive for every write. > But what do you think of the huge drop in performance at file sizes > of 16M and up (at all block sizes)? > It goes from 50Mps down to less than 20Mps starting when the file size > hits 16M? Looking at the figures, it virtually halves. > Read is even more dramatic from 108213Kps at 8192K files down to > 14796Kps at 16384K files! Could be several things - cache size issues, journal size, maybe once you are reading large enough files and your bus/CPU/cache can't keep up you need to skip a full disk revolution for each subsequent read... > > You also have the problem that you are 4x as likely to lose all of > > your data in this case. > > yeah but its only /var, /usr/lib, /usr/share, /tmp, swap that sort of thing. > I think swap may have been a mistake looking at the benchmark! Swap is a bad move, since you can just add multiple swap spaces with the same priority (if you so choose) and it will do the striping for you. Likewise, you could put each of the above trees on their own drive and you would probably get better overall performance than striping. Cheers, Andreas -- Andreas Dilger http://sourceforge.net/projects/ext2resize/ http://www-mddsp.enel.ucalgary.ca/People/adilger/ ^ permalink raw reply [flat|nested] 13+ messages in thread
* RE: [linux-lvm] lvm and 'poor mans raid' on heterogenous hard drives! 2002-02-20 11:32 ` Andreas Dilger @ 2002-02-20 16:02 ` Steve Wray 2002-02-20 18:18 ` [linux-lvm] striping volumes Steve Wray 2002-02-20 18:41 ` [linux-lvm] lvm and 'poor mans raid' on heterogenous hard drives! Rupa Schomaker 1 sibling, 1 reply; 13+ messages in thread From: Steve Wray @ 2002-02-20 16:02 UTC (permalink / raw) To: linux-lvm > From: linux-lvm-admin@sistina.com [mailto:linux-lvm-admin@sistina.com]On > Behalf Of Andreas Dilger > > On Feb 20, 2002 18:47 +1300, Steve Wray wrote: > > > The other problem (as I always complain about whenever people try > > > striping and it doesn't work) is that unless you do large file > > > I/O (as you have seen) you don't get much performance gains. This > > > is because for each small* read you basically have to wait for the > > > maxiumu seek time of all of the disks to do a read. For normal I/O > > > patterns this is really bad. > > > > This is very very true. I'm having second thoughts about having > > all of /var on it. Maybe seperate some of the /var directories > > into their own striped volumes. > > In most applications, you are better off to put separate trees each on > their own drive. Usually you only have a single application writing > into each tree (e.g. sendmail writing to /var/spool/{mail,mqueue}, > other programs writing to /var/tmp, lpd writing to /var/spool/lpd, etc). > If you have each of the high-volume trees on a separate drive it means > that each app can write at the full disk bandwidth without much seeking, > instead of the striped case where each app needs to seek every drive > for every write. Ohhhhh. Now thats a consideration I didn't take into account. Thanks for the insight. Next time I reinstall this sucker, I'll give it a go. Plus the parallel swap suggestion (which I also just read in the software RAID howto). Pity I can't just resize the partitions and insert somenew ones! (I doubt that partition magic will successfully move'n'resize an LVM partition! (even if I did have a windoze install on that box)). > > But what do you think of the huge drop in performance at file sizes > > of 16M and up (at all block sizes)? > > It goes from 50Mps down to less than 20Mps starting when the file size > > hits 16M? Looking at the figures, it virtually halves. > > Read is even more dramatic from 108213Kps at 8192K files down to > > 14796Kps at 16384K files! > > Could be several things - cache size issues, journal size, maybe once > you are reading large enough files and your bus/CPU/cache can't keep > up you need to skip a full disk revolution for each subsequent read... It seems dependent on system memory. I increased it from 68M to 192M and ran the same benchmarks; the 8M-16M step was displaced to 32M-64M. The really interesting thing is that the step is stable across all block sizes (as near as I can tell). Ie; before the step, blocksize is very important (small block sizes are way faster) after the step it doesn't matter what the blocksize is, the step goes down to 20Mps. I know this is unlikely to be LVM related tho. I can't see that this has anything to do with extent size or whatever, and its nothing to do with striping vs linear. So I guess I better shut up about it on this list... :) > > > You also have the problem that you are 4x as likely to lose all of > > > your data in this case. > > > > yeah but its only /var, /usr/lib, /usr/share, /tmp, swap that > sort of thing. > > I think swap may have been a mistake looking at the benchmark! > > Swap is a bad move, since you can just add multiple swap spaces with the > same priority (if you so choose) and it will do the striping for you. > Likewise, you could put each of the above trees on their own drive and > you would probably get better overall performance than striping. > > Cheers, Andreas > -- > Andreas Dilger > http://sourceforge.net/projects/ext2resize/ > http://www-mddsp.enel.ucalgary.ca/People/adilger/ > > > _______________________________________________ > linux-lvm mailing list > linux-lvm@sistina.com > http://lists.sistina.com/mailman/listinfo/linux-lvm > read the LVM HOW-TO at http://www.sistina.com/lvm/Pages/howto.html > ^ permalink raw reply [flat|nested] 13+ messages in thread
* [linux-lvm] striping volumes 2002-02-20 16:02 ` Steve Wray @ 2002-02-20 18:18 ` Steve Wray 0 siblings, 0 replies; 13+ messages in thread From: Steve Wray @ 2002-02-20 18:18 UTC (permalink / raw) To: linux-lvm Ok, after a bit more benchmarking, it seems clear that striping logical volumes across multiple heterogenous IDE drives (all masters) is only beneficial (WRT performance) on large file sizes. The file size at which the performance increase happens appears to depend on system memory. On my system at 128M RAM, the filesize is around 32M, with 64M RAM that drops to 8M files; but the point at which the step occurs is nothing to do with striping vs linear. Also, there seems to be very very little difference for *reads*; only writes (and the difference is definitely worth it. I get a 10Mps improvement over linear mapping starting at 64M files and that improvement is stable as filesize increases; linear mapping performance seems to constantly drop off as file size increases). I guess that this makes sense all things considered. What I'd like to know is; has anyone else done any similar benchmarking on LVM? If so, where can I get a peek at it please! :) ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [linux-lvm] lvm and 'poor mans raid' on heterogenous hard drives! 2002-02-20 11:32 ` Andreas Dilger 2002-02-20 16:02 ` Steve Wray @ 2002-02-20 18:41 ` Rupa Schomaker 2002-02-20 20:59 ` Andreas Dilger 2002-02-21 3:19 ` William Blunn 1 sibling, 2 replies; 13+ messages in thread From: Rupa Schomaker @ 2002-02-20 18:41 UTC (permalink / raw) To: linux-lvm -----BEGIN PGP SIGNED MESSAGE----- Andreas Dilger <adilger@turbolabs.com> writes: > Swap is a bad move, since you can just add multiple swap spaces with the > same priority (if you so choose) and it will do the striping for you. > Likewise, you could put each of the above trees on their own drive and > you would probably get better overall performance than striping. This suggestion has always bothered me. Yes, if all you care about performance, setting up swap this way works fine. However, for every drive you add you increase the likelyhood that you're system will fail due to a drive failure (what happens when one of the swap slices suddenly dissapears?). The better (IMO) suggestion is to use MD to setup RAID-1 mirrors and then swapadd those. That way, if one of your drives go south, you still have a workable swap. - -- - -rupa -----BEGIN PGP SIGNATURE----- Version: 2.6.3ia Charset: noconv Comment: Processed by Mailcrypt 3.5.6, an Emacs/PGP interface iQEVAwUBPHRCF3HDM4ucEopdAQHojAf/TbnHkeXcK6KwF+wQKOug8FcqJoNsZB8s 6XmCvL2V9QIdEMguXEob4qys/h2Km008xfXXvzIW+g8eXl/8zhoQAtQxRgBpJWZj Xa7XdzHUW2tEGTwztr5w/FJKFtL5nqqme6aYcILpbD2RFosgCSI8rm26QcgvSbXv /L6xmKx7ha5tD1QuMrh9/dVf5ei//c4BPiLeLSItmPaybm6DCL9NIYADQK+8WtLh WUDKycmjd+KTzFPiEH9Wmca+pbqE9XTEfmbsDRrTUSA9Fyeg3Y/t5KG4E1eI4HfS HtJvbtyYEY2uUAgiSPMcicbtxaOnyrJBoHGdBjmX6WK13lHQhoeQpA== =X3cg -----END PGP SIGNATURE----- ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [linux-lvm] lvm and 'poor mans raid' on heterogenous hard drives! 2002-02-20 18:41 ` [linux-lvm] lvm and 'poor mans raid' on heterogenous hard drives! Rupa Schomaker @ 2002-02-20 20:59 ` Andreas Dilger 2002-02-21 3:19 ` William Blunn 1 sibling, 0 replies; 13+ messages in thread From: Andreas Dilger @ 2002-02-20 20:59 UTC (permalink / raw) To: linux-lvm On Feb 20, 2002 16:40 -0800, Rupa Schomaker wrote: > Andreas Dilger <adilger@turbolabs.com> writes: > > Swap is a bad move, since you can just add multiple swap spaces with the > > same priority (if you so choose) and it will do the striping for you. > > Likewise, you could put each of the above trees on their own drive and > > you would probably get better overall performance than striping. > > This suggestion has always bothered me. Yes, if all you care about > performance, setting up swap this way works fine. However, for every > drive you add you increase the likelyhood that you're system will fail > due to a drive failure (what happens when one of the swap slices > suddenly dissapears?). > > The better (IMO) suggestion is to use MD to setup RAID-1 mirrors and > then swapadd those. That way, if one of your drives go south, you > still have a workable swap. Well that is true of ANY setup that uses RAID-0/stripe, or any unmirrored disk for that matter. I am by no means advocating the use of striped swap, just saying that to stripe at the physical layer is no benefit over letting the swap do its own striping. Cheers, Andreas -- Andreas Dilger http://sourceforge.net/projects/ext2resize/ http://www-mddsp.enel.ucalgary.ca/People/adilger/ ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [linux-lvm] lvm and 'poor mans raid' on heterogenous hard drives! 2002-02-20 18:41 ` [linux-lvm] lvm and 'poor mans raid' on heterogenous hard drives! Rupa Schomaker 2002-02-20 20:59 ` Andreas Dilger @ 2002-02-21 3:19 ` William Blunn 2002-02-21 10:15 ` Rupa Schomaker 1 sibling, 1 reply; 13+ messages in thread From: William Blunn @ 2002-02-21 3:19 UTC (permalink / raw) To: linux-lvm > Andreas Dilger <adilger@turbolabs.com> writes: > > > Swap is a bad move, since you can just add multiple swap spaces with the > > same priority (if you so choose) and it will do the striping for you. > > Likewise, you could put each of the above trees on their own drive and > > you would probably get better overall performance than striping. > > This suggestion has always bothered me. Yes, if all you care about > performance, setting up swap this way works fine. However, for every > drive you add you increase the likelyhood that you're system will fail > due to a drive failure (what happens when one of the swap slices > suddenly dissapears?). For this situation, we are considering drives failing entirely. (If you consider grown defect bad blocks appearing, then it is probably no more likely for a bad block to appear inside 1G of disk spread across two disks than it is for a bad block to appear inside 1G of disk on one disk.) Swap devices only contain volatile data anyway. I wouldn't mind losing the contents of my swap device. The machine will probably crash. It's the same as if the machine went down through a power outage. Not a big problem. Assuming only the swap device failed, I could just re-boot and run with a bit less swap space. If the drive fails, I lose the contents of any filesystems on the same drive. Much more significant. The fact that the machine went down because the swap device failed pales into insignificance, because now all the data has disappeared. No-one can do any work until we have replaces disk(s), sorted out the filesystems, restored from backups etc. If the swap had been configured on a different disk, we would have the marginal benefit of the machine probably not crashing, but the filesystems on the failed disk would still have disappeared, and we would still have the same problem. So I spread my swap over all the fast disks, by putting them directly on to disk paritions and setting the same priority value. Regards, Bill -- William H. Blunn - bill@tao-group.com - Developer Support Tao 62/63 Suttons Business Park, Earley, READING, RG6 1AZ, United Kingdom Tel: +44 118 901 2999 - Fax: +44 118 901 2963 - http://tao-group.com/ ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [linux-lvm] lvm and 'poor mans raid' on heterogenous hard drives! 2002-02-21 3:19 ` William Blunn @ 2002-02-21 10:15 ` Rupa Schomaker 0 siblings, 0 replies; 13+ messages in thread From: Rupa Schomaker @ 2002-02-21 10:15 UTC (permalink / raw) To: linux-lvm -----BEGIN PGP SIGNED MESSAGE----- "William Blunn" <bill@tao-group.com> writes: > Swap devices only contain volatile data anyway. > I wouldn't mind losing the contents of my swap device. The machine will > probably crash. It's the same as if the machine went down through a > power outage. Not a big problem. Assuming only the swap device failed, I > could just re-boot and run with a bit less swap space. <nod> But we try to minimize the posibility of failure. Thats why many of us have a UPS hooked up. If there is a power failure we can shutdown the system cleanly on our own terms and not the power companies. > If the drive fails, I lose the contents of any filesystems on the same > drive. Much more significant. The fact that the machine went down > because the swap device failed pales into insignificance, because now > all the data has disappeared. No-one can do any work until we have > replaces disk(s), sorted out the filesystems, restored from backups etc. Unless it is mirrored somehow... - -- - -rupa -----BEGIN PGP SIGNATURE----- Version: 2.6.3ia Charset: noconv Comment: Processed by Mailcrypt 3.5.6, an Emacs/PGP interface iQEVAwUBPHUdBnHDM4ucEopdAQGzPAf+InTVnZvUXgsMKMFxZqf8WUiFlqBwInY3 96MKgZtjtB2EvnChkVe9uUMksUGeMjarrAO9e1TMpnGzU2wjEcZySID8i+vErEYB ypG7vHT0VHLzZi+NsRlT1X7HKwLizU74TkDGE8/5H5HQN04HId9OgKeRDbi6XyLV Ms5TCfMET3q3lbT3LaYnOGjXZkOfrFsRt3z36CWaDfhOxyauZTYi3ThaCk2vs6jm PPU6PELmboJTIp7vmhv9VKSqwMMBYpgCDp20mmVZEaoRpz6ymWc0SCyyWTCrujQh RaXtolG9u8Aqj0aQvPgtKjpJKbCMspZM8Wtr55KGKmnqF+AVHkl3Tg== =6+ot -----END PGP SIGNATURE----- ^ permalink raw reply [flat|nested] 13+ messages in thread
end of thread, other threads:[~2002-02-21 10:15 UTC | newest] Thread overview: 13+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2002-02-19 13:54 [linux-lvm] *** ANNOUNCEMENT *** LVM 1.0.3 available at www.sistina.com Heinz J . Mauelshagen 2002-02-19 14:15 ` tim 2002-02-19 18:11 ` Heinz J . Mauelshagen 2002-02-19 20:54 ` [linux-lvm] lvm and 'poor mans raid' on heterogenous hard drives! Steve Wray 2002-02-19 23:20 ` Andreas Dilger 2002-02-19 23:47 ` Steve Wray 2002-02-20 11:32 ` Andreas Dilger 2002-02-20 16:02 ` Steve Wray 2002-02-20 18:18 ` [linux-lvm] striping volumes Steve Wray 2002-02-20 18:41 ` [linux-lvm] lvm and 'poor mans raid' on heterogenous hard drives! Rupa Schomaker 2002-02-20 20:59 ` Andreas Dilger 2002-02-21 3:19 ` William Blunn 2002-02-21 10:15 ` Rupa Schomaker
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.