From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mx1.redhat.com (mx1.redhat.com [172.16.48.31]) by int-mx1.corp.redhat.com (8.13.1/8.13.1) with ESMTP id l05CSDAP020208 for ; Fri, 5 Jan 2007 07:28:13 -0500 Received: from mx2.post.ch (mx2.post.ch [194.41.216.135]) by mx1.redhat.com (8.12.11.20060308/8.12.11) with ESMTP id l05CSBaH003218 for ; Fri, 5 Jan 2007 07:28:12 -0500 Message-ID: <6460949.1168000082119.JavaMail.mailer@post.ch> Mime-Version: 1.0 Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha1; boundary="----=_Part_103381_8132946.1168000082118" Content-class: urn:content-classes:message Subject: RE: [linux-lvm] Mirror between different SAN fabrics Date: Fri, 5 Jan 2007 13:27:56 +0100 In-Reply-To: <859a78260612281524u56385ab6x71a29e45edf4dfbe@mail.gmail.com> From: Reply-To: LVM general discussion and development List-Id: LVM general discussion and development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , List-Id: To: linux-lvm@redhat.com ------=_Part_103381_8132946.1168000082118 Content-Type: text/plain; charset="iso-8859-1" Content-class: urn:content-classes:message Content-Transfer-Encoding: quoted-printable Hey I use the same configuration as Ty and it seems that the lvm2 cluster version doesn't like the stacked approach. When I'm creating the LV in the last step, a locking error occurs: --------------- #> lvcreate -m 1 -n MirrorLV -L 500M MirrorVG --corelog Logging initialised at Wed Dec 6 10:57:20 2006 Set umask to 0077 Loaded external locking library liblvm2clusterlock.so Finding volume group "MirrorVG" Archiving volume group "MirrorVG" metadata (seqno 1). Creating logical volume MirrorLV Creating logical volume MirrorLV_mimage_0 Creating logical volume MirrorLV_mimage_1 Creating volume group backup "/etc/lvm/backup/MirrorVG" (seqno 2). Error locking on node xxx: Internal lvm error, check syslog Error locking on node xxx: Internal lvm error, check syslog Failed to activate new LV. Wiping internal VG cache=20 --------------- Syslog says: lvm[3640]: Volume group for uuid not found: xxx I can see the LV but since the state is NOT available I cannot access it #> sudo vgdisplay -v MirrorVG [...] LV Name /dev/MirrorVG/Mirror1LV LV Status NOT available [...] Mathias > -----Original Message----- > From: linux-lvm-bounces@redhat.com=20 > [mailto:linux-lvm-bounces@redhat.com] On Behalf Of Matt P > Sent: Freitag, 29 Dezember, 2006 00:25 > To: LVM general discussion and development > Subject: Re: [linux-lvm] Mirror between different SAN fabrics >=20 > That's exactly the steps I used to test it out. The failure I=20 > encountered was at the point of adding the StripeLVs to the=20 > MirrorVG. I don't recall the error I got but I seem to recall=20 > it being the same error as if the PV hadn't been pvcreated.=20 > Although when I went through the process again just now,=20 > without any errors... It's quite likely I mistyped or skipped=20 > a step during my first attempt...=20 >=20 > I've gone through the whole process 4 times now from raw disk=20 > to a mirrored LV without getting the error again. >=20 > It looks as though this could work and isn't nearly as crazy=20 > as my initial configuration. I wonder now if anything wonky=20 > will happen if we were to lose a disk or in the original post=20 > if we lost one of the fabrics...=20 >=20 >=20 > On 12/28/06, Ty! Boyack wrote: >=20 > =09Actually, I'm quite surprised that this approach=20 > mangles the lvm data. > =09It seems that when you do a pvcreate on a block device,=20 > LVM should (and > =09I think, does) write the lvm metadata in a region of=20 > that device, and=20 > =09then never let anything touch that metadata. This way,=20 > if you do a 'dd > =09if=3D/dev/zeros of=3D' it blanks out the device,=20 > but the metadata > =09is intact. > =09 > =09So, if you do a 'pvcreate' on an LV, it should contain=20 > a second copy of=20 > =09the metadata, unique and independent from the first=20 > copy on the original > =09block device. My tests on this has worked fine=20 > (although my tests have > =09been for building two VGs that have striped volumes=20 > across the member=20 > =09disks, and then a VG that creates a mirrored LV of the=20 > striped volumes, > =09so no multipathing is involved). I'm wondering if we=20 > can compare notes > =09to see if I'm doing something that makes it look like=20 > it's working -- I=20 > =09don't want to be quietly destroying my lvm data and not=20 > knowing it!!! > =09 > =09I'm doing (roughly, block devices are a bit made-up): > =09 > =09# prepare the physical volumes > =09pvcreate /dev/sda > =09pvcreate /dev/sdb=20 > =09pvcreate /dev/sdc > =09pvcreate /dev/sdd > =09pvcreate /dev/sde > =09 > =09# Create volume groups to contain uniquely striped volumes > =09vgcreate Stripe1VG /dev/sda /dev/sdb > =09vgcreate Stripe2VG /dev/sdc /dev/sdd > =09 > =09# Create the striped volumes=20 > =09lvcreate -i 2 -n Stripe1LV -L 1G Stripe1VG > =09lvcreate -i 2 -n Stripe2LV -L 1G Stripe2VG > =09 > =09# Make the striped volumes into PVs > =09pvcreate /dev/Stripe1VG/Stripe1LV > =09pvcreate /dev/Stripe2VG/Stripe2LV > =09 > =09# Create the volume group for mirrored volumes=20 > =09vgcreate MirrorVG /dev/Stripe1VG/Stripe1LV=20 > /dev/Stripe2VG/Stripe2LV /dev/sde > =09# (Had to use three PVs to have the mirror log in place) > =09 > =09# Create the mirrored volume > =09lvcreate -m 1 -n Mirror1LV -L 500M MirrorVG=20 > =09 > =09# Filesystem, test, etc. this will be GFS eventually,=20 > but testing with > =09ext3 for now. > =09mke2fs -j -i16384 -v /dev/MirrorVG/Mirror1LV > =09mkdir /mnt/mirror1lv > =09mount /dev/MirrorVG/Mirror1LV /mnt/mirror1 > =09 > =09 > =09 > =09Is that about your procedure as well? When does the=20 > lvm data get mangled? > =09 > =09(Sorry if this is going off topic - but if this is=20 > solvable it might > =09actually answer the original question...) > =09 > =09-Ty! > =09 > =09 > =09 > =09 > =09Matt P wrote: > =09> This is basically the "messy" way I mentioned in my=20 > reply above. I > =09> found if you pvcreate the LV device, you end up=20 > mangling the lvm data > =09> (this probably comes as little surprise) and it=20 > breaks down after=20 > =09> that. So, I ended up using losetup and an "image=20 > file", one for/on > =09> each fabric. Then did pvcreate on each loop device,=20 > and made a new VG > =09> containing both PVs and created the LV with mirroring.... It=20 > =09> worked.... I did no performance, stability, or=20 > failure testing... > =09 > =09 > =09-- > =09-=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D- > =09 Ty! Boyack > =09 NREL Unix Network Manager > =09 ty@nrel.colostate.edu=20 > =09 (970) 491-1186 > =09-=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D- > =09 > =09_______________________________________________ > =09linux-lvm mailing list > =09linux-lvm@redhat.com > =09https://www.redhat.com/mailman/listinfo/linux-lvm=20 > =20 > =09read the LVM HOW-TO at http://tldp.org/HOWTO/LVM-HOWTO/ > =09 >=20 >=20 >=20 Sicherheitshinweis: Dieses E-Mail von PostFinance ist signiert. Weitere Informationen finden Si= e unter:=20 https://www.postfinance.ch/e-signature. Geben Sie Ihre Sicherheitselemente niemals Dritten bekannt. ------=_Part_103381_8132946.1168000082118 Content-Type: application/pkcs7-signature; name=smime.p7s; smime-type=signed-data Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIINszCCA6cw ggMQoAMCAQICEG+vuGdzb316NcV1yvWubhowDQYJKoZIhvcNAQEFBQAwbjEpMCcGA1UEChMgRGV1 dHNjaGVyIFNwYXJrYXNzZW4gVmVybGFnIEdtYkgxHzAdBgNVBAsTFlZlcmlTaWduIFRydXN0IE5l dHdvcmsxIDAeBgNVBAMTF1MtVHJ1c3QsIERFLCBDbGFzcyAyIENBMB4XDTA1MTEyMjAwMDAwMFoX DTE1MTEyMTIzNTk1OVowggEFMQswCQYDVQQGEwJDSDENMAsGA1UECBMEQmVybjENMAsGA1UEBxME QmVybjEgMB4GA1UEChMXRGllIFNjaHdlaXplcmlzY2hlIFBvc3QxHzAdBgNVBAsTFlZlcmlTaWdu IFRydXN0IE5ldHdvcmsxOTA3BgNVBAsTMFRlcm1zIG9mIHVzZSBhdCBodHRwczovL3d3dy5zLXRy dXN0LmRlL3JwYSAoYykwNTEwMC4GA1UECxMnQ2xhc3MgMiBPblNpdGUgSW5kaXZpZHVhbCBTdWJz Y3JpYmVyIENBMSgwJgYDVQQDEx9EaWUgU2Nod2VpemVyaXNjaGUgUG9zdCBNYWlsIENBMIGfMA0G CSqGSIb3DQEBAQUAA4GNADCBiQKBgQDsULs5KMIpCW4QrE3xKMO0FKxooh6XbkEL8QqW/rWLKoqc NyAQxdWpYB6RjWupKklPPrkMJNT5IwgbfeF9InLAGTUHX5ZMuynsvfIxB739ArYWErbDvEoP7+oe P1AxLd63YgGz6W6hS46Rg1pmXwJ1ISdhABSifM4jmIDkLq75awIDAQABo4GsMIGpMBIGA1UdEwEB /wQIMAYBAf8CAQAwQgYDVR0gBDswOTA3BgtghkgBhvhFAQcXAjAoMCYGCCsGAQUFBwIBFhpodHRw czovL3d3dy5zLXRydXN0LmRlL3JwYTAOBgNVHQ8BAf8EBAMCAQYwIAYDVR0RBBkwF6QVMBMxETAP BgNVBAMTCEMxQzItMS01MB0GA1UdDgQWBBRIOwWhs7CcfqGatK/Ext+WyKs4KzANBgkqhkiG9w0B AQUFAAOBgQB2nxmJWiIUOlwTlhqQpCVNelrBMnMR5RA9DQJQpt9bfM2qpbLVo3n+wziO63iRjGAR LSlbQh2Q+nbeVwilQ7u4nh8+kwT2VcXElO61hNqU+6MTCWQob5rXu1LJjvcejD3OQwHEVmkr9bH9 rqo7E/NFYFNiF0tssg9rDgaDH4PjXDCCAwIwggJrAhAfQihfPIgPjjyJs4Szqx8cMA0GCSqGSIb3 DQEBBQUAMIHBMQswCQYDVQQGEwJVUzEXMBUGA1UEChMOVmVyaVNpZ24sIEluYy4xPDA6BgNVBAsT M0NsYXNzIDIgUHVibGljIFByaW1hcnkgQ2VydGlmaWNhdGlvbiBBdXRob3JpdHkgLSBHMjE6MDgG A1UECxMxKGMpIDE5OTggVmVyaVNpZ24sIEluYy4gLSBGb3IgYXV0aG9yaXplZCB1c2Ugb25seTEf MB0GA1UECxMWVmVyaVNpZ24gVHJ1c3QgTmV0d29yazAeFw05ODA1MTgwMDAwMDBaFw0xODA1MTgy MzU5NTlaMIHBMQswCQYDVQQGEwJVUzEXMBUGA1UEChMOVmVyaVNpZ24sIEluYy4xPDA6BgNVBAsT M0NsYXNzIDIgUHVibGljIFByaW1hcnkgQ2VydGlmaWNhdGlvbiBBdXRob3JpdHkgLSBHMjE6MDgG A1UECxMxKGMpIDE5OTggVmVyaVNpZ24sIEluYy4gLSBGb3IgYXV0aG9yaXplZCB1c2Ugb25seTEf MB0GA1UECxMWVmVyaVNpZ24gVHJ1c3QgTmV0d29yazCBnzANBgkqhkiG9w0BAQEFAAOBjQAwgYkC gYEAp4gBIXQs5xoD8JjhlzwPIQjxnNuX6Zr8wgQGE75fUsjMHiwSViy4AWkszJkfrbCWrnkE8hM5 wXuYuggs6MKEEyyqaekJ9MepAqRCwiNPStjwDqL7MWzJ5m+ZJwf15vRMeJ5t60aG+rmGyVTyssSv 1EYcWskVMP8NbPUtDm3Of3cCAwEAATANBgkqhkiG9w0BAQUFAAOBgQARRaikf/HjcyDKve7f9Ycj kT2NrEdFGt5t21Qhzg6DDvjc5UPV6y5hkSPicgA0VffEzxEz3cHkIiNcUFMZ+GTn9wkPRVGgVyvf vCJm/jFweyU6D8WKfsO7cgHM8L1NUoGkG1hYU9VTOvUOatrpr8ThWPNCb1RiR6wxlNENzu8dMTCC BCgwggORoAMCAQICEFOzgj3/z/gxFoM0KNJ2u24wDQYJKoZIhvcNAQEEBQAwggEFMQswCQYDVQQG EwJDSDENMAsGA1UECBMEQmVybjENMAsGA1UEBxMEQmVybjEgMB4GA1UEChMXRGllIFNjaHdlaXpl cmlzY2hlIFBvc3QxHzAdBgNVBAsTFlZlcmlTaWduIFRydXN0IE5ldHdvcmsxOTA3BgNVBAsTMFRl cm1zIG9mIHVzZSBhdCBodHRwczovL3d3dy5zLXRydXN0LmRlL3JwYSAoYykwNTEwMC4GA1UECxMn Q2xhc3MgMiBPblNpdGUgSW5kaXZpZHVhbCBTdWJzY3JpYmVyIENBMSgwJgYDVQQDEx9EaWUgU2No d2VpemVyaXNjaGUgUG9zdCBNYWlsIENBMB4XDTA2MDQwNDAwMDAwMFoXDTA3MDQwNDIzNTk1OVow gbgxIDAeBgNVBAoUF0RpZSBTY2h3ZWl6ZXJpc2NoZSBQb3N0MRowGAYDVQQLFBFNYWlsIENlcnRp ZmljYXRlczExMC8GA1UECxMoVGVybXMgb2YgdXNlIGF0IHd3dy5zLXRydXN0LmRlL3JwYSAoYykw MTEXMBUGA1UEAxMOTWF0aGlhcyBIZXJ6b2cxLDAqBgkqhkiG9w0BCQEWHW1hdGhpYXMuaGVyem9n QHBvc3RmaW5hbmNlLmNoMIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQCxwCsm0o4w2arhohH7 QuB/KfdOGgX2SYmlHMcwLCbh/MfmuQg78zdaaF4zE366h4p7tOuGhGNLGqJT8bOc1K86edvtQ2yN 6QsuFNfSsHFa152hlgzoALNyZRqhGdOrQzvcAuuodVGZCVQyYX3GLwzLXXE7qfmLplNPmjNDtKUg SwIDAQABo4HiMIHfMAkGA1UdEwQCMAAwQQYDVR0gBDowODA2BgpghkgBhvhFAQcnMCgwJgYIKwYB BQUHAgEWGmh0dHBzOi8vd3d3LnMtdHJ1c3QuZGUvcnBhMAsGA1UdDwQEAwIFoDARBglghkgBhvhC AQEEBAMCB4AwXAYDVR0fBFUwUzBRoE+gTYZLaHR0cDovL29uc2l0ZWNybC5zLXRydXN0LmRlL0Rp ZVNjaHdlaXplcmlzY2hlUG9zdE1haWxDZXJ0aWZpY2F0ZXMvTGF0ZXN0Q1JMMBEGCmCGSAGG+EUB BgkEAwEB/zANBgkqhkiG9w0BAQQFAAOBgQBCjd2C7oLyYc7paVjRl4AJuSH7n01VIgGNXCQ2mN4J B6Y5zYfqHB+zmhmqDun/fhcdfKwD4R15Q/tdSPpd6CLGzGff0A0nD18mBL1XlIc0XRLavNdFR5bc ZMP+VtSlYBUa+YBenF/thPECCdk5M/EAzazqdXIxvGjTdhgudCl/eDCCAtIwggI7oAMCAQICEEHl U7TbxXw+tOS7l1GkNQUwDQYJKoZIhvcNAQEFBQAwgcExCzAJBgNVBAYTAlVTMRcwFQYDVQQKEw5W ZXJpU2lnbiwgSW5jLjE8MDoGA1UECxMzQ2xhc3MgMiBQdWJsaWMgUHJpbWFyeSBDZXJ0aWZpY2F0 aW9uIEF1dGhvcml0eSAtIEcyMTowOAYDVQQLEzEoYykgMTk5OCBWZXJpU2lnbiwgSW5jLiAtIEZv ciBhdXRob3JpemVkIHVzZSBvbmx5MR8wHQYDVQQLExZWZXJpU2lnbiBUcnVzdCBOZXR3b3JrMB4X DTAxMDYxMjAwMDAwMFoXDTE2MDYxMTIzNTk1OVowbjEpMCcGA1UEChMgRGV1dHNjaGVyIFNwYXJr YXNzZW4gVmVybGFnIEdtYkgxHzAdBgNVBAsTFlZlcmlTaWduIFRydXN0IE5ldHdvcmsxIDAeBgNV BAMTF1MtVHJ1c3QsIERFLCBDbGFzcyAyIENBMIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQDn A5RxqZgSd7R6nw6D9qd1h2whdYj6biACg/BGyHqI+1FMLGMJh1En2nfzSBTqwJIdVa2+6YiMDQHz 8LbWCIYv3oABiLXBG8FG6rlY6nVwdkz0EXKyTtClaGDhVU36o77ApCmhNPnpmGbPZvsL9kRA1A7L Tvc0OW+iVWTAcaetKQIDAQABox0wGzAMBgNVHRMEBTADAQH/MAsGA1UdDwQEAwIBBjANBgkqhkiG 9w0BAQUFAAOBgQBAX0VqvODgoRR3ryXnpi2G5yO7KrANMHHl6GXT+WpeY7QEsmjyJWT4RUAhLc9u xMIqt5p4EmsgjrfRNdnPQt8tnWpGIR3ZpT/A7zOUs4j9H4W2n7gyow2Gzf3gF8vJkMGE+5kBOYFW 31uXgMsURqt2xMNVFJZ0n+fuc8kHKKlTRzGCA44wggOKAgEBMIIBGzCCAQUxCzAJBgNVBAYTAkNI MQ0wCwYDVQQIEwRCZXJuMQ0wCwYDVQQHEwRCZXJuMSAwHgYDVQQKExdEaWUgU2Nod2VpemVyaXNj aGUgUG9zdDEfMB0GA1UECxMWVmVyaVNpZ24gVHJ1c3QgTmV0d29yazE5MDcGA1UECxMwVGVybXMg b2YgdXNlIGF0IGh0dHBzOi8vd3d3LnMtdHJ1c3QuZGUvcnBhIChjKTA1MTAwLgYDVQQLEydDbGFz cyAyIE9uU2l0ZSBJbmRpdmlkdWFsIFN1YnNjcmliZXIgQ0ExKDAmBgNVBAMTH0RpZSBTY2h3ZWl6 ZXJpc2NoZSBQb3N0IE1haWwgQ0ECEFOzgj3/z/gxFoM0KNJ2u24wCQYFKw4DAhoFAKCCAccwGAYJ KoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMDcwMTA1MTIyODAyWjAjBgkq hkiG9w0BCQQxFgQUGLA/y+vpr0OnQFVOopiqPcJJMTMwNAYJKoZIhvcNAQkPMScwJTAKBggqhkiG 9w0DBzAOBggqhkiG9w0DAgICAIAwBwYFKw4DAgcwggEwBgsqhkiG9w0BCRACCzGCAR8wggEbMIIB BTELMAkGA1UEBhMCQ0gxDTALBgNVBAgTBEJlcm4xDTALBgNVBAcTBEJlcm4xIDAeBgNVBAoTF0Rp ZSBTY2h3ZWl6ZXJpc2NoZSBQb3N0MR8wHQYDVQQLExZWZXJpU2lnbiBUcnVzdCBOZXR3b3JrMTkw NwYDVQQLEzBUZXJtcyBvZiB1c2UgYXQgaHR0cHM6Ly93d3cucy10cnVzdC5kZS9ycGEgKGMpMDUx MDAuBgNVBAsTJ0NsYXNzIDIgT25TaXRlIEluZGl2aWR1YWwgU3Vic2NyaWJlciBDQTEoMCYGA1UE AxMfRGllIFNjaHdlaXplcmlzY2hlIFBvc3QgTWFpbCBDQQIQU7OCPf/P+DEWgzQo0na7bjANBgkq hkiG9w0BAQEFAASBgIIhVqZrD4/7Snk2q3UoFPLjrIBPvYgwWAXE2Or5Vq85/hcIp0o9S4Ti9Pe7 1XC45T0pj5PyV/VrcC4gt/Vi8Ux9aCidYpXUvEmEKafJ/hATGnusFyYr5+mX4em/hsU8jZnE5YT/ 6FHmM0r1TjOHp7UomrTmdzfm9ryPgWKWur1EAAAAAAAA ------=_Part_103381_8132946.1168000082118--