From mboxrd@z Thu Jan 1 00:00:00 1970 From: Loic Dachary Subject: Re: [ceph-users] OSD auto-mount after server reboot Date: Tue, 07 Apr 2015 21:20:14 +0200 Message-ID: <55242DEE.5030907@dachary.org> References: <5521614D.8090600@dachary.org> <5522D9FD.3000502@dachary.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="0k4f3FsNpiUoH96r7MspH0x93X0tifUsq" Return-path: Received: from mail2.dachary.org ([91.121.57.175]:42920 "EHLO smtp.dmail.dachary.org" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1751484AbbDGTUY (ORCPT ); Tue, 7 Apr 2015 15:20:24 -0400 In-Reply-To: Sender: ceph-devel-owner@vger.kernel.org List-ID: To: shiva rkreddy Cc: Ceph Development This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --0k4f3FsNpiUoH96r7MspH0x93X0tifUsq Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable [cc'ing ceph-devel for archival purposes] Hi, On 07/04/2015 19:55, shiva rkreddy wrote: > Hi Loic, > I've looked at the way our cluster provisioning partition and label the= journal device. Its done using /*parted*/ command with "gpt" label. Fol= lowing is the parted output for /dev/sdr that we were looking yesterday. >=20 > # parted /dev/sdr > GNU Parted 2.1 > Using /dev/sdr > Welcome to GNU Parted! Type 'help' to view a list of commands. > (parted) p = =20 > Model: ASR7160 JBOD-R (scsi) > Disk /dev/sdr: 960GB > Sector size (logical/physical): 512B/512B > Partition Table: *gpt* >=20 > Number Start End Size File system Name Flags > 1 9599MB 240GB 230GB primary > 2 250GB 480GB 230GB primary > 3 490GB 720GB 230GB primary > 4 730GB 960GB 230GB primary >=20 > (parted) =20 >=20 > *# sgdisk --info 1 /dev/sdr* > Partition GUID code: 45B0969E-9B03-4F30-B4C6-B4B80CEFF106 (Microsoft ba= sic data) > Partition unique GUID: 0A45987B-DC77-4816-B506-DEE0DC60AE9E > First sector: 18747392 (at 8.9 GiB) > Last sector: 468707327 (at 223.5 GiB) > Partition size: 449959936 sectors (214.6 GiB) > Attribute flags: 0000000000000000 > Partition name: 'primary' >=20 >=20 > We stared to put label on the disk based on a blog at http://blog.zhaw.= ch/icclab/deploy-ceph-and-start-using-it-end-to-end-tutorial-installation= -part-13/ >=20 > I'm not sure why sgdisk is getting "Microsoft basics data". It's not a big deal as long as it's what ceph-disk expects: https://github.com/ceph/ceph/blob/firefly/src/ceph-disk#L76 The more interesting question would be to figure out if ceph-disk-udev is= called from https://github.com/ceph/ceph/blob/firefly/udev/95-ceph-osd-alt.rules We have tried udevadm trigger --sysname-match=3Dsd* yesterday and verifie= d it is called when a udev event is sent by the kernel. And you have adde= d that to /etc/rc.local to make sure it is called at least once at boot t= ime. Would you have time to experiment as described at https://wiki.ubunt= u.com/DebuggingUdev to get more information about what happens during the= boot phase of your machine ? Cheers > =20 > Thanks, > Shiva >=20 > On Mon, Apr 6, 2015 at 2:29 PM, shiva rkreddy > wrote: >=20 > Hi, >=20 > I'm on IRC as *shivark* >=20 > # sgdisk --info 1 /dev/sdb > Partition GUID code: 4FBD7E29-9D25-41B8-AFD0-062C0CEFF05D (Unknown)= > Partition unique GUID: 1618223E-B8C9-4C4A-B5D2-EBFF6D64CB12 > First sector: 2048 (at 1024.0 KiB) > Last sector: 7811870686 (at 3.6 TiB) > Partition size: 7811868639 sectors (3.6 TiB) > Attribute flags: 0000000000000000 > Partition name: 'ceph data' > # >=20 >=20 > On Mon, Apr 6, 2015 at 2:09 PM, Loic Dachary > wrote: >=20 > Hi, >=20 > lrwxrwxrwx 1 root root 10 Apr 4 16:27 1618223e-b8c9-4c4a-b5d2-= ebff6d64cb12 -> ../../sdb1 >=20 > looks encouraging. Could you >=20 > sudo sgdisk --info 1 /dev/sdb >=20 > to check that it matches ? If you're on IRC feel free to ping m= e (CEST France/Paris time) and we can have a debug session. >=20 > Cheers >=20 > On 06/04/2015 02:47, shiva rkreddy wrote: > > We have currently two osds configured on this system running= RHEL6.5, sharing a ssd drive as journal devices. > > > > udevadm trigger --sysname-match=3Dsdb or udevadm trigger --sy= sname-match=3D/dev/sdb, return without any output. Same thing happens on = ceph 0.80.7 where mount and services are started automatically. > > > > Output paste from ceph 0.80.9 is : http://pastebin.com/1Yqnta= di > > > > > > On Sun, Apr 5, 2015 at 11:22 AM, Loic Dachary >> wrote: > > > > > > > > On 04/04/2015 22:09, shiva rkreddy wrote: > > > HI, > > > I'm currently testing Firefly 0.80.9 and noticed that O= SD are not auto-mounted after server reboot. > > > It used to mount auto with Firefly 0.80.7. OS is RHEL = 6.5. > > > > > > There was another thread earlier on this topic with v0.= 80.8, suggestion was to add mount points to /etc/fstab. > > > > > > Question is whether the 0.80.7 behaviour could return o= r its needs to be done via /etc/fstab or something else? > > > > It should work without adding lines in /etc/fstab. Could = you give more details about your setup ? Could you try > > > > udevadm trigger --sysname-match=3Dsdb > > > > if an osd is managing /dev/sdb. Does that mount the osd ?= It would also be useful to have the output of ls -l /dev/disk/by-partuui= d > > > > Cheers > > > > -- > > Lo=C3=AFc Dachary, Artisan Logiciel Libre > > > > >=20 > -- > Lo=C3=AFc Dachary, Artisan Logiciel Libre >=20 >=20 >=20 --=20 Lo=C3=AFc Dachary, Artisan Logiciel Libre --0k4f3FsNpiUoH96r7MspH0x93X0tifUsq Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (GNU/Linux) iEYEARECAAYFAlUkLe4ACgkQ8dLMyEl6F22PlwCgot6OZCswZerTLPXTAoEdH5Wt svoAnRQwjvmOlpyBJrtTcpvqgES1o2c7 =RzQq -----END PGP SIGNATURE----- --0k4f3FsNpiUoH96r7MspH0x93X0tifUsq--