Re: [ceph-users] OSD auto-mount after server reboot

[Loic Dachary <loic@dachary.org>]

[-- Attachment #1: Type: text/plain, Size: 8499 bytes --]



On 08/04/2015 02:16, shiva rkreddy wrote:
> We didn't do a upgrade from 0.80.7 to 0.80.9. It was a fresh install with ceph 0.80.9 with ceph-deploy version 1.15.12.
> 
> May be  should have used ceph-deploy version 1.15.16  https://github.com/ceph/ceph-deploy/pull/240/files

Ok, mystery solved then, right ?
> 
> 
> On Tue, Apr 7, 2015 at 4:31 PM, Loic Dachary <loic@dachary.org <mailto:loic@dachary.org>> wrote:
> 
> 
> 
>     On 07/04/2015 23:03, shiva rkreddy wrote:
>     > It turns out that ceph service is set ceph to off. Following defect talks about it..Once its set to on, everything worked fine after host reboot.
>     >
>     > http://tracker.ceph.com/issues/9090
> 
>     Interesting :-) Does that mean that the ceph service was somehow turned off when upgrading from v0.80.7 to v0.80.9 ?
> 
>     >
>     > On Tue, Apr 7, 2015 at 2:20 PM, Loic Dachary <loic@dachary.org <mailto:loic@dachary.org> <mailto:loic@dachary.org <mailto:loic@dachary.org>>> wrote:
>     >
>     >     [cc'ing ceph-devel for archival purposes]
>     >
>     >     Hi,
>     >
>     >     On 07/04/2015 19:55, shiva rkreddy wrote:
>     >     > Hi Loic,
>     >     > I've looked at the way our cluster provisioning partition and label the journal device. Its done using /*parted*/ command with "gpt" label.  Following is the parted output for /dev/sdr that we were looking yesterday.
>     >     >
>     >     > # parted /dev/sdr
>     >     > GNU Parted 2.1
>     >     > Using /dev/sdr
>     >     > Welcome to GNU Parted! Type 'help' to view a list of commands.
>     >     > (parted) p
>     >     > Model: ASR7160 JBOD-R (scsi)
>     >     > Disk /dev/sdr: 960GB
>     >     > Sector size (logical/physical): 512B/512B
>     >     > Partition Table: *gpt*
>     >     >
>     >     > Number  Start   End    Size   File system  Name     Flags
>     >     >  1      9599MB  240GB  230GB               primary
>     >     >  2      250GB   480GB  230GB               primary
>     >     >  3      490GB   720GB  230GB               primary
>     >     >  4      730GB   960GB  230GB               primary
>     >     >
>     >     > (parted)
>     >     >
>     >     > *# sgdisk --info 1 /dev/sdr*
>     >     > Partition GUID code: 45B0969E-9B03-4F30-B4C6-B4B80CEFF106 (Microsoft basic data)
>     >     > Partition unique GUID: 0A45987B-DC77-4816-B506-DEE0DC60AE9E
>     >     > First sector: 18747392 (at 8.9 GiB)
>     >     > Last sector: 468707327 (at 223.5 GiB)
>     >     > Partition size: 449959936 sectors (214.6 GiB)
>     >     > Attribute flags: 0000000000000000
>     >     > Partition name: 'primary'
>     >     >
>     >     >
>     >     > We stared to put label on the disk based on a blog at http://blog.zhaw.ch/icclab/deploy-ceph-and-start-using-it-end-to-end-tutorial-installation-part-13/
>     >     >
>     >     > I'm not sure why sgdisk is getting  "Microsoft basics data".
>     >
>     >     It's not a big deal as long as it's what ceph-disk expects:
>     >
>     >     https://github.com/ceph/ceph/blob/firefly/src/ceph-disk#L76
>     >
>     >     The more interesting question would be to figure out if ceph-disk-udev is called from
>     >
>     >     https://github.com/ceph/ceph/blob/firefly/udev/95-ceph-osd-alt.rules
>     >
>     >     We have tried udevadm trigger --sysname-match=sd* yesterday and verified it is called when a udev event is sent by the kernel. And you have added that to /etc/rc.local to make sure it is called at least once at boot time. Would you have time to experiment as described at https://wiki.ubuntu.com/DebuggingUdev to get more information about what happens during the boot phase of your machine ?
>     >
>     >     Cheers
>     >
>     >     >
>     >     > Thanks,
>     >     > Shiva
>     >     >
>     >     > On Mon, Apr 6, 2015 at 2:29 PM, shiva rkreddy <shiva.rkreddy@gmail.com <mailto:shiva.rkreddy@gmail.com> <mailto:shiva.rkreddy@gmail.com <mailto:shiva.rkreddy@gmail.com>> <mailto:shiva.rkreddy@gmail.com <mailto:shiva.rkreddy@gmail.com> <mailto:shiva.rkreddy@gmail.com <mailto:shiva.rkreddy@gmail.com>>>> wrote:
>     >     >
>     >     >     Hi,
>     >     >
>     >     >     I'm on IRC as *shivark*
>     >     >
>     >     >     # sgdisk --info 1 /dev/sdb
>     >     >     Partition GUID code: 4FBD7E29-9D25-41B8-AFD0-062C0CEFF05D (Unknown)
>     >     >     Partition unique GUID: 1618223E-B8C9-4C4A-B5D2-EBFF6D64CB12
>     >     >     First sector: 2048 (at 1024.0 KiB)
>     >     >     Last sector: 7811870686 (at 3.6 TiB)
>     >     >     Partition size: 7811868639 sectors (3.6 TiB)
>     >     >     Attribute flags: 0000000000000000
>     >     >     Partition name: 'ceph data'
>     >     >     #
>     >     >
>     >     >
>     >     >     On Mon, Apr 6, 2015 at 2:09 PM, Loic Dachary <loic@dachary.org <mailto:loic@dachary.org> <mailto:loic@dachary.org <mailto:loic@dachary.org>> <mailto:loic@dachary.org <mailto:loic@dachary.org> <mailto:loic@dachary.org <mailto:loic@dachary.org>>>> wrote:
>     >     >
>     >     >         Hi,
>     >     >
>     >     >         lrwxrwxrwx 1 root root 10 Apr  4 16:27 1618223e-b8c9-4c4a-b5d2-ebff6d64cb12 -> ../../sdb1
>     >     >
>     >     >         looks encouraging. Could you
>     >     >
>     >     >         sudo sgdisk --info 1 /dev/sdb
>     >     >
>     >     >         to check that it matches ? If you're on IRC feel free to ping me (CEST France/Paris time) and we can have a debug session.
>     >     >
>     >     >         Cheers
>     >     >
>     >     >         On 06/04/2015 02:47, shiva rkreddy wrote:
>     >     >         > We have currently two  osds configured on this system running  RHEL6.5, sharing a ssd drive as journal devices.
>     >     >         >
>     >     >         > udevadm trigger --sysname-match=sdb or udevadm trigger --sysname-match=/dev/sdb, return without any output. Same thing happens on ceph 0.80.7 where mount and services are started automatically.
>     >     >         >
>     >     >         > Output paste from ceph 0.80.9 is : http://pastebin.com/1Yqntadi
>     >     >         >
>     >     >         >
>     >     >         > On Sun, Apr 5, 2015 at 11:22 AM, Loic Dachary <loic@dachary.org <mailto:loic@dachary.org> <mailto:loic@dachary.org <mailto:loic@dachary.org>> <mailto:loic@dachary.org <mailto:loic@dachary.org> <mailto:loic@dachary.org <mailto:loic@dachary.org>>> <mailto:loic@dachary.org <mailto:loic@dachary.org> <mailto:loic@dachary.org <mailto:loic@dachary.org>> <mailto:loic@dachary.org <mailto:loic@dachary.org> <mailto:loic@dachary.org <mailto:loic@dachary.org>>>>> wrote:
>     >     >         >
>     >     >         >
>     >     >         >
>     >     >         >     On 04/04/2015 22:09, shiva rkreddy wrote:
>     >     >         >     > HI,
>     >     >         >     > I'm currently testing Firefly 0.80.9 and noticed that OSD are not auto-mounted after server reboot.
>     >     >         >     > It used to mount auto with Firefly 0.80.7.  OS is RHEL 6.5.
>     >     >         >     >
>     >     >         >     > There was another thread earlier on this topic with v0.80.8, suggestion was to add mount points to /etc/fstab.
>     >     >         >     >
>     >     >         >     > Question is whether the 0.80.7 behaviour could return or its needs to be done via /etc/fstab or something else?
>     >     >         >
>     >     >         >     It should work without adding lines in /etc/fstab. Could you give more details about your setup ? Could you try
>     >     >         >
>     >     >         >     udevadm trigger --sysname-match=sdb
>     >     >         >
>     >     >         >     if an osd is managing /dev/sdb. Does that mount the osd ? It would also be useful to have the output of ls -l /dev/disk/by-partuuid
>     >     >         >
>     >     >         >     Cheers
>     >     >         >
>     >     >         >     --
>     >     >         >     Loïc Dachary, Artisan Logiciel Libre
>     >     >         >
>     >     >         >
>     >     >
>     >     >         --
>     >     >         Loïc Dachary, Artisan Logiciel Libre
>     >     >
>     >     >
>     >     >
>     >
>     >     --
>     >     Loïc Dachary, Artisan Logiciel Libre
>     >
>     >
> 
>     --
>     Loïc Dachary, Artisan Logiciel Libre
> 
> 

-- 
Loïc Dachary, Artisan Logiciel Libre


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 198 bytes --]