Initial Setup - Chef hangs at "in New OSD"

Initial Setup - Chef hangs at "in New OSD"

[Tilman Beitter]

[-- Attachment #1: Type: text/plain, Size: 1619 bytes --]

Hi all,

I am trying to do a test-setup with SUSE Cloud and Ceph. Ceph get's
installed via chef-client on the nodes. As I do not have enough disks in
my test environment I created two partitions for ceph. So, ceph uses
/dev/sda3 and /dev/sda4.

While installing it stops here:

[Mon, 24 Sep 2012 08:01:52 +0000] INFO: execute[Adding the secret
AQCp3FxQ+OWiBhAApsrBRhRBZcn2qhSHjQcM8A== for client.admin into
/etc/ceph/client.admin.keyring] ran successfully
[Mon, 24 Sep 2012 08:01:52 +0000] INFO: Processing execute[make xfs
filesystem on /dev/sda3] action run (ceph::osd line 36)
[Mon, 24 Sep 2012 08:01:52 +0000] INFO: Processing
directory[/var/lib/ceph/osd/ceph-2] action create (ceph::osd line 46)
[Mon, 24 Sep 2012 08:01:52 +0000] INFO: Processing
mount[/var/lib/ceph/osd/ceph-2] action enable (ceph::osd line 54)
[Mon, 24 Sep 2012 08:01:52 +0000] INFO: Processing
mount[/var/lib/ceph/osd/ceph-2] action mount (ceph::osd line 54)
[Mon, 24 Sep 2012 08:01:52 +0000] INFO: Processing ceph_osd[Initializing
new osd on /dev/sda3 ] action initialize (ceph::osd line 62)
[Mon, 24 Sep 2012 08:01:52 +0000] INFO: in New OSD

Mounts:

/dev/sda3 on /var/lib/ceph/osd/ceph-2 type xfs (rw,noatime)

Processes:

 3319 ?        Ssl    0:02 /usr/bin/ceph-mon -i d00-14-5e-6d-08-a4-ceph
--pid-file /var/run/ceph/mon.d00-14-5e-6d-08-a4-ceph.pid -c
/etc/ceph/ceph.conf
18521 ?        S      0:00 sh -c ceph osd tree | grep -q osd.2
18522 ?        Sl     0:01 ceph osd tree


Are there problems with the use of partitions or do I have another
problem / misconfig?

Thanks in advance

Til



[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 259 bytes --]

Re: Initial Setup - Chef hangs at "in New OSD"

[Gregory Farnum]

Hmmm...this is probably an issue with SUSECloud setup rather than Ceph
itself (and we don't know how SUSECloud works). But it looks like it's
hanging while running "ceph osd tree", which means it's likely a
problem somewhere in connecting or getting an answer from the
monitors.
1) See if you have all your monitors running.
2) See if you can run "ceph -s -k <path/to/admin/keyring>" on one of
your monitors and get a response.
3) See if you can run "ceph -s <path/to/ndoe/keyring>" on the host
that is stuck.
4) See what's output from "ceph osd tree" on the monitor node.

On Mon, Sep 24, 2012 at 3:15 AM, Tilman Beitter <beitter@b1-systems.de> wrote:
> Hi all,
>
> I am trying to do a test-setup with SUSE Cloud and Ceph. Ceph get's
> installed via chef-client on the nodes. As I do not have enough disks in
> my test environment I created two partitions for ceph. So, ceph uses
> /dev/sda3 and /dev/sda4.
>
> While installing it stops here:
>
> [Mon, 24 Sep 2012 08:01:52 +0000] INFO: execute[Adding the secret
> AQCp3FxQ+OWiBhAApsrBRhRBZcn2qhSHjQcM8A== for client.admin into
> /etc/ceph/client.admin.keyring] ran successfully
> [Mon, 24 Sep 2012 08:01:52 +0000] INFO: Processing execute[make xfs
> filesystem on /dev/sda3] action run (ceph::osd line 36)
> [Mon, 24 Sep 2012 08:01:52 +0000] INFO: Processing
> directory[/var/lib/ceph/osd/ceph-2] action create (ceph::osd line 46)
> [Mon, 24 Sep 2012 08:01:52 +0000] INFO: Processing
> mount[/var/lib/ceph/osd/ceph-2] action enable (ceph::osd line 54)
> [Mon, 24 Sep 2012 08:01:52 +0000] INFO: Processing
> mount[/var/lib/ceph/osd/ceph-2] action mount (ceph::osd line 54)
> [Mon, 24 Sep 2012 08:01:52 +0000] INFO: Processing ceph_osd[Initializing
> new osd on /dev/sda3 ] action initialize (ceph::osd line 62)
> [Mon, 24 Sep 2012 08:01:52 +0000] INFO: in New OSD
>
> Mounts:
>
> /dev/sda3 on /var/lib/ceph/osd/ceph-2 type xfs (rw,noatime)
>
> Processes:
>
>  3319 ?        Ssl    0:02 /usr/bin/ceph-mon -i d00-14-5e-6d-08-a4-ceph
> --pid-file /var/run/ceph/mon.d00-14-5e-6d-08-a4-ceph.pid -c
> /etc/ceph/ceph.conf
> 18521 ?        S      0:00 sh -c ceph osd tree | grep -q osd.2
> 18522 ?        Sl     0:01 ceph osd tree
>
>
> Are there problems with the use of partitions or do I have another
> problem / misconfig?
>
> Thanks in advance
>
> Til
>
>

Re: Initial Setup - Chef hangs at "in New OSD"

[Tilman Beitter]

[-- Attachment #1: Type: text/plain, Size: 737 bytes --]

On 09/24/2012 06:52 PM, Gregory Farnum wrote:
> Hmmm...this is probably an issue with SUSECloud setup rather than Ceph
> itself (and we don't know how SUSECloud works). But it looks like it's
> hanging while running "ceph osd tree", which means it's likely a
> problem somewhere in connecting or getting an answer from the
> monitors.
> 1) See if you have all your monitors running.
> 2) See if you can run "ceph -s -k <path/to/admin/keyring>" on one of
> your monitors and get a response.
> 3) See if you can run "ceph -s <path/to/ndoe/keyring>" on the host
> that is stuck.
> 4) See what's output from "ceph osd tree" on the monitor node.

thanks for the tips. I will check this with my next test setup.

greets
Til


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 259 bytes --]