Help with CEPH deployment

Help with CEPH deployment

[Venkateswara Rao Jujjuri]

Started to install basic cluster from scratch, but running into keyring issues.
Basically /etc/ceph/ceph.client.admin.keyring is not getting generated
on monitor node.
When I tried to create it on the monitor node, it fails with:

$ ceph auth get-or-create client.admin mon 'allow *' mds 'allow *' osd
'allow *' -o /etc/ceph/ceph.client.admin.keyring
2015-05-02 12:32:59.198588 7f0e30395700 -1 monclient(hunting): ERROR:
missing keyring, cannot use cephx for authentication
2015-05-02 12:32:59.198592 7f0e30395700  0 librados: client.admin
initialization error (2) No such file or directory
Error connecting to cluster: ObjectNotFound


$ ceph --version
ceph version 0.94.1 (e4bfad3a3c51054df7e537a724c8d0bf9be972ff)


Following these insructions:

http://docs.ceph.com/docs/master/start/quick-ceph-deploy/

Failing at :

$ ceph-deploy  mon create-initial
because it could not find /etc/ceph/ceph.client.admin.keyring

Help appreciated.
-- 
Jvrao
---
First they ignore you, then they laugh at you, then they fight you,
then you win. - Mahatma Gandhi

Re: Help with CEPH deployment

[Venkateswara Rao Jujjuri]

Here is the output..I am still stuck at this step. :(
(multiple times tried to by purging and restarting from scratch)

vjujjuri@rgulistan-wsl10:~/ceph-cluster$ ceph-deploy mon create-initial
[ceph_deploy.conf][DEBUG ] found configuration file at:
/home/vjujjuri/.cephdeploy.conf
[ceph_deploy.cli][INFO  ] Invoked (1.5.23): /usr/bin/ceph-deploy mon
create-initial
[ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts rgulistan-wsl11
[ceph_deploy.mon][DEBUG ] detecting platform for host rgulistan-wsl11 ...
[rgulistan-wsl11][DEBUG ] connection detected need for sudo
[rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11
[rgulistan-wsl11][DEBUG ] detect platform information from remote host
[rgulistan-wsl11][DEBUG ] detect machine type
[ceph_deploy.mon][INFO  ] distro info: Ubuntu 12.04 precise
[rgulistan-wsl11][DEBUG ] determining if provided host has same
hostname in remote
[rgulistan-wsl11][DEBUG ] get remote short hostname
[rgulistan-wsl11][DEBUG ] deploying mon to rgulistan-wsl11
[rgulistan-wsl11][DEBUG ] get remote short hostname
[rgulistan-wsl11][DEBUG ] remote hostname: rgulistan-wsl11
[rgulistan-wsl11][DEBUG ] write cluster configuration to
/etc/ceph/{cluster}.conf
[rgulistan-wsl11][DEBUG ] create the mon path if it does not exist
[rgulistan-wsl11][DEBUG ] checking for done path:
/var/lib/ceph/mon/ceph-rgulistan-wsl11/done
[rgulistan-wsl11][DEBUG ] create a done file to avoid re-doing the mon
deployment
[rgulistan-wsl11][DEBUG ] create the init path if it does not exist
[rgulistan-wsl11][DEBUG ] locating the `service` executable...
[rgulistan-wsl11][INFO  ] Running command: sudo initctl emit ceph-mon
cluster=ceph id=rgulistan-wsl11
[rgulistan-wsl11][INFO  ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status
[rgulistan-wsl11][DEBUG ]
********************************************************************************
[rgulistan-wsl11][DEBUG ] status for monitor: mon.rgulistan-wsl11
[rgulistan-wsl11][DEBUG ] {
[rgulistan-wsl11][DEBUG ]   "election_epoch": 1,
[rgulistan-wsl11][DEBUG ]   "extra_probe_peers": [],
[rgulistan-wsl11][DEBUG ]   "monmap": {
[rgulistan-wsl11][DEBUG ]     "created": "2015-05-02 10:52:17.318500",
[rgulistan-wsl11][DEBUG ]     "epoch": 1,
[rgulistan-wsl11][DEBUG ]     "fsid": "64e48bd5-f174-44a4-a485-7df3adbdad3d",
[rgulistan-wsl11][DEBUG ]     "modified": "2015-05-02 10:52:17.318500",
[rgulistan-wsl11][DEBUG ]     "mons": [
[rgulistan-wsl11][DEBUG ]       {
[rgulistan-wsl11][DEBUG ]         "addr": "xx.xx.xx.xx:6789/0",
[rgulistan-wsl11][DEBUG ]         "name": "rgulistan-wsl11",
[rgulistan-wsl11][DEBUG ]         "rank": 0
[rgulistan-wsl11][DEBUG ]       }
[rgulistan-wsl11][DEBUG ]     ]
[rgulistan-wsl11][DEBUG ]   },
[rgulistan-wsl11][DEBUG ]   "name": "rgulistan-wsl11",
[rgulistan-wsl11][DEBUG ]   "outside_quorum": [],
[rgulistan-wsl11][DEBUG ]   "quorum": [
[rgulistan-wsl11][DEBUG ]     0
[rgulistan-wsl11][DEBUG ]   ],
[rgulistan-wsl11][DEBUG ]   "rank": 0,
[rgulistan-wsl11][DEBUG ]   "state": "leader",
[rgulistan-wsl11][DEBUG ]   "sync_provider": []
[rgulistan-wsl11][DEBUG ] }
[rgulistan-wsl11][DEBUG ]
********************************************************************************
[rgulistan-wsl11][INFO  ] monitor: mon.rgulistan-wsl11 is running
[rgulistan-wsl11][INFO  ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status
[ceph_deploy.mon][INFO  ] processing monitor mon.rgulistan-wsl11
[rgulistan-wsl11][DEBUG ] connection detected need for sudo
[rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11
[rgulistan-wsl11][INFO  ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status
[ceph_deploy.mon][INFO  ] mon.rgulistan-wsl11 monitor has reached quorum!
[ceph_deploy.mon][INFO  ] all initial monitors are running and have
formed quorum
[ceph_deploy.mon][INFO  ] Running gatherkeys...
[ceph_deploy.gatherkeys][DEBUG ] Checking rgulistan-wsl11 for
/etc/ceph/ceph.client.admin.keyring
[rgulistan-wsl11][DEBUG ] connection detected need for sudo
[rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11
[rgulistan-wsl11][DEBUG ] detect platform information from remote host
[rgulistan-wsl11][DEBUG ] detect machine type
[rgulistan-wsl11][DEBUG ] fetch remote file
[ceph_deploy.gatherkeys][WARNIN] Unable to find
/etc/ceph/ceph.client.admin.keyring on rgulistan-wsl11
[ceph_deploy][ERROR ] KeyNotFoundError: Could not find keyring file:
/etc/ceph/ceph.client.admin.keyring on host rgulistan-wsl11





On Sat, May 2, 2015 at 1:58 PM, Venkateswara Rao Jujjuri
<jujjuri@gmail.com> wrote:
> Started to install basic cluster from scratch, but running into keyring issues.
> Basically /etc/ceph/ceph.client.admin.keyring is not getting generated
> on monitor node.
> When I tried to create it on the monitor node, it fails with:
>
> $ ceph auth get-or-create client.admin mon 'allow *' mds 'allow *' osd
> 'allow *' -o /etc/ceph/ceph.client.admin.keyring
> 2015-05-02 12:32:59.198588 7f0e30395700 -1 monclient(hunting): ERROR:
> missing keyring, cannot use cephx for authentication
> 2015-05-02 12:32:59.198592 7f0e30395700  0 librados: client.admin
> initialization error (2) No such file or directory
> Error connecting to cluster: ObjectNotFound
>
>
> $ ceph --version
> ceph version 0.94.1 (e4bfad3a3c51054df7e537a724c8d0bf9be972ff)
>
>
> Following these insructions:
>
> http://docs.ceph.com/docs/master/start/quick-ceph-deploy/
>
> Failing at :
>
> $ ceph-deploy  mon create-initial
> because it could not find /etc/ceph/ceph.client.admin.keyring
>
> Help appreciated.
> --
> Jvrao
> ---
> First they ignore you, then they laugh at you, then they fight you,
> then you win. - Mahatma Gandhi



-- 
Jvrao
---
First they ignore you, then they laugh at you, then they fight you,
then you win. - Mahatma Gandhi

Re: Help with CEPH deployment

[Mark Kirkwood]

On 04/05/15 05:42, Venkateswara Rao Jujjuri wrote:
> Here is the output..I am still stuck at this step. :(
> (multiple times tried to by purging and restarting from scratch)
>
> vjujjuri@rgulistan-wsl10:~/ceph-cluster$ ceph-deploy mon create-initial
> [ceph_deploy.conf][DEBUG ] found configuration file at:
> /home/vjujjuri/.cephdeploy.conf
> [ceph_deploy.cli][INFO  ] Invoked (1.5.23): /usr/bin/ceph-deploy mon
> create-initial
> [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts rgulistan-wsl11
> [ceph_deploy.mon][DEBUG ] detecting platform for host rgulistan-wsl11 ...
> [rgulistan-wsl11][DEBUG ] connection detected need for sudo
> [rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11
> [rgulistan-wsl11][DEBUG ] detect platform information from remote host
> [rgulistan-wsl11][DEBUG ] detect machine type
> [ceph_deploy.mon][INFO  ] distro info: Ubuntu 12.04 precise
> [rgulistan-wsl11][DEBUG ] determining if provided host has same
> hostname in remote
> [rgulistan-wsl11][DEBUG ] get remote short hostname
> [rgulistan-wsl11][DEBUG ] deploying mon to rgulistan-wsl11
> [rgulistan-wsl11][DEBUG ] get remote short hostname
> [rgulistan-wsl11][DEBUG ] remote hostname: rgulistan-wsl11
> [rgulistan-wsl11][DEBUG ] write cluster configuration to
> /etc/ceph/{cluster}.conf
> [rgulistan-wsl11][DEBUG ] create the mon path if it does not exist
> [rgulistan-wsl11][DEBUG ] checking for done path:
> /var/lib/ceph/mon/ceph-rgulistan-wsl11/done
> [rgulistan-wsl11][DEBUG ] create a done file to avoid re-doing the mon
> deployment
> [rgulistan-wsl11][DEBUG ] create the init path if it does not exist
> [rgulistan-wsl11][DEBUG ] locating the `service` executable...
> [rgulistan-wsl11][INFO  ] Running command: sudo initctl emit ceph-mon
> cluster=ceph id=rgulistan-wsl11
> [rgulistan-wsl11][INFO  ] Running command: sudo ceph --cluster=ceph
> --admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status
> [rgulistan-wsl11][DEBUG ]
> ********************************************************************************
> [rgulistan-wsl11][DEBUG ] status for monitor: mon.rgulistan-wsl11
> [rgulistan-wsl11][DEBUG ] {
> [rgulistan-wsl11][DEBUG ]   "election_epoch": 1,
> [rgulistan-wsl11][DEBUG ]   "extra_probe_peers": [],
> [rgulistan-wsl11][DEBUG ]   "monmap": {
> [rgulistan-wsl11][DEBUG ]     "created": "2015-05-02 10:52:17.318500",
> [rgulistan-wsl11][DEBUG ]     "epoch": 1,
> [rgulistan-wsl11][DEBUG ]     "fsid": "64e48bd5-f174-44a4-a485-7df3adbdad3d",
> [rgulistan-wsl11][DEBUG ]     "modified": "2015-05-02 10:52:17.318500",
> [rgulistan-wsl11][DEBUG ]     "mons": [
> [rgulistan-wsl11][DEBUG ]       {
> [rgulistan-wsl11][DEBUG ]         "addr": "xx.xx.xx.xx:6789/0",
> [rgulistan-wsl11][DEBUG ]         "name": "rgulistan-wsl11",
> [rgulistan-wsl11][DEBUG ]         "rank": 0
> [rgulistan-wsl11][DEBUG ]       }
> [rgulistan-wsl11][DEBUG ]     ]
> [rgulistan-wsl11][DEBUG ]   },
> [rgulistan-wsl11][DEBUG ]   "name": "rgulistan-wsl11",
> [rgulistan-wsl11][DEBUG ]   "outside_quorum": [],
> [rgulistan-wsl11][DEBUG ]   "quorum": [
> [rgulistan-wsl11][DEBUG ]     0
> [rgulistan-wsl11][DEBUG ]   ],
> [rgulistan-wsl11][DEBUG ]   "rank": 0,
> [rgulistan-wsl11][DEBUG ]   "state": "leader",
> [rgulistan-wsl11][DEBUG ]   "sync_provider": []
> [rgulistan-wsl11][DEBUG ] }
> [rgulistan-wsl11][DEBUG ]
> ********************************************************************************
> [rgulistan-wsl11][INFO  ] monitor: mon.rgulistan-wsl11 is running
> [rgulistan-wsl11][INFO  ] Running command: sudo ceph --cluster=ceph
> --admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status
> [ceph_deploy.mon][INFO  ] processing monitor mon.rgulistan-wsl11
> [rgulistan-wsl11][DEBUG ] connection detected need for sudo
> [rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11
> [rgulistan-wsl11][INFO  ] Running command: sudo ceph --cluster=ceph
> --admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status
> [ceph_deploy.mon][INFO  ] mon.rgulistan-wsl11 monitor has reached quorum!
> [ceph_deploy.mon][INFO  ] all initial monitors are running and have
> formed quorum
> [ceph_deploy.mon][INFO  ] Running gatherkeys...
> [ceph_deploy.gatherkeys][DEBUG ] Checking rgulistan-wsl11 for
> /etc/ceph/ceph.client.admin.keyring
> [rgulistan-wsl11][DEBUG ] connection detected need for sudo
> [rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11
> [rgulistan-wsl11][DEBUG ] detect platform information from remote host
> [rgulistan-wsl11][DEBUG ] detect machine type
> [rgulistan-wsl11][DEBUG ] fetch remote file
> [ceph_deploy.gatherkeys][WARNIN] Unable to find
> /etc/ceph/ceph.client.admin.keyring on rgulistan-wsl11
> [ceph_deploy][ERROR ] KeyNotFoundError: Could not find keyring file:
> /etc/ceph/ceph.client.admin.keyring on host rgulistan-wsl11
>
>


Hmmm, so this is Ubuntu 12.04, which should work ok.

It looks like the upstart command to start the monitor is working, which 
*should* kick off the key creation (see /etc/init/ceph-create-keys.conf).

I'd guess that ceph-create-keys is hanging or failing - do you see the 
process running, if not have a look in /var/log/ceph on the on host to 
see what is going on.

Regards

Mark

Re: Help with CEPH deployment

[Venkateswara Rao Jujjuri]

[-- Attachment #1.1: Type: text/plain, Size: 5745 bytes --]

Thanks Mark. I switched to completely different machine and started from
scratch, things were much smoother this time. Cluster was up in 30 mins.
I guess purgedata , droplets and and purge is
Not enough to bring the machine back clean?
What I was trying on the old machine to reset it.

Thanks
JV

On Sunday, May 3, 2015, Mark Kirkwood <mark.kirkwood-6STWZtX7tXAqAMOr+u8IRA@public.gmane.org> wrote:

> On 04/05/15 05:42, Venkateswara Rao Jujjuri wrote:
>
>> Here is the output..I am still stuck at this step. :(
>> (multiple times tried to by purging and restarting from scratch)
>>
>> vjujjuri@rgulistan-wsl10:~/ceph-cluster$ ceph-deploy mon create-initial
>> [ceph_deploy.conf][DEBUG ] found configuration file at:
>> /home/vjujjuri/.cephdeploy.conf
>> [ceph_deploy.cli][INFO  ] Invoked (1.5.23): /usr/bin/ceph-deploy mon
>> create-initial
>> [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts
>> rgulistan-wsl11
>> [ceph_deploy.mon][DEBUG ] detecting platform for host rgulistan-wsl11 ...
>> [rgulistan-wsl11][DEBUG ] connection detected need for sudo
>> [rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11
>> [rgulistan-wsl11][DEBUG ] detect platform information from remote host
>> [rgulistan-wsl11][DEBUG ] detect machine type
>> [ceph_deploy.mon][INFO  ] distro info: Ubuntu 12.04 precise
>> [rgulistan-wsl11][DEBUG ] determining if provided host has same
>> hostname in remote
>> [rgulistan-wsl11][DEBUG ] get remote short hostname
>> [rgulistan-wsl11][DEBUG ] deploying mon to rgulistan-wsl11
>> [rgulistan-wsl11][DEBUG ] get remote short hostname
>> [rgulistan-wsl11][DEBUG ] remote hostname: rgulistan-wsl11
>> [rgulistan-wsl11][DEBUG ] write cluster configuration to
>> /etc/ceph/{cluster}.conf
>> [rgulistan-wsl11][DEBUG ] create the mon path if it does not exist
>> [rgulistan-wsl11][DEBUG ] checking for done path:
>> /var/lib/ceph/mon/ceph-rgulistan-wsl11/done
>> [rgulistan-wsl11][DEBUG ] create a done file to avoid re-doing the mon
>> deployment
>> [rgulistan-wsl11][DEBUG ] create the init path if it does not exist
>> [rgulistan-wsl11][DEBUG ] locating the `service` executable...
>> [rgulistan-wsl11][INFO  ] Running command: sudo initctl emit ceph-mon
>> cluster=ceph id=rgulistan-wsl11
>> [rgulistan-wsl11][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status
>> [rgulistan-wsl11][DEBUG ]
>>
>> ********************************************************************************
>> [rgulistan-wsl11][DEBUG ] status for monitor: mon.rgulistan-wsl11
>> [rgulistan-wsl11][DEBUG ] {
>> [rgulistan-wsl11][DEBUG ]   "election_epoch": 1,
>> [rgulistan-wsl11][DEBUG ]   "extra_probe_peers": [],
>> [rgulistan-wsl11][DEBUG ]   "monmap": {
>> [rgulistan-wsl11][DEBUG ]     "created": "2015-05-02 10:52:17.318500",
>> [rgulistan-wsl11][DEBUG ]     "epoch": 1,
>> [rgulistan-wsl11][DEBUG ]     "fsid":
>> "64e48bd5-f174-44a4-a485-7df3adbdad3d",
>> [rgulistan-wsl11][DEBUG ]     "modified": "2015-05-02 10:52:17.318500",
>> [rgulistan-wsl11][DEBUG ]     "mons": [
>> [rgulistan-wsl11][DEBUG ]       {
>> [rgulistan-wsl11][DEBUG ]         "addr": "xx.xx.xx.xx:6789/0",
>> [rgulistan-wsl11][DEBUG ]         "name": "rgulistan-wsl11",
>> [rgulistan-wsl11][DEBUG ]         "rank": 0
>> [rgulistan-wsl11][DEBUG ]       }
>> [rgulistan-wsl11][DEBUG ]     ]
>> [rgulistan-wsl11][DEBUG ]   },
>> [rgulistan-wsl11][DEBUG ]   "name": "rgulistan-wsl11",
>> [rgulistan-wsl11][DEBUG ]   "outside_quorum": [],
>> [rgulistan-wsl11][DEBUG ]   "quorum": [
>> [rgulistan-wsl11][DEBUG ]     0
>> [rgulistan-wsl11][DEBUG ]   ],
>> [rgulistan-wsl11][DEBUG ]   "rank": 0,
>> [rgulistan-wsl11][DEBUG ]   "state": "leader",
>> [rgulistan-wsl11][DEBUG ]   "sync_provider": []
>> [rgulistan-wsl11][DEBUG ] }
>> [rgulistan-wsl11][DEBUG ]
>>
>> ********************************************************************************
>> [rgulistan-wsl11][INFO  ] monitor: mon.rgulistan-wsl11 is running
>> [rgulistan-wsl11][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status
>> [ceph_deploy.mon][INFO  ] processing monitor mon.rgulistan-wsl11
>> [rgulistan-wsl11][DEBUG ] connection detected need for sudo
>> [rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11
>> [rgulistan-wsl11][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status
>> [ceph_deploy.mon][INFO  ] mon.rgulistan-wsl11 monitor has reached quorum!
>> [ceph_deploy.mon][INFO  ] all initial monitors are running and have
>> formed quorum
>> [ceph_deploy.mon][INFO  ] Running gatherkeys...
>> [ceph_deploy.gatherkeys][DEBUG ] Checking rgulistan-wsl11 for
>> /etc/ceph/ceph.client.admin.keyring
>> [rgulistan-wsl11][DEBUG ] connection detected need for sudo
>> [rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11
>> [rgulistan-wsl11][DEBUG ] detect platform information from remote host
>> [rgulistan-wsl11][DEBUG ] detect machine type
>> [rgulistan-wsl11][DEBUG ] fetch remote file
>> [ceph_deploy.gatherkeys][WARNIN] Unable to find
>> /etc/ceph/ceph.client.admin.keyring on rgulistan-wsl11
>> [ceph_deploy][ERROR ] KeyNotFoundError: Could not find keyring file:
>> /etc/ceph/ceph.client.admin.keyring on host rgulistan-wsl11
>>
>>
>>
>
> Hmmm, so this is Ubuntu 12.04, which should work ok.
>
> It looks like the upstart command to start the monitor is working, which
> *should* kick off the key creation (see /etc/init/ceph-create-keys.conf).
>
> I'd guess that ceph-create-keys is hanging or failing - do you see the
> process running, if not have a look in /var/log/ceph on the on host to see
> what is going on.
>
> Regards
>
> Mark
>
>

-- 
Sent from iPhone

[-- Attachment #1.2: Type: text/html, Size: 6692 bytes --]

[-- Attachment #2: Type: text/plain, Size: 178 bytes --]

_______________________________________________
ceph-users mailing list
ceph-users-idqoXFIVOFJgJs9I8MT0rw@public.gmane.org
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: Help with CEPH deployment

[Vasu Kulkarni]

What are your initial monitor nodes? i,e what nodes did you specify in the first step: ceph-deploy new {initial-monitor-node(s)}
Did you specify rgulistan-wsl11 as your monitor node in that step?


----- Original Message -----
From: "Venkateswara Rao Jujjuri" <jujjuri-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
To: "ceph-devel" <ceph-devel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>, "ceph-users" <ceph-users-idqoXFIVOFJgJs9I8MT0rw@public.gmane.org>
Sent: Sunday, May 3, 2015 10:42:29 AM
Subject: Re: [ceph-users] Help with CEPH deployment

Here is the output..I am still stuck at this step. :(
(multiple times tried to by purging and restarting from scratch)

vjujjuri@rgulistan-wsl10:~/ceph-cluster$ ceph-deploy mon create-initial
[ceph_deploy.conf][DEBUG ] found configuration file at:
/home/vjujjuri/.cephdeploy.conf
[ceph_deploy.cli][INFO  ] Invoked (1.5.23): /usr/bin/ceph-deploy mon
create-initial
[ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts rgulistan-wsl11
[ceph_deploy.mon][DEBUG ] detecting platform for host rgulistan-wsl11 ...
[rgulistan-wsl11][DEBUG ] connection detected need for sudo
[rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11
[rgulistan-wsl11][DEBUG ] detect platform information from remote host
[rgulistan-wsl11][DEBUG ] detect machine type
[ceph_deploy.mon][INFO  ] distro info: Ubuntu 12.04 precise
[rgulistan-wsl11][DEBUG ] determining if provided host has same
hostname in remote
[rgulistan-wsl11][DEBUG ] get remote short hostname
[rgulistan-wsl11][DEBUG ] deploying mon to rgulistan-wsl11
[rgulistan-wsl11][DEBUG ] get remote short hostname
[rgulistan-wsl11][DEBUG ] remote hostname: rgulistan-wsl11
[rgulistan-wsl11][DEBUG ] write cluster configuration to
/etc/ceph/{cluster}.conf
[rgulistan-wsl11][DEBUG ] create the mon path if it does not exist
[rgulistan-wsl11][DEBUG ] checking for done path:
/var/lib/ceph/mon/ceph-rgulistan-wsl11/done
[rgulistan-wsl11][DEBUG ] create a done file to avoid re-doing the mon
deployment
[rgulistan-wsl11][DEBUG ] create the init path if it does not exist
[rgulistan-wsl11][DEBUG ] locating the `service` executable...
[rgulistan-wsl11][INFO  ] Running command: sudo initctl emit ceph-mon
cluster=ceph id=rgulistan-wsl11
[rgulistan-wsl11][INFO  ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status
[rgulistan-wsl11][DEBUG ]
********************************************************************************
[rgulistan-wsl11][DEBUG ] status for monitor: mon.rgulistan-wsl11
[rgulistan-wsl11][DEBUG ] {
[rgulistan-wsl11][DEBUG ]   "election_epoch": 1,
[rgulistan-wsl11][DEBUG ]   "extra_probe_peers": [],
[rgulistan-wsl11][DEBUG ]   "monmap": {
[rgulistan-wsl11][DEBUG ]     "created": "2015-05-02 10:52:17.318500",
[rgulistan-wsl11][DEBUG ]     "epoch": 1,
[rgulistan-wsl11][DEBUG ]     "fsid": "64e48bd5-f174-44a4-a485-7df3adbdad3d",
[rgulistan-wsl11][DEBUG ]     "modified": "2015-05-02 10:52:17.318500",
[rgulistan-wsl11][DEBUG ]     "mons": [
[rgulistan-wsl11][DEBUG ]       {
[rgulistan-wsl11][DEBUG ]         "addr": "xx.xx.xx.xx:6789/0",
[rgulistan-wsl11][DEBUG ]         "name": "rgulistan-wsl11",
[rgulistan-wsl11][DEBUG ]         "rank": 0
[rgulistan-wsl11][DEBUG ]       }
[rgulistan-wsl11][DEBUG ]     ]
[rgulistan-wsl11][DEBUG ]   },
[rgulistan-wsl11][DEBUG ]   "name": "rgulistan-wsl11",
[rgulistan-wsl11][DEBUG ]   "outside_quorum": [],
[rgulistan-wsl11][DEBUG ]   "quorum": [
[rgulistan-wsl11][DEBUG ]     0
[rgulistan-wsl11][DEBUG ]   ],
[rgulistan-wsl11][DEBUG ]   "rank": 0,
[rgulistan-wsl11][DEBUG ]   "state": "leader",
[rgulistan-wsl11][DEBUG ]   "sync_provider": []
[rgulistan-wsl11][DEBUG ] }
[rgulistan-wsl11][DEBUG ]
********************************************************************************
[rgulistan-wsl11][INFO  ] monitor: mon.rgulistan-wsl11 is running
[rgulistan-wsl11][INFO  ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status
[ceph_deploy.mon][INFO  ] processing monitor mon.rgulistan-wsl11
[rgulistan-wsl11][DEBUG ] connection detected need for sudo
[rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11
[rgulistan-wsl11][INFO  ] Running command: sudo ceph --cluster=ceph
--admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status
[ceph_deploy.mon][INFO  ] mon.rgulistan-wsl11 monitor has reached quorum!
[ceph_deploy.mon][INFO  ] all initial monitors are running and have
formed quorum
[ceph_deploy.mon][INFO  ] Running gatherkeys...
[ceph_deploy.gatherkeys][DEBUG ] Checking rgulistan-wsl11 for
/etc/ceph/ceph.client.admin.keyring
[rgulistan-wsl11][DEBUG ] connection detected need for sudo
[rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11
[rgulistan-wsl11][DEBUG ] detect platform information from remote host
[rgulistan-wsl11][DEBUG ] detect machine type
[rgulistan-wsl11][DEBUG ] fetch remote file
[ceph_deploy.gatherkeys][WARNIN] Unable to find
/etc/ceph/ceph.client.admin.keyring on rgulistan-wsl11
[ceph_deploy][ERROR ] KeyNotFoundError: Could not find keyring file:
/etc/ceph/ceph.client.admin.keyring on host rgulistan-wsl11





On Sat, May 2, 2015 at 1:58 PM, Venkateswara Rao Jujjuri
<jujjuri-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
> Started to install basic cluster from scratch, but running into keyring issues.
> Basically /etc/ceph/ceph.client.admin.keyring is not getting generated
> on monitor node.
> When I tried to create it on the monitor node, it fails with:
>
> $ ceph auth get-or-create client.admin mon 'allow *' mds 'allow *' osd
> 'allow *' -o /etc/ceph/ceph.client.admin.keyring
> 2015-05-02 12:32:59.198588 7f0e30395700 -1 monclient(hunting): ERROR:
> missing keyring, cannot use cephx for authentication
> 2015-05-02 12:32:59.198592 7f0e30395700  0 librados: client.admin
> initialization error (2) No such file or directory
> Error connecting to cluster: ObjectNotFound
>
>
> $ ceph --version
> ceph version 0.94.1 (e4bfad3a3c51054df7e537a724c8d0bf9be972ff)
>
>
> Following these insructions:
>
> http://docs.ceph.com/docs/master/start/quick-ceph-deploy/
>
> Failing at :
>
> $ ceph-deploy  mon create-initial
> because it could not find /etc/ceph/ceph.client.admin.keyring
>
> Help appreciated.
> --
> Jvrao
> ---
> First they ignore you, then they laugh at you, then they fight you,
> then you win. - Mahatma Gandhi



-- 
Jvrao
---
First they ignore you, then they laugh at you, then they fight you,
then you win. - Mahatma Gandhi
_______________________________________________
ceph-users mailing list
ceph-users-idqoXFIVOFJgJs9I8MT0rw@public.gmane.org
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: Help with CEPH deployment

[Mark Kirkwood]

On 05/05/15 04:16, Venkateswara Rao Jujjuri wrote:
> Thanks Mark. I switched to completely different machine and started from
> scratch, things were much smoother this time. Cluster was up in 30 mins.
> I guess purgedata , droplets and and purge is
> Not enough to bring the machine back clean?
> What I was trying on the old machine to reset it.
>

One other thing to check on that machine (rgulistan-wsl11) if you want 
to use it again is that it resolves its own hostname sensibly (it really 
screws up the key creation if a different ip get returned)!

Cheers

Mark