* Help with CEPH deployment @ 2015-05-02 20:58 Venkateswara Rao Jujjuri 2015-05-03 17:42 ` Venkateswara Rao Jujjuri 0 siblings, 1 reply; 6+ messages in thread From: Venkateswara Rao Jujjuri @ 2015-05-02 20:58 UTC (permalink / raw) To: ceph-devel, ceph-users Started to install basic cluster from scratch, but running into keyring issues. Basically /etc/ceph/ceph.client.admin.keyring is not getting generated on monitor node. When I tried to create it on the monitor node, it fails with: $ ceph auth get-or-create client.admin mon 'allow *' mds 'allow *' osd 'allow *' -o /etc/ceph/ceph.client.admin.keyring 2015-05-02 12:32:59.198588 7f0e30395700 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication 2015-05-02 12:32:59.198592 7f0e30395700 0 librados: client.admin initialization error (2) No such file or directory Error connecting to cluster: ObjectNotFound $ ceph --version ceph version 0.94.1 (e4bfad3a3c51054df7e537a724c8d0bf9be972ff) Following these insructions: http://docs.ceph.com/docs/master/start/quick-ceph-deploy/ Failing at : $ ceph-deploy mon create-initial because it could not find /etc/ceph/ceph.client.admin.keyring Help appreciated. -- Jvrao --- First they ignore you, then they laugh at you, then they fight you, then you win. - Mahatma Gandhi ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Help with CEPH deployment 2015-05-02 20:58 Help with CEPH deployment Venkateswara Rao Jujjuri @ 2015-05-03 17:42 ` Venkateswara Rao Jujjuri [not found] ` <CAKKTCLXG3nzSQs8V5Qq7ycpbd__-vVHMG3Dma+Mihij4o7kakg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org> 0 siblings, 1 reply; 6+ messages in thread From: Venkateswara Rao Jujjuri @ 2015-05-03 17:42 UTC (permalink / raw) To: ceph-devel, ceph-users Here is the output..I am still stuck at this step. :( (multiple times tried to by purging and restarting from scratch) vjujjuri@rgulistan-wsl10:~/ceph-cluster$ ceph-deploy mon create-initial [ceph_deploy.conf][DEBUG ] found configuration file at: /home/vjujjuri/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.23): /usr/bin/ceph-deploy mon create-initial [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts rgulistan-wsl11 [ceph_deploy.mon][DEBUG ] detecting platform for host rgulistan-wsl11 ... [rgulistan-wsl11][DEBUG ] connection detected need for sudo [rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11 [rgulistan-wsl11][DEBUG ] detect platform information from remote host [rgulistan-wsl11][DEBUG ] detect machine type [ceph_deploy.mon][INFO ] distro info: Ubuntu 12.04 precise [rgulistan-wsl11][DEBUG ] determining if provided host has same hostname in remote [rgulistan-wsl11][DEBUG ] get remote short hostname [rgulistan-wsl11][DEBUG ] deploying mon to rgulistan-wsl11 [rgulistan-wsl11][DEBUG ] get remote short hostname [rgulistan-wsl11][DEBUG ] remote hostname: rgulistan-wsl11 [rgulistan-wsl11][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [rgulistan-wsl11][DEBUG ] create the mon path if it does not exist [rgulistan-wsl11][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-rgulistan-wsl11/done [rgulistan-wsl11][DEBUG ] create a done file to avoid re-doing the mon deployment [rgulistan-wsl11][DEBUG ] create the init path if it does not exist [rgulistan-wsl11][DEBUG ] locating the `service` executable... [rgulistan-wsl11][INFO ] Running command: sudo initctl emit ceph-mon cluster=ceph id=rgulistan-wsl11 [rgulistan-wsl11][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status [rgulistan-wsl11][DEBUG ] ******************************************************************************** [rgulistan-wsl11][DEBUG ] status for monitor: mon.rgulistan-wsl11 [rgulistan-wsl11][DEBUG ] { [rgulistan-wsl11][DEBUG ] "election_epoch": 1, [rgulistan-wsl11][DEBUG ] "extra_probe_peers": [], [rgulistan-wsl11][DEBUG ] "monmap": { [rgulistan-wsl11][DEBUG ] "created": "2015-05-02 10:52:17.318500", [rgulistan-wsl11][DEBUG ] "epoch": 1, [rgulistan-wsl11][DEBUG ] "fsid": "64e48bd5-f174-44a4-a485-7df3adbdad3d", [rgulistan-wsl11][DEBUG ] "modified": "2015-05-02 10:52:17.318500", [rgulistan-wsl11][DEBUG ] "mons": [ [rgulistan-wsl11][DEBUG ] { [rgulistan-wsl11][DEBUG ] "addr": "xx.xx.xx.xx:6789/0", [rgulistan-wsl11][DEBUG ] "name": "rgulistan-wsl11", [rgulistan-wsl11][DEBUG ] "rank": 0 [rgulistan-wsl11][DEBUG ] } [rgulistan-wsl11][DEBUG ] ] [rgulistan-wsl11][DEBUG ] }, [rgulistan-wsl11][DEBUG ] "name": "rgulistan-wsl11", [rgulistan-wsl11][DEBUG ] "outside_quorum": [], [rgulistan-wsl11][DEBUG ] "quorum": [ [rgulistan-wsl11][DEBUG ] 0 [rgulistan-wsl11][DEBUG ] ], [rgulistan-wsl11][DEBUG ] "rank": 0, [rgulistan-wsl11][DEBUG ] "state": "leader", [rgulistan-wsl11][DEBUG ] "sync_provider": [] [rgulistan-wsl11][DEBUG ] } [rgulistan-wsl11][DEBUG ] ******************************************************************************** [rgulistan-wsl11][INFO ] monitor: mon.rgulistan-wsl11 is running [rgulistan-wsl11][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status [ceph_deploy.mon][INFO ] processing monitor mon.rgulistan-wsl11 [rgulistan-wsl11][DEBUG ] connection detected need for sudo [rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11 [rgulistan-wsl11][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status [ceph_deploy.mon][INFO ] mon.rgulistan-wsl11 monitor has reached quorum! [ceph_deploy.mon][INFO ] all initial monitors are running and have formed quorum [ceph_deploy.mon][INFO ] Running gatherkeys... [ceph_deploy.gatherkeys][DEBUG ] Checking rgulistan-wsl11 for /etc/ceph/ceph.client.admin.keyring [rgulistan-wsl11][DEBUG ] connection detected need for sudo [rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11 [rgulistan-wsl11][DEBUG ] detect platform information from remote host [rgulistan-wsl11][DEBUG ] detect machine type [rgulistan-wsl11][DEBUG ] fetch remote file [ceph_deploy.gatherkeys][WARNIN] Unable to find /etc/ceph/ceph.client.admin.keyring on rgulistan-wsl11 [ceph_deploy][ERROR ] KeyNotFoundError: Could not find keyring file: /etc/ceph/ceph.client.admin.keyring on host rgulistan-wsl11 On Sat, May 2, 2015 at 1:58 PM, Venkateswara Rao Jujjuri <jujjuri@gmail.com> wrote: > Started to install basic cluster from scratch, but running into keyring issues. > Basically /etc/ceph/ceph.client.admin.keyring is not getting generated > on monitor node. > When I tried to create it on the monitor node, it fails with: > > $ ceph auth get-or-create client.admin mon 'allow *' mds 'allow *' osd > 'allow *' -o /etc/ceph/ceph.client.admin.keyring > 2015-05-02 12:32:59.198588 7f0e30395700 -1 monclient(hunting): ERROR: > missing keyring, cannot use cephx for authentication > 2015-05-02 12:32:59.198592 7f0e30395700 0 librados: client.admin > initialization error (2) No such file or directory > Error connecting to cluster: ObjectNotFound > > > $ ceph --version > ceph version 0.94.1 (e4bfad3a3c51054df7e537a724c8d0bf9be972ff) > > > Following these insructions: > > http://docs.ceph.com/docs/master/start/quick-ceph-deploy/ > > Failing at : > > $ ceph-deploy mon create-initial > because it could not find /etc/ceph/ceph.client.admin.keyring > > Help appreciated. > -- > Jvrao > --- > First they ignore you, then they laugh at you, then they fight you, > then you win. - Mahatma Gandhi -- Jvrao --- First they ignore you, then they laugh at you, then they fight you, then you win. - Mahatma Gandhi ^ permalink raw reply [flat|nested] 6+ messages in thread
[parent not found: <CAKKTCLXG3nzSQs8V5Qq7ycpbd__-vVHMG3Dma+Mihij4o7kakg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>]
* Re: Help with CEPH deployment [not found] ` <CAKKTCLXG3nzSQs8V5Qq7ycpbd__-vVHMG3Dma+Mihij4o7kakg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org> @ 2015-05-03 22:32 ` Mark Kirkwood [not found] ` <5546A1E7.7060208-6STWZtX7tXAqAMOr+u8IRA@public.gmane.org> 2015-05-04 18:41 ` Vasu Kulkarni 1 sibling, 1 reply; 6+ messages in thread From: Mark Kirkwood @ 2015-05-03 22:32 UTC (permalink / raw) To: Venkateswara Rao Jujjuri, ceph-devel, ceph-users On 04/05/15 05:42, Venkateswara Rao Jujjuri wrote: > Here is the output..I am still stuck at this step. :( > (multiple times tried to by purging and restarting from scratch) > > vjujjuri@rgulistan-wsl10:~/ceph-cluster$ ceph-deploy mon create-initial > [ceph_deploy.conf][DEBUG ] found configuration file at: > /home/vjujjuri/.cephdeploy.conf > [ceph_deploy.cli][INFO ] Invoked (1.5.23): /usr/bin/ceph-deploy mon > create-initial > [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts rgulistan-wsl11 > [ceph_deploy.mon][DEBUG ] detecting platform for host rgulistan-wsl11 ... > [rgulistan-wsl11][DEBUG ] connection detected need for sudo > [rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11 > [rgulistan-wsl11][DEBUG ] detect platform information from remote host > [rgulistan-wsl11][DEBUG ] detect machine type > [ceph_deploy.mon][INFO ] distro info: Ubuntu 12.04 precise > [rgulistan-wsl11][DEBUG ] determining if provided host has same > hostname in remote > [rgulistan-wsl11][DEBUG ] get remote short hostname > [rgulistan-wsl11][DEBUG ] deploying mon to rgulistan-wsl11 > [rgulistan-wsl11][DEBUG ] get remote short hostname > [rgulistan-wsl11][DEBUG ] remote hostname: rgulistan-wsl11 > [rgulistan-wsl11][DEBUG ] write cluster configuration to > /etc/ceph/{cluster}.conf > [rgulistan-wsl11][DEBUG ] create the mon path if it does not exist > [rgulistan-wsl11][DEBUG ] checking for done path: > /var/lib/ceph/mon/ceph-rgulistan-wsl11/done > [rgulistan-wsl11][DEBUG ] create a done file to avoid re-doing the mon > deployment > [rgulistan-wsl11][DEBUG ] create the init path if it does not exist > [rgulistan-wsl11][DEBUG ] locating the `service` executable... > [rgulistan-wsl11][INFO ] Running command: sudo initctl emit ceph-mon > cluster=ceph id=rgulistan-wsl11 > [rgulistan-wsl11][INFO ] Running command: sudo ceph --cluster=ceph > --admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status > [rgulistan-wsl11][DEBUG ] > ******************************************************************************** > [rgulistan-wsl11][DEBUG ] status for monitor: mon.rgulistan-wsl11 > [rgulistan-wsl11][DEBUG ] { > [rgulistan-wsl11][DEBUG ] "election_epoch": 1, > [rgulistan-wsl11][DEBUG ] "extra_probe_peers": [], > [rgulistan-wsl11][DEBUG ] "monmap": { > [rgulistan-wsl11][DEBUG ] "created": "2015-05-02 10:52:17.318500", > [rgulistan-wsl11][DEBUG ] "epoch": 1, > [rgulistan-wsl11][DEBUG ] "fsid": "64e48bd5-f174-44a4-a485-7df3adbdad3d", > [rgulistan-wsl11][DEBUG ] "modified": "2015-05-02 10:52:17.318500", > [rgulistan-wsl11][DEBUG ] "mons": [ > [rgulistan-wsl11][DEBUG ] { > [rgulistan-wsl11][DEBUG ] "addr": "xx.xx.xx.xx:6789/0", > [rgulistan-wsl11][DEBUG ] "name": "rgulistan-wsl11", > [rgulistan-wsl11][DEBUG ] "rank": 0 > [rgulistan-wsl11][DEBUG ] } > [rgulistan-wsl11][DEBUG ] ] > [rgulistan-wsl11][DEBUG ] }, > [rgulistan-wsl11][DEBUG ] "name": "rgulistan-wsl11", > [rgulistan-wsl11][DEBUG ] "outside_quorum": [], > [rgulistan-wsl11][DEBUG ] "quorum": [ > [rgulistan-wsl11][DEBUG ] 0 > [rgulistan-wsl11][DEBUG ] ], > [rgulistan-wsl11][DEBUG ] "rank": 0, > [rgulistan-wsl11][DEBUG ] "state": "leader", > [rgulistan-wsl11][DEBUG ] "sync_provider": [] > [rgulistan-wsl11][DEBUG ] } > [rgulistan-wsl11][DEBUG ] > ******************************************************************************** > [rgulistan-wsl11][INFO ] monitor: mon.rgulistan-wsl11 is running > [rgulistan-wsl11][INFO ] Running command: sudo ceph --cluster=ceph > --admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status > [ceph_deploy.mon][INFO ] processing monitor mon.rgulistan-wsl11 > [rgulistan-wsl11][DEBUG ] connection detected need for sudo > [rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11 > [rgulistan-wsl11][INFO ] Running command: sudo ceph --cluster=ceph > --admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status > [ceph_deploy.mon][INFO ] mon.rgulistan-wsl11 monitor has reached quorum! > [ceph_deploy.mon][INFO ] all initial monitors are running and have > formed quorum > [ceph_deploy.mon][INFO ] Running gatherkeys... > [ceph_deploy.gatherkeys][DEBUG ] Checking rgulistan-wsl11 for > /etc/ceph/ceph.client.admin.keyring > [rgulistan-wsl11][DEBUG ] connection detected need for sudo > [rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11 > [rgulistan-wsl11][DEBUG ] detect platform information from remote host > [rgulistan-wsl11][DEBUG ] detect machine type > [rgulistan-wsl11][DEBUG ] fetch remote file > [ceph_deploy.gatherkeys][WARNIN] Unable to find > /etc/ceph/ceph.client.admin.keyring on rgulistan-wsl11 > [ceph_deploy][ERROR ] KeyNotFoundError: Could not find keyring file: > /etc/ceph/ceph.client.admin.keyring on host rgulistan-wsl11 > > Hmmm, so this is Ubuntu 12.04, which should work ok. It looks like the upstart command to start the monitor is working, which *should* kick off the key creation (see /etc/init/ceph-create-keys.conf). I'd guess that ceph-create-keys is hanging or failing - do you see the process running, if not have a look in /var/log/ceph on the on host to see what is going on. Regards Mark ^ permalink raw reply [flat|nested] 6+ messages in thread
[parent not found: <5546A1E7.7060208-6STWZtX7tXAqAMOr+u8IRA@public.gmane.org>]
* Re: Help with CEPH deployment [not found] ` <5546A1E7.7060208-6STWZtX7tXAqAMOr+u8IRA@public.gmane.org> @ 2015-05-04 16:16 ` Venkateswara Rao Jujjuri 2015-05-04 21:53 ` Mark Kirkwood 0 siblings, 1 reply; 6+ messages in thread From: Venkateswara Rao Jujjuri @ 2015-05-04 16:16 UTC (permalink / raw) To: Mark Kirkwood; +Cc: ceph-devel, ceph-users [-- Attachment #1.1: Type: text/plain, Size: 5745 bytes --] Thanks Mark. I switched to completely different machine and started from scratch, things were much smoother this time. Cluster was up in 30 mins. I guess purgedata , droplets and and purge is Not enough to bring the machine back clean? What I was trying on the old machine to reset it. Thanks JV On Sunday, May 3, 2015, Mark Kirkwood <mark.kirkwood-6STWZtX7tXAqAMOr+u8IRA@public.gmane.org> wrote: > On 04/05/15 05:42, Venkateswara Rao Jujjuri wrote: > >> Here is the output..I am still stuck at this step. :( >> (multiple times tried to by purging and restarting from scratch) >> >> vjujjuri@rgulistan-wsl10:~/ceph-cluster$ ceph-deploy mon create-initial >> [ceph_deploy.conf][DEBUG ] found configuration file at: >> /home/vjujjuri/.cephdeploy.conf >> [ceph_deploy.cli][INFO ] Invoked (1.5.23): /usr/bin/ceph-deploy mon >> create-initial >> [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts >> rgulistan-wsl11 >> [ceph_deploy.mon][DEBUG ] detecting platform for host rgulistan-wsl11 ... >> [rgulistan-wsl11][DEBUG ] connection detected need for sudo >> [rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11 >> [rgulistan-wsl11][DEBUG ] detect platform information from remote host >> [rgulistan-wsl11][DEBUG ] detect machine type >> [ceph_deploy.mon][INFO ] distro info: Ubuntu 12.04 precise >> [rgulistan-wsl11][DEBUG ] determining if provided host has same >> hostname in remote >> [rgulistan-wsl11][DEBUG ] get remote short hostname >> [rgulistan-wsl11][DEBUG ] deploying mon to rgulistan-wsl11 >> [rgulistan-wsl11][DEBUG ] get remote short hostname >> [rgulistan-wsl11][DEBUG ] remote hostname: rgulistan-wsl11 >> [rgulistan-wsl11][DEBUG ] write cluster configuration to >> /etc/ceph/{cluster}.conf >> [rgulistan-wsl11][DEBUG ] create the mon path if it does not exist >> [rgulistan-wsl11][DEBUG ] checking for done path: >> /var/lib/ceph/mon/ceph-rgulistan-wsl11/done >> [rgulistan-wsl11][DEBUG ] create a done file to avoid re-doing the mon >> deployment >> [rgulistan-wsl11][DEBUG ] create the init path if it does not exist >> [rgulistan-wsl11][DEBUG ] locating the `service` executable... >> [rgulistan-wsl11][INFO ] Running command: sudo initctl emit ceph-mon >> cluster=ceph id=rgulistan-wsl11 >> [rgulistan-wsl11][INFO ] Running command: sudo ceph --cluster=ceph >> --admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status >> [rgulistan-wsl11][DEBUG ] >> >> ******************************************************************************** >> [rgulistan-wsl11][DEBUG ] status for monitor: mon.rgulistan-wsl11 >> [rgulistan-wsl11][DEBUG ] { >> [rgulistan-wsl11][DEBUG ] "election_epoch": 1, >> [rgulistan-wsl11][DEBUG ] "extra_probe_peers": [], >> [rgulistan-wsl11][DEBUG ] "monmap": { >> [rgulistan-wsl11][DEBUG ] "created": "2015-05-02 10:52:17.318500", >> [rgulistan-wsl11][DEBUG ] "epoch": 1, >> [rgulistan-wsl11][DEBUG ] "fsid": >> "64e48bd5-f174-44a4-a485-7df3adbdad3d", >> [rgulistan-wsl11][DEBUG ] "modified": "2015-05-02 10:52:17.318500", >> [rgulistan-wsl11][DEBUG ] "mons": [ >> [rgulistan-wsl11][DEBUG ] { >> [rgulistan-wsl11][DEBUG ] "addr": "xx.xx.xx.xx:6789/0", >> [rgulistan-wsl11][DEBUG ] "name": "rgulistan-wsl11", >> [rgulistan-wsl11][DEBUG ] "rank": 0 >> [rgulistan-wsl11][DEBUG ] } >> [rgulistan-wsl11][DEBUG ] ] >> [rgulistan-wsl11][DEBUG ] }, >> [rgulistan-wsl11][DEBUG ] "name": "rgulistan-wsl11", >> [rgulistan-wsl11][DEBUG ] "outside_quorum": [], >> [rgulistan-wsl11][DEBUG ] "quorum": [ >> [rgulistan-wsl11][DEBUG ] 0 >> [rgulistan-wsl11][DEBUG ] ], >> [rgulistan-wsl11][DEBUG ] "rank": 0, >> [rgulistan-wsl11][DEBUG ] "state": "leader", >> [rgulistan-wsl11][DEBUG ] "sync_provider": [] >> [rgulistan-wsl11][DEBUG ] } >> [rgulistan-wsl11][DEBUG ] >> >> ******************************************************************************** >> [rgulistan-wsl11][INFO ] monitor: mon.rgulistan-wsl11 is running >> [rgulistan-wsl11][INFO ] Running command: sudo ceph --cluster=ceph >> --admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status >> [ceph_deploy.mon][INFO ] processing monitor mon.rgulistan-wsl11 >> [rgulistan-wsl11][DEBUG ] connection detected need for sudo >> [rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11 >> [rgulistan-wsl11][INFO ] Running command: sudo ceph --cluster=ceph >> --admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status >> [ceph_deploy.mon][INFO ] mon.rgulistan-wsl11 monitor has reached quorum! >> [ceph_deploy.mon][INFO ] all initial monitors are running and have >> formed quorum >> [ceph_deploy.mon][INFO ] Running gatherkeys... >> [ceph_deploy.gatherkeys][DEBUG ] Checking rgulistan-wsl11 for >> /etc/ceph/ceph.client.admin.keyring >> [rgulistan-wsl11][DEBUG ] connection detected need for sudo >> [rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11 >> [rgulistan-wsl11][DEBUG ] detect platform information from remote host >> [rgulistan-wsl11][DEBUG ] detect machine type >> [rgulistan-wsl11][DEBUG ] fetch remote file >> [ceph_deploy.gatherkeys][WARNIN] Unable to find >> /etc/ceph/ceph.client.admin.keyring on rgulistan-wsl11 >> [ceph_deploy][ERROR ] KeyNotFoundError: Could not find keyring file: >> /etc/ceph/ceph.client.admin.keyring on host rgulistan-wsl11 >> >> >> > > Hmmm, so this is Ubuntu 12.04, which should work ok. > > It looks like the upstart command to start the monitor is working, which > *should* kick off the key creation (see /etc/init/ceph-create-keys.conf). > > I'd guess that ceph-create-keys is hanging or failing - do you see the > process running, if not have a look in /var/log/ceph on the on host to see > what is going on. > > Regards > > Mark > > -- Sent from iPhone [-- Attachment #1.2: Type: text/html, Size: 6692 bytes --] [-- Attachment #2: Type: text/plain, Size: 178 bytes --] _______________________________________________ ceph-users mailing list ceph-users-idqoXFIVOFJgJs9I8MT0rw@public.gmane.org http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Help with CEPH deployment 2015-05-04 16:16 ` Venkateswara Rao Jujjuri @ 2015-05-04 21:53 ` Mark Kirkwood 0 siblings, 0 replies; 6+ messages in thread From: Mark Kirkwood @ 2015-05-04 21:53 UTC (permalink / raw) To: Venkateswara Rao Jujjuri; +Cc: ceph-devel, ceph-users On 05/05/15 04:16, Venkateswara Rao Jujjuri wrote: > Thanks Mark. I switched to completely different machine and started from > scratch, things were much smoother this time. Cluster was up in 30 mins. > I guess purgedata , droplets and and purge is > Not enough to bring the machine back clean? > What I was trying on the old machine to reset it. > One other thing to check on that machine (rgulistan-wsl11) if you want to use it again is that it resolves its own hostname sensibly (it really screws up the key creation if a different ip get returned)! Cheers Mark ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Help with CEPH deployment [not found] ` <CAKKTCLXG3nzSQs8V5Qq7ycpbd__-vVHMG3Dma+Mihij4o7kakg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org> 2015-05-03 22:32 ` Mark Kirkwood @ 2015-05-04 18:41 ` Vasu Kulkarni 1 sibling, 0 replies; 6+ messages in thread From: Vasu Kulkarni @ 2015-05-04 18:41 UTC (permalink / raw) To: Venkateswara Rao Jujjuri; +Cc: ceph-devel, ceph-users What are your initial monitor nodes? i,e what nodes did you specify in the first step: ceph-deploy new {initial-monitor-node(s)} Did you specify rgulistan-wsl11 as your monitor node in that step? ----- Original Message ----- From: "Venkateswara Rao Jujjuri" <jujjuri-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> To: "ceph-devel" <ceph-devel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>, "ceph-users" <ceph-users-idqoXFIVOFJgJs9I8MT0rw@public.gmane.org> Sent: Sunday, May 3, 2015 10:42:29 AM Subject: Re: [ceph-users] Help with CEPH deployment Here is the output..I am still stuck at this step. :( (multiple times tried to by purging and restarting from scratch) vjujjuri@rgulistan-wsl10:~/ceph-cluster$ ceph-deploy mon create-initial [ceph_deploy.conf][DEBUG ] found configuration file at: /home/vjujjuri/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.23): /usr/bin/ceph-deploy mon create-initial [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts rgulistan-wsl11 [ceph_deploy.mon][DEBUG ] detecting platform for host rgulistan-wsl11 ... [rgulistan-wsl11][DEBUG ] connection detected need for sudo [rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11 [rgulistan-wsl11][DEBUG ] detect platform information from remote host [rgulistan-wsl11][DEBUG ] detect machine type [ceph_deploy.mon][INFO ] distro info: Ubuntu 12.04 precise [rgulistan-wsl11][DEBUG ] determining if provided host has same hostname in remote [rgulistan-wsl11][DEBUG ] get remote short hostname [rgulistan-wsl11][DEBUG ] deploying mon to rgulistan-wsl11 [rgulistan-wsl11][DEBUG ] get remote short hostname [rgulistan-wsl11][DEBUG ] remote hostname: rgulistan-wsl11 [rgulistan-wsl11][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [rgulistan-wsl11][DEBUG ] create the mon path if it does not exist [rgulistan-wsl11][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-rgulistan-wsl11/done [rgulistan-wsl11][DEBUG ] create a done file to avoid re-doing the mon deployment [rgulistan-wsl11][DEBUG ] create the init path if it does not exist [rgulistan-wsl11][DEBUG ] locating the `service` executable... [rgulistan-wsl11][INFO ] Running command: sudo initctl emit ceph-mon cluster=ceph id=rgulistan-wsl11 [rgulistan-wsl11][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status [rgulistan-wsl11][DEBUG ] ******************************************************************************** [rgulistan-wsl11][DEBUG ] status for monitor: mon.rgulistan-wsl11 [rgulistan-wsl11][DEBUG ] { [rgulistan-wsl11][DEBUG ] "election_epoch": 1, [rgulistan-wsl11][DEBUG ] "extra_probe_peers": [], [rgulistan-wsl11][DEBUG ] "monmap": { [rgulistan-wsl11][DEBUG ] "created": "2015-05-02 10:52:17.318500", [rgulistan-wsl11][DEBUG ] "epoch": 1, [rgulistan-wsl11][DEBUG ] "fsid": "64e48bd5-f174-44a4-a485-7df3adbdad3d", [rgulistan-wsl11][DEBUG ] "modified": "2015-05-02 10:52:17.318500", [rgulistan-wsl11][DEBUG ] "mons": [ [rgulistan-wsl11][DEBUG ] { [rgulistan-wsl11][DEBUG ] "addr": "xx.xx.xx.xx:6789/0", [rgulistan-wsl11][DEBUG ] "name": "rgulistan-wsl11", [rgulistan-wsl11][DEBUG ] "rank": 0 [rgulistan-wsl11][DEBUG ] } [rgulistan-wsl11][DEBUG ] ] [rgulistan-wsl11][DEBUG ] }, [rgulistan-wsl11][DEBUG ] "name": "rgulistan-wsl11", [rgulistan-wsl11][DEBUG ] "outside_quorum": [], [rgulistan-wsl11][DEBUG ] "quorum": [ [rgulistan-wsl11][DEBUG ] 0 [rgulistan-wsl11][DEBUG ] ], [rgulistan-wsl11][DEBUG ] "rank": 0, [rgulistan-wsl11][DEBUG ] "state": "leader", [rgulistan-wsl11][DEBUG ] "sync_provider": [] [rgulistan-wsl11][DEBUG ] } [rgulistan-wsl11][DEBUG ] ******************************************************************************** [rgulistan-wsl11][INFO ] monitor: mon.rgulistan-wsl11 is running [rgulistan-wsl11][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status [ceph_deploy.mon][INFO ] processing monitor mon.rgulistan-wsl11 [rgulistan-wsl11][DEBUG ] connection detected need for sudo [rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11 [rgulistan-wsl11][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.rgulistan-wsl11.asok mon_status [ceph_deploy.mon][INFO ] mon.rgulistan-wsl11 monitor has reached quorum! [ceph_deploy.mon][INFO ] all initial monitors are running and have formed quorum [ceph_deploy.mon][INFO ] Running gatherkeys... [ceph_deploy.gatherkeys][DEBUG ] Checking rgulistan-wsl11 for /etc/ceph/ceph.client.admin.keyring [rgulistan-wsl11][DEBUG ] connection detected need for sudo [rgulistan-wsl11][DEBUG ] connected to host: rgulistan-wsl11 [rgulistan-wsl11][DEBUG ] detect platform information from remote host [rgulistan-wsl11][DEBUG ] detect machine type [rgulistan-wsl11][DEBUG ] fetch remote file [ceph_deploy.gatherkeys][WARNIN] Unable to find /etc/ceph/ceph.client.admin.keyring on rgulistan-wsl11 [ceph_deploy][ERROR ] KeyNotFoundError: Could not find keyring file: /etc/ceph/ceph.client.admin.keyring on host rgulistan-wsl11 On Sat, May 2, 2015 at 1:58 PM, Venkateswara Rao Jujjuri <jujjuri-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote: > Started to install basic cluster from scratch, but running into keyring issues. > Basically /etc/ceph/ceph.client.admin.keyring is not getting generated > on monitor node. > When I tried to create it on the monitor node, it fails with: > > $ ceph auth get-or-create client.admin mon 'allow *' mds 'allow *' osd > 'allow *' -o /etc/ceph/ceph.client.admin.keyring > 2015-05-02 12:32:59.198588 7f0e30395700 -1 monclient(hunting): ERROR: > missing keyring, cannot use cephx for authentication > 2015-05-02 12:32:59.198592 7f0e30395700 0 librados: client.admin > initialization error (2) No such file or directory > Error connecting to cluster: ObjectNotFound > > > $ ceph --version > ceph version 0.94.1 (e4bfad3a3c51054df7e537a724c8d0bf9be972ff) > > > Following these insructions: > > http://docs.ceph.com/docs/master/start/quick-ceph-deploy/ > > Failing at : > > $ ceph-deploy mon create-initial > because it could not find /etc/ceph/ceph.client.admin.keyring > > Help appreciated. > -- > Jvrao > --- > First they ignore you, then they laugh at you, then they fight you, > then you win. - Mahatma Gandhi -- Jvrao --- First they ignore you, then they laugh at you, then they fight you, then you win. - Mahatma Gandhi _______________________________________________ ceph-users mailing list ceph-users-idqoXFIVOFJgJs9I8MT0rw@public.gmane.org http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2015-05-04 21:53 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2015-05-02 20:58 Help with CEPH deployment Venkateswara Rao Jujjuri
2015-05-03 17:42 ` Venkateswara Rao Jujjuri
[not found] ` <CAKKTCLXG3nzSQs8V5Qq7ycpbd__-vVHMG3Dma+Mihij4o7kakg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2015-05-03 22:32 ` Mark Kirkwood
[not found] ` <5546A1E7.7060208-6STWZtX7tXAqAMOr+u8IRA@public.gmane.org>
2015-05-04 16:16 ` Venkateswara Rao Jujjuri
2015-05-04 21:53 ` Mark Kirkwood
2015-05-04 18:41 ` Vasu Kulkarni
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.