Ceph setup on single node : prob with "

Ceph setup on single node : prob with "

[hemant surale]

Hi all ,
 i have prob while executing "sudo mkcephfs -a -c /etc/ceph/ceph.conf
-k ceph.keyring"  ERROR :
*****************************************************************************************************************
root@hemant-virtual-machine:/etc/ceph# mkcephfs -a -c ceph.conf -k ceph.keyring
temp dir is /tmp/mkcephfs.n6zx4y4y33
preparing monmap in /tmp/mkcephfs.n6zx4y4y33/monmap
/usr/bin/monmaptool --create --clobber --add alpha 10.72.147.249:6789
--print /tmp/mkcephfs.n6zx4y4y33/monmap
/usr/bin/monmaptool: monmap file /tmp/mkcephfs.n6zx4y4y33/monmap
/usr/bin/monmaptool: generated fsid d4173bb9-61c9-4339-a5fa-e1edfe143d2e
epoch 0
fsid d4173bb9-61c9-4339-a5fa-e1edfe143d2e
last_changed 2012-08-14 14:31:29.350163
created 2012-08-14 14:31:29.350163
0: 10.72.147.249:6789/0 mon.alpha
/usr/bin/monmaptool: writing epoch 0 to
/tmp/mkcephfs.n6zx4y4y33/monmap (1 monitors)
=== osd.0 ===
2012-08-14 14:31:29.390410 7fe3b920e780  ** ERROR: error creating
empty object store in /ceph_data/osd.0: (2) No such file or directory
failed: '/sbin/mkcephfs -d /tmp/mkcephfs.n6zx4y4y33 --init-daemon osd.0'
***********************************************************************************************************************************


i have followed following cmds to install ceph

wget -q -O- https://raw.github.com/ceph/ceph/master/keys/release.asc |
sudo apt-key add -

echo deb http://ceph.com/debian/ $(lsb_release -sc) main | sudo tee
/etc/apt/sources.list.d/ceph.list

wget -q -O- https://raw.github.com/ceph/ceph/master/keys/autobuild.asc
\ | sudo apt-key add -

echo deb http://gitbuilder.ceph.com/ceph-deb-$(lsb_release
-sc)-x86_64-basic/ref/{BRANCH} $(lsb_release -sc) main | sudo tee
/etc/apt/sources.list.d/ceph.list

sudo apt-get update && sudo apt-get install ceph

then i hv created ceph.conf file

after that i tried to deploy it with mkcephfs
and "sudo mkcephfs -a -c /etc/ceph/ceph.conf -k ceph.keyring" gives an
error as discussed .

Please help me out..

-Hemant Surale

Re: Ceph setup on single node : prob with "

[Tommi Virtanen]

On Tue, Aug 14, 2012 at 3:13 AM, hemant surale <hemant.surale@gmail.com> wrote:
> 2012-08-14 14:31:29.390410 7fe3b920e780  ** ERROR: error creating
> empty object store in /ceph_data/osd.0: (2) No such file or directory
> failed: '/sbin/mkcephfs -d /tmp/mkcephfs.n6zx4y4y33 --init-daemon osd.0'

Sounds like /ceph_data/osd.0 does not exist. You need mkdir it, and
you probably want to mount a disk there.

Re: Ceph setup on single node : prob with "

[hemant surale]

Hello Tommi, Ceph community

I did mkdir the directory. Infact I have created a new partition by
the same name and formatted using ext3. I also executed the following
command for the partition/directory:

"mount -o remount,user_xattr /"

Still I am getting the same error:
>> 2012-08-14 14:31:29.390410 7fe3b920e780  ** ERROR: error creating
>> empty object store in /ceph_data/osd.0: (2) No such file or directory
>> failed: '/sbin/mkcephfs -d /tmp/mkcephfs.n6zx4y4y33 --init-daemon osd.0'

Can you please help me out. I am using Ubuntu 12.04 with kernel version: 3.3.7

Do let me know if I am missing out on something. My college project is
stuck because of this issue. Please help me out.

Regards
Hemant


On Tue, Aug 14, 2012 at 9:41 PM, Tommi Virtanen <tv@inktank.com> wrote:
> On Tue, Aug 14, 2012 at 3:13 AM, hemant surale <hemant.surale@gmail.com> wrote:
>> 2012-08-14 14:31:29.390410 7fe3b920e780  ** ERROR: error creating
>> empty object store in /ceph_data/osd.0: (2) No such file or directory
>> failed: '/sbin/mkcephfs -d /tmp/mkcephfs.n6zx4y4y33 --init-daemon osd.0'
>
> Sounds like /ceph_data/osd.0 does not exist. You need mkdir it, and
> you probably want to mount a disk there.

Re: Ceph setup on single node : prob with "

[Mark Kirkwood]

On 16/08/12 16:44, hemant surale wrote:
> Hello Tommi, Ceph community
>
> I did mkdir the directory. Infact I have created a new partition by
> the same name and formatted using ext3. I also executed the following
> command for the partition/directory:
>
> "mount -o remount,user_xattr /"
>
> Still I am getting the same error:
>>> 2012-08-14 14:31:29.390410 7fe3b920e780  ** ERROR: error creating
>>> empty object store in /ceph_data/osd.0: (2) No such file or directory
>>> failed: '/sbin/mkcephfs -d /tmp/mkcephfs.n6zx4y4y33 --init-daemon osd.0'
> Can you please help me out. I am using Ubuntu 12.04 with kernel version: 3.3.7
>
> Do let me know if I am missing out on something. My college project is
> stuck because of this issue. Please help me out.
>
>

Hi Hermant,

The osd.o directory needs to be pre-created before you do mkcephfs, so 
you need to:

$ sudo mkdir /ceph_data/osd.0
$ sudo mkcephfs -a -c /etc/ceph/ceph.conf

Cheers

Mark

Re: Ceph setup on single node : prob with "

[hemant surale]

Hello Mark, Ceph community

I tried the suggested ceph.conf file as well and I continue to face
the same problem. Moreover, hemant-virtual-machine is a real host
(virtual machine).

Ceph version: 0.50.

Please guide me through this I continue to get the same frustrating error:

"=== osd.0 ===
2012-08-16 14:47:26.157823 7fde12e10780 -1  ** ERROR: error creating
empty objec            t store in /ceph_data/osd.0: (2) No such file
or directory
failed: '/sbin/mkcephfs -d /tmp/mkcephfs.YFCUqpT8Qh --init-daemon osd.0'
"

Looking forward to any other tricks that I could try. Please refer to
my previous emails to get a copy of my conf file and installation and
platform details.

regards
Hemant

On Thu, Aug 16, 2012 at 12:05 PM, Mark Kirkwood
<mark.kirkwood@catalyst.net.nz> wrote:
> On 16/08/12 17:36, hemant surale wrote:
>>
>> Still same problem sir. I have attached ceph.conf here. I tried to
>> google it as well but unable to figure out what exact error is.
>>
>>
>
> Hi your ceph.conf have a few errors: any names *must* be real hosts - e.g
> myserver01 must be real. Also you can't have xxx.alpha... I am guessing that
> should be myserver01...unless they should all be hemant-virtual-machine (see
> suggestions attached).
>
> You may need to specify directory for mds too (I am not using any)...with
> some edits I can do a mkcephfs with the attached file on my system - I was
> reproducing your error with yours. Enjoy (I am off home).
>
> Cheers
>
> Mark
>
>
>

Re: Ceph setup on single node : prob with "

[Tommi Virtanen]

On Wed, Aug 15, 2012 at 9:44 PM, hemant surale <hemant.surale@gmail.com> wrote:
> Hello Tommi, Ceph community
>
> I did mkdir the directory. Infact I have created a new partition by
> the same name and formatted using ext3. I also executed the following
> command for the partition/directory:
>
> "mount -o remount,user_xattr /"

Remounting root with extended attributes isn't really relevant; what
you care about is /ceph_data/osd.0.

Please share output of

mount
ls /ceph_data/osd.0

Re: Ceph setup on single node : prob with "

[Mark Kirkwood]

[-- Attachment #1: Type: text/plain, Size: 878 bytes --]

On 17/08/12 04:13, Tommi Virtanen wrote:
> On Wed, Aug 15, 2012 at 9:44 PM, hemant surale <hemant.surale@gmail.com> wrote:
>> Hello Tommi, Ceph community
>>
>> I did mkdir the directory. Infact I have created a new partition by
>> the same name and formatted using ext3. I also executed the following
>> command for the partition/directory:
>>
>> "mount -o remount,user_xattr /"
> Remounting root with extended attributes isn't really relevant; what
> you care about is /ceph_data/osd.0.
>
> Please share output of
>
> mount
> ls /ceph_data/osd.0
> --
>

Also I think there are a few things wrong with his ceph.conf (see 
attached....was sent to me in private email).

I think he needs to:
- correct bogus host entries (myserver01, alpha)
- specify keyring for mds

Making these changes (with hostnames appropriate for my setup) I can 
mkcephfs with his ceph.conf

Cheers

Mark

[-- Attachment #2: ceph.conf --]
[-- Type: text/plain, Size: 431 bytes --]

[global]
       auth supported = cephx
       keyring = /etc/ceph/ceph.keyring

[mon]
        mon data = /ceph_data/mon.$id

[mds]

[osd]
        osd data = /ceph_data/osd.$id
        osd journal = /ceph_data/osd.$id.journal
        osd journal size = 1000

[mon.alpha]
        host = myserver01
        mon addr = 10.72.147.249:6789

[osd.0]
        host = hemant-virtual-machine

[mds.0]
        host = hemant-virtual-machine

Re: Ceph setup on single node : prob with "

[hemant surale]

Thank you Sir for your great help . Finally ceph is up and working.
Now I will move to run it on cluster of 3 nodes(VMs)
and I need to start instrumenting the code .


Regards,
Hemant

On Fri, Aug 17, 2012 at 3:31 AM, Mark Kirkwood
<mark.kirkwood@catalyst.net.nz> wrote:
> On 17/08/12 04:13, Tommi Virtanen wrote:
>>
>> On Wed, Aug 15, 2012 at 9:44 PM, hemant surale <hemant.surale@gmail.com>
>> wrote:
>>>
>>> Hello Tommi, Ceph community
>>>
>>> I did mkdir the directory. Infact I have created a new partition by
>>> the same name and formatted using ext3. I also executed the following
>>> command for the partition/directory:
>>>
>>> "mount -o remount,user_xattr /"
>>
>> Remounting root with extended attributes isn't really relevant; what
>> you care about is /ceph_data/osd.0.
>>
>> Please share output of
>>
>> mount
>> ls /ceph_data/osd.0
>> --
>>
>
> Also I think there are a few things wrong with his ceph.conf (see
> attached....was sent to me in private email).
>
> I think he needs to:
> - correct bogus host entries (myserver01, alpha)
> - specify keyring for mds
>
> Making these changes (with hostnames appropriate for my setup) I can
> mkcephfs with his ceph.conf
>
> Cheers
>
> Mark