Re: ceph mkfs failed

[Dan Mick <dan.mick@inktank.com>]

On 02/07/2013 09:59 AM, sheng qiu wrote:
> Hi,
>
> i am trying to port a local file system other than ext3,ext4,btrfs to
> manage the OSD. There are some reasons for us to do it.
> the mkcephfs stopped at this point:
>
> 2013-02-07 11:39:32.009889 7effe43d17a0 -1 filestore(/mnt/osd.0) mkfs
> failed to create leveldb: IO error:
> /mnt/osd.0/current/omap/MANIFEST-000001: Invalid argument
> 2013-02-07 11:39:32.009907 7effe43d17a0 -1 OSD::mkfs: FileStore::mkfs
> failed with error -1
> 2013-02-07 11:39:32.009949 7effe43d17a0 -1  ** ERROR: error creating
> empty object store in /mnt/osd.0: (1) Operation not permitted

Does your ssh user have permission to create dirs in /mnt?
(I'll grant you it looks like you're doing root, but, still)

> failed: 'ssh root@mon-mds /usr/local/sbin/mkcephfs -d
> /tmp/mkfs.ceph.2686 --init-daemon osd.0'

You could certainly try this command on the failing system as root,
and look with strace to see what system call is actually failing.

>
> look into the code, it failed at os/FileStore.cc -->  leveldb::Status
> status = leveldb::DB::Open(options, omap_dir, &db);
>
> Does anyone have any suggestions?
>
> Thanks,
> Sheng
>