ceph init script does not start

[Xiaopong Tran <xiaopong.tran@gmail.com>]

[-- Attachment #1: Type: text/plain, Size: 1424 bytes --]

Hi,

I'm getting this funny issue. I had setup two test clusters, and
mkcephfs and the ceph start up script worked just fine. We are
now ready to go production, we have 6 nodes, with 10 disks
each, and one osd per disk, with 3 mds and 3 mons.

The script mkcephfs ran without problem, everything was created
properly. See attached log file. However, when I run

/etc/init.d/ceph start

nothing happens, not even a line of message, not on concole,
neither in system log.

But can I manually start up each individual osd, mds, and mon.

Here is more information:

root@s100001:~# ceph health
HEALTH_OK
root@s100001:~# ceph -s
    health HEALTH_OK
    monmap e1: 3 mons at 
{a=10.1.0.11:6789/0,b=10.1.0.13:6789/0,c=10.1.0.15:6789/0}, election 
epoch 6, quorum 0,1,2 a,b,c
    osdmap e24: 60 osds: 60 up, 60 in
     pgmap v143: 11520 pgs: 11520 active+clean; 8730 bytes data, 242 GB 
used, 83552 GB / 83794 GB avail
    mdsmap e6: 1/1/1 up {0=c=up:active}, 2 up:standby

root@s100001:~# ceph -v
ceph version 0.48argonaut (commit:c2b20ca74249892c8e5e40c12aa14446a2bf2030)
root@s100001:~#

The only difference this time vs the time when I setup
the test clusters was that, for the test clusters,
I started with 0.47.3 (and one of the cluster did
a rolling upgrade to 0.48), but for this, all machines
started from fresh, with 0.48.

This is on Debian wheezy.

Can someone give a hint where else can I look into?

Thanks

Xiaopong

[-- Attachment #2: mkcephfs-log.4.txt --]
[-- Type: text/plain, Size: 67066 bytes --]

root@s100001:~# mkcephfs -v -a -c ceph.conf -k /etc/ceph/client.admin.keyring
temp dir is /tmp/mkcephfs.bznTC6oijI
preparing monmap in /tmp/mkcephfs.bznTC6oijI/monmap
/usr/bin/monmaptool --create --clobber --add a 10.1.0.11:6789 --add b 10.1.0.13:6789 --add c 10.1.0.15:6789 --print /tmp/mkcephfs.bznTC6oijI/monmap
/usr/bin/monmaptool: monmap file /tmp/mkcephfs.bznTC6oijI/monmap
/usr/bin/monmaptool: generated fsid 6571669f-a182-4b18-9972-b127c0cee176
epoch 0
fsid 6571669f-a182-4b18-9972-b127c0cee176
last_changed 2012-07-14 15:48:24.463115
created 2012-07-14 15:48:24.463115
0: 10.1.0.11:6789/0 mon.a
1: 10.1.0.13:6789/0 mon.b
2: 10.1.0.15:6789/0 mon.c
/usr/bin/monmaptool: writing epoch 0 to /tmp/mkcephfs.bznTC6oijI/monmap (3 monitors)
/usr/bin/ceph-conf -c ceph.conf -n osd.0 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.0 "ssh path"
=== osd.0 === 
pushing conf and monmap to s100001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.0"
2012-07-14 15:48:25.313236 7f31c6b10780 -1 filestore(/disk1/osd.0) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:25.811898 7f31c6b10780 -1 created object store /disk1/osd.0 journal /disk1/osd.0.journal for osd.0 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.0 keyring /etc/ceph/osd.0.keyring
creating /etc/ceph/osd.0.keyring
collecting osd.0 key
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.1 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.1 "ssh path"
=== osd.1 === 
pushing conf and monmap to s100001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.1"
2012-07-14 15:48:26.893151 7f6f4139b780 -1 filestore(/disk2/osd.1) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:27.494302 7f6f4139b780 -1 created object store /disk2/osd.1 journal /disk2/osd.1.journal for osd.1 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.1 keyring /etc/ceph/osd.1.keyring
creating /etc/ceph/osd.1.keyring
collecting osd.1 key
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.10 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.10 "ssh path"
=== osd.10 === 
pushing conf and monmap to s200001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.10"
2012-07-14 15:48:28.388166 7f37b39cd780 -1 filestore(/disk1/osd.10) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:28.966189 7f37b39cd780 -1 created object store /disk1/osd.10 journal /disk1/osd.10.journal for osd.10 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.10 keyring /etc/ceph/osd.10.keyring
creating /etc/ceph/osd.10.keyring
collecting osd.10 key
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.11 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.11 "ssh path"
=== osd.11 === 
pushing conf and monmap to s200001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.11"
2012-07-14 15:48:30.056925 7fc9d015a780 -1 filestore(/disk2/osd.11) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:30.690886 7fc9d015a780 -1 created object store /disk2/osd.11 journal /disk2/osd.11.journal for osd.11 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.11 keyring /etc/ceph/osd.11.keyring
creating /etc/ceph/osd.11.keyring
collecting osd.11 key
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.12 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.12 "ssh path"
=== osd.12 === 
pushing conf and monmap to s200001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.12"
2012-07-14 15:48:31.803712 7f5aa8cb4780 -1 filestore(/disk3/osd.12) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:32.398266 7f5aa8cb4780 -1 created object store /disk3/osd.12 journal /disk3/osd.12.journal for osd.12 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.12 keyring /etc/ceph/osd.12.keyring
creating /etc/ceph/osd.12.keyring
collecting osd.12 key
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.13 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.13 "ssh path"
=== osd.13 === 
pushing conf and monmap to s200001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.13"
2012-07-14 15:48:33.481285 7f165b667780 -1 filestore(/disk4/osd.13) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:34.222897 7f165b667780 -1 created object store /disk4/osd.13 journal /disk4/osd.13.journal for osd.13 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.13 keyring /etc/ceph/osd.13.keyring
creating /etc/ceph/osd.13.keyring
collecting osd.13 key
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.14 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.14 "ssh path"
=== osd.14 === 
pushing conf and monmap to s200001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.14"
2012-07-14 15:48:35.319978 7f43077fc780 -1 filestore(/disk5/osd.14) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:36.038893 7f43077fc780 -1 created object store /disk5/osd.14 journal /disk5/osd.14.journal for osd.14 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.14 keyring /etc/ceph/osd.14.keyring
creating /etc/ceph/osd.14.keyring
collecting osd.14 key
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.15 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.15 "ssh path"
=== osd.15 === 
pushing conf and monmap to s200001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.15"
2012-07-14 15:48:37.175935 7f3f14fba780 -1 filestore(/disk6/osd.15) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:37.904725 7f3f14fba780 -1 created object store /disk6/osd.15 journal /disk6/osd.15.journal for osd.15 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.15 keyring /etc/ceph/osd.15.keyring
creating /etc/ceph/osd.15.keyring
collecting osd.15 key
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.16 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.16 "ssh path"
=== osd.16 === 
pushing conf and monmap to s200001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.16"
2012-07-14 15:48:38.992677 7f18a065d780 -1 filestore(/disk7/osd.16) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:39.728936 7f18a065d780 -1 created object store /disk7/osd.16 journal /disk7/osd.16.journal for osd.16 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.16 keyring /etc/ceph/osd.16.keyring
creating /etc/ceph/osd.16.keyring
collecting osd.16 key
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.17 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.17 "ssh path"
=== osd.17 === 
pushing conf and monmap to s200001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.17"
2012-07-14 15:48:40.846730 7f522f076780 -1 filestore(/disk8/osd.17) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:41.578006 7f522f076780 -1 created object store /disk8/osd.17 journal /disk8/osd.17.journal for osd.17 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.17 keyring /etc/ceph/osd.17.keyring
creating /etc/ceph/osd.17.keyring
collecting osd.17 key
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.18 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.18 "ssh path"
=== osd.18 === 
pushing conf and monmap to s200001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.18"
2012-07-14 15:48:42.637817 7fe693ac7780 -1 filestore(/disk9/osd.18) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:43.344346 7fe693ac7780 -1 created object store /disk9/osd.18 journal /disk9/osd.18.journal for osd.18 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.18 keyring /etc/ceph/osd.18.keyring
creating /etc/ceph/osd.18.keyring
collecting osd.18 key
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.19 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.19 "ssh path"
=== osd.19 === 
pushing conf and monmap to s200001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.19"
2012-07-14 15:48:44.433468 7f5d02a9b780 -1 filestore(/disk10/osd.19) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:45.200236 7f5d02a9b780 -1 created object store /disk10/osd.19 journal /disk10/osd.19.journal for osd.19 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.19 keyring /etc/ceph/osd.19.keyring
creating /etc/ceph/osd.19.keyring
collecting osd.19 key
--- ssh s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.2 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.2 "ssh path"
=== osd.2 === 
pushing conf and monmap to s100001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.2"
2012-07-14 15:48:46.475014 7ff348212780 -1 filestore(/disk3/osd.2) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:47.053322 7ff348212780 -1 created object store /disk3/osd.2 journal /disk3/osd.2.journal for osd.2 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.2 keyring /etc/ceph/osd.2.keyring
creating /etc/ceph/osd.2.keyring
collecting osd.2 key
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.20 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.20 "ssh path"
=== osd.20 === 
pushing conf and monmap to s300001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.20"
2012-07-14 15:48:47.865149 7f034204b780 -1 filestore(/disk1/osd.20) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:48.446104 7f034204b780 -1 created object store /disk1/osd.20 journal /disk1/osd.20.journal for osd.20 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.20 keyring /etc/ceph/osd.20.keyring
creating /etc/ceph/osd.20.keyring
collecting osd.20 key
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.21 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.21 "ssh path"
=== osd.21 === 
pushing conf and monmap to s300001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.21"
2012-07-14 15:48:49.541871 7f59b7cfa780 -1 filestore(/disk2/osd.21) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:50.111906 7f59b7cfa780 -1 created object store /disk2/osd.21 journal /disk2/osd.21.journal for osd.21 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.21 keyring /etc/ceph/osd.21.keyring
creating /etc/ceph/osd.21.keyring
collecting osd.21 key
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.22 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.22 "ssh path"
=== osd.22 === 
pushing conf and monmap to s300001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.22"
2012-07-14 15:48:51.221038 7fdcdbc4e780 -1 filestore(/disk3/osd.22) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:51.844443 7fdcdbc4e780 -1 created object store /disk3/osd.22 journal /disk3/osd.22.journal for osd.22 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.22 keyring /etc/ceph/osd.22.keyring
creating /etc/ceph/osd.22.keyring
collecting osd.22 key
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.23 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.23 "ssh path"
=== osd.23 === 
pushing conf and monmap to s300001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.23"
2012-07-14 15:48:52.919827 7f0b7463c780 -1 filestore(/disk4/osd.23) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:53.594057 7f0b7463c780 -1 created object store /disk4/osd.23 journal /disk4/osd.23.journal for osd.23 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.23 keyring /etc/ceph/osd.23.keyring
creating /etc/ceph/osd.23.keyring
collecting osd.23 key
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.24 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.24 "ssh path"
=== osd.24 === 
pushing conf and monmap to s300001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.24"
2012-07-14 15:48:54.690692 7f29c1be9780 -1 filestore(/disk5/osd.24) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:55.310078 7f29c1be9780 -1 created object store /disk5/osd.24 journal /disk5/osd.24.journal for osd.24 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.24 keyring /etc/ceph/osd.24.keyring
creating /etc/ceph/osd.24.keyring
collecting osd.24 key
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.25 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.25 "ssh path"
=== osd.25 === 
pushing conf and monmap to s300001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.25"
2012-07-14 15:48:56.400032 7fca828d9780 -1 filestore(/disk6/osd.25) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:57.026239 7fca828d9780 -1 created object store /disk6/osd.25 journal /disk6/osd.25.journal for osd.25 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.25 keyring /etc/ceph/osd.25.keyring
creating /etc/ceph/osd.25.keyring
collecting osd.25 key
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.26 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.26 "ssh path"
=== osd.26 === 
pushing conf and monmap to s300001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.26"
2012-07-14 15:48:58.096614 7fbe9ea0e780 -1 filestore(/disk7/osd.26) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:48:58.791897 7fbe9ea0e780 -1 created object store /disk7/osd.26 journal /disk7/osd.26.journal for osd.26 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.26 keyring /etc/ceph/osd.26.keyring
creating /etc/ceph/osd.26.keyring
collecting osd.26 key
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.27 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.27 "ssh path"
=== osd.27 === 
pushing conf and monmap to s300001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.27"
2012-07-14 15:48:59.889675 7fa48fd76780 -1 filestore(/disk8/osd.27) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:00.574735 7fa48fd76780 -1 created object store /disk8/osd.27 journal /disk8/osd.27.journal for osd.27 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.27 keyring /etc/ceph/osd.27.keyring
creating /etc/ceph/osd.27.keyring
collecting osd.27 key
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.28 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.28 "ssh path"
=== osd.28 === 
pushing conf and monmap to s300001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.28"
2012-07-14 15:49:01.661160 7fa794dd5780 -1 filestore(/disk9/osd.28) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:02.332095 7fa794dd5780 -1 created object store /disk9/osd.28 journal /disk9/osd.28.journal for osd.28 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.28 keyring /etc/ceph/osd.28.keyring
creating /etc/ceph/osd.28.keyring
collecting osd.28 key
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.29 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.29 "ssh path"
=== osd.29 === 
pushing conf and monmap to s300001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.29"
2012-07-14 15:49:03.458921 7fbbf2404780 -1 filestore(/disk10/osd.29) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:04.159086 7fbbf2404780 -1 created object store /disk10/osd.29 journal /disk10/osd.29.journal for osd.29 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.29 keyring /etc/ceph/osd.29.keyring
creating /etc/ceph/osd.29.keyring
collecting osd.29 key
--- ssh s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.3 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.3 "ssh path"
=== osd.3 === 
pushing conf and monmap to s100001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.3"
2012-07-14 15:49:05.511615 7f9a013bd780 -1 filestore(/disk4/osd.3) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:06.129068 7f9a013bd780 -1 created object store /disk4/osd.3 journal /disk4/osd.3.journal for osd.3 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.3 keyring /etc/ceph/osd.3.keyring
creating /etc/ceph/osd.3.keyring
collecting osd.3 key
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.30 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.30 "ssh path"
=== osd.30 === 
pushing conf and monmap to s100002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.30"
2012-07-14 15:49:07.487329 7fe9b9154780 -1 filestore(/disk1/osd.30) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:07.950743 7fe9b9154780 -1 created object store /disk1/osd.30 journal /disk1/osd.30.journal for osd.30 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.30 keyring /etc/ceph/osd.30.keyring
creating /etc/ceph/osd.30.keyring
collecting osd.30 key
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.31 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.31 "ssh path"
=== osd.31 === 
pushing conf and monmap to s100002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.31"
2012-07-14 15:49:09.074167 7ff15fda5780 -1 filestore(/disk2/osd.31) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:09.658302 7ff15fda5780 -1 created object store /disk2/osd.31 journal /disk2/osd.31.journal for osd.31 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.31 keyring /etc/ceph/osd.31.keyring
creating /etc/ceph/osd.31.keyring
collecting osd.31 key
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.32 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.32 "ssh path"
=== osd.32 === 
pushing conf and monmap to s100002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.32"
2012-07-14 15:49:10.815133 7f55650fc780 -1 filestore(/disk3/osd.32) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:11.382636 7f55650fc780 -1 created object store /disk3/osd.32 journal /disk3/osd.32.journal for osd.32 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.32 keyring /etc/ceph/osd.32.keyring
creating /etc/ceph/osd.32.keyring
collecting osd.32 key
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.33 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.33 "ssh path"
=== osd.33 === 
pushing conf and monmap to s100002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.33"
2012-07-14 15:49:12.504503 7fc87edc0780 -1 filestore(/disk4/osd.33) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:13.065339 7fc87edc0780 -1 created object store /disk4/osd.33 journal /disk4/osd.33.journal for osd.33 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.33 keyring /etc/ceph/osd.33.keyring
creating /etc/ceph/osd.33.keyring
collecting osd.33 key
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.34 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.34 "ssh path"
=== osd.34 === 
pushing conf and monmap to s100002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.34"
2012-07-14 15:49:14.194105 7f119d946780 -1 filestore(/disk5/osd.34) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:14.756342 7f119d946780 -1 created object store /disk5/osd.34 journal /disk5/osd.34.journal for osd.34 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.34 keyring /etc/ceph/osd.34.keyring
creating /etc/ceph/osd.34.keyring
collecting osd.34 key
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.35 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.35 "ssh path"
=== osd.35 === 
pushing conf and monmap to s100002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.35"
2012-07-14 15:49:15.834317 7fa005648780 -1 filestore(/disk6/osd.35) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:16.414173 7fa005648780 -1 created object store /disk6/osd.35 journal /disk6/osd.35.journal for osd.35 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.35 keyring /etc/ceph/osd.35.keyring
creating /etc/ceph/osd.35.keyring
collecting osd.35 key
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.36 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.36 "ssh path"
=== osd.36 === 
pushing conf and monmap to s100002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.36"
2012-07-14 15:49:17.541767 7f14f1a67780 -1 filestore(/disk7/osd.36) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:18.163618 7f14f1a67780 -1 created object store /disk7/osd.36 journal /disk7/osd.36.journal for osd.36 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.36 keyring /etc/ceph/osd.36.keyring
creating /etc/ceph/osd.36.keyring
collecting osd.36 key
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.37 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.37 "ssh path"
=== osd.37 === 
pushing conf and monmap to s100002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.37"
2012-07-14 15:49:19.285589 7fa92e573780 -1 filestore(/disk8/osd.37) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:19.904214 7fa92e573780 -1 created object store /disk8/osd.37 journal /disk8/osd.37.journal for osd.37 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.37 keyring /etc/ceph/osd.37.keyring
creating /etc/ceph/osd.37.keyring
collecting osd.37 key
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.38 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.38 "ssh path"
=== osd.38 === 
pushing conf and monmap to s100002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.38"
2012-07-14 15:49:21.022614 7face3654780 -1 filestore(/disk9/osd.38) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:21.637093 7face3654780 -1 created object store /disk9/osd.38 journal /disk9/osd.38.journal for osd.38 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.38 keyring /etc/ceph/osd.38.keyring
creating /etc/ceph/osd.38.keyring
collecting osd.38 key
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.39 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.39 "ssh path"
=== osd.39 === 
pushing conf and monmap to s100002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.39"
2012-07-14 15:49:22.724265 7effbd047780 -1 filestore(/disk10/osd.39) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:23.366055 7effbd047780 -1 created object store /disk10/osd.39 journal /disk10/osd.39.journal for osd.39 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.39 keyring /etc/ceph/osd.39.keyring
creating /etc/ceph/osd.39.keyring
collecting osd.39 key
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.4 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.4 "ssh path"
=== osd.4 === 
pushing conf and monmap to s100001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.4"
2012-07-14 15:49:24.202810 7ff32f088780 -1 filestore(/disk5/osd.4) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:24.788601 7ff32f088780 -1 created object store /disk5/osd.4 journal /disk5/osd.4.journal for osd.4 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.4 keyring /etc/ceph/osd.4.keyring
creating /etc/ceph/osd.4.keyring
collecting osd.4 key
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.40 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.40 "ssh path"
=== osd.40 === 
pushing conf and monmap to s200002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.40"
2012-07-14 15:49:25.936556 7ff0eeba3780 -1 filestore(/disk1/osd.40) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:26.361372 7ff0eeba3780 -1 created object store /disk1/osd.40 journal /disk1/osd.40.journal for osd.40 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.40 keyring /etc/ceph/osd.40.keyring
creating /etc/ceph/osd.40.keyring
collecting osd.40 key
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.41 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.41 "ssh path"
=== osd.41 === 
pushing conf and monmap to s200002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.41"
2012-07-14 15:49:27.519299 7f87d83a6780 -1 filestore(/disk2/osd.41) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:28.127400 7f87d83a6780 -1 created object store /disk2/osd.41 journal /disk2/osd.41.journal for osd.41 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.41 keyring /etc/ceph/osd.41.keyring
creating /etc/ceph/osd.41.keyring
collecting osd.41 key
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.42 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.42 "ssh path"
=== osd.42 === 
pushing conf and monmap to s200002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.42"
2012-07-14 15:49:29.232001 7f412f5a2780 -1 filestore(/disk3/osd.42) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:29.793353 7f412f5a2780 -1 created object store /disk3/osd.42 journal /disk3/osd.42.journal for osd.42 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.42 keyring /etc/ceph/osd.42.keyring
creating /etc/ceph/osd.42.keyring
collecting osd.42 key
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.43 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.43 "ssh path"
=== osd.43 === 
pushing conf and monmap to s200002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.43"
2012-07-14 15:49:30.915057 7f2fc2d30780 -1 filestore(/disk4/osd.43) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:31.500816 7f2fc2d30780 -1 created object store /disk4/osd.43 journal /disk4/osd.43.journal for osd.43 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.43 keyring /etc/ceph/osd.43.keyring
creating /etc/ceph/osd.43.keyring
collecting osd.43 key
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.44 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.44 "ssh path"
=== osd.44 === 
pushing conf and monmap to s200002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.44"
2012-07-14 15:49:32.638352 7fbf03343780 -1 filestore(/disk5/osd.44) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:33.241881 7fbf03343780 -1 created object store /disk5/osd.44 journal /disk5/osd.44.journal for osd.44 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.44 keyring /etc/ceph/osd.44.keyring
creating /etc/ceph/osd.44.keyring
collecting osd.44 key
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.45 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.45 "ssh path"
=== osd.45 === 
pushing conf and monmap to s200002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.45"
2012-07-14 15:49:34.362826 7fc7676f5780 -1 filestore(/disk6/osd.45) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:35.007834 7fc7676f5780 -1 created object store /disk6/osd.45 journal /disk6/osd.45.journal for osd.45 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.45 keyring /etc/ceph/osd.45.keyring
creating /etc/ceph/osd.45.keyring
collecting osd.45 key
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.46 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.46 "ssh path"
=== osd.46 === 
pushing conf and monmap to s200002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.46"
2012-07-14 15:49:36.121322 7f5a29d19780 -1 filestore(/disk7/osd.46) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:36.732058 7f5a29d19780 -1 created object store /disk7/osd.46 journal /disk7/osd.46.journal for osd.46 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.46 keyring /etc/ceph/osd.46.keyring
creating /etc/ceph/osd.46.keyring
collecting osd.46 key
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.47 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.47 "ssh path"
=== osd.47 === 
pushing conf and monmap to s200002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.47"
2012-07-14 15:49:37.873373 7fc84867e780 -1 filestore(/disk8/osd.47) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:38.464687 7fc84867e780 -1 created object store /disk8/osd.47 journal /disk8/osd.47.journal for osd.47 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.47 keyring /etc/ceph/osd.47.keyring
creating /etc/ceph/osd.47.keyring
collecting osd.47 key
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.48 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.48 "ssh path"
=== osd.48 === 
pushing conf and monmap to s200002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.48"
2012-07-14 15:49:39.625379 7f4a661d2780 -1 filestore(/disk9/osd.48) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:40.272287 7f4a661d2780 -1 created object store /disk9/osd.48 journal /disk9/osd.48.journal for osd.48 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.48 keyring /etc/ceph/osd.48.keyring
creating /etc/ceph/osd.48.keyring
collecting osd.48 key
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.49 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.49 "ssh path"
=== osd.49 === 
pushing conf and monmap to s200002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.49"
2012-07-14 15:49:41.370501 7f6978c4c780 -1 filestore(/disk10/osd.49) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:41.912047 7f6978c4c780 -1 created object store /disk10/osd.49 journal /disk10/osd.49.journal for osd.49 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.49 keyring /etc/ceph/osd.49.keyring
creating /etc/ceph/osd.49.keyring
collecting osd.49 key
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.5 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.5 "ssh path"
=== osd.5 === 
pushing conf and monmap to s100001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.5"
2012-07-14 15:49:42.939597 7f0bb2402780 -1 filestore(/disk6/osd.5) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:43.548194 7f0bb2402780 -1 created object store /disk6/osd.5 journal /disk6/osd.5.journal for osd.5 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.5 keyring /etc/ceph/osd.5.keyring
creating /etc/ceph/osd.5.keyring
collecting osd.5 key
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.50 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.50 "ssh path"
=== osd.50 === 
pushing conf and monmap to s300002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.50"
2012-07-14 15:49:43.525415 7fd611597780 -1 filestore(/disk1/osd.50) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:43.971145 7fd611597780 -1 created object store /disk1/osd.50 journal /disk1/osd.50.journal for osd.50 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.50 keyring /etc/ceph/osd.50.keyring
creating /etc/ceph/osd.50.keyring
collecting osd.50 key
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.51 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.51 "ssh path"
=== osd.51 === 
pushing conf and monmap to s300002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.51"
2012-07-14 15:49:45.087939 7f9f5cdf8780 -1 filestore(/disk2/osd.51) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:45.653669 7f9f5cdf8780 -1 created object store /disk2/osd.51 journal /disk2/osd.51.journal for osd.51 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.51 keyring /etc/ceph/osd.51.keyring
creating /etc/ceph/osd.51.keyring
collecting osd.51 key
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.52 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.52 "ssh path"
=== osd.52 === 
pushing conf and monmap to s300002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.52"
2012-07-14 15:49:46.767933 7f94c772c780 -1 filestore(/disk3/osd.52) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:47.336514 7f94c772c780 -1 created object store /disk3/osd.52 journal /disk3/osd.52.journal for osd.52 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.52 keyring /etc/ceph/osd.52.keyring
creating /etc/ceph/osd.52.keyring
collecting osd.52 key
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.53 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.53 "ssh path"
=== osd.53 === 
pushing conf and monmap to s300002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.53"
2012-07-14 15:49:48.473450 7fb1cdc86780 -1 filestore(/disk4/osd.53) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:49.044202 7fb1cdc86780 -1 created object store /disk4/osd.53 journal /disk4/osd.53.journal for osd.53 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.53 keyring /etc/ceph/osd.53.keyring
creating /etc/ceph/osd.53.keyring
collecting osd.53 key
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.54 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.54 "ssh path"
=== osd.54 === 
pushing conf and monmap to s300002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.54"
2012-07-14 15:49:50.142994 7fd130b8e780 -1 filestore(/disk5/osd.54) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:50.726521 7fd130b8e780 -1 created object store /disk5/osd.54 journal /disk5/osd.54.journal for osd.54 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.54 keyring /etc/ceph/osd.54.keyring
creating /etc/ceph/osd.54.keyring
collecting osd.54 key
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.55 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.55 "ssh path"
=== osd.55 === 
pushing conf and monmap to s300002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.55"
2012-07-14 15:49:51.895842 7fb2f39e9780 -1 filestore(/disk6/osd.55) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:52.509483 7fb2f39e9780 -1 created object store /disk6/osd.55 journal /disk6/osd.55.journal for osd.55 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.55 keyring /etc/ceph/osd.55.keyring
creating /etc/ceph/osd.55.keyring
collecting osd.55 key
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.56 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.56 "ssh path"
=== osd.56 === 
pushing conf and monmap to s300002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.56"
2012-07-14 15:49:53.615837 7f630223e780 -1 filestore(/disk7/osd.56) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:54.275580 7f630223e780 -1 created object store /disk7/osd.56 journal /disk7/osd.56.journal for osd.56 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.56 keyring /etc/ceph/osd.56.keyring
creating /etc/ceph/osd.56.keyring
collecting osd.56 key
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.57 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.57 "ssh path"
=== osd.57 === 
pushing conf and monmap to s300002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.57"
2012-07-14 15:49:55.399723 7f4831961780 -1 filestore(/disk8/osd.57) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:56.041178 7f4831961780 -1 created object store /disk8/osd.57 journal /disk8/osd.57.journal for osd.57 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.57 keyring /etc/ceph/osd.57.keyring
creating /etc/ceph/osd.57.keyring
collecting osd.57 key
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.58 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.58 "ssh path"
=== osd.58 === 
pushing conf and monmap to s300002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.58"
2012-07-14 15:49:57.172618 7f85fa722780 -1 filestore(/disk9/osd.58) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:57.857354 7f85fa722780 -1 created object store /disk9/osd.58 journal /disk9/osd.58.journal for osd.58 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.58 keyring /etc/ceph/osd.58.keyring
creating /etc/ceph/osd.58.keyring
collecting osd.58 key
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.59 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.59 "ssh path"
=== osd.59 === 
pushing conf and monmap to s300002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.59"
2012-07-14 15:49:58.986045 7ff752855780 -1 filestore(/disk10/osd.59) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:49:59.677643 7ff752855780 -1 created object store /disk10/osd.59 journal /disk10/osd.59.journal for osd.59 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.59 keyring /etc/ceph/osd.59.keyring
creating /etc/ceph/osd.59.keyring
collecting osd.59 key
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.6 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.6 "ssh path"
=== osd.6 === 
pushing conf and monmap to s100001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.6"
2012-07-14 15:50:01.943873 7f199f2e4780 -1 filestore(/disk7/osd.6) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:50:02.615657 7f199f2e4780 -1 created object store /disk7/osd.6 journal /disk7/osd.6.journal for osd.6 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.6 keyring /etc/ceph/osd.6.keyring
creating /etc/ceph/osd.6.keyring
collecting osd.6 key
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.7 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.7 "ssh path"
=== osd.7 === 
pushing conf and monmap to s100001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.7"
2012-07-14 15:50:03.821037 7f25bdb19780 -1 filestore(/disk8/osd.7) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:50:04.556501 7f25bdb19780 -1 created object store /disk8/osd.7 journal /disk8/osd.7.journal for osd.7 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.7 keyring /etc/ceph/osd.7.keyring
creating /etc/ceph/osd.7.keyring
collecting osd.7 key
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.8 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.8 "ssh path"
=== osd.8 === 
pushing conf and monmap to s100001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.8"
2012-07-14 15:50:05.660470 7fb744b73780 -1 filestore(/disk9/osd.8) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:50:06.297331 7fb744b73780 -1 created object store /disk9/osd.8 journal /disk9/osd.8.journal for osd.8 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.8 keyring /etc/ceph/osd.8.keyring
creating /etc/ceph/osd.8.keyring
collecting osd.8 key
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n osd.9 "user"
/usr/bin/ceph-conf -c ceph.conf -n osd.9 "ssh path"
=== osd.9 === 
pushing conf and monmap to s100001.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon osd.9"
2012-07-14 15:50:07.371095 7fa90ce8f780 -1 filestore(/disk10/osd.9) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2012-07-14 15:50:08.029333 7fa90ce8f780 -1 created object store /disk10/osd.9 journal /disk10/osd.9.journal for osd.9 fsid 6571669f-a182-4b18-9972-b127c0cee176
creating private key for osd.9 keyring /etc/ceph/osd.9.keyring
creating /etc/ceph/osd.9.keyring
collecting osd.9 key
--- ssh s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n mds.a "user"
/usr/bin/ceph-conf -c ceph.conf -n mds.a "ssh path"
=== mds.a === 
pushing conf and monmap to s100002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon mds.a"
creating private key for mds.a keyring /etc/ceph/mds.a.keyring
creating /etc/ceph/mds.a.keyring
collecting mds.a key
--- ssh s100002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n mds.b "user"
/usr/bin/ceph-conf -c ceph.conf -n mds.b "ssh path"
=== mds.b === 
pushing conf and monmap to s200002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon mds.b"
creating private key for mds.b keyring /etc/ceph/mds.b.keyring
creating /etc/ceph/mds.b.keyring
collecting mds.b key
--- ssh s200002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
/usr/bin/ceph-conf -c ceph.conf -n mds.c "user"
/usr/bin/ceph-conf -c ceph.conf -n mds.c "ssh path"
=== mds.c === 
pushing conf and monmap to s300002.inneryun.io:/tmp/mkfs.ceph.8532
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; mkdir -p /tmp/mkfs.ceph.8532"
--- ssh root@s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon mds.c"
creating private key for mds.c keyring /etc/ceph/mds.c.keyring
creating /etc/ceph/mds.c.keyring
collecting mds.c key
--- ssh s300002.inneryun.io  "cd /root ; ulimit -c unlimited ; rm -r /tmp/mkfs.ceph.8532"
Building generic osdmap from /tmp/mkcephfs.bznTC6oijI/conf
/usr/bin/osdmaptool: osdmap file '/tmp/mkcephfs.bznTC6oijI/osdmap'
/usr/bin/osdmaptool: writing epoch 1 to /tmp/mkcephfs.bznTC6oijI/osdmap
Generating admin key at /tmp/mkcephfs.bznTC6oijI/keyring.admin
creating /tmp/mkcephfs.bznTC6oijI/keyring.admin
Building initial monitor keyring
added entity mds.a auth auth(auid = 18446744073709551615 key=AQCxJAFQQMEyCBAAYAfc6ZWfqH3xECkj5zd16A== with 0 caps)
added entity mds.b auth auth(auid = 18446744073709551615 key=AQCxJAFQGN9GMBAA/f0bm+a9Larozvlqoz3ndQ== with 0 caps)
added entity mds.c auth auth(auid = 18446744073709551615 key=AQCxJAFQOCkTHRAAya7KT9xtnEsI/EXA6OyPyA== with 0 caps)
added entity osd.0 auth auth(auid = 18446744073709551615 key=AQBJJAFQQPEuMRAAFcIKxomKKZbLnnz9pTZ9lQ== with 0 caps)
added entity osd.1 auth auth(auid = 18446744073709551615 key=AQBLJAFQOAM9HhAAiKV0+AUvW+1UUBFhwiOxRQ== with 0 caps)
added entity osd.10 auth auth(auid = 18446744073709551615 key=AQBMJAFQ+JJdOhAAeLQh73AaAygm9rzkFSvuOg== with 0 caps)
added entity osd.11 auth auth(auid = 18446744073709551615 key=AQBOJAFQCB3yKRAA0oGwi50k0aercuamOl/kFw== with 0 caps)
added entity osd.12 auth auth(auid = 18446744073709551615 key=AQBQJAFQ2LeEGBAAU/ExMHSUl/xa9kXkMfzp/w== with 0 caps)
added entity osd.13 auth auth(auid = 18446744073709551615 key=AQBSJAFQaGcODhAACY+5vJ6nENWv9kBCVrpEkg== with 0 caps)
added entity osd.14 auth auth(auid = 18446744073709551615 key=AQBUJAFQ4K8XAxAAqx4/w43SfJoZYmrexuSr9w== with 0 caps)
added entity osd.15 auth auth(auid = 18446744073709551615 key=AQBVJAFQEJiyNhAADP/oX4yRNzZe1zE+mmOSYg== with 0 caps)
added entity osd.16 auth auth(auid = 18446744073709551615 key=AQBXJAFQ4JA1LBAA/fzygvixFzK8PCJyHXGhaQ== with 0 caps)
added entity osd.17 auth auth(auid = 18446744073709551615 key=AQBZJAFQOOo3IxAAMkKZZWi2jF3rmDz/9ehhwA== with 0 caps)
added entity osd.18 auth auth(auid = 18446744073709551615 key=AQBbJAFQSItOFRAAm7g0ZsdV//PuFDeG3cM0Ew== with 0 caps)
added entity osd.19 auth auth(auid = 18446744073709551615 key=AQBdJAFQiHi2DBAAXD+uNO7Hdf7wfAVMMHQhxg== with 0 caps)
added entity osd.2 auth auth(auid = 18446744073709551615 key=AQBfJAFQyOT0AxAAEJtr4S2YuYC26vTH2ZjblQ== with 0 caps)
added entity osd.20 auth auth(auid = 18446744073709551615 key=AQBgJAFQGFVeGxAAP+cwIl+lv312gxG+3/+1zQ== with 0 caps)
added entity osd.21 auth auth(auid = 18446744073709551615 key=AQBiJAFQ+PlvBxAAcweBpSOSgexk/NkTc1tEGA== with 0 caps)
added entity osd.22 auth auth(auid = 18446744073709551615 key=AQBjJAFQMAAaMxAA2nWC8s6nm/NI+Q7gG0ZJ1w== with 0 caps)
added entity osd.23 auth auth(auid = 18446744073709551615 key=AQBlJAFQaHEvJBAAr8KNpzo/+4JzROana5bPfA== with 0 caps)
added entity osd.24 auth auth(auid = 18446744073709551615 key=AQBnJAFQkBtBExAASX2dphKYvg7A1p2LsmN78Q== with 0 caps)
added entity osd.25 auth auth(auid = 18446744073709551615 key=AQBpJAFQ0CxWAhAAWdR3mTbcnvaCWsy81gVKHw== with 0 caps)
added entity osd.26 auth auth(auid = 18446744073709551615 key=AQBqJAFQSLH5LxAAEIuo5JI2ixeA5dL37RhkMw== with 0 caps)
added entity osd.27 auth auth(auid = 18446744073709551615 key=AQBsJAFQqCcIIxAAiTteNvs1dm2SwpGIM2qKuA== with 0 caps)
added entity osd.28 auth auth(auid = 18446744073709551615 key=AQBuJAFQkAWSFBAAqV9hIGGW/CwKvmT292ZRCQ== with 0 caps)
added entity osd.29 auth auth(auid = 18446744073709551615 key=AQBwJAFQoJg/ChAA+2xj6QDcTu0ubsdC1WzWWw== with 0 caps)
added entity osd.3 auth auth(auid = 18446744073709551615 key=AQByJAFQ0At2CBAAJKsMG/NwFY10ybNL30Uqsg== with 0 caps)
added entity osd.30 auth auth(auid = 18446744073709551615 key=AQBzJAFQ8OxwORAALuR+rWp4muGIBPK1RpqTlA== with 0 caps)
added entity osd.31 auth auth(auid = 18446744073709551615 key=AQB1JAFQ8PwDKBAAl1Xqv55HkRG5dq3H0EbdPw== with 0 caps)
added entity osd.32 auth auth(auid = 18446744073709551615 key=AQB3JAFQSBCVFxAATcP2vfA6rN3S8T7He05RiA== with 0 caps)
added entity osd.33 auth auth(auid = 18446744073709551615 key=AQB5JAFQoGWqBBAAPFZmUZzOhK78RlATWYeJbg== with 0 caps)
added entity osd.34 auth auth(auid = 18446744073709551615 key=AQB6JAFQeEbXLRAANvcqtH76Teqvi1rAy0/32A== with 0 caps)
added entity osd.35 auth auth(auid = 18446744073709551615 key=AQB8JAFQkHx1GRAAU+SbSvfYN/siu7tObXvaag== with 0 caps)
added entity osd.36 auth auth(auid = 18446744073709551615 key=AQB+JAFQUBmHChAAwrBx6+wOTMrUiX5oB/9OeQ== with 0 caps)
added entity osd.37 auth auth(auid = 18446744073709551615 key=AQB/JAFQ4EyrNhAAHwibHshB0u0usWzLSFGHAg== with 0 caps)
added entity osd.38 auth auth(auid = 18446744073709551615 key=AQCBJAFQMGe/JhAAgoHmCRivPuEHYSw1opyzNw== with 0 caps)
added entity osd.39 auth auth(auid = 18446744073709551615 key=AQCDJAFQYJuYFhAAWVIhxzdf3dNvItnV/3anAw== with 0 caps)
added entity osd.4 auth auth(auid = 18446744073709551615 key=AQCEJAFQ+B/HLxAAoadP4uW5X46YFaxgKUfaNw== with 0 caps)
added entity osd.40 auth auth(auid = 18446744073709551615 key=AQCGJAFQ6PNOFhAAu6To8pubKE1CANRotH4X7Q== with 0 caps)
added entity osd.41 auth auth(auid = 18446744073709551615 key=AQCIJAFQQLNeCBAAV4RPsIp8PleiHoPpEow4jQ== with 0 caps)
added entity osd.42 auth auth(auid = 18446744073709551615 key=AQCJJAFQ0EAPMBAAfR6rsn0hQdHVO9e+U1npGg== with 0 caps)
added entity osd.43 auth auth(auid = 18446744073709551615 key=AQCLJAFQwLifHhAAEpUVWX1g0XlxelEnZceRWA== with 0 caps)
added entity osd.44 auth auth(auid = 18446744073709551615 key=AQCNJAFQqAcyDxAAQunzwwe5iwJ6nSvrmqspng== with 0 caps)
added entity osd.45 auth auth(auid = 18446744073709551615 key=AQCPJAFQ8LE+ARAAI8jx9PfZPge2h/EZ9+wIng== with 0 caps)
added entity osd.46 auth auth(auid = 18446744073709551615 key=AQCQJAFQqJdmLBAAQFueXXaiMiGgU5ZpZRBLjA== with 0 caps)
added entity osd.47 auth auth(auid = 18446744073709551615 key=AQCSJAFQMAJ6HBAA37OQ8ZxF0cglL14Mj0ah4w== with 0 caps)
added entity osd.48 auth auth(auid = 18446744073709551615 key=AQCUJAFQCF8AERAA3LfqEs+BJpKmesgszDLgbA== with 0 caps)
added entity osd.49 auth auth(auid = 18446744073709551615 key=AQCVJAFQeKsiNxAAYzQgEM3Xu/RTUnc3JsuAYQ== with 0 caps)
added entity osd.5 auth auth(auid = 18446744073709551615 key=AQCXJAFQUD10IRAAzbwKub9leSwv1uEWjh4HTw== with 0 caps)
added entity osd.50 auth auth(auid = 18446744073709551615 key=AQCXJAFQiB6rOhAAPlMrUxaI7sewfMnh90sjRw== with 0 caps)
added entity osd.51 auth auth(auid = 18446744073709551615 key=AQCZJAFQyAa+JxAArwRLwNsUYr6JxzrEZVGqQw== with 0 caps)
added entity osd.52 auth auth(auid = 18446744073709551615 key=AQCbJAFQcB/UFBAADzMVxCAANhi1X7DBDtrh/A== with 0 caps)
added entity osd.53 auth auth(auid = 18446744073709551615 key=AQCdJAFQAINqAxAAdMugJwXdQxYurT43F0VwIQ== with 0 caps)
added entity osd.54 auth auth(auid = 18446744073709551615 key=AQCeJAFQMJ0VLBAA4Zea3BNLbfAJZ8Xh5RGdOg== with 0 caps)
added entity osd.55 auth auth(auid = 18446744073709551615 key=AQCgJAFQUIkgHxAAowCM60aLiker/3J8JyUSGw== with 0 caps)
added entity osd.56 auth auth(auid = 18446744073709551615 key=AQCiJAFQ+HwzERAAAKiyhJoldWH72zBax5ik/Q== with 0 caps)
added entity osd.57 auth auth(auid = 18446744073709551615 key=AQCkJAFQmGA7AxAAExas+r8M9JRBegwxR3mHiQ== with 0 caps)
added entity osd.58 auth auth(auid = 18446744073709551615 key=AQClJAFQ2JPiMxAAKPPD8PrbEiQ0bE/syhOKYA== with 0 caps)
added entity osd.59 auth auth(auid = 18446744073709551615 key=AQCnJAFQoJwrKRAAesTXSRpOH7WJ2zGs3u4cFA== with 0 caps)
added entity osd.6 auth auth(auid = 18446744073709551615 key=AQCqJAFQOAR7JRAAnBQVpJHaFwwHc89tXNR46w== with 0 caps)
added entity osd.7 auth auth(auid = 18446744073709551615 key=AQCsJAFQ8FLwIRAAnQcX7vdOS7gghF6mO4KVxg== with 0 caps)
added entity osd.8 auth auth(auid = 18446744073709551615 key=AQCuJAFQOCd/EhAA0uFwPkiJoGrHy30dqknoiA== with 0 caps)
added entity osd.9 auth auth(auid = 18446744073709551615 key=AQCwJAFQeG6FAhAAij7Cs19YmmKsit2vix7g3Q== with 0 caps)
/usr/bin/ceph-conf -c ceph.conf -n mon.a "user"
/usr/bin/ceph-conf -c ceph.conf -n mon.a "ssh path"
=== mon.a === 
pushing everything to s100001.inneryun.io
--- ssh root@s100001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon mon.a"
/usr/bin/ceph-mon: created monfs at /mon/mon.a for mon.a
/usr/bin/ceph-conf -c ceph.conf -n mon.b "user"
/usr/bin/ceph-conf -c ceph.conf -n mon.b "ssh path"
=== mon.b === 
pushing everything to s200001.inneryun.io
--- ssh root@s200001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon mon.b"
/usr/bin/ceph-mon: created monfs at /mon/mon.b for mon.b
/usr/bin/ceph-conf -c ceph.conf -n mon.c "user"
/usr/bin/ceph-conf -c ceph.conf -n mon.c "ssh path"
=== mon.c === 
pushing everything to s300001.inneryun.io
--- ssh root@s300001.inneryun.io  "cd /root ; ulimit -c unlimited ; /sbin/mkcephfs -d /tmp/mkfs.ceph.8532 --init-daemon mon.c"
/usr/bin/ceph-mon: created monfs at /mon/mon.c for mon.c
placing client.admin keyring in /etc/ceph/client.admin.keyring
root@s100001:~#