From: Josh Durgin <josh.durgin@dreamhost.com>
To: Masuko Tomoya <tomoya.masuko@gmail.com>
Cc: ceph-devel@vger.kernel.org
Subject: Re: couldn't use rbd
Date: Thu, 02 Feb 2012 17:26:51 -0800 [thread overview]
Message-ID: <4F2B37DB.4070506@dreamhost.com> (raw)
In-Reply-To: <CAM2zNoOyURtLAzh=DNcPjazj1RpgEY7WeJ_-QVjOWzbTp+qSUQ@mail.gmail.com>
On 02/02/2012 01:49 AM, Masuko Tomoya wrote:
> Hi, all.
>
> When I execute "rbd" command, it is not success.
>
> root@ceph01:~# rbd list
> (no response)
>
> /var/log/ceph/mon.0.log
> -----
> 2012-02-02 17:58:19.801762 7ff4bbfb1710 -- 10.68.119.191:6789/0<==
> client.? 10.68.119.191:0/1002580 1 ==== auth(proto 0 30 bytes) v1 ====
> 56+0+0 (625540289 0 0) 0x1619a00 con 0x1615a00
> 2012-02-02 17:58:19.801919 7ff4bbfb1710 -- 10.68.119.191:6789/0 -->
> 10.68.119.191:0/1002580 -- auth_reply(proto 2 0 Success) v1 -- ?+0
> 0x1619c00 con 0x1615a00
> 2012-02-02 17:58:19.802505 7ff4bbfb1710 -- 10.68.119.191:6789/0<==
> client.? 10.68.119.191:0/1002580 2 ==== auth(proto 2 32 bytes) v1 ====
> 58+0+0 (346146289 0 0) 0x161fc00 con 0x1615a00
> 2012-02-02 17:58:19.802673 7ff4bbfb1710 -- 10.68.119.191:6789/0 -->
> 10.68.119.191:0/1002580 -- auth_reply(proto 2 0 Success) v1 -- ?+0
> 0x1619a00 con 0x1615a00
> 2012-02-02 17:58:19.803473 7ff4bbfb1710 -- 10.68.119.191:6789/0<==
> client.? 10.68.119.191:0/1002580 3 ==== auth(proto 2 165 bytes) v1
> ==== 191+0+0 (3737796417 0 0) 0x1619600 con 0x1615a00
> 2012-02-02 17:58:19.803745 7ff4bbfb1710 -- 10.68.119.191:6789/0 -->
> 10.68.119.191:0/1002580 -- auth_reply(proto 2 0 Success) v1 -- ?+0
> 0x161fc00 con 0x1615a00
> 2012-02-02 17:58:19.804425 7ff4bbfb1710 -- 10.68.119.191:6789/0<==
> client.? 10.68.119.191:0/1002580 4 ==== mon_subscribe({monmap=0+}) v2
> ==== 23+0+0 (1620593354 0 0) 0x1617380 con 0x1615a00
> 2012-02-02 17:58:19.804488 7ff4bbfb1710 -- 10.68.119.191:6789/0 -->
> 10.68.119.191:0/1002580 -- mon_map v1 -- ?+0 0x1635700 con 0x1615a00
> 2012-02-02 17:58:19.804517 7ff4bbfb1710 -- 10.68.119.191:6789/0 -->
> client.? 10.68.119.191:0/1002580 -- mon_subscribe_ack(300s) v1 -- ?+0
> 0x163d780
> 2012-02-02 17:58:19.804550 7ff4bbfb1710 -- 10.68.119.191:6789/0<==
> client.4112 10.68.119.191:0/1002580 5 ====
> mon_subscribe({monmap=0+,osdmap=0}) v2 ==== 42+0+0 (982583713 0 0)
> 0x1617a80 con 0x1615a00
> 2012-02-02 17:58:19.804578 7ff4bbfb1710 -- 10.68.119.191:6789/0 -->
> 10.68.119.191:0/1002580 -- mon_map v1 -- ?+0 0x1617380 con 0x1615a00
> 2012-02-02 17:58:19.804656 7ff4bbfb1710 -- 10.68.119.191:6789/0 -->
> client.? 10.68.119.191:0/1002580 -- osd_map(3..3 src has 1..3) v1 --
> ?+0 0x1619600
> 2012-02-02 17:58:19.804744 7ff4bbfb1710 -- 10.68.119.191:6789/0 -->
> client.4112 10.68.119.191:0/1002580 -- mon_subscribe_ack(300s) v1 --
> ?+0 0x163d900
> 2012-02-02 17:58:19.804778 7ff4bbfb1710 -- 10.68.119.191:6789/0<==
> client.4112 10.68.119.191:0/1002580 6 ====
> mon_subscribe({monmap=0+,osdmap=0}) v2 ==== 42+0+0 (982583713 0 0)
> 0x16178c0 con 0x1615a00
> 2012-02-02 17:58:19.804811 7ff4bbfb1710 -- 10.68.119.191:6789/0 -->
> 10.68.119.191:0/1002580 -- mon_map v1 -- ?+0 0x1617a80 con 0x1615a00
> 2012-02-02 17:58:19.804855 7ff4bbfb1710 -- 10.68.119.191:6789/0 -->
> client.? 10.68.119.191:0/1002580 -- osd_map(3..3 src has 1..3) v1 --
> ?+0 0x1619400
> 2012-02-02 17:58:19.804884 7ff4bbfb1710 -- 10.68.119.191:6789/0 -->
> client.4112 10.68.119.191:0/1002580 -- mon_subscribe_ack(300s) v1 --
> ?+0 0x161d300
> -----
No problems there.
>
> BTW, I could execute "rados lspools".
>
> root@ceph01:~# rados lspools
> data
> metadata
> rbd
This might mean the rbd image list object can't be read for some
reason, or the rbd tool is doing something weird that the rados tool
isn't. Can you share the output of 'ceph -s' and
'rbd ls --log-to-stderr --debug-ms 1 --debug-objecter 20 --debug-monc 20
--debug-auth 20'?
You can run 'rados lspools' with those options as well and compare.
> I would like to use rbd volume and attach it as virtual device for VM
> guest on KVM.
>
> Could you advice to me ?
>
>
> My environment is below.
>
> *ceph cluster is configured on single server.
> *server is ubuntu 10.10 maverick.
> *ceph, librados2 and librbd1 packages are installed.
> (version: 0.38-1maverick)
> *apparmor is disable.
apparmor shouldn't matter if you have libvirt 0.9.9 or newer.
> *root@ceph01:/# ls -l /etc/ceph
> total 16
> -rw-r--r-- 1 root root 340 2012-02-02 17:28 ceph.conf
> -rw------- 1 root root 92 2012-02-02 17:28 client.admin.keyring
> -rw------- 1 root root 85 2012-02-02 17:28 mds.0.keyring
> -rw------- 1 root root 85 2012-02-02 17:28 osd.0.keyring
> */var/lib/ceph/tmp is exists.
> root@ceph01:/var/log# ls -l /var/lib/ceph/
> total 4
> drwxrwxrwx 2 root root 4096 2011-11-11 09:28 tmp
>
> */etc/ceph/ceph.conf
> [global]
> auth supported = cephx
> keyring = /etc/ceph/$name.keyring
> [mon]
> mon data = /data/data/mon$id
> debug ms = 1
> [mon.0]
> host = ceph01
> mon addr = 10.68.119.191:6789
> [mds]
>
> [mds.0]
> host = ceph01
> [osd]
> osd data = /data/osd$id
> osd journal = /data/osd$id/journal
> osd journal size = 512
> osd class tmp = /var/lib/ceph/tmp
> [osd.0]
> host = ceph01
> btrfs devs = /dev/sdb1
>
>
> Waiting for your reply,
>
> Tomoya.
next prev parent reply other threads:[~2012-02-03 1:26 UTC|newest]
Thread overview: 9+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-02-02 9:49 couldn't use rbd Masuko Tomoya
2012-02-03 1:26 ` Josh Durgin [this message]
2012-02-03 8:51 ` Masuko Tomoya
2012-02-03 17:05 ` Josh Durgin
2012-02-03 22:14 ` Masuko Tomoya
2012-02-03 22:36 ` Josh Durgin
2012-02-03 22:54 ` Masuko Tomoya
2012-02-03 23:01 ` Josh Durgin
2012-02-04 0:31 ` Masuko Tomoya
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=4F2B37DB.4070506@dreamhost.com \
--to=josh.durgin@dreamhost.com \
--cc=ceph-devel@vger.kernel.org \
--cc=tomoya.masuko@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.