CEPH filesystem development
 help / color / mirror / Atom feed
From: Mario van der Linde <linde@b1-systems.de>
To: ceph-devel@vger.kernel.org
Subject: Re: rbd - input/output error
Date: Mon, 14 Nov 2011 22:30:12 +0100	[thread overview]
Message-ID: <4EC18864.4010308@b1-systems.de> (raw)
In-Reply-To: <Pine.LNX.4.64.1111141148220.29742@cobra.newdream.net>


[-- Attachment #1.1: Type: text/plain, Size: 1258 bytes --]

Hello,

On 14.11.2011 20:48, Sage Weil wrote:
> On Sun, 13 Nov 2011, Mario van der Linde wrote:
[...]
>>> ceph1:~ # modprobe rbd
>>> ceph1:~ # rbd create testimg --size 10240
>>> create error: error 5: Input/output error
> 
> Can you try with 
> 
>  rbd create testmsg --size 10240 --log-to-stderr --debug-ms 1
> 
> so we can see a bit more about what is going on?

This one gave me some output:
rbd create testimg --size=10240 --log-to-stderr 2 --debug-ms 2

See attached file.

Additional Info:
> ceph5:~ # modinfo rbd
> filename:       /lib/modules/3.1.0-rc9-1-desktop/kernel/drivers/block/rbd.ko
> license:        GPL
> author:         Jeff Garzik <jeff@garzik.org>
> description:    rados block device
> author:         Yehuda Sadeh <yehuda@hq.newdream.net>
> author:         Sage Weil <sage@newdream.net>
> srcversion:     C8F4E38D4A716AB32B9F75C
> depends:        
> vermagic:       3.1.0-rc9-1-desktop SMP preempt mod_unload modversions


Regards
Mario


-- 
Mario van der Linde
Linux Consultant & Trainer
Tel.: +49-151-16879485
Mail: linde@b1-systems.de

B1 Systems GmbH
Osterfeldstraße 7 / 85088 Vohburg / http://www.b1-systems.de
GF: Ralph Dehner / Unternehmenssitz: Vohburg / AG: Ingolstadt,HRB 3537

[-- Attachment #1.2: ceph_failure.out --]
[-- Type: text/plain, Size: 5760 bytes --]

ceph5:~ # rbd create testimg --size=10240 --log-to-stderr 2 --debug-ms 2
2011-11-14 22:22:01.046036 7fa0dff51720 -- :/0 messenger.start
2011-11-14 22:22:01.046320 7fa0dff51720 -- :/1007622 --> 192.168.1.222:6789/0 -- auth(proto 0 30 bytes) v1 -- ?+0 0x7a60f0 con 0x7a5e80
2011-11-14 22:22:01.046576 7fa0dff4f700 -- :/1007622 >> 192.168.1.222:6789/0 pipe(0x7a5c10 sd=3 pgs=0 cs=0 l=0).connect error 192.168.1.222:6789/0, 111: Connection refused
2011-11-14 22:22:01.046616 7fa0dff4f700 -- :/1007622 >> 192.168.1.222:6789/0 pipe(0x7a5c10 sd=3 pgs=0 cs=0 l=0).fault 111: Connection refused
2011-11-14 22:22:01.046659 7fa0dff4f700 -- :/1007622 >> 192.168.1.222:6789/0 pipe(0x7a5c10 sd=3 pgs=0 cs=0 l=0).fault first fault
2011-11-14 22:22:01.046962 7fa0dff4f700 -- :/1007622 >> 192.168.1.222:6789/0 pipe(0x7a5c10 sd=3 pgs=0 cs=0 l=0).connect error 192.168.1.222:6789/0, 111: Connection refused
2011-11-14 22:22:01.046977 7fa0dff4f700 -- :/1007622 >> 192.168.1.222:6789/0 pipe(0x7a5c10 sd=3 pgs=0 cs=0 l=0).fault 111: Connection refused
2011-11-14 22:22:01.247422 7fa0dff4f700 -- :/1007622 >> 192.168.1.222:6789/0 pipe(0x7a5c10 sd=3 pgs=0 cs=0 l=0).connect error 192.168.1.222:6789/0, 111: Connection refused
2011-11-14 22:22:01.247448 7fa0dff4f700 -- :/1007622 >> 192.168.1.222:6789/0 pipe(0x7a5c10 sd=3 pgs=0 cs=0 l=0).fault 111: Connection refused
2011-11-14 22:22:01.647881 7fa0dff4f700 -- :/1007622 >> 192.168.1.222:6789/0 pipe(0x7a5c10 sd=3 pgs=0 cs=0 l=0).connect error 192.168.1.222:6789/0, 111: Connection refused
2011-11-14 22:22:01.647923 7fa0dff4f700 -- :/1007622 >> 192.168.1.222:6789/0 pipe(0x7a5c10 sd=3 pgs=0 cs=0 l=0).fault 111: Connection refused
2011-11-14 22:22:02.448373 7fa0dff4f700 -- :/1007622 >> 192.168.1.222:6789/0 pipe(0x7a5c10 sd=3 pgs=0 cs=0 l=0).connect error 192.168.1.222:6789/0, 111: Connection refused
2011-11-14 22:22:02.448414 7fa0dff4f700 -- :/1007622 >> 192.168.1.222:6789/0 pipe(0x7a5c10 sd=3 pgs=0 cs=0 l=0).fault 111: Connection refused
2011-11-14 22:22:04.046398 7fa0db8db700 -- :/1007622 mark_down 0x7a5e80 -- 0x7a5c10
2011-11-14 22:22:04.046564 7fa0db8db700 -- :/1007622 --> 192.168.1.221:6789/0 -- auth(proto 0 30 bytes) v1 -- ?+0 0x7a6a70 con 0x7a67b0
2011-11-14 22:22:04.047314 7fa0da8d9700 -- 192.168.1.225:0/1007622 learned my addr 192.168.1.225:0/1007622
2011-11-14 22:22:05.051649 7fa0dc8dd700 -- 192.168.1.225:0/1007622 <== mon.0 192.168.1.221:6789/0 1 ==== auth_reply(proto 1 0 Success) v1 ==== 24+0+0 (538567308 0 0) 0x7a6a70 con 0x7a67b0
2011-11-14 22:22:05.051723 7fa0dc8dd700 -- 192.168.1.225:0/1007622 --> 192.168.1.221:6789/0 -- mon_subscribe({monmap=0+}) v1 -- ?+0 0x7a60f0 con 0x7a67b0
2011-11-14 22:22:05.051953 7fa0dff51720 -- 192.168.1.225:0/1007622 --> 192.168.1.221:6789/0 -- mon_subscribe({monmap=0+,osdmap=0}) v1 -- ?+0 0x7a5c10 con 0x7a67b0
2011-11-14 22:22:05.051994 7fa0dff51720 -- 192.168.1.225:0/1007622 --> 192.168.1.221:6789/0 -- mon_subscribe({monmap=0+,osdmap=0}) v1 -- ?+0 0x7a6cf0 con 0x7a67b0
2011-11-14 22:22:05.052966 7fa0dc8dd700 -- 192.168.1.225:0/1007622 <== mon.0 192.168.1.221:6789/0 2 ==== mon_map v1 ==== 469+0+0 (2361102807 0 0) 0x7a5df0 con 0x7a67b0
2011-11-14 22:22:05.053015 7fa0dc8dd700 -- 192.168.1.225:0/1007622 <== mon.0 192.168.1.221:6789/0 3 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (2408960605 0 0) 0x7a60f0 con 0x7a67b0
2011-11-14 22:22:05.053206 7fa0dc8dd700 -- 192.168.1.225:0/1007622 <== mon.0 192.168.1.221:6789/0 4 ==== mon_map v1 ==== 469+0+0 (2361102807 0 0) 0x7a5df0 con 0x7a67b0
2011-11-14 22:22:05.053256 7fa0dc8dd700 -- 192.168.1.225:0/1007622 <== mon.0 192.168.1.221:6789/0 5 ==== osd_map(52..52 src has 1..52) v2 ==== 3463+0+0 (777870650 0 0) 0x7a7b70 con 0x7a67b0
2011-11-14 22:22:05.053462 7fa0dc8dd700 -- 192.168.1.225:0/1007622 <== mon.0 192.168.1.221:6789/0 6 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (2408960605 0 0) 0x7a5c10 con 0x7a67b0
2011-11-14 22:22:05.053490 7fa0dc8dd700 -- 192.168.1.225:0/1007622 <== mon.0 192.168.1.221:6789/0 7 ==== mon_map v1 ==== 469+0+0 (2361102807 0 0) 0x7a7d90 con 0x7a67b0
2011-11-14 22:22:05.053767 7fa0dff51720 -- 192.168.1.225:0/1007622 --> 192.168.1.224:6800/3212 -- osd_op(client.4236.0:1 testimg.rbd [stat 0~0] 2.e35ad169) v1 -- ?+0 0x7a6d20 con 0x7a9ad0
2011-11-14 22:22:05.053908 7fa0dc8dd700 -- 192.168.1.225:0/1007622 <== mon.0 192.168.1.221:6789/0 8 ==== osd_map(52..52 src has 1..52) v2 ==== 3463+0+0 (777870650 0 0) 0x7a7000 con 0x7a67b0
2011-11-14 22:22:05.053959 7fa0dc8dd700 -- 192.168.1.225:0/1007622 <== mon.0 192.168.1.221:6789/0 9 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (2408960605 0 0) 0x7a9e80 con 0x7a67b0
2011-11-14 22:22:05.055250 7fa0dc8dd700 -- 192.168.1.225:0/1007622 <== osd.4 192.168.1.224:6800/3212 1 ==== osd_op_reply(1 testimg.rbd [stat 0~0] = -2 (No such file or directory)) v2 ==== 102+0+0 (1670433998 0 0) 0x7a6d20 con 0x7a9ad0
2011-11-14 22:22:05.055368 7fa0dff51720 -- 192.168.1.225:0/1007622 --> 192.168.1.224:6800/3212 -- osd_op(client.4236.0:2 rbd_info [write 0~0] 2.ac0e573a) v1 -- ?+0 0x7a6fa0 con 0x7a9ad0
2011-11-14 22:22:05.069088 7fa0dc8dd700 -- 192.168.1.225:0/1007622 <== osd.4 192.168.1.224:6800/3212 2 ==== osd_op_reply(2 rbd_info [write 0~0] ack = 0) v2 ==== 99+0+0 (3424702940 0 0) 0x7a6d20 con 0x7a9ad0
2011-11-14 22:22:05.069182 7fa0dff51720 -- 192.168.1.225:0/1007622 --> 192.168.1.224:6800/3212 -- osd_op(client.4236.0:3 rbd_info [call rbd.assign_bid] 2.ac0e573a) v1 -- ?+0 0x7a5cd0 con 0x7a9ad0
2011-11-14 22:22:05.069655 7fa0dc8dd700 -- 192.168.1.225:0/1007622 <== osd.4 192.168.1.224:6800/3212 3 ==== osd_op_reply(3 rbd_info [call] = -5 (Input/output error)) v2 ==== 99+0+0 (559231618 0 0) 0x7a6d20 con 0x7a9ad0
2011-11-14 22:22:05.069712 7fa0dff51720 librbd: failed to assign a block name for image
create error: error 5: Input/output error

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 262 bytes --]

  reply	other threads:[~2011-11-14 21:30 UTC|newest]

Thread overview: 9+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-11-13 10:15 rbd - input/output error Mario van der Linde
2011-11-14 19:48 ` Sage Weil
2011-11-14 21:30   ` Mario van der Linde [this message]
2011-11-14 21:39     ` Sage Weil
2011-11-14 21:59       ` Mario van der Linde
2011-11-14 22:05         ` Tommi Virtanen
2011-11-14 22:17           ` [solved] " Mario van der Linde
2011-11-14 22:09         ` Sage Weil
2011-11-14 22:13           ` Tommi Virtanen

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4EC18864.4010308@b1-systems.de \
    --to=linde@b1-systems.de \
    --cc=ceph-devel@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox