Re: [Qemu-devel] Qemu + RBD = ceph::buffer::end_of_buffer

["Dyweni - Qemu-Devel" <8SScqsnYX8tr@dyweni.com>]

Hi List!

I upgraded Ceph to the latest development version
	Commit: 0edbc75a5fe8c3028faf85546f3264d28653ea3f
	Pulled from: git://ceph.newdream.net/ceph.git

I recompiled the latest GIT version of QEMU-KVM (with Josh Durgin's
patches) against the latest git version of Ceph.

However, this error is still occurring:

terminate called after throwing an instance of 'ceph::buffer::end_of_buffer'
  what():  buffer::end_of_buffer
Aborted (core dumped)



Here's another backtrace from GDB:

#0  0x00007f16ff829495 in raise (sig=<value optimized out>) at
../nptl/sysdeps/unix/sysv/linux/raise.c:64
#1  0x00007f16ff82a81f in abort () at abort.c:92
#2  0x00007f16fed74a25 in __gnu_cxx::__verbose_terminate_handler () at
/usr/src/debug/sys-devel/gcc-4.4.5/gcc-4.4.5/libstdc++-v3/libsupc++/vterminate.cc:93
#3  0x00007f16fed71c64 in __cxxabiv1::__terminate (handler=0x7f16fed74817
<__gnu_cxx::__verbose_terminate_handler()>)
    at
/usr/src/debug/sys-devel/gcc-4.4.5/gcc-4.4.5/libstdc++-v3/libsupc++/eh_terminate.cc:38
#4  0x00007f16fed71c8c in std::terminate () at
/usr/src/debug/sys-devel/gcc-4.4.5/gcc-4.4.5/libstdc++-v3/libsupc++/eh_terminate.cc:48
#5  0x00007f16fed71ea4 in __cxxabiv1::__cxa_throw (obj=0x1346470,
tinfo=0x7f1701952ce0, dest=0x7f17017403d4
<ceph::buffer::end_of_buffer::~end_of_buffer()>)
    at
/usr/src/debug/sys-devel/gcc-4.4.5/gcc-4.4.5/libstdc++-v3/libsupc++/eh_throw.cc:83
#6  0x00007f1701740a7b in ceph::buffer::list::iterator::copy
(this=0x7f16fd8b1930, len=4, dest=0x7f16fd8b18dc "") at
include/buffer.h:379
#7  0x00007f1701743328 in decode_raw<__le32> (t=@0x7f16fd8b18dc, p=...) at
include/encoding.h:35
#8  0x00007f170174198a in decode (v=@0x7f16fd8b190c, p=...) at
include/encoding.h:80
#9  0x00007f1701741ade in decode (s=..., p=...) at include/encoding.h:189
#10 0x00007f17012e8369 in
librados::RadosClient::C_aio_sparse_read_Ack::finish (this=0x7f16f40d6200,
r=0) at librados.cc:463
#11 0x00007f170132bb5a in Objecter::handle_osd_op_reply (this=0x13423e0,
m=0x1346520) at osdc/Objecter.cc:794
#12 0x00007f17012d1444 in librados::RadosClient::_dispatch
(this=0x133f810, m=0x1346520) at librados.cc:751
#13 0x00007f17012d1244 in librados::RadosClient::ms_dispatch
(this=0x133f810, m=0x1346520) at librados.cc:717
#14 0x00007f170131b57b in Messenger::ms_deliver_dispatch (this=0x1341910,
m=0x1346520) at msg/Messenger.h:98
#15 0x00007f17013090d3 in SimpleMessenger::dispatch_entry (this=0x1341910)
at msg/SimpleMessenger.cc:352
#16 0x00007f17012e296e in SimpleMessenger::DispatchThread::entry
(this=0x1341da0) at msg/SimpleMessenger.h:533
#17 0x00007f170131a39b in Thread::_entry_func (arg=0x1341da0) at
common/Thread.h:41
#18 0x00007f1701f6dac4 in start_thread (arg=<value optimized out>) at
pthread_create.c:297
#19 0x00007f16ff8c838d in clone () at
../sysdeps/unix/sysv/linux/x86_64/clone.S:115


Thanks,
Dyweni




> Hi List!
>
> I am tripping across this error as soon as the qemu rbd disk is
> probed by the windows 2000 installer:
>
> VNC server running on `127.0.0.1:5900'
> terminate called after throwing an instance of
> 'ceph::buffer::end_of_buffer'
>   what():  buffer::end_of_buffer
> Aborted (core dumped)
>
>
>
> Has anyone else tripped across this?
>
>
>
> I am running the following:
>   Linux Kernel 2.6.37-gentoo-r4
>   Ceph 0.27
>   QEMU-KVM (commit 28262112181f27f302b5186f0df6428df6b513e7)
>     Pulled from: git://git.kernel.org/pub/scm/virt/kvm/qemu-kvm.git
>     And patched with Josh Durgin's "rbd improvements" patchset
>      (http://lists.gnu.org/archive/html/qemu-devel/2011-04/msg01211.html)
>
>
>
> The GDB Backtrace is:
>
> #0  0x00007f7733c2a495 in raise (sig=<value optimized out>) at
> ../nptl/sysdeps/unix/sysv/linux/raise.c:64
> #1  0x00007f7733c2b81f in abort () at abort.c:92
> #2  0x00007f7733175a25 in __gnu_cxx::__verbose_terminate_handler () at
> /usr/src/debug/sys-devel/gcc-4.4.5/gcc-4.4.5/libstdc++-v3/libsupc++/vterminate.cc:93
> #3  0x00007f7733172c64 in __cxxabiv1::__terminate (handler=0x7f7733175817
> <__gnu_cxx::__verbose_terminate_handler()>)
>     at
> /usr/src/debug/sys-devel/gcc-4.4.5/gcc-4.4.5/libstdc++-v3/libsupc++/eh_terminate.cc:38
> #4  0x00007f7733172c8c in std::terminate () at
> /usr/src/debug/sys-devel/gcc-4.4.5/gcc-4.4.5/libstdc++-v3/libsupc++/eh_terminate.cc:48
> #5  0x00007f7733172ea4 in __cxxabiv1::__cxa_throw (obj=0x18d62a0,
> tinfo=0x7f7735d57ce0, dest=0x7f7735b4548a
> <ceph::buffer::end_of_buffer::~end_of_buffer()>)
>     at
> /usr/src/debug/sys-devel/gcc-4.4.5/gcc-4.4.5/libstdc++-v3/libsupc++/eh_throw.cc:83
> #6  0x00007f7735b45b31 in ceph::buffer::list::iterator::copy
> (this=0x7f7731cb2930, len=4, dest=0x7f7731cb28dc "") at
> include/buffer.h:381
> #7  0x00007f7735b483de in decode_raw<__le32> (t=@0x7f7731cb28dc, p=...) at
> include/encoding.h:35
> #8  0x00007f7735b46a40 in decode (v=@0x7f7731cb290c, p=...) at
> include/encoding.h:80
> #9  0x00007f7735b46b94 in decode (s=..., p=...) at include/encoding.h:189
> #10 0x00007f77356ea3b5 in
> librados::RadosClient::C_aio_sparse_read_Ack::finish (this=0x7f77280618d0,
> r=0) at librados.cc:463
> #11 0x00007f773572dff4 in Objecter::handle_osd_op_reply (this=0x181ff10,
> m=0x18f1440) at osdc/Objecter.cc:801
> #12 0x00007f77356d347c in librados::RadosClient::_dispatch
> (this=0x181cdc0, m=0x18f1440) at librados.cc:751
> #13 0x00007f77356d327c in librados::RadosClient::ms_dispatch
> (this=0x181cdc0, m=0x18f1440) at librados.cc:717
> #14 0x00007f773571d93d in Messenger::ms_deliver_dispatch (this=0x181f300,
> m=0x18f1440) at msg/Messenger.h:98
> #15 0x00007f773570b135 in SimpleMessenger::dispatch_entry (this=0x181f300)
> at msg/SimpleMessenger.cc:352
> #16 0x00007f77356e49ba in SimpleMessenger::DispatchThread::entry
> (this=0x181f790) at msg/SimpleMessenger.h:533
> #17 0x00007f773571c75d in Thread::_entry_func (arg=0x181f790) at
> common/Thread.h:41
> #18 0x00007f7736372ac4 in start_thread (arg=<value optimized out>) at
> pthread_create.c:297
> #19 0x00007f7733cc938d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:115
>
>
>
> Thanks,
> Dyweni
>
>
>
>
>