Kernel panic in Xen

Kernel panic in Xen

[Marc Petit-Huguenin]

[-- Attachment #1: Type: text/plain, Size: 529 bytes --]

Hi,

On a 8 Gbytes server installed with Xen from the GNU/Linux Debian
distribution (linux-image-2.6.18-4-xen-686 2.6.18.dfsg.1-11), I have the
attached kernel panic when running xen-create-image.  In fact I have the
same kernel panic when I create the image on a different machine and
simply copy the files over an SSH session.

The exact same machine with only 2 Gbytes of memory does not crash.

Let me know if you need any other information.

Thanks.

-- 
Marc Petit-Huguenin
Home: marc@petit-huguenin.org
Work: marc@8x8.com

[-- Attachment #2: xen.log --]
[-- Type: text/plain, Size: 3139 bytes --]

BUG: unable to handle kernel paging request at virtual address f57ae000
 printing eip:
c01be5d4
2d747000 -> *pde = 00000000:d5afe001
2b8fe000 -> *pme = 00000000:0768a067
0168a000 -> *pte = 00000000:00000000
Oops: 0000 [#1]
SMP 
Modules linked in: bridge netloop ipv6 dm_snapshot dm_mirror dm_mod loop i2c_i8n
CPU:    0
EIP:    0061:[<c01be5d4>]    Not tainted VLI
EFLAGS: 00010206   (2.6.18-4-xen-686 #1) 
EIP is at __sync_single+0xa0/0x12a
eax: f57ae000   ebx: 00001000   ecx: 00000400   edx: 00000063
esi: f57ae000   edi: c8e7c000   ebp: 00010000   esp: ea78bd90
ds: 007b   es: 007b   ss: 0069
Process perl (pid: 2861, ti=ea78a000 task=c0dc1000 task.ti=ea78a000)
Stack: 00000001 c8e7c000 00010000 f57ae000 00000000 c46a7000 00006310 00780000 
       00000001 c46a7000 c01bead3 00010000 00000001 c9d0cc3c 00008000 00000000 
       c8e7c000 00000020 c46a7000 00000000 c9d0cc38 00018c40 00000000 00780000 
Call Trace:
 [<c01bead3>] map_single+0x16b/0x179
 [<c01bf11b>] swiotlb_map_sg+0x146/0x1c2
 [<c0108ff3>] dma_map_sg+0x74/0x14e
 [<ee09f9b1>] ide_build_sglist+0x67/0x6c [ide_core]
 [<ee09f9e1>] ide_build_dmatable+0x2b/0x151 [ide_core]
 [<c0122f99>] lock_timer_base+0x15/0x2f
 [<ee09fb2a>] ide_dma_setup+0x23/0x85 [ide_core]
 [<ee056f49>] ide_do_rw_disk+0x344/0x497 [ide_disk]
 [<c01f5513>] __add_entropy_words+0x58/0x176
 [<ee0996da>] ide_do_request+0x55a/0x717 [ide_core]
 [<c01ad5b7>] freed_request+0x1d/0x37
 [<ee09914f>] ide_end_request+0xc7/0xcf [ide_core]
 [<ee099b05>] ide_intr+0x16b/0x194 [ide_core]
 [<c013a823>] handle_IRQ_event+0x27/0x51
 [<c013a8e0>] __do_IRQ+0x93/0xe8
 [<c010612c>] do_IRQ+0x43/0x53
 [<c020c0dc>] evtchn_do_upcall+0x64/0x9b
 [<c0104a51>] hypervisor_callback+0x3d/0x48
Code: 7c 24 04 89 c6 03 74 24 10 89 44 24 0c 01 ef 2b 7c 24 08 83 3c 24 02 75 0 
EIP: [<c01be5d4>] __sync_single+0xa0/0x12a SS:ESP 0069:ea78bd90
 <0>Kernel panic - not syncing: Fatal exception in interrupt
 BUG: warning at arch/i386/kernel/smp-xen.c:526/smp_call_function()
 [<c010cdc9>] smp_call_function+0x53/0xf8
 [<c011b4aa>] printk+0x14/0x18
 [<c010ce81>] smp_send_stop+0x13/0x1e
 [<c011aad7>] panic+0x45/0xde
 [<c0105235>] die+0x242/0x276
 [<c0111cf1>] do_page_fault+0xa53/0xb76
 [<c011129e>] do_page_fault+0x0/0xb76
 [<c0104a0f>] error_code+0x2b/0x30
 [<c01be5d4>] __sync_single+0xa0/0x12a
 [<c01bead3>] map_single+0x16b/0x179
 [<c01bf11b>] swiotlb_map_sg+0x146/0x1c2
 [<c0108ff3>] dma_map_sg+0x74/0x14e
 [<ee09f9b1>] ide_build_sglist+0x67/0x6c [ide_core]
 [<ee09f9e1>] ide_build_dmatable+0x2b/0x151 [ide_core]
 [<c0122f99>] lock_timer_base+0x15/0x2f
 [<ee09fb2a>] ide_dma_setup+0x23/0x85 [ide_core]
 [<ee056f49>] ide_do_rw_disk+0x344/0x497 [ide_disk]
 [<c01f5513>] __add_entropy_words+0x58/0x176
 [<ee0996da>] ide_do_request+0x55a/0x717 [ide_core]
 [<c01ad5b7>] freed_request+0x1d/0x37
 [<ee09914f>] ide_end_request+0xc7/0xcf [ide_core]
 [<ee099b05>] ide_intr+0x16b/0x194 [ide_core]
 [<c013a823>] handle_IRQ_event+0x27/0x51
 [<c013a8e0>] __do_IRQ+0x93/0xe8
 [<c010612c>] do_IRQ+0x43/0x53
 [<c020c0dc>] evtchn_do_upcall+0x64/0x9b
 [<c0104a51>] hypervisor_callback+0x3d/0x48
(XEN) Domain 0 crashed: rebooting machine in 5 seconds.


[-- Attachment #3: Type: text/plain, Size: 138 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

RE: Kernel panic in Xen

[Petersson, Mats]

 

> -----Original Message-----
> From: xen-devel-bounces@lists.xensource.com 
> [mailto:xen-devel-bounces@lists.xensource.com] On Behalf Of 
> Marc Petit-Huguenin
> Sent: 19 March 2007 13:11
> To: xen-devel@lists.xensource.com
> Subject: [Xen-devel] Kernel panic in Xen
> 
> Hi,
> 
> On a 8 Gbytes server installed with Xen from the GNU/Linux Debian
> distribution (linux-image-2.6.18-4-xen-686 2.6.18.dfsg.1-11), 
> I have the
> attached kernel panic when running xen-create-image.  In fact 
> I have the
> same kernel panic when I create the image on a different machine and
> simply copy the files over an SSH session.
> 
> The exact same machine with only 2 Gbytes of memory does not crash.

Have you run "memtest" on the machine? 

--
Mats
> 
> Let me know if you need any other information.
> 
> Thanks.
> 
> -- 
> Marc Petit-Huguenin
> Home: marc@petit-huguenin.org
> Work: marc@8x8.com
> 

Re: Kernel panic in Xen

[Marc Petit-Huguenin]

Petersson, Mats wrote:
>  
> 
>> -----Original Message-----
>> From: xen-devel-bounces@lists.xensource.com 
>> [mailto:xen-devel-bounces@lists.xensource.com] On Behalf Of 
>> Marc Petit-Huguenin
>> Sent: 19 March 2007 13:11
>> To: xen-devel@lists.xensource.com
>> Subject: [Xen-devel] Kernel panic in Xen
>>
>> Hi,
>>
>> On a 8 Gbytes server installed with Xen from the GNU/Linux Debian
>> distribution (linux-image-2.6.18-4-xen-686 2.6.18.dfsg.1-11), 
>> I have the
>> attached kernel panic when running xen-create-image.  In fact 
>> I have the
>> same kernel panic when I create the image on a different machine and
>> simply copy the files over an SSH session.
>>
>> The exact same machine with only 2 Gbytes of memory does not crash.
> 
> Have you run "memtest" on the machine? 

No, but I have the same problem on my two 8 Gbytes servers and not on my
nine 2 Gbytes servers, so I thought that it was improbable that the
memory was bad only for them.  But if you think that this is still a
possibility, I'll run memtest.

Thanks.

> 
> --
> Mats
>> Let me know if you need any other information.
>>
>> Thanks.
>>

-- 
Marc Petit-Huguenin
Home: marc@petit-huguenin.org
Work: marc@8x8.com

Re: Kernel panic in Xen

[Keir Fraser]

On 19/3/07 13:10, "Marc Petit-Huguenin" <marc@petit-huguenin.org> wrote:

> On a 8 Gbytes server installed with Xen from the GNU/Linux Debian
> distribution (linux-image-2.6.18-4-xen-686 2.6.18.dfsg.1-11), I have the
> attached kernel panic when running xen-create-image.  In fact I have the
> same kernel panic when I create the image on a different machine and
> simply copy the files over an SSH session.
> 
> The exact same machine with only 2 Gbytes of memory does not crash.
> 
> Let me know if you need any other information.

I suspect that your dom0 kernel is missing a workaround for a bug/issue in
the Linux block-device code. I would recommend building a 2.6.18 kernel from
xen-unstable.hg repository, or at least rebuilding your Debian dom0 kernel
with the file arch/i386/kernel/swiotlb-xen.c replaced with the version from
the xen-unstable.hg repository (or if that doesn't compile, take the version
of the function __sync_single() and copy that into Debian's swiotlb-xen.c).

 -- Keir

Re: Kernel panic in Xen

[Bastian Blank]

[-- Attachment #1.1: Type: text/plain, Size: 327 bytes --]

On Mon, Mar 19, 2007 at 01:27:08PM +0000, Keir Fraser wrote:
> I suspect that your dom0 kernel is missing a workaround for a bug/issue in
> the Linux block-device code.

I can confirm this.

Marc: Can you please add a bug to the Debian BTS?

Bastian

-- 
Kirk to Enterprise -- beam down yeoman Rand and a six-pack.

[-- Attachment #1.2: Digital signature --]
[-- Type: application/pgp-signature, Size: 197 bytes --]

[-- Attachment #2: Type: text/plain, Size: 138 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

Re: Kernel panic in Xen

[Marc Petit-Huguenin]

Bastian Blank wrote:
> On Mon, Mar 19, 2007 at 01:27:08PM +0000, Keir Fraser wrote:
>> I suspect that your dom0 kernel is missing a workaround for a bug/issue in
>> the Linux block-device code.
> 
> I can confirm this.
> 
> Marc: Can you please add a bug to the Debian BTS?

Yes, I will, as soon my build and test are finished.

-- 
Marc Petit-Huguenin
Home: marc@petit-huguenin.org
Work: marc@8x8.com

Re: Kernel panic in Xen

[Marc Petit-Huguenin]

Keir Fraser wrote:
> On 19/3/07 13:10, "Marc Petit-Huguenin" <marc@petit-huguenin.org> wrote:
> 
>> On a 8 Gbytes server installed with Xen from the GNU/Linux Debian
>> distribution (linux-image-2.6.18-4-xen-686 2.6.18.dfsg.1-11), I have the
>> attached kernel panic when running xen-create-image.  In fact I have the
>> same kernel panic when I create the image on a different machine and
>> simply copy the files over an SSH session.
>>
>> The exact same machine with only 2 Gbytes of memory does not crash.
>>
>> Let me know if you need any other information.
> 
> I suspect that your dom0 kernel is missing a workaround for a bug/issue in
> the Linux block-device code. I would recommend building a 2.6.18 kernel from
> xen-unstable.hg repository, or at least rebuilding your Debian dom0 kernel
> with the file arch/i386/kernel/swiotlb-xen.c replaced with the version from
> the xen-unstable.hg repository (or if that doesn't compile, take the version
> of the function __sync_single() and copy that into Debian's swiotlb-xen.c).

This fixed this problem.  I will open a bug in Debian soon.

Thanks.

-- 
Marc Petit-Huguenin
Home: marc@petit-huguenin.org
Work: marc@8x8.com