From mboxrd@z Thu Jan 1 00:00:00 1970 From: Marek Marczykowski Subject: Re: High CPU temp, suspend problem - xen 4.1.5-pre, linux 3.7.x Date: Tue, 26 Mar 2013 18:42:52 +0100 Message-ID: <5151DE1C.1020307@invisiblethingslab.com> References: <5140E69F.9090803@invisiblethingslab.com> <20130315130240.GA8582@phenom.dumpdata.com> <514C79F3.5050504@invisiblethingslab.com> <20130322165651.GA4827@phenom.dumpdata.com> <515036BF.10105@invisiblethingslab.com> <20130325141701.GI11546@phenom.dumpdata.com> <515191CC.6060609@invisiblethingslab.com> <5151AC8C02000078000C88B9@nat28.tlf.novell.com> <5151A788.809@invisiblethingslab.com> <5151D4CC02000078000C8A1C@nat28.tlf.novell.com> <5151D0A9.7070100@invisiblethingslab.com> <5151D49C.2000809@citrix.com> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4385747697810552434==" Return-path: In-Reply-To: <5151D49C.2000809@citrix.com> List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xen.org Errors-To: xen-devel-bounces@lists.xen.org To: Andrew Cooper Cc: "xen-devel@lists.xen.org" , Jan Beulich , Konrad Rzeszutek Wilk List-Id: xen-devel@lists.xenproject.org This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --===============4385747697810552434== Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig0F752336C18E4A475CBBB1F0" This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig0F752336C18E4A475CBBB1F0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On 26.03.2013 18:02, Andrew Cooper wrote: > On 26/03/2013 16:45, Marek Marczykowski wrote: >> On 26.03.2013 17:03, Jan Beulich wrote: >>>>>> On 26.03.13 at 14:50, Marek Marczykowski >>> wrote: >>>> On 26.03.2013 14:11, Jan Beulich wrote: >>>>>>>> On 26.03.13 at 13:17, Marek Marczykowski =20 >>>> wrote: >>>>>> Finally got serial console :) >>>>>> The debug=3Dy problem is (actually at resume): >>>>>> (XEN) Assertion 'test_bit(vector, cfg->used_vectors)' failed at io= _apic.c:542 >>>>>> (XEN) ----[ Xen-4.1.5-rc1 x86_64 debug=3Dy Tainted: C ]---- >>>>>> (XEN) CPU: 0 >>>>>> (XEN) RIP: e008:[]=20 >>>>>> smp_irq_move_cleanup_interrupt+0x1c3/0x23d >>>>>> (XEN) RFLAGS: 0000000000010046 CONTEXT: hypervisor >>>>>> (XEN) rax: 0000000000000000 rbx: 00000000000000e9 rcx: ffff82c= 48029ff18 >>>>>> (XEN) rdx: 00000000000000e9 rsi: 000000000000002a rdi: ffff830= 421060538 >>>>>> (XEN) rbp: ffff82c48029ff08 rsp: ffff82c48029feb8 r8: ffff880= 41820eb60 >>>>>> (XEN) r9: 0000000000000000 r10: 0000000000007ff0 r11: 0000000= 000000000 >>>>>> (XEN) r12: ffff830421080250 r13: ffff830421060534 r14: ffff82c= 48029ff18 >>>>>> (XEN) r15: ffff82c4802dd9e0 cr0: 000000008005003b cr4: 0000000= 0000026f0 >>>>>> (XEN) cr3: 0000000300b81000 cr2: ffff880402070198 >>>>>> (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e= 008 >>>>>> (XEN) Xen stack trace from rsp=3Dffff82c48029feb8: >>>>>> (XEN) 0000000000000000 000000000000e030 ffff82c48029ff18 ffff82= c4802dd9e0 >>>>>> (XEN) ffff8802cac3c7c0 00000000ffff3729 00000000ffff3729 000000= 013fff3728 >>>>>> (XEN) ffffffff81b907c0 00000000ffff3729 00007d3b7fd600c7 ffff82= c48014de60 >>>>>> (XEN) 00000000ffff3729 ffffffff81b907c0 000000013fff3728 000000= 00ffff3729 >>>>>> (XEN) ffffffff81a01e18 00000000ffff3729 0000000000000000 000000= 0000007ff0 >>>>>> (XEN) 0000000000000000 ffff88041820eb60 ffff8803fd1820a8 ffffff= ff81b90a88 >>>>>> (XEN) 000000000000002a 000000000000002a 00000000ffff372a 000000= 2000000000 >>>>>> (XEN) ffffffff8105dd5a 000000000000e033 0000000000000246 ffffff= ff81a01db8 >>>>>> (XEN) 000000000000e02b 0000000000000000 0000000000000000 000000= 0000000000 >>>>>> (XEN) 0000000000000000 0000000000000000 ffff8300ca9a0000 000000= 0000000000 >>>>>> (XEN) 0000000000000000 >>>>>> (XEN) Xen call trace: >>>>>> (XEN) [] smp_irq_move_cleanup_interrupt+0x1c3= /0x23d >>>>>> (XEN) >>>>>> (XEN) >>>>>> (XEN) **************************************** >>>>>> (XEN) Panic on CPU 0: >>>>>> (XEN) Assertion 'test_bit(vector, cfg->used_vectors)' failed at io= _apic.c:542 >>>>>> (XEN) **************************************** >>>>> To make sense of this, we need to know the register (and maybe >>>>> stack) allocation at this point, to know which vector it was that >>>>> triggered the assertion. You can either do this analysis for us, or= >>>>> point us at the xen-syms binary matching the xen.gz you used. >>>> "info scope smp_irq_move_cleanup_interrupt" said vector is in %rbx, = so 0xe9. >>> And that system isn't using a strange mixed mode IO-APIC/legacy >>> PIC model, where particularly IRQ 9 (usually ACPI SCI) gets >>> channeled through the legacy PIC? >> I don't know... >> >>> Could you attach the complete log, ideally with 'i' output logged >>> right before suspending? >> Sure, attached. >> >>> Is this reproducible with 4.2.x or 4.3-unstable? If not, but if readi= ly >>> reproducible with 4.1.5-rc1, could you try changing the containing >>> loop's upper bound from "< NR_VECTORS" to >>> "<=3D LAST_DYNAMIC_VECTOR"? >> I've tried 4.2.x some time ago and bug also exists there (but I had no= t >> console, so not sure if exactly the same). 4.3 seems to be not affecte= d. Checked 4.2 and indeed also assert() in similar place. If anyone interest= ed, log here: http://duch.mimuw.edu.pl/~marmarek/qubes/console-4.2-failed-resume.log >> >=20 > Can you replace the ASSERT() with code similar to that in >=20 > http://xenbits.xen.org/gitweb/?p=3Dxen.git;a=3Dblob;f=3Dxen/arch/x86/ir= q.c;h=3D5e0f463c381750090373dabd8967635bc297d457;hb=3Drefs/heads/staging#= l668 >=20 > Which should call dump_irqs() in before dying because of the ASSERT.=20 > You might need to also take the latest version of dump_irqs() from > unstable, as I seem to remember there was another assertion failure due= > to xfree()'ing in IRQ context. Full log here: http://duch.mimuw.edu.pl/~marmarek/qubes/xen-4.1-failed-resume-dump-irqs.= log Interesting part: (XEN) *** IRQ BUG found *** (XEN) CPU0 -Testing vector 233 from bitmap 39,47,63-65,72,80,88,96,98,112,120,125,144,152,160,168,174,182-183,190,19= 2,198,200,208,214,222 (XEN) Guest interrupt information: (XEN) IRQ: 0 affinity:00000000,00000000,00000000,00000001 vec:f0 type=3DIO-APIC-edge status=3D00000000 mapped, unbound (XEN) IRQ: 1 affinity:00000000,00000000,00000000,00000002 vec:c6 type=3DIO-APIC-edge status=3D00000050 in-flight=3D0 domain-list=3D0: = 1(-S--), (XEN) IRQ: 2 affinity:ffffffff,ffffffff,ffffffff,ffffffff vec:e2 type=3DXT-PIC status=3D00000000 mapped, unbound (XEN) IRQ: 3 affinity:00000000,00000000,00000000,00000001 vec:40 type=3DIO-APIC-edge status=3D00000002 mapped, unbound (XEN) IRQ: 4 affinity:00000000,00000000,00000000,00000001 vec:f1 type=3DIO-APIC-edge status=3D00000000 mapped, unbound (XEN) IRQ: 5 affinity:00000000,00000000,00000000,00000001 vec:48 type=3DIO-APIC-edge status=3D00000002 mapped, unbound (XEN) IRQ: 6 affinity:00000000,00000000,00000000,00000001 vec:50 type=3DIO-APIC-edge status=3D00000002 mapped, unbound (XEN) IRQ: 7 affinity:00000000,00000000,00000000,00000001 vec:58 type=3DIO-APIC-edge status=3D00000050 in-flight=3D0 domain-list=3D0: = 7(-S--), (XEN) IRQ: 8 affinity:00000000,00000000,00000000,00000001 vec:60 type=3DIO-APIC-edge status=3D00000050 in-flight=3D0 domain-list=3D0: = 8(-S--), (XEN) IRQ: 9 affinity:00000000,00000000,00000000,00000001 vec:de type=3DIO-APIC-level status=3D00000010 in-flight=3D0 domain-list=3D0: = 9(-S--), (XEN) IRQ: 10 affinity:00000000,00000000,00000000,00000001 vec:70 type=3DIO-APIC-edge status=3D00000002 mapped, unbound (XEN) IRQ: 11 affinity:00000000,00000000,00000000,00000001 vec:78 type=3DIO-APIC-edge status=3D00000002 mapped, unbound (XEN) IRQ: 12 affinity:00000000,00000000,00000000,00000001 vec:27 type=3DIO-APIC-edge status=3D00000050 in-flight=3D0 domain-list=3D0: 1= 2(-S--), (XEN) IRQ: 13 affinity:00000000,00000000,00000000,0000000f vec:90 type=3DIO-APIC-edge status=3D00000002 mapped, unbound (XEN) IRQ: 14 affinity:00000000,00000000,00000000,00000001 vec:98 type=3DIO-APIC-edge status=3D00000002 mapped, unbound (XEN) IRQ: 15 affinity:00000000,00000000,00000000,00000001 vec:a0 type=3DIO-APIC-edge status=3D00000002 mapped, unbound (XEN) IRQ: 16 affinity:00000000,00000000,00000000,00000001 vec:2f type=3DIO-APIC-level status=3D00000050 in-flight=3D0 domain-list=3D0: 1= 6(-S--), (XEN) IRQ: 17 affinity:00000000,00000000,00000000,00000001 vec:3f type=3DIO-APIC-level status=3D00000050 in-flight=3D0 domain-list=3D0: 1= 7(-S--), (XEN) IRQ: 18 affinity:00000000,00000000,00000000,00000008 vec:41 type=3DIO-APIC-level status=3D00000002 mapped, unbound (XEN) IRQ: 19 affinity:00000000,00000000,00000000,0000000f vec:c8 type=3DIO-APIC-level status=3D00000002 mapped, unbound (XEN) IRQ: 20 affinity:00000000,00000000,00000000,00000002 vec:b7 type=3DIO-APIC-level status=3D00000050 in-flight=3D0 domain-list=3D0: 2= 0(-S--), (XEN) IRQ: 22 affinity:00000000,00000000,00000000,0000000f vec:62 type=3DIO-APIC-level status=3D00000002 mapped, unbound (XEN) IRQ: 23 affinity:00000000,00000000,00000000,0000000f vec:a8 type=3DIO-APIC-edge status=3D00000002 mapped, unbound (XEN) IRQ: 24 affinity:00000000,00000000,00000000,00000001 vec:28 type=3DDMA_MSI status=3D00000000 mapped, unbound (XEN) IRQ: 25 affinity:00000000,00000000,00000000,00000001 vec:30 type=3DDMA_MSI status=3D00000000 mapped, unbound (XEN) IRQ: 26 affinity:ffffffff,ffffffff,ffffffff,ffffffff vec:6f type=3DPCI-MSI status=3D00000042 mapped, unbound (XEN) IRQ: 27 affinity:ffffffff,ffffffff,ffffffff,ffffffff vec:77 type=3DPCI-MSI status=3D00000042 mapped, unbound (XEN) IRQ: 28 affinity:ffffffff,ffffffff,ffffffff,ffffffff vec:7f type=3DPCI-MSI status=3D00000042 mapped, unbound (XEN) IRQ: 29 affinity:ffffffff,ffffffff,ffffffff,ffffffff vec:87 type=3DPCI-MSI status=3D00000042 mapped, unbound (XEN) IRQ: 31 affinity:00000000,00000000,00000000,00000002 vec:a6 type=3DPCI-MSI status=3D00000002 mapped, unbound (XEN) IRQ: 32 affinity:00000000,00000000,00000000,00000001 vec:47 type=3DPCI-MSI status=3D00000050 in-flight=3D0 domain-list=3D0:27= 3(-S--), (XEN) IRQ: 33 affinity:00000000,00000000,00000000,00000002 vec:5f type=3DPCI-MSI status=3D00000010 in-flight=3D0 domain-list=3D0:27= 2(PS--), (XEN) IRQ: 34 affinity:00000000,00000000,00000000,00000001 vec:67 type=3DPCI-MSI status=3D00000010 in-flight=3D0 domain-list=3D0:27= 1(-S--), (XEN) IRQ: 35 affinity:00000000,00000000,00000000,00000001 vec:4f type=3DPCI-MSI status=3D00000050 in-flight=3D0 domain-list=3D1: 5= 5(-S--), (XEN) IO-APIC interrupt information: (XEN) IRQ 0 Vec240: (XEN) Apic 0x00, Pin 2: vec=3Df0 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 1 Vec198: (XEN) Apic 0x00, Pin 1: vec=3Dc6 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 3 Vec 64: (XEN) Apic 0x00, Pin 3: vec=3D40 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 4 Vec241: (XEN) Apic 0x00, Pin 4: vec=3Df1 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 5 Vec 72: (XEN) Apic 0x00, Pin 5: vec=3D48 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 6 Vec 80: (XEN) Apic 0x00, Pin 6: vec=3D50 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 7 Vec 88: (XEN) Apic 0x00, Pin 7: vec=3D58 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 8 Vec 96: (XEN) Apic 0x00, Pin 8: vec=3D60 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 9 Vec222: (XEN) Apic 0x00, Pin 9: vec=3Dde delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DL mask=3D0 dest_id:0 (XEN) IRQ 10 Vec112: (XEN) Apic 0x00, Pin 10: vec=3D70 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 11 Vec120: (XEN) Apic 0x00, Pin 11: vec=3D78 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 12 Vec 39: (XEN) Apic 0x00, Pin 12: vec=3D27 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 13 Vec144: (XEN) Apic 0x00, Pin 13: vec=3D90 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D1 dest_id:0 (XEN) IRQ 14 Vec152: (XEN) Apic 0x00, Pin 14: vec=3D98 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 15 Vec160: (XEN) Apic 0x00, Pin 15: vec=3Da0 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 16 Vec 47: (XEN) Apic 0x00, Pin 16: vec=3D2f delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D1 irr=3D0 trig=3DL mask=3D0 dest_id:0 (XEN) IRQ 17 Vec 63: (XEN) Apic 0x00, Pin 17: vec=3D3f delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D1 irr=3D0 trig=3DL mask=3D0 dest_id:0 (XEN) IRQ 18 Vec 65: (XEN) Apic 0x00, Pin 18: vec=3D41 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D1 irr=3D0 trig=3DL mask=3D1 dest_id:0 (XEN) IRQ 19 Vec200: (XEN) Apic 0x00, Pin 19: vec=3Dc8 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D1 irr=3D0 trig=3DL mask=3D1 dest_id:0 (XEN) IRQ 20 Vec183: (XEN) Apic 0x00, Pin 20: vec=3Db7 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D1 irr=3D0 trig=3DL mask=3D0 dest_id:0 (XEN) IRQ 22 Vec 98: (XEN) Apic 0x00, Pin 22: vec=3D62 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D1 irr=3D0 trig=3DL mask=3D1 dest_id:0 (XEN) IRQ 23 Vec168: (XEN) Apic 0x00, Pin 23: vec=3Da8 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D1 dest_id:0 (XEN) Xen BUG at io_apic.c:554 (XEN) ----[ Xen-4.1.5-rc1 x86_64 debug=3Dy Tainted: C ]---- (XEN) CPU: 0 (XEN) RIP: e008:[] smp_irq_move_cleanup_interrupt+0x= 211/0x289 (XEN) RFLAGS: 0000000000010092 CONTEXT: hypervisor (XEN) rax: 0000000000000000 rbx: 00000000000000e9 rcx: 00000000000000= 00 (XEN) rdx: 0000000000000016 rsi: 000000000000000a rdi: ffff82c4802592= e0 (XEN) rbp: ffff82c48029fd08 rsp: ffff82c48029fcb8 r8: 00000000000000= 18 (XEN) r9: 0000000000000000 r10: 0000000000000000 r11: 00000000000000= 01 (XEN) r12: ffff830421080250 r13: ffff830421060534 r14: ffff82c48029ff= 18 (XEN) r15: ffff82c4802dd9e0 cr0: 000000008005003b cr4: 00000000000026= f0 (XEN) cr3: 0000000119a96000 cr2: ffff880402070198 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) Xen stack trace from rsp=3Dffff82c48029fcb8: (XEN) 0000000000000000 ffff82c48029ff18 ffff82c4802dd9e0 000000e900000= 000 (XEN) ffff83042109ba04 ffff830421008000 0000000000000114 0000000000000= 01d (XEN) 0000000000000114 0000000000000000 00007d3b7fd602c7 ffff82c48014d= e60 (XEN) 0000000000000000 0000000000000114 000000000000001d 0000000000000= 114 (XEN) ffff82c48029fdc8 ffff830421008000 0000000000000246 ffff82c48025c= 1f0 (XEN) 0000000000000003 0000001944602466 0000000000000000 0000000000000= 001 (XEN) 0000000000000000 0000000000000286 ffff830421060f34 0000002000000= 000 (XEN) ffff82c4801226c0 000000000000e008 0000000000000286 ffff82c48029f= dc8 (XEN) 000000000000e010 0000000000000286 ffff82c48029fe48 ffff82c480164= 446 (XEN) ffff82c4802dd9e0 0000000000000286 ffff830421060f00 ffff830421060= f34 (XEN) ffff830421050ac0 000000000000001d 0000000000000246 ffff8301108fd= 140 (XEN) ffff82c4801226d3 ffff82c48029fe78 000000000000001d ffff8803fa889= af0 (XEN) 0000000000000114 ffff8804023be000 ffff82c48029fef8 ffff82c480176= 55b (XEN) ffff830114c7f300 ffffffff81381646 ffff82f600000008 ffff830421008= 000 (XEN) 0000000000000003 000000030000001d 00000000e2200000 0000000100a0f= b00 (XEN) 0000000000007ff0 ffffffffffffffff 0000000000000003 0000000000000= 003 (XEN) 00000000e2200000 c390ed90d1ffffff 0000000000000202 ffff8300ca666= 000 (XEN) ffff8803fc880240 0000000000000011 ffff8804023be858 ffff8804023be= 000 (XEN) 00007d3b7fd600c7 ffff82c480209f38 ffffffff8100142a 0000000000000= 021 (XEN) ffff8804023be000 ffff8804023be858 0000000000000011 ffff8803fc880= 240 (XEN) Xen call trace: (XEN) [] smp_irq_move_cleanup_interrupt+0x211/0x289 (XEN) [] irq_move_cleanup_interrupt+0x30/0x40 (XEN) [] _spin_unlock_irqrestore+0x22/0x24 (XEN) [] map_domain_pirq+0x37a/0x3df (XEN) [] do_physdev_op+0xa2b/0x1508 (XEN) [] syscall_enter+0xc8/0x122 >=20 > ~Andrew >=20 --=20 Best Regards / Pozdrawiam, Marek Marczykowski Invisible Things Lab --------------enig0F752336C18E4A475CBBB1F0 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (GNU/Linux) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iQEcBAEBAgAGBQJRUd4cAAoJENuP0xzK19cserAIAJnCkwSNPCw1mITQQ0KEgpgo DVB4A88rArlD3kRxJXyTu/lM9a9Cd41ebstqOZINDQyiY5oSpUchFJ7nZ1FcZ5FA WJ7ki9bz7oxPQ01z+17MFnqOLkXGApx4wbEX0GE+MKob2SzqvUbqdyvVJ7aBb4+o +IhJN6kf7HT+uqfyZUSdilRHkkAclhjVh+OZ3qibg9kmoWNh1oBasFHQxJif5/Vl 7UVRuurL2Ix6SFFEG+wbGJznE9Y3uO8so1xx0z+kHPZUzXz6OpLjojnCMqY1sKbr acxEmSHNsRISKS+PZZnnDvtxYmR6raAUNPj6KXfUpwXqwCQ44YjgLLlkOu+T45o= =SwRs -----END PGP SIGNATURE----- --------------enig0F752336C18E4A475CBBB1F0-- --===============4385747697810552434== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel --===============4385747697810552434==--