From mboxrd@z Thu Jan 1 00:00:00 1970 From: Marek Marczykowski Subject: Re: High CPU temp, suspend problem - xen 4.1.5-pre, linux 3.7.x Date: Tue, 26 Mar 2013 19:21:33 +0100 Message-ID: <5151E72D.30205@invisiblethingslab.com> References: <5140E69F.9090803@invisiblethingslab.com> <20130315130240.GA8582@phenom.dumpdata.com> <514C79F3.5050504@invisiblethingslab.com> <20130322165651.GA4827@phenom.dumpdata.com> <515036BF.10105@invisiblethingslab.com> <20130325141701.GI11546@phenom.dumpdata.com> <515191CC.6060609@invisiblethingslab.com> <5151AC8C02000078000C88B9@nat28.tlf.novell.com> <5151A788.809@invisiblethingslab.com> <5151D4CC02000078000C8A1C@nat28.tlf.novell.com> <5151D0A9.7070100@invisiblethingslab.com> <5151D49C.2000809@citrix.com> <5151DE1C.1020307@invisiblethingslab.com> <5151E0D5.3050707@citrix.com> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7680171259191824133==" Return-path: In-Reply-To: <5151E0D5.3050707@citrix.com> List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xen.org Errors-To: xen-devel-bounces@lists.xen.org To: Andrew Cooper Cc: "xen-devel@lists.xen.org" , Jan Beulich , Konrad Rzeszutek Wilk List-Id: xen-devel@lists.xenproject.org This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --===============7680171259191824133== Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig5215814E711F65330D08FAC9" This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig5215814E711F65330D08FAC9 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On 26.03.2013 18:54, Andrew Cooper wrote: >=20 >>> Can you replace the ASSERT() with code similar to that in >>> >>> http://xenbits.xen.org/gitweb/?p=3Dxen.git;a=3Dblob;f=3Dxen/arch/x86/= irq.c;h=3D5e0f463c381750090373dabd8967635bc297d457;hb=3Drefs/heads/stagin= g#l668 >>> >>> Which should call dump_irqs() in before dying because of the ASSERT. = >>> You might need to also take the latest version of dump_irqs() from >>> unstable, as I seem to remember there was another assertion failure d= ue >>> to xfree()'ing in IRQ context. >> Full log here: >> http://duch.mimuw.edu.pl/~marmarek/qubes/xen-4.1-failed-resume-dump-ir= qs.log >> Interesting part: (...) > Even more curious. vector e9 does not appear to be programmed in. Can= > you extend the debugging to also call __print_IO_APIC(). >=20 > The i debug key and z debug key list IO-APIC entries from different > sources of information. As you wish, full log: http://duch.mimuw.edu.pl/~marmarek/qubes/xen-4.1-failed-resume-dump-irqs2= =2Elog Final part: (XEN) *** IRQ BUG found *** (XEN) CPU0 -Testing vector 233 from bitmap 43,49,64,72,80,87-88,95-96,103,112,119-121,127,135,143-144,151-152,159-16= 0,168,192,197,200,211,216,218 (XEN) Guest interrupt information: (XEN) IRQ: 0 affinity:00000000,00000000,00000000,00000001 vec:f0 type=3DIO-APIC-edge status=3D00000000 mapped, unbound (XEN) IRQ: 1 affinity:00000000,00000000,00000000,00000001 vec:7f type=3DIO-APIC-edge status=3D00000050 in-flight=3D0 domain-list=3D0: = 1(-S--), (XEN) IRQ: 2 affinity:ffffffff,ffffffff,ffffffff,ffffffff vec:e2 type=3DXT-PIC status=3D00000000 mapped, unbound (XEN) IRQ: 3 affinity:00000000,00000000,00000000,00000001 vec:40 type=3DIO-APIC-edge status=3D00000002 mapped, unbound (XEN) IRQ: 4 affinity:00000000,00000000,00000000,00000001 vec:f1 type=3DIO-APIC-edge status=3D00000000 mapped, unbound (XEN) IRQ: 5 affinity:00000000,00000000,00000000,00000001 vec:48 type=3DIO-APIC-edge status=3D00000002 mapped, unbound (XEN) IRQ: 6 affinity:00000000,00000000,00000000,00000001 vec:50 type=3DIO-APIC-edge status=3D00000002 mapped, unbound (XEN) IRQ: 7 affinity:00000000,00000000,00000000,00000008 vec:da type=3DIO-APIC-edge status=3D00000050 in-flight=3D0 domain-list=3D0: = 7(-S--), (XEN) IRQ: 8 affinity:00000000,00000000,00000000,00000004 vec:d8 type=3DIO-APIC-edge status=3D00000050 in-flight=3D0 domain-list=3D0: = 8(-S--), (XEN) IRQ: 9 affinity:00000000,00000000,00000000,00000001 vec:87 type=3DIO-APIC-level status=3D00000010 in-flight=3D0 domain-list=3D0: = 9(-S--), (XEN) IRQ: 10 affinity:00000000,00000000,00000000,00000001 vec:70 type=3DIO-APIC-edge status=3D00000002 mapped, unbound (XEN) IRQ: 11 affinity:00000000,00000000,00000000,00000001 vec:78 type=3DIO-APIC-edge status=3D00000002 mapped, unbound (XEN) IRQ: 12 affinity:00000000,00000000,00000000,00000001 vec:8f type=3DIO-APIC-edge status=3D00000050 in-flight=3D0 domain-list=3D0: 1= 2(-S--), (XEN) IRQ: 13 affinity:00000000,00000000,00000000,0000000f vec:90 type=3DIO-APIC-edge status=3D00000002 mapped, unbound (XEN) IRQ: 14 affinity:00000000,00000000,00000000,00000001 vec:98 type=3DIO-APIC-edge status=3D00000002 mapped, unbound (XEN) IRQ: 15 affinity:00000000,00000000,00000000,00000001 vec:a0 type=3DIO-APIC-edge status=3D00000002 mapped, unbound (XEN) IRQ: 16 affinity:00000000,00000000,00000000,00000001 vec:97 type=3DIO-APIC-level status=3D00000050 in-flight=3D0 domain-list=3D0: 1= 6(-S--), (XEN) IRQ: 17 affinity:00000000,00000000,00000000,00000001 vec:9f type=3DIO-APIC-level status=3D00000050 in-flight=3D0 domain-list=3D0: 1= 7(-S--), (XEN) IRQ: 18 affinity:00000000,00000000,00000000,00000004 vec:79 type=3DIO-APIC-level status=3D00000002 mapped, unbound (XEN) IRQ: 19 affinity:00000000,00000000,00000000,0000000f vec:c8 type=3DIO-APIC-level status=3D00000002 mapped, unbound (XEN) IRQ: 20 affinity:00000000,00000000,00000000,00000002 vec:d3 type=3DIO-APIC-level status=3D00000050 in-flight=3D0 domain-list=3D0: 2= 0(-S--), (XEN) IRQ: 22 affinity:00000000,00000000,00000000,0000000f vec:2b type=3DIO-APIC-level status=3D00000002 mapped, unbound (XEN) IRQ: 23 affinity:00000000,00000000,00000000,0000000f vec:a8 type=3DIO-APIC-edge status=3D00000002 mapped, unbound (XEN) IRQ: 24 affinity:00000000,00000000,00000000,00000001 vec:28 type=3DDMA_MSI status=3D00000000 mapped, unbound (XEN) IRQ: 25 affinity:00000000,00000000,00000000,00000001 vec:30 type=3DDMA_MSI status=3D00000000 mapped, unbound (XEN) IRQ: 26 affinity:00000000,00000000,00000000,00000001 vec:c7 type=3DPCI-MSI status=3D00000010 in-flight=3D0 domain-list=3D0:27= 9(-S--), (XEN) IRQ: 27 affinity:00000000,00000000,00000000,00000001 vec:cf type=3DPCI-MSI status=3D00000050 in-flight=3D0 domain-list=3D0:27= 8(-S--), (XEN) IRQ: 28 affinity:00000000,00000000,00000000,00000001 vec:d7 type=3DPCI-MSI status=3D00000050 in-flight=3D0 domain-list=3D0:27= 7(-S--), (XEN) IRQ: 29 affinity:00000000,00000000,00000000,00000001 vec:df type=3DPCI-MSI status=3D00000050 in-flight=3D0 domain-list=3D0:27= 6(-S--), (XEN) IRQ: 30 affinity:00000000,00000000,00000000,00000001 vec:38 type=3DPCI-MSI status=3D00000050 in-flight=3D0 domain-list=3D0:27= 5(-S--), (XEN) IRQ: 31 affinity:00000000,00000000,00000000,00000004 vec:47 type=3DPCI-MSI status=3D00000002 mapped, unbound (XEN) IRQ: 32 affinity:00000000,00000000,00000000,00000001 vec:a7 type=3DPCI-MSI status=3D00000050 in-flight=3D0 domain-list=3D0:27= 3(-S--), (XEN) IRQ: 33 affinity:00000000,00000000,00000000,00000001 vec:b7 type=3DPCI-MSI status=3D00000010 in-flight=3D0 domain-list=3D0:27= 2(-S--), (XEN) IRQ: 34 affinity:00000000,00000000,00000000,00000004 vec:40 type=3DPCI-MSI status=3D00000010 in-flight=3D0 domain-list=3D0:27= 1(PS--), (XEN) IRQ: 35 affinity:00000000,00000000,00000000,00000001 vec:af type=3DPCI-MSI status=3D00000050 in-flight=3D0 domain-list=3D1: 5= 5(-S--), (XEN) IO-APIC interrupt information: (XEN) IRQ 0 Vec240: (XEN) Apic 0x00, Pin 2: vec=3Df0 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 1 Vec127: (XEN) Apic 0x00, Pin 1: vec=3D7f delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 3 Vec 64: (XEN) Apic 0x00, Pin 3: vec=3D40 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 4 Vec241: (XEN) Apic 0x00, Pin 4: vec=3Df1 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 5 Vec 72: (XEN) Apic 0x00, Pin 5: vec=3D48 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 6 Vec 80: (XEN) Apic 0x00, Pin 6: vec=3D50 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 7 Vec218: (XEN) Apic 0x00, Pin 7: vec=3Dda delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 8 Vec216: (XEN) Apic 0x00, Pin 8: vec=3Dd8 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 9 Vec135: (XEN) Apic 0x00, Pin 9: vec=3D87 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DL mask=3D0 dest_id:0 (XEN) IRQ 10 Vec112: (XEN) Apic 0x00, Pin 10: vec=3D70 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 11 Vec120: (XEN) Apic 0x00, Pin 11: vec=3D78 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 12 Vec143: (XEN) Apic 0x00, Pin 12: vec=3D8f delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 13 Vec144: (XEN) Apic 0x00, Pin 13: vec=3D90 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D1 dest_id:0 (XEN) IRQ 14 Vec152: (XEN) Apic 0x00, Pin 14: vec=3D98 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 15 Vec160: (XEN) Apic 0x00, Pin 15: vec=3Da0 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D0 dest_id:0 (XEN) IRQ 16 Vec151: (XEN) Apic 0x00, Pin 16: vec=3D97 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D1 irr=3D0 trig=3DL mask=3D0 dest_id:0 (XEN) IRQ 17 Vec159: (XEN) Apic 0x00, Pin 17: vec=3D9f delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D1 irr=3D0 trig=3DL mask=3D0 dest_id:0 (XEN) IRQ 18 Vec121: (XEN) Apic 0x00, Pin 18: vec=3D79 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D1 irr=3D0 trig=3DL mask=3D1 dest_id:0 (XEN) IRQ 19 Vec200: (XEN) Apic 0x00, Pin 19: vec=3Dc8 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D1 irr=3D0 trig=3DL mask=3D1 dest_id:0 (XEN) IRQ 20 Vec211: (XEN) Apic 0x00, Pin 20: vec=3Dd3 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D1 irr=3D0 trig=3DL mask=3D0 dest_id:0 (XEN) IRQ 22 Vec 43: (XEN) Apic 0x00, Pin 22: vec=3D2b delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D1 irr=3D0 trig=3DL mask=3D1 dest_id:0 (XEN) IRQ 23 Vec168: (XEN) Apic 0x00, Pin 23: vec=3Da8 delivery=3DLoPri dest=3DL status=3D= 0 polarity=3D0 irr=3D0 trig=3DE mask=3D1 dest_id:0 (XEN) number of MP IRQ sources: 15. (XEN) number of IO-APIC #2 registers: 24. (XEN) testing the IO APIC....................... (XEN) IO APIC #2...... (XEN) .... register #00: 02000000 (XEN) ....... : physical APIC id: 02 (XEN) ....... : Delivery Type: 0 (XEN) ....... : LTS : 0 (XEN) .... register #01: 00170020 (XEN) ....... : max redirection entries: 0017 (XEN) ....... : PRQ implemented: 0 (XEN) ....... : IO APIC version: 0020 (XEN) .... IRQ redirection table: (XEN) NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect: (XEN) 00 0DC 0C 1 0 0 0 0 1 2 87 (XEN) 01 000 00 0 0 0 0 0 1 1 7F (XEN) 02 000 00 0 0 0 0 0 1 1 F0 (XEN) 03 000 00 0 0 0 0 0 1 1 40 (XEN) 04 000 00 0 0 0 0 0 1 1 F1 (XEN) 05 000 00 0 0 0 0 0 1 1 48 (XEN) 06 000 00 0 0 0 0 0 1 1 50 (XEN) 07 000 00 0 0 0 0 0 1 1 DA (XEN) 08 000 00 0 0 0 0 0 1 1 D8 (XEN) 09 000 00 0 1 0 0 0 1 1 87 (XEN) 0a 000 00 0 0 0 0 0 1 1 70 (XEN) 0b 000 00 0 0 0 0 0 1 1 78 (XEN) 0c 000 00 0 0 0 0 0 1 1 8F (XEN) 0d 000 00 1 0 0 0 0 1 1 90 (XEN) 0e 000 00 0 0 0 0 0 1 1 98 (XEN) 0f 000 00 0 0 0 0 0 1 1 A0 (XEN) 10 000 00 0 1 0 1 0 1 1 97 (XEN) 11 000 00 0 1 0 1 0 1 1 9F (XEN) 12 000 00 1 1 0 1 0 1 1 79 (XEN) 13 000 00 1 1 0 1 0 1 1 C8 (XEN) 14 000 00 0 1 0 1 0 1 1 D3 (XEN) 15 000 00 1 0 0 0 0 0 0 00 (XEN) 16 000 00 1 1 0 1 0 1 1 2B (XEN) 17 000 00 1 0 0 0 0 1 1 A8 (XEN) Using vector-based indexing (XEN) IRQ to pin mappings: (XEN) IRQ240 -> 0:2 (XEN) IRQ127 -> 0:1 (XEN) IRQ64 -> 0:3 (XEN) IRQ241 -> 0:4 (XEN) IRQ72 -> 0:5 (XEN) IRQ80 -> 0:6 (XEN) IRQ218 -> 0:7 (XEN) IRQ216 -> 0:8 (XEN) IRQ135 -> 0:9 (XEN) IRQ112 -> 0:10 (XEN) IRQ120 -> 0:11 (XEN) IRQ143 -> 0:12 (XEN) IRQ144 -> 0:13 (XEN) IRQ152 -> 0:14 (XEN) IRQ160 -> 0:15 (XEN) IRQ151 -> 0:16 (XEN) IRQ159 -> 0:17 (XEN) IRQ121 -> 0:18 (XEN) IRQ200 -> 0:19 (XEN) IRQ211 -> 0:20 (XEN) IRQ43 -> 0:22 (XEN) IRQ168 -> 0:23 (XEN) .................................... done. (XEN) Xen BUG at io_apic.c:556 (XEN) ----[ Xen-4.1.5-rc1 x86_64 debug=3Dy Tainted: C ]---- (XEN) CPU: 0 (XEN) RIP: e008:[] smp_irq_move_cleanup_interrupt+0x= 216/0x28e (XEN) RFLAGS: 0000000000010092 CONTEXT: hypervisor (XEN) rax: 0000000000000000 rbx: 00000000000000e9 rcx: 00000000000000= 00 (XEN) rdx: 0000000000000000 rsi: 000000000000000a rdi: ffff82c4802592= e0 (XEN) rbp: ffff82c48029ff08 rsp: ffff82c48029feb8 r8: 00000000000000= 04 (XEN) r9: 0000000000000004 r10: 0000000000000004 r11: 00000000000000= 02 (XEN) r12: ffff830421080250 r13: ffff830421060534 r14: ffff82c48029ff= 18 (XEN) r15: ffff82c4802dd9e0 cr0: 000000008005003b cr4: 00000000000026= f0 (XEN) cr3: 000000026582c000 cr2: ffff8804020701d8 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008 (XEN) Xen stack trace from rsp=3Dffff82c48029feb8: (XEN) 0000000000000000 ffff82c48029ff18 ffff82c4802dd9e0 000000e900000= 000 (XEN) 000000000000e02b 0000000000000000 000000004bf51982 0000000000006= 0a9 (XEN) 0000000000000000 0000000000000000 00007d3b7fd600c7 ffff82c48014d= e60 (XEN) 0000000000000000 0000000000000000 00000000000060a9 000000004bf51= 982 (XEN) ffff8802d2665b28 0000000000000000 0000000000000000 0000000000007= ff0 (XEN) 0000000000000022 0000000000000000 000000024bf57322 0000000001307= da0 (XEN) 00000000000059a0 0000000000000000 00000000000060a9 0000002000000= 000 (XEN) ffffffff8123c51a 000000000000e033 0000000000000293 ffff8802d2665= b08 (XEN) 000000000000e02b 0000000000000000 0000000000000000 0000000000000= 000 (XEN) 0000000000000000 0000000000000000 ffff8300ca9a0000 0000000000000= 000 (XEN) 0000000000000000 (XEN) Xen call trace: (XEN) [] smp_irq_move_cleanup_interrupt+0x216/0x28e --=20 Best Regards / Pozdrawiam, Marek Marczykowski Invisible Things Lab --------------enig5215814E711F65330D08FAC9 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (GNU/Linux) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iQEcBAEBAgAGBQJRUectAAoJENuP0xzK19cs/DUH/2vrOhrz7Fh+h1UMOh51k0bd arwJcgyzEH2ytBqcEuIv1nJTd3qAz5HhfAxvzXooIhcWYX5Mgexj2O6sYyjmnY7o +076+8eOWNablpDvaXqyXV+dNjRqTy/FelgY9nULV5pgzpGChF23jb47B91XRME4 VDl9hlq84kSh5rS33+LfZOGq1rfVr80QNgrL1eo5vGi+iOP93QMfB+DGqD2429nI a7ksDX3kq338SSjDziYIEyZ6QsPWZRVAatA0BiXxIWyL79yEqVpVfjKvMoOPva28 THOwu0d934LK7xvw+v1mLHvJMEAzJ/3efxR0ymmi2LsqI6QhIg8Bb8jvE7+wPRA= =+vRO -----END PGP SIGNATURE----- --------------enig5215814E711F65330D08FAC9-- --===============7680171259191824133== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel --===============7680171259191824133==--