From mboxrd@z Thu Jan  1 00:00:00 1970
From: Andrew Cooper <andrew.cooper3@citrix.com>
Subject: Re: Xen-unstable: Xen panic when shutting down HVM
 guest with PCI passthrough: RIP: e008:[<ffff82d0801099b1>]
 evtchn_move_pirqs+0x90/0xbf
Date: Thu, 5 Jun 2014 16:03:24 +0100
Message-ID: <539086BC.7070200@citrix.com>
References: <495141585.20140605165458@eikelenboom.it>
Mime-Version: 1.0
Content-Type: multipart/mixed; boundary="===============8304666691890189464=="
Return-path: <xen-devel-bounces@lists.xen.org>
Received: from mail6.bemta4.messagelabs.com ([85.158.143.247])
	by lists.xen.org with esmtp (Exim 4.72)
	(envelope-from <Andrew.Cooper3@citrix.com>) id 1WsZD5-0001fn-81
	for xen-devel@lists.xenproject.org; Thu, 05 Jun 2014 15:04:07 +0000
In-Reply-To: <495141585.20140605165458@eikelenboom.it>
List-Unsubscribe: <http://lists.xen.org/cgi-bin/mailman/options/xen-devel>,
	<mailto:xen-devel-request@lists.xen.org?subject=unsubscribe>
List-Post: <mailto:xen-devel@lists.xen.org>
List-Help: <mailto:xen-devel-request@lists.xen.org?subject=help>
List-Subscribe: <http://lists.xen.org/cgi-bin/mailman/listinfo/xen-devel>,
	<mailto:xen-devel-request@lists.xen.org?subject=subscribe>
Sender: xen-devel-bounces@lists.xen.org
Errors-To: xen-devel-bounces@lists.xen.org
To: Sander Eikelenboom <linux@eikelenboom.it>
Cc: xen-devel@lists.xenproject.org, Jan Beulich <jbeulich@suse.com>
List-Id: xen-devel@lists.xenproject.org

--===============8304666691890189464==
Content-Type: multipart/alternative;
	boundary="------------030700090605050001050800"

--------------030700090605050001050800
Content-Type: text/plain; charset="ISO-8859-1"
Content-Transfer-Encoding: 7bit

On 05/06/14 15:54, Sander Eikelenboom wrote:
> Hi,
>
> When shutting down a HVM guest with PCI passthrough Xen panics with the panic 
> below (complete xl-dmesg attached).
>
> # addr2line -e xen-syms ffff82d0801099b1
> /usr/src/new/xen-unstable/xen/common/event_channel.c:1326
>
> which is:
>         pirq_set_affinity(d, chn->u.pirq.irq, mask);

This is presumably an ordering issue on destroy.

Does reverting bac6334b5 fix the problem?

~Andrew

>
> (XEN) [2014-06-05 14:10:54.290] AMD-Vi: Disable: device id = 0x700, domain = 1, paging mode = 4
> (XEN) [2014-06-05 14:10:54.290] AMD-Vi: Setup I/O page table: device id = 0x700, type = 0x1, root table = 0x54ef41000, domain = 0, paging mode = 3
> (XEN) [2014-06-05 14:10:54.290] AMD-Vi: Re-assign 0000:07:00.0 from dom1 to dom0
> (XEN) [2014-06-05 14:10:54.650] ----[ Xen-4.5-unstable  x86_64  debug=y  Not tainted ]----
> (XEN) [2014-06-05 14:10:54.650] CPU:    5
> (XEN) [2014-06-05 14:10:54.650] RIP:    e008:[<ffff82d0801099b1>] evtchn_move_pirqs+0x90/0xbf
> (XEN) [2014-06-05 14:10:54.650] RFLAGS: 0000000000010202   CONTEXT: hypervisor
> (XEN) [2014-06-05 14:10:54.650] rax: 0000000000000019   rbx: 0000000000000320   rcx: 0000000000000001
> (XEN) [2014-06-05 14:10:54.650] rdx: ffff83054ef86020   rsi: 0000000000000200   rdi: ffff8305416eb0bc
> (XEN) [2014-06-05 14:10:54.650] rbp: ffff83054ef7fce8   rsp: ffff83054ef7fcc8   r8:  0000000000000001
> (XEN) [2014-06-05 14:10:54.650] r9:  000000000000003a   r10: ffff82e008e31940   r11: 0000000000000001
> (XEN) [2014-06-05 14:10:54.650] r12: ffff8305416eb000   r13: ffff82d08023d740   r14: ffff8305416eb0b8
> (XEN) [2014-06-05 14:10:54.650] r15: ffffffffffffffff   cr0: 000000008005003b   cr4: 00000000000006f0
> (XEN) [2014-06-05 14:10:54.650] cr3: 0000000537296000   cr2: 0000000000000328
> (XEN) [2014-06-05 14:10:54.650] ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: e010   cs: e008
> (XEN) [2014-06-05 14:10:54.650] Xen stack trace from rsp=ffff83054ef7fcc8:
> (XEN) [2014-06-05 14:10:54.650]    ffff83009faf7000 0000000000000000 ffff830546cb6ee0 ffff83054eff8d00
> (XEN) [2014-06-05 14:10:54.650]    ffff83054ef7fd68 ffff82d080126e2f ffff83054ef7fd48 ffff830546df8ef0
> (XEN) [2014-06-05 14:10:54.650]    00000000416eb1c0 ffff830546333870 ffff8305416eb000 ffff82d080320d60
> (XEN) [2014-06-05 14:10:54.650]    ffff82d080277d20 ffff83054eff1068 0000000000000000 ffff8305416eb000
> (XEN) [2014-06-05 14:10:54.650]    ffff8305416eb000 0000000000000000 0000000000000000 0000000000000011
> (XEN) [2014-06-05 14:10:54.650]    ffff83054ef7fd98 ffff82d080105dcc ffff82d080129dcf ffff8305416eb000
> (XEN) [2014-06-05 14:10:54.650]    ffffffffffffffff 00007f9b40a0b004 ffff83054ef7fef8 ffff82d080103926
> (XEN) [2014-06-05 14:10:54.650]    ffff83054ef913a0 0000000000000282 ffff8305480e1010 ffff83009fd27000
> (XEN) [2014-06-05 14:10:54.650]    0000000000000000 ffff83009fd2718c 0000000000000246 0000000000000011
> (XEN) [2014-06-05 14:10:54.650]    ffff83054ef7fdf8 0000000000000206 ffff83054ef7fe18 ffff82d08012c757
> (XEN) [2014-06-05 14:10:54.650]    ffff83009fd27060 0000000000000005 ffff83054ef7fe68 0000000000000206
> (XEN) [2014-06-05 14:10:54.650]    ffff83009fd27088 0000000000000286 0000000a00000002 0000000000000001
> (XEN) [2014-06-05 14:10:54.650]    0000000001eb2168 0000000001eb16a0 00007f9b4037c000 00007f9b407fc9f2
> (XEN) [2014-06-05 14:10:54.650]    35622d6200000005 0000000000000000 00007fff2b72c740 00007f9b40158620
> (XEN) [2014-06-05 14:10:54.650]    0000000000000010 0000000001ea8330 00007fff2b72c7b0 0000000001eb1e40
> (XEN) [2014-06-05 14:10:54.650]    0000000000000001 00007f9b40802a55 0000000000000000 00007f9b3fa753c7
> (XEN) [2014-06-05 14:10:54.650]    ffff83054ef7fed8 ffff83009fd27000 0000000000000011 ffff88004d45ab98
> (XEN) [2014-06-05 14:10:54.650]    00007fff2b72c650 0000000000000011 00007cfab10800c7 ffff82d08022ca8b
> (XEN) [2014-06-05 14:10:54.651]    ffffffff8100148a 0000000000000024 0000000000000011 00007fff2b72c650
> (XEN) [2014-06-05 14:10:54.651]    ffff88004d45ab98 0000000000000011 ffff88004a14be98 00007fff2b72c650
> (XEN) [2014-06-05 14:10:54.651] Xen call trace:
> (XEN) [2014-06-05 14:10:54.651]    [<ffff82d0801099b1>] evtchn_move_pirqs+0x90/0xbf
> (XEN) [2014-06-05 14:10:54.651]    [<ffff82d080126e2f>] sched_move_domain+0x2c1/0x3ea
> (XEN) [2014-06-05 14:10:54.651]    [<ffff82d080105dcc>] domain_kill+0xd0/0x159
> (XEN) [2014-06-05 14:10:54.651]    [<ffff82d080103926>] do_domctl+0xab8/0x1542
> (XEN) [2014-06-05 14:10:54.651]    [<ffff82d08022ca8b>] syscall_enter+0xeb/0x145
> (XEN) [2014-06-05 14:10:54.651] 
> (XEN) [2014-06-05 14:10:54.651] Pagetable walk from 0000000000000328:
> (XEN) [2014-06-05 14:10:54.651]  L4[0x000] = 0000000544e38067 0000000000057fc5
> (XEN) [2014-06-05 14:10:54.651]  L3[0x000] = 000000053cc28067 000000000004fdd5
> (XEN) [2014-06-05 14:10:54.651]  L2[0x000] = 0000000000000000 ffffffffffffffff 
> (XEN) [2014-06-05 14:10:55.709] 
> (XEN) [2014-06-05 14:10:55.718] ****************************************
> (XEN) [2014-06-05 14:10:55.737] Panic on CPU 5:
> (XEN) [2014-06-05 14:10:55.750] FATAL PAGE FAULT
> (XEN) [2014-06-05 14:10:55.763] [error_code=0000]
> (XEN) [2014-06-05 14:10:55.776] Faulting linear address: 0000000000000328
> (XEN) [2014-06-05 14:10:55.796] ****************************************
> (XEN) [2014-06-05 14:10:55.815] 
> (XEN) [2014-06-05 14:10:55.824] Reboot in five seconds...
> (XEN) [2014-06-05 14:10:55.839] APIC error on CPU0: 00(08)
> (XEN) [2014-06-05 14:10:55.855] APIC error on CPU0: 08(08)
>
>
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xen.org
> http://lists.xen.org/xen-devel


--------------030700090605050001050800
Content-Type: text/html; charset="ISO-8859-1"
Content-Transfer-Encoding: 7bit

<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    <div class="moz-cite-prefix">On 05/06/14 15:54, Sander Eikelenboom
      wrote:<br>
    </div>
    <blockquote cite="mid:495141585.20140605165458@eikelenboom.it"
      type="cite">
      <pre wrap="">Hi,

When shutting down a HVM guest with PCI passthrough Xen panics with the panic 
below (complete xl-dmesg attached).

# addr2line -e xen-syms ffff82d0801099b1
/usr/src/new/xen-unstable/xen/common/event_channel.c:1326

which is:
        pirq_set_affinity(d, chn-&gt;u.pirq.irq, mask);</pre>
    </blockquote>
    <br>
    This is presumably an ordering issue on destroy.<br>
    <br>
    Does reverting bac6334b5 fix the problem?<br>
    <br>
    ~Andrew<br>
    <br>
    <blockquote cite="mid:495141585.20140605165458@eikelenboom.it"
      type="cite">
      <pre wrap="">

(XEN) [2014-06-05 14:10:54.290] AMD-Vi: Disable: device id = 0x700, domain = 1, paging mode = 4
(XEN) [2014-06-05 14:10:54.290] AMD-Vi: Setup I/O page table: device id = 0x700, type = 0x1, root table = 0x54ef41000, domain = 0, paging mode = 3
(XEN) [2014-06-05 14:10:54.290] AMD-Vi: Re-assign 0000:07:00.0 from dom1 to dom0
(XEN) [2014-06-05 14:10:54.650] ----[ Xen-4.5-unstable  x86_64  debug=y  Not tainted ]----
(XEN) [2014-06-05 14:10:54.650] CPU:    5
(XEN) [2014-06-05 14:10:54.650] RIP:    e008:[&lt;ffff82d0801099b1&gt;] evtchn_move_pirqs+0x90/0xbf
(XEN) [2014-06-05 14:10:54.650] RFLAGS: 0000000000010202   CONTEXT: hypervisor
(XEN) [2014-06-05 14:10:54.650] rax: 0000000000000019   rbx: 0000000000000320   rcx: 0000000000000001
(XEN) [2014-06-05 14:10:54.650] rdx: ffff83054ef86020   rsi: 0000000000000200   rdi: ffff8305416eb0bc
(XEN) [2014-06-05 14:10:54.650] rbp: ffff83054ef7fce8   rsp: ffff83054ef7fcc8   r8:  0000000000000001
(XEN) [2014-06-05 14:10:54.650] r9:  000000000000003a   r10: ffff82e008e31940   r11: 0000000000000001
(XEN) [2014-06-05 14:10:54.650] r12: ffff8305416eb000   r13: ffff82d08023d740   r14: ffff8305416eb0b8
(XEN) [2014-06-05 14:10:54.650] r15: ffffffffffffffff   cr0: 000000008005003b   cr4: 00000000000006f0
(XEN) [2014-06-05 14:10:54.650] cr3: 0000000537296000   cr2: 0000000000000328
(XEN) [2014-06-05 14:10:54.650] ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: e010   cs: e008
(XEN) [2014-06-05 14:10:54.650] Xen stack trace from rsp=ffff83054ef7fcc8:
(XEN) [2014-06-05 14:10:54.650]    ffff83009faf7000 0000000000000000 ffff830546cb6ee0 ffff83054eff8d00
(XEN) [2014-06-05 14:10:54.650]    ffff83054ef7fd68 ffff82d080126e2f ffff83054ef7fd48 ffff830546df8ef0
(XEN) [2014-06-05 14:10:54.650]    00000000416eb1c0 ffff830546333870 ffff8305416eb000 ffff82d080320d60
(XEN) [2014-06-05 14:10:54.650]    ffff82d080277d20 ffff83054eff1068 0000000000000000 ffff8305416eb000
(XEN) [2014-06-05 14:10:54.650]    ffff8305416eb000 0000000000000000 0000000000000000 0000000000000011
(XEN) [2014-06-05 14:10:54.650]    ffff83054ef7fd98 ffff82d080105dcc ffff82d080129dcf ffff8305416eb000
(XEN) [2014-06-05 14:10:54.650]    ffffffffffffffff 00007f9b40a0b004 ffff83054ef7fef8 ffff82d080103926
(XEN) [2014-06-05 14:10:54.650]    ffff83054ef913a0 0000000000000282 ffff8305480e1010 ffff83009fd27000
(XEN) [2014-06-05 14:10:54.650]    0000000000000000 ffff83009fd2718c 0000000000000246 0000000000000011
(XEN) [2014-06-05 14:10:54.650]    ffff83054ef7fdf8 0000000000000206 ffff83054ef7fe18 ffff82d08012c757
(XEN) [2014-06-05 14:10:54.650]    ffff83009fd27060 0000000000000005 ffff83054ef7fe68 0000000000000206
(XEN) [2014-06-05 14:10:54.650]    ffff83009fd27088 0000000000000286 0000000a00000002 0000000000000001
(XEN) [2014-06-05 14:10:54.650]    0000000001eb2168 0000000001eb16a0 00007f9b4037c000 00007f9b407fc9f2
(XEN) [2014-06-05 14:10:54.650]    35622d6200000005 0000000000000000 00007fff2b72c740 00007f9b40158620
(XEN) [2014-06-05 14:10:54.650]    0000000000000010 0000000001ea8330 00007fff2b72c7b0 0000000001eb1e40
(XEN) [2014-06-05 14:10:54.650]    0000000000000001 00007f9b40802a55 0000000000000000 00007f9b3fa753c7
(XEN) [2014-06-05 14:10:54.650]    ffff83054ef7fed8 ffff83009fd27000 0000000000000011 ffff88004d45ab98
(XEN) [2014-06-05 14:10:54.650]    00007fff2b72c650 0000000000000011 00007cfab10800c7 ffff82d08022ca8b
(XEN) [2014-06-05 14:10:54.651]    ffffffff8100148a 0000000000000024 0000000000000011 00007fff2b72c650
(XEN) [2014-06-05 14:10:54.651]    ffff88004d45ab98 0000000000000011 ffff88004a14be98 00007fff2b72c650
(XEN) [2014-06-05 14:10:54.651] Xen call trace:
(XEN) [2014-06-05 14:10:54.651]    [&lt;ffff82d0801099b1&gt;] evtchn_move_pirqs+0x90/0xbf
(XEN) [2014-06-05 14:10:54.651]    [&lt;ffff82d080126e2f&gt;] sched_move_domain+0x2c1/0x3ea
(XEN) [2014-06-05 14:10:54.651]    [&lt;ffff82d080105dcc&gt;] domain_kill+0xd0/0x159
(XEN) [2014-06-05 14:10:54.651]    [&lt;ffff82d080103926&gt;] do_domctl+0xab8/0x1542
(XEN) [2014-06-05 14:10:54.651]    [&lt;ffff82d08022ca8b&gt;] syscall_enter+0xeb/0x145
(XEN) [2014-06-05 14:10:54.651] 
(XEN) [2014-06-05 14:10:54.651] Pagetable walk from 0000000000000328:
(XEN) [2014-06-05 14:10:54.651]  L4[0x000] = 0000000544e38067 0000000000057fc5
(XEN) [2014-06-05 14:10:54.651]  L3[0x000] = 000000053cc28067 000000000004fdd5
(XEN) [2014-06-05 14:10:54.651]  L2[0x000] = 0000000000000000 ffffffffffffffff 
(XEN) [2014-06-05 14:10:55.709] 
(XEN) [2014-06-05 14:10:55.718] ****************************************
(XEN) [2014-06-05 14:10:55.737] Panic on CPU 5:
(XEN) [2014-06-05 14:10:55.750] FATAL PAGE FAULT
(XEN) [2014-06-05 14:10:55.763] [error_code=0000]
(XEN) [2014-06-05 14:10:55.776] Faulting linear address: 0000000000000328
(XEN) [2014-06-05 14:10:55.796] ****************************************
(XEN) [2014-06-05 14:10:55.815] 
(XEN) [2014-06-05 14:10:55.824] Reboot in five seconds...
(XEN) [2014-06-05 14:10:55.839] APIC error on CPU0: 00(08)
(XEN) [2014-06-05 14:10:55.855] APIC error on CPU0: 08(08)</pre>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
Xen-devel mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Xen-devel@lists.xen.org">Xen-devel@lists.xen.org</a>
<a class="moz-txt-link-freetext" href="http://lists.xen.org/xen-devel">http://lists.xen.org/xen-devel</a>
</pre>
    </blockquote>
    <br>
  </body>
</html>

--------------030700090605050001050800--


--===============8304666691890189464==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

--===============8304666691890189464==--