Re: [Xen-users] PCI passthrough problems after legacy update of xen 4.1

Re: [Xen-users] PCI passthrough problems after legacy update of xen 4.1

[Andreas Falck]

[-- Attachment #1.1: Type: text/plain, Size: 5442 bytes --]

I CC the xen-devel list, since that is where I understand that possible
bugs in the main xen tree should be reported. My initial description of the
problem is attached below.

I tried with and without global interrupt remapping
(iommu=amd-iommu-global-intremap in xen command line), the problem
persists. That was after reading this:
http://www.novell.com/support/kb/doc.php?id=7012337

I can provide more information from my system if needed.

Regards,
Andreas


2013/5/1 Gordan Bobic <gordan@bobich.net>

> This is probably worthy of a bug report escalation to xen-devel list.
>
> I have filed my logs via the EL6 Xen bug tracker here:
>
> http://xen.crc.id.au/bugs/**view.php?id=5<http://xen.crc.id.au/bugs/view.php?id=5>
>
> It is good to see that it is not specific to the package builds/distro,
> in the sense that it implies a real, reproducible bug that might
> actually get fixed. I narrowed the cause down to a particular patch.
> (see link above).
>
> Gordan
>
>
> On Wed, 1 May 2013 10:56:05 +0200, Andreas Falck <
> falck.andreas.lists@gmail.com**> wrote:
>
>> Hi,
>>
>> My ubuntu 12.10 vanilla install (amd64) recently got xen hypervisor
>> and utils upgraded to 4.1.3-3ubuntu1.5, via the legacy upgrade path.
>> After this I experience problems with passing through some PCI devices
>> to a windows 8 domU. I get the same problem as Gordan gets with 4.2
>> referred in this message:
>> http://lists.xen.org/archives/**html/xen-users/2013-04/**msg00341.html<http://lists.xen.org/archives/html/xen-users/2013-04/msg00341.html>[1]
>>
>> - it seems to be related to some update made to both trees.
>>
>> My symptom is that out of three devices/functions, a radeon 7790 with
>> its two functions (41:00.{01}) plus one TI usb controller, (04:00.0),
>> only the radeon gpu (41:00.0) gets passed through. The others fail
>> with the Error: (22, 'Invalid argument') message. Specifically:
>>
>> When passing the usb controller (04:00.0) only, I find the following
>> in xend.log:
>>
>> [2013-05-01 10:38:32 2568] DEBUG (XendDomainInfo:811)
>> XendDomainInfo.hvm_pci_device_**insert_dev:
>> 0000:04:00.0@100,msitranslate=**1,power_mgmt=1
>>  [2013-05-01 10:38:32 2568] DEBUG (XendDomainInfo:815) pci: assign
>> device 0000:04:00.0@100,msitranslate=**1,power_mgmt=1
>> [2013-05-01 10:38:32 2568] DEBUG (image:508) signalDeviceModel:
>> orig_state is None, retrying
>> [2013-05-01 10:38:32 2568] DEBUG (image:508) signalDeviceModel:
>> orig_state is None, retrying
>>  [2013-05-01 10:38:32 2568] DEBUG (image:508) signalDeviceModel:
>> orig_state is None, retrying
>> [2013-05-01 10:38:32 2568] DEBUG (image:508) signalDeviceModel:
>> orig_state is None, retrying
>> [2013-05-01 10:38:32 2568] INFO (image:538) signalDeviceModel:restore
>> dm state to running
>>  [2013-05-01 10:38:32 2568] INFO (pciquirk:92) NO quirks found for PCI
>> device [104c:8241:0000:0000]
>> [2013-05-01 10:38:32 2568] DEBUG (pciquirk:135) Permissive mode NOT
>> enabled for PCI device [104c:8241:0000:0000]
>> [2013-05-01 10:38:32 2568] DEBUG (pciif:334) pci: enabling iomem
>> 0xdfef0000/0x10000 pfn 0xdfef0/0x10
>>  [2013-05-01 10:38:32 2568] DEBUG (pciif:334) pci: enabling iomem
>> 0xdfeee000/0x2000 pfn 0xdfeee/0x2
>> [2013-05-01 10:38:32 2568] DEBUG (pciif:351) pci: enabling irq 19
>> [2013-05-01 10:38:32 2568] ERROR (XendDomainInfo:2927)
>> XendDomainInfo.initDomain: exception occurred
>>  Traceback (most recent call last):
>>   File
>> "/usr/lib/xen-4.1/bin/../lib/**python/xen/xend/**XendDomainInfo.py", line
>> 2914, in _initDomain
>>     self._createDevices()
>>   File
>> "/usr/lib/xen-4.1/bin/../lib/**python/xen/xend/**XendDomainInfo.py", line
>> 2395, in _createDevices
>>      self.pci_device_configure_**boot()
>>   File
>> "/usr/lib/xen-4.1/bin/../lib/**python/xen/xend/**XendDomainInfo.py", line
>> 627, in pci_device_configure_boot
>>     self.pci_device_configure(dev_**sxp, first_dev = first)
>>    File
>> "/usr/lib/xen-4.1/bin/../lib/**python/xen/xend/**XendDomainInfo.py", line
>> 970, in pci_device_configure
>>     devid = self._createDevice('pci', existing_pci_conf)
>>   File
>> "/usr/lib/xen-4.1/bin/../lib/**python/xen/xend/**XendDomainInfo.py", line
>> 2326, in _createDevice
>>      return
>> self.getDeviceController(**deviceClass).createDevice(**devConfig)
>>   File
>>
>> "/usr/lib/xen-4.1/bin/../lib/**python/xen/xend/server/**
>> DevController.py",
>> line 67, in createDevice
>>     self.setupDevice(config)
>>    File
>> "/usr/lib/xen-4.1/bin/../lib/**python/xen/xend/server/pciif.**py", line
>> 453, in setupDevice
>>     self.setupOneDevice(d)
>>   File "/usr/lib/xen-4.1/bin/../lib/**python/xen/xend/server/pciif.**py",
>> line 353, in setupOneDevice
>>      allow_access = True)
>> Error: (22, 'Invalid argument')
>>
>> Interestingly, if I try to pass through only the GPU only (41:00.0) it
>> does work, but with both functions of the radeon card passed it fails
>> again. As said, it fails also if I only pass the USB controller, so
>> it's not really VGA related. I can provide more log output if needed.
>>
>> According to various sources on the net, downgrading xen would solve
>> the problem. But I'd prefer to raise the issue and find out if it is a
>> xen bug or a hardware specification issue.
>>
>> Regards,
>>  Andreas
>>
>>
>> Links:
>> ------
>> [1] http://lists.xen.org/archives/**html/xen-users/2013-04/**
>> msg00341.html<http://lists.xen.org/archives/html/xen-users/2013-04/msg00341.html>
>>
>
>

[-- Attachment #1.2: Type: text/html, Size: 6751 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: [Xen-users] PCI passthrough problems after legacy update of xen 4.1

[Jan Beulich]

>>> On 01.05.13 at 16:22, Andreas Falck <falck.andreas.lists@gmail.com> wrote:
> I CC the xen-devel list, since that is where I understand that possible
> bugs in the main xen tree should be reported. My initial description of the
> problem is attached below.
> 
> I tried with and without global interrupt remapping
> (iommu=amd-iommu-global-intremap in xen command line), the problem
> persists. That was after reading this:
> http://www.novell.com/support/kb/doc.php?id=7012337 
> 
> I can provide more information from my system if needed.

If you could just try out the tentative solution described in
http://lists.xen.org/archives/html/xen-devel/2013-05/msg00145.html
that would already help.

Jan

Re: [Xen-users] PCI passthrough problems after legacy update of xen 4.1

[Andreas Falck]

[-- Attachment #1.1: Type: text/plain, Size: 522 bytes --]

2013/5/2 Jan Beulich <JBeulich@suse.com>

>
> If you could just try out the tentative solution described in
> http://lists.xen.org/archives/html/xen-devel/2013-05/msg00145.html
> that would already help.
>

I will have a look when I come home from work, it will be a few hours from
now. Just so that I understand it right, is this simply a matter of editing
pciif.py and commenting out the line

        if not self.vm.info.is_hvm() and dev.irq:

so that the conditioned code is executed for all guests?

Regards,
Andreas

[-- Attachment #1.2: Type: text/html, Size: 1029 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: [Xen-users] PCI passthrough problems after legacy update of xen 4.1

[Jan Beulich]

>>> On 02.05.13 at 14:42, Andreas Falck <falck.andreas.lists@gmail.com> wrote:
> 2013/5/2 Jan Beulich <JBeulich@suse.com>
> 
>>
>> If you could just try out the tentative solution described in
>> http://lists.xen.org/archives/html/xen-devel/2013-05/msg00145.html 
>> that would already help.
>>
> 
> I will have a look when I come home from work, it will be a few hours from
> now. Just so that I understand it right, is this simply a matter of editing
> pciif.py and commenting out the line
> 
>         if not self.vm.info.is_hvm() and dev.irq:
> 
> so that the conditioned code is executed for all guests?

No, not the entire line, just the is_hvm part needs to be dropped.

Jan

Re: [Xen-users] PCI passthrough problems after legacy update of xen 4.1

[Andreas Falck]

[-- Attachment #1.1: Type: text/plain, Size: 6925 bytes --]

Ok, I changed so that the corresponding first lines of code looks like this:

        if dev.irq:
            rc = xc.physdev_map_pirq(domid = fe_domid,
                                   index = dev.irq,
                                   pirq  = dev.irq)

(only the first line changed)
Then, after restarting xend, I get a different failure on line 346, which
is the last line of the above: "VmError: (17, 'File exists')". Full
xend.log attached below.

I can also do tests with the one device which I still manage to pass
through (a gpu), if I get specific suggestions on what to look for.

/Andreas

[2013-05-02 20:41:29 19545] DEBUG (XendDomainInfo:811)
XendDomainInfo.hvm_pci_device_insert_dev: 0000:04:00.0@100
,msitranslate=1,power_mgmt=1
[2013-05-02 20:41:29 19545] DEBUG (XendDomainInfo:815) pci: assign device
0000:04:00.0@100,msitranslate=1,power_mgmt=1
[2013-05-02 20:41:29 19545] DEBUG (image:508) signalDeviceModel: orig_state
is None, retrying
[2013-05-02 20:41:29 19545] INFO (image:538) signalDeviceModel:restore dm
state to running
[2013-05-02 20:41:30 19545] INFO (pciquirk:92) NO quirks found for PCI
device [104c:8241:0000:0000]
[2013-05-02 20:41:30 19545] DEBUG (pciquirk:135) Permissive mode NOT
enabled for PCI device [104c:8241:0000:0000]
[2013-05-02 20:41:30 19545] DEBUG (pciif:334) pci: enabling iomem
0xdfef0000/0x10000 pfn 0xdfef0/0x10
[2013-05-02 20:41:30 19545] DEBUG (pciif:334) pci: enabling iomem
0xdfeee000/0x2000 pfn 0xdfeee/0x2
[2013-05-02 20:41:30 19545] ERROR (XendDomainInfo:2927)
XendDomainInfo.initDomain: exception occurred
Traceback (most recent call last):
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 2914, in _initDomain
    self._createDevices()
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 2395, in _createDevices
    self.pci_device_configure_boot()
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 627, in pci_device_configure_boot
    self.pci_device_configure(dev_sxp, first_dev = first)
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 970, in pci_device_configure
    devid = self._createDevice('pci', existing_pci_conf)
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 2326, in _createDevice
    return self.getDeviceController(deviceClass).createDevice(devConfig)
  File
"/usr/lib/xen-4.1/bin/../lib/python/xen/xend/server/DevController.py", line
67, in createDevice
    self.setupDevice(config)
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/server/pciif.py", line
453, in setupDevice
    self.setupOneDevice(d)
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/server/pciif.py", line
346, in setupOneDevice
    pirq  = dev.irq)
Error: (17, 'File exists')
[2013-05-02 20:41:30 19545] ERROR (XendDomainInfo:488) VM start failed
Traceback (most recent call last):
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 474, in start
    XendTask.log_progress(31, 60, self._initDomain)
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendTask.py", line 209,
in log_progress
    retval = func(*args, **kwds)
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 2930, in _initDomain
    raise VmError(str(exn))
VmError: (17, 'File exists')
[2013-05-02 20:41:30 19545] DEBUG (XendDomainInfo:3071)
XendDomainInfo.destroy: domid=19
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2401) Destroying device
model
[2013-05-02 20:41:32 19545] INFO (image:615) w8 device model terminated
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2408) Releasing devices
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2414) Removing vif/0
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:1276)
XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2414) Removing vbd/768
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:1276)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2414) Removing vbd/832
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:1276)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/832
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2414) Removing vbd/5632
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:1276)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/5632
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2414) Removing vfb/0
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:1276)
XendDomainInfo.destroyDevice: deviceClass = vfb, device = vfb/0
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2406) No device model
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2408) Releasing devices
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2414) Removing vif/0
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:1276)
XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2414) Removing vbd/768
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:1276)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2414) Removing vbd/832
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:1276)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/832
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2414) Removing vbd/5632
[2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:1276)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/5632
[2013-05-02 20:41:32 19545] ERROR (XendDomainInfo:108) Domain construction
failed
Traceback (most recent call last):
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 106, in create
    vm.start()
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 474, in start
    XendTask.log_progress(31, 60, self._initDomain)
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendTask.py", line 209,
in log_progress
    retval = func(*args, **kwds)
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 2930, in _initDomain
    raise VmError(str(exn))
VmError: (17, 'File exists')



2013/5/2 Jan Beulich <JBeulich@suse.com>

> >>> On 02.05.13 at 14:42, Andreas Falck <falck.andreas.lists@gmail.com>
> wrote:
> > 2013/5/2 Jan Beulich <JBeulich@suse.com>
> >
> >>
> >> If you could just try out the tentative solution described in
> >> http://lists.xen.org/archives/html/xen-devel/2013-05/msg00145.html
> >> that would already help.
> >>
> >
> > I will have a look when I come home from work, it will be a few hours
> from
> > now. Just so that I understand it right, is this simply a matter of
> editing
> > pciif.py and commenting out the line
> >
> >         if not self.vm.info.is_hvm() and dev.irq:
> >
> > so that the conditioned code is executed for all guests?
>
> No, not the entire line, just the is_hvm part needs to be dropped.
>
> Jan
>
>

[-- Attachment #1.2: Type: text/html, Size: 8259 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: [Xen-users] PCI passthrough problems after legacy update of xen 4.1

[Andreas Falck]

[-- Attachment #1.1: Type: text/plain, Size: 19252 bytes --]

Ok, I have some progress. It tried also with the device I had always
managed to get through, the radeon 7790 gpu. This worked equally well with
both versions of pciif.py. However, it turned out that with the changed
version, if I pass the gpu first in the pci = [ ... ] list, the other
devices also gets through. This was not the case with the original version
of pciif.py.

If (and only if) i order the passthrough list in the config file so that it
says

pci = [ '41:00.0', '41:00.1', '04:00.0' ]

(This corresponds to GPU, HDMI audio, USB at irqs 16, 17, 19) - then
passthrough of all devices works with the new version of pciif.py ("if
dev.irq:"), but not with the old version ("if not self.vm.info.is_hvm() and
dev.irq:"). So the second failure seemingly has to do with some property
set or checked only for the first passed through device. Logs follow:

WORKING setup:
pci = [ '41:00.0', '41:00.1', '04:00.0' ]
NEW pciif.py (if dev.irq)

xend.log:
[2013-05-02 22:54:38 7863] DEBUG (pciif:169) Reconfiguring PCI device
0000:41:00.0.
[2013-05-02 22:54:38 7863] INFO (pciquirk:92) NO quirks found for PCI
device [1002:665c:1458:2269]
[2013-05-02 22:54:38 7863] DEBUG (pciquirk:135) Permissive mode NOT enabled
for PCI device [1002:665c:1458:2269]
[2013-05-02 22:54:38 7863] DEBUG (pciif:320) pci: enabling ioport
0xe000/0x100
[2013-05-02 22:54:38 7863] DEBUG (pciif:334) pci: enabling iomem
0xa0000000/0x10000000 pfn 0xa0000/0x10000
[2013-05-02 22:54:38 7863] DEBUG (pciif:334) pci: enabling iomem
0x9f800000/0x800000 pfn 0x9f800/0x800
[2013-05-02 22:54:38 7863] DEBUG (pciif:334) pci: enabling iomem
0xbffc0000/0x40000 pfn 0xbffc0/0x40
[2013-05-02 22:54:38 7863] DEBUG (pciif:334) pci: enabling iomem
0xbffa0000/0x20000 pfn 0xbffa0/0x20
[2013-05-02 22:54:38 7863] DEBUG (pciif:351) pci: enabling irq 16
[2013-05-02 22:54:38 7863] DEBUG (XendDomainInfo:893)
XendDomainInfo.pci_device_configure: ['pci', ['dev', ['slot', '0x00'],
['domain', '0x0000'], ['key', '41:00.1'], ['bus', '0x41'], ['vdevfn',
'0x100'], ['func', '0x1'], ['uuid',
'e94457db-ac50-04a3-216f-9fb6c8aab1f1']], ['state', 'Initialising'],
['sub_state', 'Booting']]
[2013-05-02 22:54:38 7863] DEBUG (XendDomainInfo:779)
XendDomainInfo.hvm_pci_device_insert: {'devs': [{'slot': '0x00', 'domain':
'0x0000', 'key': '41:00.1', 'bus': '0x41', 'vdevfn': '0x100', 'func':
'0x1', 'uuid': 'e94457db-ac50-04a3-216f-9fb6c8aab1f1'}], 'states':
['Initialising']}
[2013-05-02 22:54:38 7863] DEBUG (XendDomainInfo:790)
XendDomainInfo.hvm_pci_device_insert_dev: {'slot': '0x00', 'domain':
'0x0000', 'key': '41:00.1', 'bus': '0x41', 'vdevfn': '0x100', 'func':
'0x1', 'uuid': 'e94457db-ac50-04a3-216f-9fb6c8aab1f1'}
[2013-05-02 22:54:38 7863] DEBUG (XendDomainInfo:811)
XendDomainInfo.hvm_pci_device_insert_dev: 0000:41:00.1@100
,msitranslate=1,power_mgmt=1
[2013-05-02 22:54:38 7863] DEBUG (XendDomainInfo:815) pci: assign device
0000:41:00.1@100,msitranslate=1,power_mgmt=1
[2013-05-02 22:54:38 7863] INFO (image:538) signalDeviceModel:restore dm
state to running
[2013-05-02 22:54:38 7863] DEBUG (pciif:169) Reconfiguring PCI device
0000:41:00.1.
[2013-05-02 22:54:39 7863] INFO (pciquirk:92) NO quirks found for PCI
device [1002:0002:1458:0002]
[2013-05-02 22:54:39 7863] DEBUG (pciquirk:135) Permissive mode NOT enabled
for PCI device [1002:0002:1458:0002]
[2013-05-02 22:54:39 7863] DEBUG (pciif:334) pci: enabling iomem
0xbff9c000/0x4000 pfn 0xbff9c/0x4
[2013-05-02 22:54:39 7863] DEBUG (pciif:351) pci: enabling irq 17
[2013-05-02 22:54:39 7863] DEBUG (XendDomainInfo:893)
XendDomainInfo.pci_device_configure: ['pci', ['dev', ['slot', '0x00'],
['domain', '0x0000'], ['key', '04:00.0'], ['bus', '0x04'], ['vdevfn',
'0x100'], ['func', '0x0'], ['uuid',
'fe6ebcc1-2dcc-7337-c98e-88250cb78896']], ['state', 'Initialising'],
['sub_state', 'Booting']]
[2013-05-02 22:54:39 7863] DEBUG (XendDomainInfo:779)
XendDomainInfo.hvm_pci_device_insert: {'devs': [{'slot': '0x00', 'domain':
'0x0000', 'key': '04:00.0', 'bus': '0x04', 'vdevfn': '0x100', 'func':
'0x0', 'uuid': 'fe6ebcc1-2dcc-7337-c98e-88250cb78896'}], 'states':
['Initialising']}
[2013-05-02 22:54:39 7863] DEBUG (XendDomainInfo:790)
XendDomainInfo.hvm_pci_device_insert_dev: {'slot': '0x00', 'domain':
'0x0000', 'key': '04:00.0', 'bus': '0x04', 'vdevfn': '0x100', 'func':
'0x0', 'uuid': 'fe6ebcc1-2dcc-7337-c98e-88250cb78896'}
[2013-05-02 22:54:39 7863] DEBUG (XendDomainInfo:811)
XendDomainInfo.hvm_pci_device_insert_dev: 0000:04:00.0@100
,msitranslate=1,power_mgmt=1
[2013-05-02 22:54:39 7863] DEBUG (XendDomainInfo:815) pci: assign device
0000:04:00.0@100,msitranslate=1,power_mgmt=1
[2013-05-02 22:54:39 7863] INFO (image:538) signalDeviceModel:restore dm
state to running
[2013-05-02 22:54:39 7863] DEBUG (pciif:169) Reconfiguring PCI device
0000:04:00.0.
[2013-05-02 22:54:39 7863] INFO (pciquirk:92) NO quirks found for PCI
device [104c:8241:0000:0000]
[2013-05-02 22:54:39 7863] DEBUG (pciquirk:135) Permissive mode NOT enabled
for PCI device [104c:8241:0000:0000]
[2013-05-02 22:54:39 7863] DEBUG (pciif:334) pci: enabling iomem
0xdfef0000/0x10000 pfn 0xdfef0/0x10
[2013-05-02 22:54:39 7863] DEBUG (pciif:334) pci: enabling iomem
0xdfeee000/0x2000 pfn 0xdfeee/0x2
[2013-05-02 22:54:39 7863] DEBUG (pciif:351) pci: enabling irq 19

... all OK and running. The gpu does not initialize unless after reboot of
dom0, but that issue was since before.

FAILING setup:
pci = [ '41:00.0', '41:00.1', '04:00.0' ] (as before)
OLD pciif.py (if not ... and dev.irq)

xend.log:
[2013-05-02 22:59:13 9301] DEBUG (XendDomainInfo:811)
XendDomainInfo.hvm_pci_device_insert_dev: 0000:41:00.0@100
,msitranslate=1,power_mgmt=1
[2013-05-02 22:59:13 9301] DEBUG (XendDomainInfo:815) pci: assign device
0000:41:00.0@100,msitranslate=1,power_mgmt=1
[2013-05-02 22:59:13 9301] DEBUG (image:508) signalDeviceModel: orig_state
is None, retrying
[2013-05-02 22:59:13 9301] DEBUG (image:508) signalDeviceModel: orig_state
is None, retrying
[2013-05-02 22:59:14 9301] INFO (image:538) signalDeviceModel:restore dm
state to running
[2013-05-02 22:59:14 9301] INFO (pciquirk:92) NO quirks found for PCI
device [1002:665c:1458:2269]
[2013-05-02 22:59:14 9301] DEBUG (pciquirk:135) Permissive mode NOT enabled
for PCI device [1002:665c:1458:2269]
[2013-05-02 22:59:14 9301] DEBUG (pciif:320) pci: enabling ioport
0xe000/0x100
[2013-05-02 22:59:14 9301] DEBUG (pciif:334) pci: enabling iomem
0xa0000000/0x10000000 pfn 0xa0000/0x10000
[2013-05-02 22:59:14 9301] DEBUG (pciif:334) pci: enabling iomem
0x9f800000/0x800000 pfn 0x9f800/0x800
[2013-05-02 22:59:14 9301] DEBUG (pciif:334) pci: enabling iomem
0xbffc0000/0x40000 pfn 0xbffc0/0x40
[2013-05-02 22:59:14 9301] DEBUG (pciif:334) pci: enabling iomem
0xbffa0000/0x20000 pfn 0xbffa0/0x20
[2013-05-02 22:59:14 9301] DEBUG (pciif:351) pci: enabling irq 16
[2013-05-02 22:59:14 9301] INFO (pciquirk:92) NO quirks found for PCI
device [1002:0002:1458:0002]
[2013-05-02 22:59:14 9301] DEBUG (pciquirk:135) Permissive mode NOT enabled
for PCI device [1002:0002:1458:0002]
[2013-05-02 22:59:14 9301] DEBUG (pciif:334) pci: enabling iomem
0xbff9c000/0x4000 pfn 0xbff9c/0x4
[2013-05-02 22:59:14 9301] DEBUG (pciif:351) pci: enabling irq 17
[2013-05-02 22:59:14 9301] ERROR (XendDomainInfo:2927)
XendDomainInfo.initDomain: exception occurred
Traceback (most recent call last):
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 2914, in _initDomain
    self._createDevices()
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 2395, in _createDevices
    self.pci_device_configure_boot()
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 627, in pci_device_configure_boot
    self.pci_device_configure(dev_sxp, first_dev = first)
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 970, in pci_device_configure
    devid = self._createDevice('pci', existing_pci_conf)
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 2326, in _createDevice
    return self.getDeviceController(deviceClass).createDevice(devConfig)
  File
"/usr/lib/xen-4.1/bin/../lib/python/xen/xend/server/DevController.py", line
67, in createDevice
    self.setupDevice(config)
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/server/pciif.py", line
453, in setupDevice
    self.setupOneDevice(d)
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/server/pciif.py", line
353, in setupOneDevice
    allow_access = True)
Error: (22, 'Invalid argument')
[2013-05-02 22:59:14 9301] ERROR (XendDomainInfo:488) VM start failed
Traceback (most recent call last):
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 474, in start
    XendTask.log_progress(31, 60, self._initDomain)
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendTask.py", line 209,
in log_progress
    retval = func(*args, **kwds)
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 2930, in _initDomain
    raise VmError(str(exn))
VmError: (22, 'Invalid argument')
[2013-05-02 22:59:14 9301] DEBUG (XendDomainInfo:3071)
XendDomainInfo.destroy: domid=39
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:2401) Destroying device
model
[2013-05-02 22:59:17 9301] INFO (image:615) w8 device model terminated
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:2408) Releasing devices
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:2414) Removing vif/0
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:1276)
XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:2414) Removing vbd/768
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:1276)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:2414) Removing vbd/832
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:1276)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/832
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:2414) Removing vbd/5632
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:1276)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/5632
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:2414) Removing vfb/0
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:1276)
XendDomainInfo.destroyDevice: deviceClass = vfb, device = vfb/0
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:2406) No device model
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:2408) Releasing devices
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:2414) Removing vif/0
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:1276)
XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:2414) Removing vbd/768
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:1276)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:2414) Removing vbd/832
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:1276)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/832
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:2414) Removing vbd/5632
[2013-05-02 22:59:17 9301] DEBUG (XendDomainInfo:1276)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/5632
[2013-05-02 22:59:17 9301] ERROR (XendDomainInfo:108) Domain construction
failed
Traceback (most recent call last):
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 106, in create
    vm.start()
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 474, in start
    XendTask.log_progress(31, 60, self._initDomain)
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendTask.py", line 209,
in log_progress
    retval = func(*args, **kwds)
  File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
line 2930, in _initDomain
    raise VmError(str(exn))
VmError: (22, 'Invalid argument')

(end of file)

Any other ordering of the pci = [ ... ] list fails as before, but in
different ways as shown in my earlier test.

/Andreas


2013/5/2 Andreas Falck <falck.andreas.lists@gmail.com>

> Ok, I changed so that the corresponding first lines of code looks like
> this:
>
>         if dev.irq:
>             rc = xc.physdev_map_pirq(domid = fe_domid,
>                                    index = dev.irq,
>                                    pirq  = dev.irq)
>
> (only the first line changed)
> Then, after restarting xend, I get a different failure on line 346, which
> is the last line of the above: "VmError: (17, 'File exists')". Full
> xend.log attached below.
>
> I can also do tests with the one device which I still manage to pass
> through (a gpu), if I get specific suggestions on what to look for.
>
> /Andreas
>
> [2013-05-02 20:41:29 19545] DEBUG (XendDomainInfo:811)
> XendDomainInfo.hvm_pci_device_insert_dev: 0000:04:00.0@100
> ,msitranslate=1,power_mgmt=1
> [2013-05-02 20:41:29 19545] DEBUG (XendDomainInfo:815) pci: assign device
> 0000:04:00.0@100,msitranslate=1,power_mgmt=1
> [2013-05-02 20:41:29 19545] DEBUG (image:508) signalDeviceModel:
> orig_state is None, retrying
> [2013-05-02 20:41:29 19545] INFO (image:538) signalDeviceModel:restore dm
> state to running
> [2013-05-02 20:41:30 19545] INFO (pciquirk:92) NO quirks found for PCI
> device [104c:8241:0000:0000]
> [2013-05-02 20:41:30 19545] DEBUG (pciquirk:135) Permissive mode NOT
> enabled for PCI device [104c:8241:0000:0000]
> [2013-05-02 20:41:30 19545] DEBUG (pciif:334) pci: enabling iomem
> 0xdfef0000/0x10000 pfn 0xdfef0/0x10
> [2013-05-02 20:41:30 19545] DEBUG (pciif:334) pci: enabling iomem
> 0xdfeee000/0x2000 pfn 0xdfeee/0x2
> [2013-05-02 20:41:30 19545] ERROR (XendDomainInfo:2927)
> XendDomainInfo.initDomain: exception occurred
>
> Traceback (most recent call last):
>   File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
> line 2914, in _initDomain
>     self._createDevices()
>   File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
> line 2395, in _createDevices
>     self.pci_device_configure_boot()
>   File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
> line 627, in pci_device_configure_boot
>     self.pci_device_configure(dev_sxp, first_dev = first)
>   File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
> line 970, in pci_device_configure
>     devid = self._createDevice('pci', existing_pci_conf)
>   File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
> line 2326, in _createDevice
>     return self.getDeviceController(deviceClass).createDevice(devConfig)
>   File
> "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/server/DevController.py", line
> 67, in createDevice
>     self.setupDevice(config)
>   File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/server/pciif.py", line
> 453, in setupDevice
>     self.setupOneDevice(d)
>   File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/server/pciif.py", line
> 346, in setupOneDevice
>     pirq  = dev.irq)
> Error: (17, 'File exists')
> [2013-05-02 20:41:30 19545] ERROR (XendDomainInfo:488) VM start failed
>
> Traceback (most recent call last):
>   File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
> line 474, in start
>     XendTask.log_progress(31, 60, self._initDomain)
>   File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendTask.py", line
> 209, in log_progress
>     retval = func(*args, **kwds)
>   File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
> line 2930, in _initDomain
>     raise VmError(str(exn))
> VmError: (17, 'File exists')
> [2013-05-02 20:41:30 19545] DEBUG (XendDomainInfo:3071)
> XendDomainInfo.destroy: domid=19
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2401) Destroying device
> model
> [2013-05-02 20:41:32 19545] INFO (image:615) w8 device model terminated
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2408) Releasing devices
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2414) Removing vif/0
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:1276)
> XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2414) Removing vbd/768
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:1276)
> XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2414) Removing vbd/832
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:1276)
> XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/832
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2414) Removing vbd/5632
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:1276)
> XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/5632
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2414) Removing vfb/0
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:1276)
> XendDomainInfo.destroyDevice: deviceClass = vfb, device = vfb/0
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2406) No device model
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2408) Releasing devices
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2414) Removing vif/0
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:1276)
> XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2414) Removing vbd/768
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:1276)
> XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2414) Removing vbd/832
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:1276)
> XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/832
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:2414) Removing vbd/5632
> [2013-05-02 20:41:32 19545] DEBUG (XendDomainInfo:1276)
> XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/5632
> [2013-05-02 20:41:32 19545] ERROR (XendDomainInfo:108) Domain construction
> failed
>
> Traceback (most recent call last):
>   File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
> line 106, in create
>     vm.start()
>   File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
> line 474, in start
>     XendTask.log_progress(31, 60, self._initDomain)
>   File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendTask.py", line
> 209, in log_progress
>     retval = func(*args, **kwds)
>   File "/usr/lib/xen-4.1/bin/../lib/python/xen/xend/XendDomainInfo.py",
> line 2930, in _initDomain
>     raise VmError(str(exn))
> VmError: (17, 'File exists')
>
>
>
> 2013/5/2 Jan Beulich <JBeulich@suse.com>
>
>> >>> On 02.05.13 at 14:42, Andreas Falck <falck.andreas.lists@gmail.com>
>> wrote:
>> > 2013/5/2 Jan Beulich <JBeulich@suse.com>
>> >
>> >>
>> >> If you could just try out the tentative solution described in
>> >> http://lists.xen.org/archives/html/xen-devel/2013-05/msg00145.html
>> >> that would already help.
>> >>
>> >
>> > I will have a look when I come home from work, it will be a few hours
>> from
>> > now. Just so that I understand it right, is this simply a matter of
>> editing
>> > pciif.py and commenting out the line
>> >
>> >         if not self.vm.info.is_hvm() and dev.irq:
>> >
>> > so that the conditioned code is executed for all guests?
>>
>> No, not the entire line, just the is_hvm part needs to be dropped.
>>
>> Jan
>>
>>
>

[-- Attachment #1.2: Type: text/html, Size: 22511 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: PCI passthrough problems after legacy update of xen 4.1

[Jan Beulich]

>>> On 02.05.13 at 23:07, Andreas Falck <falck.andreas.lists@gmail.com> wrote:
> Ok, I have some progress. It tried also with the device I had always
> managed to get through, the radeon 7790 gpu. This worked equally well with
> both versions of pciif.py. However, it turned out that with the changed
> version, if I pass the gpu first in the pci = [ ... ] list, the other
> devices also gets through. This was not the case with the original version
> of pciif.py.
> 
> If (and only if) i order the passthrough list in the config file so that it
> says
> 
> pci = [ '41:00.0', '41:00.1', '04:00.0' ]
> 
> (This corresponds to GPU, HDMI audio, USB at irqs 16, 17, 19) - then
> passthrough of all devices works with the new version of pciif.py ("if
> dev.irq:"), but not with the old version ("if not self.vm.info.is_hvm() and
> dev.irq:"). So the second failure seemingly has to do with some property
> set or checked only for the first passed through device. Logs follow:

Sending xend logs here is only marginally useful, as the errors
quite certainly originate in the hypervisor. Especially considering
that the ordering of devices matters (which is quite irritating to
me), but also with the logs here now showing the -EEXIST error
that your earlier mail mentioned, we have to rely on you to help
with tracking down the root cause of this (by instrumenting the
affected hypervisor paths, i.e. extending on the debugging
patch that Andrew sent). And without you explicitly saying so
we can't even be sure there aren't (when run at maximum log
level) already messages in the hypervisor log that might provide
some further insight.

Also, please don't cross post - pick either of xen-devel or
xen-users, but not both.

Jan

Re: PCI passthrough problems after legacy update of xen 4.1

[Andreas Falck]

[-- Attachment #1.1: Type: text/plain, Size: 2839 bytes --]

Sorry, I'll stick to xen-devel then, even though I am not on the list (I
can change the latter of course).

Since I run xen 4.1 (specifically the precompiled 4.1.3-3ubuntu1.5) I guess
I cannot apply Andrew's patch directly (unless the file hasn't changed
between the versions)? But I could probably figure out where in the
4.1.3-3ubuntu1.5 sources to insert the code from the patch, if I compile it
from source.

I can do some more testing throughout the weekend. Could you give me some
directions on what I should test, which logs and info to provide, and how
to maximize debug output from tools and from the hypervisor. That would
maximize my chances to get the relevant information. I guess that at a
minimum we want a failing and a succeding case with and without the change
in pciif.py?

'xm dmesg' didn't show me anything unusual when testing, but that was
without any added debug-keys.

Should I pastebin log outputs or should I include them in emails to keep
them searchable?

/Andreas


2013/5/3 Jan Beulich <JBeulich@suse.com>

> >>> On 02.05.13 at 23:07, Andreas Falck <falck.andreas.lists@gmail.com>
> wrote:
> > Ok, I have some progress. It tried also with the device I had always
> > managed to get through, the radeon 7790 gpu. This worked equally well
> with
> > both versions of pciif.py. However, it turned out that with the changed
> > version, if I pass the gpu first in the pci = [ ... ] list, the other
> > devices also gets through. This was not the case with the original
> version
> > of pciif.py.
> >
> > If (and only if) i order the passthrough list in the config file so that
> it
> > says
> >
> > pci = [ '41:00.0', '41:00.1', '04:00.0' ]
> >
> > (This corresponds to GPU, HDMI audio, USB at irqs 16, 17, 19) - then
> > passthrough of all devices works with the new version of pciif.py ("if
> > dev.irq:"), but not with the old version ("if not self.vm.info.is_hvm()
> and
> > dev.irq:"). So the second failure seemingly has to do with some property
> > set or checked only for the first passed through device. Logs follow:
>
> Sending xend logs here is only marginally useful, as the errors
> quite certainly originate in the hypervisor. Especially considering
> that the ordering of devices matters (which is quite irritating to
> me), but also with the logs here now showing the -EEXIST error
> that your earlier mail mentioned, we have to rely on you to help
> with tracking down the root cause of this (by instrumenting the
> affected hypervisor paths, i.e. extending on the debugging
> patch that Andrew sent). And without you explicitly saying so
> we can't even be sure there aren't (when run at maximum log
> level) already messages in the hypervisor log that might provide
> some further insight.
>
> Also, please don't cross post - pick either of xen-devel or
> xen-users, but not both.
>
> Jan
>
>

[-- Attachment #1.2: Type: text/html, Size: 3607 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: PCI passthrough problems after legacy update of xen 4.1

[Jan Beulich]

>>> On 03.05.13 at 15:31, Andreas Falck <falck.andreas.lists@gmail.com> wrote:
> Sorry, I'll stick to xen-devel then, even though I am not on the list (I
> can change the latter of course).
> 
> Since I run xen 4.1 (specifically the precompiled 4.1.3-3ubuntu1.5) I guess
> I cannot apply Andrew's patch directly (unless the file hasn't changed
> between the versions)? But I could probably figure out where in the
> 4.1.3-3ubuntu1.5 sources to insert the code from the patch, if I compile it
> from source.

Andrew's patch alone won't tell us anything new. We need
instrumentation in the physdev_map_pirq() path for the problem
you're seeing now.

> I can do some more testing throughout the weekend. Could you give me some
> directions on what I should test, which logs and info to provide, and how
> to maximize debug output from tools and from the hypervisor. That would
> maximize my chances to get the relevant information. I guess that at a
> minimum we want a failing and a succeding case with and without the change
> in pciif.py?
> 
> 'xm dmesg' didn't show me anything unusual when testing, but that was
> without any added debug-keys.

That's odd - at least when you saw the -EEXIST I would have expect
some extra message to be there (because the only place where this
error gets returned in physdev.c has an accompanying message).
Please check again after adding "loglvl=all guest_loglvl=all".

Jan

Re: PCI passthrough problems after legacy update of xen 4.1

[Andrew Cooper]

[-- Attachment #1.1: Type: text/plain, Size: 3411 bytes --]

On 03/05/2013 14:31, Andreas Falck wrote:
> Sorry, I'll stick to xen-devel then, even though I am not on the list
> (I can change the latter of course).
>
> Since I run xen 4.1 (specifically the precompiled 4.1.3-3ubuntu1.5) I
> guess I cannot apply Andrew's patch directly (unless the file hasn't
> changed between the versions)? But I could probably figure out where
> in the 4.1.3-3ubuntu1.5 sources to insert the code from the patch, if
> I compile it from source.

Attached is the same debugging patch against 4.1.  If you grab the src
rpm, you should be able to add it as another patch to the specfile and
use rpmbuild.  Or you can just build straight from source, whichever is
easier.

~Andrew

>
> I can do some more testing throughout the weekend. Could you give me
> some directions on what I should test, which logs and info to provide,
> and how to maximize debug output from tools and from the hypervisor.
> That would maximize my chances to get the relevant information. I
> guess that at a minimum we want a failing and a succeding case with
> and without the change in pciif.py?
>
> 'xm dmesg' didn't show me anything unusual when testing, but that was
> without any added debug-keys.
>
> Should I pastebin log outputs or should I include them in emails to
> keep them searchable?
>
> /Andreas
>
>
> 2013/5/3 Jan Beulich <JBeulich@suse.com <mailto:JBeulich@suse.com>>
>
>     >>> On 02.05.13 at 23:07, Andreas Falck
>     <falck.andreas.lists@gmail.com
>     <mailto:falck.andreas.lists@gmail.com>> wrote:
>     > Ok, I have some progress. It tried also with the device I had always
>     > managed to get through, the radeon 7790 gpu. This worked equally
>     well with
>     > both versions of pciif.py. However, it turned out that with the
>     changed
>     > version, if I pass the gpu first in the pci = [ ... ] list, the
>     other
>     > devices also gets through. This was not the case with the
>     original version
>     > of pciif.py.
>     >
>     > If (and only if) i order the passthrough list in the config file
>     so that it
>     > says
>     >
>     > pci = [ '41:00.0', '41:00.1', '04:00.0' ]
>     >
>     > (This corresponds to GPU, HDMI audio, USB at irqs 16, 17, 19) - then
>     > passthrough of all devices works with the new version of
>     pciif.py ("if
>     > dev.irq:"), but not with the old version ("if not
>     self.vm.info.is_hvm() and
>     > dev.irq:"). So the second failure seemingly has to do with some
>     property
>     > set or checked only for the first passed through device. Logs
>     follow:
>
>     Sending xend logs here is only marginally useful, as the errors
>     quite certainly originate in the hypervisor. Especially considering
>     that the ordering of devices matters (which is quite irritating to
>     me), but also with the logs here now showing the -EEXIST error
>     that your earlier mail mentioned, we have to rely on you to help
>     with tracking down the root cause of this (by instrumenting the
>     affected hypervisor paths, i.e. extending on the debugging
>     patch that Andrew sent). And without you explicitly saying so
>     we can't even be sure there aren't (when run at maximum log
>     level) already messages in the hypervisor log that might provide
>     some further insight.
>
>     Also, please don't cross post - pick either of xen-devel or
>     xen-users, but not both.
>
>     Jan
>
>


[-- Attachment #1.2: Type: text/html, Size: 5938 bytes --]

[-- Attachment #2: XSA-46-xen-4.1-debug.patch --]
[-- Type: text/plain, Size: 691 bytes --]

diff --git a/xen/common/domctl.c b/xen/common/domctl.c
index c3240db..c7c1058 100644
--- a/xen/common/domctl.c
+++ b/xen/common/domctl.c
@@ -851,6 +851,7 @@ long do_domctl(XEN_GUEST_HANDLE(xen_domctl_t) u_domctl)
     {
         struct domain *d;
         unsigned int pirq = op->u.irq_permission.pirq;
+        int allow = op->u.irq_permission.allow_access;
 
         ret = -ESRCH;
         d = rcu_lock_domain_by_id(op->domain);
@@ -864,6 +865,8 @@ long do_domctl(XEN_GUEST_HANDLE(xen_domctl_t) u_domctl)
         else
             ret = pirq_deny_access(d, pirq);
 
+        printk("**DBG perms { %u, %d } = %ld\n", pirq, allow, ret);
+
         rcu_unlock_domain(d);
     }
     break;

[-- Attachment #3: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: PCI passthrough problems after legacy update of xen 4.1

[Jan Beulich]

>>> On 03.05.13 at 15:57, Andrew Cooper <andrew.cooper3@citrix.com> wrote:
> On 03/05/2013 14:31, Andreas Falck wrote:
>> Sorry, I'll stick to xen-devel then, even though I am not on the list
>> (I can change the latter of course).
>>
>> Since I run xen 4.1 (specifically the precompiled 4.1.3-3ubuntu1.5) I
>> guess I cannot apply Andrew's patch directly (unless the file hasn't
>> changed between the versions)? But I could probably figure out where
>> in the 4.1.3-3ubuntu1.5 sources to insert the code from the patch, if
>> I compile it from source.
> 
> Attached is the same debugging patch against 4.1.  If you grab the src
> rpm, you should be able to add it as another patch to the specfile and
> use rpmbuild.  Or you can just build straight from source, whichever is
> easier.

But from what Andreas told us he's not even getting here
anymore after the small xend adjustment. As written earlier,
he'll need to add some extra printing to the physdev_map_pirq()
path.

Jan

Re: PCI passthrough problems after legacy update of xen 4.1

[Andreas Falck]

[-- Attachment #1.1: Type: text/plain, Size: 449 bytes --]

>
> But from what Andreas told us he's not even getting here
> anymore after the small xend adjustment. As written earlier,
> he'll need to add some extra printing to the physdev_map_pirq()
> path.


Just tell me what I should add and I'll try to add it. If we have concluded
that the change in pciif.py is valid, I can skip that part of the debugging
search space. Unless you want more information from the error as of before
the change.

/Andreas

[-- Attachment #1.2: Type: text/html, Size: 713 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: PCI passthrough problems after legacy update of xen 4.1

[Jan Beulich]

>>> On 03.05.13 at 16:56, Andreas Falck <falck.andreas.lists@gmail.com> wrote:
>> 
>> But from what Andreas told us he's not even getting here
>> anymore after the small xend adjustment. As written earlier,
>> he'll need to add some extra printing to the physdev_map_pirq()
>> path.
> 
> 
> Just tell me what I should add and I'll try to add it. If we have concluded
> that the change in pciif.py is valid, I can skip that part of the debugging
> search space. Unless you want more information from the error as of before
> the change.

The reason for the error before that change is understood (hence
the adjustment to the xend code).

I can of course work on handing you a debugging patch, but you
doing so yourself would improve the turnaround quite significantly.

And yes, even without any debugging patch, seeing a full hypervisor
log especially for the case where you got the EEXIST error in xend
might already help.

Jan

Re: PCI passthrough problems after legacy update of xen 4.1

[Andreas Falck]

[-- Attachment #1.1: Type: text/plain, Size: 2194 bytes --]

Hi,

I started by looking at xm dmesg with max log level, before adding debug
code anywhere. It turns out that when starting the failing config, I get
(only) this message:

(XEN) physdev.c:209: dom4: pirq 19 conflicts with irq 19

 That is when I pass the USB controller first, "pci = [04:00.0, 41:00.0,
41:00.1]" If I try to pass only the HDMI audio (pci = 41:00.1), I get:

(XEN) physdev.c:209: dom5: pirq 17 conflicts with irq 17

It may be also in the standard log level, I might have missed it before.

Output from 'xm dmesg' from running the working config "pci = [ 41:00.0,
41:00.1, 04:00.0 ]", with which the devices gets irq:s 16, 17 and 19 (in
that order):

http://pastebin.com/NNWTrk8H

Output from 'xm dmesg' before starting any VM:

http://pastebin.com/QmZJpvP9

The last line

(XEN) physdev.c:171: dom0: wrong map_pirq type 3

has always been around on my system, as long as I can remember. I realize
now that it may be related.

>From your answers so far I assume that debugging further is simply a matter
of putting printfs at sensible points in physdev_map_pirq() and/or dumping
values. I'll give compiling a try during the weekend.

Regards,
Andreas


2013/5/3 Jan Beulich <JBeulich@suse.com>

> >>> On 03.05.13 at 16:56, Andreas Falck <falck.andreas.lists@gmail.com>
> wrote:
> >>
> >> But from what Andreas told us he's not even getting here
> >> anymore after the small xend adjustment. As written earlier,
> >> he'll need to add some extra printing to the physdev_map_pirq()
> >> path.
> >
> >
> > Just tell me what I should add and I'll try to add it. If we have
> concluded
> > that the change in pciif.py is valid, I can skip that part of the
> debugging
> > search space. Unless you want more information from the error as of
> before
> > the change.
>
> The reason for the error before that change is understood (hence
> the adjustment to the xend code).
>
> I can of course work on handing you a debugging patch, but you
> doing so yourself would improve the turnaround quite significantly.
>
> And yes, even without any debugging patch, seeing a full hypervisor
> log especially for the case where you got the EEXIST error in xend
> might already help.
>
> Jan
>
>

[-- Attachment #1.2: Type: text/html, Size: 3019 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: PCI passthrough problems after legacy update of xen 4.1

[Andreas Falck]

[-- Attachment #1.1: Type: text/plain, Size: 8063 bytes --]

Hi again,

I tried adding some debugging statements in physdev_map_pirq. I have
attached the physdev.c with my debug statements, a hypervisor log from
testing, and the output of lspci -vv for my three devices.

First briefly my understanding of the function, including where I put the
log messages:

// - comments denote what I've added
/**/ - comments denote my assumption on what the code does

int physdev_map_pirq(physdev_map_pirq *map) {
 // added log AF1, dumping most of *map

 switch(map->type) /* MSI | GSI */
 // added log AF2 for clarifying MSI/GSI case for myself
 case GSI:
     /* fetching real irq */
     // add log AF2.5: real irq
 case MSI:
     /* invent irq */
 /* end switch*/

 /* some mutex locking here */

     pirq = domain_irq_to_pirq(d, irq); /* lookup in host-specific table */
    // added log AF3, map->pirq= ..., pirq = ...

    if ( map->pirq < 0 )
    {
        if (pirq)
            /* "already mapped" error */
        else
            // added log AF4
    }
    else
    {
        if ( pirq && pirq != map->pirq )
        {
             /* failing case follows */
             // added log AF4.5: pirq = ...
            dprintk(XENLOG_G_ERR, "dom%d: pirq %d conflicts with irq %d\n",
                    d->domain_id, map->index, map->pirq);
            ret = -EEXIST;
            goto done;
        }
        else
        {
            // added log AF5 "else case instead of EEXIST"
            pirq = map->pirq;
        }
    }

    map->pirq = pirq;     /* when everything is ok */
     // added log AF6: map->pirq=...

 /* mutex unlocking */
 /* cleaning up */
 }

Output from xm dmesg with vm creation details is attached. Whereas I'm
unsure about the meaning of map->index, I note that in the failing case
with only device 04:00.0 passed we see (the GSI cases seem the relevant
ones, so I omit the MSI cases here. Full log is attached.):

[FAILING]
(XEN) physdev.c:98: AF1: map->domid1, map->type1, map->index19,
map->pirq-1, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=19 (if <= 0, irq will be set to
map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=16
(XEN) physdev.c:236: AF6: final map->pirq: 16
...
(XEN) physdev.c:98: AF1: map->domid1, map->type1, map->index19,
map->pirq19, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=19 (if <= 0, irq will be set to
map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq19, pirq16
(XEN) physdev.c:219: AF4.5: pirq right before EEXIST error: 16
(XEN) physdev.c:221: dom1: pirq 19 conflicts with irq 19

I find it confusing that the error statement on the last line reports "pirq
19", while the value being reported is really from "map->index", according
to the code above. My AF4.5 is executed right before, so the value of the
local variable pirq is then 16 (while map->pirq == map->index == 19). Can
it be that the code assumes that local "pirq" and "map->index" at this
point of the code should have the same value, and some other new code has
invalidated the assumption? Relying on the same assumption somewhere else
may then have caused the error.

In the working case, when all three devices are passed, [41:00.0, 41:00.1,
04:00.0], I see what seems like multiple instances of setting up each
device. The first seems to correspond to 41:00.0:

[WORKING]
(XEN) physdev.c:98: AF1: map->domid2, map->type1, map->index16,
map->pirq-1, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=16 (if <= 0, irq will be set to
map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=16
(XEN) physdev.c:236: AF6: final map->pirq: 16
...
(XEN) physdev.c:98: AF1: map->domid2, map->type1, map->index16,
map->pirq16, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=16 (if <= 0, irq will be set to
map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq16, pirq16
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 16

(p)IRQs match all the way. Then:

(XEN) physdev.c:98: AF1: map->domid2, map->type1, map->index17,
map->pirq17, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=17 (if <= 0, irq will be set to
map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq17, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 17
(XEN) physdev.c:98: AF1: map->domid2, map->type1, map->index19,
map->pirq19, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=19 (if <= 0, irq will be set to
map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq19, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 19

41:00.1 and 04:00.0 seem to be correctly set up on "first try", finding the
"right" irq. Then follows some repetitions of the function, sometimes with
errors/warnings, sometimes without. See the attached log, I can't really
decide if they are needed or if they are redundant. From the above it seems
that the get_free_pirq function plays a role. I haven't looked further into
it.

Regards,
Andreas



2013/5/3 Andreas Falck <falck.andreas.lists@gmail.com>

> Hi,
>
> I started by looking at xm dmesg with max log level, before adding debug
> code anywhere. It turns out that when starting the failing config, I get
> (only) this message:
>
> (XEN) physdev.c:209: dom4: pirq 19 conflicts with irq 19
>
>  That is when I pass the USB controller first, "pci = [04:00.0, 41:00.0,
> 41:00.1]" If I try to pass only the HDMI audio (pci = 41:00.1), I get:
>
> (XEN) physdev.c:209: dom5: pirq 17 conflicts with irq 17
>
> It may be also in the standard log level, I might have missed it before.
>
> Output from 'xm dmesg' from running the working config "pci = [ 41:00.0,
> 41:00.1, 04:00.0 ]", with which the devices gets irq:s 16, 17 and 19 (in
> that order):
>
> http://pastebin.com/NNWTrk8H
>
> Output from 'xm dmesg' before starting any VM:
>
> http://pastebin.com/QmZJpvP9
>
> The last line
>
> (XEN) physdev.c:171: dom0: wrong map_pirq type 3
>
> has always been around on my system, as long as I can remember. I realize
> now that it may be related.
>
> From your answers so far I assume that debugging further is simply a
> matter of putting printfs at sensible points in physdev_map_pirq() and/or
> dumping values. I'll give compiling a try during the weekend.
>
> Regards,
> Andreas
>
>
> 2013/5/3 Jan Beulich <JBeulich@suse.com>
>
>> >>> On 03.05.13 at 16:56, Andreas Falck <falck.andreas.lists@gmail.com>
>> wrote:
>> >>
>> >> But from what Andreas told us he's not even getting here
>> >> anymore after the small xend adjustment. As written earlier,
>> >> he'll need to add some extra printing to the physdev_map_pirq()
>> >> path.
>> >
>> >
>> > Just tell me what I should add and I'll try to add it. If we have
>> concluded
>> > that the change in pciif.py is valid, I can skip that part of the
>> debugging
>> > search space. Unless you want more information from the error as of
>> before
>> > the change.
>>
>> The reason for the error before that change is understood (hence
>> the adjustment to the xend code).
>>
>> I can of course work on handing you a debugging patch, but you
>> doing so yourself would improve the turnaround quite significantly.
>>
>> And yes, even without any debugging patch, seeing a full hypervisor
>> log especially for the case where you got the EEXIST error in xend
>> might already help.
>>
>> Jan
>>
>>
>

[-- Attachment #1.2: Type: text/html, Size: 9966 bytes --]

[-- Attachment #2: physdev.c --]
[-- Type: text/x-csrc, Size: 18758 bytes --]


#include <xen/config.h>
#include <xen/init.h>
#include <xen/lib.h>
#include <xen/types.h>
#include <xen/sched.h>
#include <xen/irq.h>
#include <xen/event.h>
#include <xen/guest_access.h>
#include <xen/iocap.h>
#include <asm/current.h>
#include <asm/msi.h>
#include <asm/hypercall.h>
#include <public/xen.h>
#include <public/physdev.h>
#include <xsm/xsm.h>
#include <asm/p2m.h>

#ifndef COMPAT
typedef long ret_t;
#endif

int
ioapic_guest_read(
    unsigned long physbase, unsigned int reg, u32 *pval);
int
ioapic_guest_write(
    unsigned long physbase, unsigned int reg, u32 pval);

static int physdev_hvm_map_pirq(
    struct domain *d, struct physdev_map_pirq *map)
{
    int pirq, ret = 0;

    spin_lock(&d->event_lock);
    switch ( map->type )
    {
    case MAP_PIRQ_TYPE_GSI: {
        struct hvm_irq_dpci *hvm_irq_dpci;
        struct hvm_girq_dpci_mapping *girq;
        uint32_t machine_gsi = 0;

        if ( map->index < 0 || map->index >= NR_HVM_IRQS )
        {
            ret = -EINVAL;
            break;
        }

        /* find the machine gsi corresponding to the
         * emulated gsi */
        hvm_irq_dpci = domain_get_irq_dpci(d);
        if ( hvm_irq_dpci )
        {
            BUILD_BUG_ON(ARRAY_SIZE(hvm_irq_dpci->girq) < NR_HVM_IRQS);
            list_for_each_entry ( girq,
                                  &hvm_irq_dpci->girq[map->index],
                                  list )
                machine_gsi = girq->machine_gsi;
        }
        /* found one, this mean we are dealing with a pt device */
        if ( machine_gsi )
        {
            map->index = domain_pirq_to_irq(d, machine_gsi);
            pirq = machine_gsi;
            ret = (pirq > 0) ? 0 : pirq;
        }
        /* we didn't find any, this means we are dealing
         * with an emulated device */
        else
        {
            pirq = map->pirq;
            if ( pirq < 0 )
                pirq = get_free_pirq(d, map->type, map->index);
            ret = map_domain_emuirq_pirq(d, pirq, map->index);
        }
        map->pirq = pirq;
        break;
    }

    default:
        ret = -EINVAL;
        dprintk(XENLOG_G_WARNING, "map type %d not supported yet\n", map->type);
        break;
    }

    spin_unlock(&d->event_lock);
    return ret;
}

static int physdev_map_pirq(struct physdev_map_pirq *map)
{
    struct domain *d;
    int pirq, irq, ret = 0;
    struct msi_info _msi;
    void *map_data = NULL;
	
    dprintk (XENLOG_G_DEBUG, "AF1: map->domid%d, map->type%d, map->index%d, map->pirq%d, map->bus%d, map->devfn%d, map->entry_nr%d\n", 
             map->domid, map->type, map->index, map->pirq, map->bus, map->devfn, map->entry_nr); /* add AF */ 
    ret = rcu_lock_target_domain_by_id(map->domid, &d);
    if ( ret )
        return ret; /* seems this seldom happens /af */

    if ( map->domid == DOMID_SELF && is_hvm_domain(d) )
    {
        /*I don't understand the above logic, is domid = DOMID_SELF only for dom0? Then, can dom0 be or not be HVM? */
        dprintk(XENLOG_G_DEBUG, "after if#2 (map->domid == DOMID_SELF && ...)\n"); /* add AF */
        /*
         * Only makes sense for vector-based callback, else HVM-IRQ logic
         * calls back into itself and deadlocks on hvm_domain.irq_lock.
         */
        if ( !is_hvm_pv_evtchn_domain(d) )
        {
            ret = -EINVAL;
            goto free_domain;
        }
        ret = physdev_hvm_map_pirq(d, map);
        dprintk (XENLOG_G_DEBUG, "End of if#2, ret =%d\n", ret); /* add AF */
       goto free_domain;
    }

    if ( !IS_PRIV_FOR(current->domain, d) )
    {
        ret = -EPERM;
        goto free_domain;
    }

    /* Verify or get irq. */
    switch ( map->type )
    {
    case MAP_PIRQ_TYPE_GSI:
    	dprintk(XENLOG_G_DEBUG, "AF2: map->type=GSI\n"); /* add AF */
        if ( map->index < 0 || map->index >= nr_irqs_gsi )
        {
            dprintk(XENLOG_G_ERR, "dom%d: map invalid irq %d\n",
                    d->domain_id, map->index);
            ret = -EINVAL;
            goto free_domain;
        }

        irq = domain_pirq_to_irq(current->domain, map->index);
        dprintk(XENLOG_G_DEBUG, "AF2.5: found irq=%d (if <= 0, irq will be set to map->index instead or fail with error)\n", irq); /* add AF */
        if ( irq <= 0 )
        {
            if ( IS_PRIV(current->domain) )
                irq = map->index;
            else {
                dprintk(XENLOG_G_ERR, "dom%d: map pirq with incorrect irq!\n",
                        d->domain_id);
                ret = -EINVAL;
                goto free_domain;
            }
        }
        break;

    case MAP_PIRQ_TYPE_MSI:
    	dprintk(XENLOG_G_DEBUG, "AF2: map->type=MSI\n"); /* add AF */
        irq = map->index;
        if ( irq == -1 )
            irq = create_irq();

        if ( irq < nr_irqs_gsi || irq >= nr_irqs )
        {
            dprintk(XENLOG_G_ERR, "dom%d: can't create irq for msi!\n",
                    d->domain_id);
            ret = -EINVAL;
            goto free_domain;
        }

        _msi.bus = map->bus;
        _msi.devfn = map->devfn;
        _msi.entry_nr = map->entry_nr;
        _msi.table_base = map->table_base;
        _msi.irq = irq;
        map_data = &_msi;
        break;

    default:
        dprintk(XENLOG_G_ERR, "dom%d: wrong map_pirq type %x\n",
                d->domain_id, map->type);
        ret = -EINVAL;
        goto free_domain;
    }

    spin_lock(&pcidevs_lock);
    /* Verify or get pirq. */
    spin_lock(&d->event_lock);
    pirq = domain_irq_to_pirq(d, irq); /* seems to be looking up in arch-specific table /AF */
    dprintk(XENLOG_G_DEBUG, "AF3: after getting pirq: map->pirq%d, pirq%d\n", map->pirq, pirq); /* add AF */
    if ( map->pirq < 0 ) /* map->pirq = -1 /AF */
    {
        if ( pirq )
        {
            dprintk(XENLOG_G_ERR, "dom%d: %d:%d already mapped to %d\n",
                    d->domain_id, map->index, map->pirq,
                    pirq);
            if ( pirq < 0 )
            {
                ret = -EBUSY;
                goto done;
            }
        }
        else
        {
            pirq = get_free_pirq(d, map->type, map->index);
            dprintk(XENLOG_G_DEBUG, "AF4: got previously free pirq=%d\n", pirq); /* add AF */
            if ( pirq < 0 )
            {
                dprintk(XENLOG_G_ERR, "dom%d: no free pirq\n", d->domain_id);
                ret = pirq;
                goto done;
            }
        }
    }
    else
    {
        if ( pirq && pirq != map->pirq )
        {
        	/* failing case here */
            dprintk(XENLOG_G_DEBUG, "AF4.5: pirq right before EEXIST error: %d\n", pirq); /* add AF */
            dprintk(XENLOG_G_ERR, "dom%d: pirq %d conflicts with irq %d\n",
                    d->domain_id, map->index, map->pirq);
            ret = -EEXIST;
            goto done;
        }
        else
        {
            dprintk(XENLOG_G_DEBUG, "AF5: else case instead of EEXIST error\n"); /* add AF */
            pirq = map->pirq;
        }
    }

    ret = map_domain_pirq(d, pirq, irq, map->type, map_data);
    if ( ret == 0 )
    {
        map->pirq = pirq;
        dprintk(XENLOG_G_DEBUG, "AF6: final map->pirq: %d\n", map->pirq); /* add AF */
    }

 done:
    spin_unlock(&d->event_lock);
    spin_unlock(&pcidevs_lock);
    if ( (ret != 0) && (map->type == MAP_PIRQ_TYPE_MSI) && (map->index == -1) )
        destroy_irq(irq);
 free_domain:
    rcu_unlock_domain(d);
    return ret;
}

static int physdev_unmap_pirq(struct physdev_unmap_pirq *unmap)
{
    struct domain *d;
    int ret;

    ret = rcu_lock_target_domain_by_id(unmap->domid, &d);
    if ( ret )
        return ret;

    ret = -EINVAL;
    if ( unmap->pirq < 0 || unmap->pirq >= d->nr_pirqs )
        goto free_domain;

    if ( is_hvm_domain(d) )
    {
        spin_lock(&d->event_lock);
        if ( domain_pirq_to_emuirq(d, unmap->pirq) != IRQ_UNBOUND )
            ret = unmap_domain_pirq_emuirq(d, unmap->pirq);
        spin_unlock(&d->event_lock);
        if ( unmap->domid == DOMID_SELF || ret )
            goto free_domain;
    }

    ret = -EPERM;
    if ( !IS_PRIV_FOR(current->domain, d) )
        goto free_domain;

    spin_lock(&pcidevs_lock);
    spin_lock(&d->event_lock);
    ret = unmap_domain_pirq(d, unmap->pirq);
    spin_unlock(&d->event_lock);
    spin_unlock(&pcidevs_lock);

 free_domain:
    rcu_unlock_domain(d);
    return ret;
}

ret_t do_physdev_op(int cmd, XEN_GUEST_HANDLE(void) arg)
{
    int irq;
    ret_t ret;
    struct vcpu *v = current;

    switch ( cmd )
    {
    case PHYSDEVOP_eoi: {
        struct physdev_eoi eoi;
        ret = -EFAULT;
        if ( copy_from_guest(&eoi, arg, 1) != 0 )
            break;
        ret = -EINVAL;
        if ( eoi.irq >= v->domain->nr_pirqs )
            break;
        if ( v->domain->arch.auto_unmask )
            evtchn_unmask(v->domain->pirq_to_evtchn[eoi.irq]);
        if ( !is_hvm_domain(v->domain) ||
             domain_pirq_to_irq(v->domain, eoi.irq) > 0 )
            ret = pirq_guest_eoi(v->domain, eoi.irq);
        else
            ret = 0;
        spin_lock(&v->domain->event_lock);
        if ( is_hvm_domain(v->domain) &&
                domain_pirq_to_emuirq(v->domain, eoi.irq) > 0 )
        {
            struct hvm_irq *hvm_irq = &v->domain->arch.hvm_domain.irq;
            int gsi = domain_pirq_to_emuirq(v->domain, eoi.irq);

            /* if this is a level irq and count > 0, send another
             * notification */ 
            if ( gsi >= NR_ISAIRQS /* ISA irqs are edge triggered */
                    && hvm_irq->gsi_assert_count[gsi] )
                send_guest_pirq(v->domain, eoi.irq);
        }
        spin_unlock(&v->domain->event_lock);
        break;
    }

    case PHYSDEVOP_pirq_eoi_gmfn_v2:
    case PHYSDEVOP_pirq_eoi_gmfn_v1: {
        struct physdev_pirq_eoi_gmfn info;
        unsigned long mfn;

        ret = -EFAULT;
        if ( copy_from_guest(&info, arg, 1) != 0 )
            break;

        ret = -EINVAL;
        mfn = gmfn_to_mfn(current->domain, info.gmfn);
        if ( !mfn_valid(mfn) ||
             !get_page_and_type(mfn_to_page(mfn), v->domain,
                                PGT_writable_page) )
            break;

        if ( cmpxchg(&v->domain->arch.pirq_eoi_map_mfn, 0, mfn) != 0 )
        {
            put_page_and_type(mfn_to_page(mfn));
            ret = -EBUSY;
            break;
        }

        v->domain->arch.pirq_eoi_map = map_domain_page_global(mfn);
        if ( v->domain->arch.pirq_eoi_map == NULL )
        {
            v->domain->arch.pirq_eoi_map_mfn = 0;
            put_page_and_type(mfn_to_page(mfn));
            ret = -ENOSPC;
            break;
        }
        if ( cmd == PHYSDEVOP_pirq_eoi_gmfn_v1 )
            v->domain->arch.auto_unmask = 1;

        ret = 0;
        break;
    }

    /* Legacy since 0x00030202. */
    case PHYSDEVOP_IRQ_UNMASK_NOTIFY: {
        ret = pirq_guest_unmask(v->domain);
        break;
    }

    case PHYSDEVOP_irq_status_query: {
        struct physdev_irq_status_query irq_status_query;
        ret = -EFAULT;
        if ( copy_from_guest(&irq_status_query, arg, 1) != 0 )
            break;
        irq = irq_status_query.irq;
        ret = -EINVAL;
        if ( (irq < 0) || (irq >= v->domain->nr_pirqs) )
            break;
        irq_status_query.flags = 0;
        if ( is_hvm_domain(v->domain) &&
                domain_pirq_to_irq(v->domain, irq) <= 0 &&
                domain_pirq_to_emuirq(v->domain, irq) == IRQ_UNBOUND )
        {
            ret = -EINVAL;
            break;
        }

        /*
         * Even edge-triggered or message-based IRQs can need masking from
         * time to time. If teh guest is not dynamically checking for this
         * via the new pirq_eoi_map mechanism, it must conservatively always
         * execute the EOI hypercall. In practice, this only really makes a
         * difference for maskable MSI sources, and if those are supported
         * then dom0 is probably modern anyway.
         */
        irq_status_query.flags |= XENIRQSTAT_needs_eoi;
        if ( pirq_shared(v->domain, irq) )
            irq_status_query.flags |= XENIRQSTAT_shared;
        ret = copy_to_guest(arg, &irq_status_query, 1) ? -EFAULT : 0;
        break;
    }

    case PHYSDEVOP_map_pirq: {
        struct physdev_map_pirq map;

        ret = -EFAULT;
        if ( copy_from_guest(&map, arg, 1) != 0 )
            break;

        ret = physdev_map_pirq(&map);

        if ( copy_to_guest(arg, &map, 1) != 0 )
            ret = -EFAULT;
        break;
    }

    case PHYSDEVOP_unmap_pirq: {
        struct physdev_unmap_pirq unmap;

        ret = -EFAULT;
        if ( copy_from_guest(&unmap, arg, 1) != 0 )
            break;

        ret = physdev_unmap_pirq(&unmap);
        break;
    }

    case PHYSDEVOP_apic_read: {
        struct physdev_apic apic;
        ret = -EFAULT;
        if ( copy_from_guest(&apic, arg, 1) != 0 )
            break;
        ret = -EPERM;
        if ( !IS_PRIV(v->domain) )
            break;
        ret = xsm_apic(v->domain, cmd);
        if ( ret )
            break;
        ret = ioapic_guest_read(apic.apic_physbase, apic.reg, &apic.value);
        if ( copy_to_guest(arg, &apic, 1) != 0 )
            ret = -EFAULT;
        break;
    }

    case PHYSDEVOP_apic_write: {
        struct physdev_apic apic;
        ret = -EFAULT;
        if ( copy_from_guest(&apic, arg, 1) != 0 )
            break;
        ret = -EPERM;
        if ( !IS_PRIV(v->domain) )
            break;
        ret = xsm_apic(v->domain, cmd);
        if ( ret )
            break;
        ret = ioapic_guest_write(apic.apic_physbase, apic.reg, apic.value);
        break;
    }

    case PHYSDEVOP_alloc_irq_vector: {
        struct physdev_irq irq_op;

        ret = -EFAULT;
        if ( copy_from_guest(&irq_op, arg, 1) != 0 )
            break;

        ret = -EPERM;
        if ( !IS_PRIV(v->domain) )
            break;

        ret = xsm_assign_vector(v->domain, irq_op.irq);
        if ( ret )
            break;

        /* Vector is only used by hypervisor, and dom0 shouldn't
           touch it in its world, return irq_op.irq as the vecotr,
           and make this hypercall dummy, and also defer the vector 
           allocation when dom0 tries to programe ioapic entry. */
        irq_op.vector = irq_op.irq;
        ret = 0;
        
        if ( copy_to_guest(arg, &irq_op, 1) != 0 )
            ret = -EFAULT;
        break;
    }

    case PHYSDEVOP_set_iopl: {
        struct physdev_set_iopl set_iopl;
        ret = -EFAULT;
        if ( copy_from_guest(&set_iopl, arg, 1) != 0 )
            break;
        ret = -EINVAL;
        if ( set_iopl.iopl > 3 )
            break;
        ret = 0;
        v->arch.iopl = set_iopl.iopl;
        break;
    }

    case PHYSDEVOP_set_iobitmap: {
        struct physdev_set_iobitmap set_iobitmap;
        ret = -EFAULT;
        if ( copy_from_guest(&set_iobitmap, arg, 1) != 0 )
            break;
        ret = -EINVAL;
        if ( !guest_handle_okay(set_iobitmap.bitmap, IOBMP_BYTES) ||
             (set_iobitmap.nr_ports > 65536) )
            break;
        ret = 0;
#ifndef COMPAT
        v->arch.iobmp       = set_iobitmap.bitmap;
#else
        guest_from_compat_handle(v->arch.iobmp, set_iobitmap.bitmap);
#endif
        v->arch.iobmp_limit = set_iobitmap.nr_ports;
        break;
    }

    case PHYSDEVOP_manage_pci_add: {
        struct physdev_manage_pci manage_pci;
        ret = -EPERM;
        if ( !IS_PRIV(v->domain) )
            break;
        ret = -EFAULT;
        if ( copy_from_guest(&manage_pci, arg, 1) != 0 )
            break;

        ret = pci_add_device(manage_pci.bus, manage_pci.devfn, NULL);
        break;
    }

    case PHYSDEVOP_manage_pci_remove: {
        struct physdev_manage_pci manage_pci;
        ret = -EPERM;
        if ( !IS_PRIV(v->domain) )
            break;
        ret = -EFAULT;
        if ( copy_from_guest(&manage_pci, arg, 1) != 0 )
            break;

        ret = pci_remove_device(manage_pci.bus, manage_pci.devfn);
        break;
    }

    case PHYSDEVOP_manage_pci_add_ext: {
        struct physdev_manage_pci_ext manage_pci_ext;
        struct pci_dev_info pdev_info;

        ret = -EPERM;
        if ( !IS_PRIV(current->domain) )
            break;

        ret = -EFAULT;
        if ( copy_from_guest(&manage_pci_ext, arg, 1) != 0 )
            break;

        ret = -EINVAL;
        if ( (manage_pci_ext.is_extfn > 1) || (manage_pci_ext.is_virtfn > 1) )
            break;

        pdev_info.is_extfn = manage_pci_ext.is_extfn;
        pdev_info.is_virtfn = manage_pci_ext.is_virtfn;
        pdev_info.physfn.bus = manage_pci_ext.physfn.bus;
        pdev_info.physfn.devfn = manage_pci_ext.physfn.devfn;
        ret = pci_add_device(manage_pci_ext.bus,
                             manage_pci_ext.devfn,
                             &pdev_info);
        break;
    }

    case PHYSDEVOP_restore_msi: {
        struct physdev_restore_msi restore_msi;
        struct pci_dev *pdev;

        ret = -EPERM;
        if ( !IS_PRIV(v->domain) )
            break;

        ret = -EFAULT;
        if ( copy_from_guest(&restore_msi, arg, 1) != 0 )
            break;

        spin_lock(&pcidevs_lock);
        pdev = pci_get_pdev(restore_msi.bus, restore_msi.devfn);
        ret = pdev ? pci_restore_msi_state(pdev) : -ENODEV;
        spin_unlock(&pcidevs_lock);
        break;
    }
    case PHYSDEVOP_setup_gsi: {
        struct physdev_setup_gsi setup_gsi;

        ret = -EPERM;
        if ( !IS_PRIV(v->domain) )
            break;

        ret = -EFAULT;
        if ( copy_from_guest(&setup_gsi, arg, 1) != 0 )
            break;
        
        ret = -EINVAL;
        if ( setup_gsi.gsi < 0 || setup_gsi.gsi >= nr_irqs_gsi )
            break;
        ret = mp_register_gsi(setup_gsi.gsi, setup_gsi.triggering,
                              setup_gsi.polarity);
        break; 
    }
    case PHYSDEVOP_get_free_pirq: {
        struct physdev_get_free_pirq out;
        struct domain *d;

        d = rcu_lock_current_domain();
        
        ret = -EFAULT;
        if ( copy_from_guest(&out, arg, 1) != 0 )
            break;

        spin_lock(&d->event_lock);
        ret = get_free_pirq(d, out.type, 0);
        if ( ret >= 0 )
            d->arch.pirq_irq[ret] = PIRQ_ALLOCATED;
        spin_unlock(&d->event_lock);

        if ( ret >= 0 )
        {
            out.pirq = ret;
            ret = copy_to_guest(arg, &out, 1) ? -EFAULT : 0;
        }

        rcu_unlock_domain(d);
        break;
    }
    default:
        ret = -ENOSYS;
        break;
    }

    return ret;
}

/*
 * Local variables:
 * mode: C
 * c-set-style: "BSD"
 * c-basic-offset: 4
 * tab-width: 4
 * indent-tabs-mode: nil
 * End:
 */

[-- Attachment #3: xm_dmesg_per_deviceorder --]
[-- Type: application/octet-stream, Size: 6395 bytes --]

FAILING case
w8.cfg:
pci = 04:00.0

> xm create w8.cfg
Error: (17, 'File exists')
usage: /usr/local/bin/xmc <config file present in /alt/xen/configs>

>xm dmesg
...
(XEN) physdev.c:98: AF1: map->domid1, map->type1, map->index19, map->pirq-1, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=19 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=16
(XEN) physdev.c:236: AF6: final map->pirq: 16
(XEN) physdev.c:98: AF1: map->domid1, map->type0, map->index-1, map->pirq-1, map->bus4, map->devfn0, map->entry_nr0
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=55
(XEN) physdev.c:236: AF6: final map->pirq: 55
(XEN) physdev.c:98: AF1: map->domid1, map->type1, map->index19, map->pirq19, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=19 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq19, pirq16
(XEN) physdev.c:219: AF4.5: pirq right before EEXIST error: 16
(XEN) physdev.c:221: dom1: pirq 19 conflicts with irq 19

WORKING case
w8.cfg:
pci = [ 41:00.0, 41:00.1, 04:00.0 ]
> xm create w8.cfg

>xm dmesg
...
(XEN) physdev.c:98: AF1: map->domid2, map->type1, map->index16, map->pirq-1, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=16 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=16
(XEN) physdev.c:236: AF6: final map->pirq: 16
(XEN) physdev.c:98: AF1: map->domid2, map->type0, map->index-1, map->pirq-1, map->bus65, map->devfn0, map->entry_nr0
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=55
(XEN) physdev.c:236: AF6: final map->pirq: 55
(XEN) physdev.c:98: AF1: map->domid2, map->type1, map->index16, map->pirq16, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=16 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq16, pirq16
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 16
(XEN) physdev.c:98: AF1: map->domid2, map->type1, map->index17, map->pirq17, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=17 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq17, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 17
(XEN) physdev.c:98: AF1: map->domid2, map->type1, map->index19, map->pirq19, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=19 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq19, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 19
(XEN) physdev.c:98: AF1: map->domid2, map->type1, map->index16, map->pirq16, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=16 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq16, pirq16
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 16
(XEN) physdev.c:98: AF1: map->domid2, map->type1, map->index17, map->pirq-1, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=17 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq17
(XEN) physdev.c:195: dom2: 17:-1 already mapped to 17
(XEN) physdev.c:236: AF6: final map->pirq: 17
(XEN) physdev.c:98: AF1: map->domid2, map->type0, map->index-1, map->pirq-1, map->bus65, map->devfn1, map->entry_nr0
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=54
(XEN) physdev.c:236: AF6: final map->pirq: 54
(XEN) physdev.c:98: AF1: map->domid2, map->type1, map->index17, map->pirq17, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=17 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq17, pirq17
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 17
(XEN) physdev.c:98: AF1: map->domid2, map->type1, map->index19, map->pirq-1, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=19 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq19
(XEN) physdev.c:195: dom2: 19:-1 already mapped to 19
(XEN) physdev.c:236: AF6: final map->pirq: 19
(XEN) physdev.c:98: AF1: map->domid2, map->type0, map->index-1, map->pirq-1, map->bus4, map->devfn0, map->entry_nr0
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=53
(XEN) physdev.c:236: AF6: final map->pirq: 53
(XEN) physdev.c:98: AF1: map->domid2, map->type1, map->index19, map->pirq19, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=19 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq19, pirq19
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 19
(XEN) HVM2: HVM Loader
(XEN) HVM2: Detected Xen v4.1.3
...

[-- Attachment #4: lspci_passed_through_devs --]
[-- Type: application/octet-stream, Size: 8661 bytes --]

04:00.0 USB controller: Texas Instruments TUSB73x0 SuperSpeed USB 3.0 xHCI Host Controller (rev 02) (prog-if 30 [XHCI])
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Interrupt: pin A routed to IRQ 19
	Region 0: Memory at dfef0000 (64-bit, non-prefetchable) [disabled] [size=64K]
	Region 2: Memory at dfeee000 (64-bit, non-prefetchable) [disabled] [size=8K]
	Capabilities: [40] Power Management version 3
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=100mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [48] MSI: Enable- Count=1/8 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [70] Express (v2) Endpoint, MSI 00
		DevCap:	MaxPayload 1024 bytes, PhantFunc 0, Latency L0s unlimited, L1 unlimited
			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
		LnkCap:	Port #0, Speed 5GT/s, Width x1, ASPM L0s L1, Latency L0 <512ns, L1 <64us
			ClockPM+ Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [c0] MSI-X: Enable- Count=8 Masked-
		Vector table: BAR=2 offset=00000000
		PBA: BAR=2 offset=00001000
	Capabilities: [100 v2] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
	Capabilities: [150 v1] Device Serial Number 08-00-28-00-00-20-00-00
	Kernel driver in use: pciback

41:00.0 VGA compatible controller: Advanced Micro Devices [AMD] nee ATI Device 665c (prog-if 00 [VGA controller])
	Subsystem: Giga-byte Technology Device 2269
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Interrupt: pin A routed to IRQ 16
	Region 0: Memory at a0000000 (64-bit, prefetchable) [disabled] [size=256M]
	Region 2: Memory at 9f800000 (64-bit, prefetchable) [disabled] [size=8M]
	Region 4: I/O ports at e000 [disabled] [size=256]
	Region 5: Memory at bffc0000 (32-bit, non-prefetchable) [disabled] [size=256K]
	Expansion ROM at bffa0000 [disabled] [size=128K]
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1+,D2+,D3hot+,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [58] Express (v2) Legacy Endpoint, MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <4us, L1 unlimited
			ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 8GT/s, Width x16, ASPM L0s L1, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 5GT/s, Width x16, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis-
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [100 v1] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150 v2] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
	Capabilities: [270 v1] #19
	Capabilities: [2b0 v1] Address Translation Service (ATS)
		ATSCap:	Invalidate Queue Depth: 00
		ATSCtl:	Enable-, Smallest Translation Unit: 00
	Capabilities: [2c0 v1] #13
	Capabilities: [2d0 v1] #1b
	Kernel driver in use: pciback

41:00.1 Audio device: Advanced Micro Devices [AMD] nee ATI Device 0002
	Subsystem: Giga-byte Technology Device 0002
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Interrupt: pin B routed to IRQ 17
	Region 0: Memory at bff9c000 (64-bit, non-prefetchable) [disabled] [size=16K]
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [58] Express (v2) Legacy Endpoint, MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <4us, L1 unlimited
			ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 8GT/s, Width x16, ASPM L0s L1, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 5GT/s, Width x16, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis-
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [100 v1] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150 v2] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
	Kernel driver in use: pciback
	Kernel modules: snd-hda-intel


[-- Attachment #5: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: PCI passthrough problems after legacy update of xen 4.1

[Jan Beulich]

>>> On 05.05.13 at 21:33, Andreas Falck <falck.andreas.lists@gmail.com> wrote:
> [FAILING]
> (XEN) physdev.c:98: AF1: map->domid1, map->type1, map->index19,
> map->pirq-1, map->bus0, map->devfn0, map->entry_nr0
> (XEN) physdev.c:131: AF2: map->type=GSI
> (XEN) physdev.c:141: AF2.5: found irq=19 (if <= 0, irq will be set to
> map->index instead or fail with error)
> (XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
> (XEN) physdev.c:205: AF4: got previously free pirq=16
> (XEN) physdev.c:236: AF6: final map->pirq: 16
> ...
> (XEN) physdev.c:98: AF1: map->domid1, map->type1, map->index19,
> map->pirq19, map->bus0, map->devfn0, map->entry_nr0
> (XEN) physdev.c:131: AF2: map->type=GSI
> (XEN) physdev.c:141: AF2.5: found irq=19 (if <= 0, irq will be set to
> map->index instead or fail with error)
> (XEN) physdev.c:188: AF3: after getting pirq: map->pirq19, pirq16
> (XEN) physdev.c:219: AF4.5: pirq right before EEXIST error: 16
> (XEN) physdev.c:221: dom1: pirq 19 conflicts with irq 19

This makes matters pretty clear (minus finding the places where
the calls originate from in xend): The tool stack ought to settle on
whether it wants a 1:1 mapping for GSIs (in which case it needs to
pass in ->irq and ->index set to the same value) or whether it
wants Xen to establish a mapping (in which case it has to _always_
pass in -1 for ->pirq).

Of course we could try to work around this in the hypervisor:
Rather than calling get_free_pirq() unconditionally if map->pirq
is negative and pirq is zero, we could first see whether we can
use the 1:1 mapping slot (i.e. if it's not in use or already set up
for a 1:1 mapping). But to me that's a last resort thing, should
we find that fixing xend really isn't doable with reasonable effort.

The working case results from get_free_pirq() being first called
for IRQ16, and with a low-to-high allocation strategy this happens
to produce a 1:1 mapping (as 16 is the first slot available).

What I'm mildly concerned about is

>(XEN) physdev.c:141: AF2.5: found irq=19 (if <= 0, irq will be set to
>map->index instead or fail with error)

in both the working a failure cases - arch_domain_create() sets
up only IRQs below 16, so without any other action done by the
tool stack the translation should return zero here. But of course
that doesn't make any difference to the control flow further down
as the immediately following code - as your added messages also
states - would use map->index anyway.

Nevertheless it might be worth hunting down where that setup is
being done (domain_pirq_to_irq() simply being a read of
d->arch.pirq_irq[], it ought to be one of the few places where
that array gets written to with a positive value.

Jan

Re: PCI passthrough problems after legacy update of xen 4.1

[Jan Beulich]

[-- Attachment #1: Type: text/plain, Size: 2457 bytes --]

>>> On 05.05.13 at 21:33, Andreas Falck <falck.andreas.lists@gmail.com> wrote:
> I tried adding some debugging statements in physdev_map_pirq. I have
> attached the physdev.c with my debug statements, a hypervisor log from
> testing, and the output of lspci -vv for my three devices.

Since I didn't hear anything from either of you anymore, I went
through the (not very familiar to me) tool stack code again, and
found that qemu and xend/libxl fundamentally disagree about the
model to be used. Qemu wants to allocate PIRQs while xend/libxl
want a 1:1 mapping. Allocating after having created a 1:1 mapping
works by returning the 1:1 mapping as allocation result, so as long
as libxl completes its setup before launching qemu, it would be
obvious why things work there. Consequently I assume that xend
launches qemu quite a bit earlier in the process of creating a new
domain, and the result of an attempt to establish a 1:1 mapping
when a different mapping was already established is dependent on
the specific interrupt numbers (i.e. also explains the observations
one of you made).

Since the tool stack as a whole really ought to use a consistent
model, and since the 1:1 mapping model for non-MSI IRQs seems
quite natural, the below/attached patch takes care of enforcing
a 1:1 mapping in libxc when allocation is being requested by the
caller. Ian, Ian - do you foresee any problem with this?

Please both of you give this a try and let us know of the results
(patch applies cleanly to all of -unstable, 4.2, and 4.1).

Jan

--- a/tools/libxc/xc_physdev.c
+++ b/tools/libxc/xc_physdev.c
@@ -49,7 +49,7 @@ int xc_physdev_map_pirq(xc_interface *xc
     map.domid = domid;
     map.type = MAP_PIRQ_TYPE_GSI;
     map.index = index;
-    map.pirq = *pirq;
+    map.pirq = *pirq < 0 ? index : *pirq;
 
     rc = do_physdev_op(xch, PHYSDEVOP_map_pirq, &map, sizeof(map));
 
--- a/tools/python/xen/xend/server/pciif.py
+++ b/tools/python/xen/xend/server/pciif.py
@@ -340,7 +340,7 @@ class PciController(DevController):
                 raise VmError(('pci: failed to configure I/O memory on device '+
                             '%s - errno=%d')%(dev.name,rc))
 
-        if not self.vm.info.is_hvm() and dev.irq:
+        if dev.irq > 0:
             rc = xc.physdev_map_pirq(domid = fe_domid,
                                    index = dev.irq,
                                    pirq  = dev.irq)



[-- Attachment #2: xsa46-fix.patch --]
[-- Type: text/plain, Size: 892 bytes --]

--- a/tools/libxc/xc_physdev.c
+++ b/tools/libxc/xc_physdev.c
@@ -49,7 +49,7 @@ int xc_physdev_map_pirq(xc_interface *xc
     map.domid = domid;
     map.type = MAP_PIRQ_TYPE_GSI;
     map.index = index;
-    map.pirq = *pirq;
+    map.pirq = *pirq < 0 ? index : *pirq;
 
     rc = do_physdev_op(xch, PHYSDEVOP_map_pirq, &map, sizeof(map));
 
--- a/tools/python/xen/xend/server/pciif.py
+++ b/tools/python/xen/xend/server/pciif.py
@@ -340,7 +340,7 @@ class PciController(DevController):
                 raise VmError(('pci: failed to configure I/O memory on device '+
                             '%s - errno=%d')%(dev.name,rc))
 
-        if not self.vm.info.is_hvm() and dev.irq:
+        if dev.irq > 0:
             rc = xc.physdev_map_pirq(domid = fe_domid,
                                    index = dev.irq,
                                    pirq  = dev.irq)

[-- Attachment #3: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: PCI passthrough problems after legacy update of xen 4.1

[Gordan Bobic]

 Thanks Jan,

 I'll try this tonight and report back.

 Many thanks.

 Gordan

 On Tue, 14 May 2013 15:01:11 +0100, "Jan Beulich" <JBeulich@suse.com> 
 wrote:
>>>> On 05.05.13 at 21:33, Andreas Falck 
>>>> <falck.andreas.lists@gmail.com> wrote:
>> I tried adding some debugging statements in physdev_map_pirq. I have
>> attached the physdev.c with my debug statements, a hypervisor log 
>> from
>> testing, and the output of lspci -vv for my three devices.
>
> Since I didn't hear anything from either of you anymore, I went
> through the (not very familiar to me) tool stack code again, and
> found that qemu and xend/libxl fundamentally disagree about the
> model to be used. Qemu wants to allocate PIRQs while xend/libxl
> want a 1:1 mapping. Allocating after having created a 1:1 mapping
> works by returning the 1:1 mapping as allocation result, so as long
> as libxl completes its setup before launching qemu, it would be
> obvious why things work there. Consequently I assume that xend
> launches qemu quite a bit earlier in the process of creating a new
> domain, and the result of an attempt to establish a 1:1 mapping
> when a different mapping was already established is dependent on
> the specific interrupt numbers (i.e. also explains the observations
> one of you made).
>
> Since the tool stack as a whole really ought to use a consistent
> model, and since the 1:1 mapping model for non-MSI IRQs seems
> quite natural, the below/attached patch takes care of enforcing
> a 1:1 mapping in libxc when allocation is being requested by the
> caller. Ian, Ian - do you foresee any problem with this?
>
> Please both of you give this a try and let us know of the results
> (patch applies cleanly to all of -unstable, 4.2, and 4.1).
>
> Jan
>
> --- a/tools/libxc/xc_physdev.c
> +++ b/tools/libxc/xc_physdev.c
> @@ -49,7 +49,7 @@ int xc_physdev_map_pirq(xc_interface *xc
>      map.domid = domid;
>      map.type = MAP_PIRQ_TYPE_GSI;
>      map.index = index;
> -    map.pirq = *pirq;
> +    map.pirq = *pirq < 0 ? index : *pirq;
>
>      rc = do_physdev_op(xch, PHYSDEVOP_map_pirq, &map, sizeof(map));
>
> --- a/tools/python/xen/xend/server/pciif.py
> +++ b/tools/python/xen/xend/server/pciif.py
> @@ -340,7 +340,7 @@ class PciController(DevController):
>                  raise VmError(('pci: failed to configure I/O memory
> on device '+
>                              '%s - errno=%d')%(dev.name,rc))
>
> -        if not self.vm.info.is_hvm() and dev.irq:
> +        if dev.irq > 0:
>              rc = xc.physdev_map_pirq(domid = fe_domid,
>                                     index = dev.irq,
>                                     pirq  = dev.irq)

Re: PCI passthrough problems after legacy update of xen 4.1

[Gordan Bobic]

Bad news, I'm afraid - I still get error "22, invalid argument" with 
this patch.

Gordan

On 05/14/2013 03:01 PM, Jan Beulich wrote:
>>>> On 05.05.13 at 21:33, Andreas Falck <falck.andreas.lists@gmail.com> wrote:
>> I tried adding some debugging statements in physdev_map_pirq. I have
>> attached the physdev.c with my debug statements, a hypervisor log from
>> testing, and the output of lspci -vv for my three devices.
>
> Since I didn't hear anything from either of you anymore, I went
> through the (not very familiar to me) tool stack code again, and
> found that qemu and xend/libxl fundamentally disagree about the
> model to be used. Qemu wants to allocate PIRQs while xend/libxl
> want a 1:1 mapping. Allocating after having created a 1:1 mapping
> works by returning the 1:1 mapping as allocation result, so as long
> as libxl completes its setup before launching qemu, it would be
> obvious why things work there. Consequently I assume that xend
> launches qemu quite a bit earlier in the process of creating a new
> domain, and the result of an attempt to establish a 1:1 mapping
> when a different mapping was already established is dependent on
> the specific interrupt numbers (i.e. also explains the observations
> one of you made).
>
> Since the tool stack as a whole really ought to use a consistent
> model, and since the 1:1 mapping model for non-MSI IRQs seems
> quite natural, the below/attached patch takes care of enforcing
> a 1:1 mapping in libxc when allocation is being requested by the
> caller. Ian, Ian - do you foresee any problem with this?
>
> Please both of you give this a try and let us know of the results
> (patch applies cleanly to all of -unstable, 4.2, and 4.1).
>
> Jan
>
> --- a/tools/libxc/xc_physdev.c
> +++ b/tools/libxc/xc_physdev.c
> @@ -49,7 +49,7 @@ int xc_physdev_map_pirq(xc_interface *xc
>       map.domid = domid;
>       map.type = MAP_PIRQ_TYPE_GSI;
>       map.index = index;
> -    map.pirq = *pirq;
> +    map.pirq = *pirq < 0 ? index : *pirq;
>
>       rc = do_physdev_op(xch, PHYSDEVOP_map_pirq, &map, sizeof(map));
>
> --- a/tools/python/xen/xend/server/pciif.py
> +++ b/tools/python/xen/xend/server/pciif.py
> @@ -340,7 +340,7 @@ class PciController(DevController):
>                   raise VmError(('pci: failed to configure I/O memory on device '+
>                               '%s - errno=%d')%(dev.name,rc))
>
> -        if not self.vm.info.is_hvm() and dev.irq:
> +        if dev.irq > 0:
>               rc = xc.physdev_map_pirq(domid = fe_domid,
>                                      index = dev.irq,
>                                      pirq  = dev.irq)
>
>

Re: PCI passthrough problems after legacy update of xen 4.1

[Jan Beulich]

>>> On 14.05.13 at 21:30, Gordan Bobic <gordan@bobich.net> wrote:
> Bad news, I'm afraid - I still get error "22, invalid argument" with 
> this patch.

It would of course help to know precisely where this error is being
observed, the more that the xend change alone was reported to
convert the original EINVAL into EEXIST in another place.

Jan

> On 05/14/2013 03:01 PM, Jan Beulich wrote:
>>>>> On 05.05.13 at 21:33, Andreas Falck <falck.andreas.lists@gmail.com> wrote:
>>> I tried adding some debugging statements in physdev_map_pirq. I have
>>> attached the physdev.c with my debug statements, a hypervisor log from
>>> testing, and the output of lspci -vv for my three devices.
>>
>> Since I didn't hear anything from either of you anymore, I went
>> through the (not very familiar to me) tool stack code again, and
>> found that qemu and xend/libxl fundamentally disagree about the
>> model to be used. Qemu wants to allocate PIRQs while xend/libxl
>> want a 1:1 mapping. Allocating after having created a 1:1 mapping
>> works by returning the 1:1 mapping as allocation result, so as long
>> as libxl completes its setup before launching qemu, it would be
>> obvious why things work there. Consequently I assume that xend
>> launches qemu quite a bit earlier in the process of creating a new
>> domain, and the result of an attempt to establish a 1:1 mapping
>> when a different mapping was already established is dependent on
>> the specific interrupt numbers (i.e. also explains the observations
>> one of you made).
>>
>> Since the tool stack as a whole really ought to use a consistent
>> model, and since the 1:1 mapping model for non-MSI IRQs seems
>> quite natural, the below/attached patch takes care of enforcing
>> a 1:1 mapping in libxc when allocation is being requested by the
>> caller. Ian, Ian - do you foresee any problem with this?
>>
>> Please both of you give this a try and let us know of the results
>> (patch applies cleanly to all of -unstable, 4.2, and 4.1).
>>
>> Jan
>>
>> --- a/tools/libxc/xc_physdev.c
>> +++ b/tools/libxc/xc_physdev.c
>> @@ -49,7 +49,7 @@ int xc_physdev_map_pirq(xc_interface *xc
>>       map.domid = domid;
>>       map.type = MAP_PIRQ_TYPE_GSI;
>>       map.index = index;
>> -    map.pirq = *pirq;
>> +    map.pirq = *pirq < 0 ? index : *pirq;
>>
>>       rc = do_physdev_op(xch, PHYSDEVOP_map_pirq, &map, sizeof(map));
>>
>> --- a/tools/python/xen/xend/server/pciif.py
>> +++ b/tools/python/xen/xend/server/pciif.py
>> @@ -340,7 +340,7 @@ class PciController(DevController):
>>                   raise VmError(('pci: failed to configure I/O memory on 
> device '+
>>                               '%s - errno=%d')%(dev.name,rc))
>>
>> -        if not self.vm.info.is_hvm() and dev.irq:
>> +        if dev.irq > 0:
>>               rc = xc.physdev_map_pirq(domid = fe_domid,
>>                                      index = dev.irq,
>>                                      pirq  = dev.irq)
>>
>>

Re: PCI passthrough problems after XSA46 patch

[Gordan Bobic]

On 05/15/2013 08:06 AM, Jan Beulich wrote:
>>>> On 14.05.13 at 21:30, Gordan Bobic <gordan@bobich.net> wrote:
>> Bad news, I'm afraid - I still get error "22, invalid argument" with
>> this patch.
>
> It would of course help to know precisely where this error is being
> observed, the more that the xend change alone was reported to
> convert the original EINVAL into EEXIST in another place.

Not sure what you mean. It's observed when running
xm start $guestname

Which logs would you like me to attach?

Gordan

Re: PCI passthrough problems after XSA46 patch

[Jan Beulich]

>>> On 15.05.13 at 09:24, Gordan Bobic <gordan@bobich.net> wrote:
> On 05/15/2013 08:06 AM, Jan Beulich wrote:
>>>>> On 14.05.13 at 21:30, Gordan Bobic <gordan@bobich.net> wrote:
>>> Bad news, I'm afraid - I still get error "22, invalid argument" with
>>> this patch.
>>
>> It would of course help to know precisely where this error is being
>> observed, the more that the xend change alone was reported to
>> convert the original EINVAL into EEXIST in another place.
> 
> Not sure what you mean. It's observed when running
> xm start $guestname
> 
> Which logs would you like me to attach?

xend.log and xend-debug.log, but ideally only the parts that in fact
relate to a run with the newly built bits (so that I won't have to guess
which pieces are from still running with the unpatched code).

Also, with the logs having no way for me to see that you actually
built and installed binaries with the patch in place, please double
check that you actually did (just to avoid chasing a phantom).

Jan

Re: PCI passthrough problems after XSA46 patch

[Gordan Bobic]

[-- Attachment #1: Type: text/plain, Size: 2140 bytes --]

On 05/15/2013 08:50 AM, Jan Beulich wrote:
>>>> On 15.05.13 at 09:24, Gordan Bobic <gordan@bobich.net> wrote:
>> On 05/15/2013 08:06 AM, Jan Beulich wrote:
>>>>>> On 14.05.13 at 21:30, Gordan Bobic <gordan@bobich.net> wrote:
>>>> Bad news, I'm afraid - I still get error "22, invalid argument" with
>>>> this patch.
>>>
>>> It would of course help to know precisely where this error is being
>>> observed, the more that the xend change alone was reported to
>>> convert the original EINVAL into EEXIST in another place.
>>
>> Not sure what you mean. It's observed when running
>> xm start $guestname
>>
>> Which logs would you like me to attach?
>
> xend.log and xend-debug.log, but ideally only the parts that in fact
> relate to a run with the newly built bits (so that I won't have to guess
> which pieces are from still running with the unpatched code).
>
> Also, with the logs having no way for me to see that you actually
> built and installed binaries with the patch in place, please double
> check that you actually did (just to avoid chasing a phantom).

OK, here goes.

The 4.2.1-7 rpm I am testing against (closest to the 4.2.1-6 that works 
for me) no longer appears to be in the CRC repository here:
http://uk1.mirror.crc.id.au/repo/el6/SRPMS/

In the spec files, the patches applied are as follows:

Patch35: xend-pci-loop.patch
Patch48: qemu-xen.tradonly.patch

Patch50: xsa34-4.2.patch
Patch51: xsa35-4.2.patch
Patch52: xsa36-4.2.patch
Patch53: xsa38-v3.patch
Patch54: xsa47-4.2.patch
Patch55: xsa44-4.2.patch
Patch56: xsa46-4.2.patch
Patch57: xsa46-fix.patch

The xsa46-fix patch is the one you provided on 14/05 (two lines 
replaced, in xc_physdev_map_pirq, and one in class 
PciController(DevController).


Attached is the build log to verify that the patch was being applied.
Compressed with xz because the uncompressed file is 6.5MB.


Trying to start the domU:
# xm start edi
Error: (22, 'Invalid argument')
Usage: xm start <DomainName>

xm debug-keys izq; xm dmesg
output attached.

xend.log and xend-debug.log also attached.

Two consecutive startups attempted, hence why there are two entries in 
the logs.

Gordan

[-- Attachment #2: xen-build-4.2.1-8.log.xz --]
[-- Type: application/octet-stream, Size: 92384 bytes --]

[-- Attachment #3: xm-dmesg --]
[-- Type: text/plain, Size: 34291 bytes --]

 __  __            _  _    ____    _     ___       _  __   
 \ \/ /___ _ __   | || |  |___ \  / |   ( _ )  ___| |/ /_  
  \  // _ \ '_ \  | || |_   __) | | |__ / _ \ / _ \ | '_ \ 
  /  \  __/ | | | |__   _| / __/ _| |__| (_) |  __/ | (_) |
 /_/\_\___|_| |_|    |_|(_)_____(_)_|   \___(_)___|_|\___/ 
                                                           
(XEN) Xen version 4.2.1 (root@shatteredsilicon.net) (gcc (GCC) 4.4.6 20120305 (Red Hat 4.4.6-4)) Fri May 17 20:03:49 BST 2013
(XEN) Latest ChangeSet: unavailable
(XEN) Bootloader: PXELINUX 3.86 2010-04-01 
(XEN) Command line: loglvl=all noreboot dom0_vcpus_pin
(XEN) Video information:
(XEN)  VGA is text mode 80x25, font 8x16
(XEN)  VBE/DDC methods: V2; EDID transfer time: 1 seconds
(XEN) Disc information:
(XEN)  Found 0 MBR signatures
(XEN)  Found 0 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 000000000009d400 (usable)
(XEN)  000000000009d400 - 00000000000a0000 (reserved)
(XEN)  00000000000e0000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 000000003f790000 (usable)
(XEN)  000000003f790000 - 000000003f79e000 (ACPI data)
(XEN)  000000003f79e000 - 000000003f7d0000 (ACPI NVS)
(XEN)  000000003f7d0000 - 000000003f7e0000 (reserved)
(XEN)  000000003f7e7000 - 0000000040000000 (reserved)
(XEN)  00000000fee00000 - 00000000fee01000 (reserved)
(XEN)  00000000ffc00000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 0000000cc0000000 (usable)
(XEN) ACPI: RSDP 000F9F70, 0024 (r2 ACPIAM)
(XEN) ACPI: XSDT 3F790100, 0064 (r1 042413 XSDT1438 20130424 MSFT       97)
(XEN) ACPI: FACP 3F790290, 00F4 (r4 042413 FACP1438 20130424 MSFT       97)
(XEN) ACPI: DSDT 3F7904F0, 58A3 (r2  1W555 1W555A58      A58 INTL 20051117)
(XEN) ACPI: FACS 3F79E000, 0040
(XEN) ACPI: APIC 3F790390, 0118 (r2 042413 APIC1438 20130424 MSFT       97)
(XEN) ACPI: MCFG 3F7904B0, 003C (r1 042413 OEMMCFG  20130424 MSFT       97)
(XEN) ACPI: OEMB 3F79E040, 0082 (r1 042413 OEMB1438 20130424 MSFT       97)
(XEN) ACPI: SRAT 3F79A4F0, 0250 (r2 042413 OEMSRAT         1 INTL        1)
(XEN) ACPI: HPET 3F79A740, 0038 (r1 042413 OEMHPET  20130424 MSFT       97)
(XEN) ACPI: DMAR 3F79E0D0, 0120 (r1    AMI  OEMDMAR        1 MSFT       97)
(XEN) ACPI: SSDT 3F7A4C70, 0363 (r1 DpgPmm    CpuPm       12 INTL 20051117)
(XEN) System RAM: 49143MB (50322612kB)
(XEN) SRAT: PXM 0 -> APIC 0 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 2 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 4 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 16 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 18 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 20 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 1 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 3 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 5 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 17 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 19 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 21 -> Node 0
(XEN) SRAT: PXM 1 -> APIC 32 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 34 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 36 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 48 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 50 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 52 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 33 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 35 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 37 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 49 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 51 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 53 -> Node 1
(XEN) SRAT: Node 0 PXM 0 0-a0000
(XEN) SRAT: Node 0 PXM 0 100000-40000000
(XEN) SRAT: Node 0 PXM 0 100000000-6c0000000
(XEN) SRAT: Node 1 PXM 1 6c0000000-cc0000000
(XEN) NUMA: Allocated memnodemap from cbaf1e000 - cbaf2b000
(XEN) NUMA: Using 8 for the hash shift.
(XEN) Domain heap initialised DMA width 32 bits
(XEN) found SMP MP-table at 000ff780
(XEN) DMI present.
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x808
(XEN) ACPI: ACPI SLEEP INFO: pm1x_cnt[804,0], pm1x_evt[800,0]
(XEN) ACPI:                  wakeup_vec[3f79e00c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
(XEN) Processor #0 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
(XEN) Processor #2 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x04] enabled)
(XEN) Processor #4 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x10] enabled)
(XEN) Processor #16 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x12] enabled)
(XEN) Processor #18 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x14] enabled)
(XEN) Processor #20 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x20] enabled)
(XEN) Processor #32 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x22] enabled)
(XEN) Processor #34 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x24] enabled)
(XEN) Processor #36 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x30] enabled)
(XEN) Processor #48 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x32] enabled)
(XEN) Processor #50 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x34] enabled)
(XEN) Processor #52 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x01] enabled)
(XEN) Processor #1 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x03] enabled)
(XEN) Processor #3 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x05] enabled)
(XEN) Processor #5 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x10] lapic_id[0x11] enabled)
(XEN) Processor #17 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x11] lapic_id[0x13] enabled)
(XEN) Processor #19 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x12] lapic_id[0x15] enabled)
(XEN) Processor #21 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x13] lapic_id[0x21] enabled)
(XEN) Processor #33 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x14] lapic_id[0x23] enabled)
(XEN) Processor #35 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x15] lapic_id[0x25] enabled)
(XEN) Processor #37 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x16] lapic_id[0x31] enabled)
(XEN) Processor #49 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x17] lapic_id[0x33] enabled)
(XEN) Processor #51 6:12 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x18] lapic_id[0x35] enabled)
(XEN) Processor #53 6:12 APIC version 21
(XEN) Overriding APIC driver with bigsmp
(XEN) ACPI: IOAPIC (id[0x06] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 6, version 32, address 0xfec00000, GSI 0-23
(XEN) ACPI: IOAPIC (id[0x07] address[0xfec8a000] gsi_base[24])
(XEN) IOAPIC[1]: apic_id 7, version 32, address 0xfec8a000, GSI 24-47
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 20 low level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) ACPI: IRQ9 used by override.
(XEN) Enabling APIC mode:  Phys.  Using 2 I/O APICs
(XEN) ACPI: HPET id: 0xffffffff base: 0xfed00000
(XEN) Table is not found!
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) SMP: Allowing 24 CPUs (0 hotplug CPUs)
(XEN) IRQ limits: 48 GSI, 4576 MSI/MSI-X
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 3321.782 MHz processor.
(XEN) Initing memory sharing.
(XEN) mce_intel.c:1239: MCA Capability: BCAST 1 SER 0 CMCI 1 firstbank 0 extended MCE MSR 0
(XEN) Intel machine check reporting enabled
(XEN) PCI: MCFG configuration 0: base e0000000 segment 0000 buses 00 - ff
(XEN) PCI: Not using MCFG for segment 0000 bus 00-ff
(XEN) Intel VT-d supported page sizes: 4kB.
(XEN) Intel VT-d Snoop Control enabled.
(XEN) Intel VT-d Dom0 DMA Passthrough not enabled.
(XEN) Intel VT-d Queued Invalidation enabled.
(XEN) Intel VT-d Interrupt Remapping not enabled.
(XEN) Intel VT-d Shared EPT tables not enabled.
(XEN) I/O virtualisation enabled
(XEN)  - Dom0 mode: Relaxed
(XEN) Enabled directed EOI with ioapic_ack_old on!
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using old ACK method
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) Platform timer is 14.318MHz HPET
(XEN) Defaulting to alternative key handling; send 'A' to switch to normal mode.
(XEN) Allocated console ring of 256 KiB.
(XEN) VMX: Supported advanced features:
(XEN)  - APIC MMIO access virtualisation
(XEN)  - APIC TPR shadow
(XEN)  - Extended Page Tables (EPT)
(XEN)  - Virtual-Processor Identifiers (VPID)
(XEN)  - Virtual NMI
(XEN)  - MSR direct-access bitmap
(XEN)  - Unrestricted Guest
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging (HAP) detected
(XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB
(XEN) Brought up 24 CPUs
(XEN) ACPI sleep modes: S3
(XEN) mcheck_poll: Machine check polling timer started.
(XEN) *** LOADING DOMAIN 0 ***
(XEN)  Xen  kernel: 64-bit, lsb, compat32
(XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x1f65000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   0000000420000000->0000000430000000 (12302825 pages to be allocated)
(XEN)  Init. ramdisk: 0000000cbc0b5000->0000000cbffff200
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: ffffffff81000000->ffffffff81f65000
(XEN)  Init. ramdisk: ffffffff81f65000->ffffffff85eaf200
(XEN)  Phys-Mach map: ffffffff85eb0000->ffffffff8bd2c9a0
(XEN)  Start info:    ffffffff8bd2d000->ffffffff8bd2d4b4
(XEN)  Page tables:   ffffffff8bd2e000->ffffffff8bd91000
(XEN)  Boot stack:    ffffffff8bd91000->ffffffff8bd92000
(XEN)  TOTAL:         ffffffff80000000->ffffffff8c000000
(XEN)  ENTRY ADDRESS: ffffffff818001e0
(XEN) Dom0 has maximum 24 VCPUs
(XEN) Scrubbing Free RAM: .done.
(XEN) Initial low memory virq threshold set at 0x4000 pages.
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
(XEN) Freed 252kB init memory.
(XEN) PCI add device 0000:00:00.0
(XEN) PCI add device 0000:00:02.0
(XEN) PCI add device 0000:00:03.0
(XEN) PCI add device 0000:00:07.0
(XEN) PCI add device 0000:00:13.0
(XEN) PCI add device 0000:00:14.0
(XEN) PCI add device 0000:00:14.1
(XEN) PCI add device 0000:00:14.2
(XEN) PCI add device 0000:00:14.3
(XEN) PCI add device 0000:00:1a.0
(XEN) PCI add device 0000:00:1a.1
(XEN) PCI add device 0000:00:1a.2
(XEN) PCI add device 0000:00:1a.7
(XEN) PCI add device 0000:00:1b.0
(XEN) PCI add device 0000:00:1c.0
(XEN) PCI add device 0000:00:1c.2
(XEN) PCI add device 0000:00:1c.4
(XEN) PCI add device 0000:00:1d.0
(XEN) PCI add device 0000:00:1d.1
(XEN) PCI add device 0000:00:1d.2
(XEN) PCI add device 0000:00:1d.7
(XEN) PCI add device 0000:00:1e.0
(XEN) PCI add device 0000:00:1f.0
(XEN) PCI add device 0000:00:1f.2
(XEN) PCI add device 0000:00:1f.3
(XEN) PCI add device 0000:0d:00.0
(XEN) PCI add device 0000:09:00.0
(XEN) PCI add device 0000:0a:00.0
(XEN) PCI add device 0000:0a:02.0
(XEN) PCI add device 0000:0b:00.0
(XEN) PCI add device 0000:05:00.0
(XEN) PCI add device 0000:06:00.0
(XEN) PCI add device 0000:06:02.0
(XEN) PCI add device 0000:07:00.0
(XEN) PCI add device 0000:07:00.1
(XEN) PCI add device 0000:03:00.0
(XEN) PCI add device 0000:02:00.0
(XEN) PCI add device 0000:fe:00.0
(XEN) PCI add device 0000:fe:00.1
(XEN) PCI add device 0000:fe:02.0
(XEN) PCI add device 0000:fe:02.1
(XEN) PCI add device 0000:fe:02.2
(XEN) PCI add device 0000:fe:02.3
(XEN) PCI add device 0000:fe:02.4
(XEN) PCI add device 0000:fe:02.5
(XEN) PCI add device 0000:fe:03.0
(XEN) PCI add device 0000:fe:03.1
(XEN) PCI add device 0000:fe:03.2
(XEN) PCI add device 0000:fe:03.4
(XEN) PCI add device 0000:fe:04.0
(XEN) PCI add device 0000:fe:04.1
(XEN) PCI add device 0000:fe:04.2
(XEN) PCI add device 0000:fe:04.3
(XEN) PCI add device 0000:fe:05.0
(XEN) PCI add device 0000:fe:05.1
(XEN) PCI add device 0000:fe:05.2
(XEN) PCI add device 0000:fe:05.3
(XEN) PCI add device 0000:fe:06.0
(XEN) PCI add device 0000:fe:06.1
(XEN) PCI add device 0000:fe:06.2
(XEN) PCI add device 0000:fe:06.3
(XEN) PCI add device 0000:ff:00.0
(XEN) PCI add device 0000:ff:00.1
(XEN) PCI add device 0000:ff:02.0
(XEN) PCI add device 0000:ff:02.1
(XEN) PCI add device 0000:ff:02.2
(XEN) PCI add device 0000:ff:02.3
(XEN) PCI add device 0000:ff:02.4
(XEN) PCI add device 0000:ff:02.5
(XEN) PCI add device 0000:ff:03.0
(XEN) PCI add device 0000:ff:03.1
(XEN) PCI add device 0000:ff:03.2
(XEN) PCI add device 0000:ff:03.4
(XEN) PCI add device 0000:ff:04.0
(XEN) PCI add device 0000:ff:04.1
(XEN) PCI add device 0000:ff:04.2
(XEN) PCI add device 0000:ff:04.3
(XEN) PCI add device 0000:ff:05.0
(XEN) PCI add device 0000:ff:05.1
(XEN) PCI add device 0000:ff:05.2
(XEN) PCI add device 0000:ff:05.3
(XEN) PCI add device 0000:ff:06.0
(XEN) PCI add device 0000:ff:06.1
(XEN) PCI add device 0000:ff:06.2
(XEN) PCI add device 0000:ff:06.3
(XEN) traps.c:2584:d0 Domain attempted WRMSR 00000000000000e2 from 0x0000000006000403 to 0x0000000000000403.
(XEN) traps.c:2584:d0 Domain attempted WRMSR 00000000000000e2 from 0x0000000006000403 to 0x0000000000000403.
(XEN) traps.c:2584:d0 Domain attempted WRMSR 00000000000000e2 from 0x0000000006000403 to 0x0000000000000403.
(XEN) traps.c:2584:d0 Domain attempted WRMSR 00000000000000e2 from 0x0000000006000403 to 0x0000000000000403.
(XEN) traps.c:2584:d0 Domain attempted WRMSR 00000000000000e2 from 0x0000000006000403 to 0x0000000000000403.
(XEN) traps.c:2584:d0 Domain attempted WRMSR 00000000000000e2 from 0x0000000006000403 to 0x0000000000000403.
(XEN) traps.c:2584:d0 Domain attempted WRMSR 00000000000000e2 from 0x0000000006000403 to 0x0000000000000403.
(XEN) traps.c:2584:d0 Domain attempted WRMSR 00000000000000e2 from 0x0000000006000403 to 0x0000000000000403.
(XEN) traps.c:2584:d0 Domain attempted WRMSR 00000000000000e2 from 0x0000000006000403 to 0x0000000000000403.
(XEN) traps.c:2584:d0 Domain attempted WRMSR 00000000000000e2 from 0x0000000006000403 to 0x0000000000000403.
(XEN) Monitor-Mwait will be used to enter C1 state
(XEN) Monitor-Mwait will be used to enter C3 state
(XEN) printk: 38 messages suppressed.
(XEN) domain.c:721:d0 Attempt to change CR4 flags 00002660 -> 000026e0
(XEN) domain.c:721:d0 Attempt to change CR4 flags 00002660 -> 000026e0
(XEN) domain.c:721:d0 Attempt to change CR4 flags 00002660 -> 000026e0
(XEN) domain.c:721:d0 Attempt to change CR4 flags 00002660 -> 000026e0
(XEN) domain.c:721:d0 Attempt to change CR4 flags 00002660 -> 000026e0
(XEN) domain.c:721:d0 Attempt to change CR4 flags 00002660 -> 000026e0
(XEN) sh error: sh_remove_all_mappings(): can't find all mappings of mfn 4709ae: c=c000000000000002 t=7400000000000001
(XEN) sh error: sh_remove_all_mappings(): can't find all mappings of mfn 866daa: c=c000000000000002 t=7400000000000001
(XEN) sh error: sh_remove_all_mappings(): can't find all mappings of mfn 855b6a: c=c000000000000002 t=7400000000000001
(XEN) Guest interrupt information:
(XEN)    IRQ:   0 affinity:000001 vec:f0 type=IO-APIC-edge    status=00000000 mapped, unbound
(XEN)    IRQ:   1 affinity:000001 vec:30 type=IO-APIC-edge    status=00000014 in-flight=0 domain-list=0:  1(----),
(XEN)    IRQ:   2 affinity:ffffff vec:e2 type=XT-PIC          status=00000000 mapped, unbound
(XEN)    IRQ:   3 affinity:000001 vec:38 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:   4 affinity:000001 vec:40 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:   5 affinity:000001 vec:48 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:   6 affinity:000001 vec:50 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:   7 affinity:000001 vec:58 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:   8 affinity:000001 vec:60 type=IO-APIC-edge    status=00000010 in-flight=0 domain-list=0:  8(----),
(XEN)    IRQ:   9 affinity:000001 vec:a0 type=IO-APIC-level   status=00000002 mapped, unbound
(XEN)    IRQ:  10 affinity:000001 vec:68 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:  11 affinity:000001 vec:70 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:  12 affinity:000001 vec:78 type=IO-APIC-edge    status=00000010 in-flight=0 domain-list=0: 12(----),
(XEN)    IRQ:  13 affinity:ffffff vec:88 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:  14 affinity:000001 vec:90 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:  15 affinity:000001 vec:98 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:  16 affinity:000001 vec:c0 type=IO-APIC-level   status=00000002 mapped, unbound
(XEN)    IRQ:  17 affinity:ffffff vec:b0 type=IO-APIC-level   status=00000002 mapped, unbound
(XEN)    IRQ:  18 affinity:000001 vec:b8 type=IO-APIC-level   status=00000010 in-flight=0 domain-list=0: 18(----),
(XEN)    IRQ:  19 affinity:000001 vec:d0 type=IO-APIC-level   status=00000010 in-flight=0 domain-list=0: 19(----),
(XEN)    IRQ:  20 affinity:000001 vec:a8 type=IO-APIC-level   status=00000010 in-flight=0 domain-list=0: 20(----),
(XEN)    IRQ:  21 affinity:000001 vec:c8 type=IO-APIC-level   status=00000010 in-flight=0 domain-list=0: 21(----),
(XEN)    IRQ:  22 affinity:ffffff vec:c1 type=IO-APIC-level   status=00000002 mapped, unbound
(XEN)    IRQ:  23 affinity:000001 vec:d8 type=IO-APIC-level   status=00000010 in-flight=0 domain-list=0: 23(----),
(XEN)    IRQ:  29 affinity:ffffff vec:21 type=IO-APIC-level   status=00000002 mapped, unbound
(XEN)    IRQ:  35 affinity:000001 vec:c9 type=IO-APIC-level   status=00000010 in-flight=0 domain-list=0: 35(----),
(XEN)    IRQ:  38 affinity:ffffff vec:b1 type=IO-APIC-level   status=00000002 mapped, unbound
(XEN)    IRQ:  39 affinity:ffffff vec:b9 type=IO-APIC-level   status=00000002 mapped, unbound
(XEN)    IRQ:  48 affinity:000001 vec:28 type=DMA_MSI         status=00000000 mapped, unbound
(XEN)    IRQ:  49 affinity:000001 vec:29 type=PCI-MSI/-X      status=00000010 in-flight=0 domain-list=0:303(----),
(XEN)    IRQ:  50 affinity:000001 vec:31 type=PCI-MSI/-X      status=00000010 in-flight=0 domain-list=0:302(----),
(XEN)    IRQ:  51 affinity:000001 vec:39 type=PCI-MSI/-X      status=00000010 in-flight=0 domain-list=0:301(----),
(XEN)    IRQ:  52 affinity:000001 vec:41 type=PCI-MSI         status=00000010 in-flight=0 domain-list=0:300(----),
(XEN)    IRQ:  53 affinity:000001 vec:49 type=PCI-MSI         status=00000010 in-flight=0 domain-list=0:299(----),
(XEN)    IRQ:  54 affinity:000001 vec:51 type=PCI-MSI         status=00000010 in-flight=0 domain-list=0:298(----),
(XEN)    IRQ:  55 affinity:000001 vec:59 type=PCI-MSI         status=00000010 in-flight=0 domain-list=0:297(----),
(XEN)    IRQ:  57 affinity:000001 vec:69 type=PCI-MSI         status=00000010 in-flight=0 domain-list=0:295(----),
(XEN)    IRQ:  58 affinity:000001 vec:71 type=PCI-MSI/-X      status=00000010 in-flight=0 domain-list=0:294(----),
(XEN)    IRQ:  59 affinity:000001 vec:79 type=PCI-MSI/-X      status=00000010 in-flight=0 domain-list=0:293(----),
(XEN)    IRQ:  60 affinity:000001 vec:81 type=PCI-MSI/-X      status=00000010 in-flight=0 domain-list=0:292(----),
(XEN)    IRQ:  61 affinity:000001 vec:89 type=PCI-MSI/-X      status=00000010 in-flight=0 domain-list=0:291(----),
(XEN)    IRQ:  62 affinity:000001 vec:91 type=PCI-MSI/-X      status=00000010 in-flight=0 domain-list=0:290(----),
(XEN)    IRQ:  63 affinity:000001 vec:99 type=PCI-MSI/-X      status=00000010 in-flight=0 domain-list=0:289(----),
(XEN)    IRQ:  64 affinity:000001 vec:a1 type=PCI-MSI/-X      status=00000010 in-flight=0 domain-list=0:288(----),
(XEN)    IRQ:  65 affinity:000001 vec:a9 type=PCI-MSI/-X      status=00000010 in-flight=0 domain-list=0:287(----),
(XEN) IO-APIC interrupt information:
(XEN)     IRQ  0 Vec240:
(XEN)       Apic 0x00, Pin  2: vec=f0 delivery=Fixed dest=P status=0 polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ  1 Vec 48:
(XEN)       Apic 0x00, Pin  1: vec=30 delivery=Fixed dest=P status=0 polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ  3 Vec 56:
(XEN)       Apic 0x00, Pin  3: vec=38 delivery=Fixed dest=P status=0 polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ  4 Vec 64:
(XEN)       Apic 0x00, Pin  4: vec=40 delivery=Fixed dest=P status=0 polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ  5 Vec 72:
(XEN)       Apic 0x00, Pin  5: vec=48 delivery=Fixed dest=P status=0 polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ  6 Vec 80:
(XEN)       Apic 0x00, Pin  6: vec=50 delivery=Fixed dest=P status=0 polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ  7 Vec 88:
(XEN)       Apic 0x00, Pin  7: vec=58 delivery=Fixed dest=P status=0 polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ  8 Vec 96:
(XEN)       Apic 0x00, Pin  8: vec=60 delivery=Fixed dest=P status=0 polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ  9 Vec160:
(XEN)       Apic 0x00, Pin 20: vec=a8 delivery=Fixed dest=P status=0 polarity=1 irr=0 trig=L mask=0 dest_id:0
(XEN)     IRQ 10 Vec104:
(XEN)       Apic 0x00, Pin 10: vec=68 delivery=Fixed dest=P status=0 polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ 11 Vec112:
(XEN)       Apic 0x00, Pin 11: vec=70 delivery=Fixed dest=P status=0 polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ 12 Vec120:
(XEN)       Apic 0x00, Pin 12: vec=78 delivery=Fixed dest=P status=0 polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ 13 Vec136:
(XEN)       Apic 0x00, Pin 13: vec=88 delivery=Fixed dest=P status=0 polarity=0 irr=0 trig=E mask=1 dest_id:0
(XEN)     IRQ 14 Vec144:
(XEN)       Apic 0x00, Pin 14: vec=90 delivery=Fixed dest=P status=0 polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ 15 Vec152:
(XEN)       Apic 0x00, Pin 15: vec=98 delivery=Fixed dest=P status=0 polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ 16 Vec192:
(XEN)       Apic 0x00, Pin 16: vec=c0 delivery=Fixed dest=P status=0 polarity=1 irr=0 trig=L mask=1 dest_id:0
(XEN)     IRQ 17 Vec176:
(XEN)       Apic 0x00, Pin 17: vec=b0 delivery=Fixed dest=P status=0 polarity=1 irr=0 trig=L mask=1 dest_id:0
(XEN)     IRQ 18 Vec184:
(XEN)       Apic 0x00, Pin 18: vec=b8 delivery=Fixed dest=P status=0 polarity=1 irr=0 trig=L mask=0 dest_id:0
(XEN)     IRQ 19 Vec208:
(XEN)       Apic 0x00, Pin 19: vec=d0 delivery=Fixed dest=P status=0 polarity=1 irr=0 trig=L mask=0 dest_id:0
(XEN)     IRQ 20 Vec168:
(XEN)       Apic 0x00, Pin 20: vec=a8 delivery=Fixed dest=P status=0 polarity=1 irr=0 trig=L mask=0 dest_id:0
(XEN)     IRQ 21 Vec200:
(XEN)       Apic 0x00, Pin 21: vec=c8 delivery=Fixed dest=P status=0 polarity=1 irr=0 trig=L mask=0 dest_id:0
(XEN)     IRQ 22 Vec193:
(XEN)       Apic 0x00, Pin 22: vec=c1 delivery=Fixed dest=P status=0 polarity=1 irr=0 trig=L mask=1 dest_id:0
(XEN)     IRQ 23 Vec216:
(XEN)       Apic 0x00, Pin 23: vec=d8 delivery=Fixed dest=P status=0 polarity=1 irr=0 trig=L mask=0 dest_id:0
(XEN)     IRQ 29 Vec 33:
(XEN)       Apic 0x01, Pin  5: vec=21 delivery=Fixed dest=P status=0 polarity=1 irr=0 trig=L mask=1 dest_id:0
(XEN)     IRQ 35 Vec201:
(XEN)       Apic 0x01, Pin 11: vec=c9 delivery=Fixed dest=P status=0 polarity=1 irr=0 trig=L mask=0 dest_id:0
(XEN)     IRQ 38 Vec177:
(XEN)       Apic 0x01, Pin 14: vec=b1 delivery=Fixed dest=P status=0 polarity=1 irr=0 trig=L mask=1 dest_id:0
(XEN)     IRQ 39 Vec185:
(XEN)       Apic 0x01, Pin 15: vec=b9 delivery=Fixed dest=P status=0 polarity=1 irr=0 trig=L mask=1 dest_id:0
(XEN) number of MP IRQ sources: 15.
(XEN) number of IO-APIC #6 registers: 24.
(XEN) number of IO-APIC #7 registers: 24.
(XEN) testing the IO APIC.......................
(XEN) IO APIC #6......
(XEN) .... register #00: 06000000
(XEN) .......    : physical APIC id: 06
(XEN) .......    : Delivery Type: 0
(XEN) .......    : LTS          : 0
(XEN) .... register #01: 00170020
(XEN) .......     : max redirection entries: 0017
(XEN) .......     : PRQ implemented: 0
(XEN) .......     : IO APIC version: 0020
(XEN) .... IRQ redirection table:
(XEN)  NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:   
(XEN)  00 000 00  1    0    0   0   0    0    0    00
(XEN)  01 000 00  0    0    0   0   0    0    0    30
(XEN)  02 000 00  0    0    0   0   0    0    0    F0
(XEN)  03 000 00  0    0    0   0   0    0    0    38
(XEN)  04 000 00  0    0    0   0   0    0    0    40
(XEN)  05 000 00  0    0    0   0   0    0    0    48
(XEN)  06 000 00  0    0    0   0   0    0    0    50
(XEN)  07 000 00  0    0    0   0   0    0    0    58
(XEN)  08 000 00  0    0    0   0   0    0    0    60
(XEN)  09 000 00  1    0    0   0   0    0    0    00
(XEN)  0a 000 00  0    0    0   0   0    0    0    68
(XEN)  0b 000 00  0    0    0   0   0    0    0    70
(XEN)  0c 000 00  0    0    0   0   0    0    0    78
(XEN)  0d 000 00  1    0    0   0   0    0    0    88
(XEN)  0e 000 00  0    0    0   0   0    0    0    90
(XEN)  0f 000 00  0    0    0   0   0    0    0    98
(XEN)  10 000 00  1    1    0   1   0    0    0    C0
(XEN)  11 000 00  1    1    0   1   0    0    0    B0
(XEN)  12 000 00  0    1    0   1   0    0    0    B8
(XEN)  13 000 00  0    1    0   1   0    0    0    D0
(XEN)  14 000 00  0    1    0   1   0    0    0    A8
(XEN)  15 000 00  0    1    0   1   0    0    0    C8
(XEN)  16 000 00  1    1    0   1   0    0    0    C1
(XEN)  17 000 00  0    1    0   1   0    0    0    D8
(XEN) IO APIC #7......
(XEN) .... register #00: 08000000
(XEN) .......    : physical APIC id: 08
(XEN) .......    : Delivery Type: 0
(XEN) .......    : LTS          : 0
(XEN) .... register #01: 00170020
(XEN) .......     : max redirection entries: 0017
(XEN) .......     : PRQ implemented: 0
(XEN) .......     : IO APIC version: 0020
(XEN) .... register #02: 00000000
(XEN) .......     : arbitration: 00
(XEN) .... register #03: 00000001
(XEN) .......     : Boot DT    : 1
(XEN) .... IRQ redirection table:
(XEN)  NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:   
(XEN)  00 000 00  1    0    0   0   0    0    0    00
(XEN)  01 000 00  1    0    0   0   0    0    0    00
(XEN)  02 000 00  1    0    0   0   0    0    0    00
(XEN)  03 000 00  1    0    0   0   0    0    0    00
(XEN)  04 000 00  1    0    0   0   0    0    0    00
(XEN)  05 000 00  1    1    0   1   0    0    0    21
(XEN)  06 000 00  1    0    0   0   0    0    0    00
(XEN)  07 000 00  1    0    0   0   0    0    0    00
(XEN)  08 000 00  1    0    0   0   0    0    0    00
(XEN)  09 000 00  1    0    0   0   0    0    0    00
(XEN)  0a 000 00  1    0    0   0   0    0    0    00
(XEN)  0b 000 00  0    1    0   1   0    0    0    C9
(XEN)  0c 000 00  1    0    0   0   0    0    0    00
(XEN)  0d 000 00  1    0    0   0   0    0    0    00
(XEN)  0e 000 00  1    1    0   1   0    0    0    B1
(XEN)  0f 000 00  1    1    0   1   0    0    0    B9
(XEN)  10 000 00  1    0    0   0   0    0    0    00
(XEN)  11 000 00  1    0    0   0   0    0    0    00
(XEN)  12 000 00  1    0    0   0   0    0    0    00
(XEN)  13 000 00  1    0    0   0   0    0    0    00
(XEN)  14 000 00  1    0    0   0   0    0    0    00
(XEN)  15 000 00  1    0    0   0   0    0    0    00
(XEN)  16 000 00  1    0    0   0   0    0    0    00
(XEN)  17 000 00  1    0    0   0   0    0    0    00
(XEN) Using vector-based indexing
(XEN) IRQ to pin mappings:
(XEN) IRQ240 -> 0:2
(XEN) IRQ48 -> 0:1
(XEN) IRQ56 -> 0:3
(XEN) IRQ64 -> 0:4
(XEN) IRQ72 -> 0:5
(XEN) IRQ80 -> 0:6
(XEN) IRQ88 -> 0:7
(XEN) IRQ96 -> 0:8
(XEN) IRQ160 -> 0:20
(XEN) IRQ104 -> 0:10
(XEN) IRQ112 -> 0:11
(XEN) IRQ120 -> 0:12
(XEN) IRQ136 -> 0:13
(XEN) IRQ144 -> 0:14
(XEN) IRQ152 -> 0:15
(XEN) IRQ192 -> 0:16
(XEN) IRQ176 -> 0:17
(XEN) IRQ184 -> 0:18
(XEN) IRQ208 -> 0:19
(XEN) IRQ168 -> 0:20
(XEN) IRQ200 -> 0:21
(XEN) IRQ193 -> 0:22
(XEN) IRQ216 -> 0:23
(XEN) IRQ33 -> 1:5
(XEN) IRQ201 -> 1:11
(XEN) IRQ177 -> 1:14
(XEN) IRQ185 -> 1:15
(XEN) .................................... done.
(XEN) 'q' pressed -> dumping domain info (now=0xCD:FE39AD0F)
(XEN) General information for domain 0:
(XEN)     refcnt=3 dying=0 pause_count=0
(XEN)     nr_pages=11879936 xenheap_pages=6 shared_pages=0 paged_pages=0 dirty_cpus={0-2,4,15,20} max_pages=4294967295
(XEN)     handle=00000000-0000-0000-0000-000000000000 vm_assist=0000000d
(XEN)     watchdog 0 expires in 19 seconds
(XEN) Rangesets belonging to domain 0:
(XEN)     I/O Ports  { 0-1f, 22-3f, 44-60, 62-9f, a2-807, 80c-cfb, d00-ffff }
(XEN)     Interrupts { 1-47, 49-55, 57-65 }
(XEN)     I/O Memory { 0-febff, fec01-fec89, fec8b-fedff, fee01-ffffffffffffffff }
(XEN) Memory pages belonging to domain 0:
(XEN)     DomPage list too long to display
(XEN)     XenPage 000000000043b3bd: caf=c000000000000002, taf=7400000000000002
(XEN)     XenPage 000000000043b3bc: caf=c000000000000001, taf=7400000000000001
(XEN)     XenPage 000000000043b3bb: caf=c000000000000001, taf=7400000000000001
(XEN)     XenPage 000000000043b3ba: caf=c000000000000001, taf=7400000000000001
(XEN)     XenPage 000000000003f2f7: caf=c000000000000002, taf=7400000000000002
(XEN)     XenPage 0000000000467151: caf=c000000000000002, taf=7400000000000002
(XEN) VCPU information and callbacks for domain 0:
(XEN)     VCPU0: CPU0 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={0} cpu_affinity={0}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU1: CPU1 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={1} cpu_affinity={1}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU2: CPU2 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={2} cpu_affinity={2}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU3: CPU3 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={} cpu_affinity={3}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU4: CPU4 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={4} cpu_affinity={4}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU5: CPU5 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={} cpu_affinity={5}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU6: CPU6 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={} cpu_affinity={6}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU7: CPU7 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={} cpu_affinity={7}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU8: CPU8 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={} cpu_affinity={8}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU9: CPU9 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={} cpu_affinity={9}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU10: CPU10 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={} cpu_affinity={10}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU11: CPU11 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={} cpu_affinity={11}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU12: CPU12 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={} cpu_affinity={12}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU13: CPU13 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={} cpu_affinity={13}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU14: CPU14 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={} cpu_affinity={14}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU15: CPU15 [has=T] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={15} cpu_affinity={15}
(XEN)     pause_count=0 pause_flags=0
(XEN)     No periodic timer
(XEN)     VCPU16: CPU16 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={} cpu_affinity={16}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU17: CPU17 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={} cpu_affinity={17}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU18: CPU18 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={} cpu_affinity={18}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU19: CPU19 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={} cpu_affinity={19}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU20: CPU20 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={20} cpu_affinity={20}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU21: CPU21 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={} cpu_affinity={21}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU22: CPU22 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={} cpu_affinity={22}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN)     VCPU23: CPU23 [has=F] poll=0 upcall_pend = 00, upcall_mask = 00 dirty_cpus={} cpu_affinity={23}
(XEN)     pause_count=0 pause_flags=1
(XEN)     No periodic timer
(XEN) Notifying guest 0:0 (virq 1, port 4, stat 0/0/0)
(XEN) Notifying guest 0:1 (virq 1, port 10, stat 0/0/0)
(XEN) Notifying guest 0:2 (virq 1, port 16, stat 0/0/0)
(XEN) Notifying guest 0:3 (virq 1, port 22, stat 0/0/0)
(XEN) Notifying guest 0:4 (virq 1, port 28, stat 0/0/0)
(XEN) Notifying guest 0:5 (virq 1, port 34, stat 0/0/0)
(XEN) Notifying guest 0:6 (virq 1, port 40, stat 0/0/0)
(XEN) Notifying guest 0:7 (virq 1, port 46, stat 0/0/0)
(XEN) Notifying guest 0:8 (virq 1, port 52, stat 0/0/0)
(XEN) Notifying guest 0:9 (virq 1, port 58, stat 0/0/0)
(XEN) Notifying guest 0:10 (virq 1, port 64, stat 0/0/0)
(XEN) Notifying guest 0:11 (virq 1, port 70, stat 0/0/0)
(XEN) Notifying guest 0:12 (virq 1, port 76, stat 0/0/0)
(XEN) Notifying guest 0:13 (virq 1, port 82, stat 0/0/0)
(XEN) Notifying guest 0:14 (virq 1, port 88, stat 0/0/0)
(XEN) Notifying guest 0:15 (virq 1, port 94, stat 0/0/0)
(XEN) Notifying guest 0:16 (virq 1, port 100, stat 0/0/0)
(XEN) Notifying guest 0:17 (virq 1, port 106, stat 0/0/0)
(XEN) Notifying guest 0:18 (virq 1, port 112, stat 0/0/0)
(XEN) Notifying guest 0:19 (virq 1, port 118, stat 0/0/0)
(XEN) Notifying guest 0:20 (virq 1, port 124, stat 0/0/0)
(XEN) Notifying guest 0:21 (virq 1, port 130, stat 0/0/0)
(XEN) Notifying guest 0:22 (virq 1, port 136, stat 0/0/0)
(XEN) Notifying guest 0:23 (virq 1, port 142, stat 0/0/0)
(XEN) Shared frames 0 -- Saved frames 0

[-- Attachment #4: xend.log --]
[-- Type: text/plain, Size: 58299 bytes --]

[2013-05-17 20:12:17 6427] INFO (SrvDaemon:339) Xend Daemon started
[2013-05-17 20:12:17 6428] INFO (SrvDaemon:339) Xend Daemon started
[2013-05-17 20:12:17 6427] INFO (SrvDaemon:343) Xend changeset: unavailable.
[2013-05-17 20:12:17 6428] INFO (SrvDaemon:343) Xend changeset: unavailable.
[2013-05-17 20:12:17 6428] ERROR (SrvDaemon:356) Exception starting xend ([Errno 2] No such file or directory: '/var/lib/xend/relocation-socket')
Traceback (most recent call last):
  File "/usr/lib64/python2.6/site-packages/xen/xend/server/SrvDaemon.py", line 346, in run
    relocate.listenRelocation()
  File "/usr/lib64/python2.6/site-packages/xen/xend/server/relocate.py", line 146, in listenRelocation
    unix.UnixListener(path, RelocationProtocol)
  File "/usr/lib64/python2.6/site-packages/xen/web/unix.py", line 50, in __init__
    connection.SocketListener.__init__(self, protocol_class)
  File "/usr/lib64/python2.6/site-packages/xen/web/connection.py", line 89, in __init__
    self.sock = self.createSocket()
  File "/usr/lib64/python2.6/site-packages/xen/web/unix.py", line 54, in createSocket
    return bind(self.path, socket.SOCK_STREAM)
  File "/usr/lib64/python2.6/site-packages/xen/web/unix.py", line 40, in bind
    os.unlink(path)
OSError: [Errno 2] No such file or directory: '/var/lib/xend/relocation-socket'
[2013-05-17 20:12:21 6427] DEBUG (XendNode:332) pscsi record count: 3
[2013-05-17 20:12:21 6427] DEBUG (XendCPUPool:747) recreate_active_pools
[2013-05-17 20:12:22 6427] DEBUG (XendDomainInfo:151) XendDomainInfo.recreate({'max_vcpu_id': 23, 'cpu_time': 81890549726L, 'ssidref': 0, 'hvm': 0, 'shutdown_reason': 255, 'dying': 0, 'online_vcpus': 24, 'domid': 0, 'paused': 0, 'crashed': 0, 'running': 1, 'maxmem_kb': 17179869180L, 'shutdown': 0, 'mem_kb': 49538256L, 'blocked': 0, 'handle': [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], 'cpupool': 0, 'name': 'Domain-0'})
[2013-05-17 20:12:22 6427] INFO (XendDomainInfo:169) Recreating domain 0, UUID 00000000-0000-0000-0000-000000000000. at /local/domain/0
[2013-05-17 20:12:22 6427] DEBUG (XendDomainInfo:3426) Storing VM details: {'on_xend_stop': 'ignore', 'pool_name': 'Pool-0', 'shadow_memory': '0', 'uuid': '00000000-0000-0000-0000-000000000000', 'on_reboot': 'restart', 'image': "(linux (kernel '') (superpages 0) (nomigrate 0) (tsc_mode 0))", 'on_poweroff': 'destroy', 'bootloader_args': '', 'on_xend_start': 'ignore', 'on_crash': 'restart', 'xend/restart_count': '0', 'vcpus': '24', 'vcpu_avail': '16777215', 'bootloader': '', 'name': 'Domain-0'}
[2013-05-17 20:12:22 6427] DEBUG (XendDomainInfo:1795) Storing domain details: {'cpu/3/availability': 'online', 'cpu/6/availability': 'online', 'vm': '/vm/00000000-0000-0000-0000-000000000000', 'cpu/22/availability': 'online', 'control/platform-feature-multiprocessor-suspend': '1', 'cpu/17/availability': 'online', 'cpu/14/availability': 'online', 'console/limit': '1048576', 'cpu/2/availability': 'online', 'cpu/11/availability': 'online', 'cpu/1/availability': 'online', 'cpu/7/availability': 'online', 'memory/target': '49538256', 'cpu/20/availability': 'online', 'control/platform-feature-xs_reset_watches': '1', 'cpu/15/availability': 'online', 'description': '', 'cpu/13/availability': 'online', 'cpu/8/availability': 'online', 'cpu/9/availability': 'online', 'cpu/5/availability': 'online', 'cpu/23/availability': 'online', 'cpu/0/availability': 'online', 'cpu/18/availability': 'online', 'console/type': 'xenconsoled', 'cpu/12/availability': 'online', 'cpu/19/availability': 'online', 'name': 'Domain-0', 'domid': '0', 'cpu/4/availability': 'online', 'cpu/16/availability': 'online', 'cpu/21/availability': 'online', 'cpu/10/availability': 'online'}
[2013-05-17 20:12:22 6427] DEBUG (XendDomain:476) Adding Domain: 0
[2013-05-17 20:12:22 6427] DEBUG (XendDomainInfo:1882) XendDomainInfo.handleShutdownWatch
[2013-05-17 20:12:22 6427] DEBUG (XendDomain:410) number of vcpus to use is 0
[2013-05-17 20:12:23 6427] ERROR (XendDomain:365) Unable to open or parse config.sxp: /var/lib/xend/domains/28a98319-ac01-69f7-e817-bb913b349fb4/config.sxp
Traceback (most recent call last):
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomain.py", line 356, in _managed_domains
    cfg = XendConfig.XendConfig(filename = cfg_file)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendConfig.py", line 355, in __init__
    self._sxp_to_xapi(sxp_obj)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendConfig.py", line 882, in _sxp_to_xapi
    cfg = self._parse_sxp(sxp_cfg)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendConfig.py", line 745, in _parse_sxp
    self.device_add(dev_type, cfg_sxp = config, target = cfg)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendConfig.py", line 1442, in device_add
    vusb_dict = self.vusb_convert_sxp_to_dict(config)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendConfig.py", line 1876, in vusb_convert_sxp_to_dict
    for port in ports[1:]:
TypeError: 'NoneType' object is unsubscriptable
[2013-05-17 20:12:23 6427] INFO (SrvServer:184) unix path=/var/lib/xend/xend-socket
[2013-05-17 20:12:23 6427] WARNING (XendAPI:708) API call: VBD.set_device not found
[2013-05-17 20:12:23 6427] WARNING (XendAPI:708) API call: VBD.set_type not found
[2013-05-17 20:12:23 6427] WARNING (XendAPI:708) API call: session.get_all_records not found
[2013-05-17 20:12:23 6427] WARNING (XendAPI:708) API call: event.get_record not found
[2013-05-17 20:12:23 6427] WARNING (XendAPI:708) API call: event.get_all not found
[2013-05-17 20:12:23 6427] WARNING (XendAPI:708) API call: VIF.set_device not found
[2013-05-17 20:12:23 6427] WARNING (XendAPI:708) API call: VIF.set_MAC not found
[2013-05-17 20:12:23 6427] WARNING (XendAPI:708) API call: VIF.set_MTU not found
[2013-05-17 20:12:23 6427] WARNING (XendAPI:708) API call: debug.get_all not found
[2013-05-17 20:12:23 6427] INFO (XMLRPCServer:161) Opening Unix domain socket XML-RPC server on /var/run/xend/xen-api.sock; authentication has been disabled for this server.
[2013-05-17 20:12:23 6427] INFO (XMLRPCServer:161) Opening Unix domain socket XML-RPC server on /var/run/xend/xmlrpc.sock.
[2013-05-17 20:16:19 21275] INFO (SrvDaemon:339) Xend Daemon started
[2013-05-17 20:16:19 21275] INFO (SrvDaemon:343) Xend changeset: unavailable.
[2013-05-17 20:16:20 21275] DEBUG (XendNode:332) pscsi record count: 3
[2013-05-17 20:16:20 21275] DEBUG (XendCPUPool:747) recreate_active_pools
[2013-05-17 20:16:20 21275] DEBUG (XendDomainInfo:151) XendDomainInfo.recreate({'max_vcpu_id': 23, 'cpu_time': 139004174713L, 'ssidref': 0, 'hvm': 0, 'shutdown_reason': 255, 'dying': 0, 'online_vcpus': 24, 'domid': 0, 'paused': 0, 'crashed': 0, 'running': 1, 'maxmem_kb': 17179869180L, 'shutdown': 0, 'mem_kb': 49538256L, 'blocked': 0, 'handle': [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], 'cpupool': 0, 'name': 'Domain-0'})
[2013-05-17 20:16:20 21275] INFO (XendDomainInfo:169) Recreating domain 0, UUID 00000000-0000-0000-0000-000000000000. at /local/domain/0
[2013-05-17 20:16:20 21275] DEBUG (XendDomain:476) Adding Domain: 0
[2013-05-17 20:16:20 21275] DEBUG (XendDomain:410) number of vcpus to use is 0
[2013-05-17 20:16:20 21275] DEBUG (XendDomainInfo:1882) XendDomainInfo.handleShutdownWatch
[2013-05-17 20:16:20 21275] ERROR (XendDomain:365) Unable to open or parse config.sxp: /var/lib/xend/domains/28a98319-ac01-69f7-e817-bb913b349fb4/config.sxp
Traceback (most recent call last):
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomain.py", line 356, in _managed_domains
    cfg = XendConfig.XendConfig(filename = cfg_file)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendConfig.py", line 355, in __init__
    self._sxp_to_xapi(sxp_obj)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendConfig.py", line 882, in _sxp_to_xapi
    cfg = self._parse_sxp(sxp_cfg)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendConfig.py", line 745, in _parse_sxp
    self.device_add(dev_type, cfg_sxp = config, target = cfg)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendConfig.py", line 1442, in device_add
    vusb_dict = self.vusb_convert_sxp_to_dict(config)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendConfig.py", line 1876, in vusb_convert_sxp_to_dict
    for port in ports[1:]:
TypeError: 'NoneType' object is unsubscriptable
[2013-05-17 20:16:20 21275] INFO (SrvServer:184) unix path=/var/lib/xend/xend-socket
[2013-05-17 20:16:20 21275] WARNING (XendAPI:708) API call: VBD.set_device not found
[2013-05-17 20:16:20 21275] WARNING (XendAPI:708) API call: VBD.set_type not found
[2013-05-17 20:16:20 21275] WARNING (XendAPI:708) API call: session.get_all_records not found
[2013-05-17 20:16:20 21275] WARNING (XendAPI:708) API call: event.get_record not found
[2013-05-17 20:16:20 21275] WARNING (XendAPI:708) API call: event.get_all not found
[2013-05-17 20:16:20 21275] WARNING (XendAPI:708) API call: VIF.set_device not found
[2013-05-17 20:16:20 21275] WARNING (XendAPI:708) API call: VIF.set_MAC not found
[2013-05-17 20:16:20 21275] WARNING (XendAPI:708) API call: VIF.set_MTU not found
[2013-05-17 20:16:20 21275] WARNING (XendAPI:708) API call: debug.get_all not found
[2013-05-17 20:16:20 21275] INFO (XMLRPCServer:161) Opening Unix domain socket XML-RPC server on /var/run/xend/xen-api.sock; authentication has been disabled for this server.
[2013-05-17 20:16:20 21275] INFO (XMLRPCServer:161) Opening Unix domain socket XML-RPC server on /var/run/xend/xmlrpc.sock.
[2013-05-17 20:19:57 21275] DEBUG (XendDomainInfo:103) XendDomainInfo.create(['vm', ['name', 'edi'], ['memory', '2048'], ['maxmem', '2048'], ['vcpus', '8'], ['cpus', '0-7'], ['uuid', 'c413e3f2-98ae-7883-03a2-453cbb100a9a'], ['on_poweroff', 'destroy'], ['on_reboot', 'restart'], ['on_crash', 'restart'], ['image', ['hvm', ['kernel', '/usr/lib/xen/boot/hvmloader'], ['vcpus', '8'], ['boot', 'c'], ['acpi', '1'], ['apic', '1'], ['pae', '1'], ['usb', '1'], ['usbdevice', 'tablet'], ['parallel', 'none'], ['serial', 'pty'], ['soundhw', 'es1370'], ['device_model', '/usr/lib64/xen/bin/qemu-dm'], ['vnc', '1'], ['vncunused', '1'], ['keymap', 'en-gb'], ['rtc_timeoffset', '0'], ['localtime', '1']]], ['localtime', '1'], ['device', ['vbd', ['dev', 'hda:disk'], ['uname', 'phy:/dev/disk/by-path/ip-10.2.0.10:3260-iscsi-iqn.2013-02.net.shatteredsilicon:legion-lun-0'], ['mode', 'w']]]])
[2013-05-17 20:19:57 21275] DEBUG (XendDomainInfo:2499) XendDomainInfo.constructDomain
[2013-05-17 20:19:57 21275] DEBUG (balloon:187) Balloon: 131000 KiB free; need 16384; done.
[2013-05-17 20:19:57 21275] DEBUG (XendDomain:476) Adding Domain: 1
[2013-05-17 20:19:57 21275] DEBUG (XendDomainInfo:2842) XendDomainInfo.initDomain: 1 256
[2013-05-17 20:19:57 21275] DEBUG (image:343) No VNC passwd configured for vfb access
[2013-05-17 20:19:57 21275] DEBUG (image:895) args: boot, val: c
[2013-05-17 20:19:57 21275] DEBUG (image:895) args: fda, val: None
[2013-05-17 20:19:57 21275] DEBUG (image:895) args: fdb, val: None
[2013-05-17 20:19:57 21275] DEBUG (image:895) args: soundhw, val: es1370
[2013-05-17 20:19:57 21275] DEBUG (image:895) args: localtime, val: 1
[2013-05-17 20:19:57 21275] DEBUG (image:895) args: serial, val: ['pty']
[2013-05-17 20:19:57 21275] DEBUG (image:895) args: std-vga, val: None
[2013-05-17 20:19:57 21275] DEBUG (image:895) args: isa, val: None
[2013-05-17 20:19:57 21275] DEBUG (image:895) args: acpi, val: 1
[2013-05-17 20:19:57 21275] DEBUG (image:895) args: usb, val: 1
[2013-05-17 20:19:57 21275] DEBUG (image:895) args: usbdevice, val: tablet
[2013-05-17 20:19:57 21275] DEBUG (image:895) args: gfx_passthru, val: None
[2013-05-17 20:19:57 21275] INFO (image:826) Need to create platform device.[domid:1]
[2013-05-17 20:19:57 21275] DEBUG (XendDomainInfo:2869) _initDomain:shadow_memory=0x0, memory_static_max=0x80000000, memory_static_min=0x0.
[2013-05-17 20:19:57 21275] DEBUG (balloon:172) Balloon: tmem relinquished -1 KiB of 2007780 KiB requested.
[2013-05-17 20:19:57 21275] DEBUG (balloon:193) Balloon: 126236 KiB free; 0 to scrub; need 2134016; retries: 25.
[2013-05-17 20:19:57 21275] DEBUG (balloon:207) Balloon: setting dom0 target to 46416 MiB.
[2013-05-17 20:19:57 21275] DEBUG (XendDomainInfo:1467) Setting memory target of domain Domain-0 (0) to 46416 MiB.
[2013-05-17 20:19:57 21275] DEBUG (balloon:193) Balloon: 431388 KiB free; 0 to scrub; need 2134016; retries: 30.
[2013-05-17 20:19:57 21275] DEBUG (balloon:207) Balloon: setting dom0 target to 46406 MiB.
[2013-05-17 20:19:57 21275] DEBUG (XendDomainInfo:1467) Setting memory target of domain Domain-0 (0) to 46406 MiB.
[2013-05-17 20:19:57 21275] DEBUG (balloon:193) Balloon: 1113372 KiB free; 0 to scrub; need 2134016; retries: 30.
[2013-05-17 20:19:58 21275] INFO (image:186) buildDomain os=hvm dom=1 vcpus=8
[2013-05-17 20:19:58 21275] DEBUG (image:954) domid          = 1
[2013-05-17 20:19:58 21275] DEBUG (image:955) image          = /usr/lib/xen/boot/hvmloader
[2013-05-17 20:19:58 21275] DEBUG (image:956) store_evtchn   = 10
[2013-05-17 20:19:58 21275] DEBUG (image:957) memsize        = 2048
[2013-05-17 20:19:58 21275] DEBUG (image:958) target         = 2048
[2013-05-17 20:19:58 21275] DEBUG (image:959) vcpus          = 8
[2013-05-17 20:19:58 21275] DEBUG (image:960) vcpu_avail     = 255
[2013-05-17 20:19:58 21275] DEBUG (image:961) acpi           = 1
[2013-05-17 20:19:58 21275] DEBUG (image:962) apic           = 1
[2013-05-17 20:19:58 6427] DEBUG (XendDomainInfo:151) XendDomainInfo.recreate({'max_vcpu_id': 7, 'cpu_time': 0L, 'ssidref': 0, 'hvm': 1, 'shutdown_reason': 255, 'dying': 0, 'online_vcpus': 1, 'domid': 1, 'paused': 1, 'crashed': 0, 'running': 0, 'maxmem_kb': 2101248L, 'shutdown': 0, 'mem_kb': 2097056L, 'handle': [196, 19, 227, 242, 152, 174, 120, 131, 3, 162, 69, 60, 187, 16, 10, 154], 'blocked': 0, 'cpupool': 0})
[2013-05-17 20:19:58 6427] INFO (XendDomainInfo:169) Recreating domain 1, UUID c413e3f2-98ae-7883-03a2-453cbb100a9a. at /local/domain/1
[2013-05-17 20:19:58 6427] WARNING (XendDomainInfo:191) /vm/c413e3f2-98ae-7883-03a2-453cbb100a9a/uuid/ is missing. recreate is confused, trying our best to recover
[2013-05-17 20:19:58 6427] DEBUG (XendDomainInfo:3426) Storing VM details: {'on_xend_stop': 'ignore', 'pool_name': 'Pool-0', 'shadow_memory': '0', 'uuid': 'c413e3f2-98ae-7883-03a2-453cbb100a9a', 'on_reboot': 'restart', 'image': "(linux (kernel '') (superpages 0) (nomigrate 0) (tsc_mode 0))", 'on_poweroff': 'destroy', 'bootloader_args': '', 'on_xend_start': 'ignore', 'on_crash': 'restart', 'xend/restart_count': '0', 'vcpus': '8', 'vcpu_avail': '255', 'bootloader': '', 'name': 'Domain-Unnamed'}
[2013-05-17 20:19:58 6427] DEBUG (XendDomainInfo:1795) Storing domain details: {'cpu/3/availability': 'online', 'description': '', 'console/limit': '1048576', 'memory/target': '2097056', 'cpu/2/availability': 'online', 'vm': '/vm/c413e3f2-98ae-7883-03a2-453cbb100a9a', 'domid': '1', 'control/platform-feature-xs_reset_watches': '1', 'cpu/7/availability': 'online', 'cpu/0/availability': 'online', 'cpu/1/availability': 'online', 'cpu/5/availability': 'online', 'control/platform-feature-multiprocessor-suspend': '1', 'cpu/6/availability': 'online', 'console/type': 'xenconsoled', 'cpu/4/availability': 'online', 'name': 'Domain-Unnamed'}
[2013-05-17 20:19:58 6427] DEBUG (XendDomain:476) Adding Domain: 1
[2013-05-17 20:19:58 6427] DEBUG (XendDomainInfo:1882) XendDomainInfo.handleShutdownWatch
[2013-05-17 20:19:58 21275] INFO (XendDomainInfo:2358) createDevice: vfb : {'vncunused': '1', 'keymap': 'en-gb', 'vnc': '1', 'uuid': '148c142f-2a59-6b9d-b171-662488add0a4', 'other_config': {'vncunused': '1', 'keymap': 'en-gb', 'vnc': '1'}}
[2013-05-17 20:19:58 21275] DEBUG (DevController:95) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/vfb/1/0'} to /local/domain/1/device/vfb/0.
[2013-05-17 20:19:58 21275] DEBUG (DevController:97) DevController: writing {'vncunused': '1', 'domain': 'edi', 'frontend': '/local/domain/1/device/vfb/0', 'uuid': '148c142f-2a59-6b9d-b171-662488add0a4', 'frontend-id': '1', 'state': '1', 'keymap': 'en-gb', 'online': '1', 'vnc': '1'} to /local/domain/0/backend/vfb/1/0.
[2013-05-17 20:19:58 21275] INFO (XendDomainInfo:2358) createDevice: vbd : {'uuid': '98d65f8f-a2a4-3a59-13c9-3fdc4b13b42d', 'bootable': 1, 'driver': 'paravirtualised', 'dev': 'hda:disk', 'uname': 'phy:/dev/disk/by-path/ip-10.2.0.10:3260-iscsi-iqn.2013-02.net.shatteredsilicon:legion-lun-0', 'mode': 'w'}
[2013-05-17 20:19:58 21275] DEBUG (DevController:95) DevController: writing {'backend-id': '0', 'virtual-device': '768', 'device-type': 'disk', 'state': '1', 'backend': '/local/domain/0/backend/vbd/1/768'} to /local/domain/1/device/vbd/768.
[2013-05-17 20:19:58 21275] DEBUG (DevController:97) DevController: writing {'domain': 'edi', 'frontend': '/local/domain/1/device/vbd/768', 'uuid': '98d65f8f-a2a4-3a59-13c9-3fdc4b13b42d', 'bootable': '1', 'dev': 'hda', 'state': '1', 'params': '/dev/disk/by-path/ip-10.2.0.10:3260-iscsi-iqn.2013-02.net.shatteredsilicon:legion-lun-0', 'mode': 'w', 'online': '1', 'frontend-id': '1', 'type': 'phy'} to /local/domain/0/backend/vbd/1/768.
[2013-05-17 20:19:58 21275] INFO (image:422) spawning device models: /usr/lib64/xen/bin/qemu-dm ['/usr/lib64/xen/bin/qemu-dm', '-d', '1', '-domain-name', 'edi', '-videoram', '4', '-k', 'en-gb', '-vnc', '127.0.0.1:0', '-vncunused', '-parallel', 'none', '-vcpus', '8', '-vcpu_avail', '0xff', '-boot', 'c', '-soundhw', 'es1370', '-localtime', '-serial', 'pty', '-acpi', '-usb', '-usbdevice', 'tablet', '-net', 'none', '-M', 'xenfv']
[2013-05-17 20:19:58 21275] INFO (image:471) device model pid: 25620
[2013-05-17 20:19:58 21275] INFO (image:594) waiting for sentinel_fifo
[2013-05-17 20:19:58 21275] DEBUG (XendDomainInfo:3426) Storing VM details: {'on_xend_stop': 'ignore', 'pool_name': 'Pool-0', 'shadow_memory': '24', 'uuid': 'c413e3f2-98ae-7883-03a2-453cbb100a9a', 'on_reboot': 'restart', 'start_time': '1368818398.71', 'on_poweroff': 'destroy', 'bootloader_args': '', 'on_xend_start': 'ignore', 'on_crash': 'restart', 'vcpus': '8', 'vcpu_avail': '255', 'bootloader': '', 'image': "(hvm (kernel '') (superpages 0) (hpet 0) (loader /usr/lib/xen/boot/hvmloader) (xen_platform_pci 1) (rtc_timeoffset 0) (parallel none) (pci ()) (localtime 1) (timer_mode 1) (apic 1) (usbdevice tablet) (vpt_align 1) (serial pty) (vncunused 1) (soundhw es1370) (boot c) (pae 1) (viridian 0) (acpi 1) (vnc 1) (nomigrate 0) (usb 1) (tsc_mode 0) (device_model /usr/lib64/xen/bin/qemu-dm) (keymap en-gb) (notes (SUSPEND_CANCEL 1)))", 'name': 'edi'}
[2013-05-17 20:19:58 21275] DEBUG (XendDomainInfo:1795) Storing domain details: {'console/port': '11', 'cpu/3/availability': 'online', 'description': '', 'console/limit': '1048576', 'store/port': '10', 'console/type': 'ioemu', 'cpu/2/availability': 'online', 'vm': '/vm/c413e3f2-98ae-7883-03a2-453cbb100a9a', 'domid': '1', 'control/platform-feature-xs_reset_watches': '1', 'cpu/7/availability': 'online', 'cpu/0/availability': 'online', 'memory/target': '2097152', 'cpu/5/availability': 'online', 'control/platform-feature-multiprocessor-suspend': '1', 'cpu/6/availability': 'online', 'store/ring-ref': '1044476', 'cpu/1/availability': 'online', 'cpu/4/availability': 'online', 'image/suspend-cancel': '1', 'name': 'edi'}
[2013-05-17 20:19:58 21275] DEBUG (DevController:95) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/console/1/0'} to /local/domain/1/device/console/0.
[2013-05-17 20:19:58 21275] DEBUG (DevController:97) DevController: writing {'domain': 'edi', 'frontend': '/local/domain/1/device/console/0', 'uuid': 'b7113309-735d-58ad-6acc-686a4051f1ad', 'frontend-id': '1', 'state': '1', 'location': '11', 'online': '1', 'protocol': 'vt100'} to /local/domain/0/backend/console/1/0.
[2013-05-17 20:19:58 21275] DEBUG (XendDomainInfo:1882) XendDomainInfo.handleShutdownWatch
[2013-05-17 20:19:58 21275] DEBUG (DevController:139) Waiting for devices tap2.
[2013-05-17 20:19:58 21275] DEBUG (DevController:139) Waiting for devices vif.
[2013-05-17 20:19:58 21275] DEBUG (DevController:139) Waiting for devices vkbd.
[2013-05-17 20:19:58 21275] DEBUG (DevController:139) Waiting for devices ioports.
[2013-05-17 20:19:58 21275] DEBUG (DevController:139) Waiting for devices tap.
[2013-05-17 20:19:58 21275] DEBUG (DevController:139) Waiting for devices vif2.
[2013-05-17 20:19:58 21275] DEBUG (DevController:139) Waiting for devices console.
[2013-05-17 20:19:58 21275] DEBUG (DevController:144) Waiting for 0.
[2013-05-17 20:19:58 21275] DEBUG (DevController:139) Waiting for devices vscsi.
[2013-05-17 20:19:58 21275] DEBUG (DevController:139) Waiting for devices vbd.
[2013-05-17 20:19:58 21275] DEBUG (DevController:144) Waiting for 768.
[2013-05-17 20:19:58 21275] DEBUG (DevController:628) hotplugStatusCallback /local/domain/0/backend/vbd/1/768/hotplug-status.
[2013-05-17 20:19:59 21275] DEBUG (DevController:628) hotplugStatusCallback /local/domain/0/backend/vbd/1/768/hotplug-status.
[2013-05-17 20:19:59 21275] DEBUG (DevController:642) hotplugStatusCallback 1.
[2013-05-17 20:19:59 21275] DEBUG (DevController:139) Waiting for devices irq.
[2013-05-17 20:19:59 21275] DEBUG (DevController:139) Waiting for devices vfb.
[2013-05-17 20:19:59 21275] DEBUG (DevController:139) Waiting for devices pci.
[2013-05-17 20:19:59 21275] DEBUG (DevController:139) Waiting for devices vusb.
[2013-05-17 20:19:59 21275] DEBUG (DevController:139) Waiting for devices vtpm.
[2013-05-17 20:19:59 21275] INFO (XendDomain:1225) Domain edi (1) unpaused.
[2013-05-17 20:19:59 21275] DEBUG (XendDomainInfo:260) XendDomainInfo.createDormant({'vcpus_params': {'cap': 0, 'weight': 256}, 'PV_args': '', 'features': '', 'cpus': [[0, 1, 2, 3, 4, 5, 6, 7], [0, 1, 2, 3, 4, 5, 6, 7], [0, 1, 2, 3, 4, 5, 6, 7], [0, 1, 2, 3, 4, 5, 6, 7], [0, 1, 2, 3, 4, 5, 6, 7], [0, 1, 2, 3, 4, 5, 6, 7], [0, 1, 2, 3, 4, 5, 6, 7], [0, 1, 2, 3, 4, 5, 6, 7]], 'use_tmp_kernel': False, 'devices': {'8a62bf3a-8c83-a878-6005-1498b605c975': ('vfb', {'vncunused': '1', 'keymap': 'en-gb', 'vnc': '1', 'uuid': '8a62bf3a-8c83-a878-6005-1498b605c975', 'other_config': {'vncunused': '1', 'keymap': 'en-gb', 'vnc': '1'}}), '0aa3a7b7-5c9c-6bf4-6a12-42ca178c092f': ('vbd', {'uuid': '0aa3a7b7-5c9c-6bf4-6a12-42ca178c092f', 'bootable': 1, 'driver': 'paravirtualised', 'dev': 'hda:disk', 'uname': 'phy:/dev/disk/by-path/ip-10.2.0.10:3260-iscsi-iqn.2013-02.net.shatteredsilicon:legion-lun-0', 'mode': 'w'})}, 'memory_sharing': 0, 'superpages': 0, 'VCPUs_live': 1, 'PV_bootloader': '', 'actions_after_crash': 'restart', 'vbd_refs': ['0aa3a7b7-5c9c-6bf4-6a12-42ca178c092f'], 'PV_ramdisk': '', 'is_control_domain': False, 'name_label': 'edi', 'VCPUs_at_startup': 1, 'HVM_boot_params': {'order': 'c'}, 'platform': {'hpet': 0, 'rtc_timeoffset': '0', 'loader': '/usr/lib/xen/boot/hvmloader', 'serial': 'pty', 'vncunused': '1', 'soundhw': 'es1370', 'boot': 'c', 'parallel': 'none', 'xen_platform_pci': 1, 'pae': '1', 'vpt_align': 1, 'viridian': 0, 'acpi': '1', 'localtime': '1', 'timer_mode': 1, 'vnc': '1', 'apic': '1', 'nomigrate': 0, 'usb': '1', 'tsc_mode': 0, 'usbdevice': 'tablet', 'device_model': '/usr/lib64/xen/bin/qemu-dm', 'keymap': 'en-gb'}, 'PV_kernel': '', 'console_refs': ['8a62bf3a-8c83-a878-6005-1498b605c975'], 'on_xend_stop': 'ignore', 'pool_name': 'Pool-0', 'memory_static_min': 0, 'HVM_boot_policy': 'BIOS order', 'description': '', 'VCPUs_max': 8, 'memory_static_max': 2147483648, 'actions_after_shutdown': 'destroy', 'use_tmp_ramdisk': False, 'on_xend_start': 'ignore', 'memory_dynamic_max': 2147483648, 'actions_after_suspend': '', 'is_a_template': False, 'PV_bootloader_args': '', 'memory_dynamic_min': 2147483648, 'uuid': 'c413e3f2-98ae-7883-03a2-453cbb100a9a', 'shadow_memory': 0, 'target': 0, 'vcpu_avail': 255, 'other_config': {}, 'auto_power_on': False, 'actions_after_reboot': 'restart', 'Description': '', 'vif_refs': [], 'vtpm_refs': []})
[2013-05-17 20:19:59 21275] DEBUG (XendDomain:1036) Creating new managed domain: edi
[2013-05-17 20:20:02 21275] DEBUG (XendDomainInfo:3077) XendDomainInfo.destroy: domid=1
[2013-05-17 20:20:02 21275] DEBUG (XendDomainInfo:2402) Destroying device model
[2013-05-17 20:20:02 6427] DEBUG (DevController:95) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/console/1/1'} to /local/domain/1/device/console/1.
[2013-05-17 20:20:02 6427] DEBUG (DevController:97) DevController: writing {'domain': 'edi', 'frontend': '/local/domain/1/device/console/1', 'uuid': '4c104521-0b66-c7db-11f2-b695f7925423', 'frontend-id': '1', 'state': '1', 'location': '11', 'online': '1', 'protocol': 'vt100'} to /local/domain/0/backend/console/1/1.
[2013-05-17 20:20:02 6427] DEBUG (XendDomainInfo:2402) Destroying device model
[2013-05-17 20:20:02 6427] DEBUG (XendDomainInfo:2409) Releasing devices
[2013-05-17 20:20:02 6427] DEBUG (XendDomainInfo:2415) Removing console/0
[2013-05-17 20:20:02 6427] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = console, device = console/0
[2013-05-17 20:20:02 6427] DEBUG (XendDomainInfo:2415) Removing console/1
[2013-05-17 20:20:02 6427] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = console, device = console/1
[2013-05-17 20:20:02 6427] DEBUG (XendDomainInfo:2415) Removing vbd/768
[2013-05-17 20:20:02 6427] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768
[2013-05-17 20:20:02 6427] DEBUG (XendDomainInfo:2415) Removing vfb/0
[2013-05-17 20:20:02 6427] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = vfb, device = vfb/0
[2013-05-17 20:20:02 21275] INFO (image:619) edi device model terminated
[2013-05-17 20:20:02 21275] DEBUG (XendDomainInfo:2409) Releasing devices
[2013-05-17 20:20:02 21275] DEBUG (XendDomainInfo:2415) Removing vbd/768
[2013-05-17 20:20:02 21275] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768
[2013-05-17 20:20:02 21275] DEBUG (XendDomainInfo:2407) No device model
[2013-05-17 20:20:02 21275] DEBUG (XendDomainInfo:2409) Releasing devices
[2013-05-17 20:20:02 21275] DEBUG (XendDomainInfo:2415) Removing vbd/768
[2013-05-17 20:20:02 21275] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768
[2013-05-17 20:20:38 21275] DEBUG (XendDomainInfo:893) XendDomainInfo.pci_device_configure: ['pci', ['dev', ['slot', '0x1a'], ['domain', '0x0000'], ['key', '0000:00:1a.0'], ['bus', '0x00'], ['vdevfn', '0x100'], ['func', '0x0']], ['state', 'Initialising']]
[2013-05-17 20:20:38 21275] DEBUG (XendDomainInfo:664) XendDomainInfo.hvm_pci_device_create: {'devs': [{'slot': '0x1a', 'domain': '0x0000', 'key': '0000:00:1a.0', 'bus': '0x00', 'vdevfn': '0x100', 'func': '0x0', 'uuid': 'c6eb8170-d594-8de7-4631-dbb660784e13'}], 'states': ['Initialising']}
[2013-05-17 20:20:38 21275] DEBUG (XendDomainInfo:790) XendDomainInfo.hvm_pci_device_insert_dev: {'slot': '0x1a', 'domain': '0x0000', 'key': '0000:00:1a.0', 'bus': '0x00', 'vdevfn': '0x100', 'func': '0x0', 'uuid': 'c6eb8170-d594-8de7-4631-dbb660784e13'}
[2013-05-17 20:20:38 21275] DEBUG (XendDomainInfo:838) XendDomainInfo.device_create: ['pci', ['dev', ['slot', '0x1a'], ['domain', '0x0000'], ['key', '0000:00:1a.0'], ['bus', '0x00'], ['vdevfn', '0x100'], ['func', '0x0']], ['state', 'Initialising']]
[2013-05-17 20:20:38 21275] DEBUG (XendDomainInfo:850) XendDomainInfo.device_create: {'devs': [{'slot': '0x1a', 'domain': '0x0000', 'key': '0000:00:1a.0', 'bus': '0x00', 'vdevfn': '0x100', 'func': '0x0', 'uuid': '72c3c556-cf34-9100-323f-aebbee9b643b'}], 'uuid': '56eb6d09-ec52-69bd-4c93-524d4d8b161e'}
[2013-05-17 20:20:44 21275] DEBUG (XendDomainInfo:893) XendDomainInfo.pci_device_configure: ['pci', ['dev', ['slot', '0x1b'], ['domain', '0x0000'], ['key', '0000:00:1b.0'], ['bus', '0x00'], ['vdevfn', '0x100'], ['func', '0x0']], ['state', 'Initialising']]
[2013-05-17 20:20:44 21275] DEBUG (XendDomainInfo:664) XendDomainInfo.hvm_pci_device_create: {'devs': [{'slot': '0x1b', 'domain': '0x0000', 'key': '0000:00:1b.0', 'bus': '0x00', 'vdevfn': '0x100', 'func': '0x0', 'uuid': '2668a187-efd1-ea4a-2b4b-6b04a0805d05'}], 'states': ['Initialising']}
[2013-05-17 20:20:44 21275] DEBUG (XendDomainInfo:790) XendDomainInfo.hvm_pci_device_insert_dev: {'slot': '0x1b', 'domain': '0x0000', 'key': '0000:00:1b.0', 'bus': '0x00', 'vdevfn': '0x100', 'func': '0x0', 'uuid': '2668a187-efd1-ea4a-2b4b-6b04a0805d05'}
[2013-05-17 20:20:49 21275] DEBUG (XendDomainInfo:893) XendDomainInfo.pci_device_configure: ['pci', ['dev', ['slot', '0x1d'], ['domain', '0x0000'], ['key', '0000:00:1d.2'], ['bus', '0x00'], ['vdevfn', '0x100'], ['func', '0x2']], ['state', 'Initialising']]
[2013-05-17 20:20:49 21275] DEBUG (XendDomainInfo:664) XendDomainInfo.hvm_pci_device_create: {'devs': [{'slot': '0x1d', 'domain': '0x0000', 'key': '0000:00:1d.2', 'bus': '0x00', 'vdevfn': '0x100', 'func': '0x2', 'uuid': 'bdbaa2d9-c997-b61a-a053-fe293741823b'}], 'states': ['Initialising']}
[2013-05-17 20:20:49 21275] DEBUG (XendDomainInfo:790) XendDomainInfo.hvm_pci_device_insert_dev: {'slot': '0x1d', 'domain': '0x0000', 'key': '0000:00:1d.2', 'bus': '0x00', 'vdevfn': '0x100', 'func': '0x2', 'uuid': 'bdbaa2d9-c997-b61a-a053-fe293741823b'}
[2013-05-17 20:20:54 21275] DEBUG (XendDomainInfo:893) XendDomainInfo.pci_device_configure: ['pci', ['dev', ['slot', '0x00'], ['domain', '0x0000'], ['key', '0000:02:00.0'], ['bus', '0x02'], ['vdevfn', '0x100'], ['func', '0x0']], ['state', 'Initialising']]
[2013-05-17 20:20:54 21275] DEBUG (XendDomainInfo:664) XendDomainInfo.hvm_pci_device_create: {'devs': [{'slot': '0x00', 'domain': '0x0000', 'key': '0000:02:00.0', 'bus': '0x02', 'vdevfn': '0x100', 'func': '0x0', 'uuid': '558139bc-c397-fc4d-6a4a-b422adaf10b2'}], 'states': ['Initialising']}
[2013-05-17 20:20:54 21275] DEBUG (XendDomainInfo:790) XendDomainInfo.hvm_pci_device_insert_dev: {'slot': '0x00', 'domain': '0x0000', 'key': '0000:02:00.0', 'bus': '0x02', 'vdevfn': '0x100', 'func': '0x0', 'uuid': '558139bc-c397-fc4d-6a4a-b422adaf10b2'}
[2013-05-17 20:21:00 21275] DEBUG (XendDomainInfo:893) XendDomainInfo.pci_device_configure: ['pci', ['dev', ['slot', '0x00'], ['domain', '0x0000'], ['key', '0000:07:00.0'], ['bus', '0x07'], ['vdevfn', '0x100'], ['func', '0x0']], ['state', 'Initialising']]
[2013-05-17 20:21:00 21275] DEBUG (XendDomainInfo:664) XendDomainInfo.hvm_pci_device_create: {'devs': [{'slot': '0x00', 'domain': '0x0000', 'key': '0000:07:00.0', 'bus': '0x07', 'vdevfn': '0x100', 'func': '0x0', 'uuid': '801a7d40-adb9-65e3-3394-7aa7b3a8d53f'}], 'states': ['Initialising']}
[2013-05-17 20:21:00 21275] DEBUG (XendDomainInfo:790) XendDomainInfo.hvm_pci_device_insert_dev: {'slot': '0x00', 'domain': '0x0000', 'key': '0000:07:00.0', 'bus': '0x07', 'vdevfn': '0x100', 'func': '0x0', 'uuid': '801a7d40-adb9-65e3-3394-7aa7b3a8d53f'}
[2013-05-17 20:21:02 21275] DEBUG (XendDomainInfo:893) XendDomainInfo.pci_device_configure: ['pci', ['dev', ['slot', '0x00'], ['domain', '0x0000'], ['key', '0000:07:00.1'], ['bus', '0x07'], ['vdevfn', '0x100'], ['func', '0x1']], ['state', 'Initialising']]
[2013-05-17 20:21:02 21275] DEBUG (XendDomainInfo:664) XendDomainInfo.hvm_pci_device_create: {'devs': [{'slot': '0x00', 'domain': '0x0000', 'key': '0000:07:00.1', 'bus': '0x07', 'vdevfn': '0x100', 'func': '0x1', 'uuid': '72cea209-b65d-fb3e-f3ea-deeeeb6ff710'}], 'states': ['Initialising']}
[2013-05-17 20:21:02 21275] DEBUG (XendDomainInfo:790) XendDomainInfo.hvm_pci_device_insert_dev: {'slot': '0x00', 'domain': '0x0000', 'key': '0000:07:00.1', 'bus': '0x07', 'vdevfn': '0x100', 'func': '0x1', 'uuid': '72cea209-b65d-fb3e-f3ea-deeeeb6ff710'}
[2013-05-17 20:21:19 21275] DEBUG (SrvDomain:76) Starting domain edi False
[2013-05-17 20:21:19 21275] DEBUG (XendDomainInfo:2499) XendDomainInfo.constructDomain
[2013-05-17 20:21:19 21275] DEBUG (balloon:187) Balloon: 2149504 KiB free; need 16384; done.
[2013-05-17 20:21:19 21275] DEBUG (XendDomain:476) Adding Domain: 2
[2013-05-17 20:21:19 21275] DEBUG (XendDomainInfo:2842) XendDomainInfo.initDomain: 2 256
[2013-05-17 20:21:19 21275] DEBUG (image:343) No VNC passwd configured for vfb access
[2013-05-17 20:21:19 21275] DEBUG (image:895) args: boot, val: c
[2013-05-17 20:21:19 21275] DEBUG (image:895) args: fda, val: None
[2013-05-17 20:21:19 21275] DEBUG (image:895) args: fdb, val: None
[2013-05-17 20:21:19 21275] DEBUG (image:895) args: soundhw, val: es1370
[2013-05-17 20:21:19 21275] DEBUG (image:895) args: localtime, val: 1
[2013-05-17 20:21:19 21275] DEBUG (image:895) args: serial, val: ['pty']
[2013-05-17 20:21:19 21275] DEBUG (image:895) args: std-vga, val: None
[2013-05-17 20:21:19 21275] DEBUG (image:895) args: isa, val: None
[2013-05-17 20:21:19 21275] DEBUG (image:895) args: acpi, val: 1
[2013-05-17 20:21:19 21275] DEBUG (image:895) args: usb, val: 1
[2013-05-17 20:21:19 21275] DEBUG (image:895) args: usbdevice, val: tablet
[2013-05-17 20:21:19 21275] DEBUG (image:895) args: gfx_passthru, val: None
[2013-05-17 20:21:19 21275] INFO (image:826) Need to create platform device.[domid:2]
[2013-05-17 20:21:20 21275] DEBUG (XendDomainInfo:2869) _initDomain:shadow_memory=0x0, memory_static_max=0x80000000, memory_static_min=0x0.
[2013-05-17 20:21:20 21275] INFO (image:186) buildDomain os=hvm dom=2 vcpus=8
[2013-05-17 20:21:20 21275] DEBUG (image:954) domid          = 2
[2013-05-17 20:21:20 21275] DEBUG (image:955) image          = /usr/lib/xen/boot/hvmloader
[2013-05-17 20:21:20 21275] DEBUG (image:956) store_evtchn   = 10
[2013-05-17 20:21:20 21275] DEBUG (image:957) memsize        = 2048
[2013-05-17 20:21:20 21275] DEBUG (image:958) target         = 2048
[2013-05-17 20:21:20 21275] DEBUG (image:959) vcpus          = 8
[2013-05-17 20:21:20 21275] DEBUG (image:960) vcpu_avail     = 255
[2013-05-17 20:21:20 21275] DEBUG (image:961) acpi           = 1
[2013-05-17 20:21:20 21275] DEBUG (image:962) apic           = 1
[2013-05-17 20:21:20 6427] DEBUG (XendDomainInfo:151) XendDomainInfo.recreate({'max_vcpu_id': 7, 'cpu_time': 0L, 'ssidref': 0, 'hvm': 1, 'shutdown_reason': 255, 'dying': 0, 'online_vcpus': 1, 'domid': 2, 'paused': 1, 'crashed': 0, 'running': 0, 'maxmem_kb': 2101248L, 'shutdown': 0, 'mem_kb': 2097056L, 'handle': [196, 19, 227, 242, 152, 174, 120, 131, 3, 162, 69, 60, 187, 16, 10, 154], 'blocked': 0, 'cpupool': 0})
[2013-05-17 20:21:20 6427] INFO (XendDomainInfo:169) Recreating domain 2, UUID c413e3f2-98ae-7883-03a2-453cbb100a9a. at /local/domain/2
[2013-05-17 20:21:20 6427] WARNING (XendDomainInfo:191) /vm/c413e3f2-98ae-7883-03a2-453cbb100a9a-1/uuid/ is missing. recreate is confused, trying our best to recover
[2013-05-17 20:21:20 21275] INFO (XendDomainInfo:2358) createDevice: vfb : {'vncunused': '1', 'keymap': 'en-gb', 'vnc': '1', 'uuid': '8a62bf3a-8c83-a878-6005-1498b605c975', 'other_config': {'vncunused': '1', 'keymap': 'en-gb', 'vnc': '1'}}
[2013-05-17 20:21:20 6427] DEBUG (XendDomainInfo:3426) Storing VM details: {'on_xend_stop': 'ignore', 'pool_name': 'Pool-0', 'shadow_memory': '0', 'uuid': 'c413e3f2-98ae-7883-03a2-453cbb100a9a', 'on_reboot': 'restart', 'image': "(linux (kernel '') (superpages 0) (nomigrate 0) (tsc_mode 0))", 'on_poweroff': 'destroy', 'bootloader_args': '', 'on_xend_start': 'ignore', 'on_crash': 'restart', 'xend/restart_count': '0', 'vcpus': '8', 'vcpu_avail': '255', 'bootloader': '', 'name': 'Domain-Unnamed'}
[2013-05-17 20:21:20 21275] DEBUG (DevController:95) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/vfb/2/0'} to /local/domain/2/device/vfb/0.
[2013-05-17 20:21:20 21275] DEBUG (DevController:97) DevController: writing {'vncunused': '1', 'domain': 'edi', 'frontend': '/local/domain/2/device/vfb/0', 'uuid': '8a62bf3a-8c83-a878-6005-1498b605c975', 'frontend-id': '2', 'state': '1', 'keymap': 'en-gb', 'online': '1', 'vnc': '1'} to /local/domain/0/backend/vfb/2/0.
[2013-05-17 20:21:20 6427] DEBUG (XendDomainInfo:1795) Storing domain details: {'cpu/3/availability': 'online', 'description': '', 'console/limit': '1048576', 'memory/target': '2097056', 'cpu/2/availability': 'online', 'vm': '/vm/c413e3f2-98ae-7883-03a2-453cbb100a9a-1', 'domid': '2', 'control/platform-feature-xs_reset_watches': '1', 'cpu/7/availability': 'online', 'cpu/0/availability': 'online', 'cpu/1/availability': 'online', 'cpu/5/availability': 'online', 'control/platform-feature-multiprocessor-suspend': '1', 'cpu/6/availability': 'online', 'console/type': 'xenconsoled', 'cpu/4/availability': 'online', 'name': 'Domain-Unnamed'}
[2013-05-17 20:21:20 6427] DEBUG (XendDomain:476) Adding Domain: 2
[2013-05-17 20:21:20 6427] DEBUG (XendDomainInfo:1882) XendDomainInfo.handleShutdownWatch
[2013-05-17 20:21:20 21275] INFO (XendDomainInfo:2358) createDevice: vbd : {'uuid': '0aa3a7b7-5c9c-6bf4-6a12-42ca178c092f', 'bootable': 1, 'driver': 'paravirtualised', 'dev': 'hda:disk', 'uname': 'phy:/dev/disk/by-path/ip-10.2.0.10:3260-iscsi-iqn.2013-02.net.shatteredsilicon:legion-lun-0', 'mode': 'w'}
[2013-05-17 20:21:20 21275] DEBUG (DevController:95) DevController: writing {'backend-id': '0', 'virtual-device': '768', 'device-type': 'disk', 'state': '1', 'backend': '/local/domain/0/backend/vbd/2/768'} to /local/domain/2/device/vbd/768.
[2013-05-17 20:21:20 21275] DEBUG (DevController:97) DevController: writing {'domain': 'edi', 'frontend': '/local/domain/2/device/vbd/768', 'uuid': '0aa3a7b7-5c9c-6bf4-6a12-42ca178c092f', 'bootable': '1', 'dev': 'hda', 'state': '1', 'params': '/dev/disk/by-path/ip-10.2.0.10:3260-iscsi-iqn.2013-02.net.shatteredsilicon:legion-lun-0', 'mode': 'w', 'online': '1', 'frontend-id': '2', 'type': 'phy'} to /local/domain/0/backend/vbd/2/768.
[2013-05-17 20:21:20 21275] INFO (XendDomainInfo:2358) createDevice: pci : {'devs': [{'slot': '0x1a', 'domain': '0x0000', 'key': '0000:00:1a.0', 'bus': '0x00', 'vdevfn': '0x100', 'func': '0x0', 'uuid': '72c3c556-cf34-9100-323f-aebbee9b643b'}, {'slot': '0x1b', 'domain': '0x0000', 'key': '0000:00:1b.0', 'bus': '0x00', 'vdevfn': '0x100', 'func': '0x0', 'uuid': 'b28c8a70-f4d0-1fcf-9a38-89f7160c428b'}, {'slot': '0x1d', 'domain': '0x0000', 'key': '0000:00:1d.2', 'bus': '0x00', 'vdevfn': '0x100', 'func': '0x2', 'uuid': 'edb78277-262f-5598-c6e6-fdcfcf1a7784'}, {'slot': '0x00', 'domain': '0x0000', 'key': '0000:02:00.0', 'bus': '0x02', 'vdevfn': '0x100', 'func': '0x0', 'uuid': 'b0b28091-f263-c05f-3d42-16714f5ece4b'}, {'slot': '0x00', 'domain': '0x0000', 'key': '0000:07:00.0', 'bus': '0x07', 'vdevfn': '0x100', 'func': '0x0', 'uuid': '136f9d6f-26a6-2ddc-6d90-1f5be92eb756'}, {'slot': '0x00', 'domain': '0x0000', 'key': '0000:07:00.1', 'bus': '0x07', 'vdevfn': '0x100', 'func': '0x1', 'uuid': '1dcac32e-35a4-36df-19db-ca42e21bcc06'}], 'uuid': '56eb6d09-ec52-69bd-4c93-524d4d8b161e'}
[2013-05-17 20:21:23 21275] INFO (image:422) spawning device models: /usr/lib64/xen/bin/qemu-dm ['/usr/lib64/xen/bin/qemu-dm', '-d', '2', '-domain-name', 'edi', '-videoram', '4', '-k', 'en-gb', '-vnc', '127.0.0.1:0', '-vncunused', '-parallel', 'none', '-vcpus', '8', '-vcpu_avail', '0xff', '-boot', 'c', '-soundhw', 'es1370', '-localtime', '-serial', 'pty', '-acpi', '-usb', '-usbdevice', 'tablet', '-net', 'none', '-M', 'xenfv']
[2013-05-17 20:21:23 21275] INFO (image:471) device model pid: 28104
[2013-05-17 20:21:23 21275] INFO (image:594) waiting for sentinel_fifo
[2013-05-17 20:21:23 21275] DEBUG (XendDomainInfo:893) XendDomainInfo.pci_device_configure: ['pci', ['dev', ['slot', '0x1a'], ['domain', '0x0000'], ['key', '0000:00:1a.0'], ['bus', '0x00'], ['vdevfn', '0x100'], ['func', '0x0'], ['uuid', '72c3c556-cf34-9100-323f-aebbee9b643b']], ['state', 'Initialising'], ['sub_state', 'Booting']]
[2013-05-17 20:21:23 21275] DEBUG (XendDomainInfo:779) XendDomainInfo.hvm_pci_device_insert: {'devs': [{'slot': '0x1a', 'domain': '0x0000', 'key': '0000:00:1a.0', 'bus': '0x00', 'vdevfn': '0x100', 'func': '0x0', 'uuid': '72c3c556-cf34-9100-323f-aebbee9b643b'}], 'states': ['Initialising']}
[2013-05-17 20:21:23 21275] DEBUG (XendDomainInfo:790) XendDomainInfo.hvm_pci_device_insert_dev: {'slot': '0x1a', 'domain': '0x0000', 'key': '0000:00:1a.0', 'bus': '0x00', 'vdevfn': '0x100', 'func': '0x0', 'uuid': '72c3c556-cf34-9100-323f-aebbee9b643b'}
[2013-05-17 20:21:23 21275] DEBUG (XendDomainInfo:811) XendDomainInfo.hvm_pci_device_insert_dev: 0000:00:1a.0@100
[2013-05-17 20:21:23 21275] DEBUG (XendDomainInfo:815) pci: assign device 0000:00:1a.0@100
[2013-05-17 20:21:23 21275] DEBUG (image:512) signalDeviceModel: orig_state is None, retrying
[2013-05-17 20:21:24 21275] INFO (image:542) signalDeviceModel:restore dm state to running
[2013-05-17 20:21:24 21275] INFO (pciquirk:92) NO quirks found for PCI device [8086:3a37:3842:101a]
[2013-05-17 20:21:24 21275] DEBUG (pciquirk:135) Permissive mode NOT enabled for PCI device [8086:3a37:3842:101a]
[2013-05-17 20:21:24 21275] DEBUG (pciif:320) pci: enabling ioport 0xa980/0x20
[2013-05-17 20:21:24 21275] DEBUG (pciif:351) pci: enabling irq 16
[2013-05-17 20:21:24 21275] INFO (pciquirk:92) NO quirks found for PCI device [8086:3a3e:3842:101a]
[2013-05-17 20:21:24 21275] DEBUG (pciquirk:135) Permissive mode NOT enabled for PCI device [8086:3a3e:3842:101a]
[2013-05-17 20:21:24 21275] DEBUG (pciif:334) pci: enabling iomem 0xf1df4000/0x4000 pfn 0xf1df4/0x4
[2013-05-17 20:21:24 21275] DEBUG (pciif:351) pci: enabling irq 22
[2013-05-17 20:21:24 21275] ERROR (XendDomainInfo:2933) XendDomainInfo.initDomain: exception occurred
Traceback (most recent call last):
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomainInfo.py", line 2920, in _initDomain
    self._createDevices()
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomainInfo.py", line 2396, in _createDevices
    self.pci_device_configure_boot()
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomainInfo.py", line 627, in pci_device_configure_boot
    self.pci_device_configure(dev_sxp, first_dev = first)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomainInfo.py", line 970, in pci_device_configure
    devid = self._createDevice('pci', existing_pci_conf)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomainInfo.py", line 2327, in _createDevice
    return self.getDeviceController(deviceClass).createDevice(devConfig)
  File "/usr/lib64/python2.6/site-packages/xen/xend/server/DevController.py", line 67, in createDevice
    self.setupDevice(config)
  File "/usr/lib64/python2.6/site-packages/xen/xend/server/pciif.py", line 453, in setupDevice
    self.setupOneDevice(d)
  File "/usr/lib64/python2.6/site-packages/xen/xend/server/pciif.py", line 353, in setupOneDevice
    allow_access = True)
Error: (22, 'Invalid argument')
[2013-05-17 20:21:24 21275] ERROR (XendDomainInfo:488) VM start failed
Traceback (most recent call last):
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomainInfo.py", line 474, in start
    XendTask.log_progress(31, 60, self._initDomain)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendTask.py", line 209, in log_progress
    retval = func(*args, **kwds)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomainInfo.py", line 2936, in _initDomain
    raise VmError(str(exn))
VmError: (22, 'Invalid argument')
[2013-05-17 20:21:24 21275] DEBUG (XendDomainInfo:3077) XendDomainInfo.destroy: domid=2
[2013-05-17 20:21:25 6427] DEBUG (XendDomainInfo:2402) Destroying device model
[2013-05-17 20:21:25 21275] DEBUG (XendDomainInfo:2402) Destroying device model
[2013-05-17 20:21:25 6427] DEBUG (XendDomainInfo:2409) Releasing devices
[2013-05-17 20:21:25 6427] DEBUG (XendDomainInfo:2415) Removing vbd/768
[2013-05-17 20:21:25 6427] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768
[2013-05-17 20:21:25 6427] DEBUG (XendDomainInfo:2415) Removing vfb/0
[2013-05-17 20:21:25 6427] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = vfb, device = vfb/0
[2013-05-17 20:21:25 21275] INFO (image:619) edi device model terminated
[2013-05-17 20:21:25 21275] DEBUG (XendDomainInfo:2409) Releasing devices
[2013-05-17 20:21:25 21275] DEBUG (XendDomainInfo:2415) Removing vbd/768
[2013-05-17 20:21:25 21275] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768
[2013-05-17 20:21:25 21275] DEBUG (XendDomainInfo:2407) No device model
[2013-05-17 20:21:25 21275] DEBUG (XendDomainInfo:2409) Releasing devices
[2013-05-17 20:21:25 21275] DEBUG (XendDomainInfo:2415) Removing vbd/768
[2013-05-17 20:21:25 21275] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768
[2013-05-17 20:21:25 21275] ERROR (SrvBase:88) Request start failed.
Traceback (most recent call last):
  File "/usr/lib64/python2.6/site-packages/xen/web/SrvBase.py", line 85, in perform
    return op_method(op, req)
  File "/usr/lib64/python2.6/site-packages/xen/xend/server/SrvDomain.py", line 77, in op_start
    return self.xd.domain_start(self.dom.getName(), paused)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomain.py", line 1070, in domain_start
    dominfo.start(is_managed = True)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomainInfo.py", line 474, in start
    XendTask.log_progress(31, 60, self._initDomain)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendTask.py", line 209, in log_progress
    retval = func(*args, **kwds)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomainInfo.py", line 2936, in _initDomain
    raise VmError(str(exn))
VmError: (22, 'Invalid argument')
[2013-05-17 20:21:33 21275] DEBUG (XendDomainInfo:2499) XendDomainInfo.constructDomain
[2013-05-17 20:21:33 21275] DEBUG (balloon:187) Balloon: 2149496 KiB free; need 16384; done.
[2013-05-17 20:21:33 21275] DEBUG (XendDomain:476) Adding Domain: 3
[2013-05-17 20:21:33 21275] DEBUG (XendDomainInfo:2842) XendDomainInfo.initDomain: 3 256
[2013-05-17 20:21:33 21275] DEBUG (image:343) No VNC passwd configured for vfb access
[2013-05-17 20:21:33 21275] DEBUG (image:895) args: boot, val: c
[2013-05-17 20:21:33 21275] DEBUG (image:895) args: fda, val: None
[2013-05-17 20:21:33 21275] DEBUG (image:895) args: fdb, val: None
[2013-05-17 20:21:33 21275] DEBUG (image:895) args: soundhw, val: es1370
[2013-05-17 20:21:33 21275] DEBUG (image:895) args: localtime, val: 1
[2013-05-17 20:21:33 21275] DEBUG (image:895) args: serial, val: ['pty']
[2013-05-17 20:21:33 21275] DEBUG (image:895) args: std-vga, val: None
[2013-05-17 20:21:33 21275] DEBUG (image:895) args: isa, val: None
[2013-05-17 20:21:33 21275] DEBUG (image:895) args: acpi, val: 1
[2013-05-17 20:21:33 21275] DEBUG (image:895) args: usb, val: 1
[2013-05-17 20:21:33 21275] DEBUG (image:895) args: usbdevice, val: tablet
[2013-05-17 20:21:33 21275] DEBUG (image:895) args: gfx_passthru, val: None
[2013-05-17 20:21:33 21275] INFO (image:826) Need to create platform device.[domid:3]
[2013-05-17 20:21:33 21275] DEBUG (XendDomainInfo:2869) _initDomain:shadow_memory=0x18, memory_static_max=0x80000000, memory_static_min=0x0.
[2013-05-17 20:21:33 21275] INFO (image:186) buildDomain os=hvm dom=3 vcpus=8
[2013-05-17 20:21:33 21275] DEBUG (image:954) domid          = 3
[2013-05-17 20:21:33 21275] DEBUG (image:955) image          = /usr/lib/xen/boot/hvmloader
[2013-05-17 20:21:33 21275] DEBUG (image:956) store_evtchn   = 10
[2013-05-17 20:21:33 21275] DEBUG (image:957) memsize        = 2048
[2013-05-17 20:21:33 21275] DEBUG (image:958) target         = 2048
[2013-05-17 20:21:33 21275] DEBUG (image:959) vcpus          = 8
[2013-05-17 20:21:33 21275] DEBUG (image:960) vcpu_avail     = 255
[2013-05-17 20:21:33 21275] DEBUG (image:961) acpi           = 1
[2013-05-17 20:21:33 21275] DEBUG (image:962) apic           = 1
[2013-05-17 20:21:33 6427] DEBUG (XendDomainInfo:151) XendDomainInfo.recreate({'max_vcpu_id': 7, 'cpu_time': 0L, 'ssidref': 0, 'hvm': 1, 'shutdown_reason': 255, 'dying': 0, 'online_vcpus': 1, 'domid': 3, 'paused': 1, 'crashed': 0, 'running': 0, 'maxmem_kb': 2101248L, 'shutdown': 0, 'mem_kb': 2097056L, 'handle': [196, 19, 227, 242, 152, 174, 120, 131, 3, 162, 69, 60, 187, 16, 10, 154], 'blocked': 0, 'cpupool': 0})
[2013-05-17 20:21:33 6427] INFO (XendDomainInfo:169) Recreating domain 3, UUID c413e3f2-98ae-7883-03a2-453cbb100a9a. at /local/domain/3
[2013-05-17 20:21:33 6427] WARNING (XendDomainInfo:191) /vm/c413e3f2-98ae-7883-03a2-453cbb100a9a-1/uuid/ is missing. recreate is confused, trying our best to recover
[2013-05-17 20:21:33 6427] DEBUG (XendDomainInfo:3426) Storing VM details: {'on_xend_stop': 'ignore', 'pool_name': 'Pool-0', 'shadow_memory': '0', 'uuid': 'c413e3f2-98ae-7883-03a2-453cbb100a9a', 'on_reboot': 'restart', 'image': "(linux (kernel '') (superpages 0) (nomigrate 0) (tsc_mode 0))", 'on_poweroff': 'destroy', 'bootloader_args': '', 'on_xend_start': 'ignore', 'on_crash': 'restart', 'xend/restart_count': '0', 'vcpus': '8', 'vcpu_avail': '255', 'bootloader': '', 'name': 'Domain-Unnamed'}
[2013-05-17 20:21:33 6427] DEBUG (XendDomainInfo:1795) Storing domain details: {'cpu/3/availability': 'online', 'description': '', 'console/limit': '1048576', 'memory/target': '2097056', 'cpu/2/availability': 'online', 'vm': '/vm/c413e3f2-98ae-7883-03a2-453cbb100a9a-1', 'domid': '3', 'control/platform-feature-xs_reset_watches': '1', 'cpu/7/availability': 'online', 'cpu/0/availability': 'online', 'cpu/1/availability': 'online', 'cpu/5/availability': 'online', 'control/platform-feature-multiprocessor-suspend': '1', 'cpu/6/availability': 'online', 'console/type': 'xenconsoled', 'cpu/4/availability': 'online', 'name': 'Domain-Unnamed'}
[2013-05-17 20:21:33 21275] INFO (XendDomainInfo:2358) createDevice: vfb : {'vncunused': '1', 'other_config': {'vncunused': '1', 'keymap': 'en-gb', 'vnc': '1'}, 'vnc': '1', 'uuid': '8a62bf3a-8c83-a878-6005-1498b605c975', 'devid': 0, 'keymap': 'en-gb'}
[2013-05-17 20:21:33 6427] DEBUG (XendDomain:476) Adding Domain: 3
[2013-05-17 20:21:33 21275] DEBUG (DevController:95) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/vfb/3/0'} to /local/domain/3/device/vfb/0.
[2013-05-17 20:21:33 21275] DEBUG (DevController:97) DevController: writing {'vncunused': '1', 'domain': 'edi', 'frontend': '/local/domain/3/device/vfb/0', 'uuid': '8a62bf3a-8c83-a878-6005-1498b605c975', 'frontend-id': '3', 'state': '1', 'keymap': 'en-gb', 'online': '1', 'vnc': '1'} to /local/domain/0/backend/vfb/3/0.
[2013-05-17 20:21:34 6427] DEBUG (XendDomainInfo:1882) XendDomainInfo.handleShutdownWatch
[2013-05-17 20:21:34 21275] INFO (XendDomainInfo:2358) createDevice: vbd : {'uuid': '0aa3a7b7-5c9c-6bf4-6a12-42ca178c092f', 'bootable': 1, 'devid': 768, 'driver': 'paravirtualised', 'dev': 'hda:disk', 'uname': 'phy:/dev/disk/by-path/ip-10.2.0.10:3260-iscsi-iqn.2013-02.net.shatteredsilicon:legion-lun-0', 'mode': 'w'}
[2013-05-17 20:21:34 21275] DEBUG (DevController:95) DevController: writing {'backend-id': '0', 'virtual-device': '768', 'device-type': 'disk', 'state': '1', 'backend': '/local/domain/0/backend/vbd/3/768'} to /local/domain/3/device/vbd/768.
[2013-05-17 20:21:34 21275] DEBUG (DevController:97) DevController: writing {'domain': 'edi', 'frontend': '/local/domain/3/device/vbd/768', 'uuid': '0aa3a7b7-5c9c-6bf4-6a12-42ca178c092f', 'bootable': '1', 'dev': 'hda', 'state': '1', 'params': '/dev/disk/by-path/ip-10.2.0.10:3260-iscsi-iqn.2013-02.net.shatteredsilicon:legion-lun-0', 'mode': 'w', 'online': '1', 'frontend-id': '3', 'type': 'phy'} to /local/domain/0/backend/vbd/3/768.
[2013-05-17 20:21:34 21275] INFO (XendDomainInfo:2358) createDevice: pci : {'devs': [{'slot': '0x1a', 'domain': '0x0000', 'key': '0000:00:1a.0', 'bus': '0x00', 'vdevfn': '0x100', 'func': '0x0', 'uuid': '72c3c556-cf34-9100-323f-aebbee9b643b'}, {'slot': '0x1b', 'domain': '0x0000', 'key': '0000:00:1b.0', 'bus': '0x00', 'vdevfn': '0x100', 'func': '0x0', 'uuid': 'b28c8a70-f4d0-1fcf-9a38-89f7160c428b'}, {'slot': '0x1d', 'domain': '0x0000', 'key': '0000:00:1d.2', 'bus': '0x00', 'vdevfn': '0x100', 'func': '0x2', 'uuid': 'edb78277-262f-5598-c6e6-fdcfcf1a7784'}, {'slot': '0x00', 'domain': '0x0000', 'key': '0000:02:00.0', 'bus': '0x02', 'vdevfn': '0x100', 'func': '0x0', 'uuid': 'b0b28091-f263-c05f-3d42-16714f5ece4b'}, {'slot': '0x00', 'domain': '0x0000', 'key': '0000:07:00.0', 'bus': '0x07', 'vdevfn': '0x100', 'func': '0x0', 'uuid': '136f9d6f-26a6-2ddc-6d90-1f5be92eb756'}, {'slot': '0x00', 'domain': '0x0000', 'key': '0000:07:00.1', 'bus': '0x07', 'vdevfn': '0x100', 'func': '0x1', 'uuid': '1dcac32e-35a4-36df-19db-ca42e21bcc06'}], 'uuid': '56eb6d09-ec52-69bd-4c93-524d4d8b161e'}
[2013-05-17 20:21:37 21275] INFO (image:422) spawning device models: /usr/lib64/xen/bin/qemu-dm ['/usr/lib64/xen/bin/qemu-dm', '-d', '3', '-domain-name', 'edi', '-videoram', '4', '-k', 'en-gb', '-vnc', '127.0.0.1:0', '-vncunused', '-parallel', 'none', '-vcpus', '8', '-vcpu_avail', '0xff', '-boot', 'c', '-soundhw', 'es1370', '-localtime', '-serial', 'pty', '-acpi', '-usb', '-usbdevice', 'tablet', '-net', 'none', '-M', 'xenfv']
[2013-05-17 20:21:37 21275] INFO (image:471) device model pid: 28483
[2013-05-17 20:21:37 21275] INFO (image:594) waiting for sentinel_fifo
[2013-05-17 20:21:37 21275] DEBUG (XendDomainInfo:893) XendDomainInfo.pci_device_configure: ['pci', ['dev', ['slot', '0x1a'], ['domain', '0x0000'], ['key', '0000:00:1a.0'], ['bus', '0x00'], ['vdevfn', '0x100'], ['func', '0x0'], ['uuid', '72c3c556-cf34-9100-323f-aebbee9b643b']], ['state', 'Initialising'], ['sub_state', 'Booting']]
[2013-05-17 20:21:37 21275] DEBUG (XendDomainInfo:779) XendDomainInfo.hvm_pci_device_insert: {'devs': [{'slot': '0x1a', 'domain': '0x0000', 'key': '0000:00:1a.0', 'bus': '0x00', 'vdevfn': '0x100', 'func': '0x0', 'uuid': '72c3c556-cf34-9100-323f-aebbee9b643b'}], 'states': ['Initialising']}
[2013-05-17 20:21:37 21275] DEBUG (XendDomainInfo:790) XendDomainInfo.hvm_pci_device_insert_dev: {'slot': '0x1a', 'domain': '0x0000', 'key': '0000:00:1a.0', 'bus': '0x00', 'vdevfn': '0x100', 'func': '0x0', 'uuid': '72c3c556-cf34-9100-323f-aebbee9b643b'}
[2013-05-17 20:21:37 21275] DEBUG (XendDomainInfo:811) XendDomainInfo.hvm_pci_device_insert_dev: 0000:00:1a.0@100
[2013-05-17 20:21:37 21275] DEBUG (XendDomainInfo:815) pci: assign device 0000:00:1a.0@100
[2013-05-17 20:21:37 21275] DEBUG (image:512) signalDeviceModel: orig_state is None, retrying
[2013-05-17 20:21:37 21275] INFO (image:542) signalDeviceModel:restore dm state to running
[2013-05-17 20:21:37 21275] INFO (pciquirk:92) NO quirks found for PCI device [8086:3a37:3842:101a]
[2013-05-17 20:21:37 21275] DEBUG (pciquirk:135) Permissive mode NOT enabled for PCI device [8086:3a37:3842:101a]
[2013-05-17 20:21:37 21275] DEBUG (pciif:320) pci: enabling ioport 0xa980/0x20
[2013-05-17 20:21:37 21275] DEBUG (pciif:351) pci: enabling irq 16
[2013-05-17 20:21:37 21275] INFO (pciquirk:92) NO quirks found for PCI device [8086:3a3e:3842:101a]
[2013-05-17 20:21:38 21275] DEBUG (pciquirk:135) Permissive mode NOT enabled for PCI device [8086:3a3e:3842:101a]
[2013-05-17 20:21:38 21275] DEBUG (pciif:334) pci: enabling iomem 0xf1df4000/0x4000 pfn 0xf1df4/0x4
[2013-05-17 20:21:38 21275] DEBUG (pciif:351) pci: enabling irq 22
[2013-05-17 20:21:38 21275] ERROR (XendDomainInfo:2933) XendDomainInfo.initDomain: exception occurred
Traceback (most recent call last):
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomainInfo.py", line 2920, in _initDomain
    self._createDevices()
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomainInfo.py", line 2396, in _createDevices
    self.pci_device_configure_boot()
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomainInfo.py", line 627, in pci_device_configure_boot
    self.pci_device_configure(dev_sxp, first_dev = first)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomainInfo.py", line 970, in pci_device_configure
    devid = self._createDevice('pci', existing_pci_conf)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomainInfo.py", line 2327, in _createDevice
    return self.getDeviceController(deviceClass).createDevice(devConfig)
  File "/usr/lib64/python2.6/site-packages/xen/xend/server/DevController.py", line 67, in createDevice
    self.setupDevice(config)
  File "/usr/lib64/python2.6/site-packages/xen/xend/server/pciif.py", line 453, in setupDevice
    self.setupOneDevice(d)
  File "/usr/lib64/python2.6/site-packages/xen/xend/server/pciif.py", line 353, in setupOneDevice
    allow_access = True)
Error: (22, 'Invalid argument')
[2013-05-17 20:21:38 21275] ERROR (XendDomainInfo:488) VM start failed
Traceback (most recent call last):
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomainInfo.py", line 474, in start
    XendTask.log_progress(31, 60, self._initDomain)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendTask.py", line 209, in log_progress
    retval = func(*args, **kwds)
  File "/usr/lib64/python2.6/site-packages/xen/xend/XendDomainInfo.py", line 2936, in _initDomain
    raise VmError(str(exn))
VmError: (22, 'Invalid argument')
[2013-05-17 20:21:38 21275] DEBUG (XendDomainInfo:3077) XendDomainInfo.destroy: domid=3
[2013-05-17 20:21:38 6427] DEBUG (XendDomainInfo:2402) Destroying device model
[2013-05-17 20:21:38 21275] DEBUG (XendDomainInfo:2402) Destroying device model
[2013-05-17 20:21:38 6427] DEBUG (XendDomainInfo:2409) Releasing devices
[2013-05-17 20:21:38 6427] DEBUG (XendDomainInfo:2415) Removing vbd/768
[2013-05-17 20:21:38 6427] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768
[2013-05-17 20:21:38 6427] DEBUG (XendDomainInfo:2415) Removing vfb/0
[2013-05-17 20:21:38 6427] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = vfb, device = vfb/0
[2013-05-17 20:21:38 21275] INFO (image:619) edi device model terminated
[2013-05-17 20:21:39 21275] DEBUG (XendDomainInfo:2409) Releasing devices
[2013-05-17 20:21:39 21275] DEBUG (XendDomainInfo:2415) Removing vbd/768
[2013-05-17 20:21:39 21275] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768
[2013-05-17 20:21:39 21275] DEBUG (XendDomainInfo:2407) No device model
[2013-05-17 20:21:39 21275] DEBUG (XendDomainInfo:2409) Releasing devices
[2013-05-17 20:21:39 21275] DEBUG (XendDomainInfo:2415) Removing vbd/768
[2013-05-17 20:21:39 21275] DEBUG (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768

[-- Attachment #5: xend-debug.log --]
[-- Type: text/plain, Size: 1474 bytes --]

Xend started at Fri May 17 20:12:17 2013.
Xend started at Fri May 17 20:12:17 2013.
Exception starting xend: [Errno 2] No such file or directory: '/var/lib/xend/relocation-socket'
/usr/lib64/python2.6/site-packages/xen/xend/XendAPI.py:551: DeprecationWarning: object.__new__() takes no parameters
  return object.__new__(cls, *args, **kwds)
Xend started at Fri May 17 20:16:18 2013.
/usr/lib64/python2.6/site-packages/xen/xend/XendAPI.py:551: DeprecationWarning: object.__new__() takes no parameters
  return object.__new__(cls, *args, **kwds)
xc: info: VIRTUAL MEMORY ARRANGEMENT:
  Loader:        0000000000100000->000000000019bb24
  TOTAL:         0000000000000000->0000000080000000
  ENTRY ADDRESS: 0000000000100000
xc: info: PHYSICAL MEMORY ALLOCATION:
  4KB PAGES: 0x0000000000010800
  2MB PAGES: 0x000000000000037c
  1GB PAGES: 0x0000000000000000
xc: info: VIRTUAL MEMORY ARRANGEMENT:
  Loader:        0000000000100000->000000000019bb24
  TOTAL:         0000000000000000->0000000080000000
  ENTRY ADDRESS: 0000000000100000
xc: info: PHYSICAL MEMORY ALLOCATION:
  4KB PAGES: 0x0000000000010400
  2MB PAGES: 0x000000000000037e
  1GB PAGES: 0x0000000000000000
xc: info: VIRTUAL MEMORY ARRANGEMENT:
  Loader:        0000000000100000->000000000019bb24
  TOTAL:         0000000000000000->0000000080000000
  ENTRY ADDRESS: 0000000000100000
xc: info: PHYSICAL MEMORY ALLOCATION:
  4KB PAGES: 0x0000000000010400
  2MB PAGES: 0x000000000000037e
  1GB PAGES: 0x0000000000000000

[-- Attachment #6: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: PCI passthrough problems after XSA46 patch

[Jan Beulich]

>>> On 15.05.13 at 09:24, Gordan Bobic <gordan@bobich.net> wrote:
> On 05/15/2013 08:06 AM, Jan Beulich wrote:
>>>>> On 14.05.13 at 21:30, Gordan Bobic <gordan@bobich.net> wrote:
>>> Bad news, I'm afraid - I still get error "22, invalid argument" with
>>> this patch.
>>
>> It would of course help to know precisely where this error is being
>> observed, the more that the xend change alone was reported to
>> convert the original EINVAL into EEXIST in another place.
> 
> Not sure what you mean. It's observed when running
> xm start $guestname
> 
> Which logs would you like me to attach?

Btw, I just took the time to figure out a way to reproduce the
original problem, and the patch I sent makes things work again
for me. So I'm suspecting you to have missed some step in the
rebuild-reinstall-restart sequence.

Let's see what the other two reporters find once they get to
trying out that patch.

Jan

Re: PCI passthrough problems after XSA46 patch

[Gordan Bobic]

On 05/16/2013 01:20 PM, Jan Beulich wrote:
>>>> On 15.05.13 at 09:24, Gordan Bobic <gordan@bobich.net> wrote:
>> On 05/15/2013 08:06 AM, Jan Beulich wrote:
>>>>>> On 14.05.13 at 21:30, Gordan Bobic <gordan@bobich.net> wrote:
>>>> Bad news, I'm afraid - I still get error "22, invalid argument" with
>>>> this patch.
>>>
>>> It would of course help to know precisely where this error is being
>>> observed, the more that the xend change alone was reported to
>>> convert the original EINVAL into EEXIST in another place.
>>
>> Not sure what you mean. It's observed when running
>> xm start $guestname
>>
>> Which logs would you like me to attach?
>
> Btw, I just took the time to figure out a way to reproduce the
> original problem, and the patch I sent makes things work again
> for me. So I'm suspecting you to have missed some step in the
> rebuild-reinstall-restart sequence.
>
> Let's see what the other two reporters find once they get to
> trying out that patch.

I'm pretty sure I didn't miss a step (logs attached in the other email), 
but I'm open to being proved wrong. Maybe there is a composite issue in 
play.

Gordan

Re: PCI passthrough problems after legacy update of xen 4.1

[Andreas Falck]

[-- Attachment #1.1: Type: text/plain, Size: 2681 bytes --]

Thanks! I'll give it a try in the weekend. I have been travelling, that's
why I haven't pursued this further yet.

Regards,
Andreas


2013/5/14 Jan Beulich <JBeulich@suse.com>

> >>> On 05.05.13 at 21:33, Andreas Falck <falck.andreas.lists@gmail.com>
> wrote:
> > I tried adding some debugging statements in physdev_map_pirq. I have
> > attached the physdev.c with my debug statements, a hypervisor log from
> > testing, and the output of lspci -vv for my three devices.
>
> Since I didn't hear anything from either of you anymore, I went
> through the (not very familiar to me) tool stack code again, and
> found that qemu and xend/libxl fundamentally disagree about the
> model to be used. Qemu wants to allocate PIRQs while xend/libxl
> want a 1:1 mapping. Allocating after having created a 1:1 mapping
> works by returning the 1:1 mapping as allocation result, so as long
> as libxl completes its setup before launching qemu, it would be
> obvious why things work there. Consequently I assume that xend
> launches qemu quite a bit earlier in the process of creating a new
> domain, and the result of an attempt to establish a 1:1 mapping
> when a different mapping was already established is dependent on
> the specific interrupt numbers (i.e. also explains the observations
> one of you made).
>
> Since the tool stack as a whole really ought to use a consistent
> model, and since the 1:1 mapping model for non-MSI IRQs seems
> quite natural, the below/attached patch takes care of enforcing
> a 1:1 mapping in libxc when allocation is being requested by the
> caller. Ian, Ian - do you foresee any problem with this?
>
> Please both of you give this a try and let us know of the results
> (patch applies cleanly to all of -unstable, 4.2, and 4.1).
>
> Jan
>
> --- a/tools/libxc/xc_physdev.c
> +++ b/tools/libxc/xc_physdev.c
> @@ -49,7 +49,7 @@ int xc_physdev_map_pirq(xc_interface *xc
>      map.domid = domid;
>      map.type = MAP_PIRQ_TYPE_GSI;
>      map.index = index;
> -    map.pirq = *pirq;
> +    map.pirq = *pirq < 0 ? index : *pirq;
>
>      rc = do_physdev_op(xch, PHYSDEVOP_map_pirq, &map, sizeof(map));
>
> --- a/tools/python/xen/xend/server/pciif.py
> +++ b/tools/python/xen/xend/server/pciif.py
> @@ -340,7 +340,7 @@ class PciController(DevController):
>                  raise VmError(('pci: failed to configure I/O memory on
> device '+
>                              '%s - errno=%d')%(dev.name,rc))
>
> -        if not self.vm.info.is_hvm() and dev.irq:
> +        if dev.irq > 0:
>              rc = xc.physdev_map_pirq(domid = fe_domid,
>                                     index = dev.irq,
>                                     pirq  = dev.irq)
>
>
>

[-- Attachment #1.2: Type: text/html, Size: 3425 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: PCI passthrough problems after legacy update of xen 4.1

[Andreas Falck]

[-- Attachment #1.1: Type: text/plain, Size: 3586 bytes --]

Now I'm happy to inform that Jan's patch solves the problem for me. I
patched the source version of the xen package under ubuntu12.10, currently
4.1.3-3ubuntu1.5_amd64. Now I can add pci devices any order I like.

After installing the full xen suite from the source (not knowing exactly
which packages were affected) and seeing it working, I replaced the
hypervisor package with a version with the debug changes I made earlier, to
produce the attached logs. These are xend.log and xm dmesg from the working
case, when I pass pci = [04:00.0, 41:00.0, 41:00.1] which didn't work
before with the pre-patch code.

Thanks for this! Let me know if I should provide some more info, especially
given that this change does not yet seem to work for Gordan on 4.2.

Regards,
Andreas



2013/5/16 Andreas Falck <falck.andreas.lists@gmail.com>

> Thanks! I'll give it a try in the weekend. I have been travelling, that's
> why I haven't pursued this further yet.
>
> Regards,
> Andreas
>
>
> 2013/5/14 Jan Beulich <JBeulich@suse.com>
>
>> >>> On 05.05.13 at 21:33, Andreas Falck <falck.andreas.lists@gmail.com>
>> wrote:
>> > I tried adding some debugging statements in physdev_map_pirq. I have
>> > attached the physdev.c with my debug statements, a hypervisor log from
>> > testing, and the output of lspci -vv for my three devices.
>>
>> Since I didn't hear anything from either of you anymore, I went
>> through the (not very familiar to me) tool stack code again, and
>> found that qemu and xend/libxl fundamentally disagree about the
>> model to be used. Qemu wants to allocate PIRQs while xend/libxl
>> want a 1:1 mapping. Allocating after having created a 1:1 mapping
>> works by returning the 1:1 mapping as allocation result, so as long
>> as libxl completes its setup before launching qemu, it would be
>> obvious why things work there. Consequently I assume that xend
>> launches qemu quite a bit earlier in the process of creating a new
>> domain, and the result of an attempt to establish a 1:1 mapping
>> when a different mapping was already established is dependent on
>> the specific interrupt numbers (i.e. also explains the observations
>> one of you made).
>>
>> Since the tool stack as a whole really ought to use a consistent
>> model, and since the 1:1 mapping model for non-MSI IRQs seems
>> quite natural, the below/attached patch takes care of enforcing
>> a 1:1 mapping in libxc when allocation is being requested by the
>> caller. Ian, Ian - do you foresee any problem with this?
>>
>> Please both of you give this a try and let us know of the results
>> (patch applies cleanly to all of -unstable, 4.2, and 4.1).
>>
>> Jan
>>
>> --- a/tools/libxc/xc_physdev.c
>> +++ b/tools/libxc/xc_physdev.c
>> @@ -49,7 +49,7 @@ int xc_physdev_map_pirq(xc_interface *xc
>>      map.domid = domid;
>>      map.type = MAP_PIRQ_TYPE_GSI;
>>      map.index = index;
>> -    map.pirq = *pirq;
>> +    map.pirq = *pirq < 0 ? index : *pirq;
>>
>>      rc = do_physdev_op(xch, PHYSDEVOP_map_pirq, &map, sizeof(map));
>>
>> --- a/tools/python/xen/xend/server/pciif.py
>> +++ b/tools/python/xen/xend/server/pciif.py
>> @@ -340,7 +340,7 @@ class PciController(DevController):
>>                  raise VmError(('pci: failed to configure I/O memory on
>> device '+
>>                              '%s - errno=%d')%(dev.name,rc))
>>
>> -        if not self.vm.info.is_hvm() and dev.irq:
>> +        if dev.irq > 0:
>>              rc = xc.physdev_map_pirq(domid = fe_domid,
>>                                     index = dev.irq,
>>                                     pirq  = dev.irq)
>>
>>
>>
>

[-- Attachment #1.2: Type: text/html, Size: 4690 bytes --]

[-- Attachment #2: xend.log-after_jans_patch --]
[-- Type: application/octet-stream, Size: 22433 bytes --]

[2013-05-19 16:33:13 2627] DEBUG (XendDomainInfo:103) XendDomainInfo.create(['vm', ['name', 'w8'], ['memory', 8192], ['on_xend_start', 'ignore'], ['on_xend_stop', 'ignore'], ['vcpus', 4], ['uuid', '0b10a5d5-ce1f-46a2-9d98-46e9ef2af87e'], ['cpus', '12-15'], ['oos', 1], ['image', ['hvm', ['videoram', 4], ['acpi', 1], ['apic', 1], ['boot', 'cd'], ['cpuid', []], ['cpuid_check', []], ['display', ':0.0'], ['fda', ''], ['fdb', ''], ['guest_os_type', 'default'], ['hap', 1], ['hpet', 0], ['isa', 0], ['keymap', 'sv'], ['localtime', 0], ['nographic', 0], ['oos', 1], ['pae', 1], ['pci', [['0x0000', '0x04', '0x00', '0x0', '0x100', [], '04:00.0'], ['0x0000', '0x41', '0x00', '0x0', '0x100', [], '41:00.0'], ['0x0000', '0x41', '0x00', '0x1', '0x100', [], '41:00.1']]], ['pci_msitranslate', 1], ['pci_power_mgmt', 1], ['rtc_timeoffset', 0], ['soundhw', ''], ['stdvga', 0], ['timer_mode', 1], ['usb', 1], ['usbdevice', 'tablet'], ['vcpus', 4], ['vnc', 1], ['vncunused', 1], ['viridian', 1], ['vpt_align', 1], ['xauthority', '/home/andreas/.Xauthority'], ['xen_platform_pci', 1], ['memory_sharing', 0], ['tsc_mode', 0], ['nomigrate', 0]]], ['s3_integrity', 1], ['device', ['vbd', ['uname', 'phy:/dev/zvol/system/win8c'], ['dev', 'hda'], ['mode', 'w']]], ['device', ['vbd', ['uname', 'phy:/dev/zvol/system/win8d'], ['dev', 'hdb'], ['mode', 'w']]], ['device', ['vbd', ['uname', 'file:/alt/xen/images/en-gb_windows_8_n_x64_dvd_915799.iso'], ['dev', 'hdc:cdrom'], ['mode', 'r']]], ['device', ['pci', ['dev', ['slot', '0x00'], ['domain', '0x0000'], ['key', '04:00.0'], ['bus', '0x04'], ['vdevfn', '0x100'], ['func', '0x0']], ['dev', ['slot', '0x00'], ['domain', '0x0000'], ['key', '41:00.0'], ['bus', '0x41'], ['vdevfn', '0x100'], ['func', '0x0']], ['dev', ['slot', '0x00'], ['domain', '0x0000'], ['key', '41:00.1'], ['bus', '0x41'], ['vdevfn', '0x100'], ['func', '0x1']]]], ['device', ['vif', ['bridge', 'xenbr0'], ['mac', '00:16:3e:68:08:6c'], ['type', 'ioemu'], ['model', 'e1000']]]])
[2013-05-19 16:33:13 2627] DEBUG (XendDomainInfo:2498) XendDomainInfo.constructDomain
[2013-05-19 16:33:13 2627] DEBUG (balloon:187) Balloon: 16331572 KiB free; need 16384; done.
[2013-05-19 16:33:13 2627] DEBUG (XendDomain:476) Adding Domain: 1
[2013-05-19 16:33:13 2627] DEBUG (XendDomainInfo:2836) XendDomainInfo.initDomain: 1 256
[2013-05-19 16:33:13 2627] DEBUG (image:339) No VNC passwd configured for vfb access
[2013-05-19 16:33:13 2627] DEBUG (image:891) args: boot, val: cd
[2013-05-19 16:33:13 2627] DEBUG (image:891) args: fda, val: None
[2013-05-19 16:33:13 2627] DEBUG (image:891) args: fdb, val: None
[2013-05-19 16:33:13 2627] DEBUG (image:891) args: soundhw, val: None
[2013-05-19 16:33:13 2627] DEBUG (image:891) args: localtime, val: 0
[2013-05-19 16:33:13 2627] DEBUG (image:891) args: serial, val: None
[2013-05-19 16:33:13 2627] DEBUG (image:891) args: std-vga, val: 0
[2013-05-19 16:33:13 2627] DEBUG (image:891) args: isa, val: 0
[2013-05-19 16:33:13 2627] DEBUG (image:891) args: acpi, val: 1
[2013-05-19 16:33:13 2627] DEBUG (image:891) args: usb, val: 1
[2013-05-19 16:33:13 2627] DEBUG (image:891) args: usbdevice, val: tablet
[2013-05-19 16:33:13 2627] DEBUG (image:891) args: gfx_passthru, val: None
[2013-05-19 16:33:13 2627] INFO (image:822) Need to create platform device.[domid:1]
[2013-05-19 16:33:13 2627] DEBUG (XendDomainInfo:2863) _initDomain:shadow_memory=0x0, memory_static_max=0x200000000, memory_static_min=0x0.
[2013-05-19 16:33:13 2627] INFO (image:182) buildDomain os=hvm dom=1 vcpus=4
[2013-05-19 16:33:13 2627] DEBUG (image:945) domid          = 1
[2013-05-19 16:33:13 2627] DEBUG (image:946) image          = /usr/lib/xen-4.1/boot/hvmloader
[2013-05-19 16:33:13 2627] DEBUG (image:947) store_evtchn   = 5
[2013-05-19 16:33:13 2627] DEBUG (image:948) memsize        = 8192
[2013-05-19 16:33:13 2627] DEBUG (image:949) target         = 8192
[2013-05-19 16:33:13 2627] DEBUG (image:950) vcpus          = 4
[2013-05-19 16:33:13 2627] DEBUG (image:951) vcpu_avail     = 15
[2013-05-19 16:33:13 2627] DEBUG (image:952) acpi           = 1
[2013-05-19 16:33:13 2627] DEBUG (image:953) apic           = 1
[2013-05-19 16:33:13 2627] INFO (XendDomainInfo:2357) createDevice: vfb : {'vncunused': 1, 'keymap': 'sv', 'vnc': '1', 'uuid': '6901ef64-3476-2c73-679b-8d935e96099b', 'other_config': {'vncunused': 1, 'keymap': 'sv', 'vnc': '1'}}
[2013-05-19 16:33:13 2627] DEBUG (DevController:95) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/vfb/1/0'} to /local/domain/1/device/vfb/0.
[2013-05-19 16:33:13 2627] DEBUG (DevController:97) DevController: writing {'vncunused': '1', 'domain': 'w8', 'frontend': '/local/domain/1/device/vfb/0', 'uuid': '6901ef64-3476-2c73-679b-8d935e96099b', 'frontend-id': '1', 'state': '1', 'keymap': 'sv', 'online': '1', 'vnc': '1'} to /local/domain/0/backend/vfb/1/0.
[2013-05-19 16:33:13 2627] INFO (XendDomainInfo:2357) createDevice: vbd : {'uuid': '08c2158d-da89-b1b0-727a-58b1a96dfe5d', 'bootable': 1, 'driver': 'paravirtualised', 'dev': 'hda', 'uname': 'phy:/dev/zvol/system/win8c', 'mode': 'w'}
[2013-05-19 16:33:13 2627] DEBUG (DevController:95) DevController: writing {'backend-id': '0', 'virtual-device': '768', 'device-type': 'disk', 'state': '1', 'backend': '/local/domain/0/backend/vbd/1/768'} to /local/domain/1/device/vbd/768.
[2013-05-19 16:33:13 2627] DEBUG (DevController:97) DevController: writing {'domain': 'w8', 'frontend': '/local/domain/1/device/vbd/768', 'uuid': '08c2158d-da89-b1b0-727a-58b1a96dfe5d', 'bootable': '1', 'dev': 'hda', 'state': '1', 'params': '/dev/zvol/system/win8c', 'mode': 'w', 'online': '1', 'frontend-id': '1', 'type': 'phy'} to /local/domain/0/backend/vbd/1/768.
[2013-05-19 16:33:13 2627] INFO (XendDomainInfo:2357) createDevice: vbd : {'uuid': 'cd5ed343-8799-bdbb-5fc6-60bfc2e65589', 'bootable': 0, 'driver': 'paravirtualised', 'dev': 'hdb', 'uname': 'phy:/dev/zvol/system/win8d', 'mode': 'w'}
[2013-05-19 16:33:13 2627] DEBUG (DevController:95) DevController: writing {'backend-id': '0', 'virtual-device': '832', 'device-type': 'disk', 'state': '1', 'backend': '/local/domain/0/backend/vbd/1/832'} to /local/domain/1/device/vbd/832.
[2013-05-19 16:33:13 2627] DEBUG (DevController:97) DevController: writing {'domain': 'w8', 'frontend': '/local/domain/1/device/vbd/832', 'uuid': 'cd5ed343-8799-bdbb-5fc6-60bfc2e65589', 'bootable': '0', 'dev': 'hdb', 'state': '1', 'params': '/dev/zvol/system/win8d', 'mode': 'w', 'online': '1', 'frontend-id': '1', 'type': 'phy'} to /local/domain/0/backend/vbd/1/832.
[2013-05-19 16:33:13 2627] INFO (XendDomainInfo:2357) createDevice: vbd : {'uuid': '7c7732d9-a184-030e-3dc4-83e5db0eab50', 'bootable': 0, 'driver': 'paravirtualised', 'dev': 'hdc:cdrom', 'uname': 'file:/alt/xen/images/en-gb_windows_8_n_x64_dvd_915799.iso', 'mode': 'r'}
[2013-05-19 16:33:13 2627] DEBUG (DevController:95) DevController: writing {'backend-id': '0', 'virtual-device': '5632', 'device-type': 'cdrom', 'state': '1', 'backend': '/local/domain/0/backend/vbd/1/5632'} to /local/domain/1/device/vbd/5632.
[2013-05-19 16:33:13 2627] DEBUG (DevController:97) DevController: writing {'domain': 'w8', 'frontend': '/local/domain/1/device/vbd/5632', 'uuid': '7c7732d9-a184-030e-3dc4-83e5db0eab50', 'bootable': '0', 'dev': 'hdc', 'state': '1', 'params': '/alt/xen/images/en-gb_windows_8_n_x64_dvd_915799.iso', 'mode': 'r', 'online': '1', 'frontend-id': '1', 'type': 'file'} to /local/domain/0/backend/vbd/1/5632.
[2013-05-19 16:33:13 2627] INFO (XendDomainInfo:2357) createDevice: vif : {'bridge': 'xenbr0', 'mac': '00:16:3e:68:08:6c', 'type': 'ioemu', 'model': 'e1000', 'uuid': '1cc2b2c8-a0b0-0e3f-69ff-257138c17279'}
[2013-05-19 16:33:13 2627] DEBUG (DevController:95) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/vif/1/0'} to /local/domain/1/device/vif/0.
[2013-05-19 16:33:13 2627] DEBUG (DevController:97) DevController: writing {'bridge': 'xenbr0', 'domain': 'w8', 'handle': '0', 'uuid': '1cc2b2c8-a0b0-0e3f-69ff-257138c17279', 'script': '/etc/xen/scripts/vif-bridge', 'mac': '00:16:3e:68:08:6c', 'frontend-id': '1', 'state': '1', 'online': '1', 'frontend': '/local/domain/1/device/vif/0', 'model': 'e1000', 'type': 'ioemu'} to /local/domain/0/backend/vif/1/0.
[2013-05-19 16:33:13 2627] INFO (XendDomainInfo:2357) createDevice: pci : {'devs': [{'slot': '0x00', 'domain': '0x0000', 'key': '04:00.0', 'bus': '0x04', 'vdevfn': '0x100', 'func': '0x0', 'uuid': 'dad43274-946a-6ce9-397a-810ab191684b'}, {'slot': '0x00', 'domain': '0x0000', 'key': '41:00.0', 'bus': '0x41', 'vdevfn': '0x100', 'func': '0x0', 'uuid': '6fafbe91-e156-b151-3e34-1ed2ae101d83'}, {'slot': '0x00', 'domain': '0x0000', 'key': '41:00.1', 'bus': '0x41', 'vdevfn': '0x100', 'func': '0x1', 'uuid': 'd0244089-74c7-07b0-326e-9bcb1e9a07a1'}], 'uuid': '63b08fc6-44d2-043a-bb4d-bec43e1ff4c8'}
[2013-05-19 16:33:18 2627] INFO (image:418) spawning device models: /usr/lib/xen-4.1/bin/qemu-dm ['/usr/lib/xen-4.1/bin/qemu-dm', '-d', '1', '-domain-name', 'w8', '-videoram', '4', '-k', 'sv', '-vnc', '127.0.0.1:0', '-vncunused', '-vcpus', '4', '-vcpu_avail', '0xf', '-boot', 'cd', '-acpi', '-usb', '-usbdevice', 'tablet', '-net', 'nic,vlan=1,macaddr=00:16:3e:68:08:6c,model=e1000', '-net', 'tap,vlan=1,ifname=vif1.0-emu,bridge=xenbr0', '-M', 'xenfv']
[2013-05-19 16:33:18 2627] INFO (image:467) device model pid: 5356
[2013-05-19 16:33:18 2627] INFO (image:590) waiting for sentinel_fifo
[2013-05-19 16:33:18 2627] DEBUG (XendDomainInfo:893) XendDomainInfo.pci_device_configure: ['pci', ['dev', ['slot', '0x00'], ['domain', '0x0000'], ['key', '04:00.0'], ['bus', '0x04'], ['vdevfn', '0x100'], ['func', '0x0'], ['uuid', 'dad43274-946a-6ce9-397a-810ab191684b']], ['state', 'Initialising'], ['sub_state', 'Booting']]
[2013-05-19 16:33:18 2627] DEBUG (XendDomainInfo:779) XendDomainInfo.hvm_pci_device_insert: {'devs': [{'slot': '0x00', 'domain': '0x0000', 'key': '04:00.0', 'bus': '0x04', 'vdevfn': '0x100', 'func': '0x0', 'uuid': 'dad43274-946a-6ce9-397a-810ab191684b'}], 'states': ['Initialising']}
[2013-05-19 16:33:18 2627] DEBUG (XendDomainInfo:790) XendDomainInfo.hvm_pci_device_insert_dev: {'slot': '0x00', 'domain': '0x0000', 'key': '04:00.0', 'bus': '0x04', 'vdevfn': '0x100', 'func': '0x0', 'uuid': 'dad43274-946a-6ce9-397a-810ab191684b'}
[2013-05-19 16:33:18 2627] DEBUG (XendDomainInfo:811) XendDomainInfo.hvm_pci_device_insert_dev: 0000:04:00.0@100,msitranslate=1,power_mgmt=1
[2013-05-19 16:33:19 2627] DEBUG (XendDomainInfo:815) pci: assign device 0000:04:00.0@100,msitranslate=1,power_mgmt=1
[2013-05-19 16:33:19 2627] DEBUG (image:508) signalDeviceModel: orig_state is None, retrying
[2013-05-19 16:33:19 2627] INFO (image:538) signalDeviceModel:restore dm state to running
[2013-05-19 16:33:19 2627] INFO (pciquirk:92) NO quirks found for PCI device [104c:8241:0000:0000]
[2013-05-19 16:33:19 2627] DEBUG (pciquirk:135) Permissive mode NOT enabled for PCI device [104c:8241:0000:0000]
[2013-05-19 16:33:19 2627] DEBUG (pciif:334) pci: enabling iomem 0xdfef0000/0x10000 pfn 0xdfef0/0x10
[2013-05-19 16:33:19 2627] DEBUG (pciif:334) pci: enabling iomem 0xdfeee000/0x2000 pfn 0xdfeee/0x2
[2013-05-19 16:33:19 2627] DEBUG (pciif:351) pci: enabling irq 19
[2013-05-19 16:33:19 2627] INFO (pciquirk:92) NO quirks found for PCI device [1002:665c:1458:2269]
[2013-05-19 16:33:19 2627] DEBUG (pciquirk:135) Permissive mode NOT enabled for PCI device [1002:665c:1458:2269]
[2013-05-19 16:33:19 2627] DEBUG (pciif:320) pci: enabling ioport 0xe000/0x100
[2013-05-19 16:33:19 2627] DEBUG (pciif:334) pci: enabling iomem 0xa0000000/0x10000000 pfn 0xa0000/0x10000
[2013-05-19 16:33:19 2627] DEBUG (pciif:334) pci: enabling iomem 0x9f800000/0x800000 pfn 0x9f800/0x800
[2013-05-19 16:33:19 2627] DEBUG (pciif:334) pci: enabling iomem 0xbffc0000/0x40000 pfn 0xbffc0/0x40
[2013-05-19 16:33:19 2627] DEBUG (pciif:334) pci: enabling iomem 0xbffa0000/0x20000 pfn 0xbffa0/0x20
[2013-05-19 16:33:19 2627] DEBUG (pciif:351) pci: enabling irq 16
[2013-05-19 16:33:19 2627] INFO (pciquirk:92) NO quirks found for PCI device [1002:0002:1458:0002]
[2013-05-19 16:33:19 2627] DEBUG (pciquirk:135) Permissive mode NOT enabled for PCI device [1002:0002:1458:0002]
[2013-05-19 16:33:19 2627] DEBUG (pciif:334) pci: enabling iomem 0xbff9c000/0x4000 pfn 0xbff9c/0x4
[2013-05-19 16:33:19 2627] DEBUG (pciif:351) pci: enabling irq 17
[2013-05-19 16:33:19 2627] DEBUG (pciif:456) pci: register aer watch /local/domain/0/backend/pci/1/0/aerState
[2013-05-19 16:33:19 2627] DEBUG (DevController:95) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/pci/1/0'} to /local/domain/1/device/pci/0.
[2013-05-19 16:33:19 2627] DEBUG (DevController:97) DevController: writing {'key-2': '41:00.1', 'key-1': '41:00.0', 'key-0': '04:00.0', 'frontend': '/local/domain/1/device/pci/0', 'domain': 'w8', 'uuid-0': 'dad43274-946a-6ce9-397a-810ab191684b', 'uuid-1': '6fafbe91-e156-b151-3e34-1ed2ae101d83', 'uuid-2': 'd0244089-74c7-07b0-326e-9bcb1e9a07a1', 'uuid': '63b08fc6-44d2-043a-bb4d-bec43e1ff4c8', 'state': '1', 'online': '1', 'opts-2': 'msitranslate=1,power_mgmt=1', 'opts-1': 'msitranslate=1,power_mgmt=1', 'opts-0': 'msitranslate=1,power_mgmt=1', 'dev-2': '0000:41:00.1', 'dev-1': '0000:41:00.0', 'dev-0': '0000:04:00.0', 'vdevfn-0': '100', 'vdevfn-1': '100', 'vdevfn-2': '100', 'frontend-id': '1', 'num_devs': '3'} to /local/domain/0/backend/pci/1/0.
[2013-05-19 16:33:19 2627] DEBUG (pciif:169) Reconfiguring PCI device 0000:04:00.0.
[2013-05-19 16:33:19 2627] INFO (pciquirk:92) NO quirks found for PCI device [104c:8241:0000:0000]
[2013-05-19 16:33:19 2627] DEBUG (pciquirk:135) Permissive mode NOT enabled for PCI device [104c:8241:0000:0000]
[2013-05-19 16:33:19 2627] DEBUG (pciif:334) pci: enabling iomem 0xdfef0000/0x10000 pfn 0xdfef0/0x10
[2013-05-19 16:33:19 2627] DEBUG (pciif:334) pci: enabling iomem 0xdfeee000/0x2000 pfn 0xdfeee/0x2
[2013-05-19 16:33:19 2627] DEBUG (pciif:351) pci: enabling irq 19
[2013-05-19 16:33:19 2627] DEBUG (XendDomainInfo:893) XendDomainInfo.pci_device_configure: ['pci', ['dev', ['slot', '0x00'], ['domain', '0x0000'], ['key', '41:00.0'], ['bus', '0x41'], ['vdevfn', '0x100'], ['func', '0x0'], ['uuid', '6fafbe91-e156-b151-3e34-1ed2ae101d83']], ['state', 'Initialising'], ['sub_state', 'Booting']]
[2013-05-19 16:33:19 2627] DEBUG (XendDomainInfo:779) XendDomainInfo.hvm_pci_device_insert: {'devs': [{'slot': '0x00', 'domain': '0x0000', 'key': '41:00.0', 'bus': '0x41', 'vdevfn': '0x100', 'func': '0x0', 'uuid': '6fafbe91-e156-b151-3e34-1ed2ae101d83'}], 'states': ['Initialising']}
[2013-05-19 16:33:20 2627] DEBUG (XendDomainInfo:790) XendDomainInfo.hvm_pci_device_insert_dev: {'slot': '0x00', 'domain': '0x0000', 'key': '41:00.0', 'bus': '0x41', 'vdevfn': '0x100', 'func': '0x0', 'uuid': '6fafbe91-e156-b151-3e34-1ed2ae101d83'}
[2013-05-19 16:33:20 2627] DEBUG (XendDomainInfo:811) XendDomainInfo.hvm_pci_device_insert_dev: 0000:41:00.0@100,msitranslate=1,power_mgmt=1
[2013-05-19 16:33:20 2627] DEBUG (XendDomainInfo:815) pci: assign device 0000:41:00.0@100,msitranslate=1,power_mgmt=1
[2013-05-19 16:33:20 2627] INFO (image:538) signalDeviceModel:restore dm state to running
[2013-05-19 16:33:20 2627] DEBUG (pciif:169) Reconfiguring PCI device 0000:41:00.0.
[2013-05-19 16:33:20 2627] INFO (pciquirk:92) NO quirks found for PCI device [1002:665c:1458:2269]
[2013-05-19 16:33:20 2627] DEBUG (pciquirk:135) Permissive mode NOT enabled for PCI device [1002:665c:1458:2269]
[2013-05-19 16:33:20 2627] DEBUG (pciif:320) pci: enabling ioport 0xe000/0x100
[2013-05-19 16:33:20 2627] DEBUG (pciif:334) pci: enabling iomem 0xa0000000/0x10000000 pfn 0xa0000/0x10000
[2013-05-19 16:33:20 2627] DEBUG (pciif:334) pci: enabling iomem 0x9f800000/0x800000 pfn 0x9f800/0x800
[2013-05-19 16:33:20 2627] DEBUG (pciif:334) pci: enabling iomem 0xbffc0000/0x40000 pfn 0xbffc0/0x40
[2013-05-19 16:33:20 2627] DEBUG (pciif:334) pci: enabling iomem 0xbffa0000/0x20000 pfn 0xbffa0/0x20
[2013-05-19 16:33:20 2627] DEBUG (pciif:351) pci: enabling irq 16
[2013-05-19 16:33:20 2627] DEBUG (XendDomainInfo:893) XendDomainInfo.pci_device_configure: ['pci', ['dev', ['slot', '0x00'], ['domain', '0x0000'], ['key', '41:00.1'], ['bus', '0x41'], ['vdevfn', '0x100'], ['func', '0x1'], ['uuid', 'd0244089-74c7-07b0-326e-9bcb1e9a07a1']], ['state', 'Initialising'], ['sub_state', 'Booting']]
[2013-05-19 16:33:20 2627] DEBUG (XendDomainInfo:779) XendDomainInfo.hvm_pci_device_insert: {'devs': [{'slot': '0x00', 'domain': '0x0000', 'key': '41:00.1', 'bus': '0x41', 'vdevfn': '0x100', 'func': '0x1', 'uuid': 'd0244089-74c7-07b0-326e-9bcb1e9a07a1'}], 'states': ['Initialising']}
[2013-05-19 16:33:20 2627] DEBUG (XendDomainInfo:790) XendDomainInfo.hvm_pci_device_insert_dev: {'slot': '0x00', 'domain': '0x0000', 'key': '41:00.1', 'bus': '0x41', 'vdevfn': '0x100', 'func': '0x1', 'uuid': 'd0244089-74c7-07b0-326e-9bcb1e9a07a1'}
[2013-05-19 16:33:20 2627] DEBUG (XendDomainInfo:811) XendDomainInfo.hvm_pci_device_insert_dev: 0000:41:00.1@100,msitranslate=1,power_mgmt=1
[2013-05-19 16:33:20 2627] DEBUG (XendDomainInfo:815) pci: assign device 0000:41:00.1@100,msitranslate=1,power_mgmt=1
[2013-05-19 16:33:20 2627] INFO (image:538) signalDeviceModel:restore dm state to running
[2013-05-19 16:33:20 2627] DEBUG (pciif:169) Reconfiguring PCI device 0000:41:00.1.
[2013-05-19 16:33:20 2627] INFO (pciquirk:92) NO quirks found for PCI device [1002:0002:1458:0002]
[2013-05-19 16:33:20 2627] DEBUG (pciquirk:135) Permissive mode NOT enabled for PCI device [1002:0002:1458:0002]
[2013-05-19 16:33:20 2627] DEBUG (pciif:334) pci: enabling iomem 0xbff9c000/0x4000 pfn 0xbff9c/0x4
[2013-05-19 16:33:20 2627] DEBUG (pciif:351) pci: enabling irq 17
[2013-05-19 16:33:20 2627] DEBUG (XendDomainInfo:3420) Storing VM details: {'on_xend_stop': 'ignore', 'pool_name': 'Pool-0', 'shadow_memory': '68', 'uuid': '0b10a5d5-ce1f-46a2-9d98-46e9ef2af87e', 'on_reboot': 'restart', 'start_time': '1368974000.9', 'on_poweroff': 'destroy', 'bootloader_args': '', 'on_xend_start': 'ignore', 'on_crash': 'restart', 'xend/restart_count': '0', 'vcpus': '4', 'vcpu_avail': '15', 'bootloader': '', 'image': "(hvm (kernel '') (superpages 0) (videoram 4) (hpet 0) (stdvga 0) (loader /usr/lib/xen-4.1/boot/hvmloader) (xen_platform_pci 1) (rtc_timeoffset 0) (pci ((0x0000 0x04 0x00 0x0 0x100 ()) (0x0000 0x41 0x00 0x0 0x100 ()) (0x0000 0x41 0x00 0x1 0x100 ()))) (hap 1) (localtime 0) (timer_mode 1) (pci_msitranslate 1) (oos 1) (apic 1) (usbdevice tablet) (display :0.0) (vpt_align 1) (vncunused 1) (boot cd) (pae 1) (viridian 1) (acpi 1) (vnc 1) (nographic 0) (nomigrate 0) (usb 1) (tsc_mode 0) (guest_os_type default) (device_model /usr/lib/xen-4.1/bin/qemu-dm) (keymap sv) (pci_power_mgmt 1) (xauthority /home/andreas/.Xauthority) (isa 0) (notes (SUSPEND_CANCEL 1)))", 'name': 'w8'}
[2013-05-19 16:33:20 2627] DEBUG (XendDomainInfo:1794) Storing domain details: {'console/port': '6', 'cpu/3/availability': 'online', 'description': '', 'console/limit': '1048576', 'store/port': '5', 'cpu/2/availability': 'online', 'vm': '/vm/0b10a5d5-ce1f-46a2-9d98-46e9ef2af87e', 'domid': '1', 'image/suspend-cancel': '1', 'cpu/0/availability': 'online', 'memory/target': '8388608', 'control/platform-feature-multiprocessor-suspend': '1', 'store/ring-ref': '1044476', 'cpu/1/availability': 'online', 'console/type': 'ioemu', 'name': 'w8'}
[2013-05-19 16:33:20 2627] DEBUG (DevController:95) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/console/1/0'} to /local/domain/1/device/console/0.
[2013-05-19 16:33:21 2627] DEBUG (DevController:97) DevController: writing {'domain': 'w8', 'frontend': '/local/domain/1/device/console/0', 'uuid': '1a5e1d8e-69a3-30f7-a8e4-eae3b8a5c01c', 'frontend-id': '1', 'state': '1', 'location': '6', 'online': '1', 'protocol': 'vt100'} to /local/domain/0/backend/console/1/0.
[2013-05-19 16:33:21 2627] DEBUG (pciif:460) XendDomainInfo.handleAerStateWatch
[2013-05-19 16:33:21 2627] DEBUG (DevController:139) Waiting for devices tap2.
[2013-05-19 16:33:21 2627] DEBUG (XendDomainInfo:1881) XendDomainInfo.handleShutdownWatch
[2013-05-19 16:33:21 2627] DEBUG (DevController:139) Waiting for devices vif.
[2013-05-19 16:33:21 2627] DEBUG (DevController:144) Waiting for 0.
[2013-05-19 16:33:21 2627] DEBUG (DevController:628) hotplugStatusCallback /local/domain/0/backend/vif/1/0/hotplug-status.
[2013-05-19 16:33:21 2627] DEBUG (DevController:642) hotplugStatusCallback 1.
[2013-05-19 16:33:21 2627] DEBUG (DevController:139) Waiting for devices vkbd.
[2013-05-19 16:33:21 2627] DEBUG (DevController:139) Waiting for devices ioports.
[2013-05-19 16:33:21 2627] DEBUG (DevController:139) Waiting for devices tap.
[2013-05-19 16:33:21 2627] DEBUG (DevController:139) Waiting for devices vif2.
[2013-05-19 16:33:21 2627] DEBUG (DevController:139) Waiting for devices console.
[2013-05-19 16:33:21 2627] DEBUG (DevController:144) Waiting for 0.
[2013-05-19 16:33:21 2627] DEBUG (DevController:139) Waiting for devices vscsi.
[2013-05-19 16:33:21 2627] DEBUG (DevController:139) Waiting for devices vbd.
[2013-05-19 16:33:21 2627] DEBUG (DevController:144) Waiting for 768.
[2013-05-19 16:33:21 2627] DEBUG (DevController:628) hotplugStatusCallback /local/domain/0/backend/vbd/1/768/hotplug-status.
[2013-05-19 16:33:21 2627] DEBUG (DevController:642) hotplugStatusCallback 1.
[2013-05-19 16:33:21 2627] DEBUG (DevController:144) Waiting for 832.
[2013-05-19 16:33:21 2627] DEBUG (DevController:628) hotplugStatusCallback /local/domain/0/backend/vbd/1/832/hotplug-status.
[2013-05-19 16:33:21 2627] DEBUG (DevController:642) hotplugStatusCallback 1.
[2013-05-19 16:33:21 2627] DEBUG (DevController:144) Waiting for 5632.
[2013-05-19 16:33:21 2627] DEBUG (DevController:628) hotplugStatusCallback /local/domain/0/backend/vbd/1/5632/hotplug-status.
[2013-05-19 16:33:21 2627] DEBUG (DevController:642) hotplugStatusCallback 1.
[2013-05-19 16:33:21 2627] DEBUG (DevController:139) Waiting for devices irq.
[2013-05-19 16:33:21 2627] DEBUG (DevController:139) Waiting for devices vfb.
[2013-05-19 16:33:21 2627] DEBUG (DevController:139) Waiting for devices pci.
[2013-05-19 16:33:21 2627] DEBUG (DevController:144) Waiting for 0.
[2013-05-19 16:33:21 2627] DEBUG (DevController:139) Waiting for devices vusb.
[2013-05-19 16:33:21 2627] DEBUG (DevController:139) Waiting for devices vtpm.
[2013-05-19 16:33:21 2627] INFO (XendDomain:1225) Domain w8 (1) unpaused.

[-- Attachment #3: xm_dmesg_debug-after_jans_patch --]
[-- Type: application/octet-stream, Size: 45476 bytes --]

(XEN) Xen version 4.1.3 (Ubuntu 4.1.3-3ubuntu1.5) (stefan.bader@canonical.com) (gcc version 4.7.2 (Ubuntu/Linaro 4.7.2-2ubuntu1) ) Sat May 18 18:43:47 CEST 2013
(XEN) Bootloader: GRUB 2.00-7ubuntu11
(XEN) Command line: placeholder dom0_mem=16G,max:24G dom0_max_vcpus=12 dom0_vcpus_pin loglvl=all guest_loglvl=all
(XEN) Video information:
(XEN)  VGA is text mode 80x25, font 8x16
(XEN)  VBE/DDC methods: V2; EDID transfer time: 1 seconds
(XEN) Disc information:
(XEN)  Found 2 MBR signatures
(XEN)  Found 2 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 0000000000099400 (usable)
(XEN)  0000000000099400 - 00000000000a0000 (reserved)
(XEN)  00000000000e6000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 0000000097e80000 (usable)
(XEN)  0000000097e8e000 - 0000000097e90000 type 9
(XEN)  0000000097e90000 - 0000000097eb4000 (ACPI data)
(XEN)  0000000097eb4000 - 0000000097ee0000 (ACPI NVS)
(XEN)  0000000097ee0000 - 0000000098000000 (reserved)
(XEN)  00000000e0000000 - 00000000f0000000 (reserved)
(XEN)  00000000ffe00000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 0000000868000000 (usable)
(XEN) ACPI: RSDP 000FA650, 0024 (r2 ACPIAM)
(XEN) ACPI: XSDT 97E90100, 008C (r1 SMCI            20130306 MSFT       97)
(XEN) ACPI: FACP 97E90290, 00F4 (r3 030613 FACP1401 20130306 MSFT       97)
(XEN) ACPI: DSDT 97E906B0, 7040 (r1  1BC11 1BC11000        0 INTL 20051117)
(XEN) ACPI: FACS 97EB4000, 0040
(XEN) ACPI: APIC 97E90390, 0158 (r1 030613 APIC1401 20130306 MSFT       97)
(XEN) ACPI: MCFG 97E904F0, 003C (r1 030613 OEMMCFG  20130306 MSFT       97)
(XEN) ACPI: OEMB 97EB4040, 00BC (r1 030613 OEMB1401 20130306 MSFT       97)
(XEN) ACPI: HPET 97E9A6B0, 0038 (r1 030613 OEMHPET  20130306 MSFT       97)
(XEN) ACPI: IVRS 97E9A6F0, 00EC (r1  AMD     RD890S   202031 AMD         0)
(XEN) ACPI: SRAT 97E9A7E0, 0220 (r2 AMD    AGESA           1 AMD         1)
(XEN) ACPI: SLIT 97E9AA00, 003C (r1 AMD    AGESA           1 AMD         1)
(XEN) ACPI: SSDT 97E9AA40, 2914 (r1 A M I  POWERNOW        1 AMD         1)
(XEN) ACPI: EINJ 97E9D360, 0130 (r1  AMIER AMI_EINJ 20130306 MSFT       97)
(XEN) ACPI: BERT 97E9D4F0, 0030 (r1  AMIER AMI_BERT 20130306 MSFT       97)
(XEN) ACPI: ERST 97E9D520, 0210 (r1  AMIER AMI_ERST 20130306 MSFT       97)
(XEN) ACPI: HEST 97E9D730, 00A8 (r1  AMIER ABC_HEST 20130306 MSFT       97)
(XEN) System RAM: 32766MB (33552484kB)
(XEN) SRAT: PXM 0 -> APIC 16 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 17 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 18 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 19 -> Node 0
(XEN) SRAT: PXM 1 -> APIC 20 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 21 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 22 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 23 -> Node 1
(XEN) SRAT: PXM 2 -> APIC 36 -> Node 2
(XEN) SRAT: PXM 2 -> APIC 37 -> Node 2
(XEN) SRAT: PXM 2 -> APIC 38 -> Node 2
(XEN) SRAT: PXM 2 -> APIC 39 -> Node 2
(XEN) SRAT: PXM 3 -> APIC 32 -> Node 3
(XEN) SRAT: PXM 3 -> APIC 33 -> Node 3
(XEN) SRAT: PXM 3 -> APIC 34 -> Node 3
(XEN) SRAT: PXM 3 -> APIC 35 -> Node 3
(XEN) SRAT: Node 0 PXM 0 0-a0000
(XEN) SRAT: Node 0 PXM 0 100000-98000000
(XEN) SRAT: Node 0 PXM 0 100000000-268000000
(XEN) SRAT: Node 1 PXM 1 268000000-468000000
(XEN) SRAT: Node 2 PXM 2 468000000-668000000
(XEN) SRAT: Node 3 PXM 3 668000000-868000000
(XEN) NUMA: Allocated memnodemap from 863ee1000 - 863eea000
(XEN) NUMA: Using 8 for the hash shift.
(XEN) Domain heap initialised DMA width 31 bits
(XEN) found SMP MP-table at 000ff780
(XEN) DMI present.
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x808
(XEN) ACPI: ACPI SLEEP INFO: pm1x_cnt[804,0], pm1x_evt[800,0]
(XEN) ACPI:                  wakeup_vec[97eb400c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x10] enabled)
(XEN) Processor #16 0:9 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x11] enabled)
(XEN) Processor #17 0:9 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled)
(XEN) Processor #18 0:9 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x13] enabled)
(XEN) Processor #19 0:9 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x14] enabled)
(XEN) Processor #20 0:9 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x15] enabled)
(XEN) Processor #21 0:9 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x16] enabled)
(XEN) Processor #22 0:9 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x17] enabled)
(XEN) Processor #23 0:9 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x20] enabled)
(XEN) Processor #32 0:9 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x21] enabled)
(XEN) Processor #33 0:9 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x22] enabled)
(XEN) Processor #34 0:9 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x23] enabled)
(XEN) Processor #35 0:9 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x24] enabled)
(XEN) Processor #36 0:9 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x25] enabled)
(XEN) Processor #37 0:9 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x26] enabled)
(XEN) Processor #38 0:9 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x10] lapic_id[0x27] enabled)
(XEN) Processor #39 0:9 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x11] lapic_id[0x90] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x12] lapic_id[0x91] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x13] lapic_id[0x92] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x14] lapic_id[0x93] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x15] lapic_id[0x94] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x16] lapic_id[0x95] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x17] lapic_id[0x96] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x18] lapic_id[0x97] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x19] lapic_id[0x98] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x99] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x9a] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x9b] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x9c] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x9d] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x9e] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x20] lapic_id[0x9f] disabled)
(XEN) ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
(XEN) Overriding APIC driver with bigsmp
(XEN) ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 0, version 33, address 0xfec00000, GSI 0-23
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) ACPI: IRQ9 used by override.
(XEN) Enabling APIC mode:  Phys.  Using 1 I/O APICs
(XEN) ACPI: HPET id: 0x8300 base: 0xfed00000
(XEN) PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
(XEN) PCI: MCFG area at e0000000 reserved in E820
(XEN) ERST table is invalid
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) IRQ limits: 24 GSI, 3064 MSI/MSI-X
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 2300.071 MHz processor.
(XEN) Initing memory sharing.
(XEN) AMD Fam10h machine check reporting enabled
(XEN) AMD-Vi: IOMMU 0 Enabled.
(XEN) AMD-Vi: IOMMU 1 Enabled.
(XEN) AMD-Vi: Enabling per-device vector maps
(XEN) I/O virtualisation enabled
(XEN)  - Dom0 mode: Relaxed
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using new ACK method
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) Platform timer appears to have unexpectedly wrapped 10 or more times.
(XEN) Platform timer is 14.318MHz HPET
(XEN) Allocated console ring of 128 KiB.
(XEN) HVM: ASIDs enabled.
(XEN) SVM: Supported advanced features:
(XEN)  - Nested Page Tables (NPT)
(XEN)  - Last Branch Record (LBR) Virtualisation
(XEN)  - Next-RIP Saved on #VMEXIT
(XEN)  - Pause-Intercept Filter
(XEN) HVM: SVM enabled
(XEN) HVM: Hardware Assisted Paging (HAP) detected
(XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB
(XEN) Brought up 16 CPUs
(XEN) HPET's MSI mode hasn't been supported when Interrupt Remapping is enabled.
(XEN) ACPI sleep modes: S3
(XEN) mcheck_poll: Machine check polling timer started.
(XEN) mtrr: your CPUs had inconsistent variable MTRR settings
(XEN) mtrr: probably your BIOS does not setup all CPUs.
(XEN) mtrr: corrected configuration.
(XEN) Xenoprofile: AMD IBS detected (0x0000001f)
(XEN) *** LOADING DOMAIN 0 ***
(XEN)  Xen  kernel: 64-bit, lsb, compat32
(XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x234f000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   0000000258000000->0000000260000000 (4150953 pages to be allocated)
(XEN)  Init. ramdisk: 00000008656a9000->0000000867fff200
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: ffffffff81000000->ffffffff8234f000
(XEN)  Init. ramdisk: ffffffff8234f000->ffffffff84ca5200
(XEN)  Phys-Mach map: ffffffff84ca6000->ffffffff86ca6000
(XEN)  Start info:    ffffffff86ca6000->ffffffff86ca64b4
(XEN)  Page tables:   ffffffff86ca7000->ffffffff86ce2000
(XEN)  Boot stack:    ffffffff86ce2000->ffffffff86ce3000
(XEN)  TOTAL:         ffffffff80000000->ffffffff87000000
(XEN)  ENTRY ADDRESS: ffffffff81cf2210
(XEN) Dom0 has maximum 12 VCPUs
(XEN) Scrubbing Free RAM: .............................................................................................................................................................done.
(XEN) Xen trace buffers: disabled
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: All
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
(XEN) Freed 216kB init memory.
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index9, map->pirq9, map->bus32, map->devfn0, map->entry_nr-2118115656
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=0 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq9, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 9
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index1, map->pirq1, map->bus-2130479602, map->devfn-1, map->entry_nr-2118115592
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=0 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq1, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 1
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index2, map->pirq2, map->bus-2130479602, map->devfn-1, map->entry_nr-2118115592
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=2 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq2, pirq2
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 2
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index3, map->pirq3, map->bus-2130479602, map->devfn-1, map->entry_nr-2118115592
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=0 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq3, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 3
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index4, map->pirq4, map->bus-2130479602, map->devfn-1, map->entry_nr-2118115592
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=0 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq4, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 4
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index5, map->pirq5, map->bus-2130479602, map->devfn-1, map->entry_nr-2118115592
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=0 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq5, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 5
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index6, map->pirq6, map->bus-2130479602, map->devfn-1, map->entry_nr-2118115592
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=0 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq6, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 6
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index7, map->pirq7, map->bus-2130479602, map->devfn-1, map->entry_nr-2118115592
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=0 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq7, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 7
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index8, map->pirq8, map->bus-2130479602, map->devfn-1, map->entry_nr-2118115592
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=0 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq8, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 8
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index10, map->pirq10, map->bus-2130479602, map->devfn-1, map->entry_nr-2118115592
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=0 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq10, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 10
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index11, map->pirq11, map->bus-2130479602, map->devfn-1, map->entry_nr-2118115592
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=0 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq11, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 11
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index12, map->pirq12, map->bus-2130479602, map->devfn-1, map->entry_nr-2118115592
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=0 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq12, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 12
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index13, map->pirq13, map->bus-2130479602, map->devfn-1, map->entry_nr-2118115592
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=0 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq13, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 13
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index14, map->pirq14, map->bus-2130479602, map->devfn-1, map->entry_nr-2118115592
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=0 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq14, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 14
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index15, map->pirq15, map->bus-2130479602, map->devfn-1, map->entry_nr-2118115592
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=0 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq15, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 15
(XEN) traps.c:2488:d0 Domain attempted WRMSR 00000000c0010004 from 0x0000000000000000 to 0x000000000000abcd.
(XEN) PCI add device 00:00.0
(XEN) PCI add device 00:00.2
(XEN) PCI add device 00:02.0
(XEN) PCI add device 00:0b.0
(XEN) PCI add device 00:0c.0
(XEN) PCI add device 00:0d.0
(XEN) PCI add device 00:11.0
(XEN) PCI add device 00:12.0
(XEN) PCI add device 00:12.1
(XEN) PCI add device 00:12.2
(XEN) PCI add device 00:13.0
(XEN) PCI add device 00:13.1
(XEN) PCI add device 00:13.2
(XEN) PCI add device 00:14.0
(XEN) PCI add device 00:14.1
(XEN) PCI add device 00:14.3
(XEN) PCI add device 00:14.4
(XEN) PCI add device 00:14.5
(XEN) PCI add device 00:18.0
(XEN) PCI add device 00:18.1
(XEN) PCI add device 00:18.2
(XEN) PCI add device 00:18.3
(XEN) PCI add device 00:18.4
(XEN) PCI add device 00:19.0
(XEN) PCI add device 00:19.1
(XEN) PCI add device 00:19.2
(XEN) PCI add device 00:19.3
(XEN) PCI add device 00:19.4
(XEN) PCI add device 00:1a.0
(XEN) PCI add device 00:1a.1
(XEN) PCI add device 00:1a.2
(XEN) PCI add device 00:1a.3
(XEN) PCI add device 00:1a.4
(XEN) PCI add device 00:1b.0
(XEN) PCI add device 00:1b.1
(XEN) PCI add device 00:1b.2
(XEN) PCI add device 00:1b.3
(XEN) PCI add device 00:1b.4
(XEN) PCI add device 05:00.0
(XEN) PCI add device 05:00.1
(XEN) PCI add device 04:00.0
(XEN) PCI add device 03:00.0
(XEN) PCI add device 02:00.0
(XEN) PCI add device 02:00.1
(XEN) PCI add device 01:04.0
(XEN) PCI add device 40:00.0
(XEN) PCI add device 40:00.2
(XEN) PCI add device 40:0b.0
(XEN) PCI add device 41:00.0
(XEN) PCI add device 41:00.1
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index18, map->pirq18, map->bus32, map->devfn0, map->entry_nr1100168384
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=0 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq18, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 18
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index19, map->pirq19, map->bus32, map->devfn0, map->entry_nr1100168384
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=0 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq19, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 19
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index16, map->pirq16, map->bus32, map->devfn0, map->entry_nr1100168384
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=0 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq16, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 16
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index17, map->pirq17, map->bus32, map->devfn0, map->entry_nr1100168384
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=0 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq17, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 17
(XEN) physdev.c:98: AF1: map->domid32752, map->type3, map->index-1, map->pirq-1, map->bus64, map->devfn88, map->entry_nr0
(XEN) physdev.c:179: dom0: wrong map_pirq type 3
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus64, map->devfn88, map->entry_nr0
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=279
(XEN) physdev.c:236: AF6: final map->pirq: 279
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus4, map->devfn0, map->entry_nr0
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=278
(XEN) physdev.c:236: AF6: final map->pirq: 278
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus4, map->devfn0, map->entry_nr1
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=277
(XEN) physdev.c:236: AF6: final map->pirq: 277
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus4, map->devfn0, map->entry_nr2
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=276
(XEN) physdev.c:236: AF6: final map->pirq: 276
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus4, map->devfn0, map->entry_nr3
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=275
(XEN) physdev.c:236: AF6: final map->pirq: 275
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus4, map->devfn0, map->entry_nr4
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=274
(XEN) physdev.c:236: AF6: final map->pirq: 274
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus4, map->devfn0, map->entry_nr5
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=273
(XEN) physdev.c:236: AF6: final map->pirq: 273
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus4, map->devfn0, map->entry_nr6
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=272
(XEN) physdev.c:236: AF6: final map->pirq: 272
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus4, map->devfn0, map->entry_nr7
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=271
(XEN) physdev.c:236: AF6: final map->pirq: 271
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus3, map->devfn0, map->entry_nr0
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=270
(XEN) physdev.c:236: AF6: final map->pirq: 270
(XEN) physdev.c:98: AF1: map->domid32752, map->type1, map->index22, map->pirq22, map->bus32, map->devfn0, map->entry_nr1031158656
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=0 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq22, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 22
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus2, map->devfn0, map->entry_nr0
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=269
(XEN) physdev.c:236: AF6: final map->pirq: 269
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus2, map->devfn0, map->entry_nr1
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=268
(XEN) physdev.c:236: AF6: final map->pirq: 268
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus2, map->devfn0, map->entry_nr2
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=267
(XEN) physdev.c:236: AF6: final map->pirq: 267
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus2, map->devfn0, map->entry_nr3
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=266
(XEN) physdev.c:236: AF6: final map->pirq: 266
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus2, map->devfn0, map->entry_nr4
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=265
(XEN) physdev.c:236: AF6: final map->pirq: 265
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus2, map->devfn0, map->entry_nr5
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=264
(XEN) physdev.c:236: AF6: final map->pirq: 264
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus2, map->devfn0, map->entry_nr6
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=263
(XEN) physdev.c:236: AF6: final map->pirq: 263
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus2, map->devfn0, map->entry_nr7
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=262
(XEN) physdev.c:236: AF6: final map->pirq: 262
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus2, map->devfn0, map->entry_nr8
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=261
(XEN) physdev.c:236: AF6: final map->pirq: 261
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus2, map->devfn1, map->entry_nr0
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=260
(XEN) physdev.c:236: AF6: final map->pirq: 260
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus2, map->devfn1, map->entry_nr1
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=259
(XEN) physdev.c:236: AF6: final map->pirq: 259
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus2, map->devfn1, map->entry_nr2
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=258
(XEN) physdev.c:236: AF6: final map->pirq: 258
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus2, map->devfn1, map->entry_nr3
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=257
(XEN) physdev.c:236: AF6: final map->pirq: 257
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus2, map->devfn1, map->entry_nr4
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=256
(XEN) physdev.c:236: AF6: final map->pirq: 256
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus2, map->devfn1, map->entry_nr5
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=255
(XEN) physdev.c:236: AF6: final map->pirq: 255
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus2, map->devfn1, map->entry_nr6
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=254
(XEN) physdev.c:236: AF6: final map->pirq: 254
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus2, map->devfn1, map->entry_nr7
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=253
(XEN) physdev.c:236: AF6: final map->pirq: 253
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus2, map->devfn1, map->entry_nr8
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=252
(XEN) physdev.c:236: AF6: final map->pirq: 252
(XEN) physdev.c:98: AF1: map->domid32752, map->type0, map->index-1, map->pirq-1, map->bus5, map->devfn0, map->entry_nr0
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=251
(XEN) physdev.c:236: AF6: final map->pirq: 251
(XEN) physdev.c:98: AF1: map->domid1, map->type1, map->index19, map->pirq19, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=19 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq19, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 19
(XEN) physdev.c:98: AF1: map->domid1, map->type0, map->index-1, map->pirq-1, map->bus4, map->devfn0, map->entry_nr0
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=55
(XEN) physdev.c:236: AF6: final map->pirq: 55
(XEN) physdev.c:98: AF1: map->domid1, map->type1, map->index19, map->pirq19, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=19 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq19, pirq19
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 19
(XEN) physdev.c:98: AF1: map->domid1, map->type1, map->index16, map->pirq16, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=16 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq16, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 16
(XEN) physdev.c:98: AF1: map->domid1, map->type1, map->index17, map->pirq17, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=17 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq17, pirq0
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 17
(XEN) physdev.c:98: AF1: map->domid1, map->type1, map->index19, map->pirq19, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=19 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq19, pirq19
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 19
(XEN) physdev.c:98: AF1: map->domid1, map->type1, map->index16, map->pirq16, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=16 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq16, pirq16
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 16
(XEN) physdev.c:98: AF1: map->domid1, map->type0, map->index-1, map->pirq-1, map->bus65, map->devfn0, map->entry_nr0
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=54
(XEN) physdev.c:236: AF6: final map->pirq: 54
(XEN) physdev.c:98: AF1: map->domid1, map->type1, map->index16, map->pirq16, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=16 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq16, pirq16
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 16
(XEN) physdev.c:98: AF1: map->domid1, map->type1, map->index17, map->pirq17, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=17 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq17, pirq17
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 17
(XEN) physdev.c:98: AF1: map->domid1, map->type0, map->index-1, map->pirq-1, map->bus65, map->devfn1, map->entry_nr0
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=53
(XEN) physdev.c:236: AF6: final map->pirq: 53
(XEN) physdev.c:98: AF1: map->domid1, map->type1, map->index17, map->pirq17, map->bus0, map->devfn0, map->entry_nr0
(XEN) physdev.c:131: AF2: map->type=GSI
(XEN) physdev.c:141: AF2.5: found irq=17 (if <= 0, irq will be set to map->index instead or fail with error)
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq17, pirq17
(XEN) physdev.c:227: AF5: else case instead of EEXIST error
(XEN) physdev.c:236: AF6: final map->pirq: 17
(XEN) HVM1: HVM Loader
(XEN) HVM1: Detected Xen v4.1.3
(XEN) HVM1: CPU speed is 2300 MHz
(XEN) HVM1: Xenbus rings @0xfeffc000, event channel 5
(XEN) irq.c:264: Dom1 PCI link 0 changed 0 -> 5
(XEN) HVM1: PCI-ISA link 0 routed to IRQ5
(XEN) irq.c:264: Dom1 PCI link 1 changed 0 -> 10
(XEN) HVM1: PCI-ISA link 1 routed to IRQ10
(XEN) irq.c:264: Dom1 PCI link 2 changed 0 -> 11
(XEN) HVM1: PCI-ISA link 2 routed to IRQ11
(XEN) irq.c:264: Dom1 PCI link 3 changed 0 -> 5
(XEN) HVM1: PCI-ISA link 3 routed to IRQ5
(XEN) HVM1: pci dev 01:2 INTD->IRQ5
(XEN) HVM1: pci dev 01:3 INTA->IRQ10
(XEN) HVM1: pci dev 03:0 INTA->IRQ5
(XEN) HVM1: pci dev 04:0 INTA->IRQ5
(XEN) HVM1: pci dev 05:0 INTA->IRQ10
(XEN) HVM1: pci dev 06:0 INTA->IRQ11
(XEN) HVM1: pci dev 07:0 INTB->IRQ5
(XEN) HVM1: pci dev 06:0 bar 10 size 10000000: e000000c
(XEN) domctl.c:993:d0 memory_map:add: gfn=e0000 mfn=a0000 nr_mfns=10000
(XEN) HVM1: pci dev 02:0 bar 10 size 02000000: f0000008
(XEN) HVM1: pci dev 03:0 bar 14 size 01000000: f2000008
(XEN) domctl.c:993:d0 memory_map:add: gfn=f3000 mfn=9f800 nr_mfns=800
(XEN) HVM1: pci dev 06:0 bar 18 size 00800000: f300000c
(XEN) domctl.c:993:d0 memory_map:add: gfn=f3800 mfn=bffc0 nr_mfns=40
(XEN) HVM1: pci dev 06:0 bar 24 size 00040000: f3800000
(XEN) HVM1: pci dev 04:0 bar 10 size 00020000: f3840000
(XEN) HVM1: pci dev 06:0 bar 30 size 00020000: f3860000
(XEN) HVM1: pci dev 05:0 bar 10 size 00010000: f3880004
(XEN) domctl.c:993:d0 memory_map:add: gfn=f3880 mfn=dfef0 nr_mfns=10
(XEN) HVM1: pci dev 07:0 bar 10 size 00004000: f3890004
(XEN) domctl.c:993:d0 memory_map:add: gfn=f3890 mfn=bff9c nr_mfns=4
(XEN) domctl.c:993:d0 memory_map:add: gfn=f3894 mfn=dfeee nr_mfns=2
(XEN) domctl.c:1003:d0 memory_map:remove: gfn=f3894 mfn=dfeee nr_mfns=1
(XEN) HVM1: pci dev 05:0 bar 18 size 00002000: f3894004
(XEN) HVM1: pci dev 02:0 bar 14 size 00001000: f3896000
(XEN) HVM1: pci dev 03:0 bar 10 size 00000100: 0000c001
(XEN) HVM1: pci dev 06:0 bar 20 size 00000100: 0000c101
(XEN) domctl.c:1049:d0 ioport_map:add f_gport=c100 f_mport=e000 np=100
(XEN) HVM1: pci dev 04:0 bar 14 size 00000040: 0000c201
(XEN) HVM1: pci dev 01:2 bar 20 size 00000020: 0000c241
(XEN) HVM1: pci dev 01:1 bar 20 size 00000010: 0000c261
(XEN) HVM1: Multiprocessor initialisation:
(XEN) HVM1:  - CPU0 ... 48-bit phys ... fixed MTRRs ... var MTRRs [3/8] ... done.
(XEN) HVM1:  - CPU1 ... 48-bit phys ... fixed MTRRs ... var MTRRs [3/8] ... done.
(XEN) HVM1:  - CPU2 ... 48-bit phys ... fixed MTRRs ... var MTRRs [3/8] ... done.
(XEN) HVM1:  - CPU3 ... 48-bit phys ... fixed MTRRs ... var MTRRs [3/8] ... done.
(XEN) HVM1: Writing SMBIOS tables ...
(XEN) HVM1: Loading ROMBIOS ...
(XEN) HVM1: 12604 bytes of ROMBIOS high-memory extensions:
(XEN) HVM1:   Relocating to 0xfc000000-0xfc00313c ... done
(XEN) HVM1: Creating MP tables ...
(XEN) HVM1: Loading Cirrus VGABIOS ...
(XEN) HVM1: Loading PCI Option ROM ...
(XEN) HVM1:  - Manufacturer: http://ipxe.org
(XEN) HVM1:  - Product name: iPXE
(XEN) HVM1: Loading ACPI ...
(XEN) HVM1:  - Lo data: 000ea020-000ea04f
(XEN) HVM1:  - Hi data: fc003400-fc00f31f
(XEN) HVM1: vm86 TSS at fc00f400
(XEN) HVM1: BIOS map:
(XEN) HVM1:  c0000-c8fff: VGA BIOS
(XEN) HVM1:  c9000-da7ff: Etherboot ROM
(XEN) HVM1:  eb000-eb1b7: SMBIOS tables
(XEN) HVM1:  f0000-fffff: Main BIOS
(XEN) HVM1: E820 table:
(XEN) HVM1:  [00]: 00000000:00000000 - 00000000:0009e000: RAM
(XEN) HVM1:  [01]: 00000000:0009e000 - 00000000:0009fc00: RESERVED
(XEN) HVM1:  [02]: 00000000:0009fc00 - 00000000:000a0000: RESERVED
(XEN) HVM1:  HOLE: 00000000:000a0000 - 00000000:000e0000
(XEN) HVM1:  [03]: 00000000:000e0000 - 00000000:00100000: RESERVED
(XEN) HVM1:  [04]: 00000000:00100000 - 00000000:e0000000: RAM
(XEN) HVM1:  HOLE: 00000000:e0000000 - 00000000:fc000000
(XEN) HVM1:  [05]: 00000000:fc000000 - 00000001:00000000: RESERVED
(XEN) HVM1:  [06]: 00000001:00000000 - 00000002:20000000: RAM
(XEN) HVM1: Invoking ROMBIOS ...
(XEN) HVM1: $Revision: 1.221 $ $Date: 2008/12/07 17:32:29 $
(XEN) stdvga.c:147:d1 entering stdvga and caching modes
(XEN) HVM1: VGABios $Id: vgabios.c,v 1.67 2008/01/27 09:44:12 vruppert Exp $
(XEN) HVM1: Bochs BIOS - build: 06/23/99
(XEN) HVM1: $Revision: 1.221 $ $Date: 2008/12/07 17:32:29 $
(XEN) HVM1: Options: apmbios pcibios eltorito PMM 
(XEN) HVM1: 
(XEN) HVM1: ata0-0: PCHS=16383/16/63 translation=lba LCHS=1024/255/63
(XEN) HVM1: ata0 master: QEMU HARDDISK ATA-7 Hard-Disk ( 120 GBytes)
(XEN) HVM1: ata0-1: PCHS=16383/16/63 translation=lba LCHS=1024/255/63
(XEN) HVM1: ata0  slave: QEMU HARDDISK ATA-7 Hard-Disk ( 200 GBytes)
(XEN) HVM1: ata1 master: QEMU DVD-ROM ATAPI-4 CD-Rom/DVD-Rom
(XEN) HVM1: IDE time out
(XEN) HVM1: 
(XEN) HVM1: 
(XEN) HVM1: 
(XEN) HVM1: Press F12 for boot menu.
(XEN) HVM1: 
(XEN) HVM1: Booting from Hard Disk...
(XEN) HVM1: Booting from 0000:7c00
(XEN) stdvga.c:151:d1 leaving stdvga
(XEN) viridian.c:145:d1 Guest os:
(XEN) viridian.c:147:d1 	vendor: 1
(XEN) viridian.c:149:d1 	os: 4
(XEN) viridian.c:151:d1 	major: 6
(XEN) viridian.c:153:d1 	minor: 2
(XEN) viridian.c:155:d1 	sp: 0
(XEN) viridian.c:157:d1 	build: 23f0
(XEN) viridian.c:162:d1 Set hypercall page 4001.
(XEN) irq.c:264: Dom1 PCI link 1 changed 10 -> 0
(XEN) irq.c:264: Dom1 PCI link 2 changed 11 -> 0
(XEN) irq.c:264: Dom1 PCI link 3 changed 5 -> 0
(XEN) irq.c:264: Dom1 PCI link 0 changed 5 -> 0
(XEN) domctl.c:1003:d0 memory_map:remove: gfn=f3880 mfn=dfef0 nr_mfns=10
(XEN) domctl.c:993:d0 memory_map:add: gfn=f3894 mfn=dfeee nr_mfns=1
(XEN) domctl.c:1003:d0 memory_map:remove: gfn=f3894 mfn=dfeee nr_mfns=2
(XEN) domctl.c:993:d0 memory_map:add: gfn=f3880 mfn=dfef0 nr_mfns=10
(XEN) domctl.c:993:d0 memory_map:add: gfn=f3894 mfn=dfeee nr_mfns=2
(XEN) domctl.c:1003:d0 memory_map:remove: gfn=f3894 mfn=dfeee nr_mfns=1
(XEN) domctl.c:1003:d0 memory_map:remove: gfn=e0000 mfn=a0000 nr_mfns=10000
(XEN) domctl.c:1003:d0 memory_map:remove: gfn=f3000 mfn=9f800 nr_mfns=800
(XEN) domctl.c:1073:d0 ioport_map:remove f_gport=c100 f_mport=e000 np=100
(XEN) domctl.c:1003:d0 memory_map:remove: gfn=f3800 mfn=bffc0 nr_mfns=40
(XEN) domctl.c:993:d0 memory_map:add: gfn=e0000 mfn=a0000 nr_mfns=10000
(XEN) domctl.c:993:d0 memory_map:add: gfn=f3000 mfn=9f800 nr_mfns=800
(XEN) domctl.c:1049:d0 ioport_map:add f_gport=c100 f_mport=e000 np=100
(XEN) domctl.c:993:d0 memory_map:add: gfn=f3800 mfn=bffc0 nr_mfns=40
(XEN) domctl.c:1003:d0 memory_map:remove: gfn=f3890 mfn=bff9c nr_mfns=4
(XEN) domctl.c:993:d0 memory_map:add: gfn=f3890 mfn=bff9c nr_mfns=4
(XEN) domctl.c:1003:d0 memory_map:remove: gfn=e0000 mfn=a0000 nr_mfns=10000
(XEN) domctl.c:1003:d0 memory_map:remove: gfn=f3000 mfn=9f800 nr_mfns=800
(XEN) domctl.c:1073:d0 ioport_map:remove f_gport=c100 f_mport=e000 np=100
(XEN) domctl.c:1003:d0 memory_map:remove: gfn=f3800 mfn=bffc0 nr_mfns=40
(XEN) domctl.c:993:d0 memory_map:add: gfn=e0000 mfn=a0000 nr_mfns=10000
(XEN) domctl.c:993:d0 memory_map:add: gfn=f3000 mfn=9f800 nr_mfns=800
(XEN) domctl.c:1049:d0 ioport_map:add f_gport=c100 f_mport=e000 np=100
(XEN) domctl.c:993:d0 memory_map:add: gfn=f3800 mfn=bffc0 nr_mfns=40
(XEN) domctl.c:1003:d0 memory_map:remove: gfn=f3880 mfn=dfef0 nr_mfns=10
(XEN) domctl.c:993:d0 memory_map:add: gfn=f3894 mfn=dfeee nr_mfns=1
(XEN) domctl.c:1003:d0 memory_map:remove: gfn=f3894 mfn=dfeee nr_mfns=2
(XEN) domctl.c:993:d0 memory_map:add: gfn=f3880 mfn=dfef0 nr_mfns=10
(XEN) domctl.c:993:d0 memory_map:add: gfn=f3894 mfn=dfeee nr_mfns=2
(XEN) domctl.c:1003:d0 memory_map:remove: gfn=f3894 mfn=dfeee nr_mfns=1
(XEN) physdev.c:98: AF1: map->domid1, map->type0, map->index-1, map->pirq-1, map->bus4, map->devfn0, map->entry_nr0
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=52
(XEN) msi.c:867: MSI is already in use on device 04:00.0
(XEN) physdev.c:236: AF6: final map->pirq: 52
(XEN) physdev.c:98: AF1: map->domid1, map->type0, map->index-1, map->pirq-1, map->bus4, map->devfn0, map->entry_nr1
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=51
(XEN) msi.c:867: MSI is already in use on device 04:00.0
(XEN) physdev.c:236: AF6: final map->pirq: 51
(XEN) physdev.c:98: AF1: map->domid1, map->type0, map->index-1, map->pirq-1, map->bus4, map->devfn0, map->entry_nr2
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=50
(XEN) msi.c:867: MSI is already in use on device 04:00.0
(XEN) physdev.c:236: AF6: final map->pirq: 50
(XEN) physdev.c:98: AF1: map->domid1, map->type0, map->index-1, map->pirq-1, map->bus4, map->devfn0, map->entry_nr3
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=49
(XEN) msi.c:867: MSI is already in use on device 04:00.0
(XEN) physdev.c:236: AF6: final map->pirq: 49
(XEN) physdev.c:98: AF1: map->domid1, map->type0, map->index-1, map->pirq-1, map->bus4, map->devfn0, map->entry_nr4
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=48
(XEN) msi.c:867: MSI is already in use on device 04:00.0
(XEN) physdev.c:236: AF6: final map->pirq: 48
(XEN) physdev.c:98: AF1: map->domid1, map->type0, map->index-1, map->pirq-1, map->bus4, map->devfn0, map->entry_nr5
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=47
(XEN) msi.c:867: MSI is already in use on device 04:00.0
(XEN) physdev.c:236: AF6: final map->pirq: 47
(XEN) physdev.c:98: AF1: map->domid1, map->type0, map->index-1, map->pirq-1, map->bus4, map->devfn0, map->entry_nr6
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=46
(XEN) msi.c:867: MSI is already in use on device 04:00.0
(XEN) physdev.c:236: AF6: final map->pirq: 46
(XEN) physdev.c:98: AF1: map->domid1, map->type0, map->index-1, map->pirq-1, map->bus4, map->devfn0, map->entry_nr7
(XEN) physdev.c:156: AF2: map->type=MSI
(XEN) physdev.c:188: AF3: after getting pirq: map->pirq-1, pirq0
(XEN) physdev.c:205: AF4: got previously free pirq=45
(XEN) msi.c:867: MSI is already in use on device 04:00.0
(XEN) physdev.c:236: AF6: final map->pirq: 45
(XEN) domctl.c:1003:d0 memory_map:remove: gfn=f3890 mfn=bff9c nr_mfns=4
(XEN) domctl.c:993:d0 memory_map:add: gfn=f3890 mfn=bff9c nr_mfns=4

[-- Attachment #4: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: PCI passthrough problems after legacy update of xen 4.1

[Gordan Bobic]

I stand corrected! Jan's patch does in fact fix the problem. I have no 
idea what I was doing wrong, but I just tried it again (for the 4th 
time) just to make sure, uninstalled the old packages, installed the new 
ones - and now it works! There must have been a stale file somewhere 
that was breaking it.

Thanks Jan, most appreciated. :)

Gordan

On 05/19/2013 03:56 PM, Andreas Falck wrote:
> Now I'm happy to inform that Jan's patch solves the problem for me. I
> patched the source version of the xen package under ubuntu12.10,
> currently 4.1.3-3ubuntu1.5_amd64. Now I can add pci devices any order I
> like.
>
> After installing the full xen suite from the source (not knowing exactly
> which packages were affected) and seeing it working, I replaced the
> hypervisor package with a version with the debug changes I made earlier,
> to produce the attached logs. These are xend.log and xm dmesg from the
> working case, when I pass pci = [04:00.0, 41:00.0, 41:00.1] which didn't
> work before with the pre-patch code.
>
> Thanks for this! Let me know if I should provide some more info,
> especially given that this change does not yet seem to work for Gordan
> on 4.2.
>
> Regards,
> Andreas
>
>
>
> 2013/5/16 Andreas Falck <falck.andreas.lists@gmail.com
> <mailto:falck.andreas.lists@gmail.com>>
>
>     Thanks! I'll give it a try in the weekend. I have been travelling,
>     that's why I haven't pursued this further yet.
>
>     Regards,
>     Andreas
>
>
>     2013/5/14 Jan Beulich <JBeulich@suse.com <mailto:JBeulich@suse.com>>
>
>          >>> On 05.05.13 at 21:33, Andreas Falck
>         <falck.andreas.lists@gmail.com
>         <mailto:falck.andreas.lists@gmail.com>> wrote:
>          > I tried adding some debugging statements in physdev_map_pirq.
>         I have
>          > attached the physdev.c with my debug statements, a hypervisor
>         log from
>          > testing, and the output of lspci -vv for my three devices.
>
>         Since I didn't hear anything from either of you anymore, I went
>         through the (not very familiar to me) tool stack code again, and
>         found that qemu and xend/libxl fundamentally disagree about the
>         model to be used. Qemu wants to allocate PIRQs while xend/libxl
>         want a 1:1 mapping. Allocating after having created a 1:1 mapping
>         works by returning the 1:1 mapping as allocation result, so as long
>         as libxl completes its setup before launching qemu, it would be
>         obvious why things work there. Consequently I assume that xend
>         launches qemu quite a bit earlier in the process of creating a new
>         domain, and the result of an attempt to establish a 1:1 mapping
>         when a different mapping was already established is dependent on
>         the specific interrupt numbers (i.e. also explains the observations
>         one of you made).
>
>         Since the tool stack as a whole really ought to use a consistent
>         model, and since the 1:1 mapping model for non-MSI IRQs seems
>         quite natural, the below/attached patch takes care of enforcing
>         a 1:1 mapping in libxc when allocation is being requested by the
>         caller. Ian, Ian - do you foresee any problem with this?
>
>         Please both of you give this a try and let us know of the results
>         (patch applies cleanly to all of -unstable, 4.2, and 4.1).
>
>         Jan
>
>         --- a/tools/libxc/xc_physdev.c
>         +++ b/tools/libxc/xc_physdev.c
>         @@ -49,7 +49,7 @@ int xc_physdev_map_pirq(xc_interface *xc
>               map.domid = domid;
>               map.type = MAP_PIRQ_TYPE_GSI;
>               map.index = index;
>         -    map.pirq = *pirq;
>         +    map.pirq = *pirq < 0 ? index : *pirq;
>
>               rc = do_physdev_op(xch, PHYSDEVOP_map_pirq, &map,
>         sizeof(map));
>
>         --- a/tools/python/xen/xend/server/pciif.py
>         +++ b/tools/python/xen/xend/server/pciif.py
>         @@ -340,7 +340,7 @@ class PciController(DevController):
>                           raise VmError(('pci: failed to configure I/O
>         memory on device '+
>                                       '%s - errno=%d')%(dev.name
>         <http://dev.name>,rc))
>
>         -        if not self.vm.info.is_hvm() and dev.irq:
>         +        if dev.irq > 0:
>                       rc = xc.physdev_map_pirq(domid = fe_domid,
>                                              index = dev.irq,
>                                              pirq  = dev.irq)
>
>
>
>

Re: PCI passthrough problems after legacy update of xen 4.1

[Steven Haigh]

On 20/05/2013 5:59 AM, Gordan Bobic wrote:
> I stand corrected! Jan's patch does in fact fix the problem. I have no
> idea what I was doing wrong, but I just tried it again (for the 4th
> time) just to make sure, uninstalled the old packages, installed the new
> ones - and now it works! There must have been a stale file somewhere
> that was breaking it.
>
> Thanks Jan, most appreciated. :)

This is great news...

Jan / Ian / Andrew:

What is the path forward for this now? Will it just be committed then 
included in 4.2.3 or 4.1.x? I'm just trying to figure out if this will 
be the official fix or something else will happen before I start rolling 
new packages with this fix applied for distribution...

-- 
Steven Haigh

Email: netwiz@crc.id.au
Web: https://www.crc.id.au
Phone: (03) 9001 6090 - 0412 935 897
Fax: (03) 8338 0299

Re: PCI passthrough problems after legacy update of xen 4.1

[Andrew Cooper]

On 20/05/13 01:50, Steven Haigh wrote:
> On 20/05/2013 5:59 AM, Gordan Bobic wrote:
>> I stand corrected! Jan's patch does in fact fix the problem. I have no
>> idea what I was doing wrong, but I just tried it again (for the 4th
>> time) just to make sure, uninstalled the old packages, installed the new
>> ones - and now it works! There must have been a stale file somewhere
>> that was breaking it.
>>
>> Thanks Jan, most appreciated. :)
> This is great news...
>
> Jan / Ian / Andrew:
>
> What is the path forward for this now? Will it just be committed then 
> included in 4.2.3 or 4.1.x? I'm just trying to figure out if this will 
> be the official fix or something else will happen before I start rolling 
> new packages with this fix applied for distribution...
>

It looks to me like a good fix.  It is however a libxc bugfix so is at
the discretion of the tools maintainers.

~Andrew

Re: PCI passthrough problems after legacy update of xen 4.1

[Ian Campbell]

On Mon, 2013-05-20 at 09:55 +0100, Andrew Cooper wrote:
> On 20/05/13 01:50, Steven Haigh wrote:
> > On 20/05/2013 5:59 AM, Gordan Bobic wrote:
> >> I stand corrected! Jan's patch does in fact fix the problem. I have no
> >> idea what I was doing wrong, but I just tried it again (for the 4th
> >> time) just to make sure, uninstalled the old packages, installed the new
> >> ones - and now it works! There must have been a stale file somewhere
> >> that was breaking it.
> >>
> >> Thanks Jan, most appreciated. :)
> > This is great news...
> >
> > Jan / Ian / Andrew:
> >
> > What is the path forward for this now? Will it just be committed then 
> > included in 4.2.3 or 4.1.x? I'm just trying to figure out if this will 
> > be the official fix or something else will happen before I start rolling 
> > new packages with this fix applied for distribution...
> >
> 
> It looks to me like a good fix.  It is however a libxc bugfix so is at
> the discretion of the tools maintainers.

I suppose someone (Jan I guess) is going to repost it with an
appropriate subject line, S-o-b, Tested-by, etc?

Ian.

Re: PCI passthrough problems after legacy update of xen 4.1

[Jan Beulich]

>>> On 20.05.13 at 11:13, Ian Campbell <Ian.Campbell@citrix.com> wrote:
> On Mon, 2013-05-20 at 09:55 +0100, Andrew Cooper wrote:
>> On 20/05/13 01:50, Steven Haigh wrote:
>> > On 20/05/2013 5:59 AM, Gordan Bobic wrote:
>> >> I stand corrected! Jan's patch does in fact fix the problem. I have no
>> >> idea what I was doing wrong, but I just tried it again (for the 4th
>> >> time) just to make sure, uninstalled the old packages, installed the new
>> >> ones - and now it works! There must have been a stale file somewhere
>> >> that was breaking it.
>> >>
>> >> Thanks Jan, most appreciated. :)
>> > This is great news...
>> >
>> > Jan / Ian / Andrew:
>> >
>> > What is the path forward for this now? Will it just be committed then 
>> > included in 4.2.3 or 4.1.x? I'm just trying to figure out if this will 
>> > be the official fix or something else will happen before I start rolling 
>> > new packages with this fix applied for distribution...
>> >
>> 
>> It looks to me like a good fix.  It is however a libxc bugfix so is at
>> the discretion of the tools maintainers.
> 
> I suppose someone (Jan I guess) is going to repost it with an
> appropriate subject line, S-o-b, Tested-by, etc?

Sure - I'm in the process of doing so.

Jan