From mboxrd@z Thu Jan  1 00:00:00 1970
From: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Subject: Re: pci-passthrough loses msi-x interrupts ability
 after domain destroy
Date: Fri, 22 Sep 2017 15:25:00 -0400
Message-ID: <20170922192500.GD26248@char.us.oracle.com>
References: <609868325.225353.1505937035977.JavaMail.zimbra@savoirfairelinux.com>
 <20170921083952.r2moey2n7qgnowgo@dhcp-3-128.uk.xensource.com>
 <1707661043.20170921222701@eikelenboom.it>
 <CACMJ4GbEp3sEQsc93OsiRh3o1T+5F_byH9yWcKGa0Bn2e9XGUg@mail.gmail.com>
 <373043a4-68e2-0b39-f4d3-82815e0e7767@eikelenboom.it>
Mime-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
Return-path: <xen-devel-bounces@lists.xen.org>
Received: from mail6.bemta3.messagelabs.com ([195.245.230.39])
 by lists.xenproject.org with esmtp (Exim 4.84_2)
 (envelope-from <konrad.wilk@oracle.com>) id 1dvTaS-0002u7-JL
 for xen-devel@lists.xenproject.org; Fri, 22 Sep 2017 19:26:08 +0000
Content-Disposition: inline
In-Reply-To: <373043a4-68e2-0b39-f4d3-82815e0e7767@eikelenboom.it>
List-Unsubscribe: <https://lists.xen.org/cgi-bin/mailman/options/xen-devel>,
 <mailto:xen-devel-request@lists.xen.org?subject=unsubscribe>
List-Post: <mailto:xen-devel@lists.xen.org>
List-Help: <mailto:xen-devel-request@lists.xen.org?subject=help>
List-Subscribe: <https://lists.xen.org/cgi-bin/mailman/listinfo/xen-devel>,
 <mailto:xen-devel-request@lists.xen.org?subject=subscribe>
Errors-To: xen-devel-bounces@lists.xen.org
Sender: "Xen-devel" <xen-devel-bounces@lists.xen.org>
To: Sander Eikelenboom <linux@eikelenboom.it>, Govinda Tatti <govinda.tatti@oracle.com>
Cc: Juergen Gross <jgross@suse.com>, Christopher Clark <christopher.w.clark@gmail.co>, Kyle Temkin <temkink@ainfosec.com>, =?iso-8859-1?B?Suly9G1l?= Oufella <jerome.oufella@savoirfairelinux.com>, "xen-devel@lists.xenproject.org" <xen-devel@lists.xenproject.org>, Boris Ostrovsky <boris.ostrovsky@oracle.com>, Roger Pau =?iso-8859-1?Q?Monn=E9?= <roger.pau@citrix.com>
List-Id: xen-devel@lists.xenproject.org

T24gRnJpLCBTZXAgMjIsIDIwMTcgYXQgMDk6MzU6NDBBTSArMDIwMCwgU2FuZGVyIEVpa2VsZW5i
b29tIHdyb3RlOgo+IE9uIDIyLzA5LzE3IDA0OjA5LCBDaHJpc3RvcGhlciBDbGFyayB3cm90ZToK
PiA+IE9uIFRodSwgU2VwIDIxLCAyMDE3IGF0IDE6MjcgUE0sIFNhbmRlciBFaWtlbGVuYm9vbQo+
ID4gPGxpbnV4QGVpa2VsZW5ib29tLml0PiB3cm90ZToKPiA+Pgo+ID4+IE9uIFRodSwgU2VwdGVt
YmVyIDIxLCAyMDE3LCAxMDozOTo1MiBBTSwgUm9nZXIgUGF1IE1vbm7DqSB3cm90ZToKPiA+Pgo+
ID4+PiBPbiBXZWQsIFNlcCAyMCwgMjAxNyBhdCAwMzo1MDozNVBNIC0wNDAwLCBKw6lyw7RtZSBP
dWZlbGxhIHdyb3RlOgo+ID4+Pj4KPiA+Pj4+IEknbSB1c2luZyBQQ0kgcGFzcy10aHJvdWdoIHRv
IG1hcCBhIFBDSWUgKGludGVsIGkyMTApIGNvbnRyb2xsZXIgaW50bwo+ID4+Pj4gYSBIVk0gZG9t
YWluLiBUaGUgc3lzdGVtIHVzZXMgeGVuLXBjaWJhY2sgdG8gaGlkZSB0aGUgYXBwcm9wcmlhdGUg
UENJCj4gPj4+PiBkZXZpY2UgZnJvbSBEb20wLgo+ID4+Pj4KPiA+Pj4+IFdoZW4gY3JlYXRpbmcg
dGhlIEhWTSBkb21haW4gYWZ0ZXIgYW4gaHlwZXJ2aXNvciBjb2xkIGJvb3QsIHRoZSBIVk0KPiA+
Pj4+IGRvbWFpbiBjYW4gYWNjZXNzIGFuZCB1c2UgdGhlIFBDSWUgY29udHJvbGxlciB3aXRob3V0
IHByb2JsZW0uCj4gPj4+Pgo+ID4+Pj4gSG93ZXZlciwgaWYgdGhlIEhWTSBkb21haW4gaXMgZGVz
dHJveWVkIHRoZW4gcmVzdGFydGVkLCBpdCB3b24ndCBiZQo+ID4+Pj4gYWJsZSB0byB1c2UgdGhl
IHBhc3MtdGhyb3VnaCBQQ0kgZGV2aWNlIGFueW1vcmUuIFRoZSBQQ0kgZGV2aWNlIGlzCj4gPj4+
PiBzZWVuIGFuZCBjYW4gYmUgbWFwcGVkLCBob3dldmVyLCB0aGUgaW50ZXJydXB0cyB3aWxsIG5v
dCBiZSBwYXNzZWQgdG8KPiA+Pj4+IHRoZSBIVk0gZG9tYWluIGFueW1vcmUgKHRoaXMgaXMgdmlz
aWJsZSB1bmRlciBhIExpbnV4IGd1ZXN0IGFzCj4gPj4+PiAvcHJvYy9pbnRlcnJ1cHRzIGNvdW50
ZXJzIHJlbWFpbiAwKS4gVGhlIGJlaGF2aW9yIG9uIGEgV2luZG93czEwIGd1ZXN0Cj4gPj4+PiBp
cyB0aGUgc2FtZS4KPiA+Pj4+Cj4gPj4+PiBBIGZldyBpbnRlcmVzdGluZyBoaW50cyBJIG5vdGlj
ZWQ6Cj4gPj4+Pgo+ID4+Pj4gLSBPbiBEb20wLCAnbHNwY2kgLXZ2JyBvbiB0aGF0IFBDSWUgZGV2
aWNlIGJldHdlZW4gdGhlICJ3b3JraW5nIiBhbmQKPiA+Pj4+IHRoZSAibXV0ZWQgaW50ZXJydXB0
cyIgc3RhdGVzLCBJIG5vdGVkIGEgZGlmZmVyZW5jZSBiZXR3ZWVuIHRoZQo+ID4+Pj4gTVNJLVgg
Y2FwczoKPiA+Pj4+Cj4gPj4+PiAtIENhcGFiaWxpdGllczogWzcwXSBNU0ktWDogRW5hYmxlLSBD
b3VudD01IE1hc2tlZC0gPC0tIElSUXMgd2lsbCB3b3JrIGlmIGRvbWFpbiBzdGFydGVkCj4gPj4+
PiArIENhcGFiaWxpdGllczogWzcwXSBNU0ktWDogRW5hYmxlLSBDb3VudD01IE1hc2tlZCsgPC0t
IElSUXMgd29uJ3Qgd29yayBpZiBkb21haW4gc3RhcnRlZAo+ID4+Pj4gICAgICAgICAgICAgICAg
ICAgICAgICAgICAgICAgICAgICAgICAgICAgICBeXl5eXl5eCj4gPj4KPiA+Pj4gSU1ITyBpdCBz
ZWVtcyB0aGF0IGVpdGhlciB5b3VyIGRldmljZSBpcyBub3QgYWJsZSB0byBwZXJmb3JtIGEgcmVz
ZXQKPiA+Pj4gc3VjY2Vzc2Z1bGx5LCBvciBMaW51eCBpcyBub3QgY29ycmVjdGx5IHBlcmZvcm1p
bmcgc3VjaCByZXNldC4gSSBkb24ndAo+ID4+PiB0aGluayB0aGVyZSdzIGEgbG90IHRoYXQgY2Fu
IGJlIGRvbmUgZnJvbSB0aGUgWGVuIHNpZGUuCj4gPj4KPiA+PiBVbmZvcnR1bmF0ZWx5IGZvciBh
IGxvdCBvZiBwY2ktZGV2aWNlcyBhIHNpbXBsZSByZXNldCBhcyBwZXJmb3JtZWQgYnkgZGVmYXVs
dCBpc24ndCBlbm91Z2gsCj4gPj4gYnV0IGFsc28gYWxtb3N0IG5vbmUgc3VwcG9ydCBhIHJlYWwg
cGNpIEZMUi4KPiA+Pgo+ID4+IEluIHRoZSBkaXN0YW50IHBhc3QgS29ucmFkIGhhcyBtYWRlIGEg
cGF0Y2hzZXQgdGhhdCBpbXBsZW1lbnRlZCBhIGJ1cyByZXNldCBhbmQKPiA+PiByZXNldGluZyBj
b25maWcgc3BhY2UuIChJdCBwaWdneSBiYWNrZWQgb24gYWxyZWFkeSBleGlzdGluZyBsaWJ4bCBt
ZWNoYW5pc20gb2YKPiA+PiB0cnlpbmcgdG8gY2FsbCBvbiBhIHN5ZnMgImRvX2ZsciIgYXR0cmli
dXRlIHdoaWNoIHRyaWdnZXJzIHBjaWJhY2sgdG8gcGVyZm9ybQo+ID4+IHRoZSBidXNyZXNldCBh
bmQgcmV3cml0ZSBvZiBjb25maWcgc3BhY2UgZm9yIHRoZSBkZXZpY2UuCj4gPj4KPiA+PiBJIHVz
ZSB0aGF0IHBhdGNoc2V0IGV2ZXIgc2luY2UgZm9yIG15IHBjaS1wYXNzdHJvdWdoIG5lZWRzIGFu
ZCBpdCB3b3JrcyBwcmV0dHkKPiA+PiB3ZWxsLiBJIGNhbiBzaHV0ZG93biBhbiByZXN0YXJ0IFZN
J3Mgd2l0aCBwY2kgZGV2aWNlcyBwYXNzZWQgdHJob3VnaCAoYWxzbyBBTUQKPiA+PiBSYWRlb24g
Z3JhcGhpYyBjYXJkcykuCj4gPiAKPiA+IEp1c3QgdG8gY29uZmlybSB0aGUgdXRpbGl0eSBvZiB0
aGF0IHBpZWNlIG9mIHdvcms6IE9wZW5YVCBhbHNvIHVzZXMgYW4KPiA+IGV4dGVuZGVkIHZlcnNp
b24gb2YgdGhhdCBzYW1lIHBhdGNoIHRvIHBlcmZvcm0gZGV2aWNlIHJlc2V0IGZvcgo+ID4gcGFz
c3Rocm91Z2guCj4gPiAKPiA+IEkndmUgYXR0YWNoZWQgYSBjb3B5IG9mIHRoYXQgT3BlblhUIHBh
dGNoIHRvIHRoaXMgbWVzc2FnZSBhbmQgaXQgY2FuCj4gPiBhbHNvIGJlIG9idGFpbmVkIGZyb20g
b3VyIGdpdCByZXBvc2l0b3J5Ogo+ID4gaHR0cHM6Ly9naXRodWIuY29tL09wZW5YVC94ZW5jbGll
bnQtb2UvYmxvYi9mOGQzYjI4MmE4NzIzMWQ5YWU3MTdiMTNkNTA2ZThlN2UyOGM3OGM0L3JlY2lw
ZXMta2VybmVsL2xpbnV4LzQuOS9wYXRjaGVzL3Rob3JvdWdoLXJlc2V0LWludGVyZmFjZS10by1w
Y2liYWNrLXMtc3lzZnMucGF0Y2gKPiA+IFRoaXMgdmVyc2lvbiBjcmVhdGVzIGEgc3lzZnMgbm9k
ZSBuYW1lZCAicmVzZXRfZGV2aWNlIiBhbmQgdGhlIE9wZW5YVAo+ID4gbGlieGwgdG9vbHN0YWNr
IGlzIHBhdGNoZWQgdG8gdXNlIHRoYXQgbm9kZSBpbnN0ZWFkIG9mICJkb19mbHIiLgo+IAo+IE5p
Y2UgdG8gaGVhciB0aGVyZSBhcmUgbW9yZSB1c2VycyBvZiB0aGlzIHBhdGNoLiBPbiAjeGVuIG9u
IElSQyB0aGVyZSB3ZXJlIGZyb20gdGltZSB0byB0aW1lCj4gYWxzbyB1c2VycyB3aG8gdHJpZWQg
cGNpLXBhc3N0cm91Z2ggYW5kIHJhbiBpbnRvIHRoaXMgaXNzdWUgKGFuZCBwcm9iYWJseSBhYmFu
ZG9ubmluZyB0aGUgaWRlYQo+IHNpbmNlIGhhdmluZyB0byByZXN0YXJ0IHlvdXIgaG9zdCBiZWZv
cmUgYmVpbmcgYWJsZSB0byB1c2UgeW91ciBwYXNzIHRocm91Z2hlZCBkZXZpY2UgYWdhaW4KPiBk
ZWZpZXMgbXVjaCBvZiB0aGUgdXNlIGNhc2UpLgo+ICAKPiA+IEtvbnJhZCdzIG9yaWdpbmFsIHdv
cmsgZW5jb3VudGVyZWQgcHVzaGJhY2sgb24gdXBzdHJlYW0gYWNjZXB0YW5jZSBhdAo+ID4gdGhl
IHRpbWUgaXQgd2FzIGRldmVsb3BlZC4gSSdtIG5vdCBzdXJlIEkndmUgZm91bmQgd2hlcmUgdGhh
dAo+ID4gZGlzY3Vzc2lvbiBlbmRlZC4gSXMgdGhlcmUgYW55IHByb3NwZWN0IG9mIGEgbW9yZSBj
b21wcmVoZW5zaXZlIHJlc2V0Cj4gPiBtZWNoYW5pc20gYmVpbmcgYWNjZXB0ZWQgaW50byB4ZW4t
cGNpYmFjaywgb3IgZWxzZXdoZXJlIGluIHRoZSBrZXJuZWw/Cj4gCj4gWWVhaCBpdCB3YXMgbmFj
a2VkIGJ5IERhdmlkIFZyYWJlbCBhbmQgdGhlIGRpc2N1c3Npb24gc29tZXdoYXQgYmxlZWRlZCB0
byBkZWF0aC4gCj4gPkZyb20gd2hhdCBpIHJlbWVtYmVyIHRoZSBtYWluIGlzc3VlIHdhcyB3aXRo
IHRoZSBuYW1pbmcsIHNpbmNlIGl0IGRvZXNuJ3QgZG8gYSBGTFIsCj4gdGhlIHN5c2ZzIGhvb2sg
c2hvdWxkbid0IGJlIGNhbGxlZCAiZG9fZmxyIi4KPiAKPiBTb21lIG90aGVyIHBlcmhhcHMgbWlu
b3IgaXNzdWVzIGkgY2FuIHRoaW5rIG9mIGFyZToKPiAtIE5vIHdheSB0byBleGNlbXB0IHBjaS1k
ZXZpY2VzIGZyb20gdGhpcyBuZXcgd2F5IG9mIHJlc2V0dGluZyB0aGVtLgo+ICAgUGVyaGFwcyB0
aGVyZSBjb3VsZCBiZSBwY2kgZGV2aWNlcy90b3BvbG9naWVzIHdlcmUgdGhpcyB3YXkgb2YKPiAg
IHJlc2V0dGluZyBjYXVzZXMgbW9yZSBwcm9ibGVtcyB0aGFuIGl0IHNvbHZlcyBhbmQgY291bGQg
Y2F1c2UgYQo+ICAgcmVncmVzc2lvbi4gVW5mb3J0dW5hdGVseSBhdXRvIGRldGVjdGluZyB3aGF0
IHdvcmtzIGRvZXNuJ3Qgc2VlbSB0bwo+ICAgYmUgcG9zc2libGUuIE9uIHRoZSBvdGhlciBoYW5k
ICh0aG91Z2ggb25seSB3aXRoIG15IG49MTApIGkgaGF2ZW4ndCBlbmNvdW50ZXJlZAo+ICAgc3Vj
aCBhIGRldmljZSB5ZXQuCj4gCj4gLSBUaGUgY29tbXVuaWNhdGlvbiBwYXRoIGJldHdlZW4gbGli
eGwgYW5kIHRoZSBrZXJuZWwgdmlhIHN5c2ZzLgo+ICAgSSB0aGluayB0aGUgcHJlZmVyZW5jZSB3
YXMgZm9yIGE6Cj4gICBhKSBoYXZpbmcgaXQgdXNlIGEgbW9yZSBjb21tb24gdXNlZCBYZW4gY29t
bXVuaWNhdGlvbiBjaGFubmVsIG9yCj4gICBiKSBoYXZpbmcgaXQgYWxsIHNlbGYtY29udGFpbmVk
IGluIHBjaS1iYWNrLiAoZnJvbSBteSBtZW1vcnkgYW5kIHRoZSBvcGVueHQgcGF0Y2ggZGVzY3Jp
cHRpb24KPiAgICAgIHRoZXJlIGNvdWxkIGJlIHNvbWUgbG9ja2luZyBpc3N1ZSB3aGVuIHRyeWlu
ZyB0byBpbXBsZW1lbnQgaXQgdGhpcyB3YXksCj4gICAgICBidXQgdGhlIHZmaW8gZ3V5cyBoYWQg
dGhhdCBzb2x2ZWQgZm9yIHRoZXJlIHJlc2V0IGltcGxlbWVudGF0aW9uIGlmIGkKPiAgICAgIGZy
b20gb25lIG9mIHRoZSBjb21tZW50cyBpbiB0aGVyZSBzb3VyY2UgY29kZSAocGF0Y2hlcyBieSBB
bGV4IFdpbGxpYW1zb24KPiAgICAgIGlmIGkgcmVtZW1iZXIgY29ycmVjdGx5KS4KPiAKPiAtIE5v
dCBhbiBpc3N1ZSBiYWNrIHRoZW4gd2hlbiB0aGUgcGF0Y2ggd2FzIG1hZGUsIGJ1dCBhcyB0aGUg
cXVlc3Rpb24gZWFybGllciB0byBSb2dlciwKPiAgIHRoZSBoeXBlcnZpc29yIHNlZW1zIHRvIGdy
b3cgbW9yZSBpbnRlcmZlcmVuY2Ugd2l0aCBwY2kgZGV2aWNlcyB3aXRoIHRoZSBQVkggZG9tMCB3
b3JrLgo+ICAgSWYgYW5kIGhvb3cgZG9lcyB0aGF0IHJlbGF0ZSB0byBwY2ktYmFjayBhbmQgcGNp
LXBhc3N0aHJvdWdoIGFuZCAodGhlIGxvY2F0aW9uIG9mKSByZXNldHRpbmcgbWVjaGFuaXNtcyA/
Cj4gCj4gCj4gU28gaSB0aGluayBEYXZpZCdzIE5BQ0sgd2FzIG1vc3RseSBmb3IgdGhlIHBhdGNo
c2V0IGhhdmluZyBzb21lIGhhY2tpc2ggY29zbWV0aWNzLgoKSGUgZGlkbid0IGxpa2UgJ2RvX2Zs
cicgd2hpY2ggbWFkZSBzZW5zZSBhcyB0aGUgcGF0Y2hzZXQgZGlkIG5vdCBkbyBGTFIuIEl0IG1h
ZGUgYSBidXMtcmVzZXQKZm9yIG1vcmUgdGhhbiBvbmUgZGV2aWNlIChpZiB0aG9zZSBkZXZpY2Vz
IHdlcmUgYXNzaWduZWQgdG8gcGNpYmFjaykuCgo+IAo+IE9uIHRoZSB1cHNpZGUgb25lIGNhbiBj
b25jbHVkZSB0aGF0IHRoaXMgcGF0Y2hzZXQgaXMgbm93IHByZXR0eSB3ZWxsIHRlc3RlZCBvdmVy
IHRoZSB5ZWFycyA7KQo+IAo+IFNpbmNlIERhdmlkIGhhcyBsZWZ0LCBwZXJoYXBzIEp1cmdlbi9C
b3Jpcy9Lb25yYWQgY291bGQgZXhwcmVzcyB0aGVpciB2aWV3cyAoYWdhaW4pID8KPiAoQ0MnZWQg
dGhlbSBhcyB3ZWxsKQoKSSd2ZSBhc2tlZCBHb3ZpbmRhIChDQy1lZCkgdG8gcmVmcmVzaCB0aGUg
cGF0Y2hzZXQgYWdhaW5zdCB0aGUgbGFzdGVzdCBrZXJuZWwgYW5kCnJlcG9zdCBpdCBhbmQgc2Vl
IHdoZXJlIGl0IGdvZXMuCgo+IAo+ID4gQXMgbm90ZWQgaW4gdGhlIG9yaWdpbmFsIExLTUwgdGhy
ZWFkcywgdmZpbyBoYXMgc2ltaWxhciByZWxldmFudCBwY2kKPiA+IGRldmljZSByZXNldCByZXRy
eSBsb2dpYy4gKFRoYW5rcyB0byBSaWNoIFBlcnNhdWQgZm9yIHRoaXMgcG9pbnRlcjopCj4gPiBo
dHRwOi8vZWxpeGlyLmZyZWUtZWxlY3Ryb25zLmNvbS9saW51eC92NC4xNC1yYzEvc291cmNlL2Ry
aXZlcnMvdmZpby9wY2kvdmZpb19wY2kuYyNMMTM1Mwo+ID4gCj4gPiBsaWJ2aXJ0IGFsc28gcGVy
Zm9ybXMgc2ltaWxhciByZXNldCBsb2dpYywgdXNpbmcgYSBkaXJlY3QgbG93IGxldmVsCj4gPiBp
bnRlcmZhY2UgdG8gY29uZmlnIHNwYWNlIChUaGFua3MgdG8gTWFyZWsgZm9yIHRoaXMgcG9pbnRl
ciwgbGlidmlydAo+ID4gaXMgdXNlZCBieSBRdWJlczopCj4gPiBodHRwczovL2dpdGh1Yi5jb20v
bGlidmlydC9saWJ2aXJ0L2Jsb2IvbWFzdGVyL3NyYy91dGlsL3ZpcnBjaS5jI0w5MjkKPiA+IEkg
dGhpbmtzIHRoaXMgaW5kaWNhdGVzIHRoYXQgaXQgd291bGQgYmUgcG9zc2libGUgdG8gZXh0ZW5k
IGxpYnhsIHRvCj4gPiBkbyBzb21ldGhpbmcgc2ltaWxhciwgYnV0IHRoYXQgc2VlbXMgbGVzcyBz
YXRpc2ZhY3RvcnkgY29tcGFyZWQgdG8KPiA+IHBlcmZvcm1pbmcgdGhlIHdvcmsgaW4gYSBrZXJu
ZWwtcHJvdmlkZWQgaW1wbGVtZW50YXRpb24uCj4gPiAKPiA+IElzIHRoZXJlIGEgd2F5IGZvcndh
cmQgdG8gcHJvdmlkaW5nIHRoaXMgZnVuY3Rpb25hbGl0eSB3aXRoaW4gWGVuCj4gPiBzb2Z0d2Fy
ZSBvciBMaW51eD4gQ2hyaXN0b3BoZXIKPiA+IC0tCj4gPiAKPiA+IG9wZW54dC5vcmcKPiA+IAo+
IAoKX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KWGVuLWRl
dmVsIG1haWxpbmcgbGlzdApYZW4tZGV2ZWxAbGlzdHMueGVuLm9yZwpodHRwczovL2xpc3RzLnhl
bi5vcmcveGVuLWRldmVsCg==