From mboxrd@z Thu Jan  1 00:00:00 1970
From: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Subject: Re: PCIe devices that are hotplugged after MMIO has
 been setup fail due to _CRS not covering 64-bit area
Date: Tue, 1 Nov 2016 10:39:27 -0400
Message-ID: <20161101143927.GA8950@char.us.oracle.com>
References: <20160927144338.GH16528@localhost.localdomain>
 <57EBA7A402000078001132F6@prv-mh.provo.novell.com>
 <20161012211539.GA30696@char.us.oracle.com>
 <57FF6DF80200007800116FC6@prv-mh.provo.novell.com>
Mime-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
Return-path: <xen-devel-bounces@lists.xen.org>
Received: from mail6.bemta5.messagelabs.com ([195.245.231.135])
 by lists.xenproject.org with esmtp (Exim 4.84_2)
 (envelope-from <konrad.wilk@oracle.com>) id 1c1aDs-00009X-Pc
 for xen-devel@lists.xenproject.org; Tue, 01 Nov 2016 14:39:32 +0000
Content-Disposition: inline
In-Reply-To: <57FF6DF80200007800116FC6@prv-mh.provo.novell.com>
List-Unsubscribe: <https://lists.xen.org/cgi-bin/mailman/options/xen-devel>,
 <mailto:xen-devel-request@lists.xen.org?subject=unsubscribe>
List-Post: <mailto:xen-devel@lists.xen.org>
List-Help: <mailto:xen-devel-request@lists.xen.org?subject=help>
List-Subscribe: <https://lists.xen.org/cgi-bin/mailman/listinfo/xen-devel>,
 <mailto:xen-devel-request@lists.xen.org?subject=subscribe>
Errors-To: xen-devel-bounces@lists.xen.org
Sender: "Xen-devel" <xen-devel-bounces@lists.xen.org>
To: Jan Beulich <JBeulich@suse.com>
Cc: xen-devel@lists.xenproject.org
List-Id: xen-devel@lists.xenproject.org

T24gVGh1LCBPY3QgMTMsIDIwMTYgYXQgMDM6MjA6MjRBTSAtMDYwMCwgSmFuIEJldWxpY2ggd3Jv
dGU6Cj4gPj4+IE9uIDEyLjEwLjE2IGF0IDIzOjE1LCA8a29ucmFkLndpbGtAb3JhY2xlLmNvbT4g
d3JvdGU6Cj4gPiBPbiBXZWQsIFNlcCAyOCwgMjAxNiBhdCAwMzoyMTowOEFNIC0wNjAwLCBKYW4g
QmV1bGljaCB3cm90ZToKPiA+PiA+Pj4gT24gMjcuMDkuMTYgYXQgMTY6NDMsIDxrb25yYWQud2ls
a0BvcmFjbGUuY29tPiB3cm90ZToKPiA+PiA+IElmIHRoZSBndWVzdCBpcyBib290ZWQgd2l0aCAn
cGNpJyB3ZSBuaWNlbHkgZXhwYW5kIHRoZSBNTUlPIHJlZ2lvbiBiZWxvdwo+ID4+ID4gNEdCIGFu
ZCB0cnkgdG8gZml0IGluIHRoZSBCQVJzIGluIHRoZXJlLiBJZiB0aGF0IGZhaWxzIChub3QgZW5v
dWdoCj4gPj4gPiBzcGFjZSkgd2UgbW92ZSBpdCBhYm92ZSB0aGUgbWVtb3J5ICg2NC1iaXQpLiBB
bmQgdGhyb3VnaG91dCBhbGwgb2YgdGhpcwo+ID4+ID4gd2UgYWxzbyB1cGRhdGUgdGhlIF9DUlMg
ZmllbGQgdG8gY292ZXIgdGhlc2UgcmFuZ2VzLgo+ID4+ID4gCj4gPj4gPiAoTm90ZSwgSSBuZWVk
IHRvIGNoZWNrIGlmIHRoZSA2NC1iaXQgYXJlYSBpcyBhbHNvIHNldCwgSSB0aGluayBpdCBpcyku
Cj4gPj4gPiAKPiA+PiA+IEJ1dCB0aGUgc2l0dWF0aW9uIGlzIGRpZmZlcmVudCBpZiB3ZSBob3Qt
cGx1ZyBhIGRldmljZSB0aGF0IGhhcyB0b28gYmlnCj4gPj4gPiBCQVIgdG8gZml0IGluIHRoZSBN
TUlPIHJlZ2lvbi4gV2UgbW92ZSBpdCBpbiB0aGUgNjQtYml0IGFyZWEgYnV0IHdlCj4gPj4gPiBk
b24ndCB1cGRhdGUgdGhlIF9DUlMuIFdoaWNoIG1lYW5zIHRoYXQgTGludXggd2lsbCBjb21wbGFp
biAodW5sZXNzCj4gPj4gPiBib290ZWQgd2l0aCBwY2k9bm9jcnMpKS4gTm90IHN1cmUgYWJvdXQg
V2luZG93cyBidXQgSSB3b3VsZCBhc3N1bWUgc28KPiA+PiA+IHRvLgo+ID4+ID4gCj4gPj4gPiBJ
IHdhcyB3b25kZXJpbmcgd2hhdCB3b3VsZCBiZSBhIGdvb2Qgd2F5IHRvIHNvbHZlIHRoaXM/IEkg
bG9va2VkIGF0IHNvbWUKPiA+PiA+IERlbGwgbWFjaGluZXMgdG8gc2VlIGhvdyB0aGV5IGRlYWwg
d2l0aCBob3RwbHVnIFBDSWUgZGV2aWNlcyBhbmQgdGhleQo+ID4+ID4ganVzdCBkZWNsYXJlZCBh
bGwgdGhlIG1lbW9yeSBpbiB0aGUgX0NSUyAoaW5jbHVkaW5nIFJBTSkuCj4gPj4gPiAKPiA+PiA+
IFdlIGNvdWxkIGRvIGEgaHlicmlkIC0gZHVyaW5nIGJvb3R1cCBtYWtlIHRoZSBfQ1JTIHJlZ2lv
biBoYXZlIGVudHJ5IGZyb20KPiA+PiA+IGVuZCBvZiBSQU0gdG8gLi4gZW5kIG9mIG1lbW9yeT8K
PiA+PiAKPiA+PiBFbmQgb2YgcGh5c2ljYWwgYWRkcmVzcyBzcGFjZSB5b3UgbWVhbj8gR2VuZXJh
bGx5IHllcywgYnV0IHdlCj4gPj4gbmVlZCB0byBiZSBhIGxpdHRsZSBjYXJlZnVsIHRoZXJlOiBG
b3Igb25lLCBvbiBBTUQgd2UnZCBiZXR0ZXIgbm90Cj4gPj4gb3ZlcmxhcCB3aXRoIHRoZSBIVCBh
cmVhLiBBbmQgdGhlbiB0aGVyZSdzIHRoaXMgTVRSUiByZWxhdGVkCj4gPj4gY29tbWVudCBuZXh0
IHRvIHRoZSBzZXR0aW5nIG9mIHBjaV9oaV9tZW1fZW5kIChhbGJlaXQgYm90aCBIVAo+ID4+IGFy
ZWEgc3RhcnQgYW5kIGVuZCBvZiBQQSBzcGFjZSBzaG91bGQgYmUgYWxpZ25lZCB3ZWxsIGVub3Vn
aCkuCgpUaGlzIGdvdCBpbnRlcmVzdGluZy4gVGhlIGV4aXN0aW5nIGNvZGUgdGhhdCBzZXRzIHRo
ZSB2YXJpYWJsZQpNVFJSIHJhbiBvdXQgb2YgTVRSUnMgdG8gY292ZXIgc2F5IDE8PDM2IG9mIHNw
YWNlLiBUaGUgcmVhc29uCmlzIHRoYXQgaXQgc3RhcnRzIGF0IGxvdyBncmFudWxhcml0eSBzaXpl
cyAoNEtCKSBhbmQgdGhlbiBidWlsZHMgdXAKZnJvbSB0aGVyZS4gVG8gY292ZXIgc2F5IGZyb20g
NEdCIHRvIDY0R0Igd2UgcmFuIG91dCBvZiBNVFJScy4KSSBtb2RpZmllZCBpdCBiZSBzdWJ0cmFj
dGl2ZSwgYW5kIGdvdCBpdCB0byBzdGFydCB3aXRoCmxhcmdlIGFyZWFzIGFuZCB0aGVuIHNtYWxs
ZXIgYW5kIHNtYWxsZXI6CgooZDIpICAtIENQVTAgLi4uIDM2LWJpdCBwaHlzIC4uLiBmaXhlZCBN
VFJScyAuLi4gQ292ZXIgQDAwMDAwNDM0NChNQikgdG8gMDAwMDY1NTM2KE0KKGQyKSBCKSB3aXRo
IDcgTVRSUnMuCihkMikgTVRSUiAxICAgICBAMDAwMDA0MzQ0KE1CKSAgMDAwMDM3MTEyKE1CKQoo
ZDIpIE1UUlIgMiAgICAgQDAwMDAzNzExMihNQikgIDAwMDA1MzQ5NihNQikKKGQyKSBNVFJSIDMg
ICAgIEAwMDAwNTM0OTYoTUIpICAwMDAwNjE2ODgoTUIpCihkMikgTVRSUiA0ICAgICBAMDAwMDYx
Njg4KE1CKSAgMDAwMDYzNzM2KE1CKQooZDIpIE1UUlIgNSAgICAgQDAwMDA2MzczNihNQikgIDAw
MDA2NDc2MChNQikKKGQyKSBNVFJSIDYgICAgIEAwMDAwNjQ3NjAoTUIpICAwMDAwNjUyNzIoTUIp
CihkMikgTVRSUiA3ICAgICBAMDAwMDY1MjcyKE1CKSAgMDAwMDY1NTI4KE1CKQooZDIpIHZhciBN
VFJScyBbOC84XSAuLi4gZG9uZS4KCkJ1dCBvZiBjb3Vyc2Ugb24gNDgtYml0IGhhcmR3YXJlLCBl
dmVuIHdpdGggdGhpcyB3ZSByYW4gb3V0IG9mIE1UUlJzOgooZDEpICAtIENQVTAgLi4uIDQ4LWJp
dCBwaHlzIC4uLiBmaXhlZCBNVFJScyAuLi4gQ292ZXIgQDAwMDAwNDM0NChNQikgdG8gMDI2ODQz
NTQ1NigKKGQxKSBNQikgd2l0aCA3IE1UUlJzLgooZDEpIE1UUlIgMSAgICAgQDAwMDAwNDM0NChN
QikgIDAxMzQyMjIwNzIoTUIpCihkMSkgTVRSUiAyICAgICBAMDEzNDIyMjA3MihNQikgMDIwMTMz
MDkzNihNQikKKGQxKSBNVFJSIDMgICAgIEAwMjAxMzMwOTM2KE1CKSAwMjM0ODg1MzY4KE1CKQoo
ZDEpIE1UUlIgNCAgICAgQDAyMzQ4ODUzNjgoTUIpIDAyNTE2NjI1ODQoTUIpCihkMSkgTVRSUiA1
ICAgICBAMDI1MTY2MjU4NChNQikgMDI2MDA1MTE5MihNQikKKGQxKSBNVFJSIDYgICAgIEAwMjYw
MDUxMTkyKE1CKSAwMjY0MjQ1NDk2KE1CKQooZDEpIE1UUlIgNyAgICAgQDAyNjQyNDU0OTYoTUIp
IDAyNjYzNDI2NDgoTUIpCihkMSkgdmFyIE1UUlJzIFs4LzhdIC4uLiBkb25lLgoKW0kgZmlndXJl
ZCB0aGF0IGl0IHdvdWxkIGJlIE9LIHRvIHNldCB0aGUgVUMgTVRSUiBldmVuIGZvciB0aGUKSFQg
cmVnaW9uOiBGQyBGRkZGIEZGRkYgLT4gRkYgRkZGRiBGRkZGIGFzIHlvdSBzdXJlbHkgZG9uJ3Qg
d2FudCBXQiB0aGVyZT9dCgpUaGVuIGl0IG9jdXJyZWQgdG8gbWUgdGhhdCBtYXliZSBJIGFtIG92
ZXJ0aGlua2luZyBpdCBhbmQKc2hvdWxkIGp1c3QgcGljayB0aGUgYmlnZ2VzdCBvbmU6CgooZDMy
KSBNdWx0aXByb2Nlc3NvciBpbml0aWFsaXNhdGlvbjoKKGQzMikgIC0gQ1BVMCAuLi4gNDgtYml0
IHBoeXMgLi4uIGZpeGVkIE1UUlJzIC4uLiBDb3ZlciBAMDAwMDA0MzQ0KE1CKSB0byAwMjY4NDM1
NDU2KAooZDMyKSBNQikgd2l0aCA3IE1UUlJzLgooZDMyKSBNVFJSIDEgICAgQDAwMDAwNDM0NChN
QikgIDAyNjg0Mzk4MDAoTUIpCihkMzIpIHZhciBNVFJScyBbMS84XSAuLi4gZG9uZS4KCldoaWNo
IHdvdWxkIGNvdmVyIF9wYXN0XyB0aGUgQ1BVIGVuZCwgYnV0IHRoYXQgc3VyZWx5IHdvbid0IGJl
IGhlYWx0aHkKdG8gdGhlIENQVT8gVGhlIEludGVsIFNETSBkb2Vzbid0IG1lbnRpb24gd2hhdCBo
YXBwZW5zIHRoZW4uCgpBbHNvIEkgcmVhbGl6ZWQgdGhhdCAiUmFuZ2UgU2l6ZSBhbmQgQWxpZ25t
ZW50IFJlcXVpcmVtZW50IiBhcmVuJ3QgbWVldAp3aXRoIHRoZSBjb2RlIEkgd3JvdGUgLSBhcyB0
aGUgc2l6ZSAoMl5uKSBtdXN0IGJlIGFsaWduZWQgb24gdGhlCjJebiBib3VuZGFyeSwgYW5kIHRo
YXQgaXMgY2VydGFpbmx5IG5vdCBtZWV0LgoKQW55aG93IHRoZSBwb2ludCBoZXJlIGlzIHRoYXQg
d2l0aCBtb2RpZmljYXRpb25zIGhlcmUgSSB3aWxsCnN0aWxsIHJ1biBpbiB0aGUgdmFyaWFibGUg
TVRSUiBsaW1pdCBpZiBJIGFtIHRvIGNvdmVyIG1vc3Qgb2YgdGhlCnNwYWNlLiBJIGNhbiBkbyB1
cCB0byBhIGNlcnRhaW4gdmFsdWUuIEFuZCB0aGF0ICd2YWx1ZScgY291bGQKYmVjb21lIHRoZSBw
Y2lfaGlnaF9tZW1fZW5kPwoKT3IgcGVyaGFwcyByZXZpc2l0IGE2YTgyMjMyNDoKQXV0aG9yOiBL
ZWlyIEZyYXNlciA8a2Vpci5mcmFzZXJAY2l0cml4LmNvbT4KRGF0ZTogICBXZWQgQXByIDE2IDEz
OjM2OjQ0IDIwMDggKzAxMDAKCiAgICB4ODYsIGh2bTogTG90cyBvZiBNVFJSL1BBVCBlbXVsYXRp
b24gY2xlYW51cC4KICAgIAogICAgIC0gTW92ZSBNVFJSIE1TUiBpbml0aWFsaXNhdGlvbiBpbnRv
IGh2bWxvYWRlci4KICAgICAtIFNpbXBsaWZ5IGluaXRpYWxpc2F0aW9uIGxvZ2ljIGJ5IG92ZXJs
YXlpbmcgVUMgb24gZGVmYXVsdCBXQiByYXRoZXIKICAgICAgIHRoYW4gdmljZSB2ZXJzYS4KICAg
ICAtIENsZWFuIHVwIGh5cGVydmlzb3IgSFZNIE1UUlIvUEFFIGNvZGUncyBpbnRlcmZhY2Ugd2l0
aCByZXN0IG9mCiAgICAgICBoeXBlcnZpc29yLgogICAgCgpBcyB0aGUgZGVmYXVsdCBNVFJSIGlz
IFdCLiBJZiB0aGF0IHdhcyBVQyB3ZSBjb3VsZCBqdXN0IHNldCBNVFJScwpmb3IgUkFNIHJlZ2lv
bnMgYW5kIGhhdmUgdGhlIHR5cGUgYmUgV0IgZm9yIHRob3NlIHJlZ2lvbnM/CgpJIGFtIG5vdCBz
dXJlIHRob3VnaHQgaWYgdGhhdCBpcyBhIGdvb2QgZGlyZWN0aW9uIGVpdGhlcj8KCj4gPj4gCj4g
Pj4gPiBPciBwZXJoYXBzIGFkZCBzb21lIGV4dHJhIGxvZ2ljIGJldHdlZW4gUUVNVSBhbmQgQUNQ
SSBBTUwgdG8gZXhwYW5kIChvcgo+ID4+ID4gcGVyaGFwcyBtb2RpZnkgdGhlIGxhc3QgX0NSUyBl
bnRyeSkgd2hlbiBQQ0llIGRldmljZXMgYXJlIGhvdHBsdWdnZWQ/Cj4gPj4gCj4gPj4gV2hpbGUg
dGhhdCB3b3VsZCBiZSB0aGUgbW9zdCBmbGV4aWJsZSB2YXJpYW50LCBJJ2QgYmUgYWZyYWlkIG9m
IHRoaXMKPiA+PiBnZXR0aW5nIHJhdGhlciBjb21wbGljYXRlZC4gT3IgaGF2ZSB5b3UgYWxyZWFk
eSBnb3Qgc29tZQo+ID4+IHJlYXNvbmFibGUgbGF5b3V0IG9mIGhvdyB0aGlzIHdvdWxkIGxvb2sg
bGlrZT8KPiA+IAo+ID4gSSBkaWQgdGhpcyBhbmQgd2hpbGUgYWxsIHRoZSBwbHVtYmluZyB3b3Jr
cyBncmVhdCBhbmQgSSBjYW4gc2VlIHRoYXQKPiA+IHRoZSBwY2lfaGlfbGVuIGdldHMgaW5jcmVt
ZW50ZWQgYnkgdGhlIHNpemUgb2YgdGhlIDY0LWJpdCBCQVJTIG9mIHRoZQo+ID4gbmV3IGRldmlj
ZSAoYW5kIGFsc28gZGVjcmVtZW50ZWQgaWYgaG90LXVucGx1Z2dlZCkgSSBoaXQgYSBzbmFnOgo+
ID4gCj4gPiBMaW51eCBldmFsdWF0ZXMgdGhpcyBvbmx5IG9uY2UgKGFjdHVhbGx5IHR3aWNlLCBi
dXQgb25seSBkdXJpbmcgYm9vdHVwKS4KPiAKPiBBaCAtIHF1aXRlIHJlYXNvbmFibGUgdG8gZXhw
ZWN0IHRoaXMgd29uJ3QgY2hhbmdlLgo+IAo+ID4gRm9yIHJpZ2h0IG5vdyBsZXQgbWUganVtcCB3
aXRoIHRoZSAic2ltcGxlciIgc29sdXRpb24gb2YganVzdAo+ID4gaGFyZGNvZGluZyB0aGUgZW5k
IG9mIHBoeXNpY2FsIGFkZHJlc3Mgc3BhY2UgYW5kIHNlZSBob3cgdGhhdCB3b3JrcyBvdXQuCj4g
Cj4gUmlnaHQuCgpBbmQgdGhhdCBhY3R1YWxseSB3b3JrZWQgb3V0IG5pY2VseS4gTGludXggc2Vl
cyB0aGUgbmV3IF9DUlMgcmVnaW9ucwphbmQgSSBnb3QgW3RoaXMgaW5jbHVkZXMgdHdvIGV4dHJh
IHJlZ2lvbnMgLSBzbyB0aGF0IHRoZSBIVCByZWdpb24KaXMgbm90IHRvdWNoZWRdOgoKIC4uLgog
ICAgIHBjaV9idXMgMDAwMDowMDogcm9vdCBidXMgcmVzb3VyY2UgW2lvICAweDAwMDAtMHgwY2Y3
IHdpbmRvd10KICAgICBwY2lfYnVzIDAwMDA6MDA6IHJvb3QgYnVzIHJlc291cmNlIFtpbyAgMHgw
ZDAwLTB4ZmZmZiB3aW5kb3ddCiAgICAgcGNpX2J1cyAwMDAwOjAwOiByb290IGJ1cyByZXNvdXJj
ZSBbbWVtIDB4MDAwYTAwMDAtMHgwMDBiZmZmZiB3aW5kb3ddCiAgICAgcGNpX2J1cyAwMDAwOjAw
OiByb290IGJ1cyByZXNvdXJjZSBbbWVtIDB4ZjAwMDAwMDAtMHhmYmZmZmZmZiB3aW5kb3ddCiAg
ICAgcGNpX2J1cyAwMDAwOjAwOiByb290IGJ1cyByZXNvdXJjZSBbbWVtIDB4MTBmYzAwMDAwLTB4
ZmNmZmZmZmZmZSB3aW5kb3ddCiAgICAgcGNpX2J1cyAwMDAwOjAwOiByb290IGJ1cyByZXNvdXJj
ZSBbbWVtIDB4MTAwMDAwMDAwMDAtMHhmZmZmZmZmZmZmZmYgd2luZG93XQogICAgIHBjaV9idXMg
MDAwMDowMDogcm9vdCBidXMgcmVzb3VyY2UgW2J1cyAwMC1mZl0KCmZyb206CiAgICBwY2lfYnVz
IDAwMDA6MDA6IHJvb3QgYnVzIHJlc291cmNlIFtpbyAgMHgwMDAwLTB4MGNmNyB3aW5kb3ddCiAg
ICBwY2lfYnVzIDAwMDA6MDA6IHJvb3QgYnVzIHJlc291cmNlIFtpbyAgMHgwZDAwLTB4ZmZmZiB3
aW5kb3ddCiAgICBwY2lfYnVzIDAwMDA6MDA6IHJvb3QgYnVzIHJlc291cmNlIFttZW0gMHgwMDBh
MDAwMC0weDAwMGJmZmZmIHdpbmRvd10KICAgIHBjaV9idXMgMDAwMDowMDogcm9vdCBidXMgcmVz
b3VyY2UgW21lbSAweGUwMDAwMDAwLTB4ZmJmZmZmZmYgd2luZG93XQogICAgcGNpX2J1cyAwMDAw
OjAwOiByb290IGJ1cyByZXNvdXJjZSBbYnVzIDAwLWZmXQoKRXhjZXB0IHRoYXQgd2hlbiBJIHRy
aWVkIHRoaXMgd2l0aCBXaW5kb3dzIDIwMDAgSSBmb3VuZCBvdXQgdGhhdAppdHMgQU1MIGludGVy
cHJldGVyIGJsb3dzIHVwIGlmIGFueSBvZiB0aGUgdmFsdWVzIGFyZSBiaWdnZXIgdGhhbgo4R0Iu
IFdpdGggYSBiaXQgb2YgZXh0cmEgQU1MIGR1Y3QtdGFwZSB0aGF0IGdvdCBzb2x2ZWQsIGFsYmVp
dCBJIG5lZWQKdG8gdmVyaWZ5IG90aGVyIFdpbmRvd3MgcGxhdGZvcm1zLiBXaGljaCByZW1pbmRz
IG1lIC0geW91IGhhZCBkYWJibGVkCmluIHRoaXMgLSBhcmUgdGhlcmUgYW55IG90aGVyIHN1cnBy
aXNlcyBJIHNob3VsZCBiZSBhd2FyZSBvZiA/Cgo+IAo+IEphbgo+IAoKX19fX19fX19fX19fX19f
X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KWGVuLWRldmVsIG1haWxpbmcgbGlzdApY
ZW4tZGV2ZWxAbGlzdHMueGVuLm9yZwpodHRwczovL2xpc3RzLnhlbi5vcmcveGVuLWRldmVsCg==