From mboxrd@z Thu Jan 1 00:00:00 1970 From: Oleksandr Andrushchenko Subject: [Xen-devel][RFC 3/3] xen/gntdev: Add support for Linux dma buffers Date: Thu, 17 May 2018 11:26:04 +0300 Message-ID: <20180517082604.14828-4-andr2000@gmail.com> References: <20180517082604.14828-1-andr2000@gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Return-path: Received: from mail-lf0-x241.google.com (mail-lf0-x241.google.com [IPv6:2a00:1450:4010:c07::241]) by gabe.freedesktop.org (Postfix) with ESMTPS id E72A56E6D9 for ; Thu, 17 May 2018 08:26:18 +0000 (UTC) Received: by mail-lf0-x241.google.com with SMTP id t129-v6so7461177lff.3 for ; Thu, 17 May 2018 01:26:18 -0700 (PDT) In-Reply-To: <20180517082604.14828-1-andr2000@gmail.com> List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dri-devel-bounces@lists.freedesktop.org Sender: "dri-devel" To: xen-devel@lists.xenproject.org, linux-kernel@vger.kernel.org, dri-devel@lists.freedesktop.org, linux-media@vger.kernel.org, jgross@suse.com, boris.ostrovsky@oracle.com, konrad.wilk@oracle.com Cc: andr2000@gmail.com, daniel.vetter@intel.com, dongwon.kim@intel.com, Oleksandr Andrushchenko List-Id: dri-devel@lists.freedesktop.org RnJvbTogT2xla3NhbmRyIEFuZHJ1c2hjaGVua28gPG9sZWtzYW5kcl9hbmRydXNoY2hlbmtvQGVw YW0uY29tPgoKU2lnbmVkLW9mZi1ieTogT2xla3NhbmRyIEFuZHJ1c2hjaGVua28gPG9sZWtzYW5k cl9hbmRydXNoY2hlbmtvQGVwYW0uY29tPgotLS0KIGRyaXZlcnMveGVuL2dudGRldi5jICAgICAg fCA5NTQgKysrKysrKysrKysrKysrKysrKysrKysrKysrKysrKysrKysrKy0KIGluY2x1ZGUvdWFw aS94ZW4vZ250ZGV2LmggfCAxMDEgKysrKwogaW5jbHVkZS94ZW4vZ250ZGV2X2V4cC5oICB8ICAy MyArCiAzIGZpbGVzIGNoYW5nZWQsIDEwNjYgaW5zZXJ0aW9ucygrKSwgMTIgZGVsZXRpb25zKC0p CiBjcmVhdGUgbW9kZSAxMDA2NDQgaW5jbHVkZS94ZW4vZ250ZGV2X2V4cC5oCgpkaWZmIC0tZ2l0 IGEvZHJpdmVycy94ZW4vZ250ZGV2LmMgYi9kcml2ZXJzL3hlbi9nbnRkZXYuYwppbmRleCA5NTEw ZjIyOGVmZTkuLjBlZTg4ZTE5MzM2MiAxMDA2NDQKLS0tIGEvZHJpdmVycy94ZW4vZ250ZGV2LmMK KysrIGIvZHJpdmVycy94ZW4vZ250ZGV2LmMKQEAgLTQsNiArNCw4IEBACiAgKiBEZXZpY2UgZm9y IGFjY2Vzc2luZyAoaW4gdXNlci1zcGFjZSkgcGFnZXMgdGhhdCBoYXZlIGJlZW4gZ3JhbnRlZCBi eSBvdGhlcgogICogZG9tYWlucy4KICAqCisgKiBETUEgYnVmZmVyIGltcGxlbWVudGF0aW9uIGlz IGJhc2VkIG9uIGRyaXZlcnMvZ3B1L2RybS9kcm1fcHJpbWUuYy4KKyAqCiAgKiBDb3B5cmlnaHQg KGMpIDIwMDYtMjAwNywgRCBHIE11cnJheS4KICAqICAgICAgICAgICAoYykgMjAwOSBHZXJkIEhv ZmZtYW5uIDxrcmF4ZWxAcmVkaGF0LmNvbT4KICAqCkBAIC0zNyw2ICszOSw5IEBACiAjaW5jbHVk ZSA8bGludXgvaGlnaG1lbS5oPgogI2luY2x1ZGUgPGxpbnV4L3JlZmNvdW50Lmg+CiAKKyNpbmNs dWRlIDxsaW51eC9kbWEtYnVmLmg+CisjaW5jbHVkZSA8bGludXgvb2ZfZGV2aWNlLmg+CisKICNp bmNsdWRlIDx4ZW4veGVuLmg+CiAjaW5jbHVkZSA8eGVuL2dyYW50X3RhYmxlLmg+CiAjaW5jbHVk ZSA8eGVuL2JhbGxvb24uaD4KQEAgLTYxLDE2ICs2NiwzOSBAQCBzdGF0aWMgYXRvbWljX3QgcGFn ZXNfbWFwcGVkID0gQVRPTUlDX0lOSVQoMCk7CiBzdGF0aWMgaW50IHVzZV9wdGVtb2Q7CiAjZGVm aW5lIHBvcHVsYXRlX2ZyZWVhYmxlX21hcHMgdXNlX3B0ZW1vZAogCisjaWZuZGVmIEdSQU5UX0lO VkFMSURfUkVGCisvKgorICogTm90ZSBvbiB1c2FnZSBvZiBncmFudCByZWZlcmVuY2UgMCBhcyBp bnZhbGlkIGdyYW50IHJlZmVyZW5jZToKKyAqIGdyYW50IHJlZmVyZW5jZSAwIGlzIHZhbGlkLCBi dXQgbmV2ZXIgZXhwb3NlZCB0byBhIGRyaXZlciwKKyAqIGJlY2F1c2Ugb2YgdGhlIGZhY3QgaXQg aXMgYWxyZWFkeSBpbiB1c2UvcmVzZXJ2ZWQgYnkgdGhlIFBWIGNvbnNvbGUuCisgKi8KKyNkZWZp bmUgR1JBTlRfSU5WQUxJRF9SRUYJMAorI2VuZGlmCisKIHN0cnVjdCBnbnRkZXZfcHJpdiB7CiAJ LyogbWFwcyB3aXRoIHZpc2libGUgb2Zmc2V0cyBpbiB0aGUgZmlsZSBkZXNjcmlwdG9yICovCiAJ c3RydWN0IGxpc3RfaGVhZCBtYXBzOwogCS8qIG1hcHMgdGhhdCBhcmUgbm90IHZpc2libGU7IHdp bGwgYmUgZnJlZWQgb24gbXVubWFwLgogCSAqIE9ubHkgcG9wdWxhdGVkIGlmIHBvcHVsYXRlX2Zy ZWVhYmxlX21hcHMgPT0gMSAqLwogCXN0cnVjdCBsaXN0X2hlYWQgZnJlZWFibGVfbWFwczsKKwkv KiBMaXN0IG9mIGRtYS1idWZzLiAqLworCXN0cnVjdCBsaXN0X2hlYWQgZG1hX2J1ZnM7CiAJLyog bG9jayBwcm90ZWN0cyBtYXBzIGFuZCBmcmVlYWJsZV9tYXBzICovCiAJc3RydWN0IG11dGV4IGxv Y2s7CiAJc3RydWN0IG1tX3N0cnVjdCAqbW07CiAJc3RydWN0IG1tdV9ub3RpZmllciBtbjsKKwor CS8qIFByaXZhdGUgZGF0YSBvZiB0aGUgaHlwZXIgRE1BIGJ1ZmZlcnMuICovCisKKwlzdHJ1Y3Qg ZGV2aWNlICpkZXY7CisJLyogTGlzdCBvZiBleHBvcnRlZCBETUEgYnVmZmVycy4gKi8KKwlzdHJ1 Y3QgbGlzdF9oZWFkIGRtYWJ1Zl9leHBfbGlzdDsKKwkvKiBMaXN0IG9mIHdhaXQgb2JqZWN0cy4g Ki8KKwlzdHJ1Y3QgbGlzdF9oZWFkIGRtYWJ1Zl9leHBfd2FpdF9saXN0OworCS8qIExpc3Qgb2Yg aW1wb3J0ZWQgRE1BIGJ1ZmZlcnMuICovCisJc3RydWN0IGxpc3RfaGVhZCBkbWFidWZfaW1wX2xp c3Q7CisJLyogVGhpcyBpcyB0aGUgbG9jayB3aGljaCBwcm90ZWN0cyBkbWFfYnVmX3h4eCBsaXN0 cy4gKi8KKwlzdHJ1Y3QgbXV0ZXggZG1hYnVmX2xvY2s7CiB9OwogCiBzdHJ1Y3QgdW5tYXBfbm90 aWZ5IHsKQEAgLTk1LDEwICsxMjMsNjUgQEAgc3RydWN0IGdyYW50X21hcCB7CiAJc3RydWN0IGdu dHRhYl91bm1hcF9ncmFudF9yZWYgKmt1bm1hcF9vcHM7CiAJc3RydWN0IHBhZ2UgKipwYWdlczsK IAl1bnNpZ25lZCBsb25nIHBhZ2VzX3ZtX3N0YXJ0OworCisJLyoKKwkgKiBBbGwgdGhlIGZpZWxk cyBzdGFydGluZyB3aXRoIGRtYWJ1Zl8gYXJlIG9ubHkgdmFsaWQgaWYgdGhpcworCSAqIG1hcHBp bmcgaXMgdXNlZCBmb3IgZXhwb3J0aW5nIGEgRE1BIGJ1ZmZlci4KKwkgKiBJZiBkbWFidWZfdmFk ZHIgaXMgbm90IE5VTEwgdGhlbiB0aGlzIG1hcHBpbmcgaXMgYmFja2VkIGJ5IERNQQorCSAqIGNh cGFibGUgbWVtb3J5LgorCSAqLworCisJLyogRmxhZ3MgdXNlZCB0byBjcmVhdGUgdGhpcyBETUEg YnVmZmVyOiBHTlRERVZfRE1BQlVGX0ZMQUdfWFhYLiAqLworCWJvb2wgZG1hYnVmX2ZsYWdzOwor CS8qIFZpcnR1YWwvQ1BVIGFkZHJlc3Mgb2YgdGhlIERNQSBidWZmZXIuICovCisJdm9pZCAqZG1h YnVmX3ZhZGRyOworCS8qIEJ1cyBhZGRyZXNzIG9mIHRoZSBETUEgYnVmZmVyLiAqLworCWRtYV9h ZGRyX3QgZG1hYnVmX2J1c19hZGRyOworfTsKKworc3RydWN0IGh5cGVyX2RtYWJ1ZiB7CisJc3Ry dWN0IGdudGRldl9wcml2ICpwcml2OworCXN0cnVjdCBkbWFfYnVmICpkbWFidWY7CisJc3RydWN0 IGxpc3RfaGVhZCBuZXh0OworCWludCBmZDsKKworCXVuaW9uIHsKKwkJc3RydWN0IHsKKwkJCS8q IEV4cG9ydGVkIGJ1ZmZlcnMgYXJlIHJlZmVyZW5jZSBjb3VudGVkLiAqLworCQkJc3RydWN0IGty ZWYgcmVmY291bnQ7CisJCQlzdHJ1Y3QgZ3JhbnRfbWFwICptYXA7CisJCX0gZXhwOworCQlzdHJ1 Y3QgeworCQkJLyogR3JhbnRlZCByZWZlcmVuY2VzIG9mIHRoZSBpbXBvcnRlZCBidWZmZXIuICov CisJCQlncmFudF9yZWZfdCAqcmVmczsKKwkJCS8qIFNjYXR0ZXItZ2F0aGVyIHRhYmxlIG9mIHRo ZSBpbXBvcnRlZCBidWZmZXIuICovCisJCQlzdHJ1Y3Qgc2dfdGFibGUgKnNndDsKKwkJCS8qIGRt YS1idWYgYXR0YWNobWVudCBvZiB0aGUgaW1wb3J0ZWQgYnVmZmVyLiAqLworCQkJc3RydWN0IGRt YV9idWZfYXR0YWNobWVudCAqYXR0YWNoOworCQl9IGltcDsKKwl9IHU7CisKKwkvKiBOdW1iZXIg b2YgcGFnZXMgdGhpcyBidWZmZXIgaGFzLiAqLworCWludCBucl9wYWdlczsKKwkvKiBQYWdlcyBv ZiB0aGlzIGJ1ZmZlci4gKi8KKwlzdHJ1Y3QgcGFnZSAqKnBhZ2VzOworfTsKKworc3RydWN0IGh5 cGVyX2RtYWJ1Zl93YWl0X29iaiB7CisJc3RydWN0IGxpc3RfaGVhZCBuZXh0OworCXN0cnVjdCBo eXBlcl9kbWFidWYgKmh5cGVyX2RtYWJ1ZjsKKwlzdHJ1Y3QgY29tcGxldGlvbiBjb21wbGV0aW9u OworfTsKKworc3RydWN0IGh5cGVyX2RhbWJ1Zl9hdHRhY2htZW50IHsKKwlzdHJ1Y3Qgc2dfdGFi bGUgKnNndDsKKwllbnVtIGRtYV9kYXRhX2RpcmVjdGlvbiBkaXI7CiB9OwogCiBzdGF0aWMgaW50 IHVubWFwX2dyYW50X3BhZ2VzKHN0cnVjdCBncmFudF9tYXAgKm1hcCwgaW50IG9mZnNldCwgaW50 IHBhZ2VzKTsKIAorc3RhdGljIHN0cnVjdCBtaXNjZGV2aWNlIGdudGRldl9taXNjZGV2OworCiAv KiAtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0gKi8KIAogc3RhdGljIHZvaWQgZ250ZGV2X3ByaW50X21hcHMoc3RydWN0IGdu dGRldl9wcml2ICpwcml2LApAQCAtMTIwLDggKzIwMywxNyBAQCBzdGF0aWMgdm9pZCBnbnRkZXZf ZnJlZV9tYXAoc3RydWN0IGdyYW50X21hcCAqbWFwKQogCWlmIChtYXAgPT0gTlVMTCkKIAkJcmV0 dXJuOwogCi0JaWYgKG1hcC0+cGFnZXMpCisJaWYgKG1hcC0+ZG1hYnVmX3ZhZGRyKSB7CisJCWJv b2wgY29oZXJlbnQgPSBtYXAtPmRtYWJ1Zl9mbGFncyAmCisJCQlHTlRERVZfRE1BQlVGX0ZMQUdf RE1BX0NPSEVSRU5UOworCisJCWdudHRhYl9kbWFfZnJlZV9wYWdlcyhnbnRkZXZfbWlzY2Rldi50 aGlzX2RldmljZSwKKwkJCQkgICAgICBjb2hlcmVudCwgbWFwLT5jb3VudCwgbWFwLT5wYWdlcywK KwkJCQkgICAgICBtYXAtPmRtYWJ1Zl92YWRkciwgbWFwLT5kbWFidWZfYnVzX2FkZHIpOworCX0g ZWxzZSBpZiAobWFwLT5wYWdlcykgewogCQlnbnR0YWJfZnJlZV9wYWdlcyhtYXAtPmNvdW50LCBt YXAtPnBhZ2VzKTsKKwl9CisKIAlrZnJlZShtYXAtPnBhZ2VzKTsKIAlrZnJlZShtYXAtPmdyYW50 cyk7CiAJa2ZyZWUobWFwLT5tYXBfb3BzKTsKQEAgLTEzMSw3ICsyMjMsNyBAQCBzdGF0aWMgdm9p ZCBnbnRkZXZfZnJlZV9tYXAoc3RydWN0IGdyYW50X21hcCAqbWFwKQogCWtmcmVlKG1hcCk7CiB9 CiAKLXN0YXRpYyBzdHJ1Y3QgZ3JhbnRfbWFwICpnbnRkZXZfYWxsb2NfbWFwKHN0cnVjdCBnbnRk ZXZfcHJpdiAqcHJpdiwgaW50IGNvdW50KQorc3RhdGljIHN0cnVjdCBncmFudF9tYXAgKmdudGRl dl9hbGxvY19tYXAoaW50IGNvdW50LCBpbnQgZG1hYnVmX2ZsYWdzKQogewogCXN0cnVjdCBncmFu dF9tYXAgKmFkZDsKIAlpbnQgaTsKQEAgLTE1NCw4ICsyNDYsMjYgQEAgc3RhdGljIHN0cnVjdCBn cmFudF9tYXAgKmdudGRldl9hbGxvY19tYXAoc3RydWN0IGdudGRldl9wcml2ICpwcml2LCBpbnQg Y291bnQpCiAJICAgIE5VTEwgPT0gYWRkLT5wYWdlcykKIAkJZ290byBlcnI7CiAKLQlpZiAoZ250 dGFiX2FsbG9jX3BhZ2VzKGNvdW50LCBhZGQtPnBhZ2VzKSkKLQkJZ290byBlcnI7CisJYWRkLT5k bWFidWZfZmxhZ3MgPSBkbWFidWZfZmxhZ3M7CisKKwkvKgorCSAqIENoZWNrIGlmIHRoaXMgbWFw cGluZyBpcyByZXF1ZXN0ZWQgdG8gYmUgYmFja2VkCisJICogYnkgYSBETUEgYnVmZmVyLgorCSAq LworCWlmIChkbWFidWZfZmxhZ3MgJiAoR05UREVWX0RNQUJVRl9GTEFHX0RNQV9XQyB8CisJCSAg ICAgR05UREVWX0RNQUJVRl9GTEFHX0RNQV9DT0hFUkVOVCkpIHsKKwkJYm9vbCBjb2hlcmVudCA9 IGRtYWJ1Zl9mbGFncyAmIEdOVERFVl9ETUFCVUZfRkxBR19ETUFfQ09IRVJFTlQ7CisKKwkJaWYg KGdudHRhYl9kbWFfYWxsb2NfcGFnZXMoZ250ZGV2X21pc2NkZXYudGhpc19kZXZpY2UsCisJCQkJ CSAgIGNvaGVyZW50LAorCQkJCQkgICBjb3VudCwgYWRkLT5wYWdlcywKKwkJCQkJICAgJmFkZC0+ ZG1hYnVmX3ZhZGRyLAorCQkJCQkgICAmYWRkLT5kbWFidWZfYnVzX2FkZHIpKQorCQkJZ290byBl cnI7CisJfSBlbHNlIHsKKwkJaWYgKGdudHRhYl9hbGxvY19wYWdlcyhjb3VudCwgYWRkLT5wYWdl cykpCisJCQlnb3RvIGVycjsKKwl9CiAKIAlmb3IgKGkgPSAwOyBpIDwgY291bnQ7IGkrKykgewog CQlhZGQtPm1hcF9vcHNbaV0uaGFuZGxlID0gLTE7CkBAIC0yMzMsNiArMzQzLDE1IEBAIHN0YXRp YyB2b2lkIGdudGRldl9wdXRfbWFwKHN0cnVjdCBnbnRkZXZfcHJpdiAqcHJpdiwgc3RydWN0IGdy YW50X21hcCAqbWFwKQogCWdudGRldl9mcmVlX21hcChtYXApOwogfQogCitzdGF0aWMgdm9pZCBn bnRkZXZfcHV0X21hcF91bmxpbmsoc3RydWN0IGdudGRldl9wcml2ICpwcml2LAorCQkJCSAgc3Ry dWN0IGdyYW50X21hcCAqbWFwKQoreworCW11dGV4X2xvY2soJnByaXYtPmxvY2spOworCWxpc3Rf ZGVsKCZtYXAtPm5leHQpOworCWdudGRldl9wdXRfbWFwKE5VTEwgLyogYWxyZWFkeSByZW1vdmVk ICovLCBtYXApOworCW11dGV4X3VubG9jaygmcHJpdi0+bG9jayk7Cit9CisKIC8qIC0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LSAqLwogCiBzdGF0aWMgaW50IGZpbmRfZ3JhbnRfcHRlcyhwdGVfdCAqcHRlLCBwZ3RhYmxlX3Qg dG9rZW4sCkBAIC0zMjQsNiArNDQzLDEyIEBAIHN0YXRpYyBpbnQgbWFwX2dyYW50X3BhZ2VzKHN0 cnVjdCBncmFudF9tYXAgKm1hcCkKIAkJbWFwLT51bm1hcF9vcHNbaV0uaGFuZGxlID0gbWFwLT5t YXBfb3BzW2ldLmhhbmRsZTsKIAkJaWYgKHVzZV9wdGVtb2QpCiAJCQltYXAtPmt1bm1hcF9vcHNb aV0uaGFuZGxlID0gbWFwLT5rbWFwX29wc1tpXS5oYW5kbGU7CisJCWVsc2UgaWYgKG1hcC0+ZG1h YnVmX3ZhZGRyKSB7CisJCQl1bnNpZ25lZCBsb25nIG1mbjsKKworCQkJbWZuID0gX19wZm5fdG9f bWZuKHBhZ2VfdG9fcGZuKG1hcC0+cGFnZXNbaV0pKTsKKwkJCW1hcC0+dW5tYXBfb3BzW2ldLmRl dl9idXNfYWRkciA9IF9fcGZuX3RvX3BoeXMobWZuKTsKKwkJfQogCX0KIAlyZXR1cm4gZXJyOwog fQpAQCAtNTI3LDE5ICs2NTIsNDggQEAgc3RhdGljIGNvbnN0IHN0cnVjdCBtbXVfbm90aWZpZXJf b3BzIGdudGRldl9tbXVfb3BzID0gewogCiAvKiAtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0gKi8KIAotc3RhdGljIGludCBn bnRkZXZfb3BlbihzdHJ1Y3QgaW5vZGUgKmlub2RlLCBzdHJ1Y3QgZmlsZSAqZmxpcCkKK3N0cnVj dCBnbnRkZXZfcHJpdiAqZ250ZGV2X2FsbG9jX2NvbnRleHQoc3RydWN0IGRldmljZSAqZGV2KQog ewogCXN0cnVjdCBnbnRkZXZfcHJpdiAqcHJpdjsKLQlpbnQgcmV0ID0gMDsKIAogCXByaXYgPSBr emFsbG9jKHNpemVvZigqcHJpdiksIEdGUF9LRVJORUwpOwogCWlmICghcHJpdikKLQkJcmV0dXJu IC1FTk9NRU07CisJCXJldHVybiBFUlJfUFRSKC1FTk9NRU0pOwogCiAJSU5JVF9MSVNUX0hFQUQo JnByaXYtPm1hcHMpOwogCUlOSVRfTElTVF9IRUFEKCZwcml2LT5mcmVlYWJsZV9tYXBzKTsKIAlt dXRleF9pbml0KCZwcml2LT5sb2NrKTsKIAorCXByaXYtPmRldiA9IGRldjsKKwltdXRleF9pbml0 KCZwcml2LT5kbWFidWZfbG9jayk7CisJSU5JVF9MSVNUX0hFQUQoJnByaXYtPmRtYWJ1Zl9leHBf bGlzdCk7CisJSU5JVF9MSVNUX0hFQUQoJnByaXYtPmRtYWJ1Zl9leHBfd2FpdF9saXN0KTsKKwlJ TklUX0xJU1RfSEVBRCgmcHJpdi0+ZG1hYnVmX2ltcF9saXN0KTsKKworCS8qCisJICogVGhlIGRl dmljZSBpcyBub3Qgc3Bhd24gZnJvbSBhIGRldmljZSB0cmVlLCBzbyBhcmNoX3NldHVwX2RtYV9v cHMKKwkgKiBpcyBub3QgY2FsbGVkLCB0aHVzIGxlYXZpbmcgdGhlIGRldmljZSB3aXRoIGR1bW15 IERNQSBvcHMuCisJICogVGhpcyBtYWtlcyB0aGUgZGV2aWNlIHJldHVybiBlcnJvciBvbiBQUklN RSBidWZmZXIgaW1wb3J0LCB3aGljaAorCSAqIGlzIG5vdCBjb3JyZWN0OiB0byBmaXggdGhpcyBj YWxsIG9mX2RtYV9jb25maWd1cmUoKSB3aXRoIGEgTlVMTAorCSAqIG5vZGUgdG8gc2V0IGRlZmF1 bHQgRE1BIG9wcy4KKwkgKi8KKwlvZl9kbWFfY29uZmlndXJlKGRldiwgTlVMTCk7CisKKwlwcl9k ZWJ1ZygicHJpdiAlcFxuIiwgcHJpdik7CisKKwlyZXR1cm4gcHJpdjsKK30KK0VYUE9SVF9TWU1C T0woZ250ZGV2X2FsbG9jX2NvbnRleHQpOworCitzdGF0aWMgaW50IGdudGRldl9vcGVuKHN0cnVj dCBpbm9kZSAqaW5vZGUsIHN0cnVjdCBmaWxlICpmbGlwKQoreworCXN0cnVjdCBnbnRkZXZfcHJp diAqcHJpdjsKKwlpbnQgcmV0ID0gMDsKKworCXByaXYgPSBnbnRkZXZfYWxsb2NfY29udGV4dChn bnRkZXZfbWlzY2Rldi50aGlzX2RldmljZSk7CisJaWYgKElTX0VSUihwcml2KSkKKwkJcmV0dXJu IFBUUl9FUlIocHJpdik7CisKIAlpZiAodXNlX3B0ZW1vZCkgewogCQlwcml2LT5tbSA9IGdldF90 YXNrX21tKGN1cnJlbnQpOwogCQlpZiAoIXByaXYtPm1tKSB7CkBAIC01NTcsMTQgKzcxMSwxMiBA QCBzdGF0aWMgaW50IGdudGRldl9vcGVuKHN0cnVjdCBpbm9kZSAqaW5vZGUsIHN0cnVjdCBmaWxl ICpmbGlwKQogCX0KIAogCWZsaXAtPnByaXZhdGVfZGF0YSA9IHByaXY7Ci0JcHJfZGVidWcoInBy aXYgJXBcbiIsIHByaXYpOwogCiAJcmV0dXJuIDA7CiB9CiAKLXN0YXRpYyBpbnQgZ250ZGV2X3Jl bGVhc2Uoc3RydWN0IGlub2RlICppbm9kZSwgc3RydWN0IGZpbGUgKmZsaXApCit2b2lkIGdudGRl dl9mcmVlX2NvbnRleHQoc3RydWN0IGdudGRldl9wcml2ICpwcml2KQogewotCXN0cnVjdCBnbnRk ZXZfcHJpdiAqcHJpdiA9IGZsaXAtPnByaXZhdGVfZGF0YTsKIAlzdHJ1Y3QgZ3JhbnRfbWFwICpt YXA7CiAKIAlwcl9kZWJ1ZygicHJpdiAlcFxuIiwgcHJpdik7CkBAIC01NzYsMTEgKzcyOCwyOCBA QCBzdGF0aWMgaW50IGdudGRldl9yZWxlYXNlKHN0cnVjdCBpbm9kZSAqaW5vZGUsIHN0cnVjdCBm aWxlICpmbGlwKQogCQlnbnRkZXZfcHV0X21hcChOVUxMIC8qIGFscmVhZHkgcmVtb3ZlZCAqLywg bWFwKTsKIAl9CiAJV0FSTl9PTighbGlzdF9lbXB0eSgmcHJpdi0+ZnJlZWFibGVfbWFwcykpOwor CiAJbXV0ZXhfdW5sb2NrKCZwcml2LT5sb2NrKTsKIAorCVdBUk4oIWxpc3RfZW1wdHkoJnByaXYt PmRtYWJ1Zl9leHBfbGlzdCksCisJICAgICAiUmVtb3Zpbmcgd2l0aCBub24tZW1wdHkgZXhwb3J0 ZWQgRE1BIGJ1ZmZlciBsaXN0IVxuIik7CisJV0FSTighbGlzdF9lbXB0eSgmcHJpdi0+ZG1hYnVm X2V4cF93YWl0X2xpc3QpLAorCSAgICAgIlJlbW92aW5nIHdpdGggcGVuZGluZyB3YWl0IG9iamVj dHMhXG4iKTsKKwlXQVJOKCFsaXN0X2VtcHR5KCZwcml2LT5kbWFidWZfaW1wX2xpc3QpLAorCSAg ICAgIlJlbW92aW5nIHdpdGggbm9uLWVtcHR5IGltcG9ydGVkIERNQSBidWZmZXIgbGlzdCFcbiIp OworCisJa2ZyZWUocHJpdik7Cit9CitFWFBPUlRfU1lNQk9MKGdudGRldl9mcmVlX2NvbnRleHQp OworCitzdGF0aWMgaW50IGdudGRldl9yZWxlYXNlKHN0cnVjdCBpbm9kZSAqaW5vZGUsIHN0cnVj dCBmaWxlICpmbGlwKQoreworCXN0cnVjdCBnbnRkZXZfcHJpdiAqcHJpdiA9IGZsaXAtPnByaXZh dGVfZGF0YTsKKwogCWlmICh1c2VfcHRlbW9kKQogCQltbXVfbm90aWZpZXJfdW5yZWdpc3Rlcigm cHJpdi0+bW4sIHByaXYtPm1tKTsKLQlrZnJlZShwcml2KTsKKworCWdudGRldl9mcmVlX2NvbnRl eHQocHJpdik7CiAJcmV0dXJuIDA7CiB9CiAKQEAgLTU5OCw3ICs3NjcsNyBAQCBzdGF0aWMgbG9u ZyBnbnRkZXZfaW9jdGxfbWFwX2dyYW50X3JlZihzdHJ1Y3QgZ250ZGV2X3ByaXYgKnByaXYsCiAJ CXJldHVybiAtRUlOVkFMOwogCiAJZXJyID0gLUVOT01FTTsKLQltYXAgPSBnbnRkZXZfYWxsb2Nf bWFwKHByaXYsIG9wLmNvdW50KTsKKwltYXAgPSBnbnRkZXZfYWxsb2NfbWFwKG9wLmNvdW50LCAw IC8qIHRoaXMgaXMgbm90IGEgZG1hLWJ1ZiAqLyk7CiAJaWYgKCFtYXApCiAJCXJldHVybiBlcnI7 CiAKQEAgLTk0OSw2ICsxMTE4LDc1NSBAQCBzdGF0aWMgbG9uZyBnbnRkZXZfaW9jdGxfZ3JhbnRf Y29weShzdHJ1Y3QgZ250ZGV2X3ByaXYgKnByaXYsIHZvaWQgX191c2VyICp1KQogCXJldHVybiBy ZXQ7CiB9CiAKKy8qIC0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLSAqLworLyogRE1BIGJ1ZmZlciBzdXBwb3J0LiAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICovCisvKiAtLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0g Ki8KKworLyogLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tICovCisvKiBJbXBsZW1lbnRhdGlvbiBvZiB3YWl0IGZvciBleHBv cnRlZCBETUEgYnVmZmVyIHJlbGVhc2VkLiAgICAgICAgICAgKi8KKy8qIC0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLSAqLwor CitzdGF0aWMgdm9pZCBkbWFidWZfZXhwX3JlbGVhc2Uoc3RydWN0IGtyZWYgKmtyZWYpOworCitz dGF0aWMgc3RydWN0IGh5cGVyX2RtYWJ1Zl93YWl0X29iaiAqCitkbWFidWZfZXhwX3dhaXRfb2Jq X25ldyhzdHJ1Y3QgZ250ZGV2X3ByaXYgKnByaXYsCisJCQlzdHJ1Y3QgaHlwZXJfZG1hYnVmICpo eXBlcl9kbWFidWYpCit7CisJc3RydWN0IGh5cGVyX2RtYWJ1Zl93YWl0X29iaiAqb2JqOworCisJ b2JqID0ga3phbGxvYyhzaXplb2YoKm9iaiksIEdGUF9LRVJORUwpOworCWlmICghb2JqKQorCQly ZXR1cm4gRVJSX1BUUigtRU5PTUVNKTsKKworCWluaXRfY29tcGxldGlvbigmb2JqLT5jb21wbGV0 aW9uKTsKKwlvYmotPmh5cGVyX2RtYWJ1ZiA9IGh5cGVyX2RtYWJ1ZjsKKworCW11dGV4X2xvY2so JnByaXYtPmRtYWJ1Zl9sb2NrKTsKKwlsaXN0X2FkZCgmb2JqLT5uZXh0LCAmcHJpdi0+ZG1hYnVm X2V4cF93YWl0X2xpc3QpOworCS8qIFB1dCBvdXIgcmVmZXJlbmNlIGFuZCB3YWl0IGZvciBoeXBl cl9kbWFidWYncyByZWxlYXNlIHRvIGZpcmUuICovCisJa3JlZl9wdXQoJmh5cGVyX2RtYWJ1Zi0+ dS5leHAucmVmY291bnQsIGRtYWJ1Zl9leHBfcmVsZWFzZSk7CisJbXV0ZXhfdW5sb2NrKCZwcml2 LT5kbWFidWZfbG9jayk7CisJcmV0dXJuIG9iajsKK30KKworc3RhdGljIHZvaWQgZG1hYnVmX2V4 cF93YWl0X29ial9mcmVlKHN0cnVjdCBnbnRkZXZfcHJpdiAqcHJpdiwKKwkJCQkgICAgIHN0cnVj dCBoeXBlcl9kbWFidWZfd2FpdF9vYmogKm9iaikKK3sKKwlzdHJ1Y3QgaHlwZXJfZG1hYnVmX3dh aXRfb2JqICpjdXJfb2JqLCAqcTsKKworCW11dGV4X2xvY2soJnByaXYtPmRtYWJ1Zl9sb2NrKTsK KwlsaXN0X2Zvcl9lYWNoX2VudHJ5X3NhZmUoY3VyX29iaiwgcSwgJnByaXYtPmRtYWJ1Zl9leHBf d2FpdF9saXN0LCBuZXh0KQorCQlpZiAoY3VyX29iaiA9PSBvYmopIHsKKwkJCWxpc3RfZGVsKCZv YmotPm5leHQpOworCQkJa2ZyZWUob2JqKTsKKwkJCWJyZWFrOworCQl9CisJbXV0ZXhfdW5sb2Nr KCZwcml2LT5kbWFidWZfbG9jayk7Cit9CisKK3N0YXRpYyBpbnQgZG1hYnVmX2V4cF93YWl0X29i al93YWl0KHN0cnVjdCBoeXBlcl9kbWFidWZfd2FpdF9vYmogKm9iaiwKKwkJCQkgICAgdTMyIHdh aXRfdG9fbXMpCit7CisJaWYgKHdhaXRfZm9yX2NvbXBsZXRpb25fdGltZW91dCgmb2JqLT5jb21w bGV0aW9uLAorCQkJbXNlY3NfdG9famlmZmllcyh3YWl0X3RvX21zKSkgPD0gMCkKKwkJcmV0dXJu IC1FVElNRURPVVQ7CisKKwlyZXR1cm4gMDsKK30KKworc3RhdGljIHZvaWQgZG1hYnVmX2V4cF93 YWl0X29ial9zaWduYWwoc3RydWN0IGdudGRldl9wcml2ICpwcml2LAorCQkJCSAgICAgICBzdHJ1 Y3QgaHlwZXJfZG1hYnVmICpoeXBlcl9kbWFidWYpCit7CisJc3RydWN0IGh5cGVyX2RtYWJ1Zl93 YWl0X29iaiAqb2JqLCAqcTsKKworCWxpc3RfZm9yX2VhY2hfZW50cnlfc2FmZShvYmosIHEsICZw cml2LT5kbWFidWZfZXhwX3dhaXRfbGlzdCwgbmV4dCkKKwkJaWYgKG9iai0+aHlwZXJfZG1hYnVm ID09IGh5cGVyX2RtYWJ1ZikgeworCQkJcHJfZGVidWcoIkZvdW5kIGh5cGVyX2RtYWJ1ZiBpbiB0 aGUgd2FpdCBsaXN0LCB3YWtlXG4iKTsKKwkJCWNvbXBsZXRlX2FsbCgmb2JqLT5jb21wbGV0aW9u KTsKKwkJfQorfQorCitzdGF0aWMgc3RydWN0IGh5cGVyX2RtYWJ1ZiAqCitkbWFidWZfZXhwX3dh aXRfb2JqX2dldF9ieV9mZChzdHJ1Y3QgZ250ZGV2X3ByaXYgKnByaXYsIGludCBmZCkKK3sKKwlz dHJ1Y3QgaHlwZXJfZG1hYnVmICpxLCAqaHlwZXJfZG1hYnVmLCAqcmV0ID0gRVJSX1BUUigtRU5P RU5UKTsKKworCW11dGV4X2xvY2soJnByaXYtPmRtYWJ1Zl9sb2NrKTsKKwlsaXN0X2Zvcl9lYWNo X2VudHJ5X3NhZmUoaHlwZXJfZG1hYnVmLCBxLCAmcHJpdi0+ZG1hYnVmX2V4cF9saXN0LCBuZXh0 KQorCQlpZiAoaHlwZXJfZG1hYnVmLT5mZCA9PSBmZCkgeworCQkJcHJfZGVidWcoIkZvdW5kIGh5 cGVyX2RtYWJ1ZiBpbiB0aGUgd2FpdCBsaXN0XG4iKTsKKwkJCWtyZWZfZ2V0KCZoeXBlcl9kbWFi dWYtPnUuZXhwLnJlZmNvdW50KTsKKwkJCXJldCA9IGh5cGVyX2RtYWJ1ZjsKKwkJCWJyZWFrOwor CQl9CisJbXV0ZXhfdW5sb2NrKCZwcml2LT5kbWFidWZfbG9jayk7CisJcmV0dXJuIHJldDsKK30K Kworc3RhdGljIGludCBkbWFidWZfZXhwX3dhaXRfcmVsZWFzZWQoc3RydWN0IGdudGRldl9wcml2 ICpwcml2LCBpbnQgZmQsCisJCQkJICAgIGludCB3YWl0X3RvX21zKQoreworCXN0cnVjdCBoeXBl cl9kbWFidWYgKmh5cGVyX2RtYWJ1ZjsKKwlzdHJ1Y3QgaHlwZXJfZG1hYnVmX3dhaXRfb2JqICpv Ymo7CisJaW50IHJldDsKKworCXByX2RlYnVnKCJXaWxsIHdhaXQgZm9yIGRtYS1idWYgd2l0aCBm ZCAlZFxuIiwgZmQpOworCS8qCisJICogVHJ5IHRvIGZpbmQgdGhlIERNQSBidWZmZXI6IGlmIG5v dCBmb3VuZCBtZWFucyB0aGF0CisJICogZWl0aGVyIHRoZSBidWZmZXIgaGFzIGFscmVhZHkgYmVl biByZWxlYXNlZCBvciBmaWxlIGRlc2NyaXB0b3IKKwkgKiBwcm92aWRlZCBpcyB3cm9uZy4KKwkg Ki8KKwloeXBlcl9kbWFidWYgPSBkbWFidWZfZXhwX3dhaXRfb2JqX2dldF9ieV9mZChwcml2LCBm ZCk7CisJaWYgKElTX0VSUihoeXBlcl9kbWFidWYpKQorCQlyZXR1cm4gUFRSX0VSUihoeXBlcl9k bWFidWYpOworCisJLyoKKwkgKiBoeXBlcl9kbWFidWYgc3RpbGwgZXhpc3RzIGFuZCBpcyByZWZl cmVuY2UgY291bnQgbG9ja2VkIGJ5IHVzIG5vdywKKwkgKiBzbyBwcmVwYXJlIHRvIHdhaXQ6IGFs bG9jYXRlIHdhaXQgb2JqZWN0IGFuZCBhZGQgaXQgdG8gdGhlIHdhaXQgbGlzdCwKKwkgKiBzbyB3 ZSBjYW4gZmluZCBpdCBvbiByZWxlYXNlLgorCSAqLworCW9iaiA9IGRtYWJ1Zl9leHBfd2FpdF9v YmpfbmV3KHByaXYsIGh5cGVyX2RtYWJ1Zik7CisJaWYgKElTX0VSUihvYmopKSB7CisJCXByX2Vy cigiRmFpbGVkIHRvIHNldHVwIHdhaXQgb2JqZWN0LCByZXQgJWxkXG4iLCBQVFJfRVJSKG9iaikp OworCQlyZXR1cm4gUFRSX0VSUihvYmopOworCX0KKworCXJldCA9IGRtYWJ1Zl9leHBfd2FpdF9v Ympfd2FpdChvYmosIHdhaXRfdG9fbXMpOworCWRtYWJ1Zl9leHBfd2FpdF9vYmpfZnJlZShwcml2 LCBvYmopOworCXJldHVybiByZXQ7Cit9CisKKy8qIC0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLSAqLworLyogRE1BIGJ1ZmZl ciBleHBvcnQgc3VwcG9ydC4gICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICovCisvKiAtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0gKi8KKworc3RhdGljIHN0cnVjdCBzZ190YWJsZSAqCitkbWFidWZf cGFnZXNfdG9fc2d0KHN0cnVjdCBwYWdlICoqcGFnZXMsIHVuc2lnbmVkIGludCBucl9wYWdlcykK K3sKKwlzdHJ1Y3Qgc2dfdGFibGUgKnNndDsKKwlpbnQgcmV0OworCisJc2d0ID0ga21hbGxvYyhz aXplb2Yoc3RydWN0IHNnX3RhYmxlKSwgR0ZQX0tFUk5FTCk7CisJaWYgKCFzZ3QpIHsKKwkJcmV0 ID0gLUVOT01FTTsKKwkJZ290byBvdXQ7CisJfQorCisJcmV0ID0gc2dfYWxsb2NfdGFibGVfZnJv bV9wYWdlcyhzZ3QsIHBhZ2VzLCBucl9wYWdlcywgMCwKKwkJCQkJbnJfcGFnZXMgPDwgUEFHRV9T SElGVCwKKwkJCQkJR0ZQX0tFUk5FTCk7CisJaWYgKHJldCkKKwkJZ290byBvdXQ7CisKKwlyZXR1 cm4gc2d0OworCitvdXQ6CisJa2ZyZWUoc2d0KTsKKwlyZXR1cm4gRVJSX1BUUihyZXQpOworfQor CitzdGF0aWMgaW50IGRtYWJ1Zl9leHBfb3BzX2F0dGFjaChzdHJ1Y3QgZG1hX2J1ZiAqZG1hX2J1 ZiwKKwkJCQkgc3RydWN0IGRldmljZSAqdGFyZ2V0X2RldiwKKwkJCQkgc3RydWN0IGRtYV9idWZf YXR0YWNobWVudCAqYXR0YWNoKQoreworCXN0cnVjdCBoeXBlcl9kYW1idWZfYXR0YWNobWVudCAq aHlwZXJfZGFtYnVmX2F0dGFjaDsKKworCWh5cGVyX2RhbWJ1Zl9hdHRhY2ggPSBremFsbG9jKHNp emVvZigqaHlwZXJfZGFtYnVmX2F0dGFjaCksIEdGUF9LRVJORUwpOworCWlmICghaHlwZXJfZGFt YnVmX2F0dGFjaCkKKwkJcmV0dXJuIC1FTk9NRU07CisKKwloeXBlcl9kYW1idWZfYXR0YWNoLT5k aXIgPSBETUFfTk9ORTsKKwlhdHRhY2gtPnByaXYgPSBoeXBlcl9kYW1idWZfYXR0YWNoOworCS8q IE1pZ2h0IG5lZWQgdG8gcGluIHRoZSBwYWdlcyBvZiB0aGUgYnVmZmVyIG5vdy4gKi8KKwlyZXR1 cm4gMDsKK30KKworc3RhdGljIHZvaWQgZG1hYnVmX2V4cF9vcHNfZGV0YWNoKHN0cnVjdCBkbWFf YnVmICpkbWFfYnVmLAorCQkJCSAgc3RydWN0IGRtYV9idWZfYXR0YWNobWVudCAqYXR0YWNoKQor eworCXN0cnVjdCBoeXBlcl9kYW1idWZfYXR0YWNobWVudCAqaHlwZXJfZGFtYnVmX2F0dGFjaCA9 IGF0dGFjaC0+cHJpdjsKKworCWlmIChoeXBlcl9kYW1idWZfYXR0YWNoKSB7CisJCXN0cnVjdCBz Z190YWJsZSAqc2d0ID0gaHlwZXJfZGFtYnVmX2F0dGFjaC0+c2d0OworCisJCWlmIChzZ3QpIHsK KwkJCWlmIChoeXBlcl9kYW1idWZfYXR0YWNoLT5kaXIgIT0gRE1BX05PTkUpCisJCQkJZG1hX3Vu bWFwX3NnX2F0dHJzKGF0dGFjaC0+ZGV2LCBzZ3QtPnNnbCwKKwkJCQkJCSAgIHNndC0+bmVudHMs CisJCQkJCQkgICBoeXBlcl9kYW1idWZfYXR0YWNoLT5kaXIsCisJCQkJCQkgICBETUFfQVRUUl9T S0lQX0NQVV9TWU5DKTsKKwkJCXNnX2ZyZWVfdGFibGUoc2d0KTsKKwkJfQorCisJCWtmcmVlKHNn dCk7CisJCWtmcmVlKGh5cGVyX2RhbWJ1Zl9hdHRhY2gpOworCQlhdHRhY2gtPnByaXYgPSBOVUxM OworCX0KKwkvKiBNaWdodCBuZWVkIHRvIHVucGluIHRoZSBwYWdlcyBvZiB0aGUgYnVmZmVyIG5v dy4gKi8KK30KKworc3RhdGljIHN0cnVjdCBzZ190YWJsZSAqCitkbWFidWZfZXhwX29wc19tYXBf ZG1hX2J1ZihzdHJ1Y3QgZG1hX2J1Zl9hdHRhY2htZW50ICphdHRhY2gsCisJCQkgICBlbnVtIGRt YV9kYXRhX2RpcmVjdGlvbiBkaXIpCit7CisJc3RydWN0IGh5cGVyX2RhbWJ1Zl9hdHRhY2htZW50 ICpoeXBlcl9kYW1idWZfYXR0YWNoID0gYXR0YWNoLT5wcml2OworCXN0cnVjdCBoeXBlcl9kbWFi dWYgKmh5cGVyX2RtYWJ1ZiA9IGF0dGFjaC0+ZG1hYnVmLT5wcml2OworCXN0cnVjdCBzZ190YWJs ZSAqc2d0OworCisJcHJfZGVidWcoIk1hcHBpbmcgJWQgcGFnZXMgZm9yIGRldiAlcFxuIiwgaHlw ZXJfZG1hYnVmLT5ucl9wYWdlcywKKwkJIGF0dGFjaC0+ZGV2KTsKKworCWlmIChXQVJOX09OKGRp ciA9PSBETUFfTk9ORSB8fCAhaHlwZXJfZGFtYnVmX2F0dGFjaCkpCisJCXJldHVybiBFUlJfUFRS KC1FSU5WQUwpOworCisJLyogUmV0dXJuIHRoZSBjYWNoZWQgbWFwcGluZyB3aGVuIHBvc3NpYmxl LiAqLworCWlmIChoeXBlcl9kYW1idWZfYXR0YWNoLT5kaXIgPT0gZGlyKQorCQlyZXR1cm4gaHlw ZXJfZGFtYnVmX2F0dGFjaC0+c2d0OworCisJLyoKKwkgKiBUd28gbWFwcGluZ3Mgd2l0aCBkaWZm ZXJlbnQgZGlyZWN0aW9ucyBmb3IgdGhlIHNhbWUgYXR0YWNobWVudCBhcmUKKwkgKiBub3QgYWxs b3dlZC4KKwkgKi8KKwlpZiAoV0FSTl9PTihoeXBlcl9kYW1idWZfYXR0YWNoLT5kaXIgIT0gRE1B X05PTkUpKQorCQlyZXR1cm4gRVJSX1BUUigtRUJVU1kpOworCisJc2d0ID0gZG1hYnVmX3BhZ2Vz X3RvX3NndChoeXBlcl9kbWFidWYtPnBhZ2VzLCBoeXBlcl9kbWFidWYtPm5yX3BhZ2VzKTsKKwlp ZiAoIUlTX0VSUihzZ3QpKSB7CisJCWlmICghZG1hX21hcF9zZ19hdHRycyhhdHRhY2gtPmRldiwg c2d0LT5zZ2wsIHNndC0+bmVudHMsIGRpciwKKwkJCQkgICAgICBETUFfQVRUUl9TS0lQX0NQVV9T WU5DKSkgeworCQkJc2dfZnJlZV90YWJsZShzZ3QpOworCQkJa2ZyZWUoc2d0KTsKKwkJCXNndCA9 IEVSUl9QVFIoLUVOT01FTSk7CisJCX0gZWxzZSB7CisJCQloeXBlcl9kYW1idWZfYXR0YWNoLT5z Z3QgPSBzZ3Q7CisJCQloeXBlcl9kYW1idWZfYXR0YWNoLT5kaXIgPSBkaXI7CisJCX0KKwl9CisJ aWYgKElTX0VSUihzZ3QpCisJCXByX2VycigiRmFpbGVkIHRvIG1hcCBzZyB0YWJsZSBmb3IgZGV2 ICVwXG4iLCBhdHRhY2gtPmRldik7CisJcmV0dXJuIHNndDsKK30KKworc3RhdGljIHZvaWQgZG1h YnVmX2V4cF9vcHNfdW5tYXBfZG1hX2J1ZihzdHJ1Y3QgZG1hX2J1Zl9hdHRhY2htZW50ICphdHRh Y2gsCisJCQkJCSBzdHJ1Y3Qgc2dfdGFibGUgKnNndCwKKwkJCQkJIGVudW0gZG1hX2RhdGFfZGly ZWN0aW9uIGRpcikKK3sKKwkvKiBOb3QgaW1wbGVtZW50ZWQuIFRoZSB1bm1hcCBpcyBkb25lIGF0 IGRtYWJ1Zl9leHBfb3BzX2RldGFjaCgpLiAqLworfQorCitzdGF0aWMgdm9pZCBkbWFidWZfZXhw X3JlbGVhc2Uoc3RydWN0IGtyZWYgKmtyZWYpCit7CisJc3RydWN0IGh5cGVyX2RtYWJ1ZiAqaHlw ZXJfZG1hYnVmID0KKwkJY29udGFpbmVyX29mKGtyZWYsIHN0cnVjdCBoeXBlcl9kbWFidWYsCisJ CQkgICAgIHUuZXhwLnJlZmNvdW50KTsKKworCWRtYWJ1Zl9leHBfd2FpdF9vYmpfc2lnbmFsKGh5 cGVyX2RtYWJ1Zi0+cHJpdiwgaHlwZXJfZG1hYnVmKTsKKwlsaXN0X2RlbCgmaHlwZXJfZG1hYnVm LT5uZXh0KTsKKwlrZnJlZShoeXBlcl9kbWFidWYpOworfQorCitzdGF0aWMgdm9pZCBkbWFidWZf ZXhwX29wc19yZWxlYXNlKHN0cnVjdCBkbWFfYnVmICpkbWFfYnVmKQoreworCXN0cnVjdCBoeXBl cl9kbWFidWYgKmh5cGVyX2RtYWJ1ZiA9IGRtYV9idWYtPnByaXY7CisJc3RydWN0IGdudGRldl9w cml2ICpwcml2ID0gaHlwZXJfZG1hYnVmLT5wcml2OworCisJZ250ZGV2X3B1dF9tYXBfdW5saW5r KHByaXYsIGh5cGVyX2RtYWJ1Zi0+dS5leHAubWFwKTsKKwltdXRleF9sb2NrKCZwcml2LT5kbWFi dWZfbG9jayk7CisJa3JlZl9wdXQoJmh5cGVyX2RtYWJ1Zi0+dS5leHAucmVmY291bnQsIGRtYWJ1 Zl9leHBfcmVsZWFzZSk7CisJbXV0ZXhfdW5sb2NrKCZwcml2LT5kbWFidWZfbG9jayk7Cit9CisK K3N0YXRpYyB2b2lkICpkbWFidWZfZXhwX29wc19rbWFwX2F0b21pYyhzdHJ1Y3QgZG1hX2J1ZiAq ZG1hX2J1ZiwKKwkJCQkJdW5zaWduZWQgbG9uZyBwYWdlX251bSkKK3sKKwkvKiBOb3QgaW1wbGVt ZW50ZWQuICovCisJcmV0dXJuIE5VTEw7Cit9CisKK3N0YXRpYyB2b2lkICpkbWFidWZfZXhwX29w c19rbWFwKHN0cnVjdCBkbWFfYnVmICpkbWFfYnVmLAorCQkJCSB1bnNpZ25lZCBsb25nIHBhZ2Vf bnVtKQoreworCS8qIE5vdCBpbXBsZW1lbnRlZC4gKi8KKwlyZXR1cm4gTlVMTDsKK30KKworc3Rh dGljIGludCBkbWFidWZfZXhwX29wc19tbWFwKHN0cnVjdCBkbWFfYnVmICpkbWFfYnVmLAorCQkJ ICAgICAgIHN0cnVjdCB2bV9hcmVhX3N0cnVjdCAqdm1hKQoreworCS8qIE5vdCBpbXBsZW1lbnRl ZC4gKi8KKwlyZXR1cm4gMDsKK30KKworc3RhdGljIGNvbnN0IHN0cnVjdCBkbWFfYnVmX29wcyBk bWFidWZfZXhwX29wcyA9ICB7CisJLmF0dGFjaCA9IGRtYWJ1Zl9leHBfb3BzX2F0dGFjaCwKKwku ZGV0YWNoID0gZG1hYnVmX2V4cF9vcHNfZGV0YWNoLAorCS5tYXBfZG1hX2J1ZiA9IGRtYWJ1Zl9l eHBfb3BzX21hcF9kbWFfYnVmLAorCS51bm1hcF9kbWFfYnVmID0gZG1hYnVmX2V4cF9vcHNfdW5t YXBfZG1hX2J1ZiwKKwkucmVsZWFzZSA9IGRtYWJ1Zl9leHBfb3BzX3JlbGVhc2UsCisJLmttYXAg PSBkbWFidWZfZXhwX29wc19rbWFwLAorCS5rbWFwX2F0b21pYyA9IGRtYWJ1Zl9leHBfb3BzX2tt YXBfYXRvbWljLAorCS5tbWFwID0gZG1hYnVmX2V4cF9vcHNfbW1hcCwKK307CisKK3N0YXRpYyBp bnQgZG1hYnVmX2V4cG9ydChzdHJ1Y3QgZ250ZGV2X3ByaXYgKnByaXYsIHN0cnVjdCBncmFudF9t YXAgKm1hcCwKKwkJCSBpbnQgKmZkKQoreworCURFRklORV9ETUFfQlVGX0VYUE9SVF9JTkZPKGV4 cF9pbmZvKTsKKwlzdHJ1Y3QgaHlwZXJfZG1hYnVmICpoeXBlcl9kbWFidWY7CisJaW50IHJldCA9 IDA7CisKKwloeXBlcl9kbWFidWYgPSBremFsbG9jKHNpemVvZigqaHlwZXJfZG1hYnVmKSwgR0ZQ X0tFUk5FTCk7CisJaWYgKCFoeXBlcl9kbWFidWYpCisJCXJldHVybiAtRU5PTUVNOworCisJa3Jl Zl9pbml0KCZoeXBlcl9kbWFidWYtPnUuZXhwLnJlZmNvdW50KTsKKworCWh5cGVyX2RtYWJ1Zi0+ cHJpdiA9IHByaXY7CisJaHlwZXJfZG1hYnVmLT5ucl9wYWdlcyA9IG1hcC0+Y291bnQ7CisJaHlw ZXJfZG1hYnVmLT5wYWdlcyA9IG1hcC0+cGFnZXM7CisJaHlwZXJfZG1hYnVmLT51LmV4cC5tYXAg PSBtYXA7CisKKwlleHBfaW5mby5leHBfbmFtZSA9IEtCVUlMRF9NT0ROQU1FOworCWV4cF9pbmZv Lm9wcyA9ICZkbWFidWZfZXhwX29wczsKKwlleHBfaW5mby5zaXplID0gbWFwLT5jb3VudCA8PCBQ QUdFX1NISUZUOworCWV4cF9pbmZvLmZsYWdzID0gT19SRFdSOworCWV4cF9pbmZvLnByaXYgPSBo eXBlcl9kbWFidWY7CisKKwloeXBlcl9kbWFidWYtPmRtYWJ1ZiA9IGRtYV9idWZfZXhwb3J0KCZl eHBfaW5mbyk7CisJaWYgKElTX0VSUihoeXBlcl9kbWFidWYtPmRtYWJ1ZikpIHsKKwkJcmV0ID0g UFRSX0VSUihoeXBlcl9kbWFidWYtPmRtYWJ1Zik7CisJCWh5cGVyX2RtYWJ1Zi0+ZG1hYnVmID0g TlVMTDsKKwkJZ290byBmYWlsOworCX0KKworCXJldCA9IGRtYV9idWZfZmQoaHlwZXJfZG1hYnVm LT5kbWFidWYsIE9fQ0xPRVhFQyk7CisJaWYgKHJldCA8IDApCisJCWdvdG8gZmFpbDsKKworCWh5 cGVyX2RtYWJ1Zi0+ZmQgPSByZXQ7CisJKmZkID0gcmV0OworCisJcHJfZGVidWcoIkV4cG9ydGlu ZyBETUEgYnVmZmVyIHdpdGggZmQgJWRcbiIsIHJldCk7CisKKwltdXRleF9sb2NrKCZwcml2LT5k bWFidWZfbG9jayk7CisJbGlzdF9hZGQoJmh5cGVyX2RtYWJ1Zi0+bmV4dCwgJnByaXYtPmRtYWJ1 Zl9leHBfbGlzdCk7CisJbXV0ZXhfdW5sb2NrKCZwcml2LT5kbWFidWZfbG9jayk7CisJcmV0dXJu IDA7CisKK2ZhaWw6CisJaWYgKGh5cGVyX2RtYWJ1Zi0+ZG1hYnVmKQorCQlkbWFfYnVmX3B1dCho eXBlcl9kbWFidWYtPmRtYWJ1Zik7CisJa2ZyZWUoaHlwZXJfZG1hYnVmKTsKKwlyZXR1cm4gcmV0 OworfQorCitzdGF0aWMgc3RydWN0IGdyYW50X21hcCAqCitkbWFidWZfZXhwX2FsbG9jX2JhY2tp bmdfc3RvcmFnZShpbnQgZG1hYnVmX2ZsYWdzLCBpbnQgY291bnQpCit7CisJc3RydWN0IGdyYW50 X21hcCAqbWFwOworCisJaWYgKHVubGlrZWx5KGNvdW50IDw9IDApKQorCQlyZXR1cm4gRVJSX1BU UigtRUlOVkFMKTsKKworCWlmICgoZG1hYnVmX2ZsYWdzICYgR05UREVWX0RNQUJVRl9GTEFHX0RN QV9XQykgJiYKKwkgICAgKGRtYWJ1Zl9mbGFncyAmIEdOVERFVl9ETUFCVUZfRkxBR19ETUFfQ09I RVJFTlQpKSB7CisJCXByX2VycigiV3JvbmcgZG1hLWJ1ZiBmbGFnczogZWl0aGVyIFdDIG9yIGNv aGVyZW50LCBub3QgYm90aFxuIik7CisJCXJldHVybiBFUlJfUFRSKC1FSU5WQUwpOworCX0KKwor CW1hcCA9IGdudGRldl9hbGxvY19tYXAoY291bnQsIGRtYWJ1Zl9mbGFncyk7CisJaWYgKCFtYXAp CisJCXJldHVybiBFUlJfUFRSKC1FTk9NRU0pOworCisJaWYgKHVubGlrZWx5KGF0b21pY19hZGRf cmV0dXJuKGNvdW50LCAmcGFnZXNfbWFwcGVkKSA+IGxpbWl0KSkgeworCQlwcl9lcnIoImNhbid0 IG1hcDogb3ZlciBsaW1pdFxuIik7CisJCWdudGRldl9wdXRfbWFwKE5VTEwsIG1hcCk7CisJCXJl dHVybiBFUlJfUFRSKC1FTk9NRU0pOworCX0KKwlyZXR1cm4gbWFwOworfQorCitpbnQgZ250ZGV2 X2RtYWJ1Zl9leHBfZnJvbV9yZWZzKHN0cnVjdCBnbnRkZXZfcHJpdiAqcHJpdiwgaW50IGZsYWdz LAorCQkJCWludCBjb3VudCwgdTMyIGRvbWlkLCB1MzIgKnJlZnMsIHUzMiAqZmQpCit7CisJc3Ry dWN0IGdyYW50X21hcCAqbWFwOworCWludCBpLCByZXQ7CisKKwkqZmQgPSAtMTsKKworCWlmICh1 c2VfcHRlbW9kKSB7CisJCXByX2VycigiQ2Fubm90IHByb3ZpZGUgZG1hLWJ1ZjogdXNlX3B0ZW1v ZGUgJWRcbiIsCisJCSAgICAgICB1c2VfcHRlbW9kKTsKKwkJcmV0dXJuIC1FSU5WQUw7CisJfQor CisJbWFwID0gZG1hYnVmX2V4cF9hbGxvY19iYWNraW5nX3N0b3JhZ2UoZmxhZ3MsIGNvdW50KTsK KwlpZiAoSVNfRVJSKG1hcCkpCisJCXJldHVybiBQVFJfRVJSKG1hcCk7CisKKwlmb3IgKGkgPSAw OyBpIDwgY291bnQ7IGkrKykgeworCQltYXAtPmdyYW50c1tpXS5kb21pZCA9IGRvbWlkOworCQlt YXAtPmdyYW50c1tpXS5yZWYgPSByZWZzW2ldOworCX0KKworCW11dGV4X2xvY2soJnByaXYtPmxv Y2spOworCWdudGRldl9hZGRfbWFwKHByaXYsIG1hcCk7CisJbXV0ZXhfdW5sb2NrKCZwcml2LT5s b2NrKTsKKworCW1hcC0+ZmxhZ3MgfD0gR05UTUFQX2hvc3RfbWFwOworI2lmIGRlZmluZWQoQ09O RklHX1g4NikKKwltYXAtPmZsYWdzIHw9IEdOVE1BUF9kZXZpY2VfbWFwOworI2VuZGlmCisKKwly ZXQgPSBtYXBfZ3JhbnRfcGFnZXMobWFwKTsKKwlpZiAocmV0IDwgMCkKKwkJZ290byBvdXQ7CisK KwlyZXQgPSBkbWFidWZfZXhwb3J0KHByaXYsIG1hcCwgZmQpOworCWlmIChyZXQgPCAwKQorCQln b3RvIG91dDsKKworCXJldHVybiAwOworCitvdXQ6CisJZ250ZGV2X3B1dF9tYXBfdW5saW5rKHBy aXYsIG1hcCk7CisJcmV0dXJuIHJldDsKK30KK0VYUE9SVF9TWU1CT0woZ250ZGV2X2RtYWJ1Zl9l eHBfZnJvbV9yZWZzKTsKKworc3RhdGljIGxvbmcKK2dudGRldl9pb2N0bF9kbWFidWZfZXhwX2Zy b21fcmVmcyhzdHJ1Y3QgZ250ZGV2X3ByaXYgKnByaXYsCisJCQkJICBzdHJ1Y3QgaW9jdGxfZ250 ZGV2X2RtYWJ1Zl9leHBfZnJvbV9yZWZzIF9fdXNlciAqdSkKK3sKKwlzdHJ1Y3QgaW9jdGxfZ250 ZGV2X2RtYWJ1Zl9leHBfZnJvbV9yZWZzIG9wOworCXUzMiAqcmVmczsKKwlsb25nIHJldDsKKwor CWlmIChjb3B5X2Zyb21fdXNlcigmb3AsIHUsIHNpemVvZihvcCkpICE9IDApCisJCXJldHVybiAt RUZBVUxUOworCisJcmVmcyA9IGtjYWxsb2Mob3AuY291bnQsIHNpemVvZigqcmVmcyksIEdGUF9L RVJORUwpOworCWlmICghcmVmcykKKwkJcmV0dXJuIC1FTk9NRU07CisKKwlpZiAoY29weV9mcm9t X3VzZXIocmVmcywgdS0+cmVmcywgc2l6ZW9mKCpyZWZzKSAqIG9wLmNvdW50KSAhPSAwKSB7CisJ CXJldCA9IC1FRkFVTFQ7CisJCWdvdG8gb3V0OworCX0KKworCXJldCA9IGdudGRldl9kbWFidWZf ZXhwX2Zyb21fcmVmcyhwcml2LCBvcC5mbGFncywgb3AuY291bnQsCisJCQkJCSAgb3AuZG9taWQs IHJlZnMsICZvcC5mZCk7CisJaWYgKHJldCkKKwkJZ290byBvdXQ7CisKKwlpZiAoY29weV90b191 c2VyKHUsICZvcCwgc2l6ZW9mKG9wKSkgIT0gMCkKKwkJcmV0ID0gLUVGQVVMVDsKKworb3V0Ogor CWtmcmVlKHJlZnMpOworCXJldHVybiByZXQ7Cit9CisKK3N0YXRpYyBsb25nCitnbnRkZXZfaW9j dGxfZG1hYnVmX2V4cF93YWl0X3JlbGVhc2VkKHN0cnVjdCBnbnRkZXZfcHJpdiAqcHJpdiwKKwkJ CQkgICAgICBzdHJ1Y3QgaW9jdGxfZ250ZGV2X2RtYWJ1Zl9leHBfd2FpdF9yZWxlYXNlZCBfX3Vz ZXIgKnUpCit7CisJc3RydWN0IGlvY3RsX2dudGRldl9kbWFidWZfZXhwX3dhaXRfcmVsZWFzZWQg b3A7CisKKwlpZiAoY29weV9mcm9tX3VzZXIoJm9wLCB1LCBzaXplb2Yob3ApKSAhPSAwKQorCQly ZXR1cm4gLUVGQVVMVDsKKworCXJldHVybiBkbWFidWZfZXhwX3dhaXRfcmVsZWFzZWQocHJpdiwg b3AuZmQsIG9wLndhaXRfdG9fbXMpOworfQorCitpbnQgZ250ZGV2X2RtYWJ1Zl9leHBfd2FpdF9y ZWxlYXNlZChzdHJ1Y3QgZ250ZGV2X3ByaXYgKnByaXYsIHUzMiBmZCwKKwkJCQkgICAgaW50IHdh aXRfdG9fbXMpCit7CisJcmV0dXJuIGRtYWJ1Zl9leHBfd2FpdF9yZWxlYXNlZChwcml2LCBmZCwg d2FpdF90b19tcyk7Cit9CitFWFBPUlRfU1lNQk9MKGdudGRldl9kbWFidWZfZXhwX3dhaXRfcmVs ZWFzZWQpOworCisvKiAtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0gKi8KKy8qIERNQSBidWZmZXIgaW1wb3J0IHN1cHBvcnQu ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAqLworLyogLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t ICovCisKK3N0YXRpYyBpbnQKK2RtYWJ1Zl9pbXBfZ3JhbnRfZm9yZWlnbl9hY2Nlc3Moc3RydWN0 IHBhZ2UgKipwYWdlcywgdTMyICpyZWZzLAorCQkJCWludCBjb3VudCwgaW50IGRvbWlkKQorewor CWdyYW50X3JlZl90IHByaXZfZ3JlZl9oZWFkOworCWludCBpLCByZXQ7CisKKwlyZXQgPSBnbnR0 YWJfYWxsb2NfZ3JhbnRfcmVmZXJlbmNlcyhjb3VudCwgJnByaXZfZ3JlZl9oZWFkKTsKKwlpZiAo cmV0IDwgMCkgeworCQlwcl9lcnIoIkNhbm5vdCBhbGxvY2F0ZSBncmFudCByZWZlcmVuY2VzLCBy ZXQgJWRcbiIsIHJldCk7CisJCXJldHVybiByZXQ7CisJfQorCisJZm9yIChpID0gMDsgaSA8IGNv dW50OyBpKyspIHsKKwkJaW50IGN1cl9yZWY7CisKKwkJY3VyX3JlZiA9IGdudHRhYl9jbGFpbV9n cmFudF9yZWZlcmVuY2UoJnByaXZfZ3JlZl9oZWFkKTsKKwkJaWYgKGN1cl9yZWYgPCAwKSB7CisJ CQlyZXQgPSBjdXJfcmVmOworCQkJcHJfZXJyKCJDYW5ub3QgY2xhaW0gZ3JhbnQgcmVmZXJlbmNl LCByZXQgJWRcbiIsIHJldCk7CisJCQlnb3RvIG91dDsKKwkJfQorCisJCWdudHRhYl9ncmFudF9m b3JlaWduX2FjY2Vzc19yZWYoY3VyX3JlZiwgZG9taWQsCisJCQkJCQl4ZW5fcGFnZV90b19nZm4o cGFnZXNbaV0pLCAwKTsKKwkJcmVmc1tpXSA9IGN1cl9yZWY7CisJfQorCisJcmV0ID0gMDsKKwor b3V0OgorCWdudHRhYl9mcmVlX2dyYW50X3JlZmVyZW5jZXMocHJpdl9ncmVmX2hlYWQpOworCXJl dHVybiByZXQ7Cit9CisKK3N0YXRpYyB2b2lkIGRtYWJ1Zl9pbXBfZW5kX2ZvcmVpZ25fYWNjZXNz KHUzMiAqcmVmcywgaW50IGNvdW50KQoreworCWludCBpOworCisJZm9yIChpID0gMDsgaSA8IGNv dW50OyBpKyspCisJCWlmIChyZWZzW2ldICE9IEdSQU5UX0lOVkFMSURfUkVGKQorCQkJZ250dGFi X2VuZF9mb3JlaWduX2FjY2VzcyhyZWZzW2ldLCAwLCAwVUwpOworfQorCitzdGF0aWMgdm9pZCBk bWFidWZfaW1wX2ZyZWVfc3RvcmFnZShzdHJ1Y3QgaHlwZXJfZG1hYnVmICpoeXBlcl9kbWFidWYp Cit7CisJa2ZyZWUoaHlwZXJfZG1hYnVmLT5wYWdlcyk7CisJa2ZyZWUoaHlwZXJfZG1hYnVmLT51 LmltcC5yZWZzKTsKKwlrZnJlZShoeXBlcl9kbWFidWYpOworfQorCitzdGF0aWMgc3RydWN0IGh5 cGVyX2RtYWJ1ZiAqZG1hYnVmX2ltcF9hbGxvY19zdG9yYWdlKGludCBjb3VudCkKK3sKKwlzdHJ1 Y3QgaHlwZXJfZG1hYnVmICpoeXBlcl9kbWFidWY7CisJaW50IGk7CisKKwloeXBlcl9kbWFidWYg PSBremFsbG9jKHNpemVvZigqaHlwZXJfZG1hYnVmKSwgR0ZQX0tFUk5FTCk7CisJaWYgKCFoeXBl cl9kbWFidWYpCisJCWdvdG8gZmFpbDsKKworCWh5cGVyX2RtYWJ1Zi0+dS5pbXAucmVmcyA9IGtj YWxsb2MoY291bnQsCisJCQkJCSAgIHNpemVvZihoeXBlcl9kbWFidWYtPnUuaW1wLnJlZnNbMF0p LAorCQkJCQkgICBHRlBfS0VSTkVMKTsKKwlpZiAoIWh5cGVyX2RtYWJ1Zi0+dS5pbXAucmVmcykK KwkJZ290byBmYWlsOworCisJaHlwZXJfZG1hYnVmLT5wYWdlcyA9IGtjYWxsb2MoY291bnQsCisJ CQkJICAgICAgc2l6ZW9mKGh5cGVyX2RtYWJ1Zi0+cGFnZXNbMF0pLAorCQkJCSAgICAgIEdGUF9L RVJORUwpOworCWlmICghaHlwZXJfZG1hYnVmLT5wYWdlcykKKwkJZ290byBmYWlsOworCisJaHlw ZXJfZG1hYnVmLT5ucl9wYWdlcyA9IGNvdW50OworCisJZm9yIChpID0gMDsgaSA8IGNvdW50OyBp KyspCisJICAgICBoeXBlcl9kbWFidWYtPnUuaW1wLnJlZnNbaV0gPSBHUkFOVF9JTlZBTElEX1JF RjsKKworCXJldHVybiBoeXBlcl9kbWFidWY7CisKK2ZhaWw6CisJZG1hYnVmX2ltcF9mcmVlX3N0 b3JhZ2UoaHlwZXJfZG1hYnVmKTsKKwlyZXR1cm4gRVJSX1BUUigtRU5PTUVNKTsKK30KKworc3Rh dGljIHN0cnVjdCBoeXBlcl9kbWFidWYgKgorZG1hYnVmX2ltcG9ydChzdHJ1Y3QgZ250ZGV2X3By aXYgKnByaXYsIGludCBmZCwgaW50IGNvdW50LCBpbnQgZG9taWQpCit7CisJc3RydWN0IGh5cGVy X2RtYWJ1ZiAqaHlwZXJfZG1hYnVmLCAqcmV0OworCXN0cnVjdCBkbWFfYnVmICpkbWFfYnVmOwor CXN0cnVjdCBkbWFfYnVmX2F0dGFjaG1lbnQgKmF0dGFjaDsKKwlzdHJ1Y3Qgc2dfdGFibGUgKnNn dDsKKwlzdHJ1Y3Qgc2dfcGFnZV9pdGVyIHNnX2l0ZXI7CisJaW50IGk7CisKKwlkbWFfYnVmID0g ZG1hX2J1Zl9nZXQoZmQpOworCWlmIChJU19FUlIoZG1hX2J1ZikpCisJCXJldHVybiBFUlJfQ0FT VChkbWFfYnVmKTsKKworCWh5cGVyX2RtYWJ1ZiA9IGRtYWJ1Zl9pbXBfYWxsb2Nfc3RvcmFnZShj b3VudCk7CisJaWYgKElTX0VSUihoeXBlcl9kbWFidWYpKSB7CisJCXJldCA9IGh5cGVyX2RtYWJ1 ZjsKKwkJZ290byBmYWlsX3B1dDsKKwl9CisKKwloeXBlcl9kbWFidWYtPnByaXYgPSBwcml2Owor CWh5cGVyX2RtYWJ1Zi0+ZmQgPSBmZDsKKworCWF0dGFjaCA9IGRtYV9idWZfYXR0YWNoKGRtYV9i dWYsIHByaXYtPmRldik7CisJaWYgKElTX0VSUihhdHRhY2gpKSB7CisJCXJldCA9IEVSUl9DQVNU KGF0dGFjaCk7CisJCWdvdG8gZmFpbF9mcmVlX29iajsKKwl9CisKKwloeXBlcl9kbWFidWYtPnUu aW1wLmF0dGFjaCA9IGF0dGFjaDsKKworCXNndCA9IGRtYV9idWZfbWFwX2F0dGFjaG1lbnQoYXR0 YWNoLCBETUFfQklESVJFQ1RJT05BTCk7CisJaWYgKElTX0VSUihzZ3QpKSB7CisJCXJldCA9IEVS Ul9DQVNUKHNndCk7CisJCWdvdG8gZmFpbF9kZXRhY2g7CisJfQorCisJLyogQ2hlY2sgbnVtYmVy IG9mIHBhZ2VzIHRoYXQgaW1wb3J0ZWQgYnVmZmVyIGhhcy4gKi8KKwlpZiAoYXR0YWNoLT5kbWFi dWYtPnNpemUgIT0gaHlwZXJfZG1hYnVmLT5ucl9wYWdlcyA8PCBQQUdFX1NISUZUKSB7CisJCXJl dCA9IEVSUl9QVFIoLUVJTlZBTCk7CisJCXByX2VycigiRE1BIGJ1ZmZlciBoYXMgJXp1IHBhZ2Vz LCB1c2VyLXNwYWNlIGV4cGVjdHMgJWRcbiIsCisJCSAgICAgICBhdHRhY2gtPmRtYWJ1Zi0+c2l6 ZSwgaHlwZXJfZG1hYnVmLT5ucl9wYWdlcyk7CisJCWdvdG8gZmFpbF91bm1hcDsKKwl9CisKKwlo eXBlcl9kbWFidWYtPnUuaW1wLnNndCA9IHNndDsKKworCS8qIE5vdyBjb252ZXJ0IHNndCB0byBh cnJheSBvZiBwYWdlcyBhbmQgY2hlY2sgZm9yIHBhZ2UgdmFsaWRpdHkuICovCisJaSA9IDA7CisJ Zm9yX2VhY2hfc2dfcGFnZShzZ3QtPnNnbCwgJnNnX2l0ZXIsIHNndC0+bmVudHMsIDApIHsKKwkJ c3RydWN0IHBhZ2UgKnBhZ2UgPSBzZ19wYWdlX2l0ZXJfcGFnZSgmc2dfaXRlcik7CisJCS8qCisJ CSAqIENoZWNrIGlmIHBhZ2UgaXMgdmFsaWQ6IHRoaXMgY2FuIGhhcHBlbiBpZiB3ZSBhcmUgZ2l2 ZW4KKwkJICogYSBwYWdlIGZyb20gVlJBTSBvciBvdGhlciByZXNvdXJjZXMgd2hpY2ggYXJlIG5v dCBiYWNrZWQKKwkJICogYnkgYSBzdHJ1Y3QgcGFnZS4KKwkJICovCisJCWlmICghcGZuX3ZhbGlk KHBhZ2VfdG9fcGZuKHBhZ2UpKSkgeworCQkJcmV0ID0gRVJSX1BUUigtRUlOVkFMKTsKKwkJCWdv dG8gZmFpbF91bm1hcDsKKwkJfQorCisJCWh5cGVyX2RtYWJ1Zi0+cGFnZXNbaSsrXSA9IHBhZ2U7 CisJfQorCisJcmV0ID0gRVJSX1BUUihkbWFidWZfaW1wX2dyYW50X2ZvcmVpZ25fYWNjZXNzKGh5 cGVyX2RtYWJ1Zi0+cGFnZXMsCisJCQkJCQkgICAgICBoeXBlcl9kbWFidWYtPnUuaW1wLnJlZnMs CisJCQkJCQkgICAgICBjb3VudCwgZG9taWQpKTsKKwlpZiAoSVNfRVJSKHJldCkpCisJCWdvdG8g ZmFpbF9lbmRfYWNjZXNzOworCisJcHJfZGVidWcoIkltcG9ydGVkIERNQSBidWZmZXIgd2l0aCBm ZCAlZFxuIiwgZmQpOworCisJbXV0ZXhfbG9jaygmcHJpdi0+ZG1hYnVmX2xvY2spOworCWxpc3Rf YWRkKCZoeXBlcl9kbWFidWYtPm5leHQsICZwcml2LT5kbWFidWZfaW1wX2xpc3QpOworCW11dGV4 X3VubG9jaygmcHJpdi0+ZG1hYnVmX2xvY2spOworCisJcmV0dXJuIGh5cGVyX2RtYWJ1ZjsKKwor ZmFpbF9lbmRfYWNjZXNzOgorCWRtYWJ1Zl9pbXBfZW5kX2ZvcmVpZ25fYWNjZXNzKGh5cGVyX2Rt YWJ1Zi0+dS5pbXAucmVmcywgY291bnQpOworZmFpbF91bm1hcDoKKwlkbWFfYnVmX3VubWFwX2F0 dGFjaG1lbnQoYXR0YWNoLCBzZ3QsIERNQV9CSURJUkVDVElPTkFMKTsKK2ZhaWxfZGV0YWNoOgor CWRtYV9idWZfZGV0YWNoKGRtYV9idWYsIGF0dGFjaCk7CitmYWlsX2ZyZWVfb2JqOgorCWRtYWJ1 Zl9pbXBfZnJlZV9zdG9yYWdlKGh5cGVyX2RtYWJ1Zik7CitmYWlsX3B1dDoKKwlkbWFfYnVmX3B1 dChkbWFfYnVmKTsKKwlyZXR1cm4gcmV0OworfQorCisvKgorICogRmluZCB0aGUgaHlwZXIgZG1h LWJ1ZiBieSBpdHMgZmlsZSBkZXNjcmlwdG9yIGFuZCByZW1vdmUKKyAqIGl0IGZyb20gdGhlIGJ1 ZmZlcidzIGxpc3QuCisgKi8KK3N0YXRpYyBzdHJ1Y3QgaHlwZXJfZG1hYnVmICoKK2RtYWJ1Zl9p bXBfZmluZF91bmxpbmsoc3RydWN0IGdudGRldl9wcml2ICpwcml2LCBpbnQgZmQpCit7CisJc3Ry dWN0IGh5cGVyX2RtYWJ1ZiAqcSwgKmh5cGVyX2RtYWJ1ZiwgKnJldCA9IEVSUl9QVFIoLUVOT0VO VCk7CisKKwltdXRleF9sb2NrKCZwcml2LT5kbWFidWZfbG9jayk7CisJbGlzdF9mb3JfZWFjaF9l bnRyeV9zYWZlKGh5cGVyX2RtYWJ1ZiwgcSwgJnByaXYtPmRtYWJ1Zl9pbXBfbGlzdCwgbmV4dCkg eworCQlpZiAoaHlwZXJfZG1hYnVmLT5mZCA9PSBmZCkgeworCQkJcHJfZGVidWcoIkZvdW5kIGh5 cGVyX2RtYWJ1ZiBpbiB0aGUgaW1wb3J0IGxpc3RcbiIpOworCQkJcmV0ID0gaHlwZXJfZG1hYnVm OworCQkJbGlzdF9kZWwoJmh5cGVyX2RtYWJ1Zi0+bmV4dCk7CisJCQlicmVhazsKKwkJfQorCX0K KwltdXRleF91bmxvY2soJnByaXYtPmRtYWJ1Zl9sb2NrKTsKKwlyZXR1cm4gcmV0OworfQorCitp bnQgZ250ZGV2X2RtYWJ1Zl9pbXBfcmVsZWFzZShzdHJ1Y3QgZ250ZGV2X3ByaXYgKnByaXYsIHUz MiBmZCkKK3sKKwlzdHJ1Y3QgaHlwZXJfZG1hYnVmICpoeXBlcl9kbWFidWY7CisJc3RydWN0IGRt YV9idWZfYXR0YWNobWVudCAqYXR0YWNoOworCXN0cnVjdCBkbWFfYnVmICpkbWFfYnVmOworCisJ aHlwZXJfZG1hYnVmID0gZG1hYnVmX2ltcF9maW5kX3VubGluayhwcml2LCBmZCk7CisJaWYgKElT X0VSUihoeXBlcl9kbWFidWYpKQorCQlyZXR1cm4gUFRSX0VSUihoeXBlcl9kbWFidWYpOworCisJ cHJfZGVidWcoIlJlbGVhc2luZyBETUEgYnVmZmVyIHdpdGggZmQgJWRcbiIsIGZkKTsKKworCWF0 dGFjaCA9IGh5cGVyX2RtYWJ1Zi0+dS5pbXAuYXR0YWNoOworCisJaWYgKGh5cGVyX2RtYWJ1Zi0+ dS5pbXAuc2d0KQorCQlkbWFfYnVmX3VubWFwX2F0dGFjaG1lbnQoYXR0YWNoLCBoeXBlcl9kbWFi dWYtPnUuaW1wLnNndCwKKwkJCQkJIERNQV9CSURJUkVDVElPTkFMKTsKKwlkbWFfYnVmID0gYXR0 YWNoLT5kbWFidWY7CisJZG1hX2J1Zl9kZXRhY2goYXR0YWNoLT5kbWFidWYsIGF0dGFjaCk7CisJ ZG1hX2J1Zl9wdXQoZG1hX2J1Zik7CisKKwlkbWFidWZfaW1wX2VuZF9mb3JlaWduX2FjY2Vzcyho eXBlcl9kbWFidWYtPnUuaW1wLnJlZnMsCisJCQkJICAgICAgaHlwZXJfZG1hYnVmLT5ucl9wYWdl cyk7CisJZG1hYnVmX2ltcF9mcmVlX3N0b3JhZ2UoaHlwZXJfZG1hYnVmKTsKKwlyZXR1cm4gMDsK K30KK0VYUE9SVF9TWU1CT0woZ250ZGV2X2RtYWJ1Zl9pbXBfcmVsZWFzZSk7CisKK3N0YXRpYyBs b25nCitnbnRkZXZfaW9jdGxfZG1hYnVmX2ltcF9yZWxlYXNlKHN0cnVjdCBnbnRkZXZfcHJpdiAq cHJpdiwKKwkJCQlzdHJ1Y3QgaW9jdGxfZ250ZGV2X2RtYWJ1Zl9pbXBfcmVsZWFzZSBfX3VzZXIg KnUpCit7CisJc3RydWN0IGlvY3RsX2dudGRldl9kbWFidWZfaW1wX3JlbGVhc2Ugb3A7CisKKwlp ZiAoY29weV9mcm9tX3VzZXIoJm9wLCB1LCBzaXplb2Yob3ApKSAhPSAwKQorCQlyZXR1cm4gLUVG QVVMVDsKKworCXJldHVybiBnbnRkZXZfZG1hYnVmX2ltcF9yZWxlYXNlKHByaXYsIG9wLmZkKTsK K30KKworc3RhdGljIGxvbmcKK2dudGRldl9pb2N0bF9kbWFidWZfaW1wX3RvX3JlZnMoc3RydWN0 IGdudGRldl9wcml2ICpwcml2LAorCQkJCXN0cnVjdCBpb2N0bF9nbnRkZXZfZG1hYnVmX2ltcF90 b19yZWZzIF9fdXNlciAqdSkKK3sKKwlzdHJ1Y3QgaW9jdGxfZ250ZGV2X2RtYWJ1Zl9pbXBfdG9f cmVmcyBvcDsKKwlzdHJ1Y3QgaHlwZXJfZG1hYnVmICpoeXBlcl9kbWFidWY7CisJbG9uZyByZXQ7 CisKKwlpZiAoY29weV9mcm9tX3VzZXIoJm9wLCB1LCBzaXplb2Yob3ApKSAhPSAwKQorCQlyZXR1 cm4gLUVGQVVMVDsKKworCWh5cGVyX2RtYWJ1ZiA9IGRtYWJ1Zl9pbXBvcnQocHJpdiwgb3AuZmQs IG9wLmNvdW50LCBvcC5kb21pZCk7CisJaWYgKElTX0VSUihoeXBlcl9kbWFidWYpKQorCQlyZXR1 cm4gUFRSX0VSUihoeXBlcl9kbWFidWYpOworCisJaWYgKGNvcHlfdG9fdXNlcih1LT5yZWZzLCBo eXBlcl9kbWFidWYtPnUuaW1wLnJlZnMsCisJCQkgc2l6ZW9mKCp1LT5yZWZzKSAqIG9wLmNvdW50 KSAhPSAwKSB7CisJCXJldCA9IC1FRkFVTFQ7CisJCWdvdG8gb3V0X3JlbGVhc2U7CisJfQorCXJl dHVybiAwOworCitvdXRfcmVsZWFzZToKKwlnbnRkZXZfZG1hYnVmX2ltcF9yZWxlYXNlKHByaXYs IG9wLmZkKTsKKwlyZXR1cm4gcmV0OworfQorCit1MzIgKmdudGRldl9kbWFidWZfaW1wX3RvX3Jl ZnMoc3RydWN0IGdudGRldl9wcml2ICpwcml2LCBpbnQgZmQsCisJCQkgICAgICBpbnQgY291bnQs IGludCBkb21pZCwgdTMyICoqcmVmcykKK3sKKwlzdHJ1Y3QgaHlwZXJfZG1hYnVmICpoeXBlcl9k bWFidWY7CisKKwloeXBlcl9kbWFidWYgPSBkbWFidWZfaW1wb3J0KHByaXYsIGZkLCBjb3VudCwg ZG9taWQpOworCWlmIChJU19FUlIoaHlwZXJfZG1hYnVmKSkKKwkJcmV0dXJuIEVSUl9DQVNUKGh5 cGVyX2RtYWJ1Zik7CisKKwlyZXR1cm4gaHlwZXJfZG1hYnVmLT51LmltcC5yZWZzOworfQorRVhQ T1JUX1NZTUJPTChnbnRkZXZfZG1hYnVmX2ltcF90b19yZWZzKTsKKwogc3RhdGljIGxvbmcgZ250 ZGV2X2lvY3RsKHN0cnVjdCBmaWxlICpmbGlwLAogCQkJIHVuc2lnbmVkIGludCBjbWQsIHVuc2ln bmVkIGxvbmcgYXJnKQogewpAQCAtOTcxLDYgKzE4ODksMTggQEAgc3RhdGljIGxvbmcgZ250ZGV2 X2lvY3RsKHN0cnVjdCBmaWxlICpmbGlwLAogCWNhc2UgSU9DVExfR05UREVWX0dSQU5UX0NPUFk6 CiAJCXJldHVybiBnbnRkZXZfaW9jdGxfZ3JhbnRfY29weShwcml2LCBwdHIpOwogCisJY2FzZSBJ T0NUTF9HTlRERVZfRE1BQlVGX0VYUF9GUk9NX1JFRlM6CisJCXJldHVybiBnbnRkZXZfaW9jdGxf ZG1hYnVmX2V4cF9mcm9tX3JlZnMocHJpdiwgcHRyKTsKKworCWNhc2UgSU9DVExfR05UREVWX0RN QUJVRl9FWFBfV0FJVF9SRUxFQVNFRDoKKwkJcmV0dXJuIGdudGRldl9pb2N0bF9kbWFidWZfZXhw X3dhaXRfcmVsZWFzZWQocHJpdiwgcHRyKTsKKworCWNhc2UgSU9DVExfR05UREVWX0RNQUJVRl9J TVBfVE9fUkVGUzoKKwkJcmV0dXJuIGdudGRldl9pb2N0bF9kbWFidWZfaW1wX3RvX3JlZnMocHJp diwgcHRyKTsKKworCWNhc2UgSU9DVExfR05UREVWX0RNQUJVRl9JTVBfUkVMRUFTRToKKwkJcmV0 dXJuIGdudGRldl9pb2N0bF9kbWFidWZfaW1wX3JlbGVhc2UocHJpdiwgcHRyKTsKKwogCWRlZmF1 bHQ6CiAJCXByX2RlYnVnKCJwcml2ICVwLCB1bmtub3duIGNtZCAleFxuIiwgcHJpdiwgY21kKTsK IAkJcmV0dXJuIC1FTk9JT0NUTENNRDsKZGlmZiAtLWdpdCBhL2luY2x1ZGUvdWFwaS94ZW4vZ250 ZGV2LmggYi9pbmNsdWRlL3VhcGkveGVuL2dudGRldi5oCmluZGV4IGQwNjYxOTc3NjY3ZS4uN2Nm N2NhMzFkYjIxIDEwMDY0NAotLS0gYS9pbmNsdWRlL3VhcGkveGVuL2dudGRldi5oCisrKyBiL2lu Y2x1ZGUvdWFwaS94ZW4vZ250ZGV2LmgKQEAgLTE5OSw0ICsxOTksMTA1IEBAIHN0cnVjdCBpb2N0 bF9nbnRkZXZfZ3JhbnRfY29weSB7CiAvKiBTZW5kIGFuIGludGVycnVwdCBvbiB0aGUgaW5kaWNh dGVkIGV2ZW50IGNoYW5uZWwgKi8KICNkZWZpbmUgVU5NQVBfTk9USUZZX1NFTkRfRVZFTlQgMHgy CiAKKy8qCisgKiBDcmVhdGUgYSBkbWEtYnVmIFsxXSBmcm9tIGdyYW50IHJlZmVyZW5jZXMgQHJl ZnMgb2YgY291bnQgQGNvdW50IHByb3ZpZGVkCisgKiBieSB0aGUgZm9yZWlnbiBkb21haW4gQGRv bWlkIHdpdGggZmxhZ3MgQGZsYWdzLgorICoKKyAqIEJ5IGRlZmF1bHQgZG1hLWJ1ZiBpcyBiYWNr ZWQgYnkgc3lzdGVtIG1lbW9yeSBwYWdlcywgYnV0IGJ5IHByb3ZpZGluZworICogR05UREVWX0RN QUJVRl9GTEFHX0RNQSBmbGFnIGl0IGNhbiBhbHNvIGJlIGNyZWF0ZWQgYXMgYSBETUEgd3JpdGUt Y29tYmluZQorICogYnVmZmVyLCBlLmcuIGFsbG9jYXRlZCB3aXRoIGRtYV9hbGxvY193Yy4KKyAq CisgKiBSZXR1cm5zIDAgaWYgZG1hLWJ1ZiB3YXMgc3VjY2Vzc2Z1bGx5IGNyZWF0ZWQgYW5kIHRo ZSBjb3JyZXNwb25kaW5nCisgKiBkbWEtYnVmJ3MgZmlsZSBkZXNjcmlwdG9yIGlzIHJldHVybmVk IGluIEBmZC4KKyAqCisgKiBbMV0gaHR0cHM6Ly9lbGl4aXIuYm9vdGxpbi5jb20vbGludXgvbGF0 ZXN0L3NvdXJjZS9Eb2N1bWVudGF0aW9uL2RyaXZlci1hcGkvZG1hLWJ1Zi5yc3QKKyAqLworCisv KgorICogUmVxdWVzdCBkbWEtYnVmIGJhY2tpbmcgc3RvcmFnZSB0byBiZSBhbGxvY2F0ZWQgd2l0 aCBETUEgQVBJOgorICogdGhlIGJ1ZmZlciBpcyBiYWNrZWQgd2l0aCBtZW1vcnkgYWxsb2NhdGVk IHdpdGggZG1hX2FsbG9jX3djLgorICovCisjZGVmaW5lIEdOVERFVl9ETUFCVUZfRkxBR19ETUFf V0MJKDEgPDwgMSkKKworLyoKKyAqIFJlcXVlc3QgZG1hLWJ1ZiBiYWNraW5nIHN0b3JhZ2UgdG8g YmUgYWxsb2NhdGVkIHdpdGggRE1BIEFQSToKKyAqIHRoZSBidWZmZXIgaXMgYmFja2VkIHdpdGgg bWVtb3J5IGFsbG9jYXRlZCB3aXRoIGRtYV9hbGxvY19jb2hlcmVudC4KKyAqLworI2RlZmluZSBH TlRERVZfRE1BQlVGX0ZMQUdfRE1BX0NPSEVSRU5UCSgxIDw8IDIpCisKKyNkZWZpbmUgSU9DVExf R05UREVWX0RNQUJVRl9FWFBfRlJPTV9SRUZTIFwKKwlfSU9DKF9JT0NfTk9ORSwgJ0cnLCA5LCBc CisJICAgICBzaXplb2Yoc3RydWN0IGlvY3RsX2dudGRldl9kbWFidWZfZXhwX2Zyb21fcmVmcykp CitzdHJ1Y3QgaW9jdGxfZ250ZGV2X2RtYWJ1Zl9leHBfZnJvbV9yZWZzIHsKKwkvKiBJTiBwYXJh bWV0ZXJzLiAqLworCS8qIFNwZWNpZmljIG9wdGlvbnMgZm9yIHRoaXMgZG1hLWJ1Zjogc2VlIEdO VERFVl9ETUFCVUZfRkxBR19YWFguICovCisJX191MzIgZmxhZ3M7CisJLyogTnVtYmVyIG9mIGdy YW50IHJlZmVyZW5jZXMgaW4gQHJlZnMgYXJyYXkuICovCisJX191MzIgY291bnQ7CisJLyogT1VU IHBhcmFtZXRlcnMuICovCisJLyogRmlsZSBkZXNjcmlwdG9yIG9mIHRoZSBkbWEtYnVmLiAqLwor CV9fdTMyIGZkOworCS8qIFRoZSBkb21haW4gSUQgb2YgdGhlIGdyYW50IHJlZmVyZW5jZXMgdG8g YmUgbWFwcGVkLiAqLworCV9fdTMyIGRvbWlkOworCS8qIFZhcmlhYmxlIElOIHBhcmFtZXRlci4g Ki8KKwkvKiBBcnJheSBvZiBncmFudCByZWZlcmVuY2VzIG9mIHNpemUgQGNvdW50LiAqLworCV9f dTMyIHJlZnNbMV07Cit9OworCisvKgorICogVGhpcyB3aWxsIGJsb2NrIHVudGlsIHRoZSBkbWEt YnVmIHdpdGggdGhlIGZpbGUgZGVzY3JpcHRvciBAZmQgaXMKKyAqIHJlbGVhc2VkLiBUaGlzIGlz IG9ubHkgdmFsaWQgZm9yIGJ1ZmZlcnMgY3JlYXRlZCB3aXRoCisgKiBJT0NUTF9HTlRERVZfRE1B QlVGX0VYUF9GUk9NX1JFRlMuCisgKgorICogSWYgd2l0aGluZyBAd2FpdF90b19tcyBtaWxsaXNl Y29uZHMgdGhlIGJ1ZmZlciBpcyBub3QgcmVsZWFzZWQKKyAqIHRoZW4gLUVUSU1FRE9VVCBlcnJv ciBpcyByZXR1cm5lZC4KKyAqIElmIHRoZSBidWZmZXIgd2l0aCBmaWxlIGRlc2NyaXB0b3IgQGZk IGRvZXMgbm90IGV4aXN0IG9yIGhhcyBhbHJlYWR5CisgKiBiZWVuIHJlbGVhc2VkLCB0aGVuIC1F Tk9FTlQgaXMgcmV0dXJuZWQuIEZvciB2YWxpZCBmaWxlIGRlc2NyaXB0b3JzCisgKiB0aGlzIG11 c3Qgbm90IGJlIHRyZWF0ZWQgYXMgZXJyb3IuCisgKi8KKyNkZWZpbmUgSU9DVExfR05UREVWX0RN QUJVRl9FWFBfV0FJVF9SRUxFQVNFRCBcCisJX0lPQyhfSU9DX05PTkUsICdHJywgMTAsIFwKKwkg ICAgIHNpemVvZihzdHJ1Y3QgaW9jdGxfZ250ZGV2X2RtYWJ1Zl9leHBfd2FpdF9yZWxlYXNlZCkp CitzdHJ1Y3QgaW9jdGxfZ250ZGV2X2RtYWJ1Zl9leHBfd2FpdF9yZWxlYXNlZCB7CisJLyogSU4g cGFyYW1ldGVycyAqLworCV9fdTMyIGZkOworCV9fdTMyIHdhaXRfdG9fbXM7Cit9OworCisvKgor ICogSW1wb3J0IGEgZG1hLWJ1ZiB3aXRoIGZpbGUgZGVzY3JpcHRvciBAZmQgYW5kIGV4cG9ydCBn cmFudGVkIHJlZmVyZW5jZXMKKyAqIHRvIHRoZSBwYWdlcyBvZiB0aGF0IGRtYS1idWYgaW50byBh cnJheSBAcmVmcyBvZiBzaXplIEBjb3VudC4KKyAqLworI2RlZmluZSBJT0NUTF9HTlRERVZfRE1B QlVGX0lNUF9UT19SRUZTIFwKKwlfSU9DKF9JT0NfTk9ORSwgJ0cnLCAxMSwgXAorCSAgICAgc2l6 ZW9mKHN0cnVjdCBpb2N0bF9nbnRkZXZfZG1hYnVmX2ltcF90b19yZWZzKSkKK3N0cnVjdCBpb2N0 bF9nbnRkZXZfZG1hYnVmX2ltcF90b19yZWZzIHsKKwkvKiBJTiBwYXJhbWV0ZXJzLiAqLworCS8q IEZpbGUgZGVzY3JpcHRvciBvZiB0aGUgZG1hLWJ1Zi4gKi8KKwlfX3UzMiBmZDsKKwkvKiBOdW1i ZXIgb2YgZ3JhbnQgcmVmZXJlbmNlcyBpbiBAcmVmcyBhcnJheS4gKi8KKwlfX3UzMiBjb3VudDsK KwkvKiBUaGUgZG9tYWluIElEIGZvciB3aGljaCByZWZlcmVuY2VzIHRvIGJlIGdyYW50ZWQuICov CisJX191MzIgZG9taWQ7CisJLyogUmVzZXJ2ZWQgLSBtdXN0IGJlIHplcm8uICovCisJX191MzIg cmVzZXJ2ZWQ7CisJLyogT1VUIHBhcmFtZXRlcnMuICovCisJLyogQXJyYXkgb2YgZ3JhbnQgcmVm ZXJlbmNlcyBvZiBzaXplIEBjb3VudC4gKi8KKwlfX3UzMiByZWZzWzFdOworfTsKKworLyoKKyAq IFRoaXMgd2lsbCBjbG9zZSBhbGwgcmVmZXJlbmNlcyB0byBhbiBpbXBvcnRlZCBidWZmZXIsIHNv IGl0IGNhbiBiZQorICogcmVsZWFzZWQgYnkgdGhlIG93bmVyLiBUaGlzIGlzIG9ubHkgdmFsaWQg Zm9yIGJ1ZmZlcnMgY3JlYXRlZCB3aXRoCisgKiBJT0NUTF9HTlRERVZfRE1BQlVGX0lNUF9UT19S RUZTLgorICovCisjZGVmaW5lIElPQ1RMX0dOVERFVl9ETUFCVUZfSU1QX1JFTEVBU0UgXAorCV9J T0MoX0lPQ19OT05FLCAnRycsIDEyLCBcCisJICAgICBzaXplb2Yoc3RydWN0IGlvY3RsX2dudGRl dl9kbWFidWZfaW1wX3JlbGVhc2UpKQorc3RydWN0IGlvY3RsX2dudGRldl9kbWFidWZfaW1wX3Jl bGVhc2UgeworCS8qIElOIHBhcmFtZXRlcnMgKi8KKwlfX3UzMiBmZDsKKwlfX3UzMiByZXNlcnZl ZDsKK307CisKICNlbmRpZiAvKiBfX0xJTlVYX1BVQkxJQ19HTlRERVZfSF9fICovCmRpZmYgLS1n aXQgYS9pbmNsdWRlL3hlbi9nbnRkZXZfZXhwLmggYi9pbmNsdWRlL3hlbi9nbnRkZXZfZXhwLmgK bmV3IGZpbGUgbW9kZSAxMDA2NDQKaW5kZXggMDAwMDAwMDAwMDAwLi5hYWY0NWJkYTMwYWMKLS0t IC9kZXYvbnVsbAorKysgYi9pbmNsdWRlL3hlbi9nbnRkZXZfZXhwLmgKQEAgLTAsMCArMSwyMyBA QAorLyoqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioq KioqKioqKioqKioqKioqKioqKioqKioqKgorICogWGVuIGdyYW50IGRldmljZSBleHBvcnRlZCBm dW5jdGlvbmFsaXR5CisgKi8KKworI2lmbmRlZiBfWEVOX0dOVERFVl9FWFBfSAorI2RlZmluZSBf WEVOX0dOVERFVl9FWFBfSAorCitzdHJ1Y3QgZ250ZGV2X3ByaXYgKmdudGRldl9hbGxvY19jb250 ZXh0KHN0cnVjdCBkZXZpY2UgKmRldik7CisKK3ZvaWQgZ250ZGV2X2ZyZWVfY29udGV4dChzdHJ1 Y3QgZ250ZGV2X3ByaXYgKnByaXYpOworCitpbnQgZ250ZGV2X2RtYWJ1Zl9leHBfZnJvbV9yZWZz KHN0cnVjdCBnbnRkZXZfcHJpdiAqcHJpdiwgaW50IGZsYWdzLAorCQkJCWludCBjb3VudCwgdTMy IGRvbWlkLCB1MzIgKnJlZnMsIHUzMiAqZmQpOworCitpbnQgZ250ZGV2X2RtYWJ1Zl9leHBfd2Fp dF9yZWxlYXNlZChzdHJ1Y3QgZ250ZGV2X3ByaXYgKnByaXYsIHUzMiBmZCwKKwkJCQkgICAgaW50 IHdhaXRfdG9fbXMpOworCitpbnQgZ250ZGV2X2RtYWJ1Zl9pbXBfcmVsZWFzZShzdHJ1Y3QgZ250 ZGV2X3ByaXYgKnByaXYsIHUzMiBmZCk7CisKK3UzMiAqZ250ZGV2X2RtYWJ1Zl9pbXBfdG9fcmVm cyhzdHJ1Y3QgZ250ZGV2X3ByaXYgKnByaXYsIGludCBmZCwKKwkJCSAgICAgIGludCBjb3VudCwg aW50IGRvbWlkLCB1MzIgKipyZWZzKTsKKworI2VuZGlmCi0tIAoyLjE3LjAKCl9fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCmRyaS1kZXZlbCBtYWlsaW5nIGxp c3QKZHJpLWRldmVsQGxpc3RzLmZyZWVkZXNrdG9wLm9yZwpodHRwczovL2xpc3RzLmZyZWVkZXNr dG9wLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2RyaS1kZXZlbAo= From mboxrd@z Thu Jan 1 00:00:00 1970 Return-path: Received: from mail-lf0-f67.google.com ([209.85.215.67]:45674 "EHLO mail-lf0-f67.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752391AbeEQI0T (ORCPT ); Thu, 17 May 2018 04:26:19 -0400 From: Oleksandr Andrushchenko To: xen-devel@lists.xenproject.org, linux-kernel@vger.kernel.org, dri-devel@lists.freedesktop.org, linux-media@vger.kernel.org, jgross@suse.com, boris.ostrovsky@oracle.com, konrad.wilk@oracle.com Cc: daniel.vetter@intel.com, andr2000@gmail.com, dongwon.kim@intel.com, matthew.d.roper@intel.com, Oleksandr Andrushchenko Subject: [Xen-devel][RFC 3/3] xen/gntdev: Add support for Linux dma buffers Date: Thu, 17 May 2018 11:26:04 +0300 Message-Id: <20180517082604.14828-4-andr2000@gmail.com> In-Reply-To: <20180517082604.14828-1-andr2000@gmail.com> References: <20180517082604.14828-1-andr2000@gmail.com> Sender: linux-media-owner@vger.kernel.org List-ID: From: Oleksandr Andrushchenko Signed-off-by: Oleksandr Andrushchenko --- drivers/xen/gntdev.c | 954 +++++++++++++++++++++++++++++++++++++- include/uapi/xen/gntdev.h | 101 ++++ include/xen/gntdev_exp.h | 23 + 3 files changed, 1066 insertions(+), 12 deletions(-) create mode 100644 include/xen/gntdev_exp.h diff --git a/drivers/xen/gntdev.c b/drivers/xen/gntdev.c index 9510f228efe9..0ee88e193362 100644 --- a/drivers/xen/gntdev.c +++ b/drivers/xen/gntdev.c @@ -4,6 +4,8 @@ * Device for accessing (in user-space) pages that have been granted by other * domains. * + * DMA buffer implementation is based on drivers/gpu/drm/drm_prime.c. + * * Copyright (c) 2006-2007, D G Murray. * (c) 2009 Gerd Hoffmann * @@ -37,6 +39,9 @@ #include #include +#include +#include + #include #include #include @@ -61,16 +66,39 @@ static atomic_t pages_mapped = ATOMIC_INIT(0); static int use_ptemod; #define populate_freeable_maps use_ptemod +#ifndef GRANT_INVALID_REF +/* + * Note on usage of grant reference 0 as invalid grant reference: + * grant reference 0 is valid, but never exposed to a driver, + * because of the fact it is already in use/reserved by the PV console. + */ +#define GRANT_INVALID_REF 0 +#endif + struct gntdev_priv { /* maps with visible offsets in the file descriptor */ struct list_head maps; /* maps that are not visible; will be freed on munmap. * Only populated if populate_freeable_maps == 1 */ struct list_head freeable_maps; + /* List of dma-bufs. */ + struct list_head dma_bufs; /* lock protects maps and freeable_maps */ struct mutex lock; struct mm_struct *mm; struct mmu_notifier mn; + + /* Private data of the hyper DMA buffers. */ + + struct device *dev; + /* List of exported DMA buffers. */ + struct list_head dmabuf_exp_list; + /* List of wait objects. */ + struct list_head dmabuf_exp_wait_list; + /* List of imported DMA buffers. */ + struct list_head dmabuf_imp_list; + /* This is the lock which protects dma_buf_xxx lists. */ + struct mutex dmabuf_lock; }; struct unmap_notify { @@ -95,10 +123,65 @@ struct grant_map { struct gnttab_unmap_grant_ref *kunmap_ops; struct page **pages; unsigned long pages_vm_start; + + /* + * All the fields starting with dmabuf_ are only valid if this + * mapping is used for exporting a DMA buffer. + * If dmabuf_vaddr is not NULL then this mapping is backed by DMA + * capable memory. + */ + + /* Flags used to create this DMA buffer: GNTDEV_DMABUF_FLAG_XXX. */ + bool dmabuf_flags; + /* Virtual/CPU address of the DMA buffer. */ + void *dmabuf_vaddr; + /* Bus address of the DMA buffer. */ + dma_addr_t dmabuf_bus_addr; +}; + +struct hyper_dmabuf { + struct gntdev_priv *priv; + struct dma_buf *dmabuf; + struct list_head next; + int fd; + + union { + struct { + /* Exported buffers are reference counted. */ + struct kref refcount; + struct grant_map *map; + } exp; + struct { + /* Granted references of the imported buffer. */ + grant_ref_t *refs; + /* Scatter-gather table of the imported buffer. */ + struct sg_table *sgt; + /* dma-buf attachment of the imported buffer. */ + struct dma_buf_attachment *attach; + } imp; + } u; + + /* Number of pages this buffer has. */ + int nr_pages; + /* Pages of this buffer. */ + struct page **pages; +}; + +struct hyper_dmabuf_wait_obj { + struct list_head next; + struct hyper_dmabuf *hyper_dmabuf; + struct completion completion; +}; + +struct hyper_dambuf_attachment { + struct sg_table *sgt; + enum dma_data_direction dir; }; static int unmap_grant_pages(struct grant_map *map, int offset, int pages); +static struct miscdevice gntdev_miscdev; + /* ------------------------------------------------------------------ */ static void gntdev_print_maps(struct gntdev_priv *priv, @@ -120,8 +203,17 @@ static void gntdev_free_map(struct grant_map *map) if (map == NULL) return; - if (map->pages) + if (map->dmabuf_vaddr) { + bool coherent = map->dmabuf_flags & + GNTDEV_DMABUF_FLAG_DMA_COHERENT; + + gnttab_dma_free_pages(gntdev_miscdev.this_device, + coherent, map->count, map->pages, + map->dmabuf_vaddr, map->dmabuf_bus_addr); + } else if (map->pages) { gnttab_free_pages(map->count, map->pages); + } + kfree(map->pages); kfree(map->grants); kfree(map->map_ops); @@ -131,7 +223,7 @@ static void gntdev_free_map(struct grant_map *map) kfree(map); } -static struct grant_map *gntdev_alloc_map(struct gntdev_priv *priv, int count) +static struct grant_map *gntdev_alloc_map(int count, int dmabuf_flags) { struct grant_map *add; int i; @@ -154,8 +246,26 @@ static struct grant_map *gntdev_alloc_map(struct gntdev_priv *priv, int count) NULL == add->pages) goto err; - if (gnttab_alloc_pages(count, add->pages)) - goto err; + add->dmabuf_flags = dmabuf_flags; + + /* + * Check if this mapping is requested to be backed + * by a DMA buffer. + */ + if (dmabuf_flags & (GNTDEV_DMABUF_FLAG_DMA_WC | + GNTDEV_DMABUF_FLAG_DMA_COHERENT)) { + bool coherent = dmabuf_flags & GNTDEV_DMABUF_FLAG_DMA_COHERENT; + + if (gnttab_dma_alloc_pages(gntdev_miscdev.this_device, + coherent, + count, add->pages, + &add->dmabuf_vaddr, + &add->dmabuf_bus_addr)) + goto err; + } else { + if (gnttab_alloc_pages(count, add->pages)) + goto err; + } for (i = 0; i < count; i++) { add->map_ops[i].handle = -1; @@ -233,6 +343,15 @@ static void gntdev_put_map(struct gntdev_priv *priv, struct grant_map *map) gntdev_free_map(map); } +static void gntdev_put_map_unlink(struct gntdev_priv *priv, + struct grant_map *map) +{ + mutex_lock(&priv->lock); + list_del(&map->next); + gntdev_put_map(NULL /* already removed */, map); + mutex_unlock(&priv->lock); +} + /* ------------------------------------------------------------------ */ static int find_grant_ptes(pte_t *pte, pgtable_t token, @@ -324,6 +443,12 @@ static int map_grant_pages(struct grant_map *map) map->unmap_ops[i].handle = map->map_ops[i].handle; if (use_ptemod) map->kunmap_ops[i].handle = map->kmap_ops[i].handle; + else if (map->dmabuf_vaddr) { + unsigned long mfn; + + mfn = __pfn_to_mfn(page_to_pfn(map->pages[i])); + map->unmap_ops[i].dev_bus_addr = __pfn_to_phys(mfn); + } } return err; } @@ -527,19 +652,48 @@ static const struct mmu_notifier_ops gntdev_mmu_ops = { /* ------------------------------------------------------------------ */ -static int gntdev_open(struct inode *inode, struct file *flip) +struct gntdev_priv *gntdev_alloc_context(struct device *dev) { struct gntdev_priv *priv; - int ret = 0; priv = kzalloc(sizeof(*priv), GFP_KERNEL); if (!priv) - return -ENOMEM; + return ERR_PTR(-ENOMEM); INIT_LIST_HEAD(&priv->maps); INIT_LIST_HEAD(&priv->freeable_maps); mutex_init(&priv->lock); + priv->dev = dev; + mutex_init(&priv->dmabuf_lock); + INIT_LIST_HEAD(&priv->dmabuf_exp_list); + INIT_LIST_HEAD(&priv->dmabuf_exp_wait_list); + INIT_LIST_HEAD(&priv->dmabuf_imp_list); + + /* + * The device is not spawn from a device tree, so arch_setup_dma_ops + * is not called, thus leaving the device with dummy DMA ops. + * This makes the device return error on PRIME buffer import, which + * is not correct: to fix this call of_dma_configure() with a NULL + * node to set default DMA ops. + */ + of_dma_configure(dev, NULL); + + pr_debug("priv %p\n", priv); + + return priv; +} +EXPORT_SYMBOL(gntdev_alloc_context); + +static int gntdev_open(struct inode *inode, struct file *flip) +{ + struct gntdev_priv *priv; + int ret = 0; + + priv = gntdev_alloc_context(gntdev_miscdev.this_device); + if (IS_ERR(priv)) + return PTR_ERR(priv); + if (use_ptemod) { priv->mm = get_task_mm(current); if (!priv->mm) { @@ -557,14 +711,12 @@ static int gntdev_open(struct inode *inode, struct file *flip) } flip->private_data = priv; - pr_debug("priv %p\n", priv); return 0; } -static int gntdev_release(struct inode *inode, struct file *flip) +void gntdev_free_context(struct gntdev_priv *priv) { - struct gntdev_priv *priv = flip->private_data; struct grant_map *map; pr_debug("priv %p\n", priv); @@ -576,11 +728,28 @@ static int gntdev_release(struct inode *inode, struct file *flip) gntdev_put_map(NULL /* already removed */, map); } WARN_ON(!list_empty(&priv->freeable_maps)); + mutex_unlock(&priv->lock); + WARN(!list_empty(&priv->dmabuf_exp_list), + "Removing with non-empty exported DMA buffer list!\n"); + WARN(!list_empty(&priv->dmabuf_exp_wait_list), + "Removing with pending wait objects!\n"); + WARN(!list_empty(&priv->dmabuf_imp_list), + "Removing with non-empty imported DMA buffer list!\n"); + + kfree(priv); +} +EXPORT_SYMBOL(gntdev_free_context); + +static int gntdev_release(struct inode *inode, struct file *flip) +{ + struct gntdev_priv *priv = flip->private_data; + if (use_ptemod) mmu_notifier_unregister(&priv->mn, priv->mm); - kfree(priv); + + gntdev_free_context(priv); return 0; } @@ -598,7 +767,7 @@ static long gntdev_ioctl_map_grant_ref(struct gntdev_priv *priv, return -EINVAL; err = -ENOMEM; - map = gntdev_alloc_map(priv, op.count); + map = gntdev_alloc_map(op.count, 0 /* this is not a dma-buf */); if (!map) return err; @@ -949,6 +1118,755 @@ static long gntdev_ioctl_grant_copy(struct gntdev_priv *priv, void __user *u) return ret; } +/* ------------------------------------------------------------------ */ +/* DMA buffer support. */ +/* ------------------------------------------------------------------ */ + +/* ------------------------------------------------------------------ */ +/* Implementation of wait for exported DMA buffer released. */ +/* ------------------------------------------------------------------ */ + +static void dmabuf_exp_release(struct kref *kref); + +static struct hyper_dmabuf_wait_obj * +dmabuf_exp_wait_obj_new(struct gntdev_priv *priv, + struct hyper_dmabuf *hyper_dmabuf) +{ + struct hyper_dmabuf_wait_obj *obj; + + obj = kzalloc(sizeof(*obj), GFP_KERNEL); + if (!obj) + return ERR_PTR(-ENOMEM); + + init_completion(&obj->completion); + obj->hyper_dmabuf = hyper_dmabuf; + + mutex_lock(&priv->dmabuf_lock); + list_add(&obj->next, &priv->dmabuf_exp_wait_list); + /* Put our reference and wait for hyper_dmabuf's release to fire. */ + kref_put(&hyper_dmabuf->u.exp.refcount, dmabuf_exp_release); + mutex_unlock(&priv->dmabuf_lock); + return obj; +} + +static void dmabuf_exp_wait_obj_free(struct gntdev_priv *priv, + struct hyper_dmabuf_wait_obj *obj) +{ + struct hyper_dmabuf_wait_obj *cur_obj, *q; + + mutex_lock(&priv->dmabuf_lock); + list_for_each_entry_safe(cur_obj, q, &priv->dmabuf_exp_wait_list, next) + if (cur_obj == obj) { + list_del(&obj->next); + kfree(obj); + break; + } + mutex_unlock(&priv->dmabuf_lock); +} + +static int dmabuf_exp_wait_obj_wait(struct hyper_dmabuf_wait_obj *obj, + u32 wait_to_ms) +{ + if (wait_for_completion_timeout(&obj->completion, + msecs_to_jiffies(wait_to_ms)) <= 0) + return -ETIMEDOUT; + + return 0; +} + +static void dmabuf_exp_wait_obj_signal(struct gntdev_priv *priv, + struct hyper_dmabuf *hyper_dmabuf) +{ + struct hyper_dmabuf_wait_obj *obj, *q; + + list_for_each_entry_safe(obj, q, &priv->dmabuf_exp_wait_list, next) + if (obj->hyper_dmabuf == hyper_dmabuf) { + pr_debug("Found hyper_dmabuf in the wait list, wake\n"); + complete_all(&obj->completion); + } +} + +static struct hyper_dmabuf * +dmabuf_exp_wait_obj_get_by_fd(struct gntdev_priv *priv, int fd) +{ + struct hyper_dmabuf *q, *hyper_dmabuf, *ret = ERR_PTR(-ENOENT); + + mutex_lock(&priv->dmabuf_lock); + list_for_each_entry_safe(hyper_dmabuf, q, &priv->dmabuf_exp_list, next) + if (hyper_dmabuf->fd == fd) { + pr_debug("Found hyper_dmabuf in the wait list\n"); + kref_get(&hyper_dmabuf->u.exp.refcount); + ret = hyper_dmabuf; + break; + } + mutex_unlock(&priv->dmabuf_lock); + return ret; +} + +static int dmabuf_exp_wait_released(struct gntdev_priv *priv, int fd, + int wait_to_ms) +{ + struct hyper_dmabuf *hyper_dmabuf; + struct hyper_dmabuf_wait_obj *obj; + int ret; + + pr_debug("Will wait for dma-buf with fd %d\n", fd); + /* + * Try to find the DMA buffer: if not found means that + * either the buffer has already been released or file descriptor + * provided is wrong. + */ + hyper_dmabuf = dmabuf_exp_wait_obj_get_by_fd(priv, fd); + if (IS_ERR(hyper_dmabuf)) + return PTR_ERR(hyper_dmabuf); + + /* + * hyper_dmabuf still exists and is reference count locked by us now, + * so prepare to wait: allocate wait object and add it to the wait list, + * so we can find it on release. + */ + obj = dmabuf_exp_wait_obj_new(priv, hyper_dmabuf); + if (IS_ERR(obj)) { + pr_err("Failed to setup wait object, ret %ld\n", PTR_ERR(obj)); + return PTR_ERR(obj); + } + + ret = dmabuf_exp_wait_obj_wait(obj, wait_to_ms); + dmabuf_exp_wait_obj_free(priv, obj); + return ret; +} + +/* ------------------------------------------------------------------ */ +/* DMA buffer export support. */ +/* ------------------------------------------------------------------ */ + +static struct sg_table * +dmabuf_pages_to_sgt(struct page **pages, unsigned int nr_pages) +{ + struct sg_table *sgt; + int ret; + + sgt = kmalloc(sizeof(struct sg_table), GFP_KERNEL); + if (!sgt) { + ret = -ENOMEM; + goto out; + } + + ret = sg_alloc_table_from_pages(sgt, pages, nr_pages, 0, + nr_pages << PAGE_SHIFT, + GFP_KERNEL); + if (ret) + goto out; + + return sgt; + +out: + kfree(sgt); + return ERR_PTR(ret); +} + +static int dmabuf_exp_ops_attach(struct dma_buf *dma_buf, + struct device *target_dev, + struct dma_buf_attachment *attach) +{ + struct hyper_dambuf_attachment *hyper_dambuf_attach; + + hyper_dambuf_attach = kzalloc(sizeof(*hyper_dambuf_attach), GFP_KERNEL); + if (!hyper_dambuf_attach) + return -ENOMEM; + + hyper_dambuf_attach->dir = DMA_NONE; + attach->priv = hyper_dambuf_attach; + /* Might need to pin the pages of the buffer now. */ + return 0; +} + +static void dmabuf_exp_ops_detach(struct dma_buf *dma_buf, + struct dma_buf_attachment *attach) +{ + struct hyper_dambuf_attachment *hyper_dambuf_attach = attach->priv; + + if (hyper_dambuf_attach) { + struct sg_table *sgt = hyper_dambuf_attach->sgt; + + if (sgt) { + if (hyper_dambuf_attach->dir != DMA_NONE) + dma_unmap_sg_attrs(attach->dev, sgt->sgl, + sgt->nents, + hyper_dambuf_attach->dir, + DMA_ATTR_SKIP_CPU_SYNC); + sg_free_table(sgt); + } + + kfree(sgt); + kfree(hyper_dambuf_attach); + attach->priv = NULL; + } + /* Might need to unpin the pages of the buffer now. */ +} + +static struct sg_table * +dmabuf_exp_ops_map_dma_buf(struct dma_buf_attachment *attach, + enum dma_data_direction dir) +{ + struct hyper_dambuf_attachment *hyper_dambuf_attach = attach->priv; + struct hyper_dmabuf *hyper_dmabuf = attach->dmabuf->priv; + struct sg_table *sgt; + + pr_debug("Mapping %d pages for dev %p\n", hyper_dmabuf->nr_pages, + attach->dev); + + if (WARN_ON(dir == DMA_NONE || !hyper_dambuf_attach)) + return ERR_PTR(-EINVAL); + + /* Return the cached mapping when possible. */ + if (hyper_dambuf_attach->dir == dir) + return hyper_dambuf_attach->sgt; + + /* + * Two mappings with different directions for the same attachment are + * not allowed. + */ + if (WARN_ON(hyper_dambuf_attach->dir != DMA_NONE)) + return ERR_PTR(-EBUSY); + + sgt = dmabuf_pages_to_sgt(hyper_dmabuf->pages, hyper_dmabuf->nr_pages); + if (!IS_ERR(sgt)) { + if (!dma_map_sg_attrs(attach->dev, sgt->sgl, sgt->nents, dir, + DMA_ATTR_SKIP_CPU_SYNC)) { + sg_free_table(sgt); + kfree(sgt); + sgt = ERR_PTR(-ENOMEM); + } else { + hyper_dambuf_attach->sgt = sgt; + hyper_dambuf_attach->dir = dir; + } + } + if (IS_ERR(sgt) + pr_err("Failed to map sg table for dev %p\n", attach->dev); + return sgt; +} + +static void dmabuf_exp_ops_unmap_dma_buf(struct dma_buf_attachment *attach, + struct sg_table *sgt, + enum dma_data_direction dir) +{ + /* Not implemented. The unmap is done at dmabuf_exp_ops_detach(). */ +} + +static void dmabuf_exp_release(struct kref *kref) +{ + struct hyper_dmabuf *hyper_dmabuf = + container_of(kref, struct hyper_dmabuf, + u.exp.refcount); + + dmabuf_exp_wait_obj_signal(hyper_dmabuf->priv, hyper_dmabuf); + list_del(&hyper_dmabuf->next); + kfree(hyper_dmabuf); +} + +static void dmabuf_exp_ops_release(struct dma_buf *dma_buf) +{ + struct hyper_dmabuf *hyper_dmabuf = dma_buf->priv; + struct gntdev_priv *priv = hyper_dmabuf->priv; + + gntdev_put_map_unlink(priv, hyper_dmabuf->u.exp.map); + mutex_lock(&priv->dmabuf_lock); + kref_put(&hyper_dmabuf->u.exp.refcount, dmabuf_exp_release); + mutex_unlock(&priv->dmabuf_lock); +} + +static void *dmabuf_exp_ops_kmap_atomic(struct dma_buf *dma_buf, + unsigned long page_num) +{ + /* Not implemented. */ + return NULL; +} + +static void *dmabuf_exp_ops_kmap(struct dma_buf *dma_buf, + unsigned long page_num) +{ + /* Not implemented. */ + return NULL; +} + +static int dmabuf_exp_ops_mmap(struct dma_buf *dma_buf, + struct vm_area_struct *vma) +{ + /* Not implemented. */ + return 0; +} + +static const struct dma_buf_ops dmabuf_exp_ops = { + .attach = dmabuf_exp_ops_attach, + .detach = dmabuf_exp_ops_detach, + .map_dma_buf = dmabuf_exp_ops_map_dma_buf, + .unmap_dma_buf = dmabuf_exp_ops_unmap_dma_buf, + .release = dmabuf_exp_ops_release, + .kmap = dmabuf_exp_ops_kmap, + .kmap_atomic = dmabuf_exp_ops_kmap_atomic, + .mmap = dmabuf_exp_ops_mmap, +}; + +static int dmabuf_export(struct gntdev_priv *priv, struct grant_map *map, + int *fd) +{ + DEFINE_DMA_BUF_EXPORT_INFO(exp_info); + struct hyper_dmabuf *hyper_dmabuf; + int ret = 0; + + hyper_dmabuf = kzalloc(sizeof(*hyper_dmabuf), GFP_KERNEL); + if (!hyper_dmabuf) + return -ENOMEM; + + kref_init(&hyper_dmabuf->u.exp.refcount); + + hyper_dmabuf->priv = priv; + hyper_dmabuf->nr_pages = map->count; + hyper_dmabuf->pages = map->pages; + hyper_dmabuf->u.exp.map = map; + + exp_info.exp_name = KBUILD_MODNAME; + exp_info.ops = &dmabuf_exp_ops; + exp_info.size = map->count << PAGE_SHIFT; + exp_info.flags = O_RDWR; + exp_info.priv = hyper_dmabuf; + + hyper_dmabuf->dmabuf = dma_buf_export(&exp_info); + if (IS_ERR(hyper_dmabuf->dmabuf)) { + ret = PTR_ERR(hyper_dmabuf->dmabuf); + hyper_dmabuf->dmabuf = NULL; + goto fail; + } + + ret = dma_buf_fd(hyper_dmabuf->dmabuf, O_CLOEXEC); + if (ret < 0) + goto fail; + + hyper_dmabuf->fd = ret; + *fd = ret; + + pr_debug("Exporting DMA buffer with fd %d\n", ret); + + mutex_lock(&priv->dmabuf_lock); + list_add(&hyper_dmabuf->next, &priv->dmabuf_exp_list); + mutex_unlock(&priv->dmabuf_lock); + return 0; + +fail: + if (hyper_dmabuf->dmabuf) + dma_buf_put(hyper_dmabuf->dmabuf); + kfree(hyper_dmabuf); + return ret; +} + +static struct grant_map * +dmabuf_exp_alloc_backing_storage(int dmabuf_flags, int count) +{ + struct grant_map *map; + + if (unlikely(count <= 0)) + return ERR_PTR(-EINVAL); + + if ((dmabuf_flags & GNTDEV_DMABUF_FLAG_DMA_WC) && + (dmabuf_flags & GNTDEV_DMABUF_FLAG_DMA_COHERENT)) { + pr_err("Wrong dma-buf flags: either WC or coherent, not both\n"); + return ERR_PTR(-EINVAL); + } + + map = gntdev_alloc_map(count, dmabuf_flags); + if (!map) + return ERR_PTR(-ENOMEM); + + if (unlikely(atomic_add_return(count, &pages_mapped) > limit)) { + pr_err("can't map: over limit\n"); + gntdev_put_map(NULL, map); + return ERR_PTR(-ENOMEM); + } + return map; +} + +int gntdev_dmabuf_exp_from_refs(struct gntdev_priv *priv, int flags, + int count, u32 domid, u32 *refs, u32 *fd) +{ + struct grant_map *map; + int i, ret; + + *fd = -1; + + if (use_ptemod) { + pr_err("Cannot provide dma-buf: use_ptemode %d\n", + use_ptemod); + return -EINVAL; + } + + map = dmabuf_exp_alloc_backing_storage(flags, count); + if (IS_ERR(map)) + return PTR_ERR(map); + + for (i = 0; i < count; i++) { + map->grants[i].domid = domid; + map->grants[i].ref = refs[i]; + } + + mutex_lock(&priv->lock); + gntdev_add_map(priv, map); + mutex_unlock(&priv->lock); + + map->flags |= GNTMAP_host_map; +#if defined(CONFIG_X86) + map->flags |= GNTMAP_device_map; +#endif + + ret = map_grant_pages(map); + if (ret < 0) + goto out; + + ret = dmabuf_export(priv, map, fd); + if (ret < 0) + goto out; + + return 0; + +out: + gntdev_put_map_unlink(priv, map); + return ret; +} +EXPORT_SYMBOL(gntdev_dmabuf_exp_from_refs); + +static long +gntdev_ioctl_dmabuf_exp_from_refs(struct gntdev_priv *priv, + struct ioctl_gntdev_dmabuf_exp_from_refs __user *u) +{ + struct ioctl_gntdev_dmabuf_exp_from_refs op; + u32 *refs; + long ret; + + if (copy_from_user(&op, u, sizeof(op)) != 0) + return -EFAULT; + + refs = kcalloc(op.count, sizeof(*refs), GFP_KERNEL); + if (!refs) + return -ENOMEM; + + if (copy_from_user(refs, u->refs, sizeof(*refs) * op.count) != 0) { + ret = -EFAULT; + goto out; + } + + ret = gntdev_dmabuf_exp_from_refs(priv, op.flags, op.count, + op.domid, refs, &op.fd); + if (ret) + goto out; + + if (copy_to_user(u, &op, sizeof(op)) != 0) + ret = -EFAULT; + +out: + kfree(refs); + return ret; +} + +static long +gntdev_ioctl_dmabuf_exp_wait_released(struct gntdev_priv *priv, + struct ioctl_gntdev_dmabuf_exp_wait_released __user *u) +{ + struct ioctl_gntdev_dmabuf_exp_wait_released op; + + if (copy_from_user(&op, u, sizeof(op)) != 0) + return -EFAULT; + + return dmabuf_exp_wait_released(priv, op.fd, op.wait_to_ms); +} + +int gntdev_dmabuf_exp_wait_released(struct gntdev_priv *priv, u32 fd, + int wait_to_ms) +{ + return dmabuf_exp_wait_released(priv, fd, wait_to_ms); +} +EXPORT_SYMBOL(gntdev_dmabuf_exp_wait_released); + +/* ------------------------------------------------------------------ */ +/* DMA buffer import support. */ +/* ------------------------------------------------------------------ */ + +static int +dmabuf_imp_grant_foreign_access(struct page **pages, u32 *refs, + int count, int domid) +{ + grant_ref_t priv_gref_head; + int i, ret; + + ret = gnttab_alloc_grant_references(count, &priv_gref_head); + if (ret < 0) { + pr_err("Cannot allocate grant references, ret %d\n", ret); + return ret; + } + + for (i = 0; i < count; i++) { + int cur_ref; + + cur_ref = gnttab_claim_grant_reference(&priv_gref_head); + if (cur_ref < 0) { + ret = cur_ref; + pr_err("Cannot claim grant reference, ret %d\n", ret); + goto out; + } + + gnttab_grant_foreign_access_ref(cur_ref, domid, + xen_page_to_gfn(pages[i]), 0); + refs[i] = cur_ref; + } + + ret = 0; + +out: + gnttab_free_grant_references(priv_gref_head); + return ret; +} + +static void dmabuf_imp_end_foreign_access(u32 *refs, int count) +{ + int i; + + for (i = 0; i < count; i++) + if (refs[i] != GRANT_INVALID_REF) + gnttab_end_foreign_access(refs[i], 0, 0UL); +} + +static void dmabuf_imp_free_storage(struct hyper_dmabuf *hyper_dmabuf) +{ + kfree(hyper_dmabuf->pages); + kfree(hyper_dmabuf->u.imp.refs); + kfree(hyper_dmabuf); +} + +static struct hyper_dmabuf *dmabuf_imp_alloc_storage(int count) +{ + struct hyper_dmabuf *hyper_dmabuf; + int i; + + hyper_dmabuf = kzalloc(sizeof(*hyper_dmabuf), GFP_KERNEL); + if (!hyper_dmabuf) + goto fail; + + hyper_dmabuf->u.imp.refs = kcalloc(count, + sizeof(hyper_dmabuf->u.imp.refs[0]), + GFP_KERNEL); + if (!hyper_dmabuf->u.imp.refs) + goto fail; + + hyper_dmabuf->pages = kcalloc(count, + sizeof(hyper_dmabuf->pages[0]), + GFP_KERNEL); + if (!hyper_dmabuf->pages) + goto fail; + + hyper_dmabuf->nr_pages = count; + + for (i = 0; i < count; i++) + hyper_dmabuf->u.imp.refs[i] = GRANT_INVALID_REF; + + return hyper_dmabuf; + +fail: + dmabuf_imp_free_storage(hyper_dmabuf); + return ERR_PTR(-ENOMEM); +} + +static struct hyper_dmabuf * +dmabuf_import(struct gntdev_priv *priv, int fd, int count, int domid) +{ + struct hyper_dmabuf *hyper_dmabuf, *ret; + struct dma_buf *dma_buf; + struct dma_buf_attachment *attach; + struct sg_table *sgt; + struct sg_page_iter sg_iter; + int i; + + dma_buf = dma_buf_get(fd); + if (IS_ERR(dma_buf)) + return ERR_CAST(dma_buf); + + hyper_dmabuf = dmabuf_imp_alloc_storage(count); + if (IS_ERR(hyper_dmabuf)) { + ret = hyper_dmabuf; + goto fail_put; + } + + hyper_dmabuf->priv = priv; + hyper_dmabuf->fd = fd; + + attach = dma_buf_attach(dma_buf, priv->dev); + if (IS_ERR(attach)) { + ret = ERR_CAST(attach); + goto fail_free_obj; + } + + hyper_dmabuf->u.imp.attach = attach; + + sgt = dma_buf_map_attachment(attach, DMA_BIDIRECTIONAL); + if (IS_ERR(sgt)) { + ret = ERR_CAST(sgt); + goto fail_detach; + } + + /* Check number of pages that imported buffer has. */ + if (attach->dmabuf->size != hyper_dmabuf->nr_pages << PAGE_SHIFT) { + ret = ERR_PTR(-EINVAL); + pr_err("DMA buffer has %zu pages, user-space expects %d\n", + attach->dmabuf->size, hyper_dmabuf->nr_pages); + goto fail_unmap; + } + + hyper_dmabuf->u.imp.sgt = sgt; + + /* Now convert sgt to array of pages and check for page validity. */ + i = 0; + for_each_sg_page(sgt->sgl, &sg_iter, sgt->nents, 0) { + struct page *page = sg_page_iter_page(&sg_iter); + /* + * Check if page is valid: this can happen if we are given + * a page from VRAM or other resources which are not backed + * by a struct page. + */ + if (!pfn_valid(page_to_pfn(page))) { + ret = ERR_PTR(-EINVAL); + goto fail_unmap; + } + + hyper_dmabuf->pages[i++] = page; + } + + ret = ERR_PTR(dmabuf_imp_grant_foreign_access(hyper_dmabuf->pages, + hyper_dmabuf->u.imp.refs, + count, domid)); + if (IS_ERR(ret)) + goto fail_end_access; + + pr_debug("Imported DMA buffer with fd %d\n", fd); + + mutex_lock(&priv->dmabuf_lock); + list_add(&hyper_dmabuf->next, &priv->dmabuf_imp_list); + mutex_unlock(&priv->dmabuf_lock); + + return hyper_dmabuf; + +fail_end_access: + dmabuf_imp_end_foreign_access(hyper_dmabuf->u.imp.refs, count); +fail_unmap: + dma_buf_unmap_attachment(attach, sgt, DMA_BIDIRECTIONAL); +fail_detach: + dma_buf_detach(dma_buf, attach); +fail_free_obj: + dmabuf_imp_free_storage(hyper_dmabuf); +fail_put: + dma_buf_put(dma_buf); + return ret; +} + +/* + * Find the hyper dma-buf by its file descriptor and remove + * it from the buffer's list. + */ +static struct hyper_dmabuf * +dmabuf_imp_find_unlink(struct gntdev_priv *priv, int fd) +{ + struct hyper_dmabuf *q, *hyper_dmabuf, *ret = ERR_PTR(-ENOENT); + + mutex_lock(&priv->dmabuf_lock); + list_for_each_entry_safe(hyper_dmabuf, q, &priv->dmabuf_imp_list, next) { + if (hyper_dmabuf->fd == fd) { + pr_debug("Found hyper_dmabuf in the import list\n"); + ret = hyper_dmabuf; + list_del(&hyper_dmabuf->next); + break; + } + } + mutex_unlock(&priv->dmabuf_lock); + return ret; +} + +int gntdev_dmabuf_imp_release(struct gntdev_priv *priv, u32 fd) +{ + struct hyper_dmabuf *hyper_dmabuf; + struct dma_buf_attachment *attach; + struct dma_buf *dma_buf; + + hyper_dmabuf = dmabuf_imp_find_unlink(priv, fd); + if (IS_ERR(hyper_dmabuf)) + return PTR_ERR(hyper_dmabuf); + + pr_debug("Releasing DMA buffer with fd %d\n", fd); + + attach = hyper_dmabuf->u.imp.attach; + + if (hyper_dmabuf->u.imp.sgt) + dma_buf_unmap_attachment(attach, hyper_dmabuf->u.imp.sgt, + DMA_BIDIRECTIONAL); + dma_buf = attach->dmabuf; + dma_buf_detach(attach->dmabuf, attach); + dma_buf_put(dma_buf); + + dmabuf_imp_end_foreign_access(hyper_dmabuf->u.imp.refs, + hyper_dmabuf->nr_pages); + dmabuf_imp_free_storage(hyper_dmabuf); + return 0; +} +EXPORT_SYMBOL(gntdev_dmabuf_imp_release); + +static long +gntdev_ioctl_dmabuf_imp_release(struct gntdev_priv *priv, + struct ioctl_gntdev_dmabuf_imp_release __user *u) +{ + struct ioctl_gntdev_dmabuf_imp_release op; + + if (copy_from_user(&op, u, sizeof(op)) != 0) + return -EFAULT; + + return gntdev_dmabuf_imp_release(priv, op.fd); +} + +static long +gntdev_ioctl_dmabuf_imp_to_refs(struct gntdev_priv *priv, + struct ioctl_gntdev_dmabuf_imp_to_refs __user *u) +{ + struct ioctl_gntdev_dmabuf_imp_to_refs op; + struct hyper_dmabuf *hyper_dmabuf; + long ret; + + if (copy_from_user(&op, u, sizeof(op)) != 0) + return -EFAULT; + + hyper_dmabuf = dmabuf_import(priv, op.fd, op.count, op.domid); + if (IS_ERR(hyper_dmabuf)) + return PTR_ERR(hyper_dmabuf); + + if (copy_to_user(u->refs, hyper_dmabuf->u.imp.refs, + sizeof(*u->refs) * op.count) != 0) { + ret = -EFAULT; + goto out_release; + } + return 0; + +out_release: + gntdev_dmabuf_imp_release(priv, op.fd); + return ret; +} + +u32 *gntdev_dmabuf_imp_to_refs(struct gntdev_priv *priv, int fd, + int count, int domid, u32 **refs) +{ + struct hyper_dmabuf *hyper_dmabuf; + + hyper_dmabuf = dmabuf_import(priv, fd, count, domid); + if (IS_ERR(hyper_dmabuf)) + return ERR_CAST(hyper_dmabuf); + + return hyper_dmabuf->u.imp.refs; +} +EXPORT_SYMBOL(gntdev_dmabuf_imp_to_refs); + static long gntdev_ioctl(struct file *flip, unsigned int cmd, unsigned long arg) { @@ -971,6 +1889,18 @@ static long gntdev_ioctl(struct file *flip, case IOCTL_GNTDEV_GRANT_COPY: return gntdev_ioctl_grant_copy(priv, ptr); + case IOCTL_GNTDEV_DMABUF_EXP_FROM_REFS: + return gntdev_ioctl_dmabuf_exp_from_refs(priv, ptr); + + case IOCTL_GNTDEV_DMABUF_EXP_WAIT_RELEASED: + return gntdev_ioctl_dmabuf_exp_wait_released(priv, ptr); + + case IOCTL_GNTDEV_DMABUF_IMP_TO_REFS: + return gntdev_ioctl_dmabuf_imp_to_refs(priv, ptr); + + case IOCTL_GNTDEV_DMABUF_IMP_RELEASE: + return gntdev_ioctl_dmabuf_imp_release(priv, ptr); + default: pr_debug("priv %p, unknown cmd %x\n", priv, cmd); return -ENOIOCTLCMD; diff --git a/include/uapi/xen/gntdev.h b/include/uapi/xen/gntdev.h index d0661977667e..7cf7ca31db21 100644 --- a/include/uapi/xen/gntdev.h +++ b/include/uapi/xen/gntdev.h @@ -199,4 +199,105 @@ struct ioctl_gntdev_grant_copy { /* Send an interrupt on the indicated event channel */ #define UNMAP_NOTIFY_SEND_EVENT 0x2 +/* + * Create a dma-buf [1] from grant references @refs of count @count provided + * by the foreign domain @domid with flags @flags. + * + * By default dma-buf is backed by system memory pages, but by providing + * GNTDEV_DMABUF_FLAG_DMA flag it can also be created as a DMA write-combine + * buffer, e.g. allocated with dma_alloc_wc. + * + * Returns 0 if dma-buf was successfully created and the corresponding + * dma-buf's file descriptor is returned in @fd. + * + * [1] https://elixir.bootlin.com/linux/latest/source/Documentation/driver-api/dma-buf.rst + */ + +/* + * Request dma-buf backing storage to be allocated with DMA API: + * the buffer is backed with memory allocated with dma_alloc_wc. + */ +#define GNTDEV_DMABUF_FLAG_DMA_WC (1 << 1) + +/* + * Request dma-buf backing storage to be allocated with DMA API: + * the buffer is backed with memory allocated with dma_alloc_coherent. + */ +#define GNTDEV_DMABUF_FLAG_DMA_COHERENT (1 << 2) + +#define IOCTL_GNTDEV_DMABUF_EXP_FROM_REFS \ + _IOC(_IOC_NONE, 'G', 9, \ + sizeof(struct ioctl_gntdev_dmabuf_exp_from_refs)) +struct ioctl_gntdev_dmabuf_exp_from_refs { + /* IN parameters. */ + /* Specific options for this dma-buf: see GNTDEV_DMABUF_FLAG_XXX. */ + __u32 flags; + /* Number of grant references in @refs array. */ + __u32 count; + /* OUT parameters. */ + /* File descriptor of the dma-buf. */ + __u32 fd; + /* The domain ID of the grant references to be mapped. */ + __u32 domid; + /* Variable IN parameter. */ + /* Array of grant references of size @count. */ + __u32 refs[1]; +}; + +/* + * This will block until the dma-buf with the file descriptor @fd is + * released. This is only valid for buffers created with + * IOCTL_GNTDEV_DMABUF_EXP_FROM_REFS. + * + * If withing @wait_to_ms milliseconds the buffer is not released + * then -ETIMEDOUT error is returned. + * If the buffer with file descriptor @fd does not exist or has already + * been released, then -ENOENT is returned. For valid file descriptors + * this must not be treated as error. + */ +#define IOCTL_GNTDEV_DMABUF_EXP_WAIT_RELEASED \ + _IOC(_IOC_NONE, 'G', 10, \ + sizeof(struct ioctl_gntdev_dmabuf_exp_wait_released)) +struct ioctl_gntdev_dmabuf_exp_wait_released { + /* IN parameters */ + __u32 fd; + __u32 wait_to_ms; +}; + +/* + * Import a dma-buf with file descriptor @fd and export granted references + * to the pages of that dma-buf into array @refs of size @count. + */ +#define IOCTL_GNTDEV_DMABUF_IMP_TO_REFS \ + _IOC(_IOC_NONE, 'G', 11, \ + sizeof(struct ioctl_gntdev_dmabuf_imp_to_refs)) +struct ioctl_gntdev_dmabuf_imp_to_refs { + /* IN parameters. */ + /* File descriptor of the dma-buf. */ + __u32 fd; + /* Number of grant references in @refs array. */ + __u32 count; + /* The domain ID for which references to be granted. */ + __u32 domid; + /* Reserved - must be zero. */ + __u32 reserved; + /* OUT parameters. */ + /* Array of grant references of size @count. */ + __u32 refs[1]; +}; + +/* + * This will close all references to an imported buffer, so it can be + * released by the owner. This is only valid for buffers created with + * IOCTL_GNTDEV_DMABUF_IMP_TO_REFS. + */ +#define IOCTL_GNTDEV_DMABUF_IMP_RELEASE \ + _IOC(_IOC_NONE, 'G', 12, \ + sizeof(struct ioctl_gntdev_dmabuf_imp_release)) +struct ioctl_gntdev_dmabuf_imp_release { + /* IN parameters */ + __u32 fd; + __u32 reserved; +}; + #endif /* __LINUX_PUBLIC_GNTDEV_H__ */ diff --git a/include/xen/gntdev_exp.h b/include/xen/gntdev_exp.h new file mode 100644 index 000000000000..aaf45bda30ac --- /dev/null +++ b/include/xen/gntdev_exp.h @@ -0,0 +1,23 @@ +/****************************************************************************** + * Xen grant device exported functionality + */ + +#ifndef _XEN_GNTDEV_EXP_H +#define _XEN_GNTDEV_EXP_H + +struct gntdev_priv *gntdev_alloc_context(struct device *dev); + +void gntdev_free_context(struct gntdev_priv *priv); + +int gntdev_dmabuf_exp_from_refs(struct gntdev_priv *priv, int flags, + int count, u32 domid, u32 *refs, u32 *fd); + +int gntdev_dmabuf_exp_wait_released(struct gntdev_priv *priv, u32 fd, + int wait_to_ms); + +int gntdev_dmabuf_imp_release(struct gntdev_priv *priv, u32 fd); + +u32 *gntdev_dmabuf_imp_to_refs(struct gntdev_priv *priv, int fd, + int count, int domid, u32 **refs); + +#endif -- 2.17.0