From mboxrd@z Thu Jan 1 00:00:00 1970 From: "Michael S. Tsirkin" Subject: Re: [PATCH V11 0/6] mdev based hardware virtio offloading support Date: Thu, 7 Nov 2019 10:54:22 -0500 Message-ID: <20191107105412-mutt-send-email-mst@kernel.org> References: <20191107151109.23261-1-jasowang@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Return-path: Content-Disposition: inline In-Reply-To: <20191107151109.23261-1-jasowang@redhat.com> Sender: linux-kernel-owner@vger.kernel.org To: Jason Wang Cc: kvm@vger.kernel.org, linux-s390@vger.kernel.org, linux-kernel@vger.kernel.org, dri-devel@lists.freedesktop.org, intel-gfx@lists.freedesktop.org, intel-gvt-dev@lists.freedesktop.org, kwankhede@nvidia.com, alex.williamson@redhat.com, tiwei.bie@intel.com, virtualization@lists.linux-foundation.org, netdev@vger.kernel.org, cohuck@redhat.com, maxime.coquelin@redhat.com, cunming.liang@intel.com, zhihong.wang@intel.com, rob.miller@broadcom.com, xiao.w.wang@intel.com, haotian.wang@sifive.com, zhenyuw@linux.intel.com, zhi.a.wang@intel.com, jani.nikula@linux.intel.com, joonas.lahtinen@linux.intel.com, rodrigo.vivi@intel.com, airlied@linux.ie, daniel@ffwll.ch, farman@linux.ibm.com, pasic@linux.ibm.com, sebott@linux.ibm.com, oberpar@linux.ibm.com, heiko.carstens@de.ibm.com, gor@linux.ib List-Id: intel-gfx@lists.freedesktop.org On Thu, Nov 07, 2019 at 11:11:03PM +0800, Jason Wang wrote: > Hi all: > > There are hardwares that can do virtio datapath offloading while > having its own control path. This path tries to implement a mdev based > unified API to support using kernel virtio driver to drive those > devices. This is done by introducing a new mdev transport for virtio > (virtio_mdev) and register itself as a new kind of mdev driver. Then > it provides a unified way for kernel virtio driver to talk with mdev > device implementation. > > Though the series only contains kernel driver support, the goal is to > make the transport generic enough to support userspace drivers. This > means vhost-mdev[1] could be built on top as well by resuing the > transport. > > A sample driver is also implemented which simulate a virito-net > loopback ethernet device on top of vringh + workqueue. This could be > used as a reference implementation for real hardware driver. > > Also a real IFC VF driver was also posted here[2] which is a good > reference for vendors who is interested in their own virtio datapath > offloading product. > > Consider mdev framework only support VFIO device and driver right now, > this series also extend it to support other types. This is done > through introducing class id to the device and pairing it with > id_talbe claimed by the driver. On top, this seris also decouple > device specific ops out of the common ones for implementing class > specific operations over mdev bus. > > Pktgen test was done with virito-net + mvnet loop back device. > > Please review. > > [1] https://lkml.org/lkml/2019/11/5/424 > [2] https://lkml.org/lkml/2019/11/5/227 > > Changes from V10: > - rename mvnet to mvnet_loopback > - fix typo in the help text for sample Kconfig Acked-by: Michael S. Tsirkin > Changes from V9: > - Tweak the help text for virito-mdev kconfig > > Changes from V8: > - try silent checkpatch, some are still there becuase they were inherited > from virtio_config_ops which needs to be resolved in an independent series > - tweak on the comment and doc > - remove VIRTIO_MDEV_F_VERSION_1 completely > - rename CONFIG_VIRTIO_MDEV_DEVICE to CONFIG_VIRTIO_MDEV > > Changes from V7: > - drop {set|get}_mdev_features for virtio > - typo and comment style fixes > > Changes from V6: > - rename ops files and compile guard > > Changes from V5: > - use dev_warn() instead of WARN(1) when class id is not set > - validate id_table before trying to do matching between device and > driver > - add wildcard for modpost script > - use unique name for id_table > - move get_mdev_features() to be the first member of virtio_device_ops > and more comments for it > - typo fixes for the comments above virtio_mdev_ops > > Changes from V4: > - keep mdev_set_class() for the device that doesn't use device ops > - use union for device ops pointer in mdev_device > - introduce class specific helper for getting is device ops > - use WARN_ON instead of BUG_ON in mdev_set_virtio_ops > - explain details of get_mdev_features() and get_vendor_id() > - distinguish the optional virito device ops from mandatory ones and > make get_generation() optional > - rename vfio_mdev.h to vfio_mdev_ops.h, rename virito_mdev.h to > virtio_mdev_ops.h > - don't abuse version fileds in virtio_mdev structure, use features > instead > - fix warning during device remove > - style & docs tweaks and typo fixes > > Changes from V3: > - document that class id (device ops) must be specified in create() > - add WARN() when trying to set class_id when it has already set > - add WARN() when class_id is not specified in create() and correctly > return an error in this case > - correct the prototype of mdev_set_class() in the doc > - add documention of mdev_set_class() > - remove the unnecessary "class_id_fail" label when class id is not > specified in create() > - convert id_table in vfio_mdev to const > - move mdev_set_class and its friends after mdev_uuid() > - suqash the patch of bus uevent into patch of introducing class id > - tweak the words in the docs per Cornelia suggestion > - tie class_id and device ops through class specific initialization > routine like mdev_set_vfio_ops() > - typos fixes in the docs of virtio-mdev callbacks > - document the usage of virtqueues in struct virtio_mdev_device > - remove the useless vqs array in struct virtio_mdev_device > - rename MDEV_ID_XXX to MDEV_CLASS_ID_XXX > > Changes from V2: > - fail when class_id is not specified > - drop the vringh patch > - match the doc to the code > - tweak the commit log > - move device_ops from parent to mdev device > - remove the unused MDEV_ID_VHOST > > Changes from V1: > - move virtio_mdev.c to drivers/virtio > - store class_id in mdev_device instead of mdev_parent > - store device_ops in mdev_device instead of mdev_parent > - reorder the patch, vringh fix comes first > - really silent compiling warnings > - really switch to use u16 for class_id > - uevent and modpost support for mdev class_id > - vraious tweaks per comments from Parav > > Changes from RFC-V2: > - silent compile warnings on some specific configuration > - use u16 instead u8 for class id > - reseve MDEV_ID_VHOST for future vhost-mdev work > - introduce "virtio" type for mvnet and make "vhost" type for future > work > - add entries in MAINTAINER > - tweak and typos fixes in commit log > > Changes from RFC-V1: > - rename device id to class id > - add docs for class id and device specific ops (device_ops) > - split device_ops into seperate headers > - drop the mdev_set_dma_ops() > - use device_ops to implement the transport API, then it's not a part > of UAPI any more > - use GFP_ATOMIC in mvnet sample device and other tweaks > - set_vring_base/get_vring_base support for mvnet device > > Jason Wang (6): > mdev: class id support > modpost: add support for mdev class id > mdev: introduce device specific ops > mdev: introduce virtio device and its device ops > virtio: introduce a mdev based transport > docs: sample driver to demonstrate how to implement virtio-mdev > framework > > .../driver-api/vfio-mediated-device.rst | 38 +- > MAINTAINERS | 3 + > drivers/gpu/drm/i915/gvt/kvmgt.c | 17 +- > drivers/s390/cio/vfio_ccw_ops.c | 17 +- > drivers/s390/crypto/vfio_ap_ops.c | 13 +- > drivers/vfio/mdev/mdev_core.c | 60 ++ > drivers/vfio/mdev/mdev_driver.c | 25 + > drivers/vfio/mdev/mdev_private.h | 8 + > drivers/vfio/mdev/vfio_mdev.c | 45 +- > drivers/virtio/Kconfig | 13 + > drivers/virtio/Makefile | 1 + > drivers/virtio/virtio_mdev.c | 406 +++++++++++ > include/linux/mdev.h | 57 +- > include/linux/mdev_vfio_ops.h | 52 ++ > include/linux/mdev_virtio_ops.h | 147 ++++ > include/linux/mod_devicetable.h | 8 + > samples/Kconfig | 10 + > samples/vfio-mdev/Makefile | 1 + > samples/vfio-mdev/mbochs.c | 19 +- > samples/vfio-mdev/mdpy.c | 19 +- > samples/vfio-mdev/mtty.c | 17 +- > samples/vfio-mdev/mvnet_loopback.c | 687 ++++++++++++++++++ > scripts/mod/devicetable-offsets.c | 3 + > scripts/mod/file2alias.c | 11 + > 24 files changed, 1586 insertions(+), 91 deletions(-) > create mode 100644 drivers/virtio/virtio_mdev.c > create mode 100644 include/linux/mdev_vfio_ops.h > create mode 100644 include/linux/mdev_virtio_ops.h > create mode 100644 samples/vfio-mdev/mvnet_loopback.c > > -- > 2.19.1 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.7 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 841FBC5DF61 for ; Thu, 7 Nov 2019 15:54:39 +0000 (UTC) Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 5DBF6218AE for ; Thu, 7 Nov 2019 15:54:39 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 5DBF6218AE Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=redhat.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=intel-gfx-bounces@lists.freedesktop.org Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id 858EB6F72B; Thu, 7 Nov 2019 15:54:38 +0000 (UTC) Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by gabe.freedesktop.org (Postfix) with ESMTPS id C765C6E4AE for ; Thu, 7 Nov 2019 15:54:37 +0000 (UTC) Received: from mail-qt1-f197.google.com (mail-qt1-f197.google.com [209.85.160.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id 2BE777C0B9 for ; Thu, 7 Nov 2019 15:54:37 +0000 (UTC) Received: by mail-qt1-f197.google.com with SMTP id 2so3088141qtg.8 for ; Thu, 07 Nov 2019 07:54:37 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=BBCrA8jI8FYav5dUH4JsIvDsqU9jbzWbW4UmAoXMTfU=; b=PNQFHyRVrHrmpSYJQ5D8ijt320TIKghyp/zJNS5bVsxr+y7/FyNvOU8y0AOUgqfrbX Vq0GDfEN2tbME69C6VncJ7tAL0LPXLE6nylyoUI0kbETh/ZQxJs0hjiDaLTLG7erVAoQ vuiejAlpHjb3hajX/va4xDvAORkDFSL6nLW2MkZVEHQ3WYs0BVIn4pcT3mjIW4w0SbUF cWEgetoOcQc39jekRBqnmRRGBACcy3pAOE7QfWVZFXASPxqF/9GIWNBVN9660//UC40V 0NLSGjF1fkiOF7bryJSmrfxrmQDGnrKBRgQxU42iL6WgTUxS6MfedEztfVP03qwKC1YR OrNw== X-Gm-Message-State: APjAAAXNWKkAUWl4zjqpNJPo2wdsN1aNdvj+d4GoGVGHMDImzpvFmQ54 PWQ7xL9U3LVll1hOGalF1BwR+5gVKVBK2IrXx/w6MlLu92iuTHqdti8BEmBL2/z6+oZaAwx8a0T /w/g0qiPt+SwANmpT8xXRH9SC2hSp X-Received: by 2002:a05:620a:226:: with SMTP id u6mr3459305qkm.393.1573142076272; Thu, 07 Nov 2019 07:54:36 -0800 (PST) X-Google-Smtp-Source: APXvYqxSgLzGIZB2AaYtHaY2RkdEidB2NeRk+OXmCkV1uMYYneoFbHELGewocRRkI4W/JRZGPMhgWA== X-Received: by 2002:a05:620a:226:: with SMTP id u6mr3459254qkm.393.1573142075868; Thu, 07 Nov 2019 07:54:35 -0800 (PST) Received: from redhat.com (bzq-79-178-12-128.red.bezeqint.net. [79.178.12.128]) by smtp.gmail.com with ESMTPSA id 50sm2019631qtv.88.2019.11.07.07.54.25 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 07 Nov 2019 07:54:34 -0800 (PST) Date: Thu, 7 Nov 2019 10:54:22 -0500 From: "Michael S. Tsirkin" To: Jason Wang Message-ID: <20191107105412-mutt-send-email-mst@kernel.org> References: <20191107151109.23261-1-jasowang@redhat.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <20191107151109.23261-1-jasowang@redhat.com> Subject: Re: [Intel-gfx] [PATCH V11 0/6] mdev based hardware virtio offloading support X-BeenThere: intel-gfx@lists.freedesktop.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Intel graphics driver community testing & development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: rdunlap@infradead.org, christophe.de.dinechin@gmail.com, kvm@vger.kernel.org, airlied@linux.ie, heiko.carstens@de.ibm.com, dri-devel@lists.freedesktop.org, virtualization@lists.linux-foundation.org, kwankhede@nvidia.com, rob.miller@broadcom.com, linux-s390@vger.kernel.org, sebott@linux.ibm.com, lulu@redhat.com, eperezma@redhat.com, pasic@linux.ibm.com, borntraeger@de.ibm.com, haotian.wang@sifive.com, cunming.liang@intel.com, farman@linux.ibm.com, parav@mellanox.com, gor@linux.ibm.com, intel-gfx@lists.freedesktop.org, xiao.w.wang@intel.com, freude@linux.ibm.com, stefanha@redhat.com, zhihong.wang@intel.com, intel-gvt-dev@lists.freedesktop.org, akrowiak@linux.ibm.com, oberpar@linux.ibm.com, tiwei.bie@intel.com, netdev@vger.kernel.org, cohuck@redhat.com, linux-kernel@vger.kernel.org, maxime.coquelin@redhat.com, lingshan.zhu@intel.com Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Errors-To: intel-gfx-bounces@lists.freedesktop.org Sender: "Intel-gfx" Message-ID: <20191107155422.dPKeEC8ch_NskK3A6IVq8-1ViQHgjX4rm8Yh1-f7f1I@z> T24gVGh1LCBOb3YgMDcsIDIwMTkgYXQgMTE6MTE6MDNQTSArMDgwMCwgSmFzb24gV2FuZyB3cm90 ZToKPiBIaSBhbGw6Cj4gCj4gVGhlcmUgYXJlIGhhcmR3YXJlcyB0aGF0IGNhbiBkbyB2aXJ0aW8g ZGF0YXBhdGggb2ZmbG9hZGluZyB3aGlsZQo+IGhhdmluZyBpdHMgb3duIGNvbnRyb2wgcGF0aC4g VGhpcyBwYXRoIHRyaWVzIHRvIGltcGxlbWVudCBhIG1kZXYgYmFzZWQKPiB1bmlmaWVkIEFQSSB0 byBzdXBwb3J0IHVzaW5nIGtlcm5lbCB2aXJ0aW8gZHJpdmVyIHRvIGRyaXZlIHRob3NlCj4gZGV2 aWNlcy4gVGhpcyBpcyBkb25lIGJ5IGludHJvZHVjaW5nIGEgbmV3IG1kZXYgdHJhbnNwb3J0IGZv ciB2aXJ0aW8KPiAodmlydGlvX21kZXYpIGFuZCByZWdpc3RlciBpdHNlbGYgYXMgYSBuZXcga2lu ZCBvZiBtZGV2IGRyaXZlci4gVGhlbgo+IGl0IHByb3ZpZGVzIGEgdW5pZmllZCB3YXkgZm9yIGtl cm5lbCB2aXJ0aW8gZHJpdmVyIHRvIHRhbGsgd2l0aCBtZGV2Cj4gZGV2aWNlIGltcGxlbWVudGF0 aW9uLgo+IAo+IFRob3VnaCB0aGUgc2VyaWVzIG9ubHkgY29udGFpbnMga2VybmVsIGRyaXZlciBz dXBwb3J0LCB0aGUgZ29hbCBpcyB0bwo+IG1ha2UgdGhlIHRyYW5zcG9ydCBnZW5lcmljIGVub3Vn aCB0byBzdXBwb3J0IHVzZXJzcGFjZSBkcml2ZXJzLiBUaGlzCj4gbWVhbnMgdmhvc3QtbWRldlsx XSBjb3VsZCBiZSBidWlsdCBvbiB0b3AgYXMgd2VsbCBieSByZXN1aW5nIHRoZQo+IHRyYW5zcG9y dC4KPiAKPiBBIHNhbXBsZSBkcml2ZXIgaXMgYWxzbyBpbXBsZW1lbnRlZCB3aGljaCBzaW11bGF0 ZSBhIHZpcml0by1uZXQKPiBsb29wYmFjayBldGhlcm5ldCBkZXZpY2Ugb24gdG9wIG9mIHZyaW5n aCArIHdvcmtxdWV1ZS4gVGhpcyBjb3VsZCBiZQo+IHVzZWQgYXMgYSByZWZlcmVuY2UgaW1wbGVt ZW50YXRpb24gZm9yIHJlYWwgaGFyZHdhcmUgZHJpdmVyLgo+IAo+IEFsc28gYSByZWFsIElGQyBW RiBkcml2ZXIgd2FzIGFsc28gcG9zdGVkIGhlcmVbMl0gd2hpY2ggaXMgYSBnb29kCj4gcmVmZXJl bmNlIGZvciB2ZW5kb3JzIHdobyBpcyBpbnRlcmVzdGVkIGluIHRoZWlyIG93biB2aXJ0aW8gZGF0 YXBhdGgKPiBvZmZsb2FkaW5nIHByb2R1Y3QuCj4gCj4gQ29uc2lkZXIgbWRldiBmcmFtZXdvcmsg b25seSBzdXBwb3J0IFZGSU8gZGV2aWNlIGFuZCBkcml2ZXIgcmlnaHQgbm93LAo+IHRoaXMgc2Vy aWVzIGFsc28gZXh0ZW5kIGl0IHRvIHN1cHBvcnQgb3RoZXIgdHlwZXMuIFRoaXMgaXMgZG9uZQo+ IHRocm91Z2ggaW50cm9kdWNpbmcgY2xhc3MgaWQgdG8gdGhlIGRldmljZSBhbmQgcGFpcmluZyBp dCB3aXRoCj4gaWRfdGFsYmUgY2xhaW1lZCBieSB0aGUgZHJpdmVyLiBPbiB0b3AsIHRoaXMgc2Vy aXMgYWxzbyBkZWNvdXBsZQo+IGRldmljZSBzcGVjaWZpYyBvcHMgb3V0IG9mIHRoZSBjb21tb24g b25lcyBmb3IgaW1wbGVtZW50aW5nIGNsYXNzCj4gc3BlY2lmaWMgb3BlcmF0aW9ucyBvdmVyIG1k ZXYgYnVzLgo+IAo+IFBrdGdlbiB0ZXN0IHdhcyBkb25lIHdpdGggdmlyaXRvLW5ldCArIG12bmV0 IGxvb3AgYmFjayBkZXZpY2UuCj4gCj4gUGxlYXNlIHJldmlldy4KPiAKPiBbMV0gaHR0cHM6Ly9s a21sLm9yZy9sa21sLzIwMTkvMTEvNS80MjQKPiBbMl0gaHR0cHM6Ly9sa21sLm9yZy9sa21sLzIw MTkvMTEvNS8yMjcKPiAKPiBDaGFuZ2VzIGZyb20gVjEwOgo+IC0gcmVuYW1lIG12bmV0IHRvIG12 bmV0X2xvb3BiYWNrCj4gLSBmaXggdHlwbyBpbiB0aGUgaGVscCB0ZXh0IGZvciBzYW1wbGUgS2Nv bmZpZwoKQWNrZWQtYnk6IE1pY2hhZWwgUy4gVHNpcmtpbiA8bXN0QHJlZGhhdC5jb20+CgoKPiBD aGFuZ2VzIGZyb20gVjk6Cj4gLSBUd2VhayB0aGUgaGVscCB0ZXh0IGZvciB2aXJpdG8tbWRldiBr Y29uZmlnCj4gCj4gQ2hhbmdlcyBmcm9tIFY4Ogo+IC0gdHJ5IHNpbGVudCBjaGVja3BhdGNoLCBz b21lIGFyZSBzdGlsbCB0aGVyZSBiZWN1YXNlIHRoZXkgd2VyZSBpbmhlcml0ZWQKPiAgIGZyb20g dmlydGlvX2NvbmZpZ19vcHMgd2hpY2ggbmVlZHMgdG8gYmUgcmVzb2x2ZWQgaW4gYW4gaW5kZXBl bmRlbnQgc2VyaWVzCj4gLSB0d2VhayBvbiB0aGUgY29tbWVudCBhbmQgZG9jCj4gLSByZW1vdmUg VklSVElPX01ERVZfRl9WRVJTSU9OXzEgY29tcGxldGVseQo+IC0gcmVuYW1lIENPTkZJR19WSVJU SU9fTURFVl9ERVZJQ0UgdG8gQ09ORklHX1ZJUlRJT19NREVWCj4gCj4gQ2hhbmdlcyBmcm9tIFY3 Ogo+IC0gZHJvcCB7c2V0fGdldH1fbWRldl9mZWF0dXJlcyBmb3IgdmlydGlvCj4gLSB0eXBvIGFu ZCBjb21tZW50IHN0eWxlIGZpeGVzCj4gCj4gQ2hhbmdlcyBmcm9tIFY2Ogo+IC0gcmVuYW1lIG9w cyBmaWxlcyBhbmQgY29tcGlsZSBndWFyZAo+IAo+IENoYW5nZXMgZnJvbSBWNToKPiAtIHVzZSBk ZXZfd2FybigpIGluc3RlYWQgb2YgV0FSTigxKSB3aGVuIGNsYXNzIGlkIGlzIG5vdCBzZXQKPiAt IHZhbGlkYXRlIGlkX3RhYmxlIGJlZm9yZSB0cnlpbmcgdG8gZG8gbWF0Y2hpbmcgYmV0d2VlbiBk ZXZpY2UgYW5kCj4gICBkcml2ZXIKPiAtIGFkZCB3aWxkY2FyZCBmb3IgbW9kcG9zdCBzY3JpcHQK PiAtIHVzZSB1bmlxdWUgbmFtZSBmb3IgaWRfdGFibGUKPiAtIG1vdmUgZ2V0X21kZXZfZmVhdHVy ZXMoKSB0byBiZSB0aGUgZmlyc3QgbWVtYmVyIG9mIHZpcnRpb19kZXZpY2Vfb3BzCj4gICBhbmQg bW9yZSBjb21tZW50cyBmb3IgaXQKPiAtIHR5cG8gZml4ZXMgZm9yIHRoZSBjb21tZW50cyBhYm92 ZSB2aXJ0aW9fbWRldl9vcHMKPiAKPiBDaGFuZ2VzIGZyb20gVjQ6Cj4gLSBrZWVwIG1kZXZfc2V0 X2NsYXNzKCkgZm9yIHRoZSBkZXZpY2UgdGhhdCBkb2Vzbid0IHVzZSBkZXZpY2Ugb3BzCj4gLSB1 c2UgdW5pb24gZm9yIGRldmljZSBvcHMgcG9pbnRlciBpbiBtZGV2X2RldmljZQo+IC0gaW50cm9k dWNlIGNsYXNzIHNwZWNpZmljIGhlbHBlciBmb3IgZ2V0dGluZyBpcyBkZXZpY2Ugb3BzCj4gLSB1 c2UgV0FSTl9PTiBpbnN0ZWFkIG9mIEJVR19PTiBpbiBtZGV2X3NldF92aXJ0aW9fb3BzCj4gLSBl eHBsYWluIGRldGFpbHMgb2YgZ2V0X21kZXZfZmVhdHVyZXMoKSBhbmQgZ2V0X3ZlbmRvcl9pZCgp Cj4gLSBkaXN0aW5ndWlzaCB0aGUgb3B0aW9uYWwgdmlyaXRvIGRldmljZSBvcHMgZnJvbSBtYW5k YXRvcnkgb25lcyBhbmQKPiAgIG1ha2UgZ2V0X2dlbmVyYXRpb24oKSBvcHRpb25hbAo+IC0gcmVu YW1lIHZmaW9fbWRldi5oIHRvIHZmaW9fbWRldl9vcHMuaCwgcmVuYW1lIHZpcml0b19tZGV2Lmgg dG8KPiAgIHZpcnRpb19tZGV2X29wcy5oCj4gLSBkb24ndCBhYnVzZSB2ZXJzaW9uIGZpbGVkcyBp biB2aXJ0aW9fbWRldiBzdHJ1Y3R1cmUsIHVzZSBmZWF0dXJlcwo+ICAgaW5zdGVhZAo+IC0gZml4 IHdhcm5pbmcgZHVyaW5nIGRldmljZSByZW1vdmUKPiAtIHN0eWxlICYgZG9jcyB0d2Vha3MgYW5k IHR5cG8gZml4ZXMKPiAKPiBDaGFuZ2VzIGZyb20gVjM6Cj4gLSBkb2N1bWVudCB0aGF0IGNsYXNz IGlkIChkZXZpY2Ugb3BzKSBtdXN0IGJlIHNwZWNpZmllZCBpbiBjcmVhdGUoKQo+IC0gYWRkIFdB Uk4oKSB3aGVuIHRyeWluZyB0byBzZXQgY2xhc3NfaWQgd2hlbiBpdCBoYXMgYWxyZWFkeSBzZXQK PiAtIGFkZCBXQVJOKCkgd2hlbiBjbGFzc19pZCBpcyBub3Qgc3BlY2lmaWVkIGluIGNyZWF0ZSgp IGFuZCBjb3JyZWN0bHkKPiAgIHJldHVybiBhbiBlcnJvciBpbiB0aGlzIGNhc2UKPiAtIGNvcnJl Y3QgdGhlIHByb3RvdHlwZSBvZiBtZGV2X3NldF9jbGFzcygpIGluIHRoZSBkb2MKPiAtIGFkZCBk b2N1bWVudGlvbiBvZiBtZGV2X3NldF9jbGFzcygpCj4gLSByZW1vdmUgdGhlIHVubmVjZXNzYXJ5 ICJjbGFzc19pZF9mYWlsIiBsYWJlbCB3aGVuIGNsYXNzIGlkIGlzIG5vdAo+ICAgc3BlY2lmaWVk IGluIGNyZWF0ZSgpCj4gLSBjb252ZXJ0IGlkX3RhYmxlIGluIHZmaW9fbWRldiB0byBjb25zdAo+ IC0gbW92ZSBtZGV2X3NldF9jbGFzcyBhbmQgaXRzIGZyaWVuZHMgYWZ0ZXIgbWRldl91dWlkKCkK PiAtIHN1cWFzaCB0aGUgcGF0Y2ggb2YgYnVzIHVldmVudCBpbnRvIHBhdGNoIG9mIGludHJvZHVj aW5nIGNsYXNzIGlkCj4gLSB0d2VhayB0aGUgd29yZHMgaW4gdGhlIGRvY3MgcGVyIENvcm5lbGlh IHN1Z2dlc3Rpb24KPiAtIHRpZSBjbGFzc19pZCBhbmQgZGV2aWNlIG9wcyB0aHJvdWdoIGNsYXNz IHNwZWNpZmljIGluaXRpYWxpemF0aW9uCj4gICByb3V0aW5lIGxpa2UgbWRldl9zZXRfdmZpb19v cHMoKQo+IC0gdHlwb3MgZml4ZXMgaW4gdGhlIGRvY3Mgb2YgdmlydGlvLW1kZXYgY2FsbGJhY2tz Cj4gLSBkb2N1bWVudCB0aGUgdXNhZ2Ugb2YgdmlydHF1ZXVlcyBpbiBzdHJ1Y3QgdmlydGlvX21k ZXZfZGV2aWNlCj4gLSByZW1vdmUgdGhlIHVzZWxlc3MgdnFzIGFycmF5IGluIHN0cnVjdCB2aXJ0 aW9fbWRldl9kZXZpY2UKPiAtIHJlbmFtZSBNREVWX0lEX1hYWCB0byBNREVWX0NMQVNTX0lEX1hY WAo+IAo+IENoYW5nZXMgZnJvbSBWMjoKPiAtIGZhaWwgd2hlbiBjbGFzc19pZCBpcyBub3Qgc3Bl Y2lmaWVkCj4gLSBkcm9wIHRoZSB2cmluZ2ggcGF0Y2gKPiAtIG1hdGNoIHRoZSBkb2MgdG8gdGhl IGNvZGUKPiAtIHR3ZWFrIHRoZSBjb21taXQgbG9nCj4gLSBtb3ZlIGRldmljZV9vcHMgZnJvbSBw YXJlbnQgdG8gbWRldiBkZXZpY2UKPiAtIHJlbW92ZSB0aGUgdW51c2VkIE1ERVZfSURfVkhPU1QK PiAKPiBDaGFuZ2VzIGZyb20gVjE6Cj4gLSBtb3ZlIHZpcnRpb19tZGV2LmMgdG8gZHJpdmVycy92 aXJ0aW8KPiAtIHN0b3JlIGNsYXNzX2lkIGluIG1kZXZfZGV2aWNlIGluc3RlYWQgb2YgbWRldl9w YXJlbnQKPiAtIHN0b3JlIGRldmljZV9vcHMgaW4gbWRldl9kZXZpY2UgaW5zdGVhZCBvZiBtZGV2 X3BhcmVudAo+IC0gcmVvcmRlciB0aGUgcGF0Y2gsIHZyaW5naCBmaXggY29tZXMgZmlyc3QKPiAt IHJlYWxseSBzaWxlbnQgY29tcGlsaW5nIHdhcm5pbmdzCj4gLSByZWFsbHkgc3dpdGNoIHRvIHVz ZSB1MTYgZm9yIGNsYXNzX2lkCj4gLSB1ZXZlbnQgYW5kIG1vZHBvc3Qgc3VwcG9ydCBmb3IgbWRl diBjbGFzc19pZAo+IC0gdnJhaW91cyB0d2Vha3MgcGVyIGNvbW1lbnRzIGZyb20gUGFyYXYKPiAK PiBDaGFuZ2VzIGZyb20gUkZDLVYyOgo+IC0gc2lsZW50IGNvbXBpbGUgd2FybmluZ3Mgb24gc29t ZSBzcGVjaWZpYyBjb25maWd1cmF0aW9uCj4gLSB1c2UgdTE2IGluc3RlYWQgdTggZm9yIGNsYXNz IGlkCj4gLSByZXNldmUgTURFVl9JRF9WSE9TVCBmb3IgZnV0dXJlIHZob3N0LW1kZXYgd29yawo+ IC0gaW50cm9kdWNlICJ2aXJ0aW8iIHR5cGUgZm9yIG12bmV0IGFuZCBtYWtlICJ2aG9zdCIgdHlw ZSBmb3IgZnV0dXJlCj4gICB3b3JrCj4gLSBhZGQgZW50cmllcyBpbiBNQUlOVEFJTkVSCj4gLSB0 d2VhayBhbmQgdHlwb3MgZml4ZXMgaW4gY29tbWl0IGxvZwo+IAo+IENoYW5nZXMgZnJvbSBSRkMt VjE6Cj4gLSByZW5hbWUgZGV2aWNlIGlkIHRvIGNsYXNzIGlkCj4gLSBhZGQgZG9jcyBmb3IgY2xh c3MgaWQgYW5kIGRldmljZSBzcGVjaWZpYyBvcHMgKGRldmljZV9vcHMpCj4gLSBzcGxpdCBkZXZp Y2Vfb3BzIGludG8gc2VwZXJhdGUgaGVhZGVycwo+IC0gZHJvcCB0aGUgbWRldl9zZXRfZG1hX29w cygpCj4gLSB1c2UgZGV2aWNlX29wcyB0byBpbXBsZW1lbnQgdGhlIHRyYW5zcG9ydCBBUEksIHRo ZW4gaXQncyBub3QgYSBwYXJ0Cj4gICBvZiBVQVBJIGFueSBtb3JlCj4gLSB1c2UgR0ZQX0FUT01J QyBpbiBtdm5ldCBzYW1wbGUgZGV2aWNlIGFuZCBvdGhlciB0d2Vha3MKPiAtIHNldF92cmluZ19i YXNlL2dldF92cmluZ19iYXNlIHN1cHBvcnQgZm9yIG12bmV0IGRldmljZQo+IAo+IEphc29uIFdh bmcgKDYpOgo+ICAgbWRldjogY2xhc3MgaWQgc3VwcG9ydAo+ICAgbW9kcG9zdDogYWRkIHN1cHBv cnQgZm9yIG1kZXYgY2xhc3MgaWQKPiAgIG1kZXY6IGludHJvZHVjZSBkZXZpY2Ugc3BlY2lmaWMg b3BzCj4gICBtZGV2OiBpbnRyb2R1Y2UgdmlydGlvIGRldmljZSBhbmQgaXRzIGRldmljZSBvcHMK PiAgIHZpcnRpbzogaW50cm9kdWNlIGEgbWRldiBiYXNlZCB0cmFuc3BvcnQKPiAgIGRvY3M6IHNh bXBsZSBkcml2ZXIgdG8gZGVtb25zdHJhdGUgaG93IHRvIGltcGxlbWVudCB2aXJ0aW8tbWRldgo+ ICAgICBmcmFtZXdvcmsKPiAKPiAgLi4uL2RyaXZlci1hcGkvdmZpby1tZWRpYXRlZC1kZXZpY2Uu cnN0ICAgICAgIHwgIDM4ICstCj4gIE1BSU5UQUlORVJTICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICB8ICAgMyArCj4gIGRyaXZlcnMvZ3B1L2RybS9pOTE1L2d2dC9rdm1ndC5jICAg ICAgICAgICAgICB8ICAxNyArLQo+ICBkcml2ZXJzL3MzOTAvY2lvL3ZmaW9fY2N3X29wcy5jICAg ICAgICAgICAgICAgfCAgMTcgKy0KPiAgZHJpdmVycy9zMzkwL2NyeXB0by92ZmlvX2FwX29wcy5j ICAgICAgICAgICAgIHwgIDEzICstCj4gIGRyaXZlcnMvdmZpby9tZGV2L21kZXZfY29yZS5jICAg ICAgICAgICAgICAgICB8ICA2MCArKwo+ICBkcml2ZXJzL3ZmaW8vbWRldi9tZGV2X2RyaXZlci5j ICAgICAgICAgICAgICAgfCAgMjUgKwo+ICBkcml2ZXJzL3ZmaW8vbWRldi9tZGV2X3ByaXZhdGUu aCAgICAgICAgICAgICAgfCAgIDggKwo+ICBkcml2ZXJzL3ZmaW8vbWRldi92ZmlvX21kZXYuYyAg ICAgICAgICAgICAgICAgfCAgNDUgKy0KPiAgZHJpdmVycy92aXJ0aW8vS2NvbmZpZyAgICAgICAg ICAgICAgICAgICAgICAgIHwgIDEzICsKPiAgZHJpdmVycy92aXJ0aW8vTWFrZWZpbGUgICAgICAg ICAgICAgICAgICAgICAgIHwgICAxICsKPiAgZHJpdmVycy92aXJ0aW8vdmlydGlvX21kZXYuYyAg ICAgICAgICAgICAgICAgIHwgNDA2ICsrKysrKysrKysrCj4gIGluY2x1ZGUvbGludXgvbWRldi5o ICAgICAgICAgICAgICAgICAgICAgICAgICB8ICA1NyArLQo+ICBpbmNsdWRlL2xpbnV4L21kZXZf dmZpb19vcHMuaCAgICAgICAgICAgICAgICAgfCAgNTIgKysKPiAgaW5jbHVkZS9saW51eC9tZGV2 X3ZpcnRpb19vcHMuaCAgICAgICAgICAgICAgIHwgMTQ3ICsrKysKPiAgaW5jbHVkZS9saW51eC9t b2RfZGV2aWNldGFibGUuaCAgICAgICAgICAgICAgIHwgICA4ICsKPiAgc2FtcGxlcy9LY29uZmln ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHwgIDEwICsKPiAgc2FtcGxlcy92ZmlvLW1k ZXYvTWFrZWZpbGUgICAgICAgICAgICAgICAgICAgIHwgICAxICsKPiAgc2FtcGxlcy92ZmlvLW1k ZXYvbWJvY2hzLmMgICAgICAgICAgICAgICAgICAgIHwgIDE5ICstCj4gIHNhbXBsZXMvdmZpby1t ZGV2L21kcHkuYyAgICAgICAgICAgICAgICAgICAgICB8ICAxOSArLQo+ICBzYW1wbGVzL3ZmaW8t bWRldi9tdHR5LmMgICAgICAgICAgICAgICAgICAgICAgfCAgMTcgKy0KPiAgc2FtcGxlcy92Zmlv LW1kZXYvbXZuZXRfbG9vcGJhY2suYyAgICAgICAgICAgIHwgNjg3ICsrKysrKysrKysrKysrKysr Kwo+ICBzY3JpcHRzL21vZC9kZXZpY2V0YWJsZS1vZmZzZXRzLmMgICAgICAgICAgICAgfCAgIDMg Kwo+ICBzY3JpcHRzL21vZC9maWxlMmFsaWFzLmMgICAgICAgICAgICAgICAgICAgICAgfCAgMTEg Kwo+ICAyNCBmaWxlcyBjaGFuZ2VkLCAxNTg2IGluc2VydGlvbnMoKyksIDkxIGRlbGV0aW9ucygt KQo+ICBjcmVhdGUgbW9kZSAxMDA2NDQgZHJpdmVycy92aXJ0aW8vdmlydGlvX21kZXYuYwo+ICBj cmVhdGUgbW9kZSAxMDA2NDQgaW5jbHVkZS9saW51eC9tZGV2X3ZmaW9fb3BzLmgKPiAgY3JlYXRl IG1vZGUgMTAwNjQ0IGluY2x1ZGUvbGludXgvbWRldl92aXJ0aW9fb3BzLmgKPiAgY3JlYXRlIG1v ZGUgMTAwNjQ0IHNhbXBsZXMvdmZpby1tZGV2L212bmV0X2xvb3BiYWNrLmMKPiAKPiAtLSAKPiAy LjE5LjEKX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KSW50 ZWwtZ2Z4IG1haWxpbmcgbGlzdApJbnRlbC1nZnhAbGlzdHMuZnJlZWRlc2t0b3Aub3JnCmh0dHBz Oi8vbGlzdHMuZnJlZWRlc2t0b3Aub3JnL21haWxtYW4vbGlzdGluZm8vaW50ZWwtZ2Z4