From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-11.0 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 61666C433DB for ; Fri, 26 Mar 2021 15:26:35 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 1D15461A27 for ; Fri, 26 Mar 2021 15:26:35 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230080AbhCZP0C (ORCPT ); Fri, 26 Mar 2021 11:26:02 -0400 Received: from us-smtp-delivery-124.mimecast.com ([216.205.24.124]:54148 "EHLO us-smtp-delivery-124.mimecast.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230006AbhCZPZh (ORCPT ); Fri, 26 Mar 2021 11:25:37 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1616772336; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=37VsQPkd1CRxQEzWgbjMXquIk/ZMfXcaeWuLViJebko=; b=D/uZUBj0ZsroTRpq293SOerTbdrWDffYqAJ67JIxsy5COyR6uomIa5PMWEpxy6j7/rTNJG 1qudQaeTZg8kZ9uz/Q6NQSVvkLwTj1IcRSjQ17HALqCz+oONbEaH467QBX6b27qWQ5noKk 1ELMX9cUV9TuI8ndy1V+M6ASG+kJQoo= Received: from mail-ed1-f72.google.com (mail-ed1-f72.google.com [209.85.208.72]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-587-mWn2dXLHOK-4Z1AqEjDXog-1; Fri, 26 Mar 2021 11:25:31 -0400 X-MC-Unique: mWn2dXLHOK-4Z1AqEjDXog-1 Received: by mail-ed1-f72.google.com with SMTP id p6so4572810edq.21 for ; Fri, 26 Mar 2021 08:25:31 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:in-reply-to:references:date :message-id:mime-version:content-transfer-encoding; bh=37VsQPkd1CRxQEzWgbjMXquIk/ZMfXcaeWuLViJebko=; b=VpyqzH0drzF+RLOLAfwDlI3FyghiRGxwVSlG8Pm3KxN7PtHl+t293yjOzhOFnpe8tf AWc0UeW0GMZptcYUrj+69fxe+g+5v33S1PG3f8e3Gv+W7dm5MBG4VNQHf3kbaUQcy8fe XbFT2Sgv2YnxnaAH4mDsviYXCJa0T7aJ6CZbKiANpeSu1njYCSKlJbLMQeYlqrfuGNKt +9ajaPkfq98JjH0IJv1EXJDfJbwyt4BHt/lyXKCoZ/HApaizGDawSYRVDYO7HtTd8jBI qbtk034p1x5sdANWZlOrpT4xcJcb2h8pjIihVoe9C9qgXt4rXZHvdE/0NVmAlLLMr6zR zqgQ== X-Gm-Message-State: AOAM530fxpvVfVjat/x6kh8w2e/NQQhbMqVsrwZG++JcP9Ou/CaJB3JL L8i6qPNbpdJ3ez9QZn2juq2QA312yEZm21ts1hOwPshjNabyWhSbc30ZXV66zvts0hxaXXFCrZ5 kRNAGwhpXJMjJVjpviq0e X-Received: by 2002:a05:6402:c8:: with SMTP id i8mr15942012edu.57.1616772330261; Fri, 26 Mar 2021 08:25:30 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwnaSBLkcRDiOGM09F3pM/JyZ4ts8zUfX4ETFaa8p0imYuyky/XGZDtF86QENJnVw9u1n/TSg== X-Received: by 2002:a05:6402:c8:: with SMTP id i8mr15941993edu.57.1616772330075; Fri, 26 Mar 2021 08:25:30 -0700 (PDT) Received: from alrua-x1.borgediget.toke.dk ([45.145.92.2]) by smtp.gmail.com with ESMTPSA id 90sm4654053edr.69.2021.03.26.08.25.29 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 26 Mar 2021 08:25:29 -0700 (PDT) Received: by alrua-x1.borgediget.toke.dk (Postfix, from userid 1000) id DE18D1801A3; Fri, 26 Mar 2021 16:25:27 +0100 (CET) From: Toke =?utf-8?Q?H=C3=B8iland-J=C3=B8rgensen?= To: Pali =?utf-8?Q?Roh=C3=A1r?= Cc: vtolkm@gmail.com, Bjorn Helgaas , linux-pci@vger.kernel.org, linux-arm-kernel@lists.infradead.org, Rob Herring , Ilias Apalodimas , Marek =?utf-8?Q?Beh=C3=BAn?= , Thomas Petazzoni Subject: Re: PCI trouble on mvebu (Turris Omnia) In-Reply-To: <20210326125028.tyqkcc5fvaqbwqkn@pali> References: <87k0v7n9y9.fsf@toke.dk> <20201030142337.yushrdcuecycfhcu@pali> <87zh42lfv6.fsf@toke.dk> <20201102152403.4jlmcaqkqeivuypm@pali> <877dr3lpok.fsf@toke.dk> <20210315195806.iqdt5wvvkvpmnep7@pali> <20210316092534.czuondwbg3tqjs6w@pali> <87h7l8axqp.fsf@toke.dk> <20210318231629.vhix2cqpt25bgrne@pali> <20210326125028.tyqkcc5fvaqbwqkn@pali> X-Clacks-Overhead: GNU Terry Pratchett Date: Fri, 26 Mar 2021 16:25:27 +0100 Message-ID: <874kgyc4yg.fsf@toke.dk> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Precedence: bulk List-ID: X-Mailing-List: linux-pci@vger.kernel.org Pali Roh=C3=A1r writes: > On Friday 19 March 2021 00:16:29 Pali Roh=C3=A1r wrote: >> On Thursday 18 March 2021 23:43:58 Toke H=C3=B8iland-J=C3=B8rgensen wrot= e: >> > Pali Roh=C3=A1r writes: >> >=20 >> > > On Monday 15 March 2021 20:58:06 Pali Roh=C3=A1r wrote: >> > >> On Monday 02 November 2020 16:54:35 Toke H=C3=B8iland-J=C3=B8rgense= n wrote: >> > >> > Pali Roh=C3=A1r writes: >> > >> >=20 >> > >> > > On Saturday 31 October 2020 13:49:49 Toke H=C3=B8iland-J=C3=B8r= gensen wrote: >> > >> > >> "=E2=84=A2=D6=9F=E2=98=BB=D2=87=CC=AD =D1=BC =D2=89 =C2=AE" writes: >> > >> > >>=20 >> > >> > >> > On 30/10/2020 15:23, Pali Roh=C3=A1r wrote: >> > >> > >> >> On Friday 30 October 2020 14:02:22 Toke H=C3=B8iland-J=C3= =B8rgensen wrote: >> > >> > >> >>> Pali Roh=C3=A1r writes: >> > >> > >> >>>> My experience with that WLE900VX card, aardvark driver an= d aspm code: >> > >> > >> >>>> >> > >> > >> >>>> Link training in GEN2 mode for this card succeed only onc= e after reset. >> > >> > >> >>>> Repeated link retraining fails and it fails even when aar= dvark is >> > >> > >> >>>> reconfigured to GEN1 mode. Reset via PERST# signal is req= uired to have >> > >> > >> >>>> working link training. >> > >> > >> >>>> >> > >> > >> >>>> What I did in aardvark driver: Set mode to GEN2, do link = training. If >> > >> > >> >>>> success read "negotiated link speed" from "Link Control S= tatus Register" >> > >> > >> >>>> (for WLE900VX it is 0x1 - GEN1) and set it into aardvark.= And then >> > >> > >> >>>> retrain link again (for WLE900VX now it would be at GEN1)= . After that >> > >> > >> >>>> card is stable and all future retraining (e.g. from aspm.= c) also passes. >> > >> > >> >>>> >> > >> > >> >>>> If I do not change aardvark mode from GEN2 to GEN1 the se= cond link >> > >> > >> >>>> training fails. And if I change mode to GEN1 after this f= ailed link >> > >> > >> >>>> training then nothing happen, link training do not succes= s. >> > >> > >> >>>> >> > >> > >> >>>> So just speculation now... In current setup initializatio= n of card does >> > >> > >> >>>> one link training at GEN2. Then aspm.c is called which is= doing second >> > >> > >> >>>> link retraining at GEN2. And if it fails then below patch= issue third >> > >> > >> >>>> link retraining at GEN1. If A38x/pci-mvebu has same probl= em as aardvark >> > >> > >> >>>> then second link retraining must be at GEN1 (not GEN2) to= workaround >> > >> > >> >>>> this issue. >> > >> > >> >>>> >> > >> > >> >>>> Bjorn, Toke: what about trying to hack aspm.c code to nev= er do link >> > >> > >> >>>> retraining at GEN2 speed? And always force GEN1 speed pri= or link >> > >> > >> >>>> training? >> > >> > >> >>> Sounds like a plan. I poked around in aspm.c and must conf= ess to being a >> > >> > >> >>> bit lost in the soup of registers ;) >> > >> > >> >>> >> > >> > >> >>> So if one of you can cook up a patch, that would be most h= elpful! >> > >> > >> >> I modified Bjorn's patch, explicitly set tls to 1 and added= debug info >> > >> > >> >> about cls (current link speed, that what is used by aardvar= k). It is >> > >> > >> >> untested, I just tried to compile it. >> > >> > >> >> >> > >> > >> >> Can try it? >> > >> > >> >> >> > >> > >> >> diff --git a/drivers/pci/pcie/aspm.c b/drivers/pci/pcie/asp= m.c >> > >> > >> >> index 253c30cc1967..f934c0b52f41 100644 >> > >> > >> >> --- a/drivers/pci/pcie/aspm.c >> > >> > >> >> +++ b/drivers/pci/pcie/aspm.c >> > >> > >> >> @@ -206,6 +206,27 @@ static bool pcie_retrain_link(struct p= cie_link_state *link) >> > >> > >> >> unsigned long end_jiffies; >> > >> > >> >> u16 reg16; >> > >> > >> >>=20=20=20 >> > >> > >> >> + u32 lnkcap2; >> > >> > >> >> + u16 lnksta, lnkctl2, cls, tls; >> > >> > >> >> + >> > >> > >> >> + pcie_capability_read_dword(parent, PCI_EXP_LNKCAP2, &lnkc= ap2); >> > >> > >> >> + pcie_capability_read_word(parent, PCI_EXP_LNKSTA, &lnksta= ); >> > >> > >> >> + pcie_capability_read_word(parent, PCI_EXP_LNKCTL2, &lnkct= l2); >> > >> > >> >> + cls =3D lnksta & PCI_EXP_LNKSTA_CLS; >> > >> > >> >> + tls =3D lnkctl2 & PCI_EXP_LNKCTL2_TLS; >> > >> > >> >> + >> > >> > >> >> + pci_info(parent, "lnkcap2 %#010x sls %#04x lnksta %#06x c= ls %#03x lnkctl2 %#06x tls %#03x\n", >> > >> > >> >> + lnkcap2, (lnkcap2 & 0x3F) >> 1, >> > >> > >> >> + lnksta, cls, >> > >> > >> >> + lnkctl2, tls); >> > >> > >> >> + >> > >> > >> >> + tls =3D 1; >> > >> > >> >> + pcie_capability_clear_and_set_word(parent, PCI_EXP_LNKCTL= 2, >> > >> > >> >> + PCI_EXP_LNKCTL2_TLS, tls); >> > >> > >> >> + pcie_capability_read_word(parent, PCI_EXP_LNKCTL2, &lnkct= l2); >> > >> > >> >> + pci_info(parent, "lnkctl2 %#010x new tls %#03x\n", >> > >> > >> >> + lnkctl2, tls); >> > >> > >> >> + >> > >> > >> >> pcie_capability_read_word(parent, PCI_EXP_LNKCTL, ®16= ); >> > >> > >> >> reg16 |=3D PCI_EXP_LNKCTL_RL; >> > >> > >> >> pcie_capability_write_word(parent, PCI_EXP_LNKCTL, reg16= ); >> > >> > >> >> @@ -227,6 +248,8 @@ static bool pcie_retrain_link(struct pc= ie_link_state *link) >> > >> > >> >> break; >> > >> > >> >> msleep(1); >> > >> > >> >> } while (time_before(jiffies, end_jiffies)); >> > >> > >> >> + pci_info(parent, "lnksta %#06x new cls %#03x\n", >> > >> > >> >> + lnksta, (cls & PCI_EXP_LNKSTA_CLS)); >> > >> > >> >> return !(reg16 & PCI_EXP_LNKSTA_LT); >> > >> > >> >> } >> > >> > >> >>=20=20=20 >> > >> > >> > >> > >> > >> > Still exhibiting the BAR update error, run tested with next-= -20201030 >> > >> > >>=20 >> > >> > >> Yup, same for me :( >> > >>=20 >> > >> I'm answering my own question. This code does not work on Omnia bec= ause >> > >> A38x pci-mvebu.c driver is using emulator for PCIe root bridge and = it >> > >> does not implement PCI_EXP_LNKCTL2 and PCI_EXP_LNKCTL2 registers. So >> > >> code for forcing link speed has no effect on Omnia... >> > > >> > > Toke, on A38x PCIe controller it is possible to access PCI_EXP_LNKCT= L2 >> > > register. Just access is not exported via emulated root bridge. >> > > >> > > Documentation for this PCIe controller is public, so anybody can loo= k at >> > > register description. See page 571, A.7 PCI Express 2.0 Port 0 Regis= ters >> > > >> > > http://web.archive.org/web/20200420191927/https://www.marvell.com/co= ntent/dam/marvell/en/public-collateral/embedded-processors/marvell-embedded= -processors-armada-38x-functional-specifications-2015-11.pdf >> > > >> > > In drivers/pci/controller/pci-mvebu.c you can set a new value for th= is >> > > register via function call: >> > > >> > > mvebu_writel(port, val, PCIE_CAP_PCIEXP + PCI_EXP_LNKCTL2); >> > > >> > > So, could you try to set PCI_EXP_LNKCTL2_TLS bits to gen1 in some hw >> > > init function, e.g. mvebu_pcie_setup_hw()? >> > > >> > > u32 val =3D mvebu_readl(port, PCIE_CAP_PCIEXP + PCI_EXP_LNKCTL2); >> > > val &=3D ~PCI_EXP_LNKCTL2_TLS; >> > > val |=3D PCI_EXP_LNKCTL2_TLS_2_5GT; >> > > mvebu_writel(port, val, PCIE_CAP_PCIEXP + PCI_EXP_LNKCTL2); >> >=20 >> > I pasted this into the top of mvebu_pcie_setup_hw(), and that indeed >> > seems to fix things so that all three PCIE devices work even with ASPM >> > turned on! :) >>=20 >> Perfect! Now I'm sure that it is same issue as in aardvark driver. >>=20 >> I will prepare patches for both pci-aardvark.c and pci-mvebu.c to export >> PCI_EXP_LNKCTL2 register via emulated bridge. And so aspm.c code would >> be able to use Bjorn or my patch which I have sent last year. >>=20 >> Question reminds, if this is issue with QCA wifi chip on that Compex >> card or it is issue with PCIe controllers, now on A38x and A3720 SoC. >> Note that both A38x and A3720 platforms are from Marvell, but they have >> different PCIe controllers (so it does not mean that both must have same >> hw bugs). > > Seems that this is really issue in QCA98xx chips. I have send patch > which adds quirk for these wifi chips: > > https://lore.kernel.org/linux-pci/20210326124326.21163-1-pali@kernel.org/ I tried applying that, and while it does fix the ath10k card, it seems to break the ath9k card in the slot next to it. When booting with the patch applied, I get this in dmesg: [ 3.556599] ath: phy0: Mac Chip Rev 0xfffc0.f is not supported by this d= river Could there be some kind of data corruption in play here making the driver think the chip revision is wrong, or something like that? If I boot the same kernel without the patch applied, the ath9k initialisation works fine, but obviously the ath10k is then still broken... -Toke From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-9.0 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id E7399C433C1 for ; Fri, 26 Mar 2021 15:27:19 +0000 (UTC) Received: from desiato.infradead.org (desiato.infradead.org [90.155.92.199]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 4293461A1A for ; Fri, 26 Mar 2021 15:27:19 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 4293461A1A Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=redhat.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=desiato.20200630; h=Sender:Content-Transfer-Encoding :Content-Type:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:MIME-Version:Message-ID:Date:References:In-Reply-To: Subject:Cc:To:From:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=FsqWryORPiGoisZZQIsqknKv0fFacbdqi2KE91MfuMs=; b=IUSYnM9+ROaJ0nx5U6IC+svZD cK7caoSu0DAh+Q0EYIFohuhjDquqHjFMVmUSIo5d/Eaig9YRi29XhIwn2AaxLmvKrXTMa9s5L13TM /V4omMcUi658VSG/r8De58w6/+8+nRj+apzppQKgkTNeEY7VQkT22w/9K9P3jYm7l2EhsS1iUmlG+ n5/5KWugjINAzDOkKrAQamLMnmcGOzRADn0A/rbCfrSwCslfLA8CGXQjRICumnZXrsLEFU8KtdgK9 /hR4efZL36WP3HLDtOLC0BS5xHfYzgAEp9u4ynyAE+m4E4gniQZQNQ3AzCFENOKKA834c7vPIUlDP QY3iiuoVA==; Received: from localhost ([::1] helo=desiato.infradead.org) by desiato.infradead.org with esmtp (Exim 4.94 #2 (Red Hat Linux)) id 1lPoLJ-003sm4-Uo; Fri, 26 Mar 2021 15:25:46 +0000 Received: from us-smtp-delivery-124.mimecast.com ([216.205.24.124]) by desiato.infradead.org with esmtps (Exim 4.94 #2 (Red Hat Linux)) id 1lPoLC-003sl3-Mv for linux-arm-kernel@lists.infradead.org; Fri, 26 Mar 2021 15:25:43 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1616772334; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=nvkT3Y6Mvrl10d51PtSbmeI+x1PjP/45fm4I6POmVQA=; b=S+CqcTRNdQqTBpgwSMBrtf9RxLjYTybepFr0HWntBjZDMDIjmry+oCHq0n5FBRiB2AbR90 vw5jgesCPTNwzQBp7mG4N7fCANGluUNbkhmv4sZoLsyJsr9LKL/FBk6V7gRBg7Tae2pFvU Io5XvjF/yUfhEGJmhNlmLgwFUSSHOzI= Received: from mail-ed1-f69.google.com (mail-ed1-f69.google.com [209.85.208.69]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-447-2sIF7Ba4Mdy1Tizzmpw7Vg-1; Fri, 26 Mar 2021 11:25:31 -0400 X-MC-Unique: 2sIF7Ba4Mdy1Tizzmpw7Vg-1 Received: by mail-ed1-f69.google.com with SMTP id q12so4594029edv.9 for ; Fri, 26 Mar 2021 08:25:31 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:in-reply-to:references:date :message-id:mime-version:content-transfer-encoding; bh=37VsQPkd1CRxQEzWgbjMXquIk/ZMfXcaeWuLViJebko=; b=nkKsbvR8mCGoP8PQ0GQNlVnyMSieabd84Y5pqSqfzu+1Gugs5GMTg2h8KaDpccfboE k9RPTidEcURLXtfQDw9kwOOJMYDLuFwGJwblMlP/O1mHL84WNvOMN4ZU26CpDDvcwkI4 A+5iEFOOQ2u6I09thMTWNVv8TD0ckzOujpMQxJuhG7QJt8W9FWVQyXmoAPTvYceR3KTJ HyBGD4urKa4atDaUjywWPN0rvw4v69aEPkReGOTm+5UBIRqDo7/ti2bNufMRfdAcU3hJ VhkcvZkg+k2rxbsH8O9vZXPCMFMXkkpIgShWrAR0QIbSGg2rLvn2j9+pIpx1JTevyI3S ZbAA== X-Gm-Message-State: AOAM532lgdctCBR1aPFn/k5GHhYuqdmRnTXenHZnwlObtGMwhSoJl3K3 vSQoijb++/BZVOkmhJqKvB69AF7U1TelmbIpFTPcsguYaZBRPQxOMbn1hUJwIqS3BytZ/wvt3y9 CCa6AVe0yOLCkLwxbn6laacgJuDnI6yhn/yA= X-Received: by 2002:a05:6402:c8:: with SMTP id i8mr15942011edu.57.1616772330261; Fri, 26 Mar 2021 08:25:30 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwnaSBLkcRDiOGM09F3pM/JyZ4ts8zUfX4ETFaa8p0imYuyky/XGZDtF86QENJnVw9u1n/TSg== X-Received: by 2002:a05:6402:c8:: with SMTP id i8mr15941993edu.57.1616772330075; Fri, 26 Mar 2021 08:25:30 -0700 (PDT) Received: from alrua-x1.borgediget.toke.dk ([45.145.92.2]) by smtp.gmail.com with ESMTPSA id 90sm4654053edr.69.2021.03.26.08.25.29 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 26 Mar 2021 08:25:29 -0700 (PDT) Received: by alrua-x1.borgediget.toke.dk (Postfix, from userid 1000) id DE18D1801A3; Fri, 26 Mar 2021 16:25:27 +0100 (CET) From: Toke =?utf-8?Q?H=C3=B8iland-J=C3=B8rgensen?= To: Pali =?utf-8?Q?Roh=C3=A1r?= Cc: vtolkm@gmail.com, Bjorn Helgaas , linux-pci@vger.kernel.org, linux-arm-kernel@lists.infradead.org, Rob Herring , Ilias Apalodimas , Marek =?utf-8?Q?Beh=C3=BAn?= , Thomas Petazzoni Subject: Re: PCI trouble on mvebu (Turris Omnia) In-Reply-To: <20210326125028.tyqkcc5fvaqbwqkn@pali> References: <87k0v7n9y9.fsf@toke.dk> <20201030142337.yushrdcuecycfhcu@pali> <87zh42lfv6.fsf@toke.dk> <20201102152403.4jlmcaqkqeivuypm@pali> <877dr3lpok.fsf@toke.dk> <20210315195806.iqdt5wvvkvpmnep7@pali> <20210316092534.czuondwbg3tqjs6w@pali> <87h7l8axqp.fsf@toke.dk> <20210318231629.vhix2cqpt25bgrne@pali> <20210326125028.tyqkcc5fvaqbwqkn@pali> X-Clacks-Overhead: GNU Terry Pratchett Date: Fri, 26 Mar 2021 16:25:27 +0100 Message-ID: <874kgyc4yg.fsf@toke.dk> MIME-Version: 1.0 Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=toke@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20210326_152539_020439_98117ED5 X-CRM114-Status: GOOD ( 43.34 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org UGFsaSBSb2jDoXIgPHBhbGlAa2VybmVsLm9yZz4gd3JpdGVzOgoKPiBPbiBGcmlkYXkgMTkgTWFy Y2ggMjAyMSAwMDoxNjoyOSBQYWxpIFJvaMOhciB3cm90ZToKPj4gT24gVGh1cnNkYXkgMTggTWFy Y2ggMjAyMSAyMzo0Mzo1OCBUb2tlIEjDuGlsYW5kLUrDuHJnZW5zZW4gd3JvdGU6Cj4+ID4gUGFs aSBSb2jDoXIgPHBhbGlAa2VybmVsLm9yZz4gd3JpdGVzOgo+PiA+IAo+PiA+ID4gT24gTW9uZGF5 IDE1IE1hcmNoIDIwMjEgMjA6NTg6MDYgUGFsaSBSb2jDoXIgd3JvdGU6Cj4+ID4gPj4gT24gTW9u ZGF5IDAyIE5vdmVtYmVyIDIwMjAgMTY6NTQ6MzUgVG9rZSBIw7hpbGFuZC1Kw7hyZ2Vuc2VuIHdy b3RlOgo+PiA+ID4+ID4gUGFsaSBSb2jDoXIgPHBhbGlAa2VybmVsLm9yZz4gd3JpdGVzOgo+PiA+ ID4+ID4gCj4+ID4gPj4gPiA+IE9uIFNhdHVyZGF5IDMxIE9jdG9iZXIgMjAyMCAxMzo0OTo0OSBU b2tlIEjDuGlsYW5kLUrDuHJnZW5zZW4gd3JvdGU6Cj4+ID4gPj4gPiA+PiAi4oSi1p/imLvSh8yt ING8INKJIMKuIiA8dnRvbGttQGdvb2dsZW1haWwuY29tPiB3cml0ZXM6Cj4+ID4gPj4gPiA+PiAK Pj4gPiA+PiA+ID4+ID4gT24gMzAvMTAvMjAyMCAxNToyMywgUGFsaSBSb2jDoXIgd3JvdGU6Cj4+ ID4gPj4gPiA+PiA+PiBPbiBGcmlkYXkgMzAgT2N0b2JlciAyMDIwIDE0OjAyOjIyIFRva2UgSMO4 aWxhbmQtSsO4cmdlbnNlbiB3cm90ZToKPj4gPiA+PiA+ID4+ID4+PiBQYWxpIFJvaMOhciA8cGFs aUBrZXJuZWwub3JnPiB3cml0ZXM6Cj4+ID4gPj4gPiA+PiA+Pj4+IE15IGV4cGVyaWVuY2Ugd2l0 aCB0aGF0IFdMRTkwMFZYIGNhcmQsIGFhcmR2YXJrIGRyaXZlciBhbmQgYXNwbSBjb2RlOgo+PiA+ ID4+ID4gPj4gPj4+Pgo+PiA+ID4+ID4gPj4gPj4+PiBMaW5rIHRyYWluaW5nIGluIEdFTjIgbW9k ZSBmb3IgdGhpcyBjYXJkIHN1Y2NlZWQgb25seSBvbmNlIGFmdGVyIHJlc2V0Lgo+PiA+ID4+ID4g Pj4gPj4+PiBSZXBlYXRlZCBsaW5rIHJldHJhaW5pbmcgZmFpbHMgYW5kIGl0IGZhaWxzIGV2ZW4g d2hlbiBhYXJkdmFyayBpcwo+PiA+ID4+ID4gPj4gPj4+PiByZWNvbmZpZ3VyZWQgdG8gR0VOMSBt b2RlLiBSZXNldCB2aWEgUEVSU1QjIHNpZ25hbCBpcyByZXF1aXJlZCB0byBoYXZlCj4+ID4gPj4g PiA+PiA+Pj4+IHdvcmtpbmcgbGluayB0cmFpbmluZy4KPj4gPiA+PiA+ID4+ID4+Pj4KPj4gPiA+ PiA+ID4+ID4+Pj4gV2hhdCBJIGRpZCBpbiBhYXJkdmFyayBkcml2ZXI6IFNldCBtb2RlIHRvIEdF TjIsIGRvIGxpbmsgdHJhaW5pbmcuIElmCj4+ID4gPj4gPiA+PiA+Pj4+IHN1Y2Nlc3MgcmVhZCAi bmVnb3RpYXRlZCBsaW5rIHNwZWVkIiBmcm9tICJMaW5rIENvbnRyb2wgU3RhdHVzIFJlZ2lzdGVy Igo+PiA+ID4+ID4gPj4gPj4+PiAoZm9yIFdMRTkwMFZYIGl0IGlzIDB4MSAtIEdFTjEpIGFuZCBz ZXQgaXQgaW50byBhYXJkdmFyay4gQW5kIHRoZW4KPj4gPiA+PiA+ID4+ID4+Pj4gcmV0cmFpbiBs aW5rIGFnYWluIChmb3IgV0xFOTAwVlggbm93IGl0IHdvdWxkIGJlIGF0IEdFTjEpLiBBZnRlciB0 aGF0Cj4+ID4gPj4gPiA+PiA+Pj4+IGNhcmQgaXMgc3RhYmxlIGFuZCBhbGwgZnV0dXJlIHJldHJh aW5pbmcgKGUuZy4gZnJvbSBhc3BtLmMpIGFsc28gcGFzc2VzLgo+PiA+ID4+ID4gPj4gPj4+Pgo+ PiA+ID4+ID4gPj4gPj4+PiBJZiBJIGRvIG5vdCBjaGFuZ2UgYWFyZHZhcmsgbW9kZSBmcm9tIEdF TjIgdG8gR0VOMSB0aGUgc2Vjb25kIGxpbmsKPj4gPiA+PiA+ID4+ID4+Pj4gdHJhaW5pbmcgZmFp bHMuIEFuZCBpZiBJIGNoYW5nZSBtb2RlIHRvIEdFTjEgYWZ0ZXIgdGhpcyBmYWlsZWQgbGluawo+ PiA+ID4+ID4gPj4gPj4+PiB0cmFpbmluZyB0aGVuIG5vdGhpbmcgaGFwcGVuLCBsaW5rIHRyYWlu aW5nIGRvIG5vdCBzdWNjZXNzLgo+PiA+ID4+ID4gPj4gPj4+Pgo+PiA+ID4+ID4gPj4gPj4+PiBT byBqdXN0IHNwZWN1bGF0aW9uIG5vdy4uLiBJbiBjdXJyZW50IHNldHVwIGluaXRpYWxpemF0aW9u IG9mIGNhcmQgZG9lcwo+PiA+ID4+ID4gPj4gPj4+PiBvbmUgbGluayB0cmFpbmluZyBhdCBHRU4y LiBUaGVuIGFzcG0uYyBpcyBjYWxsZWQgd2hpY2ggaXMgZG9pbmcgc2Vjb25kCj4+ID4gPj4gPiA+ PiA+Pj4+IGxpbmsgcmV0cmFpbmluZyBhdCBHRU4yLiBBbmQgaWYgaXQgZmFpbHMgdGhlbiBiZWxv dyBwYXRjaCBpc3N1ZSB0aGlyZAo+PiA+ID4+ID4gPj4gPj4+PiBsaW5rIHJldHJhaW5pbmcgYXQg R0VOMS4gSWYgQTM4eC9wY2ktbXZlYnUgaGFzIHNhbWUgcHJvYmxlbSBhcyBhYXJkdmFyawo+PiA+ ID4+ID4gPj4gPj4+PiB0aGVuIHNlY29uZCBsaW5rIHJldHJhaW5pbmcgbXVzdCBiZSBhdCBHRU4x IChub3QgR0VOMikgdG8gd29ya2Fyb3VuZAo+PiA+ID4+ID4gPj4gPj4+PiB0aGlzIGlzc3VlLgo+ PiA+ID4+ID4gPj4gPj4+Pgo+PiA+ID4+ID4gPj4gPj4+PiBCam9ybiwgVG9rZTogd2hhdCBhYm91 dCB0cnlpbmcgdG8gaGFjayBhc3BtLmMgY29kZSB0byBuZXZlciBkbyBsaW5rCj4+ID4gPj4gPiA+ PiA+Pj4+IHJldHJhaW5pbmcgYXQgR0VOMiBzcGVlZD8gQW5kIGFsd2F5cyBmb3JjZSBHRU4xIHNw ZWVkIHByaW9yIGxpbmsKPj4gPiA+PiA+ID4+ID4+Pj4gdHJhaW5pbmc/Cj4+ID4gPj4gPiA+PiA+ Pj4gU291bmRzIGxpa2UgYSBwbGFuLiBJIHBva2VkIGFyb3VuZCBpbiBhc3BtLmMgYW5kIG11c3Qg Y29uZmVzcyB0byBiZWluZyBhCj4+ID4gPj4gPiA+PiA+Pj4gYml0IGxvc3QgaW4gdGhlIHNvdXAg b2YgcmVnaXN0ZXJzIDspCj4+ID4gPj4gPiA+PiA+Pj4KPj4gPiA+PiA+ID4+ID4+PiBTbyBpZiBv bmUgb2YgeW91IGNhbiBjb29rIHVwIGEgcGF0Y2gsIHRoYXQgd291bGQgYmUgbW9zdCBoZWxwZnVs IQo+PiA+ID4+ID4gPj4gPj4gSSBtb2RpZmllZCBCam9ybidzIHBhdGNoLCBleHBsaWNpdGx5IHNl dCB0bHMgdG8gMSBhbmQgYWRkZWQgZGVidWcgaW5mbwo+PiA+ID4+ID4gPj4gPj4gYWJvdXQgY2xz IChjdXJyZW50IGxpbmsgc3BlZWQsIHRoYXQgd2hhdCBpcyB1c2VkIGJ5IGFhcmR2YXJrKS4gSXQg aXMKPj4gPiA+PiA+ID4+ID4+IHVudGVzdGVkLCBJIGp1c3QgdHJpZWQgdG8gY29tcGlsZSBpdC4K Pj4gPiA+PiA+ID4+ID4+Cj4+ID4gPj4gPiA+PiA+PiBDYW4gdHJ5IGl0Pwo+PiA+ID4+ID4gPj4g Pj4KPj4gPiA+PiA+ID4+ID4+IGRpZmYgLS1naXQgYS9kcml2ZXJzL3BjaS9wY2llL2FzcG0uYyBi L2RyaXZlcnMvcGNpL3BjaWUvYXNwbS5jCj4+ID4gPj4gPiA+PiA+PiBpbmRleCAyNTNjMzBjYzE5 NjcuLmY5MzRjMGI1MmY0MSAxMDA2NDQKPj4gPiA+PiA+ID4+ID4+IC0tLSBhL2RyaXZlcnMvcGNp L3BjaWUvYXNwbS5jCj4+ID4gPj4gPiA+PiA+PiArKysgYi9kcml2ZXJzL3BjaS9wY2llL2FzcG0u Ywo+PiA+ID4+ID4gPj4gPj4gQEAgLTIwNiw2ICsyMDYsMjcgQEAgc3RhdGljIGJvb2wgcGNpZV9y ZXRyYWluX2xpbmsoc3RydWN0IHBjaWVfbGlua19zdGF0ZSAqbGluaykKPj4gPiA+PiA+ID4+ID4+ ICAgCXVuc2lnbmVkIGxvbmcgZW5kX2ppZmZpZXM7Cj4+ID4gPj4gPiA+PiA+PiAgIAl1MTYgcmVn MTY7Cj4+ID4gPj4gPiA+PiA+PiAgIAo+PiA+ID4+ID4gPj4gPj4gKwl1MzIgbG5rY2FwMjsKPj4g PiA+PiA+ID4+ID4+ICsJdTE2IGxua3N0YSwgbG5rY3RsMiwgY2xzLCB0bHM7Cj4+ID4gPj4gPiA+ PiA+PiArCj4+ID4gPj4gPiA+PiA+PiArCXBjaWVfY2FwYWJpbGl0eV9yZWFkX2R3b3JkKHBhcmVu dCwgUENJX0VYUF9MTktDQVAyLCAmbG5rY2FwMik7Cj4+ID4gPj4gPiA+PiA+PiArCXBjaWVfY2Fw YWJpbGl0eV9yZWFkX3dvcmQocGFyZW50LCBQQ0lfRVhQX0xOS1NUQSwgJmxua3N0YSk7Cj4+ID4g Pj4gPiA+PiA+PiArCXBjaWVfY2FwYWJpbGl0eV9yZWFkX3dvcmQocGFyZW50LCBQQ0lfRVhQX0xO S0NUTDIsICZsbmtjdGwyKTsKPj4gPiA+PiA+ID4+ID4+ICsJY2xzID0gbG5rc3RhICYgUENJX0VY UF9MTktTVEFfQ0xTOwo+PiA+ID4+ID4gPj4gPj4gKwl0bHMgPSBsbmtjdGwyICYgUENJX0VYUF9M TktDVEwyX1RMUzsKPj4gPiA+PiA+ID4+ID4+ICsKPj4gPiA+PiA+ID4+ID4+ICsJcGNpX2luZm8o cGFyZW50LCAibG5rY2FwMiAlIzAxMHggc2xzICUjMDR4IGxua3N0YSAlIzA2eCBjbHMgJSMwM3gg bG5rY3RsMiAlIzA2eCB0bHMgJSMwM3hcbiIsCj4+ID4gPj4gPiA+PiA+PiArCQlsbmtjYXAyLCAo bG5rY2FwMiAmIDB4M0YpID4+IDEsCj4+ID4gPj4gPiA+PiA+PiArCQlsbmtzdGEsIGNscywKPj4g PiA+PiA+ID4+ID4+ICsJCWxua2N0bDIsIHRscyk7Cj4+ID4gPj4gPiA+PiA+PiArCj4+ID4gPj4g PiA+PiA+PiArCXRscyA9IDE7Cj4+ID4gPj4gPiA+PiA+PiArCXBjaWVfY2FwYWJpbGl0eV9jbGVh cl9hbmRfc2V0X3dvcmQocGFyZW50LCBQQ0lfRVhQX0xOS0NUTDIsCj4+ID4gPj4gPiA+PiA+PiAr CQkJCQlQQ0lfRVhQX0xOS0NUTDJfVExTLCB0bHMpOwo+PiA+ID4+ID4gPj4gPj4gKwlwY2llX2Nh cGFiaWxpdHlfcmVhZF93b3JkKHBhcmVudCwgUENJX0VYUF9MTktDVEwyLCAmbG5rY3RsMik7Cj4+ ID4gPj4gPiA+PiA+PiArCXBjaV9pbmZvKHBhcmVudCwgImxua2N0bDIgJSMwMTB4IG5ldyB0bHMg JSMwM3hcbiIsCj4+ID4gPj4gPiA+PiA+PiArCQlsbmtjdGwyLCB0bHMpOwo+PiA+ID4+ID4gPj4g Pj4gKwo+PiA+ID4+ID4gPj4gPj4gICAJcGNpZV9jYXBhYmlsaXR5X3JlYWRfd29yZChwYXJlbnQs IFBDSV9FWFBfTE5LQ1RMLCAmcmVnMTYpOwo+PiA+ID4+ID4gPj4gPj4gICAJcmVnMTYgfD0gUENJ X0VYUF9MTktDVExfUkw7Cj4+ID4gPj4gPiA+PiA+PiAgIAlwY2llX2NhcGFiaWxpdHlfd3JpdGVf d29yZChwYXJlbnQsIFBDSV9FWFBfTE5LQ1RMLCByZWcxNik7Cj4+ID4gPj4gPiA+PiA+PiBAQCAt MjI3LDYgKzI0OCw4IEBAIHN0YXRpYyBib29sIHBjaWVfcmV0cmFpbl9saW5rKHN0cnVjdCBwY2ll X2xpbmtfc3RhdGUgKmxpbmspCj4+ID4gPj4gPiA+PiA+PiAgIAkJCWJyZWFrOwo+PiA+ID4+ID4g Pj4gPj4gICAJCW1zbGVlcCgxKTsKPj4gPiA+PiA+ID4+ID4+ICAgCX0gd2hpbGUgKHRpbWVfYmVm b3JlKGppZmZpZXMsIGVuZF9qaWZmaWVzKSk7Cj4+ID4gPj4gPiA+PiA+PiArCXBjaV9pbmZvKHBh cmVudCwgImxua3N0YSAlIzA2eCBuZXcgY2xzICUjMDN4XG4iLAo+PiA+ID4+ID4gPj4gPj4gKwkJ bG5rc3RhLCAoY2xzICYgUENJX0VYUF9MTktTVEFfQ0xTKSk7Cj4+ID4gPj4gPiA+PiA+PiAgIAly ZXR1cm4gIShyZWcxNiAmIFBDSV9FWFBfTE5LU1RBX0xUKTsKPj4gPiA+PiA+ID4+ID4+ICAgfQo+ PiA+ID4+ID4gPj4gPj4gICAKPj4gPiA+PiA+ID4+ID4KPj4gPiA+PiA+ID4+ID4gU3RpbGwgZXho aWJpdGluZyB0aGUgQkFSIHVwZGF0ZSBlcnJvciwgcnVuIHRlc3RlZCB3aXRoIG5leHQtLTIwMjAx MDMwCj4+ID4gPj4gPiA+PiAKPj4gPiA+PiA+ID4+IFl1cCwgc2FtZSBmb3IgbWUgOigKPj4gPiA+ PiAKPj4gPiA+PiBJJ20gYW5zd2VyaW5nIG15IG93biBxdWVzdGlvbi4gVGhpcyBjb2RlIGRvZXMg bm90IHdvcmsgb24gT21uaWEgYmVjYXVzZQo+PiA+ID4+IEEzOHggcGNpLW12ZWJ1LmMgZHJpdmVy IGlzIHVzaW5nIGVtdWxhdG9yIGZvciBQQ0llIHJvb3QgYnJpZGdlIGFuZCBpdAo+PiA+ID4+IGRv ZXMgbm90IGltcGxlbWVudCBQQ0lfRVhQX0xOS0NUTDIgYW5kIFBDSV9FWFBfTE5LQ1RMMiByZWdp c3RlcnMuIFNvCj4+ID4gPj4gY29kZSBmb3IgZm9yY2luZyBsaW5rIHNwZWVkIGhhcyBubyBlZmZl Y3Qgb24gT21uaWEuLi4KPj4gPiA+Cj4+ID4gPiBUb2tlLCBvbiBBMzh4IFBDSWUgY29udHJvbGxl ciBpdCBpcyBwb3NzaWJsZSB0byBhY2Nlc3MgUENJX0VYUF9MTktDVEwyCj4+ID4gPiByZWdpc3Rl ci4gSnVzdCBhY2Nlc3MgaXMgbm90IGV4cG9ydGVkIHZpYSBlbXVsYXRlZCByb290IGJyaWRnZS4K Pj4gPiA+Cj4+ID4gPiBEb2N1bWVudGF0aW9uIGZvciB0aGlzIFBDSWUgY29udHJvbGxlciBpcyBw dWJsaWMsIHNvIGFueWJvZHkgY2FuIGxvb2sgYXQKPj4gPiA+IHJlZ2lzdGVyIGRlc2NyaXB0aW9u LiBTZWUgcGFnZSA1NzEsIEEuNyBQQ0kgRXhwcmVzcyAyLjAgUG9ydCAwIFJlZ2lzdGVycwo+PiA+ ID4KPj4gPiA+IGh0dHA6Ly93ZWIuYXJjaGl2ZS5vcmcvd2ViLzIwMjAwNDIwMTkxOTI3L2h0dHBz Oi8vd3d3Lm1hcnZlbGwuY29tL2NvbnRlbnQvZGFtL21hcnZlbGwvZW4vcHVibGljLWNvbGxhdGVy YWwvZW1iZWRkZWQtcHJvY2Vzc29ycy9tYXJ2ZWxsLWVtYmVkZGVkLXByb2Nlc3NvcnMtYXJtYWRh LTM4eC1mdW5jdGlvbmFsLXNwZWNpZmljYXRpb25zLTIwMTUtMTEucGRmCj4+ID4gPgo+PiA+ID4g SW4gZHJpdmVycy9wY2kvY29udHJvbGxlci9wY2ktbXZlYnUuYyB5b3UgY2FuIHNldCBhIG5ldyB2 YWx1ZSBmb3IgdGhpcwo+PiA+ID4gcmVnaXN0ZXIgdmlhIGZ1bmN0aW9uIGNhbGw6Cj4+ID4gPgo+ PiA+ID4gICAgIG12ZWJ1X3dyaXRlbChwb3J0LCB2YWwsIFBDSUVfQ0FQX1BDSUVYUCArIFBDSV9F WFBfTE5LQ1RMMik7Cj4+ID4gPgo+PiA+ID4gU28sIGNvdWxkIHlvdSB0cnkgdG8gc2V0IFBDSV9F WFBfTE5LQ1RMMl9UTFMgYml0cyB0byBnZW4xIGluIHNvbWUgaHcKPj4gPiA+IGluaXQgZnVuY3Rp b24sIGUuZy4gbXZlYnVfcGNpZV9zZXR1cF9odygpPwo+PiA+ID4KPj4gPiA+ICAgICB1MzIgdmFs ID0gbXZlYnVfcmVhZGwocG9ydCwgUENJRV9DQVBfUENJRVhQICsgUENJX0VYUF9MTktDVEwyKTsK Pj4gPiA+ICAgICB2YWwgJj0gflBDSV9FWFBfTE5LQ1RMMl9UTFM7Cj4+ID4gPiAgICAgdmFsIHw9 IFBDSV9FWFBfTE5LQ1RMMl9UTFNfMl81R1Q7Cj4+ID4gPiAgICAgbXZlYnVfd3JpdGVsKHBvcnQs IHZhbCwgUENJRV9DQVBfUENJRVhQICsgUENJX0VYUF9MTktDVEwyKTsKPj4gPiAKPj4gPiBJIHBh c3RlZCB0aGlzIGludG8gdGhlIHRvcCBvZiBtdmVidV9wY2llX3NldHVwX2h3KCksIGFuZCB0aGF0 IGluZGVlZAo+PiA+IHNlZW1zIHRvIGZpeCB0aGluZ3Mgc28gdGhhdCBhbGwgdGhyZWUgUENJRSBk ZXZpY2VzIHdvcmsgZXZlbiB3aXRoIEFTUE0KPj4gPiB0dXJuZWQgb24hIDopCj4+IAo+PiBQZXJm ZWN0ISBOb3cgSSdtIHN1cmUgdGhhdCBpdCBpcyBzYW1lIGlzc3VlIGFzIGluIGFhcmR2YXJrIGRy aXZlci4KPj4gCj4+IEkgd2lsbCBwcmVwYXJlIHBhdGNoZXMgZm9yIGJvdGggcGNpLWFhcmR2YXJr LmMgYW5kIHBjaS1tdmVidS5jIHRvIGV4cG9ydAo+PiBQQ0lfRVhQX0xOS0NUTDIgcmVnaXN0ZXIg dmlhIGVtdWxhdGVkIGJyaWRnZS4gQW5kIHNvIGFzcG0uYyBjb2RlIHdvdWxkCj4+IGJlIGFibGUg dG8gdXNlIEJqb3JuIG9yIG15IHBhdGNoIHdoaWNoIEkgaGF2ZSBzZW50IGxhc3QgeWVhci4KPj4g Cj4+IFF1ZXN0aW9uIHJlbWluZHMsIGlmIHRoaXMgaXMgaXNzdWUgd2l0aCBRQ0Egd2lmaSBjaGlw IG9uIHRoYXQgQ29tcGV4Cj4+IGNhcmQgb3IgaXQgaXMgaXNzdWUgd2l0aCBQQ0llIGNvbnRyb2xs ZXJzLCBub3cgb24gQTM4eCBhbmQgQTM3MjAgU29DLgo+PiBOb3RlIHRoYXQgYm90aCBBMzh4IGFu ZCBBMzcyMCBwbGF0Zm9ybXMgYXJlIGZyb20gTWFydmVsbCwgYnV0IHRoZXkgaGF2ZQo+PiBkaWZm ZXJlbnQgUENJZSBjb250cm9sbGVycyAoc28gaXQgZG9lcyBub3QgbWVhbiB0aGF0IGJvdGggbXVz dCBoYXZlIHNhbWUKPj4gaHcgYnVncykuCj4KPiBTZWVtcyB0aGF0IHRoaXMgaXMgcmVhbGx5IGlz c3VlIGluIFFDQTk4eHggY2hpcHMuIEkgaGF2ZSBzZW5kIHBhdGNoCj4gd2hpY2ggYWRkcyBxdWly ayBmb3IgdGhlc2Ugd2lmaSBjaGlwczoKPgo+IGh0dHBzOi8vbG9yZS5rZXJuZWwub3JnL2xpbnV4 LXBjaS8yMDIxMDMyNjEyNDMyNi4yMTE2My0xLXBhbGlAa2VybmVsLm9yZy8KCkkgdHJpZWQgYXBw bHlpbmcgdGhhdCwgYW5kIHdoaWxlIGl0IGRvZXMgZml4IHRoZSBhdGgxMGsgY2FyZCwgaXQgc2Vl bXMKdG8gYnJlYWsgdGhlIGF0aDlrIGNhcmQgaW4gdGhlIHNsb3QgbmV4dCB0byBpdC4gV2hlbiBi b290aW5nIHdpdGggdGhlCnBhdGNoIGFwcGxpZWQsIEkgZ2V0IHRoaXMgaW4gZG1lc2c6CgpbICAg IDMuNTU2NTk5XSBhdGg6IHBoeTA6IE1hYyBDaGlwIFJldiAweGZmZmMwLmYgaXMgbm90IHN1cHBv cnRlZCBieSB0aGlzIGRyaXZlcgoKQ291bGQgdGhlcmUgYmUgc29tZSBraW5kIG9mIGRhdGEgY29y cnVwdGlvbiBpbiBwbGF5IGhlcmUgbWFraW5nIHRoZQpkcml2ZXIgdGhpbmsgdGhlIGNoaXAgcmV2 aXNpb24gaXMgd3JvbmcsIG9yIHNvbWV0aGluZyBsaWtlIHRoYXQ/IElmIEkKYm9vdCB0aGUgc2Ft ZSBrZXJuZWwgd2l0aG91dCB0aGUgcGF0Y2ggYXBwbGllZCwgdGhlIGF0aDlrIGluaXRpYWxpc2F0 aW9uCndvcmtzIGZpbmUsIGJ1dCBvYnZpb3VzbHkgdGhlIGF0aDEwayBpcyB0aGVuIHN0aWxsIGJy b2tlbi4uLgoKLVRva2UKCgpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fXwpsaW51eC1hcm0ta2VybmVsIG1haWxpbmcgbGlzdApsaW51eC1hcm0ta2VybmVsQGxp c3RzLmluZnJhZGVhZC5vcmcKaHR0cDovL2xpc3RzLmluZnJhZGVhZC5vcmcvbWFpbG1hbi9saXN0 aW5mby9saW51eC1hcm0ta2VybmVsCg==