From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from phobos.denx.de (phobos.denx.de [85.214.62.61]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 591BBC433F5 for ; Fri, 7 Jan 2022 20:14:41 +0000 (UTC) Received: from h2850616.stratoserver.net (localhost [IPv6:::1]) by phobos.denx.de (Postfix) with ESMTP id 2DEA0830BE; Fri, 7 Jan 2022 21:14:39 +0100 (CET) Authentication-Results: phobos.denx.de; dmarc=none (p=none dis=none) header.from=konsulko.com Authentication-Results: phobos.denx.de; spf=pass smtp.mailfrom=u-boot-bounces@lists.denx.de Authentication-Results: phobos.denx.de; dkim=pass (1024-bit key; unprotected) header.d=konsulko.com header.i=@konsulko.com header.b="B1kX3I2m"; dkim-atps=neutral Received: by phobos.denx.de (Postfix, from userid 109) id DA4AE804C8; Fri, 7 Jan 2022 21:14:37 +0100 (CET) Received: from mail-qt1-x82d.google.com (mail-qt1-x82d.google.com [IPv6:2607:f8b0:4864:20::82d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)) (No client certificate requested) by phobos.denx.de (Postfix) with ESMTPS id D6E3A804C8 for ; Fri, 7 Jan 2022 21:14:33 +0100 (CET) Authentication-Results: phobos.denx.de; dmarc=none (p=none dis=none) header.from=konsulko.com Authentication-Results: phobos.denx.de; spf=pass smtp.mailfrom=trini@konsulko.com Received: by mail-qt1-x82d.google.com with SMTP id s19so6618575qtc.5 for ; Fri, 07 Jan 2022 12:14:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=konsulko.com; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=XI0oGCFMezEIzm1cXREj+op7WHDbLFQZbbFZggd69wI=; b=B1kX3I2mXxFTQxlup37QEVLy5Sal04KMCaGFXWcL3iK+SmATFSNoXTrYoxI7wOsP6H WG7aEZXLG5efTAhBMkTn/S+ZymkYEui39204CXtaCBz1kd3mpbdgIOE+555CjfrxkjUo ICojbpIUfQk8BhSQcp9iFvDiuAYdW0bf7ieew= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=XI0oGCFMezEIzm1cXREj+op7WHDbLFQZbbFZggd69wI=; b=J4j/p+VlFpR3it4hM+vzvs5PVkpwwYgcNlMoeto8bPAK/6jd4X+lkQVGm/PgtBs1Ak BkXslD7+4DeQj0p8cuhsZkf2Yny34sWAnEZbI8C9Nrkn1Ev8/h408CgL1WMFonyER1Lo TmrTB/v172+ZTwoBiIoUWiLCS6riXNEVwFy5LOP9hfXYae9SmzkNrOhwtiWlt35bWiGN DzxQmdAWupNGCJLuWjcXUd2sOHI9hCJkTJIz22ipUHpKVBPphSOMbTQMYH8N/llrxfRl g1CXug0nV07HVzrF9yqstlGLTckHCjG4493n6Xt1/bsfejSloS0hJyOkIO4x7MnrKjK6 3Pfw== X-Gm-Message-State: AOAM5337D1MtcVIIRBHne6XwI997spHAsQRzzZAXI0EE9atHhwdptjfz 2HzB3Ok4aPBCgir4gqqLsxSS2Q== X-Google-Smtp-Source: ABdhPJxHXdKrGyUIDvRuUMLuyaoiQc6bE6dCXcYOfUFQCr+2NyIJr/H8xq9r51D709GRXvWtxngs/g== X-Received: by 2002:ac8:5a91:: with SMTP id c17mr60745874qtc.73.1641586472631; Fri, 07 Jan 2022 12:14:32 -0800 (PST) Received: from bill-the-cat (2603-6081-7b01-cbda-f174-9b83-85b8-612f.res6.spectrum.com. [2603:6081:7b01:cbda:f174:9b83:85b8:612f]) by smtp.gmail.com with ESMTPSA id a28sm3760878qkk.51.2022.01.07.12.14.31 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 07 Jan 2022 12:14:32 -0800 (PST) Date: Fri, 7 Jan 2022 15:14:30 -0500 From: Tom Rini To: Adam Ford , Frieder Schrempf Cc: Tim Harvey , ZHIZHIKIN Andrey , "u-boot@lists.denx.de" Subject: Re: [PATCH] Revert "tree: imx: remove old fit generator script" Message-ID: <20220107201430.GG2773246@bill-the-cat> References: <20220106185133.2375747-1-trini@konsulko.com> <20220107173751.GE2773246@bill-the-cat> <20220107182550.GF2773246@bill-the-cat> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="9DU3v65hh6ZxdM7K" Content-Disposition: inline In-Reply-To: X-Clacks-Overhead: GNU Terry Pratchett X-BeenThere: u-boot@lists.denx.de X-Mailman-Version: 2.1.38 Precedence: list List-Id: U-Boot discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: u-boot-bounces@lists.denx.de Sender: "U-Boot" X-Virus-Scanned: clamav-milter 0.103.2 at phobos.denx.de X-Virus-Status: Clean --9DU3v65hh6ZxdM7K Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Jan 07, 2022 at 02:08:00PM -0600, Adam Ford wrote: > On Fri, Jan 7, 2022 at 12:25 PM Tom Rini wrote: >=20 > > On Fri, Jan 07, 2022 at 12:21:18PM -0600, Adam Ford wrote: > > > On Fri, Jan 7, 2022 at 11:38 AM Tom Rini wrote: > > > > > > > On Fri, Jan 07, 2022 at 09:27:05AM -0800, Tim Harvey wrote: > > > > > On Thu, Jan 6, 2022 at 12:27 PM Tim Harvey > > > > wrote: > > > > > > > > > > > > On Thu, Jan 6, 2022 at 11:18 AM ZHIZHIKIN Andrey > > > > > > wrote: > > > > > > > > > > > > > > Hello Tom, > > > > > > > > > > > > > > > -----Original Message----- > > > > > > > > From: U-Boot On Behalf Of Tom > > Rini > > > > > > > > Sent: Thursday, January 6, 2022 7:52 PM > > > > > > > > To: u-boot@lists.denx.de > > > > > > > > Cc: Tim Harvey > > > > > > > > Subject: [PATCH] Revert "tree: imx: remove old fit generator > > > > script" > > > > > > > > > > > > > > > > This reverts commit d9a6f0eed66a39206b13513ec914f14084c3bb7= 3. > > > > > > > > > > > > > > > > For right now, it's too close to the release to merge the > > series > > > > that > > > > > > > > allows for binman to be used to generate the final images, = and > > > > also not > > > > > > > > break CI, and then also merge all of the series that convert > > > > currently > > > > > > > > broken platforms to use binman instead. So, bring back this > > > > script now > > > > > > > > and remove it again for real after the release. > > > > > > > > > > > > > > Please note that this might not work, as the FIT generator sc= ript > > > > would > > > > > > > generate ITS with '@' symbols which are not compatible with > > mkimage > > > > due > > > > > > > to CVE-2021-27138. This revert should be complemented with the > > fix to > > > > > > > remove those '@' symbols as well. > > > > > > > > > > > > Correct, the revert is not enough anymore: > > > > > > MKIMAGE u-boot.itb > > > > > > u-boot.its:7.11-15.5: Warning (unit_address_vs_reg): > > /images/uboot@1: > > > > > > node has a unit name, but no reg property > > > > > > u-boot.its:16.9-21.5: Warning (unit_address_vs_reg): /images/fd= t@1 > > : > > > > > > node has a unit name, but no reg property > > > > > > u-boot.its:22.9-27.5: Warning (unit_address_vs_reg): /images/fd= t@2 > > : > > > > > > node has a unit name, but no reg property > > > > > > u-boot.its:28.9-33.5: Warning (unit_address_vs_reg): /images/fd= t@3 > > : > > > > > > node has a unit name, but no reg property > > > > > > u-boot.its:34.9-39.5: Warning (unit_address_vs_reg): /images/fd= t@4 > > : > > > > > > node has a unit name, but no reg property > > > > > > u-boot.its:40.9-45.5: Warning (unit_address_vs_reg): /images/fd= t@5 > > : > > > > > > node has a unit name, but no reg property > > > > > > u-boot.its:46.9-55.5: Warning (unit_address_vs_reg): /images/at= f@1 > > : > > > > > > node has a unit name, but no reg property > > > > > > u-boot.its:60.12-65.5: Warning (unit_address_vs_reg): > > > > > > /configurations/config@1: node has a unit name, but no reg > > property > > > > > > u-boot.its:66.12-71.5: Warning (unit_address_vs_reg): > > > > > > /configurations/config@2: node has a unit name, but no reg > > property > > > > > > u-boot.its:72.12-77.5: Warning (unit_address_vs_reg): > > > > > > /configurations/config@3: node has a unit name, but no reg > > property > > > > > > u-boot.its:78.12-83.5: Warning (unit_address_vs_reg): > > > > > > /configurations/config@4: node has a unit name, but no reg > > property > > > > > > u-boot.its:84.12-89.5: Warning (unit_address_vs_reg): > > > > > > /configurations/config@5: node has a unit name, but no reg > > property > > > > > > ./tools/mkimage: verify_header failed for FIT Image support with > > exit > > > > code 1 > > > > > > Makefile:1433: recipe for target 'u-boot.itb' failed > > > > > > make: *** [u-boot.itb] Error 1 > > > > > > make: *** Deleting file 'u-boot.itb' > > > > > > make: *** Waiting for unfinished jobs.... > > > > > > > > > > > > I don't know what had changed to cause this or when (again, I > > stopped > > > > > > worrying about it because I thought we were moving to binman for > > this > > > > > > release). There was a patch that resolved this from Oliver at > > > > > > https://lists.denx.de/pipermail/u-boot/2021-August/457997.html > > but I > > > > > > don't think that fully solves anything 'at this point' either. > > > > > > > > > > > > Even with that applied to current master I then end up with: > > > > > > MKIMAGE flash.bin > > > > > > ./tools/mkimage: Can't open spl/u-boot-spl-ddr.bin: No such fil= e or > > > > directory > > > > > > arch/arm/mach-imx/Makefile:167: recipe for target 'flash.bin' > > failed > > > > > > make[1]: *** [flash.bin] Error 1 > > > > > > make[1]: *** Deleting file 'flash.bin' > > > > > > Makefile:1526: recipe for target 'flash.bin' failed > > > > > > > > > > > > At some point over the past couple of months that patch resolved > > the > > > > > > building issue when using the FIT generator but I also don't kn= ow > > what > > > > > > else has changed that now causes that to not work. > > > > > > > > > > > > As Tom pointed out in another thread these build failures did n= ot > > get > > > > > > caught by CI apparently because CI does a 'make all' which did = not > > > > > > include the FIT images (that was accomplished with the 'flash.b= in' > > > > > > target prior to binman conversion). > > > > > > > > > > > > Is it too late to apply the CI fix and the pending binman > > conversions? > > > > > > > > > > > > I know that my series has been reviewed by Marcel [1] and as far > > as I > > > > > > know didn't get merged simply because of the CI issue. It still > > > > > > applies and produces a valid flash.bin image. > > > > > > I was also able to merge Peng's series [2] which converts > > > > > > imx8mq_evk/imx8mq_phanbell/pico-imx8mq to binman and was able to > > build > > > > > > flash.bin images for them > > > > > > > > > > > > I tried to merge Adam's series that moves imx8mm_beacon to binm= an > > [3] > > > > > > and imx8mn_beacon to binman [4] but they no longer apply due to > > > > > > defconfig/Kconfig changes > > > > > > > > > > > > That still leaves the following unbuildable with > > > > > > CONFIG_SPL_FIT_GENERATOR =3D "arch/arm/mach-imx/mkimage_fit_atf= =2Esh": > > > > > > > > > > > > configs/cgtqmx8_defconfig:CONFIG_SPL_FIT_GENERATOR=3D"arch/arm/mach-imx= /mkimage_fit_atf.sh" > > > > > > > > > > > > configs/imx8mm-icore-mx8mm-ctouch2_defconfig:CONFIG_SPL_FIT_GENERATOR= =3D"arch/arm/mach-imx/mkimage_fit_atf.sh" > > > > > > > > > > > > configs/imx8mm-icore-mx8mm-edimm2.2_defconfig:CONFIG_SPL_FIT_GENERATOR= =3D"arch/arm/mach-imx/mkimage_fit_atf.sh" > > > > > > > > > > > > configs/imx8mm_beacon_defconfig:CONFIG_SPL_FIT_GENERATOR=3D"arch/arm/ma= ch-imx/mkimage_fit_atf.sh" > > > > > > > > > > > > configs/imx8mn_beacon_2g_defconfig:CONFIG_SPL_FIT_GENERATOR=3D"arch/arm= /mach-imx/mkimage_fit_atf.sh" > > > > > > > > > > > > configs/imx8mn_beacon_defconfig:CONFIG_SPL_FIT_GENERATOR=3D"arch/arm/ma= ch-imx/mkimage_fit_atf.sh" > > > > > > > > > > > > configs/imx8qm_rom7720_a1_4G_defconfig:CONFIG_SPL_FIT_GENERATOR=3D"arch= /arm/mach-imx/mkimage_fit_atf.sh" > > > > > > > > > > > > Tim > > > > > > [1] https://patchwork.ozlabs.org/project/uboot/list/?series=3D2= 65765 > > > > > > [2] https://patchwork.ozlabs.org/project/uboot/list/?series=3D2= 68380 > > > > > > [3] https://patchwork.ozlabs.org/project/uboot/list/?series=3D2= 61640 > > > > > > [4] https://patchwork.ozlabs.org/project/uboot/list/?series=3D2= 61822 > > > > > > > > > > > > > > > > Tom, > > > > > > > > > > I'm not familiar with the U-boot CI tool. > > > > > > > > It's at > > https://u-boot.readthedocs.io/en/latest/develop/ci_testing.html > > > > (and in-tree under doc/develop/ci_testing.rst). > > > > > > > > > Is it a show-stopper that it > > > > > does not build for boards using binman for release? From what you > > > > > mentioned in another thread it was never building the flash.bin > > target > > > > > for the boards using the FIT generator anyway. > > > > > > > > Yes, breaking CI is a ship-stopper. That all of these boards were = not > > > > previously building the final image as part of "all" is a problem. > > > > > > > > So, here's what I'm at right now. I've grabbed Heiko's patch. > > > > Everything is currently visible at > > > > > > > > > > https://patchwork.ozlabs.org/bundle/trini/2022-01-07-imx8-and-binman-up= dates/ > > > > and with this, we get some boards building and complaining as expec= ted: > > > > aarch64: w+ imx8mn_evk > > > > +(imx8mn_evk) Image 'main-section' is missing external blobs and is > > > > non-functional: blob-ext@1 > > > > blob-ext@2 blob-ext@3 blob-ext@4 > > > > +(imx8mn_evk) Image 'main-section' is missing external blobs and is > > > > non-functional: blob-ext > > > > +(imx8mn_evk) > > > > +(imx8mn_evk) Some images are invalid > > > > > > > > But others are: > > > > aarch64: + imx8mn_beacon_2g > > > > +(imx8mn_beacon_2g) =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D WARNING > > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > > > > +(imx8mn_beacon_2g) This board uses CONFIG_SPL_FIT_GENERATOR. Please > > > > migrate > > > > +(imx8mn_beacon_2g) to binman instead, to avoid the proliferation of > > > > +(imx8mn_beacon_2g) arch-specific scripts with no tests. > > > > +(imx8mn_beacon_2g) > > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D > > > > +(imx8mn_beacon_2g) Image 'main-section' is missing external blobs = and > > is > > > > non-functional: blob- > > > > ext@1 blob-ext@2 blob-ext@3 blob-ext@4 > > > > +(imx8mn_beacon_2g) binman: Error 1 running 'mkimage -d > > > > ./mkimage.spl.mkimage -n spl/u-boot-spl > > > > .cfgout -T imx8mimage -e 0x912000 ./mkimage-out.spl.mkimage': > > > > spl/u-boot-spl-ddr.bin: Can't ope > > > > n: No such file or directory > > > > +(imx8mn_beacon_2g) > > > > +(imx8mn_beacon_2g) make[1]: *** [Makefile:1088: all] Error 1 > > > > +(imx8mn_beacon_2g) make: *** [Makefile:177: sub-make] Error 2 > > > > > > > > > > The beacon boards are mine. I can work on this one today. Do I just > > grab > > > the binman updates and apply it to master and fix it from that starti= ng > > > point? > > > > So, yes, grabbing the series from the above link and applying it on top > > of master, and making builds work with fake binaries would be very > > helpful. As best I can tell there's still something missing with making > > fake blobs link and not fail. For example, imx8mm_venice is part of the > > series above but still fails with 'make BINMAN_FAKE_EXT_BLOBS=3D1 ...': > > Image 'main-section:u-boot-spl-ddr' has faked external blobs and is > > non-functional: lpddr4_pmu_train_1d_imem.bin lpddr4_pmu_train_1d_dmem.b= in > > lpddr4_pmu_train_2d_imem.bin lpddr4_pmu_train_2d_dmem.bin > > Image 'main-section' is missing external blobs and is non-functional: > > atf_blob blob-ext > > Wrote map file './imx-boot.map' to show errors > > binman: Node '/binman/imx-boot/blob-ext@1': Offset 0x0 (0) overlaps with > > previous entry '/binman/imx-boot/uboot' ending at 0x1aee08 (1764872) > > > > > From what I can tell looking at the imx8mm_venice board is that > the imx8mm-u-boot.dtsi has the binman nodes to build the image, > but arch/arm/dts/imx8mm-venice-u-boot.dtsi duplicates that work, so there > are two copies trying to occupy the same space. Deleting the &binman node > from the venice-u-boot.dtsi file appears to make the problem go away, and > binman is still making the image. >=20 > $ cat imx-boot.map > ImagePos Offset Size Name > 00000000 00000000 0011d778 main-section > 00000000 00000000 00039000 spl > 00057c00 00057c00 000c5b78 uboot >=20 > $ cat spl.map > ImagePos Offset Size Name > 00000000 00000000 00039000 main-section > 00000000 00000000 00039000 mkimage >=20 > $ cat u-boot-spl-ddr.map > ImagePos Offset Size Name > 00000000 00000000 00036f5c main-section > 00000000 00000000 0001ef5c u-boot-spl > 00000000 00000000 0001dc40 u-boot-spl-nodtb > 0001dc40 0001dc40 0000131c u-boot-spl-dtb > 0001ef5c 0001ef5c 00008000 1d-imem > 00026f5c 00026f5c 00004000 1d_dmem > 0002af5c 0002af5c 00008000 2d_imem > 00032f5c 00032f5c 00004000 2d_dmem >=20 > Tim, >=20 > Can you try deleting the &binman node from your mx8mm-venice-u-boot.dtsi > file and see if the stock binman node in 8mm-u-boot-dtsi works for you? > The new default one does for me on my Beacon 8mm board. >=20 > Tom, >=20 > I will submit another patch for the imx8mn_beacon boards to fix the build > error on the 2g version. I forgot to update the second defconfig file wh= en > I pushed the patch for the first one. I have it working, but I need to > clean it up. OK, thanks! I just confirmed that with the above series it's down to: imx8mn_beacon_2g imx8mm_venice kontron-sl-mx8mm phycore-imx8mm as the fails to build in CI boards: https://source.denx.de/u-boot/u-boot/-/jobs/372239 as part of=20 https://source.denx.de/u-boot/u-boot/-/pipelines/10497 I feel at this point that worst-case I can come up with something to make venice and kontron link still given what you figured out above and shouldn't be any worse off than they are today. And that can go in v2022.01. --=20 Tom --9DU3v65hh6ZxdM7K Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQGzBAABCgAdFiEEGjx/cOCPqxcHgJu/FHw5/5Y0tywFAmHYnyMACgkQFHw5/5Y0 tyzjRQwAqZt9Ly9yw+HEzqbAIfdUtV5vfSWS3+xPTmVsGP/xNa9Kr+gEIyOmh7It M8x1OD+pasvQ2DlyHbRV3iZbuE8hhinz2pbdB6yWkeXH1tfBUli2zA9klP16urFF 5zWCNZM789MSbPd1oH76FRtCCpn7pqeEH7E9LMo5iTfJx3K2eN65cc+QJanVwFfV KXNU22+KMexMngJjN1X4kZKKEjeDB3cJ5TE1ZmpnQkX0FnnAIbpz8uIaMcgbxj/r 407Ja9FE8heN/yz0ZISe4dVHxJxDnkhqif4W+X274G5RSSFW5mer5ALu+YCpd4DE bxseg/N2mTtJkDSgiTZums/tTxp8pkXeIQD/b73/BHpfTpisRF1KmpNFJYp1Jb6t tdFM5ex+PFdNaFNiP6lOKKFWNMtqBQjWjDSlakRhHF2ZJAGHR+z4Q687WvH1L5Qe fCZmn/eIT32KAC4Hi7pqWJdtnrpymTMc7jATs79BV9uB/MydvB5/1zS3qjf8Cy+v JhxHWfoD =mt41 -----END PGP SIGNATURE----- --9DU3v65hh6ZxdM7K--