* Fast model boot failure with Linux next-20250312 @ 2025-03-19 14:37 Naresh Kamboju 2025-03-19 14:55 ` Mark Rutland 0 siblings, 1 reply; 4+ messages in thread From: Naresh Kamboju @ 2025-03-19 14:37 UTC (permalink / raw) To: open list, lkft-triage, Linux ARM, kvmarm Cc: Anshuman Khandual, Rob Herring, Catalin Marinas, Mark Brown, Aishwarya TCV, Anders Roxell, Dan Carpenter, Arnd Bergmann Regressions on the arm64 Fast Model (FVP-AEMvA) caused boot failures starting with Linux next-20250312 and persisting through next-20250319. First seen on the next-20250312 Good: next-20250311 Bad: next-20250312 .. next-20250319 Regressions found on FVP: - boot Regression Analysis: - New regression? Yes - Reproducible? Yes Boot regression: Fast model boot failure with Linux next-20250312 Reported-by: Linux Kernel Functional Testing <lkft@linaro.org> Anders bisected this to this commit id, # first bad commit: [858c7bfcb35e1100b58bb63c9f562d86e09418d9] arm64/boot: Enable EL2 requirements for FEAT_PMUv3p9 NOTE: LKFT is currently running FVP Fast Models version 11.24. Planned upgrade to the Fast Models version 11.28 in this sprint. ## Boot log <No crash log on the console> ## Source * Kernel version: 6.14.0-rc7 * Git tree: https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git * Git sha: ff7f9b199e3f4cc7d61df5a9a26a7cbb5c1492e6 * Git describe: next-20250319 * Project details: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319 * DUT: arm64 Fast Model (FVP-AEMvA) * Toolchains: gcc-13 and clang-20 ## Build * Build log: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675691/suite/boot/test/gcc-13-lkftconfig/log * Build history: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675685/suite/boot/test/gcc-13-lkftconfig/history/ * Build details: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675691/suite/boot/test/gcc-13-lkftconfig/ * Build link: https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyhoi01Yy0/ * Kernel config: https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyhoi01Yy0/config -- Linaro LKFT https://lkft.linaro.org ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: Fast model boot failure with Linux next-20250312 2025-03-19 14:37 Fast model boot failure with Linux next-20250312 Naresh Kamboju @ 2025-03-19 14:55 ` Mark Rutland 2025-03-20 10:33 ` Naresh Kamboju 0 siblings, 1 reply; 4+ messages in thread From: Mark Rutland @ 2025-03-19 14:55 UTC (permalink / raw) To: Naresh Kamboju Cc: open list, lkft-triage, Linux ARM, kvmarm, Anshuman Khandual, Rob Herring, Catalin Marinas, Mark Brown, Aishwarya TCV, Anders Roxell, Dan Carpenter, Arnd Bergmann On Wed, Mar 19, 2025 at 08:07:47PM +0530, Naresh Kamboju wrote: > Regressions on the arm64 Fast Model (FVP-AEMvA) caused boot failures starting > with Linux next-20250312 and persisting through next-20250319. > > First seen on the next-20250312 > Good: next-20250311 > Bad: next-20250312 .. next-20250319 > > Regressions found on FVP: > - boot > > Regression Analysis: > - New regression? Yes > - Reproducible? Yes > > Boot regression: Fast model boot failure with Linux next-20250312 > Reported-by: Linux Kernel Functional Testing <lkft@linaro.org> > > Anders bisected this to this commit id, > > # first bad commit: > [858c7bfcb35e1100b58bb63c9f562d86e09418d9] > arm64/boot: Enable EL2 requirements for FEAT_PMUv3p9 > > NOTE: > LKFT is currently running FVP Fast Models version 11.24. > Planned upgrade to the Fast Models version 11.28 in this sprint. What firmware (and version therof) are you running within the model? For example, if the EL3 firmware lacks support for FEAT_FGT2 or FEAT_PMUv3p9, the kernel will trap to EL3 early during boot and die. It would be really helpful if you could capture that in the report in future. Mark. > > ## Boot log > <No crash log on the console> > > ## Source > * Kernel version: 6.14.0-rc7 > * Git tree: https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git > * Git sha: ff7f9b199e3f4cc7d61df5a9a26a7cbb5c1492e6 > * Git describe: next-20250319 > * Project details: > https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319 > * DUT: arm64 Fast Model (FVP-AEMvA) > * Toolchains: gcc-13 and clang-20 > > ## Build > * Build log: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675691/suite/boot/test/gcc-13-lkftconfig/log > * Build history: > https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675685/suite/boot/test/gcc-13-lkftconfig/history/ > * Build details: > https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675691/suite/boot/test/gcc-13-lkftconfig/ > * Build link: https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyhoi01Yy0/ > * Kernel config: > https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyhoi01Yy0/config > > -- > Linaro LKFT > https://lkft.linaro.org > ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: Fast model boot failure with Linux next-20250312 2025-03-19 14:55 ` Mark Rutland @ 2025-03-20 10:33 ` Naresh Kamboju 2025-03-21 12:57 ` Andre Przywara 0 siblings, 1 reply; 4+ messages in thread From: Naresh Kamboju @ 2025-03-20 10:33 UTC (permalink / raw) To: Mark Rutland Cc: open list, lkft-triage, Linux ARM, kvmarm, Anshuman Khandual, Rob Herring, Catalin Marinas, Mark Brown, Aishwarya TCV, Anders Roxell, Dan Carpenter, Arnd Bergmann On Wed, 19 Mar 2025 at 20:25, Mark Rutland <mark.rutland@arm.com> wrote: > > On Wed, Mar 19, 2025 at 08:07:47PM +0530, Naresh Kamboju wrote: > > Regressions on the arm64 Fast Model (FVP-AEMvA) caused boot failures starting > > with Linux next-20250312 and persisting through next-20250319. > > > > First seen on the next-20250312 > > Good: next-20250311 > > Bad: next-20250312 .. next-20250319 > > > > Regressions found on FVP: > > - boot > > > > Regression Analysis: > > - New regression? Yes > > - Reproducible? Yes > > > > Boot regression: Fast model boot failure with Linux next-20250312 > > Reported-by: Linux Kernel Functional Testing <lkft@linaro.org> > > > > Anders bisected this to this commit id, > > > > # first bad commit: > > [858c7bfcb35e1100b58bb63c9f562d86e09418d9] > > arm64/boot: Enable EL2 requirements for FEAT_PMUv3p9 > > > > NOTE: > > LKFT is currently running FVP Fast Models version 11.24. > > Planned upgrade to the Fast Models version 11.28 in this sprint. > > What firmware (and version therof) are you running within the model? Fast Models [11.24.11 (Nov 29 2023)] Booting Trusted Firmware BL1: v2.9(release):v2.9.0 BL2: v2.9(release):v2.9.0 BL31: v2.9(release):v2.9.0 UEFI firmware (version built at 22:31:25 on May 26 2023) UEFI v2.70 (EDK II, 0x00010000) We need to update the firmware version at our end. > > For example, if the EL3 firmware lacks support for FEAT_FGT2 or > FEAT_PMUv3p9, the kernel will trap to EL3 early during boot and die. > > It would be really helpful if you could capture that in the report in > future. > > Mark. > > > > > ## Boot log > > <No crash log on the console> > > > > ## Source > > * Kernel version: 6.14.0-rc7 > > * Git tree: https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git > > * Git sha: ff7f9b199e3f4cc7d61df5a9a26a7cbb5c1492e6 > > * Git describe: next-20250319 > > * Project details: > > https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319 > > * DUT: arm64 Fast Model (FVP-AEMvA) > > * Toolchains: gcc-13 and clang-20 > > > > ## Build > > * Build log: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675691/suite/boot/test/gcc-13-lkftconfig/log > > * Build history: > > https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675685/suite/boot/test/gcc-13-lkftconfig/history/ > > * Build details: > > https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675691/suite/boot/test/gcc-13-lkftconfig/ > > * Build link: https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyhoi01Yy0/ > > * Kernel config: > > https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyhoi01Yy0/config > > > > -- > > Linaro LKFT > > https://lkft.linaro.org > > - Naresh ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: Fast model boot failure with Linux next-20250312 2025-03-20 10:33 ` Naresh Kamboju @ 2025-03-21 12:57 ` Andre Przywara 0 siblings, 0 replies; 4+ messages in thread From: Andre Przywara @ 2025-03-21 12:57 UTC (permalink / raw) To: Naresh Kamboju Cc: Mark Rutland, open list, lkft-triage, Linux ARM, kvmarm, Anshuman Khandual, Rob Herring, Catalin Marinas, Mark Brown, Aishwarya TCV, Anders Roxell, Dan Carpenter, Arnd Bergmann On Thu, 20 Mar 2025 16:03:32 +0530 Naresh Kamboju <naresh.kamboju@linaro.org> wrote: Hi, > On Wed, 19 Mar 2025 at 20:25, Mark Rutland <mark.rutland@arm.com> wrote: > > > > On Wed, Mar 19, 2025 at 08:07:47PM +0530, Naresh Kamboju wrote: > > > Regressions on the arm64 Fast Model (FVP-AEMvA) caused boot failures starting > > > with Linux next-20250312 and persisting through next-20250319. > > > > > > First seen on the next-20250312 > > > Good: next-20250311 > > > Bad: next-20250312 .. next-20250319 > > > > > > Regressions found on FVP: > > > - boot > > > > > > Regression Analysis: > > > - New regression? Yes > > > - Reproducible? Yes > > > > > > Boot regression: Fast model boot failure with Linux next-20250312 > > > Reported-by: Linux Kernel Functional Testing <lkft@linaro.org> > > > > > > Anders bisected this to this commit id, > > > > > > # first bad commit: > > > [858c7bfcb35e1100b58bb63c9f562d86e09418d9] > > > arm64/boot: Enable EL2 requirements for FEAT_PMUv3p9 > > > > > > NOTE: > > > LKFT is currently running FVP Fast Models version 11.24. > > > Planned upgrade to the Fast Models version 11.28 in this sprint. > > > > What firmware (and version therof) are you running within the model? > > Fast Models [11.24.11 (Nov 29 2023)] > Booting Trusted Firmware > BL1: v2.9(release):v2.9.0 > BL2: v2.9(release):v2.9.0 > BL31: v2.9(release):v2.9.0 > UEFI firmware (version built at 22:31:25 on May 26 2023) > UEFI v2.70 (EDK II, 0x00010000) > > We need to update the firmware version at our end. Oh yes, please, v2.9.0 is quite old by now, especially for a moving target like the FVP, and when enabling new architecture features. FWIW, after Anshuman pointed me the problem, I made a patch for TF-A to enable PMUv3p9: https://review.trustedfirmware.org/c/TF-A/trusted-firmware-a/+/35884 You would need that for this Linux commit here to work. FEAT_FGT2 should be enabled already by default for the FVP. Please feel free to leave a comment at the TF-A gerrit, stating that you need the patch, that should accelerate the upstream process. Cheers, Andre > > For example, if the EL3 firmware lacks support for FEAT_FGT2 or > > FEAT_PMUv3p9, the kernel will trap to EL3 early during boot and die. > > > > It would be really helpful if you could capture that in the report in > > future. > > > > Mark. > > > > > > > > ## Boot log > > > <No crash log on the console> > > > > > > ## Source > > > * Kernel version: 6.14.0-rc7 > > > * Git tree: https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git > > > * Git sha: ff7f9b199e3f4cc7d61df5a9a26a7cbb5c1492e6 > > > * Git describe: next-20250319 > > > * Project details: > > > https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319 > > > * DUT: arm64 Fast Model (FVP-AEMvA) > > > * Toolchains: gcc-13 and clang-20 > > > > > > ## Build > > > * Build log: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675691/suite/boot/test/gcc-13-lkftconfig/log > > > * Build history: > > > https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675685/suite/boot/test/gcc-13-lkftconfig/history/ > > > * Build details: > > > https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675691/suite/boot/test/gcc-13-lkftconfig/ > > > * Build link: https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyhoi01Yy0/ > > > * Kernel config: > > > https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyhoi01Yy0/config > > > > > > -- > > > Linaro LKFT > > > https://lkft.linaro.org > > > > > - Naresh > ^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2025-03-21 12:59 UTC | newest] Thread overview: 4+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2025-03-19 14:37 Fast model boot failure with Linux next-20250312 Naresh Kamboju 2025-03-19 14:55 ` Mark Rutland 2025-03-20 10:33 ` Naresh Kamboju 2025-03-21 12:57 ` Andre Przywara
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox