* Fast model boot failure with Linux next-20250312
@ 2025-03-19 14:37 Naresh Kamboju
2025-03-19 14:55 ` Mark Rutland
0 siblings, 1 reply; 4+ messages in thread
From: Naresh Kamboju @ 2025-03-19 14:37 UTC (permalink / raw)
To: open list, lkft-triage, Linux ARM, kvmarm
Cc: Anshuman Khandual, Rob Herring, Catalin Marinas, Mark Brown,
Aishwarya TCV, Anders Roxell, Dan Carpenter, Arnd Bergmann
Regressions on the arm64 Fast Model (FVP-AEMvA) caused boot failures starting
with Linux next-20250312 and persisting through next-20250319.
First seen on the next-20250312
Good: next-20250311
Bad: next-20250312 .. next-20250319
Regressions found on FVP:
- boot
Regression Analysis:
- New regression? Yes
- Reproducible? Yes
Boot regression: Fast model boot failure with Linux next-20250312
Reported-by: Linux Kernel Functional Testing <lkft@linaro.org>
Anders bisected this to this commit id,
# first bad commit:
[858c7bfcb35e1100b58bb63c9f562d86e09418d9]
arm64/boot: Enable EL2 requirements for FEAT_PMUv3p9
NOTE:
LKFT is currently running FVP Fast Models version 11.24.
Planned upgrade to the Fast Models version 11.28 in this sprint.
## Boot log
<No crash log on the console>
## Source
* Kernel version: 6.14.0-rc7
* Git tree: https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
* Git sha: ff7f9b199e3f4cc7d61df5a9a26a7cbb5c1492e6
* Git describe: next-20250319
* Project details:
https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319
* DUT: arm64 Fast Model (FVP-AEMvA)
* Toolchains: gcc-13 and clang-20
## Build
* Build log: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675691/suite/boot/test/gcc-13-lkftconfig/log
* Build history:
https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675685/suite/boot/test/gcc-13-lkftconfig/history/
* Build details:
https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675691/suite/boot/test/gcc-13-lkftconfig/
* Build link: https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyhoi01Yy0/
* Kernel config:
https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyhoi01Yy0/config
--
Linaro LKFT
https://lkft.linaro.org
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: Fast model boot failure with Linux next-20250312
2025-03-19 14:37 Fast model boot failure with Linux next-20250312 Naresh Kamboju
@ 2025-03-19 14:55 ` Mark Rutland
2025-03-20 10:33 ` Naresh Kamboju
0 siblings, 1 reply; 4+ messages in thread
From: Mark Rutland @ 2025-03-19 14:55 UTC (permalink / raw)
To: Naresh Kamboju
Cc: open list, lkft-triage, Linux ARM, kvmarm, Anshuman Khandual,
Rob Herring, Catalin Marinas, Mark Brown, Aishwarya TCV,
Anders Roxell, Dan Carpenter, Arnd Bergmann
On Wed, Mar 19, 2025 at 08:07:47PM +0530, Naresh Kamboju wrote:
> Regressions on the arm64 Fast Model (FVP-AEMvA) caused boot failures starting
> with Linux next-20250312 and persisting through next-20250319.
>
> First seen on the next-20250312
> Good: next-20250311
> Bad: next-20250312 .. next-20250319
>
> Regressions found on FVP:
> - boot
>
> Regression Analysis:
> - New regression? Yes
> - Reproducible? Yes
>
> Boot regression: Fast model boot failure with Linux next-20250312
> Reported-by: Linux Kernel Functional Testing <lkft@linaro.org>
>
> Anders bisected this to this commit id,
>
> # first bad commit:
> [858c7bfcb35e1100b58bb63c9f562d86e09418d9]
> arm64/boot: Enable EL2 requirements for FEAT_PMUv3p9
>
> NOTE:
> LKFT is currently running FVP Fast Models version 11.24.
> Planned upgrade to the Fast Models version 11.28 in this sprint.
What firmware (and version therof) are you running within the model?
For example, if the EL3 firmware lacks support for FEAT_FGT2 or
FEAT_PMUv3p9, the kernel will trap to EL3 early during boot and die.
It would be really helpful if you could capture that in the report in
future.
Mark.
>
> ## Boot log
> <No crash log on the console>
>
> ## Source
> * Kernel version: 6.14.0-rc7
> * Git tree: https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
> * Git sha: ff7f9b199e3f4cc7d61df5a9a26a7cbb5c1492e6
> * Git describe: next-20250319
> * Project details:
> https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319
> * DUT: arm64 Fast Model (FVP-AEMvA)
> * Toolchains: gcc-13 and clang-20
>
> ## Build
> * Build log: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675691/suite/boot/test/gcc-13-lkftconfig/log
> * Build history:
> https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675685/suite/boot/test/gcc-13-lkftconfig/history/
> * Build details:
> https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675691/suite/boot/test/gcc-13-lkftconfig/
> * Build link: https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyhoi01Yy0/
> * Kernel config:
> https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyhoi01Yy0/config
>
> --
> Linaro LKFT
> https://lkft.linaro.org
>
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: Fast model boot failure with Linux next-20250312
2025-03-19 14:55 ` Mark Rutland
@ 2025-03-20 10:33 ` Naresh Kamboju
2025-03-21 12:57 ` Andre Przywara
0 siblings, 1 reply; 4+ messages in thread
From: Naresh Kamboju @ 2025-03-20 10:33 UTC (permalink / raw)
To: Mark Rutland
Cc: open list, lkft-triage, Linux ARM, kvmarm, Anshuman Khandual,
Rob Herring, Catalin Marinas, Mark Brown, Aishwarya TCV,
Anders Roxell, Dan Carpenter, Arnd Bergmann
On Wed, 19 Mar 2025 at 20:25, Mark Rutland <mark.rutland@arm.com> wrote:
>
> On Wed, Mar 19, 2025 at 08:07:47PM +0530, Naresh Kamboju wrote:
> > Regressions on the arm64 Fast Model (FVP-AEMvA) caused boot failures starting
> > with Linux next-20250312 and persisting through next-20250319.
> >
> > First seen on the next-20250312
> > Good: next-20250311
> > Bad: next-20250312 .. next-20250319
> >
> > Regressions found on FVP:
> > - boot
> >
> > Regression Analysis:
> > - New regression? Yes
> > - Reproducible? Yes
> >
> > Boot regression: Fast model boot failure with Linux next-20250312
> > Reported-by: Linux Kernel Functional Testing <lkft@linaro.org>
> >
> > Anders bisected this to this commit id,
> >
> > # first bad commit:
> > [858c7bfcb35e1100b58bb63c9f562d86e09418d9]
> > arm64/boot: Enable EL2 requirements for FEAT_PMUv3p9
> >
> > NOTE:
> > LKFT is currently running FVP Fast Models version 11.24.
> > Planned upgrade to the Fast Models version 11.28 in this sprint.
>
> What firmware (and version therof) are you running within the model?
Fast Models [11.24.11 (Nov 29 2023)]
Booting Trusted Firmware
BL1: v2.9(release):v2.9.0
BL2: v2.9(release):v2.9.0
BL31: v2.9(release):v2.9.0
UEFI firmware (version built at 22:31:25 on May 26 2023)
UEFI v2.70 (EDK II, 0x00010000)
We need to update the firmware version at our end.
>
> For example, if the EL3 firmware lacks support for FEAT_FGT2 or
> FEAT_PMUv3p9, the kernel will trap to EL3 early during boot and die.
>
> It would be really helpful if you could capture that in the report in
> future.
>
> Mark.
>
> >
> > ## Boot log
> > <No crash log on the console>
> >
> > ## Source
> > * Kernel version: 6.14.0-rc7
> > * Git tree: https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
> > * Git sha: ff7f9b199e3f4cc7d61df5a9a26a7cbb5c1492e6
> > * Git describe: next-20250319
> > * Project details:
> > https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319
> > * DUT: arm64 Fast Model (FVP-AEMvA)
> > * Toolchains: gcc-13 and clang-20
> >
> > ## Build
> > * Build log: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675691/suite/boot/test/gcc-13-lkftconfig/log
> > * Build history:
> > https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675685/suite/boot/test/gcc-13-lkftconfig/history/
> > * Build details:
> > https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675691/suite/boot/test/gcc-13-lkftconfig/
> > * Build link: https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyhoi01Yy0/
> > * Kernel config:
> > https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyhoi01Yy0/config
> >
> > --
> > Linaro LKFT
> > https://lkft.linaro.org
> >
- Naresh
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: Fast model boot failure with Linux next-20250312
2025-03-20 10:33 ` Naresh Kamboju
@ 2025-03-21 12:57 ` Andre Przywara
0 siblings, 0 replies; 4+ messages in thread
From: Andre Przywara @ 2025-03-21 12:57 UTC (permalink / raw)
To: Naresh Kamboju
Cc: Mark Rutland, open list, lkft-triage, Linux ARM, kvmarm,
Anshuman Khandual, Rob Herring, Catalin Marinas, Mark Brown,
Aishwarya TCV, Anders Roxell, Dan Carpenter, Arnd Bergmann
On Thu, 20 Mar 2025 16:03:32 +0530
Naresh Kamboju <naresh.kamboju@linaro.org> wrote:
Hi,
> On Wed, 19 Mar 2025 at 20:25, Mark Rutland <mark.rutland@arm.com> wrote:
> >
> > On Wed, Mar 19, 2025 at 08:07:47PM +0530, Naresh Kamboju wrote:
> > > Regressions on the arm64 Fast Model (FVP-AEMvA) caused boot failures starting
> > > with Linux next-20250312 and persisting through next-20250319.
> > >
> > > First seen on the next-20250312
> > > Good: next-20250311
> > > Bad: next-20250312 .. next-20250319
> > >
> > > Regressions found on FVP:
> > > - boot
> > >
> > > Regression Analysis:
> > > - New regression? Yes
> > > - Reproducible? Yes
> > >
> > > Boot regression: Fast model boot failure with Linux next-20250312
> > > Reported-by: Linux Kernel Functional Testing <lkft@linaro.org>
> > >
> > > Anders bisected this to this commit id,
> > >
> > > # first bad commit:
> > > [858c7bfcb35e1100b58bb63c9f562d86e09418d9]
> > > arm64/boot: Enable EL2 requirements for FEAT_PMUv3p9
> > >
> > > NOTE:
> > > LKFT is currently running FVP Fast Models version 11.24.
> > > Planned upgrade to the Fast Models version 11.28 in this sprint.
> >
> > What firmware (and version therof) are you running within the model?
>
> Fast Models [11.24.11 (Nov 29 2023)]
> Booting Trusted Firmware
> BL1: v2.9(release):v2.9.0
> BL2: v2.9(release):v2.9.0
> BL31: v2.9(release):v2.9.0
> UEFI firmware (version built at 22:31:25 on May 26 2023)
> UEFI v2.70 (EDK II, 0x00010000)
>
> We need to update the firmware version at our end.
Oh yes, please, v2.9.0 is quite old by now, especially for a moving target
like the FVP, and when enabling new architecture features.
FWIW, after Anshuman pointed me the problem, I made a patch for TF-A to
enable PMUv3p9:
https://review.trustedfirmware.org/c/TF-A/trusted-firmware-a/+/35884
You would need that for this Linux commit here to work.
FEAT_FGT2 should be enabled already by default for the FVP.
Please feel free to leave a comment at the TF-A gerrit, stating that you
need the patch, that should accelerate the upstream process.
Cheers,
Andre
> > For example, if the EL3 firmware lacks support for FEAT_FGT2 or
> > FEAT_PMUv3p9, the kernel will trap to EL3 early during boot and die.
> >
> > It would be really helpful if you could capture that in the report in
> > future.
> >
> > Mark.
> >
> > >
> > > ## Boot log
> > > <No crash log on the console>
> > >
> > > ## Source
> > > * Kernel version: 6.14.0-rc7
> > > * Git tree: https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
> > > * Git sha: ff7f9b199e3f4cc7d61df5a9a26a7cbb5c1492e6
> > > * Git describe: next-20250319
> > > * Project details:
> > > https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319
> > > * DUT: arm64 Fast Model (FVP-AEMvA)
> > > * Toolchains: gcc-13 and clang-20
> > >
> > > ## Build
> > > * Build log: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675691/suite/boot/test/gcc-13-lkftconfig/log
> > > * Build history:
> > > https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675685/suite/boot/test/gcc-13-lkftconfig/history/
> > > * Build details:
> > > https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250319/testrun/27675691/suite/boot/test/gcc-13-lkftconfig/
> > > * Build link: https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyhoi01Yy0/
> > > * Kernel config:
> > > https://storage.tuxsuite.com/public/linaro/lkft/builds/2uX2EtC2pQdmVZ7ccoyhoi01Yy0/config
> > >
> > > --
> > > Linaro LKFT
> > > https://lkft.linaro.org
> > >
>
> - Naresh
>
^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2025-03-21 12:59 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2025-03-19 14:37 Fast model boot failure with Linux next-20250312 Naresh Kamboju
2025-03-19 14:55 ` Mark Rutland
2025-03-20 10:33 ` Naresh Kamboju
2025-03-21 12:57 ` Andre Przywara
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).