From: Kevin Hilman <khilman@baylibre.com>
To: Guillaume Tucker <guillaume.tucker@collabora.com>,
Olof Johansson <olof@lixom.net>
Cc: Tomeu Vizoso <tomeu.vizoso@collabora.com>,
Tony Lindgren <tony@atomide.com>,
LinusW <linus.walleij@linaro.org>,
Mark Brown <broonie@kernel.org>,
matthew.hart@linaro.org,
Enric Balletbo i Serra <enric.balletbo@collabora.com>,
linux-omap <linux-omap@vger.kernel.org>,
Linux ARM Mailing List <linux-arm-kernel@lists.infradead.org>
Subject: Re: mainline/master boot bisection: v4.19-12838-g71e56028173b on beagle-xm
Date: Thu, 08 Nov 2018 14:34:51 -0800 [thread overview]
Message-ID: <7hbm6z6vw4.fsf@baylibre.com> (raw)
In-Reply-To: <4b7922f2-6428-3011-0338-9c0662712b8a@collabora.com>
Guillaume Tucker <guillaume.tucker@collabora.com> writes:
> On 06/11/2018 10:54, Guillaume Tucker wrote:
>> On 05/11/2018 14:33, Olof Johansson wrote:
>>> On Mon, Nov 5, 2018 at 1:43 AM Guillaume Tucker
>>> <guillaume.tucker@collabora.com> wrote:
>>>>
>>>> Hi Linus,
>>>>
>>>> Please see below, the kernelci.org automated boot bisection found
>>>> that the OMAP3 BeagleBoard-xM is failing to boot with SMP
>>>> disabled and PREEMPT enabled in multi_v7_defconfig. There is no
>>>> log output after the bootloader so the kernel seems to be
>>>> crashing very early on.
>>>
>>> Can you enable DEBUG_LL to capture what goes wrong?
>>
>> Yes I've scheduled a re-run of the automated bisection with
>> DEBUG_LL turned on, but the beagle-xm board is currently offline
>> in lab-baylibre. I'll keep you posted when I get some results.
>
> Unfortunately, enabling the DEBUG_LL config didn't help. There's
> still no visible kernel log at all from the failing LAVA jobs:
>
> http://lava.baylibre.com:10080/scheduler/alljobs?length=25&search=lava-bisect-9638#table
>
>
> This might be a hard one to debug without physical access to the
> board, but please let me know if you think there's anything else
> I can try. For example, if there's a known older kernel revision
> where the combination of SMP=n and PREEMPT=y worked then I could
> try to run an automated boot bisection based on that.
The reason DEBUG_LL doesn't show anything is because it also needs
a specific UART enabled for the output. For the case of beagle-xm, it
needs CONFIG_DEBUG_OMAP3UART3=y also.
It did that locally, and the error on the console is this:
Error: invalid dtb and unrecognized/unsupported machine ID
r1=0x0000060a, r2=0x00000000
Available machine support:
Upon closer inspection, the load addrs are such that it appears the DTB
is getting overwritten during zImage compression.
So bascially, it's just an (un)lucky fluke that CONFIG_PREEMPT=y changed
the kernel size just enough to cause this problem.
I did a local test (with pyboot, not LAVA) with all the same load
addresses, but without initrd_high and fdt_high, and it boots fine[1]
Guillaume, I think the proper solution is to fixup the LAVA device-type
for beagle-xm. In particular, it's setting the u-boot variables
'initrd_high' and 'fdt_high' which means it's not letting uboot move
them.
Looks like that can be overridden in the device-dict using
"set base_high_limits = false", so I've done that now to this device[2]
Kevin
[1] http://termbin.com/9mm6
[2] http://lava.baylibre.com:10080/scheduler/device/omap3-beagle-xm-sea/devicedict
WARNING: multiple messages have this Message-ID (diff)
From: khilman@baylibre.com (Kevin Hilman)
To: linux-arm-kernel@lists.infradead.org
Subject: mainline/master boot bisection: v4.19-12838-g71e56028173b on beagle-xm
Date: Thu, 08 Nov 2018 14:34:51 -0800 [thread overview]
Message-ID: <7hbm6z6vw4.fsf@baylibre.com> (raw)
In-Reply-To: <4b7922f2-6428-3011-0338-9c0662712b8a@collabora.com>
Guillaume Tucker <guillaume.tucker@collabora.com> writes:
> On 06/11/2018 10:54, Guillaume Tucker wrote:
>> On 05/11/2018 14:33, Olof Johansson wrote:
>>> On Mon, Nov 5, 2018 at 1:43 AM Guillaume Tucker
>>> <guillaume.tucker@collabora.com> wrote:
>>>>
>>>> Hi Linus,
>>>>
>>>> Please see below, the kernelci.org automated boot bisection found
>>>> that the OMAP3 BeagleBoard-xM is failing to boot with SMP
>>>> disabled and PREEMPT enabled in multi_v7_defconfig. There is no
>>>> log output after the bootloader so the kernel seems to be
>>>> crashing very early on.
>>>
>>> Can you enable DEBUG_LL to capture what goes wrong?
>>
>> Yes I've scheduled a re-run of the automated bisection with
>> DEBUG_LL turned on, but the beagle-xm board is currently offline
>> in lab-baylibre. I'll keep you posted when I get some results.
>
> Unfortunately, enabling the DEBUG_LL config didn't help. There's
> still no visible kernel log at all from the failing LAVA jobs:
>
> http://lava.baylibre.com:10080/scheduler/alljobs?length=25&search=lava-bisect-9638#table
>
>
> This might be a hard one to debug without physical access to the
> board, but please let me know if you think there's anything else
> I can try. For example, if there's a known older kernel revision
> where the combination of SMP=n and PREEMPT=y worked then I could
> try to run an automated boot bisection based on that.
The reason DEBUG_LL doesn't show anything is because it also needs
a specific UART enabled for the output. For the case of beagle-xm, it
needs CONFIG_DEBUG_OMAP3UART3=y also.
It did that locally, and the error on the console is this:
Error: invalid dtb and unrecognized/unsupported machine ID
r1=0x0000060a, r2=0x00000000
Available machine support:
Upon closer inspection, the load addrs are such that it appears the DTB
is getting overwritten during zImage compression.
So bascially, it's just an (un)lucky fluke that CONFIG_PREEMPT=y changed
the kernel size just enough to cause this problem.
I did a local test (with pyboot, not LAVA) with all the same load
addresses, but without initrd_high and fdt_high, and it boots fine[1]
Guillaume, I think the proper solution is to fixup the LAVA device-type
for beagle-xm. In particular, it's setting the u-boot variables
'initrd_high' and 'fdt_high' which means it's not letting uboot move
them.
Looks like that can be overridden in the device-dict using
"set base_high_limits = false", so I've done that now to this device[2]
Kevin
[1] http://termbin.com/9mm6
[2] http://lava.baylibre.com:10080/scheduler/device/omap3-beagle-xm-sea/devicedict
next prev parent reply other threads:[~2018-11-08 22:34 UTC|newest]
Thread overview: 18+ messages / expand[flat|nested] mbox.gz Atom feed top
[not found] <5bdebe88.1c69fb81.3857a.05d1@mx.google.com>
2018-11-05 9:43 ` mainline/master boot bisection: v4.19-12838-g71e56028173b on beagle-xm Guillaume Tucker
2018-11-05 9:43 ` Guillaume Tucker
2018-11-05 14:33 ` Olof Johansson
2018-11-05 14:33 ` Olof Johansson
2018-11-06 10:54 ` Guillaume Tucker
2018-11-06 10:54 ` Guillaume Tucker
2018-11-07 16:09 ` Guillaume Tucker
2018-11-07 16:09 ` Guillaume Tucker
2018-11-07 16:16 ` Olof Johansson
2018-11-07 16:16 ` Olof Johansson
2018-11-08 15:54 ` Tony Lindgren
2018-11-08 15:54 ` Tony Lindgren
2018-11-08 22:34 ` Kevin Hilman [this message]
2018-11-08 22:34 ` Kevin Hilman
2018-11-09 0:32 ` Olof Johansson
2018-11-09 0:32 ` Olof Johansson
2018-11-09 8:52 ` Linus Walleij
2018-11-09 8:52 ` Linus Walleij
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=7hbm6z6vw4.fsf@baylibre.com \
--to=khilman@baylibre.com \
--cc=broonie@kernel.org \
--cc=enric.balletbo@collabora.com \
--cc=guillaume.tucker@collabora.com \
--cc=linus.walleij@linaro.org \
--cc=linux-arm-kernel@lists.infradead.org \
--cc=linux-omap@vger.kernel.org \
--cc=matthew.hart@linaro.org \
--cc=olof@lixom.net \
--cc=tomeu.vizoso@collabora.com \
--cc=tony@atomide.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.