From: Russell King - ARM Linux admin <linux@armlinux.org.uk>
To: Chris Packham <Chris.Packham@alliedtelesis.co.nz>
Cc: Hamish Martin <Hamish.Martin@alliedtelesis.co.nz>,
"ard.biesheuvel@linaro.org" <ard.biesheuvel@linaro.org>,
"linus.walleij@linaro.org" <linus.walleij@linaro.org>,
"nico@fluxnic.net" <nico@fluxnic.net>,
"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
"stefan@agner.ch" <stefan@agner.ch>,
"tglx@linutronix.de" <tglx@linutronix.de>,
"natechancellor@gmail.com" <natechancellor@gmail.com>,
"linux-arm-kernel@lists.infradead.org"
<linux-arm-kernel@lists.infradead.org>
Subject: Re: ARM expections for location of kernel, ramdisk and dtb
Date: Wed, 27 Nov 2019 23:19:00 +0000 [thread overview]
Message-ID: <20191127231900.GG25745@shell.armlinux.org.uk> (raw)
In-Reply-To: <c108d58e3ee511040bb99edb28c893b27b238bdb.camel@alliedtelesis.co.nz>
On Wed, Nov 27, 2019 at 10:15:57PM +0000, Chris Packham wrote:
> Hi Russell,
>
> On Wed, 2019-11-27 at 09:26 +0000, Russell King - ARM Linux admin
> wrote:
> > On Wed, Nov 27, 2019 at 08:20:12AM +0000, Chris Packham wrote:
> > > Hi All,
> > >
> > > We're updating our systems to use the latest kernel. For many of them
> > > this is a fairly large leap. One problem we've hit is that durng boot
> > > the dtb is clobbered by the uncompressed kernel.
> > >
> > > Here's a snippet of output from u-boot
> > >
> > > ## Loading kernel from FIT Image at 62000000 ...
> > > Using 'XS916MXS@2' configuration
> > > Trying 'kernel@1' kernel subimage
> > > Description: linux
> > > Created: 2019-11-27 6:53:48 UTC
> > > Type: Kernel Image
> > > Compression: uncompressed
> > > Data Start: 0x62000174
> > > Data Size: 3495432 Bytes = 3.3 MiB
> > > Architecture: ARM
> > > OS: Linux
> > > Load Address: 0x00800000
> > > Entry Point: 0x60800000
> > > ...
> > > Booting using the fdt blob at 0x63b90f6c
> > > Loading Kernel Image ... OK
> > > Loading Ramdisk to 6e7c6000, end 70000000 ... OK
> > > Loading Device Tree to 607fb000, end 607fffd8 ... OK
> > >
> > > Starting kernel ...
> > >
> > > Uncompressing Linux... done, booting the kernel.
> > >
> > > Error: invalid dtb and unrecognized/unsupported machine ID
> > > r1=0x0000206e, r2=0x00000000
> > >
> > > Between old and new the location of the devicetree hasn't actually
> > > changed. But what has changed is the size of the kernel the self
> > > extracting kernel unpacks to 0x60008000 and with our current
> > > configuration extends into where the dtb is located.
> > >
> > > Documentation/arm/booting.rst says that "The dtb must be placed in a
> > > region of memory where the kernel decompressor will not overwrite it".
> > >
> > > This suggests that the problem is with our u-boot configuration, but
> > > how is u-boot supposed to know where the self-extracting kernel is
> > > going to place things? As far as I can tell u-boot is doing a
> > > reasonable job of finding a place to put the dtb which it thinks is
> > > unused. I'm not sure why it's picked 0x607fb000 instead of putting it
> > > just under the ramdisk but regardless with the information u-boot has
> > > that address is up for grabs.
> > >
> > > Has this come up before? The self-extraction code is fairly careful not
> > > to overwrite itself but doesn't seem to pay any attention to the dtb
> > > which surprised me. So I wonder if I'm missing something?
> >
> > The self-extraction hasn't changed much over the years, and basically
> > follows the same method which has worked for the vast majority of
> > platforms.
> >
> > Where things fall down is where things are placed too close, and yes,
> > as the kernel grows, what was reasonable years ago becomes too close
> > with modern kernels.
> >
> > The problem has been compounded by the various different compression
> > algorithms that can now be used for the compressed kernel.
> >
>
> I don't think it's that we don't know how big the extracted kernel will
> be. It's just that we aren't doing anything with that information w.r.t
> the dtb.
I believe u-boot tried at one point to instigate some kind of standard
placement of the kernel / dtb with respect to the available RAM, but
vendors tried hard to ignore u-boot and go their own way - resulting
in systems that didn't boot without customising various u-boot
environment variables. It's very annoying when vendors ignore the
community...
--
RMK's Patch system: https://www.armlinux.org.uk/developer/patches/
FTTC broadband for 0.8mile line in suburbia: sync at 12.1Mbps down 622kbps up
According to speedtest.net: 11.9Mbps down 500kbps up
_______________________________________________
linux-arm-kernel mailing list
linux-arm-kernel@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
WARNING: multiple messages have this Message-ID (diff)
From: Russell King - ARM Linux admin <linux@armlinux.org.uk>
To: Chris Packham <Chris.Packham@alliedtelesis.co.nz>
Cc: Hamish Martin <Hamish.Martin@alliedtelesis.co.nz>,
"nico@fluxnic.net" <nico@fluxnic.net>,
"linus.walleij@linaro.org" <linus.walleij@linaro.org>,
"ard.biesheuvel@linaro.org" <ard.biesheuvel@linaro.org>,
"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
"stefan@agner.ch" <stefan@agner.ch>,
"tglx@linutronix.de" <tglx@linutronix.de>,
"natechancellor@gmail.com" <natechancellor@gmail.com>,
"linux-arm-kernel@lists.infradead.org"
<linux-arm-kernel@lists.infradead.org>
Subject: Re: ARM expections for location of kernel, ramdisk and dtb
Date: Wed, 27 Nov 2019 23:19:00 +0000 [thread overview]
Message-ID: <20191127231900.GG25745@shell.armlinux.org.uk> (raw)
In-Reply-To: <c108d58e3ee511040bb99edb28c893b27b238bdb.camel@alliedtelesis.co.nz>
On Wed, Nov 27, 2019 at 10:15:57PM +0000, Chris Packham wrote:
> Hi Russell,
>
> On Wed, 2019-11-27 at 09:26 +0000, Russell King - ARM Linux admin
> wrote:
> > On Wed, Nov 27, 2019 at 08:20:12AM +0000, Chris Packham wrote:
> > > Hi All,
> > >
> > > We're updating our systems to use the latest kernel. For many of them
> > > this is a fairly large leap. One problem we've hit is that durng boot
> > > the dtb is clobbered by the uncompressed kernel.
> > >
> > > Here's a snippet of output from u-boot
> > >
> > > ## Loading kernel from FIT Image at 62000000 ...
> > > Using 'XS916MXS@2' configuration
> > > Trying 'kernel@1' kernel subimage
> > > Description: linux
> > > Created: 2019-11-27 6:53:48 UTC
> > > Type: Kernel Image
> > > Compression: uncompressed
> > > Data Start: 0x62000174
> > > Data Size: 3495432 Bytes = 3.3 MiB
> > > Architecture: ARM
> > > OS: Linux
> > > Load Address: 0x00800000
> > > Entry Point: 0x60800000
> > > ...
> > > Booting using the fdt blob at 0x63b90f6c
> > > Loading Kernel Image ... OK
> > > Loading Ramdisk to 6e7c6000, end 70000000 ... OK
> > > Loading Device Tree to 607fb000, end 607fffd8 ... OK
> > >
> > > Starting kernel ...
> > >
> > > Uncompressing Linux... done, booting the kernel.
> > >
> > > Error: invalid dtb and unrecognized/unsupported machine ID
> > > r1=0x0000206e, r2=0x00000000
> > >
> > > Between old and new the location of the devicetree hasn't actually
> > > changed. But what has changed is the size of the kernel the self
> > > extracting kernel unpacks to 0x60008000 and with our current
> > > configuration extends into where the dtb is located.
> > >
> > > Documentation/arm/booting.rst says that "The dtb must be placed in a
> > > region of memory where the kernel decompressor will not overwrite it".
> > >
> > > This suggests that the problem is with our u-boot configuration, but
> > > how is u-boot supposed to know where the self-extracting kernel is
> > > going to place things? As far as I can tell u-boot is doing a
> > > reasonable job of finding a place to put the dtb which it thinks is
> > > unused. I'm not sure why it's picked 0x607fb000 instead of putting it
> > > just under the ramdisk but regardless with the information u-boot has
> > > that address is up for grabs.
> > >
> > > Has this come up before? The self-extraction code is fairly careful not
> > > to overwrite itself but doesn't seem to pay any attention to the dtb
> > > which surprised me. So I wonder if I'm missing something?
> >
> > The self-extraction hasn't changed much over the years, and basically
> > follows the same method which has worked for the vast majority of
> > platforms.
> >
> > Where things fall down is where things are placed too close, and yes,
> > as the kernel grows, what was reasonable years ago becomes too close
> > with modern kernels.
> >
> > The problem has been compounded by the various different compression
> > algorithms that can now be used for the compressed kernel.
> >
>
> I don't think it's that we don't know how big the extracted kernel will
> be. It's just that we aren't doing anything with that information w.r.t
> the dtb.
I believe u-boot tried at one point to instigate some kind of standard
placement of the kernel / dtb with respect to the available RAM, but
vendors tried hard to ignore u-boot and go their own way - resulting
in systems that didn't boot without customising various u-boot
environment variables. It's very annoying when vendors ignore the
community...
--
RMK's Patch system: https://www.armlinux.org.uk/developer/patches/
FTTC broadband for 0.8mile line in suburbia: sync at 12.1Mbps down 622kbps up
According to speedtest.net: 11.9Mbps down 500kbps up
next prev parent reply other threads:[~2019-11-27 23:21 UTC|newest]
Thread overview: 10+ messages / expand[flat|nested] mbox.gz Atom feed top
2019-11-27 8:20 ARM expections for location of kernel, ramdisk and dtb Chris Packham
2019-11-27 8:20 ` Chris Packham
2019-11-27 9:26 ` Russell King - ARM Linux admin
2019-11-27 9:26 ` Russell King - ARM Linux admin
2019-11-27 22:15 ` Chris Packham
2019-11-27 22:15 ` Chris Packham
2019-11-27 23:19 ` Russell King - ARM Linux admin [this message]
2019-11-27 23:19 ` Russell King - ARM Linux admin
2019-11-27 23:53 ` Stefan Agner
2019-11-27 23:53 ` Stefan Agner
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20191127231900.GG25745@shell.armlinux.org.uk \
--to=linux@armlinux.org.uk \
--cc=Chris.Packham@alliedtelesis.co.nz \
--cc=Hamish.Martin@alliedtelesis.co.nz \
--cc=ard.biesheuvel@linaro.org \
--cc=linus.walleij@linaro.org \
--cc=linux-arm-kernel@lists.infradead.org \
--cc=linux-kernel@vger.kernel.org \
--cc=natechancellor@gmail.com \
--cc=nico@fluxnic.net \
--cc=stefan@agner.ch \
--cc=tglx@linutronix.de \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.