Booting CNS3420 EVB v 1.3 failed with 2.6.36 (and 2.6.35)

Booting CNS3420 EVB v 1.3 failed with 2.6.36 (and 2.6.35)

[Lin Mac]

Here's the my summary:
1. Booting CNS3420 EVB v 1.3 failed with linux 2.6.36 and .35
2. Build fails if enable DEBUG in head.S. ( but I guess the cause is not in
head.S, since at least "Decompressing" and "booting" is shown.)
3. How should I debug before start_kernel?

Following is the description of the issues:
--------------------------------------
CNS3420 EVB v 1.3
Linux 2.6.36 and 2.6.35
Using arch/arm/configs/cns3420vb_defconfig as default config.
Toolchain is Sourcery G++ Lite for ARM GNU/Linux, arm-2010-q1 and
arm-2009-q1

My u-boot use following bootcmd to boot image:
---
set kfile bootpImage;
set ramaddr 4000000;
set bootcmd mmc\;fatload mmc 0 \$(ramaddr) \$(kfile)\; go
\$(ramaddr);saveenv;
---
As for the ramaddr, I've tried 0x10000, 0x80000, 0x100000, 0x200000,
0x4000000. All failed.

The u-boot message:
--
U-Boot 2008.10-mpcore-00653-g4f9d01a (Sep 17 2010 - 22:19:25)
Cavium Networks CNS3XXX SDK v1.0-1462

CPU: Cavium Networks CNS3000
ID Code: 410fb024 (Part number: 0xB02, Revision number: 4)
CPU ID: 900
Chip Version: c

DRAM:  256 MB
Flash: 128 MB
In:    serial
Out:   serial
Err:   serial
CPU works at 600 MHz (600/1/1)
DDR2 Speed is 400 MHz
Hit any key to stop autoboot:  0
mmc_init
Detected SD Card
reading bootpImage

9363530 bytes read
enter do_eth_down!!!
## Starting application at 0x04000000 ...
Uncompressing Li done, booting t
--

With RVDS, the CPU stops at:
--
PC=0x815c
...
0x815c: E1A00000: MOV r0,r0
0x8560: E28F3048: B 0x815c
...
--
The assembly seems really wrong, but I don't know where is it in the code.

So I tried to enable DEBUG in head.S with following patch:
----
diff --git a/arch/arm/boot/compressed/head.S
b/arch/arm/boot/compressed/head.S
index c5191b1..fbd04c1 100644
--- a/arch/arm/boot/compressed/head.S
+++ b/arch/arm/boot/compressed/head.S
@@ -17,6 +17,7 @@
  * 100% relocatable.  Any attempt to do so will result in a crash.
  * Please select one of the following when turning on debugging.
  */
+#define DEBUG
 #ifdef DEBUG

 #if defined(CONFIG_DEBUG_ICEDCC)
----

Then it failed at building:
----
  AS      arch/arm/boot/compressed/lib1funcs.o
arch/arm/boot/compressed/head.S: Assembler messages:
arch/arm/boot/compressed/head.S:1019: Error: too many positional arguments
arch/arm/boot/compressed/head.S:1036: Error: too many positional arguments
make[3]: *** [arch/arm/boot/compressed/head.o] Error 1
----

Best Regards,
Mac Lin
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.infradead.org/pipermail/linux-arm-kernel/attachments/20101105/2f70c3cb/attachment.html>

Booting CNS3420 EVB v 1.3 failed with 2.6.36 (and 2.6.35)

[Anton Vorontsov]

On Fri, Nov 05, 2010 at 11:08:25AM +0800, Lin Mac wrote:
> Here's the my summary:
> 1. Booting CNS3420 EVB v 1.3 failed with linux 2.6.36 and .35

I see you use zImage (bootpImage) for booting. The stock U-Boot
image from Cavium has incorrect (non-mainline) machid. You have
to specify a correct one and thus use uImage.

So, you need to build the kernel with the following command:

make LOADADDR=0x200000 uImage

And boot with these commands:

setenv machid ad8
setenv bootargs console=ttyS0,38400 ip=on
tftp 100000 uImage
bootm 100000

Thanks,

-- 
Anton Vorontsov
email: cbouatmailru at gmail.com
irc://irc.freenode.net/bd2

Booting CNS3420 EVB v 1.3 failed with 2.6.36 (and 2.6.35)

[Lin Mac]

2010/11/5 Anton Vorontsov <cbouatmailru@gmail.com>
> On Fri, Nov 05, 2010 at 11:08:25AM +0800, Lin Mac wrote:
> > Here's the my summary:
> > 1. Booting CNS3420 EVB v 1.3 failed with linux 2.6.36 and .35
> I see you use zImage (bootpImage) for booting. The stock U-Boot
> image from Cavium has incorrect (non-mainline) machid. You have
> to specify a correct one and thus use uImage.
> So, you need to build the kernel with the following command:
> make LOADADDR=0x200000 uImage
> And boot with these commands:
> setenv machid ad8

Thanks for the useful suggestions. Now it booted.

> setenv bootargs console=ttyS0,38400 ip=on
Changing this doesn't take effect. I was trying console=ttyS0,115200
and root=/dev/ram0, but it just boot with the configured parameter
instead of the given one.

Is it also the issue of u-boot?

> tftp 100000 uImage
> bootm 100000

BTW, the default boot command includes root=/dev/mmcblk0p1, but
CONFIG_MMC_SDHCI_CNS3XXX is not enabled.
Even if it is enabled, I got a crash once mounted. It works fine
without L1 cache enabled (CONFIG_CPU_ICACHE_DISABLE,
CONFIG_CPU_DCACHE_DISABLE). So it seems there are some cache coherency
issue on the SDHC device.

Crash log:
---
mice: PS/2 mouse device common for all mice
sdhci: Secure Digital Host Controller Interface driver
sdhci: Copyright(c) Pierre Ossman
mmc0: SDHCI controller on platform [platform] using PIO
Waiting for root device /dev/mmcblk0p2...
mmc0: Minimum clock frequency too high for identification mode
mmc0: new high speed SDHC card at address d629
mmcblk0: mmc0:d629 SD08G 7.40 GiB
mmcblk0: p1 p2
VFS: Mounted root (ext2 filesystem) readonly on device 179:2.
Freeing init memory: 96K
Kernel panic - not syncing: Attempted to kill init!
Backtrace:
[<c0024860>] (dump_backtrace+0x0/0x114) from [<c016cc70>] (dump_stack+0x18/0x1c)
r7:c7815bc0 r6:c7815bc0 r5:c7819ee0 r4:c01f6510
[<c016cc58>] (dump_stack+0x0/0x1c) from [<c016ccd4>] (panic+0x60/0x17c)
[<c016cc74>] (panic+0x0/0x17c) from [<c0032ba4>] (do_exit+0x7c/0x5b4)
r3:c01ec260 r2:c7819e40 r1:c7815cbc r0:c01bd3af
[<c0032b28>] (do_exit+0x0/0x5b4) from [<c0033160>] (do_group_exit+0x84/0xb8)
[<c00330dc>] (do_group_exit+0x0/0xb8) from [<c003dcdc>]
(get_signal_to_deliver+0x2b8/0x2e8)
r5:c7819ee0 r4:0000000b
[<c003da24>] (get_signal_to_deliver+0x0/0x2e8) from [<c0023804>]
(do_notify_resume+0x64/0x628)
[<c00237a0>] (do_notify_resume+0x0/0x628) from [<c0020e98>]
(work_pending+0x24/0x28)
----

I tried to hack it with the following patch but still failed.

---
diff --git a/drivers/mmc/host/sdhci.c b/drivers/mmc/host/sdhci.c
index 401527d..3ccd686 100644
--- a/drivers/mmc/host/sdhci.c
+++ b/drivers/mmc/host/sdhci.c
@@ -332,6 +332,9 @@ static void sdhci_write_block_pio(struct sdhci_host *host)
 		}
 	}

+#ifdef CONFIG_MMC_SDHCI_CNS3XXX
+	flush_dcache_page(host->sg_miter.page);
+#endif
 	sg_miter_stop(&host->sg_miter);

 	local_irq_restore(flags);
---
Do you have any clue?


Best Regards,
Mac Lin.

Booting CNS3420 EVB v 1.3 failed with 2.6.36 (and 2.6.35)

[Lin Mac]

2010/11/5 Lin Mac <mkl0301@gmail.com>:
> 3. How should I debug before start_kernel?
> 9363530 bytes read
> enter do_eth_down!!!
> ## Starting application at 0x04000000 ...
> Uncompressing Li done, booting t
> --
>
> With RVDS, the CPU stops at:
> --
> PC=0x815c
> ...
> 0x815c: E1A00000: MOV r0,r0
> 0x8560: E28F3048: B 0x815c
> ...
> --
> The assembly seems really wrong, but I don't know where is it in the code.
> So I tried to enable DEBUG in head.S with following patch:
> ----
> diff --git a/arch/arm/boot/compressed/head.S
> b/arch/arm/boot/compressed/head.S
> index c5191b1..fbd04c1 100644
> --- a/arch/arm/boot/compressed/head.S
> +++ b/arch/arm/boot/compressed/head.S
> @@ -17,6 +17,7 @@
>   * 100% relocatable.  Any attempt to do so will result in a crash.
>   * Please select one of the following when turning on debugging.
>   */
> +#define DEBUG
>  #ifdef DEBUG
>
>  #if defined(CONFIG_DEBUG_ICEDCC)
> ----
>
> Then it failed at building:
> ----
>   AS      arch/arm/boot/compressed/lib1funcs.o
> arch/arm/boot/compressed/head.S: Assembler messages:
> arch/arm/boot/compressed/head.S:1019: Error: too many positional arguments
> arch/arm/boot/compressed/head.S:1036: Error: too many positional arguments
> make[3]: *** [arch/arm/boot/compressed/head.o] Error 1
> ----
I guess I would need some help in this regard.
Though this issue is solved, but I often get stuck before start_kernel
recently (sigh*) while make some tries. I could do nothing when it
happens. RVDS only provide disassembly, and there is no way for me to
know where the source code the disassembly maps to.

Any tool available for debuging assembly like RVDS do with C?
How can I print some info here? I tried to enable DEBUG in
arch/arm/boot/compressed/head.S but faild.

Really appreciate for any helps.

Best Regards,
Mac Lin

Booting CNS3420 EVB v 1.3 failed with 2.6.36 (and 2.6.35)

[Anton Vorontsov]

On Tue, Nov 09, 2010 at 03:12:25PM +0800, Lin Mac wrote:
> > So, you need to build the kernel with the following command:
> > make LOADADDR=0x200000 uImage
> > And boot with these commands:
> > setenv machid ad8
> 
> Thanks for the useful suggestions. Now it booted.

Great!

> > setenv bootargs console=ttyS0,38400 ip=on
> Changing this doesn't take effect. I was trying console=ttyS0,115200
> and root=/dev/ram0, but it just boot with the configured parameter
> instead of the given one.
> 
> Is it also the issue of u-boot?

Nope. Just remove CONFIG_CMDLINE from your kernel .config file. ;-)

> > tftp 100000 uImage
> > bootm 100000
> 
> BTW, the default boot command includes root=/dev/mmcblk0p1, but
> CONFIG_MMC_SDHCI_CNS3XXX is not enabled.
> Even if it is enabled, I got a crash once mounted. It works fine
> without L1 cache enabled (CONFIG_CPU_ICACHE_DISABLE,
> CONFIG_CPU_DCACHE_DISABLE). So it seems there are some cache coherency
> issue on the SDHC device.

I recalling I observed something like this, and it was somehow
related to the memory setup. The old (Jan 20 2010) U-Boot that
I used was configuring RAM incorrectly, and caches were just
unveiling the problem.

But, I see that you use quite new build of the U-Boot (Sep 2010),
so I'm not sure if that's the same problem as I had. Can you try
booting with something simple, e.g. init=/bin/sh?

Thanks,

-- 
Anton Vorontsov
email: cbouatmailru at gmail.com
irc://irc.freenode.net/bd2

Booting CNS3420 EVB v 1.3 failed with 2.6.36 (and 2.6.35)

[Russell King - ARM Linux]

On Tue, Nov 09, 2010 at 01:14:33PM +0300, Anton Vorontsov wrote:
> On Tue, Nov 09, 2010 at 03:12:25PM +0800, Lin Mac wrote:
> > > setenv bootargs console=ttyS0,38400 ip=on
> > Changing this doesn't take effect. I was trying console=ttyS0,115200
> > and root=/dev/ram0, but it just boot with the configured parameter
> > instead of the given one.
> > 
> > Is it also the issue of u-boot?
> 
> Nope. Just remove CONFIG_CMDLINE from your kernel .config file. ;-)

No.  The external command line overrides the built-in one unless
CMDLINE_FORCE is set.

Booting CNS3420 EVB v 1.3 failed with 2.6.36 (and 2.6.35)

[Lin Mac]

2010/11/9 Anton Vorontsov <cbouatmailru@gmail.com>:
>> BTW, the default boot command includes root=/dev/mmcblk0p1, but
>> CONFIG_MMC_SDHCI_CNS3XXX is not enabled.
>> Even if it is enabled, I got a crash once mounted. It works fine
>> without L1 cache enabled (CONFIG_CPU_ICACHE_DISABLE,
>> CONFIG_CPU_DCACHE_DISABLE). So it seems there are some cache coherency
>> issue on the SDHC device.
> I recalling I observed something like this, and it was somehow
> related to the memory setup. The old (Jan 20 2010) U-Boot that
> I used was configuring RAM incorrectly, and caches were just
> unveiling the problem.

I was using vanilla kernel. And I just found that Catalin's patches
for cache maintenance changes is not in vanilla kernel. Using
Catalin's kernel fixed this issue. It is due to the SDHCI driver is in
PIO mode, and hit the cache coherency issue with PIO mode.

Best Regards,
Mac Lin.

Booting CNS3420 EVB v 1.3 failed with 2.6.36 (and 2.6.35)

[Lin Mac]

2010/11/9 Russell King - ARM Linux <linux@arm.linux.org.uk>:
> On Tue, Nov 09, 2010 at 01:14:33PM +0300, Anton Vorontsov wrote:
>> On Tue, Nov 09, 2010 at 03:12:25PM +0800, Lin Mac wrote:
>> > > setenv bootargs console=ttyS0,38400 ip=on
>> > Changing this doesn't take effect. I was trying console=ttyS0,115200
>> > and root=/dev/ram0, but it just boot with the configured parameter
>> > instead of the given one.
>> > Is it also the issue of u-boot?
>> Nope. Just remove CONFIG_CMDLINE from your kernel .config file. ;-)
> No. ?The external command line overrides the built-in one unless
> CMDLINE_FORCE is set.

I have confirmed that CONFIG_CMDLINE_FORCE is not set.
Removing the CONFIG_CMDLINE caused linux boot fails:
--
CNS3000 # print
baudrate=38400
ethaddr=00:53:43:4F:54:54
ipaddr=172.20.5.230
serverip=172.20.5.200
netmask=255.255.0.0
bootfile="/tftpboot/uImage"
tftp_bsize=512
udp_frag_size=512
bootdelay=1
cpu_clock=600
machid=ad8
kfile=uImage
ramaddr=4000000
bootcmd=mmc;fatload mmc 0 $(ramaddr) $(kfile); bootm $(ramaddr)
bootargs=console=ttyS0,38400 mem=128M root=/dev/mmcblk0p1 ro rootwait
stdin=serial
stdout=serial
stderr=serial

Environment size: 405/131068 bytes
CNS3000 #

U-Boot 2008.10-mpcore-dirty (Nov  8 2010 - 11:44:24)
Cavium Networks CNS3XXX informal version after v1.0-1462

CPU: Cavium Networks CNS3000
ID Code: 410fb024 (Part number: 0xB02, Revision number: 4)
CPU ID: 900
Chip Version: c

DRAM:  256 MB
Flash: 128 MB
In:    serial
Out:   serial
Err:   serial
CPU works at 600 MHz (600/1/1)
DDR2 Speed is 400 MHz
Hit any key to stop autoboot:  0
mmc_init
Detected SD Card
reading uImage

1002232 bytes read
## Booting kernel from Legacy Image at 04000000 ...
   Image Name:   Linux-2.6.36+
   Created:      2010-11-10   4:04:35 UTC
   Image Type:   ARM Linux Kernel Image (uncompressed)
   Data Size:    1002168 Bytes = 978.7 kB
   Load Address: 00200000
   Entry Point:  00200000
   Verifying Checksum ... OK
   Loading Kernel Image ... OK
OK
Using machid 0xad8 from environment

Starting kernel ...

Uncompressing Li done, booting t
---

Best Regards,
Mac Lin

Booting CNS3420 EVB v 1.3 failed with 2.6.36 (and 2.6.35)

[Lin Mac]

2010/11/10 Lin Mac <mkl0301@gmail.com>:
> 2010/11/9 Russell King - ARM Linux <linux@arm.linux.org.uk>:
>> On Tue, Nov 09, 2010 at 01:14:33PM +0300, Anton Vorontsov wrote:
>>> On Tue, Nov 09, 2010 at 03:12:25PM +0800, Lin Mac wrote:
>>> > > setenv bootargs console=ttyS0,38400 ip=on
>>> > Changing this doesn't take effect. I was trying console=ttyS0,115200
>>> > and root=/dev/ram0, but it just boot with the configured parameter
>>> > instead of the given one.
>>> > Is it also the issue of u-boot?
>>> Nope. Just remove CONFIG_CMDLINE from your kernel .config file. ;-)
>> No. ?The external command line overrides the built-in one unless
>> CMDLINE_FORCE is set.
> I have confirmed that CONFIG_CMDLINE_FORCE is not set.
> Removing the CONFIG_CMDLINE caused linux boot fails:
It is fixed by enabling u-boot config CONFIG_CMDLINE_TAG,
CONFIG_SETUP_MEMORY_TAGS, CONFIG_MISC_INIT_R. Now it works just fine.
Thanks.

Best Regards,
Mac Lin

Booting CNS3420 EVB v 1.3 failed with 2.6.36 (and 2.6.35)

[Russell King - ARM Linux]

On Fri, Nov 05, 2010 at 11:08:25AM +0800, Lin Mac wrote:
> So I tried to enable DEBUG in head.S with following patch:
> ----
> diff --git a/arch/arm/boot/compressed/head.S
> b/arch/arm/boot/compressed/head.S
> index c5191b1..fbd04c1 100644
> --- a/arch/arm/boot/compressed/head.S
> +++ b/arch/arm/boot/compressed/head.S
> @@ -17,6 +17,7 @@
>   * 100% relocatable.  Any attempt to do so will result in a crash.
>   * Please select one of the following when turning on debugging.
>   */
> +#define DEBUG
>  #ifdef DEBUG
> 
>  #if defined(CONFIG_DEBUG_ICEDCC)
> ----
> 
> Then it failed at building:
> ----
>   AS      arch/arm/boot/compressed/lib1funcs.o
> arch/arm/boot/compressed/head.S: Assembler messages:
> arch/arm/boot/compressed/head.S:1019: Error: too many positional arguments
> arch/arm/boot/compressed/head.S:1036: Error: too many positional arguments
> make[3]: *** [arch/arm/boot/compressed/head.o] Error 1

Please do:

make ARCH=arm CROSS_COMPILE=... arch/arm/boot/compressed/head.s

and send me (in private mail) a copy of head.s.  Thanks.

Booting CNS3420 EVB v 1.3 failed with 2.6.36 (and 2.6.35)

[Lin Mac]

2010/11/12 Russell King - ARM Linux <linux@arm.linux.org.uk>:
> On Fri, Nov 05, 2010 at 11:08:25AM +0800, Lin Mac wrote:
>> So I tried to enable DEBUG in head.S with following patch:
>> Then it failed at building:
>> ----
>> ? AS ? ? ?arch/arm/boot/compressed/lib1funcs.o
>> arch/arm/boot/compressed/head.S: Assembler messages:
>> arch/arm/boot/compressed/head.S:1019: Error: too many positional arguments
>> arch/arm/boot/compressed/head.S:1036: Error: too many positional arguments
>> make[3]: *** [arch/arm/boot/compressed/head.o] Error 1
> Please do:
> make ARCH=arm CROSS_COMPILE=... arch/arm/boot/compressed/head.s
> and send me (in private mail) a copy of head.s. ?Thanks.
It is fixed. I'll send the patch.

Best Regards,
Mac Lin.