kernel boot broken since 4.5 on t5220 ( niagara2 ) machine

kernel boot broken since 4.5 on t5220 ( niagara2 ) machine

[Joerg Abraham]

[-- Attachment #1: Type: text/plain, Size: 446 bytes --]

Hi,

since kernel version 4.5 my t5220 does not boot anymore, small logs 
attached...

bisecting the problem points to commit:

1a40b95374f680625318ab61d81958e949e0afe3

or

1a40b95 (sparc: Fix system call tracing register handling.)

I verified that reverting the above commit solves the kernel boot 
problem on stable 4.5.2 and master of today.

Let me know what I can do to help tracking down that issue or if I'm 
doing anything else stupid


[-- Attachment #2: t5220-log.txt --]
[-- Type: text/plain, Size: 10018 bytes --]

# plain v4.5.2


SPARC Enterprise T5220, No Keyboard
Copyright (c) 1998, 2012, Oracle and/or its affiliates. All rights reserved.
OpenBoot 4.33.6.a, 32640 MB memory available, Serial #85341390.
Ethernet address 0:21:28:16:34:ce, Host ID: 851634ce.



Boot device: disk0  File and args: 
SILO Version 1.4.14_git20120819_p1
boot: 
Allocated 64 Megs of memory at 0x40000000 for kernel
Uncompressing image...
Loaded kernel version 4.5.2

[    0.000000] PROMLIB: Sun IEEE Boot Prom 'OBP 4.33.6.a 2012/03/29 11:22'
[    0.000000] PROMLIB: Root node compatible: sun4v
[    0.000000] Linux version 4.5.2-chja (joerg@t5220) (gcc version 5.3.1 20160315 (GCC) ) #29 SMP Tue Apr 26 12:47:47 CEST 2016
[    0.000000] bootconsole [earlyprom0] enabled
[    0.000000] ARCH: SUN4V
[    0.000000] Ethernet address: 00:21:28:16:34:ce
[    0.000000] MM: PAGE_OFFSET is 0xffff800000000000 (max_phys_bits == 39)
[    0.000000] MM: VMALLOC [0x0000000100000000 --> 0x0000600000000000]
[    0.000000] MM: VMEMMAP [0x0000600000000000 --> 0x0000c00000000000]
[    0.000000] Kernel: Using 3 locked TLB entries for main kernel image.
[    0.000000] Remapping the kernel... done.
ERROR: Last Trap: Watchdog Reset

{0} ok


# v4.5.2 + 1a40b95374f680625318ab61d81958e949e0afe3 reverted


SPARC Enterprise T5220, No Keyboard
Copyright (c) 1998, 2012, Oracle and/or its affiliates. All rights reserved.
OpenBoot 4.33.6.a, 32640 MB memory available, Serial #85341390.
Ethernet address 0:21:28:16:34:ce, Host ID: 851634ce.



Boot device: disk0  File and args: 
SILO Version 1.4.14_git20120819_p1
boot: 
Allocated 64 Megs of memory at 0x40000000 for kernel
Uncompressing image...
Loaded kernel version 4.5.2

[    0.000000] PROMLIB: Sun IEEE Boot Prom 'OBP 4.33.6.a 2012/03/29 11:22'
[    0.000000] PROMLIB: Root node compatible: sun4v
[    0.000000] Linux version 4.5.2-chja+ (joerg@t5220) (gcc version 5.3.1 20160315 (GCC) ) #30 SMP Tue Apr 26 13:48:06 CEST 2016
[    0.000000] bootconsole [earlyprom0] enabled
[    0.000000] ARCH: SUN4V
[    0.000000] Ethernet address: 00:21:28:16:34:ce
[    0.000000] MM: PAGE_OFFSET is 0xffff800000000000 (max_phys_bits == 39)
[    0.000000] MM: VMALLOC [0x0000000100000000 --> 0x0000600000000000]
[    0.000000] MM: VMEMMAP [0x0000600000000000 --> 0x0000c00000000000]
[    0.000000] Kernel: Using 3 locked TLB entries for main kernel image.
[    0.000000] Remapping the kernel... done.
[    0.000000] OF stdout device is: /virtual-devices@100/console@1
[    0.000000] PROM: Built device tree with 225794 bytes of memory.
[    0.000000] MDESC: Size is 62096 bytes.
[    0.000000] PLATFORM: banner-name [SPARC Enterprise T5220]
[    0.000000] PLATFORM: name [SUNW,SPARC-Enterprise-T5220]
[    0.000000] PLATFORM: hostid [851634ce]
[    0.000000] PLATFORM: serial# [00ab4130]
[    0.000000] PLATFORM: stick-frequency [457646c0]
[    0.000000] PLATFORM: mac-address [21281634ce]
[    0.000000] PLATFORM: watchdog-resolution [1000 ms]
[    0.000000] PLATFORM: watchdog-max-timeout [31536000000 ms]
[    0.000000] PLATFORM: max-cpus [64]
[    0.000000] Top of RAM: 0x7ffb0e000, Total RAM: 0x7f76a4000
[    0.000000] Memory hole size: 132MB
[    0.000000] Allocated 16384 bytes for kernel page tables.
[    0.000000] Zone ranges:
[    0.000000]   Normal   [mem 0x0000000008400000-0x00000007ffb0dfff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000008400000-0x00000007ffa81fff]
[    0.000000]   node   0: [mem 0x00000007ffa92000-0x00000007ffaa5fff]
[    0.000000]   node   0: [mem 0x00000007ffb00000-0x00000007ffb0dfff]
[    0.000000] Initmem setup node 0 [mem 0x0000000008400000-0x00000007ffb0dfff]
[    0.000000] Booting Linux...
[    0.000000] CPU CAPS: [flush,stbar,swap,muldiv,v9,blkinit,n2,mul32]
[    0.000000] CPU CAPS: [div32,v8plus,popc,vis,vis2,ASIBlkInit]
[    0.000000] PERCPU: Embedded 9 pages/cpu @ffff8007fec00000 s31512 r8192 d34024 u131072
[    0.000000] SUN4V: Mondo queue sizes [cpu(8192) dev(16384) r(8192) nr(256)]
[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 4144090
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: init=/sbin/init root=/dev/sdb1 ro isolcpus=32-63
[    0.000000] log_buf_len individual max cpu contribution: 16384 bytes
[    0.000000] log_buf_len total cpu_extra contributions: 1032192 bytes
[    0.000000] log_buf_len min size: 262144 bytes
[    0.000000] log_buf_len: 2097152 bytes
[    0.000000] early log buf free: 258712(98%)
[    0.000000] PID hash table entries: 4096 (order: 2, 32768 bytes)
[    0.000000] Sorting __ex_table...
[    0.000000] Memory: 33131296K/33413776K available (6894K kernel code, 832K rwdata, 1776K rodata, 536K init, 765K bss, 282480K reserved, 0K cma-reserved)
[    0.000000] Hierarchical RCU implementation.
[    0.000000]  Build-time adjustment of leaf fanout to 64.
[    0.000000] NR_IRQS:2048 nr_irqs:2048 1
[    0.000000] SUN4V: Using IRQ API major 1, cookie only virqs disabled
....

SPARC Enterprise T5220, No Keyboard
Copyright (c) 1998, 2012, Oracle and/or its affiliates. All rights reserved.
OpenBoot 4.33.6.a, 32640 MB memory available, Serial #85341390.
Ethernet address 0:21:28:16:34:ce, Host ID: 851634ce.


# master of today

Boot device: disk0  File and args: 
SILO Version 1.4.14_git20120819_p1
boot: 
Allocated 64 Megs of memory at 0x40000000 for kernel
Uncompressing image...
Loaded kernel version 4.6.0

[    0.000000] PROMLIB: Sun IEEE Boot Prom 'OBP 4.33.6.a 2012/03/29 11:22'
[    0.000000] PROMLIB: Root node compatible: sun4v
[    0.000000] Linux version 4.6.0-rc5-chja+ (joerg@t5220) (gcc version 5.3.1 20160315 (GCC) ) #31 SMP Tue Apr 26 14:09:08 CEST 2016
[    0.000000] bootconsole [earlyprom0] enabled
[    0.000000] ARCH: SUN4V
[    0.000000] Ethernet address: 00:21:28:16:34:ce
[    0.000000] MM: PAGE_OFFSET is 0xffff800000000000 (max_phys_bits == 39)
[    0.000000] MM: VMALLOC [0x0000000100000000 --> 0x0000600000000000]
[    0.000000] MM: VMEMMAP [0x0000600000000000 --> 0x0000c00000000000]
[    0.000000] Kernel: Using 3 locked TLB entries for main kernel image.
[    0.000000] Remapping the kernel... done.
ERROR: Last Trap: Watchdog Reset

{0} ok


# master of today + 1a40b95374f680625318ab61d81958e949e0afe3 reverted


SPARC Enterprise T5220, No Keyboard
Copyright (c) 1998, 2012, Oracle and/or its affiliates. All rights reserved.
OpenBoot 4.33.6.a, 32640 MB memory available, Serial #85341390.
Ethernet address 0:21:28:16:34:ce, Host ID: 851634ce.



Boot device: disk0  File and args: 
SILO Version 1.4.14_git20120819_p1
boot: 
Allocated 64 Megs of memory at 0x40000000 for kernel
Uncompressing image...
Loaded kernel version 4.6.0

[    0.000000] PROMLIB: Sun IEEE Boot Prom 'OBP 4.33.6.a 2012/03/29 11:22'
[    0.000000] PROMLIB: Root node compatible: sun4v
[    0.000000] Linux version 4.6.0-rc5-chja+ (joerg@t5220) (gcc version 5.3.1 20160315 (GCC) ) #32 SMP Tue Apr 26 14:25:43 CEST 2016
[    0.000000] bootconsole [earlyprom0] enabled
[    0.000000] ARCH: SUN4V
[    0.000000] Ethernet address: 00:21:28:16:34:ce
[    0.000000] MM: PAGE_OFFSET is 0xffff800000000000 (max_phys_bits == 39)
[    0.000000] MM: VMALLOC [0x0000000100000000 --> 0x0000600000000000]
[    0.000000] MM: VMEMMAP [0x0000600000000000 --> 0x0000c00000000000]
[    0.000000] Kernel: Using 3 locked TLB entries for main kernel image.
[    0.000000] Remapping the kernel... done.
[    0.000000] OF stdout device is: /virtual-devices@100/console@1
[    0.000000] PROM: Built device tree with 225794 bytes of memory.
[    0.000000] MDESC: Size is 62096 bytes.
[    0.000000] PLATFORM: banner-name [SPARC Enterprise T5220]
[    0.000000] PLATFORM: name [SUNW,SPARC-Enterprise-T5220]
[    0.000000] PLATFORM: hostid [851634ce]
[    0.000000] PLATFORM: serial# [00ab4130]
[    0.000000] PLATFORM: stick-frequency [457646c0]
[    0.000000] PLATFORM: mac-address [21281634ce]
[    0.000000] PLATFORM: watchdog-resolution [1000 ms]
[    0.000000] PLATFORM: watchdog-max-timeout [31536000000 ms]
[    0.000000] PLATFORM: max-cpus [64]
[    0.000000] Top of RAM: 0x7ffb0e000, Total RAM: 0x7f76a4000
[    0.000000] Memory hole size: 132MB
[    0.000000] Allocated 16384 bytes for kernel page tables.
[    0.000000] Zone ranges:
[    0.000000]   Normal   [mem 0x0000000008400000-0x00000007ffb0dfff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000008400000-0x00000007ffa81fff]
[    0.000000]   node   0: [mem 0x00000007ffa92000-0x00000007ffaa5fff]
[    0.000000]   node   0: [mem 0x00000007ffb00000-0x00000007ffb0dfff]
[    0.000000] Initmem setup node 0 [mem 0x0000000008400000-0x00000007ffb0dfff]
[    0.000000] Booting Linux...
[    0.000000] CPU CAPS: [flush,stbar,swap,muldiv,v9,blkinit,n2,mul32]
[    0.000000] CPU CAPS: [div32,v8plus,popc,vis,vis2,ASIBlkInit]
[    0.000000] percpu: Embedded 9 pages/cpu @ffff8007fec00000 s32600 r8192 d32936 u131072
[    0.000000] SUN4V: Mondo queue sizes [cpu(8192) dev(16384) r(8192) nr(256)]
[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 4144090
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: init=/sbin/init root=/dev/sdb1 ro isolcpus=32-63
[    0.000000] log_buf_len individual max cpu contribution: 16384 bytes
[    0.000000] log_buf_len total cpu_extra contributions: 1032192 bytes
[    0.000000] log_buf_len min size: 262144 bytes
[    0.000000] log_buf_len: 2097152 bytes
[    0.000000] early log buf free: 258712(98%)
[    0.000000] PID hash table entries: 4096 (order: 2, 32768 bytes)
[    0.000000] Sorting __ex_table...
[    0.000000] Memory: 33131296K/33413776K available (6961K kernel code, 842K rwdata, 1688K rodata, 544K init, 759K bss, 282480K reserved, 0K cma-reserved)
[    0.000000] Hierarchical RCU implementation.
[    0.000000]  Build-time adjustment of leaf fanout to 64.
[    0.000000] NR_IRQS:2048 nr_irqs:2048 1
[    0.000000] SUN4V: Using IRQ API major 1, cookie only virqs disabled
....

Re: kernel boot broken since 4.5 on t5220 ( niagara2 ) machine

[Sam Ravnborg]

On Wed, Apr 27, 2016 at 09:55:47AM +0200, Joerg Abraham wrote:
> Hi,
> 
> since kernel version 4.5 my t5220 does not boot anymore, small logs
> attached...
> 
> bisecting the problem points to commit:
> 
> 1a40b95374f680625318ab61d81958e949e0afe3
> 
> or
> 
> 1a40b95 (sparc: Fix system call tracing register handling.)

Meelis Roos reported issues with the same commit.
See the thread "RED State Exception in 4.5 on E420R"

	Sam

Re: kernel boot broken since 4.5 on t5220 ( niagara2 ) machine

[Anatoly Pugachev]

On Wed, Apr 27, 2016 at 1:09 PM, Sam Ravnborg <sam@ravnborg.org> wrote:
> On Wed, Apr 27, 2016 at 09:55:47AM +0200, Joerg Abraham wrote:
>> Hi,
>>
>> since kernel version 4.5 my t5220 does not boot anymore, small logs
>> attached...
>>
>> bisecting the problem points to commit:
>>
>> 1a40b95374f680625318ab61d81958e949e0afe3
>>
>> or
>>
>> 1a40b95 (sparc: Fix system call tracing register handling.)
>
> Meelis Roos reported issues with the same commit.
> See the thread "RED State Exception in 4.5 on E420R"

Just to let you know guys, I have quite a similar hardware, not T5220,
but T5120, and I don't have this issue, 4.5.x kernel works, 4.6.0
boots (but OOPS with different trace, going to report it with another
email).

Re: kernel boot broken since 4.5 on t5220 ( niagara2 ) machine

[Mike Frysinger]

[-- Attachment #1: Type: text/plain, Size: 1033 bytes --]

On 27 Apr 2016 14:28, Anatoly Pugachev wrote:
> On Wed, Apr 27, 2016 at 1:09 PM, Sam Ravnborg <sam@ravnborg.org> wrote:
> > On Wed, Apr 27, 2016 at 09:55:47AM +0200, Joerg Abraham wrote:
> >> Hi,
> >>
> >> since kernel version 4.5 my t5220 does not boot anymore, small logs
> >> attached...
> >>
> >> bisecting the problem points to commit:
> >>
> >> 1a40b95374f680625318ab61d81958e949e0afe3
> >>
> >> or
> >>
> >> 1a40b95 (sparc: Fix system call tracing register handling.)
> >
> > Meelis Roos reported issues with the same commit.
> > See the thread "RED State Exception in 4.5 on E420R"
> 
> Just to let you know guys, I have quite a similar hardware, not T5220,
> but T5120, and I don't have this issue, 4.5.x kernel works, 4.6.0
> boots (but OOPS with different trace, going to report it with another
> email).

i've been running v4.5 on a Sun Fire T200 for a while and haven't
noticed boot issues.  i do have some troubles under high loads and
cores locking up, but that isn't new to v4.5 :).
-mike

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 819 bytes --]