stable.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* Build failures and crashes in stable queues (3.19, 4.19, 5.0)
@ 2019-03-21 16:16 Guenter Roeck
  2019-03-21 16:47 ` Greg Kroah-Hartman
                   ` (2 more replies)
  0 siblings, 3 replies; 11+ messages in thread
From: Guenter Roeck @ 2019-03-21 16:16 UTC (permalink / raw)
  To: stable; +Cc: Greg Kroah-Hartman

Boot tests are still in process, so there may be more.

Guenter

---
v3.18.y.queue:

arm:allmodconfig:

drivers/net/ethernet/marvell/mvneta.c: In function 'mvneta_rx':
drivers/net/ethernet/marvell/mvneta.c:1485:37: error: 'struct mvneta_port' has no member named 'bm_priv'

arm:axm55xx_defconfig, keystone_defconfig:
arm64, all builds:

mm/gup.c: In function 'gup_pmd_range':
mm/gup.c:889:9: error: implicit declaration of function 'pmd_devmap'

---
v4.19.y.queue:

m68k, all builds:

mm/slab.c: In function '__check_heap_object':
mm/slab.c:4424:8: error: implicit declaration of function 'kasan_reset_tag'

s390 (crash, all tests):

addressing exception: 0005 ilc:3 [#1] SMP 
Modules linked in:
CPU: 0 PID: 2 Comm: kthreadd Not tainted 4.19.31-rc1-00212-g4107be0fa04a #1
Hardware name: QEMU 2827 QEMU (KVM/Linux)
Krnl PSW : (____ptrval____) (____ptrval____) (__list_del_entry_valid+0x28/0x100)
           R:0 T:0 IO:0 EX:0 Key:0 M:1 W:0 P:0 AS:3 CC:2 PM:0 RI:0 EA:3
Krnl GPRS: 01000d1afffffb00 000003d1007e1500 000003d1007e1508 0000000000000200
           000003d1007e1508 000000001f8538a8 0000000000000001 000000001fff1d00
           000000001f83aa00 000000001fff1d00 0000000000000002 000003d1007e1508
           00000000000000d0 0000000000bcba58 000000001f8538d8 000000001f8538b8
Krnl Code: 00000000007bafd0: a7fbffe0		aghi	%r15,-32
           00000000007bafd4: e3e0f0980024	stg	%r14,152(%r15)
          #00000000007bafda: e31020000004	lg	%r1,0(%r2)
          >00000000007bafe0: a71f0100		cghi	%r1,256
           00000000007bafe4: e33020080004	lg	%r3,8(%r2)
           00000000007bafea: a784001c		brc	8,7bb022
           00000000007bafee: a73f0200		cghi	%r3,512
           00000000007baff2: a7840030		brc	8,7bb052
Call Trace:
([<000000001fff2400>] 0x1fff2400)
 [<0000000000335e42>] get_page_from_freelist+0x742/0x1810 
 [<00000000003376b4>] __alloc_pages_nodemask+0x184/0x14f8 
 [<0000000000172f16>] copy_process.part.6+0x1de/0x2218 
 [<00000000001755e0>] _do_fork+0xd0/0x728 
 [<0000000000175c8e>] kernel_thread+0x56/0x68 
 [<00000000001a6432>] kthreadd+0x252/0x2d8 
 [<0000000000b26a1e>] kernel_thread_starter+0x6/0xc 
 [<0000000000b26a18>] kernel_thread_starter+0x0/0xc 
INFO: lockdep is turned off.
Last Breaking-Event-Address:
 [<0000000000335e3c>] get_page_from_freelist+0x73c/0x1810

---
v5.0.y.queue:

s390, (crash, all tests):

Kernel stack overflow.
CPU: 0 PID: 2 Comm: swapper/0 Not tainted 5.0.4-rc1-00148-g68af88140894 #1
Hardware name: QEMU 2827 QEMU (KVM/Linux)
Krnl PSW : 0004c00180000000 0000000000b113c2 (pgm_check_handler+0x126/0x22c)
           R:0 T:0 IO:0 EX:0 Key:0 M:1 W:0 P:0 AS:3 CC:0 PM:0 RI:0 EA:3
Krnl GPRS: 81000ef1ffff6400 0000000000000000 000000001fea26e0 000000000000008a
           0000000000b1127c 0000000000000000 0000000000000000 0000000000000000
           0004c00180000000 0000000000b113c2 0000000000b11322 000003e0000d8178
           000000001f842a00 0000000000000000 000003e0000dbea8 000003e0000d80d8
Krnl Code: 0000000000b113b4: b90400db		lgr	%r13,%r11
           0000000000b113b8: 41b0f0a0		la	%r11,160(%r15)
          #0000000000b113bc: eb07b0180024	stmg	%r0,%r7,24(%r11)
          >0000000000b113c2: b9820000		xgr	%r0,%r0
           0000000000b113c6: b9820011		xgr	%r1,%r1
           0000000000b113ca: b9820022		xgr	%r2,%r2
           0000000000b113ce: b9820033		xgr	%r3,%r3
           0000000000b113d2: b9820044		xgr	%r4,%r4
Call Trace:
addressing exception: 0005 ilc:3 [#1] SMP 
Modules linked in:
CPU: 0 PID: 2 Comm: swapper/0 Not tainted 5.0.4-rc1-00148-g68af88140894 #1
Hardware name: QEMU 2827 QEMU (KVM/Linux)
Krnl PSW : 0004e00180000000 0000000000114d24 (__dump_trace+0x4c/0x110)
           R:0 T:0 IO:0 EX:0 Key:0 M:1 W:0 P:0 AS:3 CC:2 PM:0 RI:0 EA:3
Krnl GPRS: 01000ebdffffff80 000000001fa44000 0000000000114e70 0000000000000000
           0000000000000000 000003e0000d8000 000003e0000dbf48 0000000000114e70
           000003e0000dbf60 0000000000000000 000003e0000d80d8 0000000000114e70
           000000001f842a00 0000000000b11d66 0000000000e13dd0 0000000000e13d78
Krnl Code: 0000000000114d16: a76bff48		aghi	%r6,-184
           0000000000114d1a: a7490000		lghi	%r4,0
          #0000000000114d1e: e330a0880004	lg	%r3,136(%r10)
          >0000000000114d24: b9040029		lgr	%r2,%r9
           0000000000114d28: 0de7		basr	%r14,%r7
           0000000000114d2a: 1222		ltr	%r2,%r2
           0000000000114d2c: b90400ca		lgr	%r12,%r10
           0000000000114d30: a7840017		brc	8,114d5e
Call Trace:
INFO: lockdep is turned off.
Last Breaking-Event-Address:
 [<0000000000114e4e>] dump_trace+0x66/0x88
addressing exception: 0005 ilc:3 [#2] SMP 
Modules linked in:
CPU: 0 PID: 2 Comm: swapper/0 Tainted: G      D           5.0.4-rc1-00148-g68af88140894 #1
Hardware name: QEMU 2827 QEMU (KVM/Linux)
Krnl PSW : 0004e00180000000 00000000001dfbc8 (cpuacct_charge+0x40/0x218)
           R:0 T:0 IO:0 EX:0 Key:0 M:1 W:0 P:0 AS:3 CC:2 PM:0 RI:0 EA:3
Krnl GPRS: 000000000001b944 000003e0000d8000 0000000000003000 00000000011ef130
           fffffffffff00000 ffffffffff0ed590 0000000000000000 000000001febff18
           0000000000e2a0f8 000000001f842a00 000000001f842a00 00000000011ef130
           00000000011ef130 0000000000b2c148 000000001fa47bd0 000000001fa47b68
Krnl Code: 00000000001dfbba: a78400ef		brc	8,1dfd98
           00000000001dfbbe: a7293000		lghi	%r2,12288
          #00000000001dfbc2: e3321f500091	llgh	%r3,3920(%r2,%r1)
          >00000000001dfbc8: e330d0000082	xg	%r3,0(%r13)
           00000000001dfbce: 5430d008		n	%r3,8(%r13)
           00000000001dfbd2: 581003a0		l	%r1,928
           00000000001dfbd6: a71a0001		ahi	%r1,1
           00000000001dfbda: a7b800ff		lhi	%r11,255
Call Trace:
([<0000000000000001>] 0x1)
 [<00000000001b8312>] update_curr+0x18a/0x488 
 [<00000000001bce6c>] task_tick_fair+0x4c/0x7f0 
 [<00000000001b2eaa>] scheduler_tick+0x9a/0x130 
 [<000000000022f466>] update_process_times+0x56/0x68 
 [<0000000000242a52>] tick_sched_handle.isra.5+0x52/0x78 
 [<0000000000242adc>] tick_sched_timer+0x64/0xc8 
 [<00000000002302cc>] __hrtimer_run_queues+0x144/0x510 
 [<00000000002314ca>] hrtimer_interrupt+0x102/0x248 
 [<000000000010dbac>] do_IRQ+0x6c/0xb0 
 [<0000000000b118e0>] ext_int_handler+0x130/0x134 
 [<0000000000b1032c>] _raw_spin_unlock_irq+0x44/0x60 
INFO: lockdep is turned off.
Last Breaking-Event-Address:
 [<00000000001b830c>] update_curr+0x184/0x488
Kernel panic - not syncing: Fatal exception in interrupt

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: Build failures and crashes in stable queues (3.19, 4.19, 5.0)
  2019-03-21 16:16 Build failures and crashes in stable queues (3.19, 4.19, 5.0) Guenter Roeck
@ 2019-03-21 16:47 ` Greg Kroah-Hartman
  2019-03-21 16:49 ` Greg Kroah-Hartman
  2019-03-21 16:50 ` Greg Kroah-Hartman
  2 siblings, 0 replies; 11+ messages in thread
From: Greg Kroah-Hartman @ 2019-03-21 16:47 UTC (permalink / raw)
  To: Guenter Roeck; +Cc: stable

On Thu, Mar 21, 2019 at 09:16:23AM -0700, Guenter Roeck wrote:
> Boot tests are still in process, so there may be more.
> 
> Guenter
> 
> ---
> v3.18.y.queue:
> 
> arm:allmodconfig:
> 
> drivers/net/ethernet/marvell/mvneta.c: In function 'mvneta_rx':
> drivers/net/ethernet/marvell/mvneta.c:1485:37: error: 'struct mvneta_port' has no member named 'bm_priv'
> 
> arm:axm55xx_defconfig, keystone_defconfig:
> arm64, all builds:
> 
> mm/gup.c: In function 'gup_pmd_range':
> mm/gup.c:889:9: error: implicit declaration of function 'pmd_devmap'

I've fixed these all up now, thanks for letting me know.  I'll work on
the other ones next...

greg k-h

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: Build failures and crashes in stable queues (3.19, 4.19, 5.0)
  2019-03-21 16:16 Build failures and crashes in stable queues (3.19, 4.19, 5.0) Guenter Roeck
  2019-03-21 16:47 ` Greg Kroah-Hartman
@ 2019-03-21 16:49 ` Greg Kroah-Hartman
  2019-03-21 17:38   ` Guenter Roeck
  2019-03-21 16:50 ` Greg Kroah-Hartman
  2 siblings, 1 reply; 11+ messages in thread
From: Greg Kroah-Hartman @ 2019-03-21 16:49 UTC (permalink / raw)
  To: Guenter Roeck; +Cc: stable

On Thu, Mar 21, 2019 at 09:16:23AM -0700, Guenter Roeck wrote:
> ---
> v4.19.y.queue:
> 
> m68k, all builds:
> 
> mm/slab.c: In function '__check_heap_object':
> mm/slab.c:4424:8: error: implicit declaration of function 'kasan_reset_tag'

That's odd, I don't see that function in the tree at all:
	$ git grep kasan_reset_tag
	$

Where is that coming from?

greg k-h

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: Build failures and crashes in stable queues (3.19, 4.19, 5.0)
  2019-03-21 16:16 Build failures and crashes in stable queues (3.19, 4.19, 5.0) Guenter Roeck
  2019-03-21 16:47 ` Greg Kroah-Hartman
  2019-03-21 16:49 ` Greg Kroah-Hartman
@ 2019-03-21 16:50 ` Greg Kroah-Hartman
  2019-03-21 17:28   ` Guenter Roeck
  2 siblings, 1 reply; 11+ messages in thread
From: Greg Kroah-Hartman @ 2019-03-21 16:50 UTC (permalink / raw)
  To: Guenter Roeck; +Cc: stable

On Thu, Mar 21, 2019 at 09:16:23AM -0700, Guenter Roeck wrote:
> s390 (crash, all tests):
> 
> addressing exception: 0005 ilc:3 [#1] SMP 
> Modules linked in:
> CPU: 0 PID: 2 Comm: kthreadd Not tainted 4.19.31-rc1-00212-g4107be0fa04a #1
> Hardware name: QEMU 2827 QEMU (KVM/Linux)
> Krnl PSW : (____ptrval____) (____ptrval____) (__list_del_entry_valid+0x28/0x100)
>            R:0 T:0 IO:0 EX:0 Key:0 M:1 W:0 P:0 AS:3 CC:2 PM:0 RI:0 EA:3
> Krnl GPRS: 01000d1afffffb00 000003d1007e1500 000003d1007e1508 0000000000000200
>            000003d1007e1508 000000001f8538a8 0000000000000001 000000001fff1d00
>            000000001f83aa00 000000001fff1d00 0000000000000002 000003d1007e1508
>            00000000000000d0 0000000000bcba58 000000001f8538d8 000000001f8538b8
> Krnl Code: 00000000007bafd0: a7fbffe0		aghi	%r15,-32
>            00000000007bafd4: e3e0f0980024	stg	%r14,152(%r15)
>           #00000000007bafda: e31020000004	lg	%r1,0(%r2)
>           >00000000007bafe0: a71f0100		cghi	%r1,256
>            00000000007bafe4: e33020080004	lg	%r3,8(%r2)
>            00000000007bafea: a784001c		brc	8,7bb022
>            00000000007bafee: a73f0200		cghi	%r3,512
>            00000000007baff2: a7840030		brc	8,7bb052
> Call Trace:
> ([<000000001fff2400>] 0x1fff2400)
>  [<0000000000335e42>] get_page_from_freelist+0x742/0x1810 
>  [<00000000003376b4>] __alloc_pages_nodemask+0x184/0x14f8 
>  [<0000000000172f16>] copy_process.part.6+0x1de/0x2218 
>  [<00000000001755e0>] _do_fork+0xd0/0x728 
>  [<0000000000175c8e>] kernel_thread+0x56/0x68 
>  [<00000000001a6432>] kthreadd+0x252/0x2d8 
>  [<0000000000b26a1e>] kernel_thread_starter+0x6/0xc 
>  [<0000000000b26a18>] kernel_thread_starter+0x0/0xc 
> INFO: lockdep is turned off.
> Last Breaking-Event-Address:
>  [<0000000000335e3c>] get_page_from_freelist+0x73c/0x1810
> 
> ---
> v5.0.y.queue:
> 
> s390, (crash, all tests):
> 
> Kernel stack overflow.
> CPU: 0 PID: 2 Comm: swapper/0 Not tainted 5.0.4-rc1-00148-g68af88140894 #1
> Hardware name: QEMU 2827 QEMU (KVM/Linux)
> Krnl PSW : 0004c00180000000 0000000000b113c2 (pgm_check_handler+0x126/0x22c)
>            R:0 T:0 IO:0 EX:0 Key:0 M:1 W:0 P:0 AS:3 CC:0 PM:0 RI:0 EA:3
> Krnl GPRS: 81000ef1ffff6400 0000000000000000 000000001fea26e0 000000000000008a
>            0000000000b1127c 0000000000000000 0000000000000000 0000000000000000
>            0004c00180000000 0000000000b113c2 0000000000b11322 000003e0000d8178
>            000000001f842a00 0000000000000000 000003e0000dbea8 000003e0000d80d8
> Krnl Code: 0000000000b113b4: b90400db		lgr	%r13,%r11
>            0000000000b113b8: 41b0f0a0		la	%r11,160(%r15)
>           #0000000000b113bc: eb07b0180024	stmg	%r0,%r7,24(%r11)
>           >0000000000b113c2: b9820000		xgr	%r0,%r0
>            0000000000b113c6: b9820011		xgr	%r1,%r1
>            0000000000b113ca: b9820022		xgr	%r2,%r2
>            0000000000b113ce: b9820033		xgr	%r3,%r3
>            0000000000b113d2: b9820044		xgr	%r4,%r4
> Call Trace:
> addressing exception: 0005 ilc:3 [#1] SMP 
> Modules linked in:
> CPU: 0 PID: 2 Comm: swapper/0 Not tainted 5.0.4-rc1-00148-g68af88140894 #1
> Hardware name: QEMU 2827 QEMU (KVM/Linux)
> Krnl PSW : 0004e00180000000 0000000000114d24 (__dump_trace+0x4c/0x110)
>            R:0 T:0 IO:0 EX:0 Key:0 M:1 W:0 P:0 AS:3 CC:2 PM:0 RI:0 EA:3
> Krnl GPRS: 01000ebdffffff80 000000001fa44000 0000000000114e70 0000000000000000
>            0000000000000000 000003e0000d8000 000003e0000dbf48 0000000000114e70
>            000003e0000dbf60 0000000000000000 000003e0000d80d8 0000000000114e70
>            000000001f842a00 0000000000b11d66 0000000000e13dd0 0000000000e13d78
> Krnl Code: 0000000000114d16: a76bff48		aghi	%r6,-184
>            0000000000114d1a: a7490000		lghi	%r4,0
>           #0000000000114d1e: e330a0880004	lg	%r3,136(%r10)
>           >0000000000114d24: b9040029		lgr	%r2,%r9
>            0000000000114d28: 0de7		basr	%r14,%r7
>            0000000000114d2a: 1222		ltr	%r2,%r2
>            0000000000114d2c: b90400ca		lgr	%r12,%r10
>            0000000000114d30: a7840017		brc	8,114d5e
> Call Trace:
> INFO: lockdep is turned off.
> Last Breaking-Event-Address:
>  [<0000000000114e4e>] dump_trace+0x66/0x88
> addressing exception: 0005 ilc:3 [#2] SMP 
> Modules linked in:
> CPU: 0 PID: 2 Comm: swapper/0 Tainted: G      D           5.0.4-rc1-00148-g68af88140894 #1
> Hardware name: QEMU 2827 QEMU (KVM/Linux)
> Krnl PSW : 0004e00180000000 00000000001dfbc8 (cpuacct_charge+0x40/0x218)
>            R:0 T:0 IO:0 EX:0 Key:0 M:1 W:0 P:0 AS:3 CC:2 PM:0 RI:0 EA:3
> Krnl GPRS: 000000000001b944 000003e0000d8000 0000000000003000 00000000011ef130
>            fffffffffff00000 ffffffffff0ed590 0000000000000000 000000001febff18
>            0000000000e2a0f8 000000001f842a00 000000001f842a00 00000000011ef130
>            00000000011ef130 0000000000b2c148 000000001fa47bd0 000000001fa47b68
> Krnl Code: 00000000001dfbba: a78400ef		brc	8,1dfd98
>            00000000001dfbbe: a7293000		lghi	%r2,12288
>           #00000000001dfbc2: e3321f500091	llgh	%r3,3920(%r2,%r1)
>           >00000000001dfbc8: e330d0000082	xg	%r3,0(%r13)
>            00000000001dfbce: 5430d008		n	%r3,8(%r13)
>            00000000001dfbd2: 581003a0		l	%r1,928
>            00000000001dfbd6: a71a0001		ahi	%r1,1
>            00000000001dfbda: a7b800ff		lhi	%r11,255
> Call Trace:
> ([<0000000000000001>] 0x1)
>  [<00000000001b8312>] update_curr+0x18a/0x488 
>  [<00000000001bce6c>] task_tick_fair+0x4c/0x7f0 
>  [<00000000001b2eaa>] scheduler_tick+0x9a/0x130 
>  [<000000000022f466>] update_process_times+0x56/0x68 
>  [<0000000000242a52>] tick_sched_handle.isra.5+0x52/0x78 
>  [<0000000000242adc>] tick_sched_timer+0x64/0xc8 
>  [<00000000002302cc>] __hrtimer_run_queues+0x144/0x510 
>  [<00000000002314ca>] hrtimer_interrupt+0x102/0x248 
>  [<000000000010dbac>] do_IRQ+0x6c/0xb0 
>  [<0000000000b118e0>] ext_int_handler+0x130/0x134 
>  [<0000000000b1032c>] _raw_spin_unlock_irq+0x44/0x60 
> INFO: lockdep is turned off.
> Last Breaking-Event-Address:
>  [<00000000001b830c>] update_curr+0x184/0x488
> Kernel panic - not syncing: Fatal exception in interrupt

Ugh, s390, I have no idea, I just take what is given to me...

Let me see if I can figure it out.

greg k-h

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: Build failures and crashes in stable queues (3.19, 4.19, 5.0)
  2019-03-21 16:50 ` Greg Kroah-Hartman
@ 2019-03-21 17:28   ` Guenter Roeck
  2019-03-21 17:32     ` Greg Kroah-Hartman
  0 siblings, 1 reply; 11+ messages in thread
From: Guenter Roeck @ 2019-03-21 17:28 UTC (permalink / raw)
  To: Greg Kroah-Hartman; +Cc: stable

On Thu, Mar 21, 2019 at 05:50:25PM +0100, Greg Kroah-Hartman wrote:
> On Thu, Mar 21, 2019 at 09:16:23AM -0700, Guenter Roeck wrote:
> > s390 (crash, all tests):
> > 
> > addressing exception: 0005 ilc:3 [#1] SMP 
> > Modules linked in:
> > CPU: 0 PID: 2 Comm: kthreadd Not tainted 4.19.31-rc1-00212-g4107be0fa04a #1
> > Hardware name: QEMU 2827 QEMU (KVM/Linux)
> > Krnl PSW : (____ptrval____) (____ptrval____) (__list_del_entry_valid+0x28/0x100)
> >            R:0 T:0 IO:0 EX:0 Key:0 M:1 W:0 P:0 AS:3 CC:2 PM:0 RI:0 EA:3
> > Krnl GPRS: 01000d1afffffb00 000003d1007e1500 000003d1007e1508 0000000000000200
> >            000003d1007e1508 000000001f8538a8 0000000000000001 000000001fff1d00
> >            000000001f83aa00 000000001fff1d00 0000000000000002 000003d1007e1508
> >            00000000000000d0 0000000000bcba58 000000001f8538d8 000000001f8538b8
> > Krnl Code: 00000000007bafd0: a7fbffe0		aghi	%r15,-32
> >            00000000007bafd4: e3e0f0980024	stg	%r14,152(%r15)
> >           #00000000007bafda: e31020000004	lg	%r1,0(%r2)
> >           >00000000007bafe0: a71f0100		cghi	%r1,256
> >            00000000007bafe4: e33020080004	lg	%r3,8(%r2)
> >            00000000007bafea: a784001c		brc	8,7bb022
> >            00000000007bafee: a73f0200		cghi	%r3,512
> >            00000000007baff2: a7840030		brc	8,7bb052
> > Call Trace:
> > ([<000000001fff2400>] 0x1fff2400)
> >  [<0000000000335e42>] get_page_from_freelist+0x742/0x1810 
> >  [<00000000003376b4>] __alloc_pages_nodemask+0x184/0x14f8 
> >  [<0000000000172f16>] copy_process.part.6+0x1de/0x2218 
> >  [<00000000001755e0>] _do_fork+0xd0/0x728 
> >  [<0000000000175c8e>] kernel_thread+0x56/0x68 
> >  [<00000000001a6432>] kthreadd+0x252/0x2d8 
> >  [<0000000000b26a1e>] kernel_thread_starter+0x6/0xc 
> >  [<0000000000b26a18>] kernel_thread_starter+0x0/0xc 
> > INFO: lockdep is turned off.
> > Last Breaking-Event-Address:
> >  [<0000000000335e3c>] get_page_from_freelist+0x73c/0x1810
> > 
> > ---
> > v5.0.y.queue:
> > 
> > s390, (crash, all tests):
> > 
> > Kernel stack overflow.
> > CPU: 0 PID: 2 Comm: swapper/0 Not tainted 5.0.4-rc1-00148-g68af88140894 #1
> > Hardware name: QEMU 2827 QEMU (KVM/Linux)
> > Krnl PSW : 0004c00180000000 0000000000b113c2 (pgm_check_handler+0x126/0x22c)
> >            R:0 T:0 IO:0 EX:0 Key:0 M:1 W:0 P:0 AS:3 CC:0 PM:0 RI:0 EA:3
> > Krnl GPRS: 81000ef1ffff6400 0000000000000000 000000001fea26e0 000000000000008a
> >            0000000000b1127c 0000000000000000 0000000000000000 0000000000000000
> >            0004c00180000000 0000000000b113c2 0000000000b11322 000003e0000d8178
> >            000000001f842a00 0000000000000000 000003e0000dbea8 000003e0000d80d8
> > Krnl Code: 0000000000b113b4: b90400db		lgr	%r13,%r11
> >            0000000000b113b8: 41b0f0a0		la	%r11,160(%r15)
> >           #0000000000b113bc: eb07b0180024	stmg	%r0,%r7,24(%r11)
> >           >0000000000b113c2: b9820000		xgr	%r0,%r0
> >            0000000000b113c6: b9820011		xgr	%r1,%r1
> >            0000000000b113ca: b9820022		xgr	%r2,%r2
> >            0000000000b113ce: b9820033		xgr	%r3,%r3
> >            0000000000b113d2: b9820044		xgr	%r4,%r4
> > Call Trace:
> > addressing exception: 0005 ilc:3 [#1] SMP 
> > Modules linked in:
> > CPU: 0 PID: 2 Comm: swapper/0 Not tainted 5.0.4-rc1-00148-g68af88140894 #1
> > Hardware name: QEMU 2827 QEMU (KVM/Linux)
> > Krnl PSW : 0004e00180000000 0000000000114d24 (__dump_trace+0x4c/0x110)
> >            R:0 T:0 IO:0 EX:0 Key:0 M:1 W:0 P:0 AS:3 CC:2 PM:0 RI:0 EA:3
> > Krnl GPRS: 01000ebdffffff80 000000001fa44000 0000000000114e70 0000000000000000
> >            0000000000000000 000003e0000d8000 000003e0000dbf48 0000000000114e70
> >            000003e0000dbf60 0000000000000000 000003e0000d80d8 0000000000114e70
> >            000000001f842a00 0000000000b11d66 0000000000e13dd0 0000000000e13d78
> > Krnl Code: 0000000000114d16: a76bff48		aghi	%r6,-184
> >            0000000000114d1a: a7490000		lghi	%r4,0
> >           #0000000000114d1e: e330a0880004	lg	%r3,136(%r10)
> >           >0000000000114d24: b9040029		lgr	%r2,%r9
> >            0000000000114d28: 0de7		basr	%r14,%r7
> >            0000000000114d2a: 1222		ltr	%r2,%r2
> >            0000000000114d2c: b90400ca		lgr	%r12,%r10
> >            0000000000114d30: a7840017		brc	8,114d5e
> > Call Trace:
> > INFO: lockdep is turned off.
> > Last Breaking-Event-Address:
> >  [<0000000000114e4e>] dump_trace+0x66/0x88
> > addressing exception: 0005 ilc:3 [#2] SMP 
> > Modules linked in:
> > CPU: 0 PID: 2 Comm: swapper/0 Tainted: G      D           5.0.4-rc1-00148-g68af88140894 #1
> > Hardware name: QEMU 2827 QEMU (KVM/Linux)
> > Krnl PSW : 0004e00180000000 00000000001dfbc8 (cpuacct_charge+0x40/0x218)
> >            R:0 T:0 IO:0 EX:0 Key:0 M:1 W:0 P:0 AS:3 CC:2 PM:0 RI:0 EA:3
> > Krnl GPRS: 000000000001b944 000003e0000d8000 0000000000003000 00000000011ef130
> >            fffffffffff00000 ffffffffff0ed590 0000000000000000 000000001febff18
> >            0000000000e2a0f8 000000001f842a00 000000001f842a00 00000000011ef130
> >            00000000011ef130 0000000000b2c148 000000001fa47bd0 000000001fa47b68
> > Krnl Code: 00000000001dfbba: a78400ef		brc	8,1dfd98
> >            00000000001dfbbe: a7293000		lghi	%r2,12288
> >           #00000000001dfbc2: e3321f500091	llgh	%r3,3920(%r2,%r1)
> >           >00000000001dfbc8: e330d0000082	xg	%r3,0(%r13)
> >            00000000001dfbce: 5430d008		n	%r3,8(%r13)
> >            00000000001dfbd2: 581003a0		l	%r1,928
> >            00000000001dfbd6: a71a0001		ahi	%r1,1
> >            00000000001dfbda: a7b800ff		lhi	%r11,255
> > Call Trace:
> > ([<0000000000000001>] 0x1)
> >  [<00000000001b8312>] update_curr+0x18a/0x488 
> >  [<00000000001bce6c>] task_tick_fair+0x4c/0x7f0 
> >  [<00000000001b2eaa>] scheduler_tick+0x9a/0x130 
> >  [<000000000022f466>] update_process_times+0x56/0x68 
> >  [<0000000000242a52>] tick_sched_handle.isra.5+0x52/0x78 
> >  [<0000000000242adc>] tick_sched_timer+0x64/0xc8 
> >  [<00000000002302cc>] __hrtimer_run_queues+0x144/0x510 
> >  [<00000000002314ca>] hrtimer_interrupt+0x102/0x248 
> >  [<000000000010dbac>] do_IRQ+0x6c/0xb0 
> >  [<0000000000b118e0>] ext_int_handler+0x130/0x134 
> >  [<0000000000b1032c>] _raw_spin_unlock_irq+0x44/0x60 
> > INFO: lockdep is turned off.
> > Last Breaking-Event-Address:
> >  [<00000000001b830c>] update_curr+0x184/0x488
> > Kernel panic - not syncing: Fatal exception in interrupt
> 
> Ugh, s390, I have no idea, I just take what is given to me...
> 
> Let me see if I can figure it out.
> 
Want me to bisect ?

Guenter

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: Build failures and crashes in stable queues (3.19, 4.19, 5.0)
  2019-03-21 17:28   ` Guenter Roeck
@ 2019-03-21 17:32     ` Greg Kroah-Hartman
  2019-03-21 17:52       ` Guenter Roeck
  2019-03-21 18:20       ` Guenter Roeck
  0 siblings, 2 replies; 11+ messages in thread
From: Greg Kroah-Hartman @ 2019-03-21 17:32 UTC (permalink / raw)
  To: Guenter Roeck; +Cc: stable

On Thu, Mar 21, 2019 at 10:28:31AM -0700, Guenter Roeck wrote:
> On Thu, Mar 21, 2019 at 05:50:25PM +0100, Greg Kroah-Hartman wrote:
> > On Thu, Mar 21, 2019 at 09:16:23AM -0700, Guenter Roeck wrote:
> > > s390 (crash, all tests):
> > > 
> > > addressing exception: 0005 ilc:3 [#1] SMP 
> > > Modules linked in:
> > > CPU: 0 PID: 2 Comm: kthreadd Not tainted 4.19.31-rc1-00212-g4107be0fa04a #1
> > > Hardware name: QEMU 2827 QEMU (KVM/Linux)
> > > Krnl PSW : (____ptrval____) (____ptrval____) (__list_del_entry_valid+0x28/0x100)
> > >            R:0 T:0 IO:0 EX:0 Key:0 M:1 W:0 P:0 AS:3 CC:2 PM:0 RI:0 EA:3
> > > Krnl GPRS: 01000d1afffffb00 000003d1007e1500 000003d1007e1508 0000000000000200
> > >            000003d1007e1508 000000001f8538a8 0000000000000001 000000001fff1d00
> > >            000000001f83aa00 000000001fff1d00 0000000000000002 000003d1007e1508
> > >            00000000000000d0 0000000000bcba58 000000001f8538d8 000000001f8538b8
> > > Krnl Code: 00000000007bafd0: a7fbffe0		aghi	%r15,-32
> > >            00000000007bafd4: e3e0f0980024	stg	%r14,152(%r15)
> > >           #00000000007bafda: e31020000004	lg	%r1,0(%r2)
> > >           >00000000007bafe0: a71f0100		cghi	%r1,256
> > >            00000000007bafe4: e33020080004	lg	%r3,8(%r2)
> > >            00000000007bafea: a784001c		brc	8,7bb022
> > >            00000000007bafee: a73f0200		cghi	%r3,512
> > >            00000000007baff2: a7840030		brc	8,7bb052
> > > Call Trace:
> > > ([<000000001fff2400>] 0x1fff2400)
> > >  [<0000000000335e42>] get_page_from_freelist+0x742/0x1810 
> > >  [<00000000003376b4>] __alloc_pages_nodemask+0x184/0x14f8 
> > >  [<0000000000172f16>] copy_process.part.6+0x1de/0x2218 
> > >  [<00000000001755e0>] _do_fork+0xd0/0x728 
> > >  [<0000000000175c8e>] kernel_thread+0x56/0x68 
> > >  [<00000000001a6432>] kthreadd+0x252/0x2d8 
> > >  [<0000000000b26a1e>] kernel_thread_starter+0x6/0xc 
> > >  [<0000000000b26a18>] kernel_thread_starter+0x0/0xc 
> > > INFO: lockdep is turned off.
> > > Last Breaking-Event-Address:
> > >  [<0000000000335e3c>] get_page_from_freelist+0x73c/0x1810
> > > 
> > > ---
> > > v5.0.y.queue:
> > > 
> > > s390, (crash, all tests):
> > > 
> > > Kernel stack overflow.
> > > CPU: 0 PID: 2 Comm: swapper/0 Not tainted 5.0.4-rc1-00148-g68af88140894 #1
> > > Hardware name: QEMU 2827 QEMU (KVM/Linux)
> > > Krnl PSW : 0004c00180000000 0000000000b113c2 (pgm_check_handler+0x126/0x22c)
> > >            R:0 T:0 IO:0 EX:0 Key:0 M:1 W:0 P:0 AS:3 CC:0 PM:0 RI:0 EA:3
> > > Krnl GPRS: 81000ef1ffff6400 0000000000000000 000000001fea26e0 000000000000008a
> > >            0000000000b1127c 0000000000000000 0000000000000000 0000000000000000
> > >            0004c00180000000 0000000000b113c2 0000000000b11322 000003e0000d8178
> > >            000000001f842a00 0000000000000000 000003e0000dbea8 000003e0000d80d8
> > > Krnl Code: 0000000000b113b4: b90400db		lgr	%r13,%r11
> > >            0000000000b113b8: 41b0f0a0		la	%r11,160(%r15)
> > >           #0000000000b113bc: eb07b0180024	stmg	%r0,%r7,24(%r11)
> > >           >0000000000b113c2: b9820000		xgr	%r0,%r0
> > >            0000000000b113c6: b9820011		xgr	%r1,%r1
> > >            0000000000b113ca: b9820022		xgr	%r2,%r2
> > >            0000000000b113ce: b9820033		xgr	%r3,%r3
> > >            0000000000b113d2: b9820044		xgr	%r4,%r4
> > > Call Trace:
> > > addressing exception: 0005 ilc:3 [#1] SMP 
> > > Modules linked in:
> > > CPU: 0 PID: 2 Comm: swapper/0 Not tainted 5.0.4-rc1-00148-g68af88140894 #1
> > > Hardware name: QEMU 2827 QEMU (KVM/Linux)
> > > Krnl PSW : 0004e00180000000 0000000000114d24 (__dump_trace+0x4c/0x110)
> > >            R:0 T:0 IO:0 EX:0 Key:0 M:1 W:0 P:0 AS:3 CC:2 PM:0 RI:0 EA:3
> > > Krnl GPRS: 01000ebdffffff80 000000001fa44000 0000000000114e70 0000000000000000
> > >            0000000000000000 000003e0000d8000 000003e0000dbf48 0000000000114e70
> > >            000003e0000dbf60 0000000000000000 000003e0000d80d8 0000000000114e70
> > >            000000001f842a00 0000000000b11d66 0000000000e13dd0 0000000000e13d78
> > > Krnl Code: 0000000000114d16: a76bff48		aghi	%r6,-184
> > >            0000000000114d1a: a7490000		lghi	%r4,0
> > >           #0000000000114d1e: e330a0880004	lg	%r3,136(%r10)
> > >           >0000000000114d24: b9040029		lgr	%r2,%r9
> > >            0000000000114d28: 0de7		basr	%r14,%r7
> > >            0000000000114d2a: 1222		ltr	%r2,%r2
> > >            0000000000114d2c: b90400ca		lgr	%r12,%r10
> > >            0000000000114d30: a7840017		brc	8,114d5e
> > > Call Trace:
> > > INFO: lockdep is turned off.
> > > Last Breaking-Event-Address:
> > >  [<0000000000114e4e>] dump_trace+0x66/0x88
> > > addressing exception: 0005 ilc:3 [#2] SMP 
> > > Modules linked in:
> > > CPU: 0 PID: 2 Comm: swapper/0 Tainted: G      D           5.0.4-rc1-00148-g68af88140894 #1
> > > Hardware name: QEMU 2827 QEMU (KVM/Linux)
> > > Krnl PSW : 0004e00180000000 00000000001dfbc8 (cpuacct_charge+0x40/0x218)
> > >            R:0 T:0 IO:0 EX:0 Key:0 M:1 W:0 P:0 AS:3 CC:2 PM:0 RI:0 EA:3
> > > Krnl GPRS: 000000000001b944 000003e0000d8000 0000000000003000 00000000011ef130
> > >            fffffffffff00000 ffffffffff0ed590 0000000000000000 000000001febff18
> > >            0000000000e2a0f8 000000001f842a00 000000001f842a00 00000000011ef130
> > >            00000000011ef130 0000000000b2c148 000000001fa47bd0 000000001fa47b68
> > > Krnl Code: 00000000001dfbba: a78400ef		brc	8,1dfd98
> > >            00000000001dfbbe: a7293000		lghi	%r2,12288
> > >           #00000000001dfbc2: e3321f500091	llgh	%r3,3920(%r2,%r1)
> > >           >00000000001dfbc8: e330d0000082	xg	%r3,0(%r13)
> > >            00000000001dfbce: 5430d008		n	%r3,8(%r13)
> > >            00000000001dfbd2: 581003a0		l	%r1,928
> > >            00000000001dfbd6: a71a0001		ahi	%r1,1
> > >            00000000001dfbda: a7b800ff		lhi	%r11,255
> > > Call Trace:
> > > ([<0000000000000001>] 0x1)
> > >  [<00000000001b8312>] update_curr+0x18a/0x488 
> > >  [<00000000001bce6c>] task_tick_fair+0x4c/0x7f0 
> > >  [<00000000001b2eaa>] scheduler_tick+0x9a/0x130 
> > >  [<000000000022f466>] update_process_times+0x56/0x68 
> > >  [<0000000000242a52>] tick_sched_handle.isra.5+0x52/0x78 
> > >  [<0000000000242adc>] tick_sched_timer+0x64/0xc8 
> > >  [<00000000002302cc>] __hrtimer_run_queues+0x144/0x510 
> > >  [<00000000002314ca>] hrtimer_interrupt+0x102/0x248 
> > >  [<000000000010dbac>] do_IRQ+0x6c/0xb0 
> > >  [<0000000000b118e0>] ext_int_handler+0x130/0x134 
> > >  [<0000000000b1032c>] _raw_spin_unlock_irq+0x44/0x60 
> > > INFO: lockdep is turned off.
> > > Last Breaking-Event-Address:
> > >  [<00000000001b830c>] update_curr+0x184/0x488
> > > Kernel panic - not syncing: Fatal exception in interrupt
> > 
> > Ugh, s390, I have no idea, I just take what is given to me...
> > 
> > Let me see if I can figure it out.
> > 
> Want me to bisect ?

That would be great, and save me a lot of time if you can do that,
thanks!

greg k-h

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: Build failures and crashes in stable queues (3.19, 4.19, 5.0)
  2019-03-21 16:49 ` Greg Kroah-Hartman
@ 2019-03-21 17:38   ` Guenter Roeck
  2019-03-21 18:32     ` Greg Kroah-Hartman
  0 siblings, 1 reply; 11+ messages in thread
From: Guenter Roeck @ 2019-03-21 17:38 UTC (permalink / raw)
  To: Greg Kroah-Hartman; +Cc: stable

On Thu, Mar 21, 2019 at 05:49:40PM +0100, Greg Kroah-Hartman wrote:
> On Thu, Mar 21, 2019 at 09:16:23AM -0700, Guenter Roeck wrote:
> > ---
> > v4.19.y.queue:
> > 
> > m68k, all builds:
> > 
> > mm/slab.c: In function '__check_heap_object':
> > mm/slab.c:4424:8: error: implicit declaration of function 'kasan_reset_tag'
> 
> That's odd, I don't see that function in the tree at all:
> 	$ git grep kasan_reset_tag
> 	$
> 
That is odd.

groeck@server:~/src/linux-stable$ git grep kasan_reset_tag
mm/slab.c:      ptr = kasan_reset_tag(ptr);
groeck@server:~/src/linux-stable$ git describe
v4.19.30-212-g4107be0fa04a

This is from commit 06fc4a6d44dce ("kasan, slab: fix conflicts with
CONFIG_HARDENED_USERCOPY"). Upstream commit is 219667c23c68eb3.

Is your branch different ?

FWIW, what I don't understand is why this doesn't blow up all builds.

Guenter

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: Build failures and crashes in stable queues (3.19, 4.19, 5.0)
  2019-03-21 17:32     ` Greg Kroah-Hartman
@ 2019-03-21 17:52       ` Guenter Roeck
  2019-03-21 18:20       ` Guenter Roeck
  1 sibling, 0 replies; 11+ messages in thread
From: Guenter Roeck @ 2019-03-21 17:52 UTC (permalink / raw)
  To: Greg Kroah-Hartman; +Cc: stable

On Thu, Mar 21, 2019 at 06:32:45PM +0100, Greg Kroah-Hartman wrote:
> > > 
> > Want me to bisect ?
> 
> That would be great, and save me a lot of time if you can do that,
> thanks!
> 
Will do. I'll let you know.

Guenter

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: Build failures and crashes in stable queues (3.19, 4.19, 5.0)
  2019-03-21 17:32     ` Greg Kroah-Hartman
  2019-03-21 17:52       ` Guenter Roeck
@ 2019-03-21 18:20       ` Guenter Roeck
  2019-03-22 11:08         ` Greg Kroah-Hartman
  1 sibling, 1 reply; 11+ messages in thread
From: Guenter Roeck @ 2019-03-21 18:20 UTC (permalink / raw)
  To: Greg Kroah-Hartman; +Cc: stable

On Thu, Mar 21, 2019 at 06:32:45PM +0100, Greg Kroah-Hartman wrote:
> > Want me to bisect ?
> 
> That would be great, and save me a lot of time if you can do that,
> thanks!
> 

See below. The problem is fixed with upstream commit 86a86804e4f18
("s390/setup: fix boot crash for machine without EDAT-1").

Note that 4.14.y is also affected.

Guenter

---
# bad: [4107be0fa04a568e3b3651726a4d7c4c82616ac7] Linux 4.19.31-rc1
# good: [7794d352260604f02e7d446e632af2ca7fe8dda6] Linux 4.19.30
git bisect start 'HEAD' 'v4.19.30'
# good: [49c97d9d99af8e5dcead8d5efb954c53d400c908] net: thunderx: add nicvf_send_msg_to_pf result check for set_rx_mode_task
git bisect good 49c97d9d99af8e5dcead8d5efb954c53d400c908
# bad: [39e29428ac0926122fcfe1e09a738587b6f7b5be] s390/virtio: handle find on invalid queue gracefully
git bisect bad 39e29428ac0926122fcfe1e09a738587b6f7b5be
# good: [a6300398ee44af9372c2568671fa1c34620df84a] crypto: skcipher - set CRYPTO_TFM_NEED_KEY if ->setkey() fails
git bisect good a6300398ee44af9372c2568671fa1c34620df84a
# good: [f003b3e4226914799108471ec497bbd7c27637bd] xen: fix dom0 boot on huge systems
git bisect good f003b3e4226914799108471ec497bbd7c27637bd
# good: [5b0eb946afb2233cc320cb28b50f9dbb64fd1593] regulator: s2mps11: Fix steps for buck7, buck8 and LDO35
git bisect good 5b0eb946afb2233cc320cb28b50f9dbb64fd1593
# good: [fb46b8117ab8ca280eafd754cafe98a5977cb831] clocksource/drivers/exynos_mct: Move one-shot check from tick clear to ISR
git bisect good fb46b8117ab8ca280eafd754cafe98a5977cb831
# good: [fc191b16f180cd2f05113102c97fc03a4ce98018] clocksource/drivers/arch_timer: Workaround for Allwinner A64 timer instability
git bisect good fc191b16f180cd2f05113102c97fc03a4ce98018
# bad: [66dd19a676b2d2c0679a45d6745561bc11edf9f2] s390/setup: fix early warning messages
git bisect bad 66dd19a676b2d2c0679a45d6745561bc11edf9f2
# first bad commit: [66dd19a676b2d2c0679a45d6745561bc11edf9f2] s390/setup: fix early warning messages

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: Build failures and crashes in stable queues (3.19, 4.19, 5.0)
  2019-03-21 17:38   ` Guenter Roeck
@ 2019-03-21 18:32     ` Greg Kroah-Hartman
  0 siblings, 0 replies; 11+ messages in thread
From: Greg Kroah-Hartman @ 2019-03-21 18:32 UTC (permalink / raw)
  To: Guenter Roeck; +Cc: stable

On Thu, Mar 21, 2019 at 10:38:30AM -0700, Guenter Roeck wrote:
> On Thu, Mar 21, 2019 at 05:49:40PM +0100, Greg Kroah-Hartman wrote:
> > On Thu, Mar 21, 2019 at 09:16:23AM -0700, Guenter Roeck wrote:
> > > ---
> > > v4.19.y.queue:
> > > 
> > > m68k, all builds:
> > > 
> > > mm/slab.c: In function '__check_heap_object':
> > > mm/slab.c:4424:8: error: implicit declaration of function 'kasan_reset_tag'
> > 
> > That's odd, I don't see that function in the tree at all:
> > 	$ git grep kasan_reset_tag
> > 	$
> > 
> That is odd.
> 
> groeck@server:~/src/linux-stable$ git grep kasan_reset_tag
> mm/slab.c:      ptr = kasan_reset_tag(ptr);
> groeck@server:~/src/linux-stable$ git describe
> v4.19.30-212-g4107be0fa04a
> 
> This is from commit 06fc4a6d44dce ("kasan, slab: fix conflicts with
> CONFIG_HARDENED_USERCOPY"). Upstream commit is 219667c23c68eb3.
> 
> Is your branch different ?

Ah, yes, Sasha dropped those patches earlier today, sorry about that.

Let me push out another -rc git tree so you can sync up properly.

thanks,

greg k-h

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: Build failures and crashes in stable queues (3.19, 4.19, 5.0)
  2019-03-21 18:20       ` Guenter Roeck
@ 2019-03-22 11:08         ` Greg Kroah-Hartman
  0 siblings, 0 replies; 11+ messages in thread
From: Greg Kroah-Hartman @ 2019-03-22 11:08 UTC (permalink / raw)
  To: Guenter Roeck; +Cc: stable

On Thu, Mar 21, 2019 at 11:20:55AM -0700, Guenter Roeck wrote:
> On Thu, Mar 21, 2019 at 06:32:45PM +0100, Greg Kroah-Hartman wrote:
> > > Want me to bisect ?
> > 
> > That would be great, and save me a lot of time if you can do that,
> > thanks!
> > 
> 
> See below. The problem is fixed with upstream commit 86a86804e4f18
> ("s390/setup: fix boot crash for machine without EDAT-1").
> 
> Note that 4.14.y is also affected.

Thanks for letting me know, I've now queued that patch up.

greg k-h

^ permalink raw reply	[flat|nested] 11+ messages in thread

end of thread, other threads:[~2019-03-22 11:08 UTC | newest]

Thread overview: 11+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2019-03-21 16:16 Build failures and crashes in stable queues (3.19, 4.19, 5.0) Guenter Roeck
2019-03-21 16:47 ` Greg Kroah-Hartman
2019-03-21 16:49 ` Greg Kroah-Hartman
2019-03-21 17:38   ` Guenter Roeck
2019-03-21 18:32     ` Greg Kroah-Hartman
2019-03-21 16:50 ` Greg Kroah-Hartman
2019-03-21 17:28   ` Guenter Roeck
2019-03-21 17:32     ` Greg Kroah-Hartman
2019-03-21 17:52       ` Guenter Roeck
2019-03-21 18:20       ` Guenter Roeck
2019-03-22 11:08         ` Greg Kroah-Hartman

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).