From: Jan Stancek <jstancek@redhat.com>
To: ltp@lists.linux.it
Subject: [LTP] ❌ FAIL: Test report for kernel 5.4.9-rc1-3abd3b2.cki (stable)
Date: Thu, 9 Jan 2020 05:54:18 -0500 (EST) [thread overview]
Message-ID: <1271182490.1176308.1578567258902.JavaMail.zimbra@redhat.com> (raw)
In-Reply-To: <20200109083752.GA17247@dell5510>
----- Original Message -----
> Hi,
>
> > One or more kernel tests failed:
>
> > ppc64le:
> > ? LTP
> It'd be nice if there were info which LTP tests failed (or even direct link
> to
> files which has the failure).
> There are 20 files related to LTP for ppc64le.
>
> Nothing in dmesg, grep for usual LTP errors didn't find anything
> grep -r -e FAIL -e TFAIL -e TBROK -e BROK |grep -v 'FAILED COMMAND File:'
No tests failed, but there was a soft lockup:
https://artifacts.cki-project.org/pipelines/371074/logs/ppc64le_host_1_LTP_dmesg.log
[ 7394.536000] LTP: starting dio30 (diotest6 -b 65536 -n 100 -i 100 -o 1024000)
[ 7829.754543] watchdog: BUG: soft lockup - CPU#5 stuck for 24s! [systemd-journal:510]
[ 7861.138569] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[ 7871.111478] Modules linked in: dummy minix binfmt_misc nfsv3 nfs_acl nfs lockd grace fscache
[ 7871.112283] rcu: 5-...0: (912 ticks this GP) idle=0f6/1/0x4000000000000002 softirq=333774/333774 fqs=2924
[ 7871.112284] sctp rds brd vfat fat btrfs xor zstd_compress raid6_pq zstd_decompress loop tun ip6table_nat ip6_tables xt_conntrack iptable_filter xt_MASQUERADE xt_comment iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 veth bridge stp llc overlay fuse rfkill sunrpc vmx_crypto virtio_net net_failover failover virtio_balloon crct10dif_vpmsum ip_tables xfs libcrc32c crc32c_vpmsum virtio_console virtio_blk [last unloaded: can]
[ 7871.139880] (detected by 4, t=7002 jiffies, g=449229, q=525)
[ 7871.140056] CPU: 5 PID: 510 Comm: systemd-journal Not tainted 5.4.9-rc1-3abd3b2.cki #1
[ 7882.038415] Sending NMI from CPU 4 to CPUs 5:
[ 7882.038608] NIP: c00000000000b01c LR: c00000000001bbd4 CTR: c000000000828840
[ 7882.039018] REGS: c0000003eeddb7c0 TRAP: 0901 Not tainted (5.4.9-rc1-3abd3b2.cki)
[ 7882.039155] MSR: 8000000000009033 <SF,EE,ME,IR,DR,RI,LE> CR: 4800444f XER: 00000000
[ 7882.039354] CFAR: c0000000000e9564 IRQMASK: 0
GPR00: c000000000d78070 c0000003eeddba50 c00000000180fe00 0000000000000900
GPR04: 0000000000000000 0000000000000000 5b20373830302e38 c00000003fff8a00
GPR08: 0000000800000000 c0000003f9eb27d8 c0000003f9eb27e0 c0000003fb01ea00
GPR12: c000000000828840 c00000003fff8a00
[ 7882.040042] NIP [c00000000000b01c] replay_interrupt_return+0x0/0x4
[ 7882.040177] LR [c00000000001bbd4] arch_local_irq_restore.part.0+0x54/0x70
[ 7882.040303] Call Trace:
[ 7882.040439] [c0000003eeddba50] [c0000003eeddba90] 0xc0000003eeddba90 (unreliable)
[ 7882.040675] [c0000003eeddba70] [c000000000d78070] _raw_spin_unlock_irqrestore+0x50/0xb0
[ 7882.040974] [c0000003eeddba90] [c00000000082b58c] hvc_write+0xfc/0x240
[ 7882.041143] [c0000003eeddbaf0] [c000000000801e50] n_tty_write+0x190/0x660
[ 7882.041316] [c0000003eeddbbc0] [c0000000007fc67c] tty_write+0x19c/0x320
[ 7887.785437] CPU 5 didn't respond to backtrace IPI, inspecting paca.
[ 7888.292647] [c0000003eeddbc80] [c00000000045885c] do_iter_write+0x1ac/0x280
[ 7888.292755] irq_soft_mask: 0x01 in_mce: 0 in_nmi: 0 current: 510 (systemd-journal)
[ 7888.292924] [c0000003eeddbcd0] [c000000000458a20] vfs_writev+0xc0/0x170
[ 7888.321765] Back trace of paca->saved_r1 (0xc0000003eeddb160) (possibly stale):
[ 7888.321897] [c0000003eeddbdc0] [c000000000458b60] do_writev+0x90/0x1a0
[ 7888.366983] Call Trace:
[ 7888.367103] [c0000003eeddbe20] [c00000000000b9d0] system_call+0x5c/0x68
[ 7888.367143] [c0000003eeddb160] [0000000000000001] 0x1 (unreliable)
[ 7888.367236] Instruction dump:
[ 7888.367409] rcu: rcu_sched kthread starved for 2724 jiffies! g449229 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=4
[ 7888.367449] 7d200026 618c8000 2c030900 4182e2e8 2c030500 4182dc40 2c030f00 4182f2b8
[ 7888.396459] rcu: RCU grace-period kthread stack dump:
[ 7888.396599] 2c030a00 4182ffc8 60000000 60000000 <4e800020> 7c781b78 48000349 48000361
[ 7888.396724] rcu_sched I 0 10 2 0x00000808
[ 7888.396943] Call Trace:
[ 7888.397012] [c0000003fb5ff880] [c0000003feb96b00] 0xc0000003feb96b00 (unreliable)
[ 7888.397174] [c0000003fb5ffa60] [c000000000021f4c] __switch_to+0x33c/0x500
[ 7888.397289] [c0000003fb5ffac0] [c000000000d704f8] __schedule+0x2c8/0x8f0
[ 7888.397410] [c0000003fb5ffb90] [c000000000d70b78] schedule+0x58/0x130
[ 7888.397520] [c0000003fb5ffbc0] [c000000000d76744] schedule_timeout+0x1a4/0x3c0
[ 7888.397676] [c0000003fb5ffca0] [c0000000001de608] rcu_gp_kthread+0x9b8/0xd80
[ 7888.397871] [c0000003fb5ffdb0] [c00000000016f504] kthread+0x1a4/0x1b0
[ 7888.398040] [c0000003fb5ffe20] [c00000000000bdbc] ret_from_kernel_thread+0x5c/0x80
WARNING: multiple messages have this Message-ID (diff)
From: Jan Stancek <jstancek@redhat.com>
To: Petr Vorel <pvorel@suse.cz>
Cc: CKI Project <cki-project@redhat.com>,
Memory Management <mm-qe@redhat.com>,
LTP Mailing List <ltp@lists.linux.it>,
Linux Stable maillist <stable@vger.kernel.org>
Subject: Re: [LTP] ❌ FAIL: Test report for kernel 5.4.9-rc1-3abd3b2.cki (stable)
Date: Thu, 9 Jan 2020 05:54:18 -0500 (EST) [thread overview]
Message-ID: <1271182490.1176308.1578567258902.JavaMail.zimbra@redhat.com> (raw)
In-Reply-To: <20200109083752.GA17247@dell5510>
----- Original Message -----
> Hi,
>
> > One or more kernel tests failed:
>
> > ppc64le:
> > ❌ LTP
> It'd be nice if there were info which LTP tests failed (or even direct link
> to
> files which has the failure).
> There are 20 files related to LTP for ppc64le.
>
> Nothing in dmesg, grep for usual LTP errors didn't find anything
> grep -r -e FAIL -e TFAIL -e TBROK -e BROK |grep -v 'FAILED COMMAND File:'
No tests failed, but there was a soft lockup:
https://artifacts.cki-project.org/pipelines/371074/logs/ppc64le_host_1_LTP_dmesg.log
[ 7394.536000] LTP: starting dio30 (diotest6 -b 65536 -n 100 -i 100 -o 1024000)
[ 7829.754543] watchdog: BUG: soft lockup - CPU#5 stuck for 24s! [systemd-journal:510]
[ 7861.138569] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[ 7871.111478] Modules linked in: dummy minix binfmt_misc nfsv3 nfs_acl nfs lockd grace fscache
[ 7871.112283] rcu: 5-...0: (912 ticks this GP) idle=0f6/1/0x4000000000000002 softirq=333774/333774 fqs=2924
[ 7871.112284] sctp rds brd vfat fat btrfs xor zstd_compress raid6_pq zstd_decompress loop tun ip6table_nat ip6_tables xt_conntrack iptable_filter xt_MASQUERADE xt_comment iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 veth bridge stp llc overlay fuse rfkill sunrpc vmx_crypto virtio_net net_failover failover virtio_balloon crct10dif_vpmsum ip_tables xfs libcrc32c crc32c_vpmsum virtio_console virtio_blk [last unloaded: can]
[ 7871.139880] (detected by 4, t=7002 jiffies, g=449229, q=525)
[ 7871.140056] CPU: 5 PID: 510 Comm: systemd-journal Not tainted 5.4.9-rc1-3abd3b2.cki #1
[ 7882.038415] Sending NMI from CPU 4 to CPUs 5:
[ 7882.038608] NIP: c00000000000b01c LR: c00000000001bbd4 CTR: c000000000828840
[ 7882.039018] REGS: c0000003eeddb7c0 TRAP: 0901 Not tainted (5.4.9-rc1-3abd3b2.cki)
[ 7882.039155] MSR: 8000000000009033 <SF,EE,ME,IR,DR,RI,LE> CR: 4800444f XER: 00000000
[ 7882.039354] CFAR: c0000000000e9564 IRQMASK: 0
GPR00: c000000000d78070 c0000003eeddba50 c00000000180fe00 0000000000000900
GPR04: 0000000000000000 0000000000000000 5b20373830302e38 c00000003fff8a00
GPR08: 0000000800000000 c0000003f9eb27d8 c0000003f9eb27e0 c0000003fb01ea00
GPR12: c000000000828840 c00000003fff8a00
[ 7882.040042] NIP [c00000000000b01c] replay_interrupt_return+0x0/0x4
[ 7882.040177] LR [c00000000001bbd4] arch_local_irq_restore.part.0+0x54/0x70
[ 7882.040303] Call Trace:
[ 7882.040439] [c0000003eeddba50] [c0000003eeddba90] 0xc0000003eeddba90 (unreliable)
[ 7882.040675] [c0000003eeddba70] [c000000000d78070] _raw_spin_unlock_irqrestore+0x50/0xb0
[ 7882.040974] [c0000003eeddba90] [c00000000082b58c] hvc_write+0xfc/0x240
[ 7882.041143] [c0000003eeddbaf0] [c000000000801e50] n_tty_write+0x190/0x660
[ 7882.041316] [c0000003eeddbbc0] [c0000000007fc67c] tty_write+0x19c/0x320
[ 7887.785437] CPU 5 didn't respond to backtrace IPI, inspecting paca.
[ 7888.292647] [c0000003eeddbc80] [c00000000045885c] do_iter_write+0x1ac/0x280
[ 7888.292755] irq_soft_mask: 0x01 in_mce: 0 in_nmi: 0 current: 510 (systemd-journal)
[ 7888.292924] [c0000003eeddbcd0] [c000000000458a20] vfs_writev+0xc0/0x170
[ 7888.321765] Back trace of paca->saved_r1 (0xc0000003eeddb160) (possibly stale):
[ 7888.321897] [c0000003eeddbdc0] [c000000000458b60] do_writev+0x90/0x1a0
[ 7888.366983] Call Trace:
[ 7888.367103] [c0000003eeddbe20] [c00000000000b9d0] system_call+0x5c/0x68
[ 7888.367143] [c0000003eeddb160] [0000000000000001] 0x1 (unreliable)
[ 7888.367236] Instruction dump:
[ 7888.367409] rcu: rcu_sched kthread starved for 2724 jiffies! g449229 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=4
[ 7888.367449] 7d200026 618c8000 2c030900 4182e2e8 2c030500 4182dc40 2c030f00 4182f2b8
[ 7888.396459] rcu: RCU grace-period kthread stack dump:
[ 7888.396599] 2c030a00 4182ffc8 60000000 60000000 <4e800020> 7c781b78 48000349 48000361
[ 7888.396724] rcu_sched I 0 10 2 0x00000808
[ 7888.396943] Call Trace:
[ 7888.397012] [c0000003fb5ff880] [c0000003feb96b00] 0xc0000003feb96b00 (unreliable)
[ 7888.397174] [c0000003fb5ffa60] [c000000000021f4c] __switch_to+0x33c/0x500
[ 7888.397289] [c0000003fb5ffac0] [c000000000d704f8] __schedule+0x2c8/0x8f0
[ 7888.397410] [c0000003fb5ffb90] [c000000000d70b78] schedule+0x58/0x130
[ 7888.397520] [c0000003fb5ffbc0] [c000000000d76744] schedule_timeout+0x1a4/0x3c0
[ 7888.397676] [c0000003fb5ffca0] [c0000000001de608] rcu_gp_kthread+0x9b8/0xd80
[ 7888.397871] [c0000003fb5ffdb0] [c00000000016f504] kthread+0x1a4/0x1b0
[ 7888.398040] [c0000003fb5ffe20] [c00000000000bdbc] ret_from_kernel_thread+0x5c/0x80
next prev parent reply other threads:[~2020-01-09 10:54 UTC|newest]
Thread overview: 8+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-01-08 2:42 [LTP] ❌ FAIL: Test report for kernel 5.4.9-rc1-3abd3b2.cki (stable) CKI Project
2020-01-08 2:42 ` CKI Project
2020-01-09 8:37 ` [LTP] " Petr Vorel
2020-01-09 8:37 ` Petr Vorel
2020-01-09 10:54 ` Jan Stancek [this message]
2020-01-09 10:54 ` Jan Stancek
2020-01-09 11:22 ` Petr Vorel
2020-01-09 11:22 ` Petr Vorel
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1271182490.1176308.1578567258902.JavaMail.zimbra@redhat.com \
--to=jstancek@redhat.com \
--cc=ltp@lists.linux.it \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.