public inbox for linux-rt-users@vger.kernel.org
 help / color / mirror / Atom feed
From: Petr Mladek <pmladek@suse.com>
To: "John B. Wyatt IV" <jwyatt@redhat.com>
Cc: John Ogness <john.ogness@linutronix.de>,
	Clark Williams <williams@redhat.com>,
	jlelli@redhat.com, Derek Barbosa <debarbos@redhat.com>,
	"John B. Wyatt IV" <sageofredondo@gmail.com>,
	LKML <linux-kernel@vger.kernel.org>,
	linux-rt-users <linux-rt-users@vger.kernel.org>
Subject: Re: NMI Reported with console_blast.sh
Date: Thu, 29 Feb 2024 12:19:40 +0100	[thread overview]
Message-ID: <ZeBoTNe2cjb4BeXb@alley> (raw)
In-Reply-To: <ZeBnUCk598gttpds@alley>

On Thu 2024-02-29 12:15:30, Petr Mladek wrote:
> On Thu 2024-02-22 00:21:19, John B. Wyatt IV wrote:
> > On Mon, Feb 12, 2024 at 04:23:04PM -0500, John B. Wyatt IV wrote:
> > > 
> > > Red Hat's conservers are having an issue with the machine I was testing
> > > on. It may take me a while to get back to you with more test results.
> > > 
> > 
> > Found a work-around with conserver. I was able to follow up on the printk-caller
> > info you requested.
> > 
> > I found 2 additional NMIs for a total of 3. Number 2 is very
> > large-please feel free to let me know what specific information you
> > wanted if it was unnecessary.

[...]

> > Compared to the two NMIs with throughput-performance (no preemption)
> > 
> >   <NMI>
> >   cpus=0
> >    .runnable_avg                  : 3072
> >  kthread (kernel/kthread.c:388) 
> >    .util_est_enqueued             : 0
> >   stack:0     pid:1733  tgid:1733  ppid:2      flags:0x00004000
> >    .min_vruntime                  : 2084315.290254
> >    .removed.load_avg              : 0
> >    .avg_vruntime                  : 2084315.290254
> >  console_blast.s  3497     34770.405603 N     34773.405603         3.000000     34764.898340         4   120 
> >    .util_avg                      : 1024
> >    .util_avg                      : 1024
> 
> It looks like messages from more (many) CPUs are mixed. I guess that they
> are printed by print_cfs_rq(). But the order looks random.
> 
> Also I wonder why it is printed from NMI context. Maybe, it is from
> some perf event, similar to hardlockup detector?

I have realized that we most likely see only small part of the mixed
output. I wonder if it is because it is printed from the emergency
context. Here the messages are flushed when leaving the context
and many might be lost.

Best Regards,
Petr

  reply	other threads:[~2024-02-29 11:19 UTC|newest]

Thread overview: 11+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2024-02-08  0:43 NMI Reported with console_blast.sh John B. Wyatt IV
2024-02-09  9:11 ` John Ogness
2024-02-09 20:50   ` John B. Wyatt IV
2024-02-10 21:27     ` John Ogness
2024-02-12 21:23       ` John B. Wyatt IV
2024-02-22  5:21         ` John B. Wyatt IV
2024-02-29 11:15           ` Petr Mladek
2024-02-29 11:19             ` Petr Mladek [this message]
2024-03-01 10:11             ` Sebastian Andrzej Siewior
2024-03-01 16:53             ` John B. Wyatt IV
2024-02-20 22:24   ` John B. Wyatt IV

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=ZeBoTNe2cjb4BeXb@alley \
    --to=pmladek@suse.com \
    --cc=debarbos@redhat.com \
    --cc=jlelli@redhat.com \
    --cc=john.ogness@linutronix.de \
    --cc=jwyatt@redhat.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-rt-users@vger.kernel.org \
    --cc=sageofredondo@gmail.com \
    --cc=williams@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox