From: Petr Mladek <pmladek@suse.com>
To: John Ogness <john.ogness@linutronix.de>
Cc: Sergey Senozhatsky <senozhatsky@chromium.org>,
Steven Rostedt <rostedt@goodmis.org>,
Thomas Gleixner <tglx@linutronix.de>,
linux-kernel@vger.kernel.org,
Mukesh Ojha <quic_mojha@quicinc.com>,
Andrew Morton <akpm@linux-foundation.org>,
Josh Poimboeuf <jpoimboe@kernel.org>,
"Peter Zijlstra (Intel)" <peterz@infradead.org>,
Ingo Molnar <mingo@kernel.org>,
Kefeng Wang <wangkefeng.wang@huawei.com>,
Arnd Bergmann <arnd@arndb.de>, Uros Bizjak <ubizjak@gmail.com>,
"Guilherme G. Piccoli" <gpiccoli@igalia.com>
Subject: Re: [PATCH printk v4 00/14] fix console flushing
Date: Wed, 7 Feb 2024 17:53:23 +0100 [thread overview]
Message-ID: <ZcO1g0dDmdJMefnC@alley> (raw)
In-Reply-To: <ZcOtXKtHuVUTQNRN@alley>
On Wed 2024-02-07 17:18:38, Petr Mladek wrote:
> On Wed 2024-02-07 14:46:49, John Ogness wrote:
> > Hi,
> >
> > While testing various flushing scenarios, I stumbled on a few
> > issues that cause console flushing to fail. While at LPC2023 in
> > Richmond, I sat down with Petr Mladek and we reviewed the
> > v2 [0] series. This series is the result of that offline
> > discussion. v3 is here [1].
> >
> > This series addresses the following issues:
> >
> > 1. The prb_next_seq() optimization caused inconsistent return
> > values. Fix prb_next_seq() to the originally intended
> > behavior but keep an optimization.
> >
> > 2. pr_flush() might not wait until the most recently stored
> > printk() message if non-finalized records precede it. Fix
> > pr_flush() to wait for all records to print that are at
> > least reserved at the time of the call.
> >
> > 3. In panic, the panic messages will not print if non-finalized
> > records precede them. Add a special condition so that
> > readers on the panic CPU will drop records that are not in
> > a consistent state.
> >
> > 4. It is possible (and easy to reproduce) a scenario where the
> > console on the panic CPU hands over to a waiter of a stopped
> > CPU. Do not use the handover feature in panic.
> >
> > 5. If messages are being dropped during panic, non-panic CPUs
> > are silenced. But by then it is already too late and most
> > likely the panic messages have been dropped. Change the
> > non-panic CPU silencing logic to _immediately_ silence
> > non-panic CPUs during panic. This also leads to clean panic
> > output when many CPUs are blasting the kernel log.
> >
> > 6. If a panic occurs in a context where printk() calls defer
> > printing (NMI or printk_safe section), the printing of the
> > final panic messages rely on irq_work. If that mechanism is
> > not available, the final panic messages are not seen (even
> > though they are finalized in the ringbuffer). Add one last
> > explicit flush after all printk() calls are finished to
> > ensure all available messages in the kernel log are printed.
> >
> > 7. When dumping the stacktrace from panic(), do not use the
> > printk_cpu_sync because it can deadlock if another CPU holds
> > and is unable to release the printk_cpu_sync.
> >
> > This series also performs some minor cleanups to remove open
> > coded checks about the panic context and improve documentation
> > language regarding data-less records.
> >
> > Because of multiple refactoring done in recent history, it
> > would be helpful to provide the LTS maintainers with the proper
> > backported patches. I am happy to do this.
>
> The series seems to be ready linux-next from my POV. I am going
> to push it there so that it gets as much testing before
> the merge window as possible.
JFYI, it has been committed into printk/linux.git,
branch rework/console-flushing-fixes.
Let's keep our fingers crossed.
Best Regards,
Petr
prev parent reply other threads:[~2024-02-07 16:53 UTC|newest]
Thread overview: 19+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-02-07 13:40 [PATCH printk v4 00/14] fix console flushing John Ogness
2024-02-07 13:40 ` [PATCH printk v4 01/14] printk: nbcon: Relocate 32bit seq macros John Ogness
2024-02-07 13:40 ` [PATCH printk v4 02/14] printk: Adjust mapping for " John Ogness
2024-02-07 13:40 ` [PATCH printk v4 03/14] printk: Use prb_first_seq() as base " John Ogness
2024-02-07 13:40 ` [PATCH printk v4 04/14] printk: ringbuffer: Do not skip non-finalized records with prb_next_seq() John Ogness
2024-02-07 16:00 ` Petr Mladek
2024-02-07 13:40 ` [PATCH printk v4 05/14] printk: ringbuffer: Clarify special lpos values John Ogness
2024-02-07 13:40 ` [PATCH printk v4 06/14] printk: For @suppress_panic_printk check for other CPU in panic John Ogness
2024-02-07 13:40 ` [PATCH printk v4 07/14] printk: Add this_cpu_in_panic() John Ogness
2024-02-07 13:40 ` [PATCH printk v4 08/14] printk: ringbuffer: Cleanup reader terminology John Ogness
2024-02-07 13:40 ` [PATCH printk v4 09/14] printk: Wait for all reserved records with pr_flush() John Ogness
2024-02-07 13:40 ` [PATCH printk v4 10/14] printk: ringbuffer: Skip non-finalized records in panic John Ogness
2024-02-07 13:41 ` [PATCH printk v4 11/14] printk: Disable passing console lock owner completely during panic() John Ogness
2024-02-07 13:41 ` [PATCH printk v4 12/14] printk: Avoid non-panic CPUs writing to ringbuffer John Ogness
2024-02-07 13:41 ` [PATCH printk v4 13/14] panic: Flush kernel log buffer at the end John Ogness
2024-02-07 13:41 ` [PATCH printk v4 14/14] dump_stack: Do not get cpu_sync for panic CPU John Ogness
2024-02-07 16:16 ` Petr Mladek
2024-02-07 16:18 ` [PATCH printk v4 00/14] fix console flushing Petr Mladek
2024-02-07 16:53 ` Petr Mladek [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=ZcO1g0dDmdJMefnC@alley \
--to=pmladek@suse.com \
--cc=akpm@linux-foundation.org \
--cc=arnd@arndb.de \
--cc=gpiccoli@igalia.com \
--cc=john.ogness@linutronix.de \
--cc=jpoimboe@kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=mingo@kernel.org \
--cc=peterz@infradead.org \
--cc=quic_mojha@quicinc.com \
--cc=rostedt@goodmis.org \
--cc=senozhatsky@chromium.org \
--cc=tglx@linutronix.de \
--cc=ubizjak@gmail.com \
--cc=wangkefeng.wang@huawei.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox