Kernel KVM-PPC virtualization development
 help / color / mirror / Atom feed
From: "Michal Suchánek" <msuchanek@suse.de>
To: Shrikanth Hegde <sshegde@linux.ibm.com>
Cc: Venkat Rao Bagalkote <venkat88@linux.ibm.com>,
	"Christophe Leroy (CS GROUP)" <chleroy@kernel.org>,
	Christian Zigotzky <chzigotzky@xenosoft.de>,
	linuxppc-dev <linuxppc-dev@lists.ozlabs.org>,
	"kvm-ppc@vger.kernel.org" <kvm-ppc@vger.kernel.org>,
	Madhavan Srinivasan <maddy@linux.ibm.com>,
	Peter Zijlstra <peterz@infradead.org>,
	"R.T.Dickinson" <rtd2@xtra.co.nz>,
	hypexed@yahoo.com.au, mad skateman <madskateman@gmail.com>,
	Christian Zigotzky <info@xenosoft.de>,
	Amit Machhiwal <amachhiw@linux.ibm.com>,
	Gautam Menghani <gautam@linux.ibm.com>,
	Harsh Prateek Bora <harshpb@linux.ibm.com>
Subject: Re: [Linux PPC] Disable PREEMPT
Date: Tue, 22 Sep 2026 10:22:47 +0200	[thread overview]
Message-ID: <arI61xOWOp3am23q@kunlun.suse.cz> (raw)
In-Reply-To: <bebaa831-9d56-4276-9422-9c5da8ab220f@linux.ibm.com>

On Mon, Sep 21, 2026 at 10:50:41PM +0530, Shrikanth Hegde wrote:
> Hi Michal,
> 
> On 9/21/26 10:16 PM, Michal Suchánek wrote:
> > On Mon, Sep 21, 2026 at 10:06:22AM +0200, Michal Suchánek wrote:
> > > On Thu, Sep 03, 2026 at 03:28:26PM +0200, Michal Suchánek wrote:
> > > > On Thu, Sep 03, 2026 at 06:06:16PM +0530, Harsh Prateek Bora wrote:
> > > > > + Amit, Gautam - since they recently came across a similar regression which
> > > > > is seen with non KVM workload as well.
> > > > > + Venkat - for CI improvement suggestion below.
> > > > > 
> > > > > Hi Michal,
> > > > > 
> > > > > On 03/09/26 5:55 pm, Michal Suchánek wrote:
> > > > 
> > > > > > 
> > > > > > There is another problem that Linux 7.2.2 often locks up on boot inside
> > > > > > the guest, and as a result a different kernel is needed in the guest to
> > > > > > reproduce the host crash. This is more recent, linux 6.12 does not have
> > > > > > this problem. Will try some different kernel combinations to see if I
> > > > > > can narrow this down. For this the repro is merely booting the kernel in
> > > > > > the VM, it typically fails early before userspace produces any messages.
> > > > 
> > > > This one regressed between 6.19.12
> > > > https://github.com/openSUSE/kernel-source/blob/9f6830f/config/ppc64le/default
> > > > and 7.0.12
> > > > https://github.com/openSUSE/kernel-source/blob/2ebf0bc/config/ppc64le/default
> > > 
> > > Which is when preempt was enabled.
> > > 
> > > Very likely preexisting problem that was exposed by enabling preemption
> > > again.
> > > 
> > > @@ -121,9 +122,7 @@ CONFIG_BPF_LSM=y
> > >   CONFIG_PREEMPT_BUILD=y
> > >   CONFIG_ARCH_HAS_PREEMPT_LAZY=y
> > > -# CONFIG_PREEMPT_NONE is not set
> > > -CONFIG_PREEMPT_VOLUNTARY=y
> > > -# CONFIG_PREEMPT is not set
> > > +CONFIG_PREEMPT=y
> > >   # CONFIG_PREEMPT_LAZY is not set
> > >   CONFIG_PREEMPT_COUNT=y
> > >   CONFIG_PREEMPTION=y
> > 
> > Looking more into this the problem is not reproducible with 6.19 with
> > full preempt, and can be reproduced with 7.0 with full preempt where
> > preemtion is mandatory. It only so happens that 1.19 was last kernel
> > where preemption was not mandatory and where this problem also happened
> > to not manifest with the Tumbleweed config.
> > 
> 
> I am bit confused. Is it different problem than the kprobe/bpf issue
> which was observed on host?

Yes, it appears to be different, a crash very early during boot with a
different stack trace.

> 
> Is this kvm/guest specific problem you are observing? Is it still seen
> even with that kprobe/bpf fix?

Yes, even with the fix this can be observed.

> 
> > It is not deterministic enough to bisect. It's probably some kind of
> > race condition or code generation problem that can surface and go away
> > or become too difficult to reproduce with seemingly unrelated changes.
> > 
> 
> Can you try latest kernel?

How much latest?

I tried with 7.2.6 with the kprobe fix as guest, and some earlier 7.2.x
as host already, and the problem is reproducible.

Thanks

Michal

> 
> There was change recently to move to use
> generic transfer to guest mode work. i.e VIRT_XFER_TO_GUEST_WORK.

> 
> > Crash happens very early but it's eemu so the memory can be saved
> > regardelss. The problem is that the crash tool refuses to load the core
> > bacause it detects the core as SMP and vmlinux as non-SMP or the other
> > way around.
> > 
> > Thanks
> > 
> > Michal
> > 

  reply	other threads:[~2026-09-22  8:22 UTC|newest]

Thread overview: 78+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-02-14 14:02 [Linux PPC] KVM PR and KVM HV do not work if the kernel was compiled with PREEMPT Christian Zigotzky
2026-02-17  5:02 ` Shrikanth Hegde
2026-02-17  8:52   ` Christian Zigotzky
2026-02-17  9:03     ` Shrikanth Hegde
2026-02-17  9:44       ` Christian Zigotzky
2026-02-17 10:17         ` Madhavan Srinivasan
2026-02-17 10:26           ` Christian Zigotzky
2026-02-17 11:34             ` Shrikanth Hegde
2026-02-21  5:30               ` Christian Zigotzky
2026-02-23  3:45                 ` Shrikanth Hegde
2026-02-23 16:48                   ` [Linux PPC] 7.0-rc1: e500_mmu.c:923:26: error: assignment to 'struct tlbe_priv *' from incompatible pointer type 'struct tlbe_ref *' Christian Zigotzky
2026-02-23 18:07                     ` Christophe Leroy (CS GROUP)
2026-02-23 19:38                       ` Christophe Leroy (CS GROUP)
2026-02-23 22:40                         ` Kees Cook
2026-02-24  6:30                           ` Christian Zigotzky
2026-02-24  7:18                           ` Christophe Leroy (CS GROUP)
2026-02-25  5:54               ` [Linux PPC] Disable PREEMPT Christian Zigotzky
2026-02-25  6:23                 ` Shrikanth Hegde
2026-02-25  7:16                 ` Christophe Leroy (CS GROUP)
2026-02-25 11:36                   ` Peter Zijlstra
2026-02-26  5:37                   ` Christian Zigotzky
2026-02-26 13:24                     ` Christophe Leroy (CS GROUP)
2026-09-03  9:53                       ` Michal Suchánek
2026-09-03 10:56                         ` Shrikanth Hegde
2026-09-03 11:25                           ` Michal Suchánek
2026-09-03 11:31                             ` Shrikanth Hegde
2026-09-03 11:40                               ` Michal Suchánek
2026-09-03 12:04                                 ` Shrikanth Hegde
2026-09-03 12:25                                   ` Michal Suchánek
2026-09-03 12:36                                     ` Harsh Prateek Bora
2026-09-03 12:55                                       ` Michal Suchánek
2026-09-03 15:17                                         ` Amit Machhiwal
2026-09-03 13:28                                       ` Michal Suchánek
2026-09-04  7:39                                         ` Michal Suchánek
2026-09-21  8:06                                         ` Michal Suchánek
2026-09-21 16:46                                           ` Michal Suchánek
2026-09-21 17:20                                             ` Shrikanth Hegde
2026-09-22  8:22                                               ` Michal Suchánek [this message]
2026-09-03 17:22                             ` Shrikanth Hegde
2026-09-04  7:35                               ` Michal Suchánek
2026-09-04  9:04                                 ` Shrikanth Hegde
2026-09-10  8:59                                   ` Michal Suchánek
2026-09-10 10:41                                     ` Shrikanth Hegde
2026-09-10 11:29                                       ` Michal Suchánek
2026-09-10 12:16                                         ` Michal Suchánek
2026-09-11 17:09                                           ` Shrikanth Hegde
2026-09-14 10:58                                             ` Michal Suchánek
2026-09-15  5:47                                               ` Narayana Murty N
2026-09-15  7:35                                                 ` Michal Suchánek
2026-09-15  9:08                                                   ` Shrikanth Hegde
2026-09-16 18:11                                                     ` Shrikanth Hegde
2026-09-17 10:14                                                       ` Michal Suchánek
2026-09-17 10:28                                                         ` Shrikanth Hegde
2026-09-17 13:12                                                           ` Michal Suchánek
2026-09-17 14:15                                                             ` Shrikanth Hegde
2026-09-18  2:39                                                               ` Christian Zigotzky
2026-09-18  7:10                                                                 ` Michal Suchánek
2026-09-20 11:49                                                                   ` Christian Zigotzky
2026-09-20 13:04                                                                     ` Christian Zigotzky
2026-09-21  5:12                                                                       ` Shrikanth Hegde
2026-09-23  5:09                                                                         ` Christian Zigotzky
2026-09-23  5:13                                                                           ` Shrikanth Hegde
2026-09-23 16:01                                                                             ` Christian Zigotzky
2026-09-23 18:42                                                                               ` Shrikanth Hegde
2026-09-24 17:47                                                                                 ` Christian Zigotzky
2026-09-25  6:40                                                                                   ` Shrikanth Hegde
2026-09-18  9:26                                                               ` Shrikanth Hegde
2026-09-18 11:52                                                                 ` Michal Suchánek
2026-09-04  8:55                               ` Christian Zigotzky
2026-09-04  9:20                                 ` Christian Zigotzky
2026-09-04  9:24                                   ` Shrikanth Hegde
2026-09-04  9:34                                     ` Christian Zigotzky
2026-09-05 13:07                                       ` Christian Zigotzky
2026-09-07  8:50                                         ` Michal Suchánek
2026-09-07 11:32                                           ` Christian Zigotzky
2026-09-10  8:54                                             ` Michal Suchánek
2026-09-10 10:31                                               ` Michal Suchánek
2026-09-10 11:31                                                 ` Michal Suchánek

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=arI61xOWOp3am23q@kunlun.suse.cz \
    --to=msuchanek@suse.de \
    --cc=amachhiw@linux.ibm.com \
    --cc=chleroy@kernel.org \
    --cc=chzigotzky@xenosoft.de \
    --cc=gautam@linux.ibm.com \
    --cc=harshpb@linux.ibm.com \
    --cc=hypexed@yahoo.com.au \
    --cc=info@xenosoft.de \
    --cc=kvm-ppc@vger.kernel.org \
    --cc=linuxppc-dev@lists.ozlabs.org \
    --cc=maddy@linux.ibm.com \
    --cc=madskateman@gmail.com \
    --cc=peterz@infradead.org \
    --cc=rtd2@xtra.co.nz \
    --cc=sshegde@linux.ibm.com \
    --cc=venkat88@linux.ibm.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox