All of lore.kernel.org
 help / color / mirror / Atom feed
From: Hidehiro Kawai <hidehiro.kawai.ez@hitachi.com>
To: Jonathan Corbet <corbet@lwn.net>,
	Peter Zijlstra <peterz@infradead.org>,
	Ingo Molnar <mingo@kernel.org>,
	"Eric W. Biederman" <ebiederm@xmission.com>,
	"H. Peter Anvin" <hpa@zytor.com>,
	Andrew Morton <akpm@linux-foundation.org>,
	Thomas Gleixner <tglx@linutronix.de>,
	Vivek Goyal <vgoyal@redhat.com>
Cc: linux-doc@vger.kernel.org, x86@kernel.org,
	kexec@lists.infradead.org, linux-kernel@vger.kernel.org,
	Michal Hocko <mhocko@kernel.org>,
	Masami Hiramatsu <masami.hiramatsu.pt@hitachi.com>
Subject: [V4 PATCH 0/4] Fix race issues among panic, NMI and crash_kexec
Date: Fri, 25 Sep 2015 20:28:03 +0900	[thread overview]
Message-ID: <20150925112803.4258.94241.stgit@softrs> (raw)

When an HA clustering software or administrator detects unresponsivenes
of a host, they issue an NMI to the host to completely stop current
works and take a crash dump.  If the kernel has already panicked
or is capturing a crash dump at that time, further NMI can cause
a crash dump failure.

Also, crash_kexec() called from oops context and panic() can
cause race conditions.

To solve these issues, this patch set does following things:

- Don't call panic() on NMI if the kernel has already panicked
- Extend exclusion control currently done by panic_lock to crash_kexec
- Introduce "noextnmi" boot option which masks external NMI at the
  boot time (supported only for x86)

This patch set can be applied to current -tip tree.

V4:
- Improve comments and descriptions (PATCH 1/4 to 3/4)
- Use new __crash_kexec(), no exclusion check version of crash_kexec(),
  instead of checking if panic_cpu is the current cpu or not
  (PATCH 3/4)

V3: https://lkml.org/lkml/2015/8/6/39
- Introduce nmi_panic() macro to reduce code duplication
- In the case of panic on NMI, don't return from NMI handlers
  if another cpu already panicked

V2: https://lkml.org/lkml/2015/7/27/31
- Use atomic_cmpxchg() instead of current spin_trylock() to exclude
  concurrent accesses to panic() and crash_kexec()
- Don't introduce no-lock version of panic() and crash_kexec()

V1: https://lkml.org/lkml/2015/7/22/81

---

Hidehiro Kawai (4):
      panic/x86: Fix re-entrance problem due to panic on NMI
      panic/x86: Allow cpus to save registers even if they are looping in NMI context
      kexec: Fix race between panic() and crash_kexec() called directly
      x86/apic: Introduce noextnmi boot option


 Documentation/kernel-parameters.txt |    4 ++++
 arch/x86/kernel/apic/apic.c         |   17 ++++++++++++++++-
 arch/x86/kernel/nmi.c               |   16 ++++++++++++----
 arch/x86/kernel/reboot.c            |   11 +++++++++++
 include/linux/kernel.h              |   21 +++++++++++++++++++++
 include/linux/kexec.h               |    1 +
 kernel/kexec_core.c                 |   26 +++++++++++++++++++++++++-
 kernel/panic.c                      |   29 ++++++++++++++++++++++++-----
 kernel/watchdog.c                   |    5 +++--
 9 files changed, 117 insertions(+), 13 deletions(-)


-- 
Hidehiro Kawai
Hitachi, Ltd. Research & Development Group



_______________________________________________
kexec mailing list
kexec@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/kexec

WARNING: multiple messages have this Message-ID (diff)
From: Hidehiro Kawai <hidehiro.kawai.ez@hitachi.com>
To: Jonathan Corbet <corbet@lwn.net>,
	Peter Zijlstra <peterz@infradead.org>,
	Ingo Molnar <mingo@kernel.org>,
	"Eric W. Biederman" <ebiederm@xmission.com>,
	"H. Peter Anvin" <hpa@zytor.com>,
	Andrew Morton <akpm@linux-foundation.org>,
	Thomas Gleixner <tglx@linutronix.de>,
	Vivek Goyal <vgoyal@redhat.com>
Cc: linux-doc@vger.kernel.org, x86@kernel.org,
	kexec@lists.infradead.org, linux-kernel@vger.kernel.org,
	Michal Hocko <mhocko@kernel.org>,
	Masami Hiramatsu <masami.hiramatsu.pt@hitachi.com>
Subject: [V4 PATCH 0/4] Fix race issues among panic, NMI and crash_kexec
Date: Fri, 25 Sep 2015 20:28:03 +0900	[thread overview]
Message-ID: <20150925112803.4258.94241.stgit@softrs> (raw)

When an HA clustering software or administrator detects unresponsivenes
of a host, they issue an NMI to the host to completely stop current
works and take a crash dump.  If the kernel has already panicked
or is capturing a crash dump at that time, further NMI can cause
a crash dump failure.

Also, crash_kexec() called from oops context and panic() can
cause race conditions.

To solve these issues, this patch set does following things:

- Don't call panic() on NMI if the kernel has already panicked
- Extend exclusion control currently done by panic_lock to crash_kexec
- Introduce "noextnmi" boot option which masks external NMI at the
  boot time (supported only for x86)

This patch set can be applied to current -tip tree.

V4:
- Improve comments and descriptions (PATCH 1/4 to 3/4)
- Use new __crash_kexec(), no exclusion check version of crash_kexec(),
  instead of checking if panic_cpu is the current cpu or not
  (PATCH 3/4)

V3: https://lkml.org/lkml/2015/8/6/39
- Introduce nmi_panic() macro to reduce code duplication
- In the case of panic on NMI, don't return from NMI handlers
  if another cpu already panicked

V2: https://lkml.org/lkml/2015/7/27/31
- Use atomic_cmpxchg() instead of current spin_trylock() to exclude
  concurrent accesses to panic() and crash_kexec()
- Don't introduce no-lock version of panic() and crash_kexec()

V1: https://lkml.org/lkml/2015/7/22/81

---

Hidehiro Kawai (4):
      panic/x86: Fix re-entrance problem due to panic on NMI
      panic/x86: Allow cpus to save registers even if they are looping in NMI context
      kexec: Fix race between panic() and crash_kexec() called directly
      x86/apic: Introduce noextnmi boot option


 Documentation/kernel-parameters.txt |    4 ++++
 arch/x86/kernel/apic/apic.c         |   17 ++++++++++++++++-
 arch/x86/kernel/nmi.c               |   16 ++++++++++++----
 arch/x86/kernel/reboot.c            |   11 +++++++++++
 include/linux/kernel.h              |   21 +++++++++++++++++++++
 include/linux/kexec.h               |    1 +
 kernel/kexec_core.c                 |   26 +++++++++++++++++++++++++-
 kernel/panic.c                      |   29 ++++++++++++++++++++++++-----
 kernel/watchdog.c                   |    5 +++--
 9 files changed, 117 insertions(+), 13 deletions(-)


-- 
Hidehiro Kawai
Hitachi, Ltd. Research & Development Group



             reply	other threads:[~2015-09-25 12:03 UTC|newest]

Thread overview: 78+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2015-09-25 11:28 Hidehiro Kawai [this message]
2015-09-25 11:28 ` [V4 PATCH 0/4] Fix race issues among panic, NMI and crash_kexec Hidehiro Kawai
2015-09-25 11:28 ` [V4 PATCH 1/4] panic/x86: Fix re-entrance problem due to panic on NMI Hidehiro Kawai
2015-09-25 11:28   ` Hidehiro Kawai
2015-09-25 12:13   ` 河合英宏 / KAWAI,HIDEHIRO
2015-09-25 12:13     ` 河合英宏 / KAWAI,HIDEHIRO
2015-09-30 11:26     ` Peter Zijlstra
2015-09-30 11:26       ` Peter Zijlstra
2015-10-01  1:02       ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-01  1:02         ` 河合英宏 / KAWAI,HIDEHIRO
2015-09-25 11:28 ` [V4 PATCH 2/4] panic/x86: Allow cpus to save registers even if they are looping in NMI context Hidehiro Kawai
2015-09-25 11:28   ` Hidehiro Kawai
2015-09-30 11:50   ` Peter Zijlstra
2015-09-30 11:50     ` Peter Zijlstra
2015-10-01  1:43     ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-01  1:43       ` 河合英宏 / KAWAI,HIDEHIRO
2015-09-25 11:28 ` [V4 PATCH 3/4] kexec: Fix race between panic() and crash_kexec() called directly Hidehiro Kawai
2015-09-25 11:28   ` Hidehiro Kawai
2015-09-28  3:53   ` kbuild test robot
2015-09-28  3:53     ` kbuild test robot
2015-09-28  7:08     ` 河合英宏 / KAWAI,HIDEHIRO
2015-09-28  7:08       ` 河合英宏 / KAWAI,HIDEHIRO
2015-09-30 11:53       ` Peter Zijlstra
2015-09-30 11:53         ` Peter Zijlstra
2015-10-01  2:04         ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-01  2:04           ` 河合英宏 / KAWAI,HIDEHIRO
2015-09-28  4:02   ` kbuild test robot
2015-09-28  4:02     ` kbuild test robot
2015-09-28  4:46     ` 河合英宏 / KAWAI,HIDEHIRO
2015-09-28  4:46       ` 河合英宏 / KAWAI,HIDEHIRO
2015-09-25 11:28 ` [V4 PATCH 4/4] x86/apic: Introduce noextnmi boot option Hidehiro Kawai
2015-09-25 11:28   ` Hidehiro Kawai
2015-09-30 11:55   ` Peter Zijlstra
2015-09-30 11:55     ` Peter Zijlstra
2015-10-01  2:33     ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-01  2:33       ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-01  6:27       ` Peter Zijlstra
2015-10-01  6:27         ` Peter Zijlstra
2015-10-01  7:01         ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-01  7:01           ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-01  8:43           ` Borislav Petkov
2015-10-01  8:43             ` Borislav Petkov
2015-10-01 10:24             ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-01 10:24               ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-01 11:01               ` Borislav Petkov
2015-10-01 11:01                 ` Borislav Petkov
2015-10-02  0:58                 ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-02  0:58                   ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-02  7:47                   ` Borislav Petkov
2015-10-02  7:47                     ` Borislav Petkov
2015-10-05  2:03                     ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-05  2:03                       ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-05  8:27                       ` Borislav Petkov
2015-10-05  8:27                         ` Borislav Petkov
2015-10-05  9:21                         ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-05  9:21                           ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-05 10:14                           ` Borislav Petkov
2015-10-05 10:14                             ` Borislav Petkov
2015-10-13 11:55                             ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-13 11:55                               ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-13 20:19                         ` Thomas Gleixner
2015-10-14 13:54                           ` Ingo Molnar
2015-10-14 13:54                             ` Ingo Molnar
2015-10-16  1:58                             ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-16  1:58                               ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-13 20:22   ` Thomas Gleixner
2015-10-13 20:22     ` Thomas Gleixner
2015-10-14  3:39     ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-14  3:39       ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-14  7:25       ` Thomas Gleixner
2015-10-16  2:02         ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-16  2:02           ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-27  8:46   ` Baoquan He
2015-10-27  8:46     ` Baoquan He
2015-10-27  9:01     ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-27  9:01       ` 河合英宏 / KAWAI,HIDEHIRO
2015-10-27  9:06       ` 'Baoquan He'
2015-10-27  9:06         ` 'Baoquan He'

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20150925112803.4258.94241.stgit@softrs \
    --to=hidehiro.kawai.ez@hitachi.com \
    --cc=akpm@linux-foundation.org \
    --cc=corbet@lwn.net \
    --cc=ebiederm@xmission.com \
    --cc=hpa@zytor.com \
    --cc=kexec@lists.infradead.org \
    --cc=linux-doc@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=masami.hiramatsu.pt@hitachi.com \
    --cc=mhocko@kernel.org \
    --cc=mingo@kernel.org \
    --cc=peterz@infradead.org \
    --cc=tglx@linutronix.de \
    --cc=vgoyal@redhat.com \
    --cc=x86@kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.