From: Jingbai Ma <jingbai.ma@hp.com>
To: "Eric W. Biederman" <ebiederm@xmission.com>
Cc: jingbai.ma@hp.com,
"kexec@lists.infradead.org" <kexec@lists.infradead.org>,
"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
"Mitchell, Lisa (MCLinux in Fort Collins)" <lisa.mitchell@hp.com>,
"mingo@redhat.com" <mingo@redhat.com>,
"kumagai-atsushi@mxc.nes.nec.co.jp"
<kumagai-atsushi@mxc.nes.nec.co.jp>,
"Ma, Jingbai (Kingboard)" <kingboard.ma@hp.com>,
"H. Peter Anvin" <hpa@zytor.com>,
"yinghai@kernel.org" <yinghai@kernel.org>,
Vivek Goyal <vgoyal@redhat.com>
Subject: Re: [RFC PATCH 0/5] crash dump bitmap: scan memory pages in kernel to speedup kernel dump process
Date: Mon, 11 Mar 2013 16:31:23 +0800 [thread overview]
Message-ID: <513D965B.8010503@hp.com> (raw)
In-Reply-To: <87r4jpoono.fsf@xmission.com>
On 03/09/2013 12:13 AM, Eric W. Biederman wrote:
> "Ma, Jingbai (Kingboard)"<kingboard.ma@hp.com> writes:
>
>> On 3/8/13 6:33 PM, "H. Peter Anvin"<hpa@zytor.com> wrote:
>>
>>
>>> On 03/08/2013 02:06 AM, Jingbai Ma wrote:
>>>>
>>>> Kernel do have some abilities that user space haven't. It's possible to
>>>> map whole memory space of the first kernel into user space on the second
>>>> kernel. But the user space code has to re-implement some parts of the
>>>> kernel memory management system again. And worse, it's architecture
>>>> dependent, more architectures supported, more codes have to be
>>>> implemented. All implementation in user space must be sync to kernel
>>>> implementation. It's may called "flexibility", but it's painful to
>>>> maintain the codes.
>>>>
>>>
>>> What? You are basically talking about /dev/mem... there is nothing
>>> particularly magic about it at all.
>>
>> What we are talking about is filtering memory pages (AKA memory pages
>> classification)
>> The makedumpfile (or any other dumper in user space) has to know the
>> exactly
>> memory layout of the memory management data structures, it not only
>> architecture dependent, but also may varies in different kernel release.
>> At this point, /dev/mem doesn't give any help.
>> So IMHO, I would like to do it in kernel, rather than So keep tracking
>> changes in user space code.
>
> But the fact is there is no requirment that the crash dump capture
> kernel is the same version as the kernel that crashed. In fact it has
> been common at some points in time to use slightly different build
> options, or slightly different kernels. Say a 32bit PAE kernel to
> capture a 64bit x86_64 kernel.
The filtering code will be executed in the first kernel, so this problem
will not be exist.
>
> So in fact performing this work in the kernel and is actively harmful to
> reliability and maintenance because it adds an incorrect assumption.
>
> If you do want the benefit of shared maintenance with the kernel one
> solution that has been suggested several times is to put code into
> tools/makedumpfile (probably a library) that encapsulates the kernel
> specific knowledge that can be loaded into the ramdisk when the
> crahsdump kernel is being loaded.
>
> That would allow shared maintenance along without breaking the
> possibility of supporting kernel versions.
Yes, you are right. But it requires makedumpfile changes significantly,
and if we also want to shared the code with kernel memory management
subsystem, I believe that's not a easy job. (at least to my limited
kernel knowledge)
>
> Eric
--
Jingbai Ma (jingbai.ma@hp.com)
_______________________________________________
kexec mailing list
kexec@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/kexec
WARNING: multiple messages have this Message-ID (diff)
From: Jingbai Ma <jingbai.ma@hp.com>
To: "Eric W. Biederman" <ebiederm@xmission.com>
Cc: "Ma, Jingbai (Kingboard)" <kingboard.ma@hp.com>,
"H. Peter Anvin" <hpa@zytor.com>, Vivek Goyal <vgoyal@redhat.com>,
"mingo@redhat.com" <mingo@redhat.com>,
"kumagai-atsushi@mxc.nes.nec.co.jp"
<kumagai-atsushi@mxc.nes.nec.co.jp>,
"yinghai@kernel.org" <yinghai@kernel.org>,
"kexec@lists.infradead.org" <kexec@lists.infradead.org>,
"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
"Mitchell, Lisa (MCLinux in Fort Collins)" <lisa.mitchell@hp.com>,
jingbai.ma@hp.com
Subject: Re: [RFC PATCH 0/5] crash dump bitmap: scan memory pages in kernel to speedup kernel dump process
Date: Mon, 11 Mar 2013 16:31:23 +0800 [thread overview]
Message-ID: <513D965B.8010503@hp.com> (raw)
In-Reply-To: <87r4jpoono.fsf@xmission.com>
On 03/09/2013 12:13 AM, Eric W. Biederman wrote:
> "Ma, Jingbai (Kingboard)"<kingboard.ma@hp.com> writes:
>
>> On 3/8/13 6:33 PM, "H. Peter Anvin"<hpa@zytor.com> wrote:
>>
>>
>>> On 03/08/2013 02:06 AM, Jingbai Ma wrote:
>>>>
>>>> Kernel do have some abilities that user space haven't. It's possible to
>>>> map whole memory space of the first kernel into user space on the second
>>>> kernel. But the user space code has to re-implement some parts of the
>>>> kernel memory management system again. And worse, it's architecture
>>>> dependent, more architectures supported, more codes have to be
>>>> implemented. All implementation in user space must be sync to kernel
>>>> implementation. It's may called "flexibility", but it's painful to
>>>> maintain the codes.
>>>>
>>>
>>> What? You are basically talking about /dev/mem... there is nothing
>>> particularly magic about it at all.
>>
>> What we are talking about is filtering memory pages (AKA memory pages
>> classification)
>> The makedumpfile (or any other dumper in user space) has to know the
>> exactly
>> memory layout of the memory management data structures, it not only
>> architecture dependent, but also may varies in different kernel release.
>> At this point, /dev/mem doesn't give any help.
>> So IMHO, I would like to do it in kernel, rather than So keep tracking
>> changes in user space code.
>
> But the fact is there is no requirment that the crash dump capture
> kernel is the same version as the kernel that crashed. In fact it has
> been common at some points in time to use slightly different build
> options, or slightly different kernels. Say a 32bit PAE kernel to
> capture a 64bit x86_64 kernel.
The filtering code will be executed in the first kernel, so this problem
will not be exist.
>
> So in fact performing this work in the kernel and is actively harmful to
> reliability and maintenance because it adds an incorrect assumption.
>
> If you do want the benefit of shared maintenance with the kernel one
> solution that has been suggested several times is to put code into
> tools/makedumpfile (probably a library) that encapsulates the kernel
> specific knowledge that can be loaded into the ramdisk when the
> crahsdump kernel is being loaded.
>
> That would allow shared maintenance along without breaking the
> possibility of supporting kernel versions.
Yes, you are right. But it requires makedumpfile changes significantly,
and if we also want to shared the code with kernel memory management
subsystem, I believe that's not a easy job. (at least to my limited
kernel knowledge)
>
> Eric
--
Jingbai Ma (jingbai.ma@hp.com)
next prev parent reply other threads:[~2013-03-11 8:31 UTC|newest]
Thread overview: 54+ messages / expand[flat|nested] mbox.gz Atom feed top
2013-03-07 14:58 [RFC PATCH 0/5] crash dump bitmap: scan memory pages in kernel to speedup kernel dump process Jingbai Ma
2013-03-07 14:58 ` Jingbai Ma
2013-03-07 14:58 ` [RFC PATCH 1/5] crash dump bitmap: add a kernel config and help document Jingbai Ma
2013-03-07 14:58 ` Jingbai Ma
2013-03-07 14:58 ` [RFC PATCH 2/5] crash dump bitmap: init crash dump bitmap in kernel booting process Jingbai Ma
2013-03-07 14:58 ` Jingbai Ma
2013-03-07 14:58 ` [RFC PATCH 3/5] crash dump bitmap: scan memory pages in kernel crash process Jingbai Ma
2013-03-07 14:58 ` Jingbai Ma
2013-03-07 14:59 ` [RFC PATCH 4/5] crash dump bitmap: add a proc interface for crash dump bitmap Jingbai Ma
2013-03-07 14:59 ` Jingbai Ma
2013-03-07 14:59 ` [RFC PATCH 5/5] crash dump bitmap: workaround for kernel 3.9-rc1 kdump issue Jingbai Ma
2013-03-07 14:59 ` Jingbai Ma
2013-03-07 15:21 ` [RFC PATCH 0/5] crash dump bitmap: scan memory pages in kernel to speedup kernel dump process Vivek Goyal
2013-03-07 15:21 ` Vivek Goyal
2013-03-07 21:38 ` Yinghai Lu
2013-03-07 21:38 ` Yinghai Lu
2013-03-07 21:54 ` Eric W. Biederman
2013-03-07 21:54 ` Eric W. Biederman
2013-03-08 15:52 ` Vivek Goyal
2013-03-08 15:52 ` Vivek Goyal
2013-03-08 16:19 ` Eric W. Biederman
2013-03-08 16:19 ` Eric W. Biederman
2013-03-11 8:18 ` Jingbai Ma
2013-03-11 8:18 ` Jingbai Ma
2013-03-11 9:42 ` Eric W. Biederman
2013-03-11 9:42 ` Eric W. Biederman
2013-03-12 10:05 ` Jingbai Ma
2013-03-12 10:05 ` Jingbai Ma
2013-03-12 19:48 ` Eric W. Biederman
2013-03-12 19:48 ` Eric W. Biederman
2013-03-08 1:31 ` HATAYAMA Daisuke
2013-03-08 1:31 ` HATAYAMA Daisuke
2013-03-08 10:06 ` Jingbai Ma
2013-03-08 10:06 ` Jingbai Ma
2013-03-08 10:33 ` H. Peter Anvin
2013-03-08 10:33 ` H. Peter Anvin
2013-03-08 13:31 ` Ma, Jingbai (Kingboard)
2013-03-08 13:31 ` Ma, Jingbai (Kingboard)
2013-03-08 16:13 ` Eric W. Biederman
2013-03-08 16:13 ` Eric W. Biederman
2013-03-11 8:31 ` Jingbai Ma [this message]
2013-03-11 8:31 ` Jingbai Ma
2013-03-08 16:19 ` Vivek Goyal
2013-03-08 16:19 ` Vivek Goyal
2013-03-11 8:53 ` Jingbai Ma
2013-03-11 8:53 ` Jingbai Ma
2013-03-09 4:31 ` HATAYAMA Daisuke
2013-03-09 4:31 ` HATAYAMA Daisuke
2013-03-11 9:02 ` Jingbai Ma
2013-03-11 9:02 ` Jingbai Ma
2013-03-08 10:16 ` Jingbai Ma
2013-03-08 10:16 ` Jingbai Ma
-- strict thread matches above, loose matches on Subject: below --
2013-03-07 14:05 Jingbai Ma
2013-03-07 14:00 Jingbai Ma
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=513D965B.8010503@hp.com \
--to=jingbai.ma@hp.com \
--cc=ebiederm@xmission.com \
--cc=hpa@zytor.com \
--cc=kexec@lists.infradead.org \
--cc=kingboard.ma@hp.com \
--cc=kumagai-atsushi@mxc.nes.nec.co.jp \
--cc=linux-kernel@vger.kernel.org \
--cc=lisa.mitchell@hp.com \
--cc=mingo@redhat.com \
--cc=vgoyal@redhat.com \
--cc=yinghai@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.