All of lore.kernel.org
 help / color / mirror / Atom feed
From: Vivek Goyal <vgoyal@redhat.com>
To: "H. Peter Anvin" <hpa@zytor.com>
Cc: Baoquan He <bhe@redhat.com>,
	Kexec Mailing List <kexec@lists.infradead.org>,
	linux kernel mailing list <linux-kernel@vger.kernel.org>,
	HATAYAMA Daisuke <d.hatayama@jp.fujitsu.com>,
	"Eric W. Biederman" <ebiederm@xmission.com>,
	Dave Young <dyoung@redhat.com>, WANG Chao <chaowang@redhat.com>
Subject: Re: /proc/vmcore mmap() failure issue
Date: Wed, 13 Nov 2013 18:00:56 -0500	[thread overview]
Message-ID: <20131113230056.GA19663@redhat.com> (raw)
In-Reply-To: <528400DD.3040003@zytor.com>

On Wed, Nov 13, 2013 at 02:44:45PM -0800, H. Peter Anvin wrote:
> On 11/13/2013 02:41 PM, Vivek Goyal wrote:
> > 
> > Hi Peter,
> > 
> > I noticed we seem to be trimming away partial pages in memblock.
> > 
> > memblock_x86_fill() {
> > 	/* throw away partial pages */
> >         memblock_trim_memory(PAGE_SIZE);
> > }
> > 
> > But not in e820 hence they show up in /proc/iomem.
> > 
> 
> Why does /proc/iomem matter?

Kexec-tools parse /proc/iomem and prepare PT_LOAD elf headers for all
the RAM regions which need to be dumped out, including the partial page ones.
Second kernel parses these headers and exports to user space in /proc/vmcore.
Makedumpfile tries to mmap() vmcore then tries to map the partial page pfn
too and we run into issues.

> 
> > How about something along the lines as below patch. This fixes my
> > /proc/vmcore mmap() issue.
> 
> I'm not sure if what you're seeing is something that is better handled
> in userspace.

I think it should be easy to truncate ELF headers in kexec-tools too when
we are preparing elf headers. I am not sure if it is right thing to do or
not. If some entry is showing up in /proc/iomem as RAM, then kexec-tools
need to believe that it is a possibility that kernel is using that pfn and
that pfn needs to be dumped out in vmcore. IMHO, kernel should fix this
issue.

Secondly, I am writing in-kernel kexec support too and I prepare ELF
headers there too. And I am facing the same problem there too. So if
we truncate partial pages in e820 both kexec-tools and in kernel kexec
implementation don't have to do anything.

Thanks
Vivek

_______________________________________________
kexec mailing list
kexec@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/kexec

WARNING: multiple messages have this Message-ID (diff)
From: Vivek Goyal <vgoyal@redhat.com>
To: "H. Peter Anvin" <hpa@zytor.com>
Cc: linux kernel mailing list <linux-kernel@vger.kernel.org>,
	HATAYAMA Daisuke <d.hatayama@jp.fujitsu.com>,
	Kexec Mailing List <kexec@lists.infradead.org>,
	Baoquan He <bhe@redhat.com>, WANG Chao <chaowang@redhat.com>,
	Dave Young <dyoung@redhat.com>,
	"Eric W. Biederman" <ebiederm@xmission.com>
Subject: Re: /proc/vmcore mmap() failure issue
Date: Wed, 13 Nov 2013 18:00:56 -0500	[thread overview]
Message-ID: <20131113230056.GA19663@redhat.com> (raw)
In-Reply-To: <528400DD.3040003@zytor.com>

On Wed, Nov 13, 2013 at 02:44:45PM -0800, H. Peter Anvin wrote:
> On 11/13/2013 02:41 PM, Vivek Goyal wrote:
> > 
> > Hi Peter,
> > 
> > I noticed we seem to be trimming away partial pages in memblock.
> > 
> > memblock_x86_fill() {
> > 	/* throw away partial pages */
> >         memblock_trim_memory(PAGE_SIZE);
> > }
> > 
> > But not in e820 hence they show up in /proc/iomem.
> > 
> 
> Why does /proc/iomem matter?

Kexec-tools parse /proc/iomem and prepare PT_LOAD elf headers for all
the RAM regions which need to be dumped out, including the partial page ones.
Second kernel parses these headers and exports to user space in /proc/vmcore.
Makedumpfile tries to mmap() vmcore then tries to map the partial page pfn
too and we run into issues.

> 
> > How about something along the lines as below patch. This fixes my
> > /proc/vmcore mmap() issue.
> 
> I'm not sure if what you're seeing is something that is better handled
> in userspace.

I think it should be easy to truncate ELF headers in kexec-tools too when
we are preparing elf headers. I am not sure if it is right thing to do or
not. If some entry is showing up in /proc/iomem as RAM, then kexec-tools
need to believe that it is a possibility that kernel is using that pfn and
that pfn needs to be dumped out in vmcore. IMHO, kernel should fix this
issue.

Secondly, I am writing in-kernel kexec support too and I prepare ELF
headers there too. And I am facing the same problem there too. So if
we truncate partial pages in e820 both kexec-tools and in kernel kexec
implementation don't have to do anything.

Thanks
Vivek

  reply	other threads:[~2013-11-13 23:01 UTC|newest]

Thread overview: 60+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-11-13 20:41 /proc/vmcore mmap() failure issue Vivek Goyal
2013-11-13 20:41 ` Vivek Goyal
2013-11-13 21:04 ` Vivek Goyal
2013-11-13 21:04   ` Vivek Goyal
2013-11-13 21:14   ` H. Peter Anvin
2013-11-13 21:14     ` H. Peter Anvin
2013-11-13 22:41     ` Vivek Goyal
2013-11-13 22:41       ` Vivek Goyal
2013-11-13 22:44       ` H. Peter Anvin
2013-11-13 22:44         ` H. Peter Anvin
2013-11-13 23:00         ` Vivek Goyal [this message]
2013-11-13 23:00           ` Vivek Goyal
2013-11-13 23:08           ` H. Peter Anvin
2013-11-13 23:08             ` H. Peter Anvin
2013-11-14 10:31 ` HATAYAMA Daisuke
2013-11-14 10:31   ` HATAYAMA Daisuke
2013-11-14 15:13   ` Vivek Goyal
2013-11-14 15:13     ` Vivek Goyal
2013-11-15  9:41     ` HATAYAMA Daisuke
2013-11-15  9:41       ` HATAYAMA Daisuke
2013-11-15 14:26       ` Vivek Goyal
2013-11-15 14:26         ` Vivek Goyal
2013-11-18  0:51         ` Atsushi Kumagai
2013-11-18  0:51           ` Atsushi Kumagai
2013-11-18 13:55           ` Vivek Goyal
2013-11-18 13:55             ` Vivek Goyal
2013-11-20  5:29             ` Atsushi Kumagai
2013-11-20  5:29               ` Atsushi Kumagai
2013-11-20 14:59               ` Vivek Goyal
2013-11-20 14:59                 ` Vivek Goyal
2013-11-21  5:00                 ` Atsushi Kumagai
2013-11-21  5:00                   ` Atsushi Kumagai
2013-11-21  8:31                   ` HATAYAMA Daisuke
2013-11-21  8:31                     ` HATAYAMA Daisuke
2013-11-21 16:52                     ` Vivek Goyal
2013-11-21 16:52                       ` Vivek Goyal
2013-11-25  8:10                       ` Atsushi Kumagai
2013-11-25  8:10                         ` Atsushi Kumagai
2013-11-25  9:01                         ` HATAYAMA Daisuke
2013-11-25  9:01                           ` HATAYAMA Daisuke
2013-11-25 14:41                           ` Vivek Goyal
2013-11-25 14:41                             ` Vivek Goyal
2013-11-26  1:51                             ` Atsushi Kumagai
2013-11-26  1:51                               ` Atsushi Kumagai
2013-11-26  5:16                             ` HATAYAMA Daisuke
2013-11-26  5:16                               ` HATAYAMA Daisuke
2013-11-19  9:55           ` HATAYAMA Daisuke
2013-11-19  9:55             ` HATAYAMA Daisuke
2013-11-20  5:27             ` Atsushi Kumagai
2013-11-20  5:27               ` Atsushi Kumagai
2013-11-20  6:43               ` HATAYAMA Daisuke
2013-11-20  6:43                 ` HATAYAMA Daisuke
2013-11-26  1:52                 ` Atsushi Kumagai
2013-11-26  1:52                   ` Atsushi Kumagai
2013-11-21  7:14               ` chaowang
2013-11-21  7:14                 ` chaowang
2013-11-25  8:09                 ` Atsushi Kumagai
2013-11-25  8:09                   ` Atsushi Kumagai
2013-11-26  3:29                   ` chaowang
2013-11-26  3:29                     ` chaowang

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20131113230056.GA19663@redhat.com \
    --to=vgoyal@redhat.com \
    --cc=bhe@redhat.com \
    --cc=chaowang@redhat.com \
    --cc=d.hatayama@jp.fujitsu.com \
    --cc=dyoung@redhat.com \
    --cc=ebiederm@xmission.com \
    --cc=hpa@zytor.com \
    --cc=kexec@lists.infradead.org \
    --cc=linux-kernel@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.