From: Baoquan He <bhe@redhat.com>
To: David Hildenbrand <david@redhat.com>
Cc: kexec@lists.infradead.org, linux-mm@kvack.org,
James Morse <james.morse@arm.com>,
"Eric W. Biederman" <ebiederm@xmission.com>,
Dave Young <dyoung@redhat.com>,
linux-arm-kernel@lists.infradead.org
Subject: Re: [PATCH] kexec: Discard loaded image on memory hotplug
Date: Mon, 11 May 2020 19:27:55 +0800 [thread overview]
Message-ID: <20200511112755.GB4922@MiWiFi-R3L-srv> (raw)
In-Reply-To: <a1c162fe-74de-c5ca-dadf-d451e970fdea@redhat.com>
On 05/11/20 at 10:19am, David Hildenbrand wrote:
> On 09.05.20 17:14, Eric W. Biederman wrote:
> >>> + * If the memory layout changes, any loaded kexec image should be evicted
> >>> + * as it may contain a copy of the (now stale) memory map. This also means
> >>> + * we don't need to check the memory is still present when re-assembling the
> >>> + * new kernel at machine_kexec() time.
> >>> + */
> >>
> >> Onlining/offlining is not a change of the memory map.
> >
> > Phrasing it that way is non-sense. What is important is memory
> > available in the system. A memory map is just a reflection upon that,
> > a memory map is not the definition of truth.
> >
> > So if this notifier reflects when memory is coming and going on the
> > system this is a reasonable approach.
> >
> > Do these notifiers might fire for special kinds of memory that should
> > only be used for very special purposes?
> >
> > This change with the addition of some filters say to limit taking action
> > to MEM_ONLINE and MEM_OFFLINE looks reasonable to me. Probably also
> > filtering out special kinds of memory that is not gernally useful.
>
> There are cases, where this notifier will not get called (e.g., hotplug
> a DIMM and don't online it) or will get called, although nothing changed
> (offline+re-online to a different zone triggered by user space). AFAIK,
> nothing in kexec (*besides kdump) cares about online vs. offline memory.
> This is why this feels wrong.
>
> add_memory()/try_remove_memory() is the place where:
> - Memblocks are created/deleted (if the memblock allocator is still
> alive)
> - Memory resources are created/deleted (e.g., reflected in /proc/iomem)
> - Firmware memmap entries are created/deleted (/sys/firmware/memmap)
>
> My idea would be to add something like
> kexec_map_add()/kexec_map_remove() where we have
> firmware_map_add_hotplug()/firmware_map_remove(). From there, we can
> unload the kexec image like done in this patch.
Hi David,
I may miss some details, do you know why we have to unload the kexec image
when add/remove memory?
If this is applied, even kexec_file_load is also affected. As we
discussed, kexec_file_load is not impacted by kinds of memory
adding/removing at all.
Besides, if unload image in casae memory added/removed, we will accept
that the later 'kexec -e' is actually rebooting?
Thanks
Baoquan
>
> And these callbacks might come in handy for fixing up the kexec initial
> memmap in case of kexec_file_load(). AFAIKS on x86_64:
> - Hotplugging a DIMM will not add that memory to
> e820_table_kexec
> - Hotunplugging a DIMM will not remove that memory from e820_table_kexec
>
> Maybe we have similar things to handle on other architectures.
>
> --
> Thanks,
>
> David / dhildenb
>
>
_______________________________________________
kexec mailing list
kexec@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/kexec
WARNING: multiple messages have this Message-ID (diff)
From: Baoquan He <bhe@redhat.com>
To: David Hildenbrand <david@redhat.com>
Cc: kexec@lists.infradead.org, linux-mm@kvack.org,
James Morse <james.morse@arm.com>,
"Eric W. Biederman" <ebiederm@xmission.com>,
Dave Young <dyoung@redhat.com>,
linux-arm-kernel@lists.infradead.org
Subject: Re: [PATCH] kexec: Discard loaded image on memory hotplug
Date: Mon, 11 May 2020 19:27:55 +0800 [thread overview]
Message-ID: <20200511112755.GB4922@MiWiFi-R3L-srv> (raw)
In-Reply-To: <a1c162fe-74de-c5ca-dadf-d451e970fdea@redhat.com>
On 05/11/20 at 10:19am, David Hildenbrand wrote:
> On 09.05.20 17:14, Eric W. Biederman wrote:
> >>> + * If the memory layout changes, any loaded kexec image should be evicted
> >>> + * as it may contain a copy of the (now stale) memory map. This also means
> >>> + * we don't need to check the memory is still present when re-assembling the
> >>> + * new kernel at machine_kexec() time.
> >>> + */
> >>
> >> Onlining/offlining is not a change of the memory map.
> >
> > Phrasing it that way is non-sense. What is important is memory
> > available in the system. A memory map is just a reflection upon that,
> > a memory map is not the definition of truth.
> >
> > So if this notifier reflects when memory is coming and going on the
> > system this is a reasonable approach.
> >
> > Do these notifiers might fire for special kinds of memory that should
> > only be used for very special purposes?
> >
> > This change with the addition of some filters say to limit taking action
> > to MEM_ONLINE and MEM_OFFLINE looks reasonable to me. Probably also
> > filtering out special kinds of memory that is not gernally useful.
>
> There are cases, where this notifier will not get called (e.g., hotplug
> a DIMM and don't online it) or will get called, although nothing changed
> (offline+re-online to a different zone triggered by user space). AFAIK,
> nothing in kexec (*besides kdump) cares about online vs. offline memory.
> This is why this feels wrong.
>
> add_memory()/try_remove_memory() is the place where:
> - Memblocks are created/deleted (if the memblock allocator is still
> alive)
> - Memory resources are created/deleted (e.g., reflected in /proc/iomem)
> - Firmware memmap entries are created/deleted (/sys/firmware/memmap)
>
> My idea would be to add something like
> kexec_map_add()/kexec_map_remove() where we have
> firmware_map_add_hotplug()/firmware_map_remove(). From there, we can
> unload the kexec image like done in this patch.
Hi David,
I may miss some details, do you know why we have to unload the kexec image
when add/remove memory?
If this is applied, even kexec_file_load is also affected. As we
discussed, kexec_file_load is not impacted by kinds of memory
adding/removing at all.
Besides, if unload image in casae memory added/removed, we will accept
that the later 'kexec -e' is actually rebooting?
Thanks
Baoquan
>
> And these callbacks might come in handy for fixing up the kexec initial
> memmap in case of kexec_file_load(). AFAIKS on x86_64:
> - Hotplugging a DIMM will not add that memory to
> e820_table_kexec
> - Hotunplugging a DIMM will not remove that memory from e820_table_kexec
>
> Maybe we have similar things to handle on other architectures.
>
> --
> Thanks,
>
> David / dhildenb
>
>
_______________________________________________
linux-arm-kernel mailing list
linux-arm-kernel@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
WARNING: multiple messages have this Message-ID (diff)
From: Baoquan He <bhe@redhat.com>
To: David Hildenbrand <david@redhat.com>
Cc: "Eric W. Biederman" <ebiederm@xmission.com>,
James Morse <james.morse@arm.com>,
kexec@lists.infradead.org, linux-mm@kvack.org,
linux-arm-kernel@lists.infradead.org,
Dave Young <dyoung@redhat.com>
Subject: Re: [PATCH] kexec: Discard loaded image on memory hotplug
Date: Mon, 11 May 2020 19:27:55 +0800 [thread overview]
Message-ID: <20200511112755.GB4922@MiWiFi-R3L-srv> (raw)
In-Reply-To: <a1c162fe-74de-c5ca-dadf-d451e970fdea@redhat.com>
On 05/11/20 at 10:19am, David Hildenbrand wrote:
> On 09.05.20 17:14, Eric W. Biederman wrote:
> >>> + * If the memory layout changes, any loaded kexec image should be evicted
> >>> + * as it may contain a copy of the (now stale) memory map. This also means
> >>> + * we don't need to check the memory is still present when re-assembling the
> >>> + * new kernel at machine_kexec() time.
> >>> + */
> >>
> >> Onlining/offlining is not a change of the memory map.
> >
> > Phrasing it that way is non-sense. What is important is memory
> > available in the system. A memory map is just a reflection upon that,
> > a memory map is not the definition of truth.
> >
> > So if this notifier reflects when memory is coming and going on the
> > system this is a reasonable approach.
> >
> > Do these notifiers might fire for special kinds of memory that should
> > only be used for very special purposes?
> >
> > This change with the addition of some filters say to limit taking action
> > to MEM_ONLINE and MEM_OFFLINE looks reasonable to me. Probably also
> > filtering out special kinds of memory that is not gernally useful.
>
> There are cases, where this notifier will not get called (e.g., hotplug
> a DIMM and don't online it) or will get called, although nothing changed
> (offline+re-online to a different zone triggered by user space). AFAIK,
> nothing in kexec (*besides kdump) cares about online vs. offline memory.
> This is why this feels wrong.
>
> add_memory()/try_remove_memory() is the place where:
> - Memblocks are created/deleted (if the memblock allocator is still
> alive)
> - Memory resources are created/deleted (e.g., reflected in /proc/iomem)
> - Firmware memmap entries are created/deleted (/sys/firmware/memmap)
>
> My idea would be to add something like
> kexec_map_add()/kexec_map_remove() where we have
> firmware_map_add_hotplug()/firmware_map_remove(). From there, we can
> unload the kexec image like done in this patch.
Hi David,
I may miss some details, do you know why we have to unload the kexec image
when add/remove memory?
If this is applied, even kexec_file_load is also affected. As we
discussed, kexec_file_load is not impacted by kinds of memory
adding/removing at all.
Besides, if unload image in casae memory added/removed, we will accept
that the later 'kexec -e' is actually rebooting?
Thanks
Baoquan
>
> And these callbacks might come in handy for fixing up the kexec initial
> memmap in case of kexec_file_load(). AFAIKS on x86_64:
> - Hotplugging a DIMM will not add that memory to
> e820_table_kexec
> - Hotunplugging a DIMM will not remove that memory from e820_table_kexec
>
> Maybe we have similar things to handle on other architectures.
>
> --
> Thanks,
>
> David / dhildenb
>
>
next prev parent reply other threads:[~2020-05-11 11:28 UTC|newest]
Thread overview: 39+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-05-01 16:57 [PATCH] kexec: Discard loaded image on memory hotplug James Morse
2020-05-01 16:57 ` James Morse
2020-05-01 16:57 ` James Morse
2020-05-01 17:26 ` David Hildenbrand
2020-05-01 17:26 ` David Hildenbrand
2020-05-01 17:26 ` David Hildenbrand
2020-05-09 15:14 ` Eric W. Biederman
2020-05-09 15:14 ` Eric W. Biederman
2020-05-09 15:14 ` Eric W. Biederman
2020-05-11 8:19 ` David Hildenbrand
2020-05-11 8:19 ` David Hildenbrand
2020-05-11 8:19 ` David Hildenbrand
2020-05-11 11:27 ` Baoquan He [this message]
2020-05-11 11:27 ` Baoquan He
2020-05-11 11:27 ` Baoquan He
2020-05-11 11:55 ` David Hildenbrand
2020-05-11 11:55 ` David Hildenbrand
2020-05-11 11:55 ` David Hildenbrand
2020-05-12 10:34 ` Baoquan He
2020-05-12 10:34 ` Baoquan He
2020-05-12 10:34 ` Baoquan He
2020-05-12 10:54 ` David Hildenbrand
2020-05-12 10:54 ` David Hildenbrand
2020-05-12 10:54 ` David Hildenbrand
2020-05-12 14:11 ` Baoquan He
2020-05-12 14:11 ` Baoquan He
2020-05-12 14:11 ` Baoquan He
2020-05-11 17:05 ` Eric W. Biederman
2020-05-11 17:05 ` Eric W. Biederman
2020-05-11 17:05 ` Eric W. Biederman
2020-05-12 7:45 ` David Hildenbrand
2020-05-12 7:45 ` David Hildenbrand
2020-05-12 7:45 ` David Hildenbrand
2020-05-12 11:59 ` Eric W. Biederman
2020-05-12 11:59 ` Eric W. Biederman
2020-05-12 11:59 ` Eric W. Biederman
2020-05-10 13:06 ` Baoquan He
2020-05-10 13:06 ` Baoquan He
2020-05-10 13:06 ` Baoquan He
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20200511112755.GB4922@MiWiFi-R3L-srv \
--to=bhe@redhat.com \
--cc=david@redhat.com \
--cc=dyoung@redhat.com \
--cc=ebiederm@xmission.com \
--cc=james.morse@arm.com \
--cc=kexec@lists.infradead.org \
--cc=linux-arm-kernel@lists.infradead.org \
--cc=linux-mm@kvack.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.