From: Michal Hocko <mhocko@suse.cz>
To: David Rientjes <rientjes@google.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
linux-kernel@vger.kernel.org, linux-mm@kvack.org
Subject: Re: [patch] mm, hugetlb: include hugepages in meminfo
Date: Wed, 20 Mar 2013 10:53:06 +0100 [thread overview]
Message-ID: <20130320095306.GA21856@dhcp22.suse.cz> (raw)
In-Reply-To: <alpine.DEB.2.02.1303191714440.13526@chino.kir.corp.google.com>
On Tue 19-03-13 17:18:12, David Rientjes wrote:
> Particularly in oom conditions, it's troublesome that hugetlb memory is
> not displayed. All other meminfo that is emitted will not add up to what
> is expected, and there is no artifact left in the kernel log to show that
> a potentially significant amount of memory is actually allocated as
> hugepages which are not available to be reclaimed.
Yes, I like the idea. It's bitten me already in the past.
The only objection I have is that you print only default_hstate. You
just need to wrap your for_each_node_state by for_each_hstate to do
that. With that applied, feel free to add my
Acked-by: Michal Hocko <mhocko@suse.cz>
Thanks
> Booting with hugepages=8192 on the command line, this memory is now shown
> in oom conditions. For example, with echo m > /proc/sysrq-trigger:
>
> Node 0 hugepages_total=2048 hugepages_free=2048 hugepages_surp=0 hugepages_size=2048kB
> Node 1 hugepages_total=2048 hugepages_free=2048 hugepages_surp=0 hugepages_size=2048kB
> Node 2 hugepages_total=2048 hugepages_free=2048 hugepages_surp=0 hugepages_size=2048kB
> Node 3 hugepages_total=2048 hugepages_free=2048 hugepages_surp=0 hugepages_size=2048kB
>
> Signed-off-by: David Rientjes <rientjes@google.com>
> ---
> include/linux/hugetlb.h | 4 ++++
> mm/hugetlb.c | 14 ++++++++++++++
> mm/page_alloc.c | 3 +++
> 3 files changed, 21 insertions(+)
>
> diff --git a/include/linux/hugetlb.h b/include/linux/hugetlb.h
> --- a/include/linux/hugetlb.h
> +++ b/include/linux/hugetlb.h
> @@ -58,6 +58,7 @@ void __unmap_hugepage_range(struct mmu_gather *tlb, struct vm_area_struct *vma,
> int hugetlb_prefault(struct address_space *, struct vm_area_struct *);
> void hugetlb_report_meminfo(struct seq_file *);
> int hugetlb_report_node_meminfo(int, char *);
> +void hugetlb_show_meminfo(void);
> unsigned long hugetlb_total_pages(void);
> int hugetlb_fault(struct mm_struct *mm, struct vm_area_struct *vma,
> unsigned long address, unsigned int flags);
> @@ -114,6 +115,9 @@ static inline void hugetlb_report_meminfo(struct seq_file *m)
> {
> }
> #define hugetlb_report_node_meminfo(n, buf) 0
> +static inline void hugetlb_show_meminfo(void)
> +{
> +}
> #define follow_huge_pmd(mm, addr, pmd, write) NULL
> #define follow_huge_pud(mm, addr, pud, write) NULL
> #define prepare_hugepage_range(file, addr, len) (-EINVAL)
> diff --git a/mm/hugetlb.c b/mm/hugetlb.c
> --- a/mm/hugetlb.c
> +++ b/mm/hugetlb.c
> @@ -2121,6 +2121,20 @@ int hugetlb_report_node_meminfo(int nid, char *buf)
> nid, h->surplus_huge_pages_node[nid]);
> }
>
> +void hugetlb_show_meminfo(void)
> +{
> + struct hstate *h = &default_hstate;
> + int nid;
> +
> + for_each_node_state(nid, N_MEMORY)
> + pr_info("Node %d hugepages_total=%u hugepages_free=%u hugepages_surp=%u hugepages_size=%lukB\n",
> + nid,
> + h->nr_huge_pages_node[nid],
> + h->free_huge_pages_node[nid],
> + h->surplus_huge_pages_node[nid],
> + 1UL << (huge_page_order(h) + PAGE_SHIFT - 10));
> +}
> +
> /* Return the number pages of memory we physically have, in PAGE_SIZE units. */
> unsigned long hugetlb_total_pages(void)
> {
> diff --git a/mm/page_alloc.c b/mm/page_alloc.c
> --- a/mm/page_alloc.c
> +++ b/mm/page_alloc.c
> @@ -58,6 +58,7 @@
> #include <linux/prefetch.h>
> #include <linux/migrate.h>
> #include <linux/page-debug-flags.h>
> +#include <linux/hugetlb.h>
> #include <linux/sched/rt.h>
>
> #include <asm/tlbflush.h>
> @@ -3105,6 +3106,8 @@ void show_free_areas(unsigned int filter)
> printk("= %lukB\n", K(total));
> }
>
> + hugetlb_show_meminfo();
> +
> printk("%ld total pagecache pages\n", global_page_state(NR_FILE_PAGES));
>
> show_swap_cache_info();
>
> --
> To unsubscribe, send a message with 'unsubscribe linux-mm' in
> the body to majordomo@kvack.org. For more info on Linux MM,
> see: http://www.linux-mm.org/ .
> Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
--
Michal Hocko
SUSE Labs
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
WARNING: multiple messages have this Message-ID (diff)
From: Michal Hocko <mhocko@suse.cz>
To: David Rientjes <rientjes@google.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
linux-kernel@vger.kernel.org, linux-mm@kvack.org
Subject: Re: [patch] mm, hugetlb: include hugepages in meminfo
Date: Wed, 20 Mar 2013 10:53:06 +0100 [thread overview]
Message-ID: <20130320095306.GA21856@dhcp22.suse.cz> (raw)
In-Reply-To: <alpine.DEB.2.02.1303191714440.13526@chino.kir.corp.google.com>
On Tue 19-03-13 17:18:12, David Rientjes wrote:
> Particularly in oom conditions, it's troublesome that hugetlb memory is
> not displayed. All other meminfo that is emitted will not add up to what
> is expected, and there is no artifact left in the kernel log to show that
> a potentially significant amount of memory is actually allocated as
> hugepages which are not available to be reclaimed.
Yes, I like the idea. It's bitten me already in the past.
The only objection I have is that you print only default_hstate. You
just need to wrap your for_each_node_state by for_each_hstate to do
that. With that applied, feel free to add my
Acked-by: Michal Hocko <mhocko@suse.cz>
Thanks
> Booting with hugepages=8192 on the command line, this memory is now shown
> in oom conditions. For example, with echo m > /proc/sysrq-trigger:
>
> Node 0 hugepages_total=2048 hugepages_free=2048 hugepages_surp=0 hugepages_size=2048kB
> Node 1 hugepages_total=2048 hugepages_free=2048 hugepages_surp=0 hugepages_size=2048kB
> Node 2 hugepages_total=2048 hugepages_free=2048 hugepages_surp=0 hugepages_size=2048kB
> Node 3 hugepages_total=2048 hugepages_free=2048 hugepages_surp=0 hugepages_size=2048kB
>
> Signed-off-by: David Rientjes <rientjes@google.com>
> ---
> include/linux/hugetlb.h | 4 ++++
> mm/hugetlb.c | 14 ++++++++++++++
> mm/page_alloc.c | 3 +++
> 3 files changed, 21 insertions(+)
>
> diff --git a/include/linux/hugetlb.h b/include/linux/hugetlb.h
> --- a/include/linux/hugetlb.h
> +++ b/include/linux/hugetlb.h
> @@ -58,6 +58,7 @@ void __unmap_hugepage_range(struct mmu_gather *tlb, struct vm_area_struct *vma,
> int hugetlb_prefault(struct address_space *, struct vm_area_struct *);
> void hugetlb_report_meminfo(struct seq_file *);
> int hugetlb_report_node_meminfo(int, char *);
> +void hugetlb_show_meminfo(void);
> unsigned long hugetlb_total_pages(void);
> int hugetlb_fault(struct mm_struct *mm, struct vm_area_struct *vma,
> unsigned long address, unsigned int flags);
> @@ -114,6 +115,9 @@ static inline void hugetlb_report_meminfo(struct seq_file *m)
> {
> }
> #define hugetlb_report_node_meminfo(n, buf) 0
> +static inline void hugetlb_show_meminfo(void)
> +{
> +}
> #define follow_huge_pmd(mm, addr, pmd, write) NULL
> #define follow_huge_pud(mm, addr, pud, write) NULL
> #define prepare_hugepage_range(file, addr, len) (-EINVAL)
> diff --git a/mm/hugetlb.c b/mm/hugetlb.c
> --- a/mm/hugetlb.c
> +++ b/mm/hugetlb.c
> @@ -2121,6 +2121,20 @@ int hugetlb_report_node_meminfo(int nid, char *buf)
> nid, h->surplus_huge_pages_node[nid]);
> }
>
> +void hugetlb_show_meminfo(void)
> +{
> + struct hstate *h = &default_hstate;
> + int nid;
> +
> + for_each_node_state(nid, N_MEMORY)
> + pr_info("Node %d hugepages_total=%u hugepages_free=%u hugepages_surp=%u hugepages_size=%lukB\n",
> + nid,
> + h->nr_huge_pages_node[nid],
> + h->free_huge_pages_node[nid],
> + h->surplus_huge_pages_node[nid],
> + 1UL << (huge_page_order(h) + PAGE_SHIFT - 10));
> +}
> +
> /* Return the number pages of memory we physically have, in PAGE_SIZE units. */
> unsigned long hugetlb_total_pages(void)
> {
> diff --git a/mm/page_alloc.c b/mm/page_alloc.c
> --- a/mm/page_alloc.c
> +++ b/mm/page_alloc.c
> @@ -58,6 +58,7 @@
> #include <linux/prefetch.h>
> #include <linux/migrate.h>
> #include <linux/page-debug-flags.h>
> +#include <linux/hugetlb.h>
> #include <linux/sched/rt.h>
>
> #include <asm/tlbflush.h>
> @@ -3105,6 +3106,8 @@ void show_free_areas(unsigned int filter)
> printk("= %lukB\n", K(total));
> }
>
> + hugetlb_show_meminfo();
> +
> printk("%ld total pagecache pages\n", global_page_state(NR_FILE_PAGES));
>
> show_swap_cache_info();
>
> --
> To unsubscribe, send a message with 'unsubscribe linux-mm' in
> the body to majordomo@kvack.org. For more info on Linux MM,
> see: http://www.linux-mm.org/ .
> Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
--
Michal Hocko
SUSE Labs
next prev parent reply other threads:[~2013-03-20 9:53 UTC|newest]
Thread overview: 16+ messages / expand[flat|nested] mbox.gz Atom feed top
2013-03-20 0:18 [patch] mm, hugetlb: include hugepages in meminfo David Rientjes
2013-03-20 0:18 ` David Rientjes
2013-03-20 9:53 ` Michal Hocko [this message]
2013-03-20 9:53 ` Michal Hocko
2013-03-20 18:46 ` David Rientjes
2013-03-20 18:46 ` David Rientjes
2013-03-20 18:56 ` Michal Hocko
2013-03-20 18:56 ` Michal Hocko
2013-03-20 18:58 ` David Rientjes
2013-03-20 18:58 ` David Rientjes
2013-03-20 19:21 ` Michal Hocko
2013-03-20 19:21 ` Michal Hocko
2013-03-20 19:07 ` [patch v2] " David Rientjes
2013-03-20 19:07 ` David Rientjes
2013-03-20 19:52 ` Michal Hocko
2013-03-20 19:52 ` Michal Hocko
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20130320095306.GA21856@dhcp22.suse.cz \
--to=mhocko@suse.cz \
--cc=akpm@linux-foundation.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=rientjes@google.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.