All of lore.kernel.org
 help / color / mirror / Atom feed
From: Jiang Liu <liuj97@gmail.com>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: Jiang Liu <jiang.liu@huawei.com>,
	David Rientjes <rientjes@google.com>,
	Wen Congyang <wency@cn.fujitsu.com>, Mel Gorman <mgorman@suse.de>,
	Minchan Kim <minchan@kernel.org>,
	KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>,
	Michal Hocko <mhocko@suse.cz>,
	James Bottomley <james.bottomley@hansenpartnership.com>,
	Sergei Shtylyov <sergei.shtylyov@cogentembedded.com>,
	David Howells <dhowells@redhat.com>,
	Mark Salter <msalter@redhat.com>,
	Jianguo Wu <wujianguo@huawei.com>,
	linux-mm@kvack.org, linux-arch@vger.kernel.org,
	linux-kernel@vger.kernel.org,
	Michel Lespinasse <walken@google.com>,
	Rik van Riel <riel@redhat.com>
Subject: Re: [PATCH v8, part3 10/14] mm: use a dedicated lock to protect totalram_pages and zone->managed_pages
Date: Wed, 12 Jun 2013 10:17:53 +0800	[thread overview]
Message-ID: <51B7DA51.1000304@gmail.com> (raw)
In-Reply-To: <20130611130042.3dec2cc6737f21180bc09bb1@linux-foundation.org>

On Wed 12 Jun 2013 04:00:42 AM CST, Andrew Morton wrote:
> On Sun, 26 May 2013 21:38:38 +0800 Jiang Liu <liuj97@gmail.com> wrote:
>
>> Currently lock_memory_hotplug()/unlock_memory_hotplug() are used to
>> protect totalram_pages and zone->managed_pages. Other than the memory
>> hotplug driver, totalram_pages and zone->managed_pages may also be
>> modified at runtime by other drivers, such as Xen balloon,
>> virtio_balloon etc. For those cases, memory hotplug lock is a little
>> too heavy, so introduce a dedicated lock to protect totalram_pages
>> and zone->managed_pages.
>>
>> Now we have a simplified locking rules totalram_pages and
>> zone->managed_pages as:
>> 1) no locking for read accesses because they are unsigned long.
>> 2) no locking for write accesses at boot time in single-threaded context.
>> 3) serialize write accesses at runtime by acquiring the dedicated
>>    managed_page_count_lock.
>>
>> Also adjust zone->managed_pages when freeing reserved pages into the
>> buddy system, to keep totalram_pages and zone->managed_pages in
>> consistence.
>>
>> ...
>>
>> +void adjust_managed_page_count(struct page *page, long count)
>> +{
>> +	spin_lock(&managed_page_count_lock);
>> +	page_zone(page)->managed_pages += count;
>> +	totalram_pages += count;
>> +	spin_unlock(&managed_page_count_lock);
>> +}
>> +EXPORT_SYMBOL(adjust_managed_page_count);
>
> This is exported to modules but there are no modular callers at this
> time.
>
> I assume this was done for some forthcoming xen/virtio_balloon/etc
> patches?  If so, it would be better to avoid adding the export until it
> is actually needed.
Hi Andrew,
     adjust_managed_page_count() will be used by virtio_balloon and xen 
balloon
drivers. Grep mmots tree:
drivers/virtio/virtio_balloon.c:		adjust_managed_page_count(page, -1);
drivers/virtio/virtio_balloon.c:		adjust_managed_page_count(page, 1);
drivers/xen/balloon.c:	adjust_managed_page_count(page, -1);
drivers/xen/balloon.c:	adjust_managed_page_count(page, 1);

So if we un-export it in part3, we need to export in part4 again.
Regards!
Gerry

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

WARNING: multiple messages have this Message-ID (diff)
From: Jiang Liu <liuj97@gmail.com>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: Jiang Liu <jiang.liu@huawei.com>,
	David Rientjes <rientjes@google.com>,
	Wen Congyang <wency@cn.fujitsu.com>, Mel Gorman <mgorman@suse.de>,
	Minchan Kim <minchan@kernel.org>,
	KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>,
	Michal Hocko <mhocko@suse.cz>,
	James Bottomley <james.bottomley@hansenpartnership.com>,
	Sergei Shtylyov <sergei.shtylyov@cogentembedded.com>,
	David Howells <dhowells@redhat.com>,
	Mark Salter <msalter@redhat.com>,
	Jianguo Wu <wujianguo@huawei.com>,
	linux-mm@kvack.org, linux-arch@vger.kernel.org,
	linux-kernel@vger.kernel.org,
	Michel Lespinasse <walken@google.com>,
	Rik van Riel <riel@redhat.com>
Subject: Re: [PATCH v8, part3 10/14] mm: use a dedicated lock to protect totalram_pages and zone->managed_pages
Date: Wed, 12 Jun 2013 10:17:53 +0800	[thread overview]
Message-ID: <51B7DA51.1000304@gmail.com> (raw)
Message-ID: <20130612021753.MYXkQBdceLKhMawLq9K107QBD5R75BC7jY5v5SxT90g@z> (raw)
In-Reply-To: <20130611130042.3dec2cc6737f21180bc09bb1@linux-foundation.org>

On Wed 12 Jun 2013 04:00:42 AM CST, Andrew Morton wrote:
> On Sun, 26 May 2013 21:38:38 +0800 Jiang Liu <liuj97@gmail.com> wrote:
>
>> Currently lock_memory_hotplug()/unlock_memory_hotplug() are used to
>> protect totalram_pages and zone->managed_pages. Other than the memory
>> hotplug driver, totalram_pages and zone->managed_pages may also be
>> modified at runtime by other drivers, such as Xen balloon,
>> virtio_balloon etc. For those cases, memory hotplug lock is a little
>> too heavy, so introduce a dedicated lock to protect totalram_pages
>> and zone->managed_pages.
>>
>> Now we have a simplified locking rules totalram_pages and
>> zone->managed_pages as:
>> 1) no locking for read accesses because they are unsigned long.
>> 2) no locking for write accesses at boot time in single-threaded context.
>> 3) serialize write accesses at runtime by acquiring the dedicated
>>    managed_page_count_lock.
>>
>> Also adjust zone->managed_pages when freeing reserved pages into the
>> buddy system, to keep totalram_pages and zone->managed_pages in
>> consistence.
>>
>> ...
>>
>> +void adjust_managed_page_count(struct page *page, long count)
>> +{
>> +	spin_lock(&managed_page_count_lock);
>> +	page_zone(page)->managed_pages += count;
>> +	totalram_pages += count;
>> +	spin_unlock(&managed_page_count_lock);
>> +}
>> +EXPORT_SYMBOL(adjust_managed_page_count);
>
> This is exported to modules but there are no modular callers at this
> time.
>
> I assume this was done for some forthcoming xen/virtio_balloon/etc
> patches?  If so, it would be better to avoid adding the export until it
> is actually needed.
Hi Andrew,
     adjust_managed_page_count() will be used by virtio_balloon and xen 
balloon
drivers. Grep mmots tree:
drivers/virtio/virtio_balloon.c:		adjust_managed_page_count(page, -1);
drivers/virtio/virtio_balloon.c:		adjust_managed_page_count(page, 1);
drivers/xen/balloon.c:	adjust_managed_page_count(page, -1);
drivers/xen/balloon.c:	adjust_managed_page_count(page, 1);

So if we un-export it in part3, we need to export in part4 again.
Regards!
Gerry


  reply	other threads:[~2013-06-12  2:17 UTC|newest]

Thread overview: 62+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-05-26 13:38 [PATCH v8, part3 00/14] accurately calculate memory statisitic information Jiang Liu
2013-05-26 13:38 ` Jiang Liu
2013-05-26 13:38 ` [PATCH v8, part3 01/14] mm: change signature of free_reserved_area() to fix building warnings Jiang Liu
2013-05-26 13:38   ` Jiang Liu
2013-05-26 13:38   ` Jiang Liu
2013-05-26 13:38 ` [PATCH v8, part3 02/14] mm: enhance free_reserved_area() to support poisoning memory with zero Jiang Liu
2013-05-26 13:38   ` Jiang Liu
2013-05-29  8:51   ` Vineet Gupta
2013-05-29  8:51     ` Vineet Gupta
2013-05-29  8:51     ` Vineet Gupta
2013-05-26 13:38 ` [PATCH v8, part3 03/14] mm/ARM64: kill poison_init_mem() Jiang Liu
2013-05-26 13:38   ` Jiang Liu
2013-05-26 13:38   ` Jiang Liu
2013-05-28 13:43   ` Catalin Marinas
2013-05-28 13:43     ` Catalin Marinas
2013-05-28 13:43     ` Catalin Marinas
2013-05-28 13:43     ` Catalin Marinas
2013-05-26 13:38 ` [PATCH v8, part3 04/14] mm/x86: use free_reserved_area() to simplify code Jiang Liu
2013-05-26 13:38   ` Jiang Liu
2013-05-26 13:38 ` [PATCH v8, part3 05/14] mm/tile: use common help functions to free reserved pages Jiang Liu
2013-05-26 13:38   ` Jiang Liu
2013-05-26 13:38 ` [PATCH v8, part3 06/14] mm, acornfb: use free_reserved_area() to simplify code Jiang Liu
2013-05-26 13:38   ` Jiang Liu
2013-05-26 13:38   ` Jiang Liu
2013-05-30 21:58   ` Andrew Morton
2013-05-30 21:58     ` Andrew Morton
2013-05-30 21:58     ` Andrew Morton
2013-05-31  4:31     ` Jiang Liu
2013-05-31  4:31       ` Jiang Liu
2013-05-31  4:31       ` Jiang Liu
2013-05-26 13:38 ` [PATCH v8, part3 07/14] mm: fix some trivial typos in comments Jiang Liu
2013-05-26 13:38   ` Jiang Liu
2013-05-26 13:38 ` [PATCH v8, part3 08/14] mm: use managed_pages to calculate default zonelist order Jiang Liu
2013-05-26 13:38   ` Jiang Liu
2013-05-26 13:38 ` [PATCH v8, part3 09/14] mm: accurately calculate zone->managed_pages for highmem zones Jiang Liu
2013-05-26 13:38   ` Jiang Liu
2013-05-26 13:38 ` [PATCH v8, part3 10/14] mm: use a dedicated lock to protect totalram_pages and zone->managed_pages Jiang Liu
2013-05-26 13:38   ` Jiang Liu
2013-06-11 20:00   ` Andrew Morton
2013-06-11 20:00     ` Andrew Morton
2013-06-12  2:17     ` Jiang Liu [this message]
2013-06-12  2:17       ` Jiang Liu
2013-05-26 13:38 ` [PATCH v8, part3 11/14] mm: make __free_pages_bootmem() only available at boot time Jiang Liu
2013-05-26 13:38   ` Jiang Liu
2013-05-26 13:38 ` [PATCH v8, part3 12/14] mm: correctly update zone->mamaged_pages Jiang Liu
2013-05-26 13:38   ` Jiang Liu
2013-05-26 13:38   ` Jiang Liu
2013-05-27  0:52   ` Wanpeng Li
2013-05-27  0:52   ` Wanpeng Li
2013-05-27  0:52   ` Wanpeng Li
2013-05-27  0:52   ` Wanpeng Li
2013-05-27 13:57   ` Sergei Shtylyov
2013-05-27 13:57     ` Sergei Shtylyov
2013-05-27 13:57     ` Sergei Shtylyov
2013-05-28 14:20     ` Liu Jiang
2013-05-28 14:20       ` Liu Jiang
2013-05-28 14:20       ` Liu Jiang
2013-05-27 13:57   ` Sergei Shtylyov
2013-05-26 13:38 ` [PATCH v8, part3 13/14] mm: concentrate modification of totalram_pages into the mm core Jiang Liu
2013-05-26 13:38   ` Jiang Liu
2013-05-26 13:38 ` [PATCH v8, part3 14/14] mm: report available pages as "MemTotal" for each NUMA node Jiang Liu
2013-05-26 13:38   ` Jiang Liu

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=51B7DA51.1000304@gmail.com \
    --to=liuj97@gmail.com \
    --cc=akpm@linux-foundation.org \
    --cc=dhowells@redhat.com \
    --cc=james.bottomley@hansenpartnership.com \
    --cc=jiang.liu@huawei.com \
    --cc=kamezawa.hiroyu@jp.fujitsu.com \
    --cc=linux-arch@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mgorman@suse.de \
    --cc=mhocko@suse.cz \
    --cc=minchan@kernel.org \
    --cc=msalter@redhat.com \
    --cc=riel@redhat.com \
    --cc=rientjes@google.com \
    --cc=sergei.shtylyov@cogentembedded.com \
    --cc=walken@google.com \
    --cc=wency@cn.fujitsu.com \
    --cc=wujianguo@huawei.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.