From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qk0-f179.google.com (mail-qk0-f179.google.com [209.85.220.179]) by kanga.kvack.org (Postfix) with ESMTP id 0132F6B0253 for ; Mon, 13 Jul 2015 10:20:26 -0400 (EDT) Received: by qkdv3 with SMTP id v3so59602196qkd.3 for ; Mon, 13 Jul 2015 07:20:25 -0700 (PDT) Received: from mx1.redhat.com (mx1.redhat.com. [209.132.183.28]) by mx.google.com with ESMTPS id f185si20744474qhc.71.2015.07.13.07.20.24 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 13 Jul 2015 07:20:24 -0700 (PDT) Date: Mon, 13 Jul 2015 10:20:14 -0400 From: Rafael Aquini Subject: Re: [PATCH 0/4] enable migration of driver pages Message-ID: <20150713142013.GA4025@t510.redhat.com> References: <1436776519-17337-1-git-send-email-gioh.kim@lge.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1436776519-17337-1-git-send-email-gioh.kim@lge.com> Sender: owner-linux-mm@kvack.org List-ID: To: Gioh Kim Cc: jlayton@poochiereds.net, bfields@fieldses.org, vbabka@suse.cz, iamjoonsoo.kim@lge.com, viro@zeniv.linux.org.uk, mst@redhat.com, koct9i@gmail.com, minchan@kernel.org, linux-fsdevel@vger.kernel.org, virtualization@lists.linux-foundation.org, linux-kernel@vger.kernel.org, linux-api@vger.kernel.org, linux-mm@kvack.org, dri-devel@lists.freedesktop.org, akpm@linux-foundation.org, Gioh Kim On Mon, Jul 13, 2015 at 05:35:15PM +0900, Gioh Kim wrote: > From: Gioh Kim > > Hello, > > This series try to enable migration of non-LRU pages, such as driver's page. > > My ARM-based platform occured severe fragmentation problem after long-term > (several days) test. Sometimes even order-3 page allocation failed. It has > memory size 512MB ~ 1024MB. 30% ~ 40% memory is consumed for graphic processing > and 20~30 memory is reserved for zram. > > I found that many pages of GPU driver and zram are non-movable pages. So I > reported Minchan Kim, the maintainer of zram, and he made the internal > compaction logic of zram. And I made the internal compaction of GPU driver. > > They reduced some fragmentation but they are not enough effective. > They are activated by its own interface, /sys, so they are not cooperative > with kernel compaction. If there is too much fragmentation and kernel starts > to compaction, zram and GPU driver cannot work with the kernel compaction. > > So I thought there needs a interface to combine driver and kernel compaction. > This patch adds a generic isolate/migrate/putback callbacks for page > address-space and a new interface to create anon-inode to manage > address_space_operation. The zram and GPU, and any other modules can create > anon_inode and register its own migration method. The kernel compaction can > call the registered migration when it does compaction. > > My GPU driver source is not in-kernel driver so that I apply the interface > into balloon driver. The balloon driver is already merged > into the kernel compaction as a corner-case. This patch have the balloon > driver migration be called by the generic interface. > > > This patch set combines 4 patches. > > 1. patch 1/4: get inode from anon_inodes > This patch adds new interface to create inode from anon_inodes. > > 2. patch 2/4: framework to isolate/migrate/putback page > Add isolatepage, putbackpage into address_space_operations > and wrapper function to call them. > > 3. patch 3/4: apply the framework into balloon driver > The balloon driver is applied into the framework. It gets a inode > from anon_inodes and register operations in the inode. > The kernel compaction calls generic interfaces, not balloon > driver interfaces. > Any other drivers can register operations via inode like this > to migrate it's pages. > > 4. patch 4/4: remove direct calling of migration of driver pages > Non-lru pages are also migrated with lru pages by move_to_new_page(). > > This patch set is tested: > - turn on Ubuntu 14.04 with 1G memory on qemu. > - do kernel building > - after several seconds check more than 512MB is used with free command > - command "balloon 512" in qemu monitor > - check hundreds MB of pages are migrated > > My thanks to Konstantin Khlebnikov for his reviews of the RFC patch set. > Most of the changes were based on his feedback. > > This patch-set is based on v4.1 > > > Gioh Kim (4): > fs/anon_inodes: new interface to create new inode > mm/compaction: enable mobile-page migration > mm/balloon: apply mobile page migratable into balloon > mm: remove direct calling of migration > > drivers/virtio/virtio_balloon.c | 3 ++ > fs/anon_inodes.c | 6 +++ > fs/proc/page.c | 3 ++ > include/linux/anon_inodes.h | 1 + > include/linux/balloon_compaction.h | 15 +++++-- > include/linux/compaction.h | 80 ++++++++++++++++++++++++++++++++++ > include/linux/fs.h | 2 + > include/linux/page-flags.h | 19 ++++++++ > include/uapi/linux/kernel-page-flags.h | 1 + > mm/balloon_compaction.c | 72 ++++++++++-------------------- > mm/compaction.c | 8 ++-- > mm/migrate.c | 24 +++------- > 12 files changed, 160 insertions(+), 74 deletions(-) > > -- > 2.1.4 > Acked-by: Rafael Aquini -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: email@kvack.org