From: Oleg Nesterov <oleg@redhat.com>
To: Benjamin LaHaise <ben@communityfibre.ca>
Cc: Kirill Tkhai <ktkhai@virtuozzo.com>, Tejun Heo <tj@kernel.org>,
axboe@kernel.dk, viro@zeniv.linux.org.uk,
linux-block@vger.kernel.org, linux-kernel@vger.kernel.org,
linux-aio@kvack.org
Subject: Re: [PATCH 0/5] blkcg: Limit maximum number of aio requests available for cgroup
Date: Thu, 7 Dec 2017 14:44:47 +0100 [thread overview]
Message-ID: <20171207134447.GA7723@redhat.com> (raw)
In-Reply-To: <20171206174445.GM1493@kvack.org>
On 12/06, Benjamin LaHaise wrote:
>
> On Wed, Dec 06, 2017 at 06:32:56PM +0100, Oleg Nesterov wrote:
> >
> > No. Again, this memory is not properly accounted, and unlike mlock()ed
> > memory it is visible to shrinker which will do the unnecessary work on
> > memory shortage which in turn will lead to unnecessary page faults.
> >
> > So let me repeat, shouldn't we at least do mapping_set_unevictable() in
> > aio_private_file() ?
... and probably account this memory in ->pinned_vm
> Send a patch then!
I have no idea how to test this change, and personally I don't reallly care
about aio,
> I don't know why you're asking rather than sending a
> patch to do this if you think it is needed.
Because you are maintainer, and I naively thought it is always fine to
ask the maintainer if you think the code is not correct or sub-optimal.
Sorry for bothering you.
> > > > triggers OOM-killer which kills sshd and other daemons on my machine.
> > > > These pages were not even faulted in (or the shrinker can unmap them),
> > > > the kernel can not know who should be blamed.
> > >
> > > The OOM-killer killed the wrong process: News at 11.
> >
> > Well. I do not think we should blame OOM-killer in this case. But as I
> > said this is not a bug-report or something like this, I agree this is
> > a minor issue.
>
> I do think the OOM-killer is doing the wrong thing here. If process X is
> the only one that is allocating gobs of memory,
aio_setup_ring() does find_or_create_page(file->f_mapping), this adds
the page to page cache. Again, this memory looks _reclaimable_ but it
is not because ctx->ring_pages has a reference.
I do not understand how we can blame OOM-killer, it should not kill the
task which blows the page cache, and this is how io_setup() looks to vm.
Quite possibly I missed something, please correct me.
Oleg.
prev parent reply other threads:[~2017-12-07 13:44 UTC|newest]
Thread overview: 30+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-12-04 16:12 [PATCH 0/5] blkcg: Limit maximum number of aio requests available for cgroup Kirill Tkhai
2017-12-04 16:12 ` Kirill Tkhai
2017-12-04 16:12 ` [PATCH 1/5] aio: Move aio_nr increment to separate function Kirill Tkhai
2017-12-04 16:13 ` [PATCH 2/5] aio: Export aio_nr_lock and aio_max_nr initial value to include/linux/aio.h Kirill Tkhai
2017-12-04 16:13 ` [PATCH 3/5] blkcg: Add blkcg::blkg_aio_nr and blkcg::blkg_aio_max_nr Kirill Tkhai
2017-12-04 16:13 ` [PATCH 4/5] blkcg: Charge aio requests in blkio cgroup hierarchy Kirill Tkhai
2017-12-04 16:13 ` [PATCH 5/5] blkcg: Add cgroup file to configure blkcg::blkg_aio_max_nr Kirill Tkhai
2017-12-04 16:52 ` [PATCH 0/5] blkcg: Limit maximum number of aio requests available for cgroup Benjamin LaHaise
2017-12-04 21:27 ` Kirill Tkhai
2017-12-04 21:35 ` Jeff Moyer
2017-12-04 21:48 ` Kirill Tkhai
2017-12-04 20:07 ` Tejun Heo
2017-12-04 21:44 ` Kirill Tkhai
2017-12-04 21:52 ` Tejun Heo
2017-12-04 22:49 ` Kirill Tkhai
2017-12-04 22:59 ` Jeff Moyer
2017-12-04 23:14 ` Kirill Tkhai
2017-12-05 15:41 ` Jeff Moyer
2017-12-05 15:51 ` Tejun Heo
2017-12-04 23:02 ` Tejun Heo
2017-12-04 23:05 ` Kirill Tkhai
2017-12-05 15:19 ` Oleg Nesterov
2017-12-05 15:35 ` Benjamin LaHaise
2017-12-06 17:32 ` Oleg Nesterov
2017-12-06 17:44 ` Benjamin LaHaise
2017-12-06 17:44 ` Benjamin LaHaise
2017-12-06 18:19 ` Kirill Tkhai
2017-12-06 18:30 ` Benjamin LaHaise
2017-12-06 19:37 ` Kirill Tkhai
2017-12-07 13:44 ` Oleg Nesterov [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20171207134447.GA7723@redhat.com \
--to=oleg@redhat.com \
--cc=axboe@kernel.dk \
--cc=ben@communityfibre.ca \
--cc=ktkhai@virtuozzo.com \
--cc=linux-aio@kvack.org \
--cc=linux-block@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=tj@kernel.org \
--cc=viro@zeniv.linux.org.uk \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.