public inbox for linux-kernel@vger.kernel.org
 help / color / mirror / Atom feed
From: Michal Hocko <mhocko@suse.cz>
To: Alex Bligh <alex@alex.org.uk>
Cc: linux-kernel@vger.kernel.org
Subject: Re: Local DoS through write heavy I/O on CFQ & Deadline
Date: Fri, 12 Oct 2012 16:58:39 +0200	[thread overview]
Message-ID: <20121012145838.GD22083@dhcp22.suse.cz> (raw)
In-Reply-To: <E6EF14955C67D6CA58918872@nimrod.local>

On Fri 12-10-12 15:48:34, Alex Bligh wrote:
> 
> 
> --On 12 October 2012 15:30:45 +0200 Michal Hocko <mhocko@suse.cz> wrote:
> 
> >>Full info, including logs and scripts can be found at:
> >>  https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1064521
> >
> >You seem to have 8G of RAM and dirty_ratio=20 resp.
> >dirty_background_ratio=10 which means that 1.5G worth of dirty data
> >until writer gets throttled which is a lot. Background writeback starts
> >at 800M which is probably not sufficient as well. Have you tried to set
> >dirty_bytes at a reasonable value (wrt. to your storage)?
> 
> This is for an appliance install where we have no idea how much
> memory the box has in advance other than 'at least 4G' so it
> is difficult to tune by default.
> 
> However, I don't think that would solve the problem as the zcat/dd
> can always generate data faster than it can be written to disk unless
> or until it is throttled, which it never is. 

Once dirty_ratio (resp. dirty_bytes) limit is hit then the process which
writes gets throttled. If this is not the case then there is a bug in
the throttling code.

> Isn't the only thing that is going to change that it ends up
> triggering the writeback earlier?

Set the limit lowe?
 
> Happy to test etc - what would you suggest, dirty_ratio=5,
> dirty_background_ratio=2 ?

These are measured in percentage. On the other hand if you use
dirty_bytes resp. dirty_background_bytes then you get absolute numbers
independent on the amount of memory.

-- 
Michal Hocko
SUSE Labs

  reply	other threads:[~2012-10-12 14:58 UTC|newest]

Thread overview: 15+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2012-10-11 12:23 Local DoS through write heavy I/O on CFQ & Deadline Alex Bligh
2012-10-11 13:46 ` Alan Cox
2012-10-12 12:57   ` Alex Bligh
2012-10-12 13:30 ` Michal Hocko
2012-10-12 14:48   ` Alex Bligh
2012-10-12 14:58     ` Michal Hocko [this message]
2012-10-12 16:29       ` Alex Bligh
2012-10-13 13:53         ` Hillf Danton
2012-10-13 19:33           ` Alex Bligh
2012-10-14  2:43             ` Hillf Danton
2012-10-15  8:17         ` Michal Hocko
2012-10-18 21:28         ` Jan Kara
2012-10-18 22:13           ` Chris Friesen
2012-10-18 22:24             ` Jan Kara
2012-10-14 21:17 ` Dave Chinner

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20121012145838.GD22083@dhcp22.suse.cz \
    --to=mhocko@suse.cz \
    --cc=alex@alex.org.uk \
    --cc=linux-kernel@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox