All of lore.kernel.org
 help / color / mirror / Atom feed
From: Sanjoy Mahajan <sanjoy@olin.edu>
To: Dave Chinner <david@fromorbit.com>
Cc: Jesper Juhl <jj@chaosbits.net>,
	Chris Mason <chris.mason@oracle.com>, Ingo Molnar <mingo@elte.hu>,
	Pekka Enberg <penberg@kernel.org>,
	Aidar Kultayev <the.aidar@gmail.com>,
	<linux-kernel@vger.kernel.org>, <linux-mm@kvack.org>,
	Linus Torvalds <torvalds@linux-foundation.org>,
	Andrew Morton <akpm@linux-foundation.org>,
	Jens Axboe <axboe@kernel.dk>,
	Peter Zijlstra <a.p.zijlstra@chello.nl>,
	Nick Piggin <npiggin@suse.de>,
	Arjan van de Ven <arjan@infradead.org>,
	Thomas Gleixner <tglx@linutronix.de>, "Ted Ts'o" <tytso@mit.edu>,
	Corrado Zoccolo <czoccolo@gmail.com>,
	Shaohua Li <shaohua.li@intel.com>,
	Steven Barrett <damentz@gmail.com>
Subject: Re: 2.6.36 io bring the system to its knees
Date: Fri, 5 Nov 2010 08:48:13 -0400	[thread overview]
Message-ID: <E1PELiI-0001Pj-8g@approx.mit.edu> (raw)
In-Reply-To: Your message of "Fri, 05 Nov 2010 12:43:34 +1100." <20101105014334.GF13830@dastard>

Dave Chinner <david@fromorbit.com> wrote:

> I think anyone reporting a interactivity problem also needs to
> indicate what their filesystem is, what mount paramters they are
> using, what their storage config is, whether barriers are active or
> not, what elevator they are using, whether one or more of the
> applications are issuing fsync() or sync() calls, and so on.

Good idea.  

The filesystems are all ext3 with default mount parameters.  The dmesgs
say that the filesystems are mounted in ordered data mode and that
barriers are not enabled.

mount says:

/dev/sda2 on / type ext3 (rw,errors=remount-ro,commit=0)
/dev/sda1 on /boot type ext3 (rw,commit=0)
/dev/sda3 on /home type ext3 (rw,commit=0)

> storage config

Do you mean the partition sizes?  Here's that:

$ df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/sda2              72G   52G   17G  77% /
tmpfs                 755M  4.0K  755M   1% /lib/init/rw
udev                  750M  212K  750M   1% /dev
tmpfs                 755M     0  755M   0% /dev/shm
/dev/sda1             274M  117M  143M  45% /boot
/dev/sda3              74G   37G   33G  53% /home

> elevator

CFQ

> sync-related calls

I don't have a test from the time I ran rsync (but I'll check that
tonight), but I traced the currently running emacs and iceweasel
(a.k.a. firefox) with "strace -p PID 2>&1 | grep sync".  That didn't
turn up any sync-related calls.

(I checked the firefox because I seem to remember that it used to do
fsync absurdly often, but I also seem to remember that the outcry made
them stop.)

-Sanjoy

`Until lions have their historians, tales of the hunt shall always
 glorify the hunters.'  --African Proverb

WARNING: multiple messages have this Message-ID (diff)
From: Sanjoy Mahajan <sanjoy@olin.edu>
To: Dave Chinner <david@fromorbit.com>
Cc: Jesper Juhl <jj@chaosbits.net>,
	Chris Mason <chris.mason@oracle.com>, Ingo Molnar <mingo@elte.hu>,
	Pekka Enberg <penberg@kernel.org>,
	Aidar Kultayev <the.aidar@gmail.com>,
	linux-kernel@vger.kernel.org, linux-mm@kvack.org,
	Linus Torvalds <torvalds@linux-foundation.org>,
	Andrew Morton <akpm@linux-foundation.org>,
	Jens Axboe <axboe@kernel.dk>,
	Peter Zijlstra <a.p.zijlstra@chello.nl>,
	Nick Piggin <npiggin@suse.de>,
	Arjan van de Ven <arjan@infradead.org>,
	Thomas Gleixner <tglx@linutronix.de>, Ted Ts'o <tytso@mit.edu>,
	Corrado Zoccolo <czoccolo@gmail.com>,
	Shaohua Li <shaohua.li@intel.com>,
	Steven Barrett <damentz@gmail.com>
Subject: Re: 2.6.36 io bring the system to its knees
Date: Fri, 5 Nov 2010 08:48:13 -0400	[thread overview]
Message-ID: <E1PELiI-0001Pj-8g@approx.mit.edu> (raw)
In-Reply-To: Your message of "Fri, 05 Nov 2010 12:43:34 +1100." <20101105014334.GF13830@dastard>

Dave Chinner <david@fromorbit.com> wrote:

> I think anyone reporting a interactivity problem also needs to
> indicate what their filesystem is, what mount paramters they are
> using, what their storage config is, whether barriers are active or
> not, what elevator they are using, whether one or more of the
> applications are issuing fsync() or sync() calls, and so on.

Good idea.  

The filesystems are all ext3 with default mount parameters.  The dmesgs
say that the filesystems are mounted in ordered data mode and that
barriers are not enabled.

mount says:

/dev/sda2 on / type ext3 (rw,errors=remount-ro,commit=0)
/dev/sda1 on /boot type ext3 (rw,commit=0)
/dev/sda3 on /home type ext3 (rw,commit=0)

> storage config

Do you mean the partition sizes?  Here's that:

$ df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/sda2              72G   52G   17G  77% /
tmpfs                 755M  4.0K  755M   1% /lib/init/rw
udev                  750M  212K  750M   1% /dev
tmpfs                 755M     0  755M   0% /dev/shm
/dev/sda1             274M  117M  143M  45% /boot
/dev/sda3              74G   37G   33G  53% /home

> elevator

CFQ

> sync-related calls

I don't have a test from the time I ran rsync (but I'll check that
tonight), but I traced the currently running emacs and iceweasel
(a.k.a. firefox) with "strace -p PID 2>&1 | grep sync".  That didn't
turn up any sync-related calls.

(I checked the firefox because I seem to remember that it used to do
fsync absurdly often, but I also seem to remember that the outcry made
them stop.)

-Sanjoy

`Until lions have their historians, tales of the hunt shall always
 glorify the hunters.'  --African Proverb

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Fight unfair telecom policy in Canada: sign http://dissolvethecrtc.ca/
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2010-11-05 12:48 UTC|newest]

Thread overview: 130+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <AANLkTimt7wzR9RwGWbvhiOmot_zzayfCfSh_-v6yvuAP@mail.gmail.com>
2010-10-26 13:00 ` Fwd: 2.6.36 io bring the system to its knees Aidar Kultayev
     [not found]   ` <AANLkTinzJ9a+9w7G5X0uZpX2o-L8E6XW98VFKoF1R_-S@mail.gmail.com>
2010-10-28  6:09     ` Aidar Kultayev
2010-10-28  6:32       ` Pekka Enberg
2010-10-28  6:32         ` Pekka Enberg
2010-10-28  9:00         ` Ingo Molnar
2010-10-28  9:00           ` Ingo Molnar
2010-10-28  9:34           ` Pekka Enberg
2010-10-28  9:34             ` Pekka Enberg
2010-10-28 11:16           ` Pekka Enberg
2010-10-28 11:16             ` Pekka Enberg
2010-10-28 11:33             ` Aidar Kultayev
2010-10-28 11:33               ` Aidar Kultayev
2010-10-28 11:48               ` Pekka Enberg
2010-10-28 11:48                 ` Pekka Enberg
2010-10-28 12:18                 ` Aidar Kultayev
2010-10-28 12:18                   ` Aidar Kultayev
2010-10-28 13:46                 ` Christoph Hellwig
2010-10-28 13:46                   ` Christoph Hellwig
2010-10-28 13:54                   ` Ingo Molnar
2010-10-28 13:54                     ` Ingo Molnar
2010-10-28 13:30             ` Ingo Molnar
2010-10-28 13:30               ` Ingo Molnar
2010-10-28 13:47               ` Christoph Hellwig
2010-10-28 13:47                 ` Christoph Hellwig
2010-10-28 13:50                 ` Ingo Molnar
2010-10-28 13:50                   ` Ingo Molnar
2010-10-28 17:01               ` Chris Mason
2010-10-28 17:01                 ` Chris Mason
2010-10-28 17:57                 ` Pekka Enberg
2010-10-28 17:57                   ` Pekka Enberg
2010-10-29 14:52                   ` Ted Ts'o
2010-10-29 14:52                     ` Ted Ts'o
2010-10-29 15:33                     ` Aidar Kultayev
2010-10-29 15:33                       ` Aidar Kultayev
2010-10-30  9:14                       ` Ingo Molnar
2010-10-30  9:14                         ` Ingo Molnar
2010-10-30 13:02                         ` Aidar Kultayev
2010-10-30 13:02                           ` Aidar Kultayev
2010-10-30 19:06                           ` Chris Mason
2010-10-30 19:06                             ` Chris Mason
2010-10-31  2:31                           ` Ted Ts'o
2010-10-31  2:31                             ` Ted Ts'o
2010-10-31 17:49                             ` Corrado Zoccolo
2010-10-31 17:49                               ` Corrado Zoccolo
2010-11-02  3:10                           ` Shaohua Li
2010-11-02  3:10                             ` Shaohua Li
2010-11-02 11:47                 ` Sanjoy Mahajan
2010-11-02 11:47                   ` Sanjoy Mahajan
2010-11-02 13:12                   ` Chris Mason
2010-11-02 13:12                     ` Chris Mason
2010-11-04 16:05                     ` Sanjoy Mahajan
2010-11-04 16:05                       ` Sanjoy Mahajan
2010-11-04 23:35                       ` Steven Barrett
2010-11-04 23:35                         ` Steven Barrett
2010-11-04 23:44                 ` Jesper Juhl
2010-11-04 23:44                   ` Jesper Juhl
2010-11-04 23:48                   ` Jesper Juhl
2010-11-04 23:48                     ` Jesper Juhl
2010-11-05  1:43                     ` Dave Chinner
2010-11-05  1:43                       ` Dave Chinner
2010-11-05 12:48                       ` Sanjoy Mahajan [this message]
2010-11-05 12:48                         ` Sanjoy Mahajan
2010-11-06 14:10                         ` dave b
2010-11-06 14:10                           ` dave b
2010-11-06 15:12                           ` Dave Chinner
2010-11-06 15:12                             ` Dave Chinner
2010-11-07  6:06                             ` dave b
2010-11-07  6:06                               ` dave b
2010-11-07 12:08                           ` Jens Axboe
2010-11-07 12:08                             ` Jens Axboe
2010-11-07 15:50                             ` Linus Torvalds
2010-11-07 15:50                               ` Linus Torvalds
2010-11-10  1:32                               ` Dave Chinner
2010-11-10  1:32                                 ` Dave Chinner
2010-11-10  2:01                                 ` dave b
2010-11-10  2:01                                   ` dave b
2010-11-10  8:08                                 ` Evgeniy Ivanov
2010-11-10  8:08                                   ` Evgeniy Ivanov
2010-11-10  8:24                                   ` Dave Chinner
2010-11-10  8:24                                     ` Dave Chinner
2010-11-10 14:22                                     ` Pavel Machek
2010-11-10 14:22                                       ` Pavel Machek
2010-11-10 14:20                                 ` Pavel Machek
2010-11-10 14:20                                   ` Pavel Machek
2010-11-10 14:27                                   ` Ingo Molnar
2010-11-10 14:27                                     ` Ingo Molnar
2010-11-10 14:55                                     ` Christoph Hellwig
2010-11-10 14:55                                       ` Christoph Hellwig
2010-11-10 19:09                                       ` Pavel Machek
2010-11-10 19:09                                         ` Pavel Machek
2010-11-10 14:33                                 ` Theodore Tso
2010-11-10 14:33                                   ` Theodore Tso
2010-11-10 14:57                                   ` Christoph Hellwig
2010-11-10 14:57                                     ` Christoph Hellwig
2010-11-10 15:00                                     ` Chris Mason
2010-11-10 15:00                                       ` Chris Mason
2010-11-10 23:36                                   ` Dave Chinner
2010-11-10 23:36                                     ` Dave Chinner
2010-11-10 15:59                                 ` Linus Torvalds
2010-11-10 15:59                                   ` Linus Torvalds
2010-11-10 16:46                                   ` Alexey Dobriyan
2010-11-10 16:46                                     ` Alexey Dobriyan
2010-11-10 16:55                                     ` Linus Torvalds
2010-11-10 16:55                                       ` Linus Torvalds
2010-11-10 17:10                                       ` Alexey Dobriyan
2010-11-10 17:10                                         ` Alexey Dobriyan
2010-11-10 18:55                                         ` Mark Lord
2010-11-10 18:55                                           ` Mark Lord
2010-11-10 18:27                                     ` Mike Galbraith
2010-11-10 18:27                                       ` Mike Galbraith
2010-11-10 23:43                                   ` Dave Chinner
2010-11-10 23:43                                     ` Dave Chinner
2010-11-06 19:10                         ` Arjan van de Ven
2010-11-06 19:10                           ` Arjan van de Ven
2010-11-07 17:16                       ` Jesper Juhl
2010-11-07 17:16                         ` Jesper Juhl
2010-11-09 19:47                         ` Evgeniy Ivanov
2010-11-09 19:47                           ` Evgeniy Ivanov
2010-11-09 20:20                           ` Christoph Hellwig
2010-11-09 20:20                             ` Christoph Hellwig
2010-11-09 21:00                       ` Chris Mason
2010-11-09 21:00                         ` Chris Mason
2010-10-31  1:22       ` Wu Fengguang
2010-10-31  1:22         ` Wu Fengguang
2010-10-31  1:51         ` Wu Fengguang
2010-10-31  1:51           ` Wu Fengguang
2010-11-01  1:09           ` Dimitrios Apostolou
2010-11-01  1:09             ` Dimitrios Apostolou
2010-11-02  1:20             ` Wu Fengguang
2010-11-02  1:20               ` Wu Fengguang

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=E1PELiI-0001Pj-8g@approx.mit.edu \
    --to=sanjoy@olin.edu \
    --cc=a.p.zijlstra@chello.nl \
    --cc=akpm@linux-foundation.org \
    --cc=arjan@infradead.org \
    --cc=axboe@kernel.dk \
    --cc=chris.mason@oracle.com \
    --cc=czoccolo@gmail.com \
    --cc=damentz@gmail.com \
    --cc=david@fromorbit.com \
    --cc=jj@chaosbits.net \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mingo@elte.hu \
    --cc=npiggin@suse.de \
    --cc=penberg@kernel.org \
    --cc=shaohua.li@intel.com \
    --cc=tglx@linutronix.de \
    --cc=the.aidar@gmail.com \
    --cc=torvalds@linux-foundation.org \
    --cc=tytso@mit.edu \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.