From: Fredrik Tolf <fredrik@dolda2000.com>
To: xfs@oss.sgi.com
Subject: Extreme I/O latency
Date: Tue, 2 Oct 2012 03:53:08 +0200 (CEST) [thread overview]
Message-ID: <alpine.DEB.2.02.1210020338580.3390@shack.dolda2000.com> (raw)
Dear list,
I'm having some problems with a Linux system using XFS filesystems, on top
of LVM, on top of mdraid, and I'm lacking ideas for how to proceed with
debugging it. The problem manifests itself in that certain, simple I/O
operations sometimes take extremely long to complete -- not seldomly up to
20-30 seconds!
I used to have lesser problems of a similar kind previously, but this
extremeness only started showing up since I upgraded the system from
Debian Lenny (using Linux 2.6.26) to Squeeze (using 2.6.32). I've since
upgraded to 3.2.0, and now to 3.5.4, and they all exhibit the same
problem.
The process having the worst problems with it usually sees them when it
calls upon Berkeley DB, the stack traces in which seems to tell me that
it's trying to do mmap'ed I/O in its region files, so I can only assume
that the stop happens when it's pulling in pages from disk. I can't say I
know for sure, but I'm getting the feeling that it happens when some other
process calls fdatasync() or somesuch operation. I get this feeling
because the problems very often seem to happen exactly when I fetch a
MySQL-backed webpage from the system's HTTP server (at which point mysqld
syncs its data to disk after some session table update or the like).
Does anyone have any clue as to what might cause symptoms like these, or,
if not, how I can debug the issue further? Admittedly, it's not as if I
can be sure that the problem belongs with XFS proper rather than LVM or
mdraid, but I have to being somewhere. At least XFS is the direct
interface that my programs call before getting stuck. :)
Your most obt. St. &c&c,
Fredrik Tolf
_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs
next reply other threads:[~2012-10-02 1:51 UTC|newest]
Thread overview: 5+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-10-02 1:53 Fredrik Tolf [this message]
2012-10-02 2:20 ` Extreme I/O latency Dave Chinner
2012-10-02 3:25 ` Fredrik Tolf
2012-10-02 5:08 ` Dave Chinner
2012-10-02 14:31 ` Fredrik Tolf
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=alpine.DEB.2.02.1210020338580.3390@shack.dolda2000.com \
--to=fredrik@dolda2000.com \
--cc=xfs@oss.sgi.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox