linux-btrfs.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Chris Mason <chris.mason@oracle.com>
To: Stephane Chazelas <stephane_chazelas@yahoo.fr>
Cc: cwillu <cwillu@cwillu.com>, linux-btrfs <linux-btrfs@vger.kernel.org>
Subject: Re: Memory leak?
Date: Fri, 08 Jul 2011 11:06:08 -0400	[thread overview]
Message-ID: <1310137241-sup-8158@shiny> (raw)
In-Reply-To: <20110708124429.GB4284@yahoo.fr>

Excerpts from Stephane Chazelas's message of 2011-07-08 08:44:29 -0400:
> 2011-07-06 09:11:11 +0100, Stephane Chazelas:
> > 2011-07-03 13:38:57 -0600, cwillu:
> > > On Sun, Jul 3, 2011 at 1:09 PM, Stephane Chazelas
> > > <stephane_chazelas@yahoo.fr> wrote:
> > [...]
> > > > Now, on a few occasions (actually, most of the time), when I
> > > > rsynced the data (about 2.5TB) onto the external drive, the
> > > > system would crash after some time with "Out of memory and no
> > > > killable process". Basically, something in kernel was allocating
> > > > the whole memory, then oom mass killed everybody and crash.
> > [...]
> > > Look at the output of slabtop (should be installed by default, procfs
> > > package), before rsync for comparison, and during.
> > 
> > Hi,
> > 
> > so, no crash this time
> [...]
> 
> Another attempt, again onto an empty drive, this time with
> 3.0.0-rc6. Exact same scenario.
> 
> slabinfo:

> Got another "invalid opcode" in btrfs-fixup-0. That was in the
> middle of transfering a 3.6GB file. I've got one and only one of
> those during one boot time when doing that rsync.

So the invalidate opcode in btrfs-fixup-0 is the big problem.  We're
either failing to write because we weren't able to allocate memory (and
not dealing with it properly) or there is a bigger problem.

Does the btrfs-fixup-0 oops come before or after the ooms?

Please send along any oops output during the run.  Only the first
(earliest) oops matters.

I would do two things.  First, I'd turn off compress_force.  There's no
explicit reason for this, it just seems like the mostly likely place for
a bug.

If the oops comes after the oom messages, please grab a sysrq-t and
sysrq-w output (you'll need some way to log the console if you do this).
What we really need to see is what kswapd is doing.  That's usually
where the inodes get freed.

-chris

  reply	other threads:[~2011-07-08 15:06 UTC|newest]

Thread overview: 37+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-07-03 19:09 Memory leak? Stephane Chazelas
2011-07-03 19:38 ` cwillu
2011-07-06  8:11   ` Stephane Chazelas
2011-07-07  8:09     ` Stephane Chazelas
2011-07-07  8:20       ` Li Zefan
2011-07-07  8:37         ` Stephane Chazelas
2011-07-08 12:44     ` Stephane Chazelas
2011-07-08 15:06       ` Chris Mason [this message]
2011-07-08 15:41         ` Stephane Chazelas
2011-07-08 16:11           ` Stephane Chazelas
2011-07-08 16:17             ` Chris Mason
2011-07-08 16:57               ` Stephane Chazelas
2011-07-09 17:11               ` Stephane Chazelas
2011-07-08 16:15           ` Chris Mason
2011-07-08 17:06             ` Stephane Chazelas
2011-07-08 20:04             ` Stephane Chazelas
2011-07-08 20:12               ` Chris Mason
2011-07-09  7:09                 ` Stephane Chazelas
2011-07-09  7:42                   ` A lot of writing to FS only read (Was: Memory leak?) Stephane Chazelas
2011-07-10  5:58                   ` Memory leak? Stephane Chazelas
2011-07-09 17:09         ` Stephane Chazelas
2011-07-09 19:25           ` cwillu
2011-07-09 20:36             ` Stephane Chazelas
2011-07-10 12:44               ` Chris Mason
2011-07-10 18:37                 ` Stephane Chazelas
2011-07-11  9:01                   ` Stephane Chazelas
2011-07-11 15:00                     ` Chris Mason
2011-07-11 15:35                       ` Stephane Chazelas
2011-07-11 16:25                         ` Chris Mason
2011-07-11 16:34                           ` Stephane Chazelas
2011-07-12 11:40                     ` Stephane Chazelas
2011-07-16 12:12                     ` write(2) taking 4s. (Was: Memory leak?) Stephane Chazelas
2011-07-16 16:22                       ` Stephane Chazelas
2011-07-17  9:17                       ` Stephane Chazelas
2011-07-18 10:39                         ` write(2) taking 4s Stephane Chazelas
2011-07-18 19:37                           ` Stephane Chazelas
2011-07-19  9:32                             ` Stephane Chazelas

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1310137241-sup-8158@shiny \
    --to=chris.mason@oracle.com \
    --cc=cwillu@cwillu.com \
    --cc=linux-btrfs@vger.kernel.org \
    --cc=stephane_chazelas@yahoo.fr \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).