public inbox for linux-kernel@vger.kernel.org
 help / color / mirror / Atom feed
* [ANNOUNCE] kmemtrace-user repo update
@ 2008-09-23 21:29 Eduard - Gabriel Munteanu
       [not found] ` <1223386477.28348.42.camel@penberg-laptop>
  0 siblings, 1 reply; 16+ messages in thread
From: Eduard - Gabriel Munteanu @ 2008-09-23 21:29 UTC (permalink / raw)
  To: penberg; +Cc: compudj, linux-kernel, righi.andrea, eduard.munteanu, Tom Zanussi

Hi everybody,

This concerns...
http://repo.or.cz/w/kmemtrace-user.git

kmemtrace-user's git repo has been update. This is the last revision
history alteration. Due to missing copyright notices and other problems,
I preferred to keep things clean.

So now you need to git-clone it again, but it will no longer be
necessary in the future. 

Changes:
- Refactored code, it's a lot cleaner now.
- It now works on 32-bit machines, or at least I hope so: it no longer
  exhibits problems when the userspace is compiled with the -m32 flag.
- We now use mmap() for almost anything.
- kmemtraced copies /proc/kallsyms, so if you want to hack on
  kmemtrace-report, you no longer need to do all stuff on a
  kmemtrace-enabled kernel.
- Probably other misc janitorial stuff.

Priority todos:
- Integrate Tom's UTT patch (thanks again). I'd first like to provide a UTT
  wrapper in the kernel to provide all those files without having to
  explicitly code things in kmemtrace.
- Make it work cross-arch (endianness etc.).

Kinda lower priority todos:
- Add timestamps. Useful to measure allocations' lifetimes in a tangible
  way.


Please take a shot at this and let me know what you think.


	Cheers,
	Eduard


^ permalink raw reply	[flat|nested] 16+ messages in thread

* [PROBLEM] hard-lock with kmemtrace, relayfs, and splice
       [not found]       ` <1223629803.8959.40.camel@penberg-laptop>
@ 2008-10-10  9:42         ` Pekka Enberg
  2008-10-10 11:51           ` Eduard - Gabriel Munteanu
                             ` (2 more replies)
  0 siblings, 3 replies; 16+ messages in thread
From: Pekka Enberg @ 2008-10-10  9:42 UTC (permalink / raw)
  To: Eduard - Gabriel Munteanu; +Cc: zanussi, jens.axboe, linux-kernel

(I'm cc'ing Tom, Jens, and LKML.)

On Fri, 2008-10-10 at 12:10 +0300, Pekka Enberg wrote:
> > I'm seeing a hard lock on my machine when I run kmemtraced with the
> > following patch applied:
> > 
> > http://git.kernel.org/?p=linux/kernel/git/penberg/slab-2.6.git;a=commitdiff;h=17ca1d5506b1db433f0b7167a627bfd55d319dd3
> > 
> > I can enable/disable kmemtrace via the debugfs files fine and can also
> > read the relay files with cat.
> > 
> > Any idea where this is coming from?
> 
> OK, it's the first splice() call in reader_thread() that causes the
> hang. Hmm.

To recap, with a CONFIG_KMEMTRACE enabled kernel from the
"topic/kmemtrace" branch of:

  git://git.kernel.org/pub/scm/linux/kernel/git/penberg/slab-2.6.git topic/kmemtrace

running the "kmemtraced" program from

  git://git.kernel.org/pub/scm/linux/kernel/git/penberg/kmemtrace-user.git

results to a hard lock on my machine. I am unable to find anything
obviously wrong with it and as I can read/write the relay files just
fine, I'm beginning to think it's problem in relayfs splice
implementation.

Tom, thoughts?

		Pekka



^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PROBLEM] hard-lock with kmemtrace, relayfs, and splice
  2008-10-10  9:42         ` [PROBLEM] hard-lock with kmemtrace, relayfs, and splice Pekka Enberg
@ 2008-10-10 11:51           ` Eduard - Gabriel Munteanu
  2008-10-11  4:58           ` Tom Zanussi
  2008-10-24  4:44           ` Peter Teoh
  2 siblings, 0 replies; 16+ messages in thread
From: Eduard - Gabriel Munteanu @ 2008-10-10 11:51 UTC (permalink / raw)
  To: Pekka Enberg; +Cc: zanussi, jens.axboe, linux-kernel

On Fri, Oct 10, 2008 at 12:42:03PM +0300, Pekka Enberg wrote:
> (I'm cc'ing Tom, Jens, and LKML.)
> 
> On Fri, 2008-10-10 at 12:10 +0300, Pekka Enberg wrote:
> > > I'm seeing a hard lock on my machine when I run kmemtraced with the
> > > following patch applied:
> > > 
> > > http://git.kernel.org/?p=linux/kernel/git/penberg/slab-2.6.git;a=commitdiff;h=17ca1d5506b1db433f0b7167a627bfd55d319dd3
> > > 
> > > I can enable/disable kmemtrace via the debugfs files fine and can also
> > > read the relay files with cat.
> > > 
> > > Any idea where this is coming from?
> > 
> > OK, it's the first splice() call in reader_thread() that causes the
> > hang. Hmm.
> 
> To recap, with a CONFIG_KMEMTRACE enabled kernel from the
> "topic/kmemtrace" branch of:
> 
>   git://git.kernel.org/pub/scm/linux/kernel/git/penberg/slab-2.6.git topic/kmemtrace
> 
> running the "kmemtraced" program from
> 
>   git://git.kernel.org/pub/scm/linux/kernel/git/penberg/kmemtrace-user.git
> 
> results to a hard lock on my machine. I am unable to find anything
> obviously wrong with it and as I can read/write the relay files just
> fine, I'm beginning to think it's problem in relayfs splice
> implementation.
> 
> Tom, thoughts?
> 
> 		Pekka
>

Hmm, I've seen kmemtraced not stopping, but no hard locks. It seems not
even SIGKILL can stop it. As far as I know, SIGKILL should stop even a
blocking splice() (in case this is the problem). This is what I did:
# ./kmemtraced &
# killall -KILL kmemtraced
... kmemtraced still running and using CPU.


	Eduard


^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PROBLEM] hard-lock with kmemtrace, relayfs, and splice
  2008-10-10  9:42         ` [PROBLEM] hard-lock with kmemtrace, relayfs, and splice Pekka Enberg
  2008-10-10 11:51           ` Eduard - Gabriel Munteanu
@ 2008-10-11  4:58           ` Tom Zanussi
  2008-10-11 18:17             ` Eduard - Gabriel Munteanu
  2008-10-13  6:57             ` Pekka Enberg
  2008-10-24  4:44           ` Peter Teoh
  2 siblings, 2 replies; 16+ messages in thread
From: Tom Zanussi @ 2008-10-11  4:58 UTC (permalink / raw)
  To: Pekka Enberg; +Cc: Eduard - Gabriel Munteanu, jens.axboe, linux-kernel


On Fri, 2008-10-10 at 12:42 +0300, Pekka Enberg wrote:
> (I'm cc'ing Tom, Jens, and LKML.)
> 
> On Fri, 2008-10-10 at 12:10 +0300, Pekka Enberg wrote:
> > > I'm seeing a hard lock on my machine when I run kmemtraced with the
> > > following patch applied:
> > > 
> > > http://git.kernel.org/?p=linux/kernel/git/penberg/slab-2.6.git;a=commitdiff;h=17ca1d5506b1db433f0b7167a627bfd55d319dd3
> > > 
> > > I can enable/disable kmemtrace via the debugfs files fine and can also
> > > read the relay files with cat.
> > > 
> > > Any idea where this is coming from?
> > 
> > OK, it's the first splice() call in reader_thread() that causes the
> > hang. Hmm.
> 
> To recap, with a CONFIG_KMEMTRACE enabled kernel from the
> "topic/kmemtrace" branch of:
> 
>   git://git.kernel.org/pub/scm/linux/kernel/git/penberg/slab-2.6.git topic/kmemtrace
> 
> running the "kmemtraced" program from
> 
>   git://git.kernel.org/pub/scm/linux/kernel/git/penberg/kmemtrace-user.git
> 
> results to a hard lock on my machine. I am unable to find anything
> obviously wrong with it and as I can read/write the relay files just
> fine, I'm beginning to think it's problem in relayfs splice
> implementation.
> 
> Tom, thoughts?
> 

It looks like you hit the same problem as described here:

commit 8191ecd1d14c6914c660dfa007154860a7908857

    splice: fix infinite loop in generic_file_splice_read()

relay uses the same loop but it never got noticed or fixed.  Can you try
the following patch:

diff --git a/kernel/relay.c b/kernel/relay.c
index 8d13a78..6a4d439 100644
--- a/kernel/relay.c
+++ b/kernel/relay.c
@@ -1318,12 +1318,9 @@ static ssize_t relay_file_splice_read(struct file *in,
 		if (ret < 0)
 			break;
 		else if (!ret) {
-			if (spliced)
-				break;
-			if (flags & SPLICE_F_NONBLOCK) {
+			if (flags & SPLICE_F_NONBLOCK)
 				ret = -EAGAIN;
-				break;
-			}
+			break;
 		}
 
 		*ppos += ret;


It worked for me, but I also had to apply the following patch to
kmemtraced:

diff --git a/kmemtraced.c b/kmemtraced.c
index 217478d..324ced9 100644
--- a/kmemtraced.c
+++ b/kmemtraced.c
@@ -109,6 +109,8 @@ static void *reader_thread(void *data)
 		if (retval < 0)
 			panic("splice() (from) failed: %s\n",
 			      strerror(errno));
+		if (!retval)
+			continue;
 		retval = splice(pipe_fd[0], NULL, log_fd, NULL,
 				128, SPLICE_F_MOVE);
 		if (retval < 0)


Otherwise it would end up hanging kmemtraced in the second splice (pipe
to log_fd) if the return from the first splice was 0 (i.e. there's no
data available (and we can never know if there will ever be any
more)).

I'm not sure why kmemtraced is only splicing 128 bytes at a time - it
seems to defeat the purpose - or why it wouldn't be using poll to know
when there's at least a whole sub-buffer to splice, but to each his own.
Hopefully the kernel patch at least fixes the loop. 

Tom




^ permalink raw reply related	[flat|nested] 16+ messages in thread

* Re: [PROBLEM] hard-lock with kmemtrace, relayfs, and splice
  2008-10-11  4:58           ` Tom Zanussi
@ 2008-10-11 18:17             ` Eduard - Gabriel Munteanu
  2008-10-13  6:57             ` Pekka Enberg
  1 sibling, 0 replies; 16+ messages in thread
From: Eduard - Gabriel Munteanu @ 2008-10-11 18:17 UTC (permalink / raw)
  To: Tom Zanussi; +Cc: Pekka Enberg, jens.axboe, linux-kernel

On Fri, Oct 10, 2008 at 11:58:51PM -0500, Tom Zanussi wrote:
> It worked for me, but I also had to apply the following patch to
> kmemtraced:
> 
> diff --git a/kmemtraced.c b/kmemtraced.c
> index 217478d..324ced9 100644
> --- a/kmemtraced.c
> +++ b/kmemtraced.c
> @@ -109,6 +109,8 @@ static void *reader_thread(void *data)
>  		if (retval < 0)
>  			panic("splice() (from) failed: %s\n",
>  			      strerror(errno));
> +		if (!retval)
> +			continue;
>  		retval = splice(pipe_fd[0], NULL, log_fd, NULL,
>  				128, SPLICE_F_MOVE);
>  		if (retval < 0)
> 
> Otherwise it would end up hanging kmemtraced in the second splice (pipe
> to log_fd) if the return from the first splice was 0 (i.e. there's no
> data available (and we can never know if there will ever be any
> more)).

Thanks, I'll apply it.

> I'm not sure why kmemtraced is only splicing 128 bytes at a time - it
> seems to defeat the purpose - or why it wouldn't be using poll to know
> when there's at least a whole sub-buffer to splice, but to each his own.
> Hopefully the kernel patch at least fixes the loop. 

Yeah, it was a misguided attempt to fix the strange behavior.

> Tom


	Cheers,
	Eduard


^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PROBLEM] hard-lock with kmemtrace, relayfs, and splice
  2008-10-11  4:58           ` Tom Zanussi
  2008-10-11 18:17             ` Eduard - Gabriel Munteanu
@ 2008-10-13  6:57             ` Pekka Enberg
  2008-10-14  4:03               ` Tom Zanussi
  1 sibling, 1 reply; 16+ messages in thread
From: Pekka Enberg @ 2008-10-13  6:57 UTC (permalink / raw)
  To: Tom Zanussi; +Cc: Eduard - Gabriel Munteanu, jens.axboe, linux-kernel

Hi Tom,

On Fri, 2008-10-10 at 23:58 -0500, Tom Zanussi wrote:
> It looks like you hit the same problem as described here:
> 
> commit 8191ecd1d14c6914c660dfa007154860a7908857
> 
>     splice: fix infinite loop in generic_file_splice_read()
> 
> relay uses the same loop but it never got noticed or fixed.  Can you try
> the following patch:
> 
> diff --git a/kernel/relay.c b/kernel/relay.c
> index 8d13a78..6a4d439 100644
> --- a/kernel/relay.c
> +++ b/kernel/relay.c
> @@ -1318,12 +1318,9 @@ static ssize_t relay_file_splice_read(struct file *in,
>  		if (ret < 0)
>  			break;
>  		else if (!ret) {
> -			if (spliced)
> -				break;
> -			if (flags & SPLICE_F_NONBLOCK) {
> +			if (flags & SPLICE_F_NONBLOCK)
>  				ret = -EAGAIN;
> -				break;
> -			}
> +			break;
>  		}
>  
>  		*ppos += ret;
> 

Indeed. That fixes the deadlock.

However, now I don't get anything to the cpu*.out files if I run
kmemtraced with kmemtrace disabled. If I enable kmemtrace manually and
then run kmemtraced, I do receive some data. I did apply the
kmemtrace-user patch as well.

Hmm?

		Pekka


^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PROBLEM] hard-lock with kmemtrace, relayfs, and splice
  2008-10-13  6:57             ` Pekka Enberg
@ 2008-10-14  4:03               ` Tom Zanussi
  2008-10-14  5:13                 ` Pekka Enberg
  0 siblings, 1 reply; 16+ messages in thread
From: Tom Zanussi @ 2008-10-14  4:03 UTC (permalink / raw)
  To: Pekka Enberg; +Cc: Eduard - Gabriel Munteanu, jens.axboe, linux-kernel

Hi Pekka,

On Mon, 2008-10-13 at 09:57 +0300, Pekka Enberg wrote:
> Hi Tom,
> 
> On Fri, 2008-10-10 at 23:58 -0500, Tom Zanussi wrote:
> > It looks like you hit the same problem as described here:
> > 
> > commit 8191ecd1d14c6914c660dfa007154860a7908857
> > 
> >     splice: fix infinite loop in generic_file_splice_read()
> > 
> > relay uses the same loop but it never got noticed or fixed.  Can you try
> > the following patch:
> > 
> > diff --git a/kernel/relay.c b/kernel/relay.c
> > index 8d13a78..6a4d439 100644
> > --- a/kernel/relay.c
> > +++ b/kernel/relay.c
> > @@ -1318,12 +1318,9 @@ static ssize_t relay_file_splice_read(struct file *in,
> >  		if (ret < 0)
> >  			break;
> >  		else if (!ret) {
> > -			if (spliced)
> > -				break;
> > -			if (flags & SPLICE_F_NONBLOCK) {
> > +			if (flags & SPLICE_F_NONBLOCK)
> >  				ret = -EAGAIN;
> > -				break;
> > -			}
> > +			break;
> >  		}
> >  
> >  		*ppos += ret;
> > 
> 
> Indeed. That fixes the deadlock.
> 
> However, now I don't get anything to the cpu*.out files if I run
> kmemtraced with kmemtrace disabled. If I enable kmemtrace manually and
> then run kmemtraced, I do receive some data. I did apply the
> kmemtrace-user patch as well.
> 
> Hmm?

To me, that sounds like how it should work - if kmemtrace is disabled,
it shouldn't be logging anything, and that's in fact what I saw when
debugging this - it started out disabled and therefore nothing being
logged to relay (printks confirmed that).  When I wrote 1 to the enabled
file, data started getting logged to relay and to the *.out files.

So I don't know why the enabled state behaves the way it does, or if
it's unexpected, but that anyway doesn't seem like a relay problem to
me.

Tom

> 
> 		Pekka
> 


^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PROBLEM] hard-lock with kmemtrace, relayfs, and splice
  2008-10-14  4:03               ` Tom Zanussi
@ 2008-10-14  5:13                 ` Pekka Enberg
  2008-10-14  5:46                   ` Tom Zanussi
  2008-10-14  7:05                   ` Pekka Enberg
  0 siblings, 2 replies; 16+ messages in thread
From: Pekka Enberg @ 2008-10-14  5:13 UTC (permalink / raw)
  To: Tom Zanussi; +Cc: Eduard - Gabriel Munteanu, jens.axboe, linux-kernel

Hi Tom,

Tom Zanussi wrote:
> To me, that sounds like how it should work - if kmemtrace is disabled,
> it shouldn't be logging anything, and that's in fact what I saw when
> debugging this - it started out disabled and therefore nothing being
> logged to relay (printks confirmed that).  When I wrote 1 to the enabled
> file, data started getting logged to relay and to the *.out files.
> 
> So I don't know why the enabled state behaves the way it does, or if
> it's unexpected, but that anyway doesn't seem like a relay problem to
> me.

Oh, right. Looking at kmemtraced.c, we never enable kmemtrace, just 
disable it (which doesn't make much sense). Bug in README or the code. 
Eduard?

Btw, Tom, you can add my

Tested-by: Pekka Enberg <penberg@cs.helsinki.fi>

to your patch if you want. Are you going to send it to Andrew or do you 
want me to pick it up with rest of the kmemtrace patches?

		Pekka

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PROBLEM] hard-lock with kmemtrace, relayfs, and splice
  2008-10-14  5:13                 ` Pekka Enberg
@ 2008-10-14  5:46                   ` Tom Zanussi
  2008-10-14  6:58                     ` Pekka Enberg
  2008-10-14  7:30                     ` Eduard - Gabriel Munteanu
  2008-10-14  7:05                   ` Pekka Enberg
  1 sibling, 2 replies; 16+ messages in thread
From: Tom Zanussi @ 2008-10-14  5:46 UTC (permalink / raw)
  To: Pekka Enberg; +Cc: Eduard - Gabriel Munteanu, jens.axboe, linux-kernel

Hi Pekka,

On Tue, 2008-10-14 at 08:13 +0300, Pekka Enberg wrote:
> Hi Tom,
> 
> Tom Zanussi wrote:
> > To me, that sounds like how it should work - if kmemtrace is disabled,
> > it shouldn't be logging anything, and that's in fact what I saw when
> > debugging this - it started out disabled and therefore nothing being
> > logged to relay (printks confirmed that).  When I wrote 1 to the enabled
> > file, data started getting logged to relay and to the *.out files.
> > 
> > So I don't know why the enabled state behaves the way it does, or if
> > it's unexpected, but that anyway doesn't seem like a relay problem to
> > me.
> 
> Oh, right. Looking at kmemtraced.c, we never enable kmemtrace, just 
> disable it (which doesn't make much sense). Bug in README or the code. 
> Eduard?
> 
> Btw, Tom, you can add my
> 
> Tested-by: Pekka Enberg <penberg@cs.helsinki.fi>
> 
> to your patch if you want. Are you going to send it to Andrew or do you 
> want me to pick it up with rest of the kmemtrace patches?

If you pick it up that would be fine with me.  Here's my sob:

Signed-off-by: Tom Zanussi <tzanussi@gmail.com>

Thanks,

Tom

> 
> 		Pekka


^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PROBLEM] hard-lock with kmemtrace, relayfs, and splice
  2008-10-14  5:46                   ` Tom Zanussi
@ 2008-10-14  6:58                     ` Pekka Enberg
  2008-10-14  7:30                     ` Eduard - Gabriel Munteanu
  1 sibling, 0 replies; 16+ messages in thread
From: Pekka Enberg @ 2008-10-14  6:58 UTC (permalink / raw)
  To: Tom Zanussi; +Cc: Eduard - Gabriel Munteanu, jens.axboe, linux-kernel

On Tue, 2008-10-14 at 00:46 -0500, Tom Zanussi wrote:
> > Tested-by: Pekka Enberg <penberg@cs.helsinki.fi>
> > 
> > to your patch if you want. Are you going to send it to Andrew or do you 
> > want me to pick it up with rest of the kmemtrace patches?
> 
> If you pick it up that would be fine with me.  Here's my sob:
> 
> Signed-off-by: Tom Zanussi <tzanussi@gmail.com>

Applied, thanks!

http://git.kernel.org/?p=linux/kernel/git/penberg/slab-2.6.git;a=commitdiff;h=51b19be3535c8fbcce6b6f838d89b9a6a4cc5b92


^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PROBLEM] hard-lock with kmemtrace, relayfs, and splice
  2008-10-14  5:13                 ` Pekka Enberg
  2008-10-14  5:46                   ` Tom Zanussi
@ 2008-10-14  7:05                   ` Pekka Enberg
  1 sibling, 0 replies; 16+ messages in thread
From: Pekka Enberg @ 2008-10-14  7:05 UTC (permalink / raw)
  To: Tom Zanussi; +Cc: Eduard - Gabriel Munteanu, jens.axboe, linux-kernel

On Tue, 2008-10-14 at 08:13 +0300, Pekka Enberg wrote:
> Hi Tom,
> 
> Tom Zanussi wrote:
> > To me, that sounds like how it should work - if kmemtrace is disabled,
> > it shouldn't be logging anything, and that's in fact what I saw when
> > debugging this - it started out disabled and therefore nothing being
> > logged to relay (printks confirmed that).  When I wrote 1 to the enabled
> > file, data started getting logged to relay and to the *.out files.
> > 
> > So I don't know why the enabled state behaves the way it does, or if
> > it's unexpected, but that anyway doesn't seem like a relay problem to
> > me.
> 
> Oh, right. Looking at kmemtraced.c, we never enable kmemtrace, just 
> disable it (which doesn't make much sense). Bug in README or the code. 

Eduard, here's a fix for the userspace counterpart:

>From aa95e997458fd4d2a3b9a5c75e1452e22a3159af Mon Sep 17 00:00:00 2001
From: Pekka Enberg <penberg@cs.helsinki.fi>
Date: Tue, 14 Oct 2008 10:03:51 +0300
Subject: [PATCH] kmemtrace: enable tracing in kmemtraced

If kmemtrace is not enabled at boot, we need to enable it before we start
relaying data to userspace.

Signed-off-by: Pekka Enberg <penberg@cs.helsinki.fi>
---
 kmemtraced.c |    4 ++--
 1 files changed, 2 insertions(+), 2 deletions(-)

diff --git a/kmemtraced.c b/kmemtraced.c
index 217478d..5cc1ada 100644
--- a/kmemtraced.c
+++ b/kmemtraced.c
@@ -165,8 +165,6 @@ int main(int argc, char *argv[])
 	if (!readers)
 		panic("Out of memory!\n");
 
-	write_str("/sys/kernel/debug/kmemtrace/enabled", "0");
-
 	printf("Copying /proc/kallsyms...\n");
 	copy_kallsyms();
 
@@ -180,6 +178,8 @@ int main(int argc, char *argv[])
 			      strerror(errno));
 	}
 
+	write_str("/sys/kernel/debug/kmemtrace/enabled", "1");
+
 	printf("Logging... Press Control-C to stop.\n");
 
 	while (sigwait(&signals, &signal) == 0) {
-- 
1.5.4.3




^ permalink raw reply related	[flat|nested] 16+ messages in thread

* Re: [PROBLEM] hard-lock with kmemtrace, relayfs, and splice
  2008-10-14  5:46                   ` Tom Zanussi
  2008-10-14  6:58                     ` Pekka Enberg
@ 2008-10-14  7:30                     ` Eduard - Gabriel Munteanu
  1 sibling, 0 replies; 16+ messages in thread
From: Eduard - Gabriel Munteanu @ 2008-10-14  7:30 UTC (permalink / raw)
  To: Tom Zanussi; +Cc: Pekka Enberg, jens.axboe, linux-kernel

On Tue, Oct 14, 2008 at 12:46:47AM -0500, Tom Zanussi wrote:
> Hi Pekka,
> 
> On Tue, 2008-10-14 at 08:13 +0300, Pekka Enberg wrote:
> > Hi Tom,
> > 
> > Tom Zanussi wrote:
> > > To me, that sounds like how it should work - if kmemtrace is disabled,
> > > it shouldn't be logging anything, and that's in fact what I saw when
> > > debugging this - it started out disabled and therefore nothing being
> > > logged to relay (printks confirmed that).  When I wrote 1 to the enabled
> > > file, data started getting logged to relay and to the *.out files.
> > > 
> > > So I don't know why the enabled state behaves the way it does, or if
> > > it's unexpected, but that anyway doesn't seem like a relay problem to
> > > me.
> > 
> > Oh, right. Looking at kmemtraced.c, we never enable kmemtrace, just 
> > disable it (which doesn't make much sense). Bug in README or the code. 
> > Eduard?
> > 
> > Btw, Tom, you can add my
> > 
> > Tested-by: Pekka Enberg <penberg@cs.helsinki.fi>
> > 
> > to your patch if you want. Are you going to send it to Andrew or do you 
> > want me to pick it up with rest of the kmemtrace patches?
> 
> If you pick it up that would be fine with me.  Here's my sob:
> 
> Signed-off-by: Tom Zanussi <tzanussi@gmail.com>
> 
> Thanks,
> 
> Tom
>

Great, this makes it go swifter. I'll commit the change to
kmemtrace-user.



^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PROBLEM] hard-lock with kmemtrace, relayfs, and splice
  2008-10-10  9:42         ` [PROBLEM] hard-lock with kmemtrace, relayfs, and splice Pekka Enberg
  2008-10-10 11:51           ` Eduard - Gabriel Munteanu
  2008-10-11  4:58           ` Tom Zanussi
@ 2008-10-24  4:44           ` Peter Teoh
  2008-10-24 14:15             ` Pekka Enberg
  2 siblings, 1 reply; 16+ messages in thread
From: Peter Teoh @ 2008-10-24  4:44 UTC (permalink / raw)
  To: Pekka Enberg, Eduard - Gabriel Munteanu; +Cc: zanussi, jens.axboe, linux-kernel

[-- Attachment #1: Type: text/plain, Size: 2004 bytes --]

after doing a

git clone git://repo.or.cz/linux-2.6/kmemtrace.git

I reboot the OS and encountered several application crashes.....the
logs are as per attached....please comment.

for bug0 and bug1, the system go into a state of complete
non-responsive, even connecting via SSH into the system becomes
impossible, and bug0 and bug1 was generated just before it goes into
this state.

for bug2, the mouse seemed to respond, i managed to output the dmesg
(which is bug2 itself).

any comments?

On Fri, Oct 10, 2008 at 5:42 PM, Pekka Enberg <penberg@cs.helsinki.fi> wrote:
> (I'm cc'ing Tom, Jens, and LKML.)
>
> On Fri, 2008-10-10 at 12:10 +0300, Pekka Enberg wrote:
>> > I'm seeing a hard lock on my machine when I run kmemtraced with the
>> > following patch applied:
>> >
>> > http://git.kernel.org/?p=linux/kernel/git/penberg/slab-2.6.git;a=commitdiff;h=17ca1d5506b1db433f0b7167a627bfd55d319dd3
>> >
>> > I can enable/disable kmemtrace via the debugfs files fine and can also
>> > read the relay files with cat.
>> >
>> > Any idea where this is coming from?
>>
>> OK, it's the first splice() call in reader_thread() that causes the
>> hang. Hmm.
>
> To recap, with a CONFIG_KMEMTRACE enabled kernel from the
> "topic/kmemtrace" branch of:
>
>  git://git.kernel.org/pub/scm/linux/kernel/git/penberg/slab-2.6.git topic/kmemtrace
>
> running the "kmemtraced" program from
>
>  git://git.kernel.org/pub/scm/linux/kernel/git/penberg/kmemtrace-user.git
>
> results to a hard lock on my machine. I am unable to find anything
> obviously wrong with it and as I can read/write the relay files just
> fine, I'm beginning to think it's problem in relayfs splice
> implementation.
>
> Tom, thoughts?
>
>                Pekka
>
>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at  http://www.tux.org/lkml/
>



-- 
Regards,
Peter Teoh

[-- Attachment #2: bug0 --]
[-- Type: application/octet-stream, Size: 35275 bytes --]

[    0.000000] Linux version 2.6.26 (root@funnyman) (gcc version 4.1.2 20070626 (Red Hat 4.1.2-13)) #1 SMP Fri Oct 24 00:10:25 SGT 2008
[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  BIOS-e820: 0000000000000000 - 000000000009fc00 (usable)
[    0.000000]  BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved)
[    0.000000]  BIOS-e820: 00000000000e4000 - 0000000000100000 (reserved)
[    0.000000]  BIOS-e820: 0000000000100000 - 00000000bbf90000 (usable)
[    0.000000]  BIOS-e820: 00000000bbf90000 - 00000000bbf9e000 (ACPI data)
[    0.000000]  BIOS-e820: 00000000bbf9e000 - 00000000bbfe0000 (ACPI NVS)
[    0.000000]  BIOS-e820: 00000000bbfe0000 - 00000000bc000000 (reserved)
[    0.000000]  BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
[    0.000000]  BIOS-e820: 00000000ffb00000 - 0000000100000000 (reserved)
[    0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
[    0.000000] 2111MB HIGHMEM available.
[    0.000000] 896MB LOWMEM available.
[    0.000000] found SMP MP-table at [c00ff780] 000ff780
[    0.000000] Entering add_active_range(0, 0, 769936) 0 entries of 256 used
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA             0 ->     4096
[    0.000000]   Normal       4096 ->   229376
[    0.000000]   HighMem    229376 ->   769936
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[1] active PFN ranges
[    0.000000]     0:        0 ->   769936
[    0.000000] On node 0 totalpages: 769936
[    0.000000]   DMA zone: 32 pages used for memmap
[    0.000000]   DMA zone: 0 pages reserved
[    0.000000]   DMA zone: 4064 pages, LIFO batch:0
[    0.000000]   Normal zone: 1760 pages used for memmap
[    0.000000]   Normal zone: 223520 pages, LIFO batch:31
[    0.000000]   HighMem zone: 4224 pages used for memmap
[    0.000000]   HighMem zone: 536336 pages, LIFO batch:31
[    0.000000]   Movable zone: 0 pages used for memmap
[    0.000000] DMI 2.4 present.
[    0.000000] ACPI: RSDP 000FAE40, 0024 (r2 ACPIAM)
[    0.000000] ACPI: XSDT BBF90100, 0054 (r1 ÿÿÿÿÿÿ ÿÿÿÿÿÿÿÿ  1000722 MSFT       97)
[    0.000000] ACPI: FACP BBF90290, 00F4 (r3 MSTEST OEMFACP   1000722 MSFT       97)
[    0.000000] ACPI: DSDT BBF905C0, 8E63 (r1  A0667 A0667000        0 INTL 20060113)
[    0.000000] ACPI: FACS BBF9E000, 0040
[    0.000000] ACPI: APIC BBF90390, 006C (r1 MSTEST OEMAPIC   1000722 MSFT       97)
[    0.000000] ACPI: MCFG BBF90400, 003C (r1 MSTEST OEMMCFG   1000722 MSFT       97)
[    0.000000] ACPI: SLIC BBF90440, 0176 (r1 ÿÿÿÿÿÿ ÿÿÿÿÿÿÿÿ  1000722 MSFT       97)
[    0.000000] ACPI: OEMB BBF9E040, 007B (r1 MSTEST AMI_OEM   1000722 MSFT       97)
[    0.000000] ACPI: HPET BBF99430, 0038 (r1 MSTEST OEMHPET   1000722 MSFT       97)
[    0.000000] ACPI: PM-Timer IO Port: 0x808
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x82] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x83] disabled)
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ2 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Enabling APIC mode:  Flat.  Using 1 I/O APICs
[    0.000000] ACPI: HPET id: 0x8086a202 base: 0xfed00000
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] Allocating PCI resources starting at c0000000 (gap: bc000000:42e00000)
[    0.000000] SMP: Allowing 4 CPUs, 2 hotplug CPUs
[    0.000000] PERCPU: Allocating 41384 bytes of per cpu data
[    0.000000] NR_CPUS: 32, nr_cpu_ids: 4
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 763920
[    0.000000] Kernel command line: ro root=LABEL=/ rhgb quiet
[    0.000000] mapped APIC to ffffb000 (fee00000)
[    0.000000] mapped IOAPIC to ffffa000 (fec00000)
[    0.000000] Enabling fast FPU save and restore... done.
[    0.000000] Enabling unmasked SIMD FPU exception support... done.
[    0.000000] Initializing CPU#0
[    0.000000] CPU 0 irqstacks, hard=c04fe000 soft=c04de000
[    0.000000] PID hash table entries: 4096 (order: 12, 16384 bytes)
[    0.000000] Extended CMOS year: 2000
[    0.000000] Detected 2133.382 MHz processor.
[    0.000999] Console: colour VGA+ 80x25
[    0.000999] console [tty0] enabled
[    0.000999] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
[    0.000999] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
[    0.000999] Memory: 3046364k/3079744k available (2339k kernel code, 32196k reserved, 1307k data, 280k init, 2162240k highmem)
[    0.000999] virtual kernel memory layout:
[    0.000999]     fixmap  : 0xffc54000 - 0xfffff000   (3756 kB)
[    0.000999]     pkmap   : 0xff400000 - 0xff800000   (4096 kB)
[    0.000999]     vmalloc : 0xf8800000 - 0xff3fe000   ( 107 MB)
[    0.000999]     lowmem  : 0xc0000000 - 0xf8000000   ( 896 MB)
[    0.000999]       .init : 0xc0495000 - 0xc04db000   ( 280 kB)
[    0.000999]       .data : 0xc0348e50 - 0xc048fbc0   (1307 kB)
[    0.000999]       .text : 0xc0100000 - 0xc0348e50   (2339 kB)
[    0.000999] Checking if this processor honours the WP bit even in supervisor mode...Ok.
[    0.000999] CPA: page pool initialized 48 of 48 pages preallocated
[    0.000999] SLUB: Genslabs=12, HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000999] kmemtrace: early init successful.
[    0.000999] hpet clockevent registered
[    0.060856] Calibrating delay using timer specific routine.. 4269.35 BogoMIPS (lpj=2134675)
[    0.060881] Security Framework initialized
[    0.060886] SELinux:  Initializing.
[    0.060895] SELinux:  Starting in permissive mode
[    0.060899] selinux_register_security:  Registering secondary module capability
[    0.060901] Capability LSM initialized as secondary
[    0.060913] Mount-cache hash table entries: 512
[    0.060990] CPU: L1 I cache: 32K, L1 D cache: 32K
[    0.060990] CPU: L2 cache: 4096K
[    0.060990] CPU: Physical Processor ID: 0
[    0.060990] CPU: Processor Core ID: 0
[    0.060990] Intel machine check architecture supported.
[    0.060990] Intel machine check reporting enabled on CPU#0.
[    0.060990] using mwait in idle threads.
[    0.060990] Checking 'hlt' instruction... OK.
[    0.065989] ACPI: Core revision 20080321
[    0.077988] ENABLING IO-APIC IRQs
[    0.077988] ..TIMER: vector=0x31 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.087975] CPU0: Intel(R) Core(TM)2 CPU          6420  @ 2.13GHz stepping 06
[    0.091985] CPU 1 irqstacks, hard=c04ff000 soft=c04df000
[    0.091985] Booting processor 1/1 ip 6000
[    0.103984] Initializing CPU#1
[    0.103984] Calibrating delay using timer specific routine.. 4266.55 BogoMIPS (lpj=2133277)
[    0.103984] CPU: L1 I cache: 32K, L1 D cache: 32K
[    0.103984] CPU: L2 cache: 4096K
[    0.103984] CPU: Physical Processor ID: 0
[    0.103984] CPU: Processor Core ID: 1
[    0.103984] Intel machine check architecture supported.
[    0.103984] Intel machine check reporting enabled on CPU#1.
[    0.103984] x86 PAT enabled: cpu 1, old 0x7040600070406, new 0x7010600070106
[    0.164496] CPU1: Intel(R) Core(TM)2 CPU          6420  @ 2.13GHz stepping 06
[    0.164509] checking TSC synchronization [CPU#0 -> CPU#1]: passed.
[    0.165974] Brought up 2 CPUs
[    0.165974] Total of 2 processors activated (8535.90 BogoMIPS).
[    0.165974] CPU0 attaching sched-domain:
[    0.165974]  domain 0: span 0-1
[    0.165974]   groups: 0 1
[    0.165974] CPU1 attaching sched-domain:
[    0.165974]  domain 0: span 0-1
[    0.165974]   groups: 1 0
[    0.103984] khelper used greatest stack depth: 2728 bytes left
[    0.165974] net_namespace: 660 bytes
[    0.165974] Booting paravirtualized kernel on bare hardware
[    0.166974] NET: Registered protocol family 16
[    0.166974] ACPI: bus type pci registered
[    0.166974] PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
[    0.166974] PCI: Not using MMCONFIG.
[    0.166974] PCI: PCI BIOS revision 3.00 entry at 0xf0031, last bus=5
[    0.166974] PCI: Using configuration type 1 for base access
[    0.166974] Setting up standard PCI resources
[    0.174648] ACPI: EC: Look up EC in DSDT
[    0.187140] ACPI: Interpreter enabled
[    0.187140] ACPI: (supports S0 S1 S3 S5)
[    0.187140] ACPI: Using IOAPIC for interrupt routing
[    0.187202] PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
[    0.190112] PCI: MCFG area at e0000000 reserved in ACPI motherboard resources
[    0.190115] PCI: Using MMCONFIG for extended config space
[    0.201138] ACPI: PCI Root Bridge [PCI0] (0000:00)
[    0.201783] pci 0000:00:1f.0: quirk: region 0800-087f claimed by ICH6 ACPI/GPIO/TCO
[    0.201787] pci 0000:00:1f.0: quirk: region 0480-04bf claimed by ICH6 GPIO
[    0.202836] PCI: Transparent bridge - 0000:00:1e.0
[    0.202866] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
[    0.203725] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P2._PRT]
[    0.203861] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P1._PRT]
[    0.203937] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P4._PRT]
[    0.204081] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P8._PRT]
[    0.204223] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P9._PRT]
[    0.222934] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 *11 12 14 15)
[    0.222934] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *10 11 12 14 15)
[    0.222934] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 7 10 11 12 14 15)
[    0.223072] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 10 11 12 14 *15)
[    0.223208] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled.
[    0.223344] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 11 12 *14 15)
[    0.223479] ACPI: PCI Interrupt Link [LNKG] (IRQs *3 4 5 6 7 10 11 12 14 15)
[    0.223884] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *7 10 11 12 14 15)
[    0.224203] ACPI Warning (tbutils-0217): Incorrect checksum in table [OEMB] - A2, should be 99 [20080321]
[    0.224203] Linux Plug and Play Support v0.97 (c) Adam Belay
[    0.224203] pnp: PnP ACPI init
[    0.224203] ACPI: bus type pnp registered
[    0.228571] pnp: PnP ACPI: found 16 devices
[    0.228573] ACPI: ACPI bus type pnp unregistered
[    0.229203] usbcore: registered new interface driver usbfs
[    0.229203] usbcore: registered new interface driver hub
[    0.229203] usbcore: registered new device driver usb
[    0.229203] PCI: Using ACPI for IRQ routing
[    0.231074] NetLabel: Initializing
[    0.231077] NetLabel:  domain hash size = 128
[    0.231078] NetLabel:  protocols = UNLABELED CIPSOv4
[    0.231098] NetLabel:  unlabeled traffic allowed by default
[    0.231104] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.231109] hpet0: 3 64-bit timers, 14318180 Hz
[    0.233118] system 00:01: iomem range 0xfed14000-0xfed19fff has been reserved
[    0.233130] system 00:08: ioport range 0x290-0x297 has been reserved
[    0.233138] system 00:09: ioport range 0x4d0-0x4d1 has been reserved
[    0.233141] system 00:09: ioport range 0x800-0x87f has been reserved
[    0.233145] system 00:09: ioport range 0x480-0x4bf has been reserved
[    0.233149] system 00:09: iomem range 0xffafe000-0xffb0cbff could not be reserved
[    0.233153] system 00:09: iomem range 0xffb00000-0xffbfffff could not be reserved
[    0.233157] system 00:09: iomem range 0xfed1c000-0xfed1ffff has been reserved
[    0.233161] system 00:09: iomem range 0xfed20000-0xfed8ffff has been reserved
[    0.233165] system 00:09: iomem range 0xfff00000-0xfffffffe could not be reserved
[    0.233168] system 00:09: iomem range 0xfebfe000-0xfebfec00 has been reserved
[    0.233177] system 00:0b: iomem range 0xfec00000-0xfec00fff has been reserved
[    0.233181] system 00:0b: iomem range 0xfee00000-0xfee00fff could not be reserved
[    0.233190] system 00:0e: iomem range 0xe0000000-0xefffffff has been reserved
[    0.233198] system 00:0f: iomem range 0x0-0x9ffff could not be reserved
[    0.233202] system 00:0f: iomem range 0xc0000-0xcffff could not be reserved
[    0.233206] system 00:0f: iomem range 0xe0000-0xfffff could not be reserved
[    0.233210] system 00:0f: iomem range 0x100000-0xbbffffff could not be reserved
[    0.264503] PCI: Bridge: 0000:00:01.0
[    0.264506]   IO window: 9000-9fff
[    0.264509]   MEM window: 0xf8700000-0xfe7fffff
[    0.264512]   PREFETCH window: 0x00000000bfe00000-0x00000000dfdfffff
[    0.264515] PCI: Bridge: 0000:00:1c.0
[    0.264517]   IO window: disabled.
[    0.264520]   MEM window: disabled.
[    0.264523]   PREFETCH window: 0x00000000dfe00000-0x00000000dfefffff
[    0.264524] PCI: Bridge: 0000:00:1c.4
[    0.264524]   IO window: b000-bfff
[    0.264524]   MEM window: 0xfe900000-0xfe9fffff
[    0.264524]   PREFETCH window: disabled.
[    0.264524] PCI: Bridge: 0000:00:1c.5
[    0.264524]   IO window: a000-afff
[    0.264524]   MEM window: 0xfe800000-0xfe8fffff
[    0.264524]   PREFETCH window: disabled.
[    0.264524] PCI: Bridge: 0000:00:1e.0
[    0.264524]   IO window: disabled.
[    0.264524]   MEM window: 0xfea00000-0xfeafffff
[    0.264524]   PREFETCH window: disabled.
[    0.264524] ACPI: PCI Interrupt 0000:00:01.0[A] -> GSI 16 (level, low) -> IRQ 16
[    0.264524] PCI: Setting latency timer of device 0000:00:01.0 to 64
[    0.264524] ACPI: PCI Interrupt 0000:00:1c.0[A] -> GSI 16 (level, low) -> IRQ 16
[    0.264524] PCI: Setting latency timer of device 0000:00:1c.0 to 64
[    0.264524] ACPI: PCI Interrupt 0000:00:1c.4[A] -> GSI 16 (level, low) -> IRQ 16
[    0.264524] PCI: Setting latency timer of device 0000:00:1c.4 to 64
[    0.264524] ACPI: PCI Interrupt 0000:00:1c.5[B] -> GSI 17 (level, low) -> IRQ 17
[    0.264524] PCI: Setting latency timer of device 0000:00:1c.5 to 64
[    0.264524] PCI: Setting latency timer of device 0000:00:1e.0 to 64
[    0.264524] NET: Registered protocol family 2
[    0.267699] IP route cache hash table entries: 32768 (order: 5, 131072 bytes)
[    0.267973] TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.268573] TCP bind hash table entries: 65536 (order: 7, 524288 bytes)
[    0.268812] TCP: Hash tables configured (established 131072 bind 65536)
[    0.268815] TCP reno registered
[    0.269845] NET: Registered protocol family 1
[    0.270000] checking if image is initramfs... it is
[    0.427473] debug: unmapping init memory f7dc2000..f7ff0000
[    0.427871] apm: BIOS version 1.2 Flags 0x03 (Driver version 1.16ac)
[    0.427871] apm: disabled - APM is not SMP safe.
[    0.427954] audit: initializing netlink socket (disabled)
[    0.427972] type=2000 audit(1224831837.425:1): initialized
[    0.434613] highmem bounce pool size: 64 pages
[    0.434613] Total HugeTLB memory allocated, 0
[    0.436623] VFS: Disk quotas dquot_6.5.1
[    0.437613] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[    0.437614] msgmni has been set to 1728
[    0.437614] SELinux:  Registering netfilter hooks
[    0.437614] io scheduler noop registered
[    0.437614] io scheduler anticipatory registered
[    0.437614] io scheduler deadline registered
[    0.437614] io scheduler cfq registered (default)
[    0.437614] pci 0000:01:00.0: Boot video device
[    0.437614] PCI: Setting latency timer of device 0000:00:01.0 to 64
[    0.437622] assign_interrupt_mode Found MSI capability
[    0.437645] Allocate Port Service[0000:00:01.0:pcie00]
[    0.438613] Allocate Port Service[0000:00:01.0:pcie03]
[    0.438613] PCI: Setting latency timer of device 0000:00:1c.0 to 64
[    0.438613] assign_interrupt_mode Found MSI capability
[    0.438613] Allocate Port Service[0000:00:1c.0:pcie00]
[    0.438613] Allocate Port Service[0000:00:1c.0:pcie02]
[    0.438613] Allocate Port Service[0000:00:1c.0:pcie03]
[    0.438613] PCI: Setting latency timer of device 0000:00:1c.4 to 64
[    0.438613] assign_interrupt_mode Found MSI capability
[    0.438613] Allocate Port Service[0000:00:1c.4:pcie00]
[    0.438613] Allocate Port Service[0000:00:1c.4:pcie02]
[    0.438614] Allocate Port Service[0000:00:1c.4:pcie03]
[    0.438614] PCI: Setting latency timer of device 0000:00:1c.5 to 64
[    0.438614] assign_interrupt_mode Found MSI capability
[    0.438614] Allocate Port Service[0000:00:1c.5:pcie00]
[    0.438614] Allocate Port Service[0000:00:1c.5:pcie02]
[    0.438614] Allocate Port Service[0000:00:1c.5:pcie03]
[    0.438614] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    0.439613] ACPI: ACPI0007:00 is registered as cooling_device0
[    0.440613] ACPI: ACPI0007:01 is registered as cooling_device1
[    0.443613] isapnp: Scanning for PnP cards...
[    0.504206] Switched to high resolution mode on CPU 1
[    0.504661] Switched to high resolution mode on CPU 0
[    0.799364] isapnp: No Plug & Play device found
[    0.801979] hpet_resources: 0xfed00000 is busy
[    0.802080] Non-volatile memory driver v1.2
[    0.802117] Linux agpgart interface v0.103
[    0.803405] Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
[    1.047456] serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    1.048406] 00:06: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    1.095379] brd: module loaded
[    1.095379] input: Macintosh mouse button emulation as /class/input/input0
[    1.095379] PNP: PS/2 Controller [PNP0303:PS2K,PNP0f03:PS2M] at 0x60,0x64 irq 1,12
[    1.098390] serio: i8042 KBD port at 0x60,0x64 irq 1
[    1.098396] serio: i8042 AUX port at 0x60,0x64 irq 12
[    1.099405] mice: PS/2 mouse device common for all mice
[    1.127394] input: AT Translated Set 2 keyboard as /class/input/input1
[    1.133637] cpuidle: using governor ladder
[    1.133637] cpuidle: using governor menu
[    1.133637] usbcore: registered new interface driver hiddev
[    1.133637] usbcore: registered new interface driver usbhid
[    1.133637] usbhid: v2.6:USB HID core driver
[    1.133637] TCP cubic registered
[    1.133637] Initializing XFRM netlink socket
[    1.133637] NET: Registered protocol family 17
[    1.134405] Starting balanced_irq
[    1.134405] Using IPI No-Shortcut mode
[    1.134405] registered taskstats version 1
[    1.134405] kmemtrace: fully up.
[    1.134570] debug: unmapping init memory c0495000..c04db000
[    1.134624] Write protecting the kernel text: 2340k
[    1.134639] Write protecting the kernel read-only data: 1084k
[    1.411758] USB Universal Host Controller Interface driver v3.0
[    1.411784] ACPI: PCI Interrupt 0000:00:1a.0[A] -> GSI 16 (level, low) -> IRQ 16
[    1.411792] PCI: Setting latency timer of device 0000:00:1a.0 to 64
[    1.411795] uhci_hcd 0000:00:1a.0: UHCI Host Controller
[    1.412758] uhci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    1.412758] uhci_hcd 0000:00:1a.0: irq 16, io base 0x0000dc00
[    1.412758] usb usb1: configuration #1 chosen from 1 choice
[    1.412758] hub 1-0:1.0: USB hub found
[    1.412758] hub 1-0:1.0: 2 ports detected
[    1.513632] ACPI: PCI Interrupt 0000:00:1a.1[B] -> GSI 17 (level, low) -> IRQ 17
[    1.513640] PCI: Setting latency timer of device 0000:00:1a.1 to 64
[    1.513644] uhci_hcd 0000:00:1a.1: UHCI Host Controller
[    1.513724] uhci_hcd 0000:00:1a.1: new USB bus registered, assigned bus number 2
[    1.513747] uhci_hcd 0000:00:1a.1: irq 17, io base 0x0000e000
[    1.513801] usb usb2: configuration #1 chosen from 1 choice
[    1.513801] hub 2-0:1.0: USB hub found
[    1.513801] hub 2-0:1.0: 2 ports detected
[    1.614265] ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 23 (level, low) -> IRQ 23
[    1.614273] PCI: Setting latency timer of device 0000:00:1d.0 to 64
[    1.614277] uhci_hcd 0000:00:1d.0: UHCI Host Controller
[    1.614373] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 3
[    1.614396] uhci_hcd 0000:00:1d.0: irq 23, io base 0x0000d480
[    1.614484] usb usb3: configuration #1 chosen from 1 choice
[    1.614532] hub 3-0:1.0: USB hub found
[    1.614539] hub 3-0:1.0: 2 ports detected
[    1.762076] ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 19
[    1.762084] PCI: Setting latency timer of device 0000:00:1d.1 to 64
[    1.762088] uhci_hcd 0000:00:1d.1: UHCI Host Controller
[    1.762178] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 4
[    1.762201] uhci_hcd 0000:00:1d.1: irq 19, io base 0x0000d800
[    1.762291] usb usb4: configuration #1 chosen from 1 choice
[    1.762337] hub 4-0:1.0: USB hub found
[    1.762344] hub 4-0:1.0: 2 ports detected
[    1.835776] input: ImPS/2 Generic Wheel Mouse as /class/input/input2
[    1.863168] ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 18
[    1.863176] PCI: Setting latency timer of device 0000:00:1d.2 to 64
[    1.863180] uhci_hcd 0000:00:1d.2: UHCI Host Controller
[    1.863281] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 5
[    1.863305] uhci_hcd 0000:00:1d.2: irq 18, io base 0x0000d880
[    1.863397] usb usb5: configuration #1 chosen from 1 choice
[    1.863443] hub 5-0:1.0: USB hub found
[    1.863450] hub 5-0:1.0: 2 ports detected
[    1.972783] insmod used greatest stack depth: 2192 bytes left
[    1.974337] ohci_hcd: 2006 August 04 USB 1.1 'Open' Host Controller (OHCI) Driver
[    1.975778] ACPI: PCI Interrupt 0000:00:1a.7[C] -> GSI 18 (level, low) -> IRQ 18
[    1.975778] PCI: Setting latency timer of device 0000:00:1a.7 to 64
[    1.975778] ehci_hcd 0000:00:1a.7: EHCI Host Controller
[    1.975778] ehci_hcd 0000:00:1a.7: new USB bus registered, assigned bus number 6
[    1.979679] ehci_hcd 0000:00:1a.7: debug port 1
[    1.979684] PCI: cache line size of 32 is not supported by device 0000:00:1a.7
[    1.979689] ehci_hcd 0000:00:1a.7: irq 18, io mem 0xfebffc00
[    1.988935] ehci_hcd 0000:00:1a.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
[    1.989778] usb usb6: configuration #1 chosen from 1 choice
[    1.989778] hub 6-0:1.0: USB hub found
[    1.989778] hub 6-0:1.0: 4 ports detected
[    2.090778] ACPI: PCI Interrupt 0000:00:1d.7[A] -> GSI 23 (level, low) -> IRQ 23
[    2.090778] PCI: Setting latency timer of device 0000:00:1d.7 to 64
[    2.090778] ehci_hcd 0000:00:1d.7: EHCI Host Controller
[    2.090778] ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 7
[    2.094852] ehci_hcd 0000:00:1d.7: debug port 1
[    2.094857] PCI: cache line size of 32 is not supported by device 0000:00:1d.7
[    2.094861] ehci_hcd 0000:00:1d.7: irq 23, io mem 0xfebff800
[    2.104579] ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
[    2.104959] usb usb7: configuration #1 chosen from 1 choice
[    2.104959] hub 7-0:1.0: USB hub found
[    2.104959] hub 7-0:1.0: 6 ports detected
[    2.234555] SCSI subsystem initialized
[    2.235555] Driver 'sd' needs updating - please use bus_type methods
[    2.237556] No dock devices found.
[    2.244554] libata version 3.00 loaded.
[    2.246554] ata_piix 0000:00:1f.2: version 2.12
[    2.246554] ACPI: PCI Interrupt 0000:00:1f.2[B] -> GSI 19 (level, low) -> IRQ 19
[    2.246554] ata_piix 0000:00:1f.2: MAP [ P0 P2 P1 P3 ]
[    2.246554] PCI: Setting latency timer of device 0000:00:1f.2 to 64
[    2.246554] scsi0 : ata_piix
[    2.246554] scsi1 : ata_piix
[    2.249188] ata1: SATA max UDMA/133 cmd 0xec00 ctl 0xe880 bmdma 0xe400 irq 19
[    2.249193] ata2: SATA max UDMA/133 cmd 0xe800 ctl 0xe480 bmdma 0xe408 irq 19
[    2.564301] ata1: SATA link down (SStatus 0 SControl 300)
[    3.019667] ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[    3.069222] ata2.00: ATA-7: ST3500630AS, 3.AAK, max UDMA/133
[    3.069222] ata2.00: 976773168 sectors, multi 16: LBA48 NCQ (depth 0/32)
[    3.144251] ata2.00: configured for UDMA/133
[    3.188140] scsi 1:0:0:0: Direct-Access     ATA      ST3500630AS      3.AA PQ: 0 ANSI: 5
[    3.188140] sd 1:0:0:0: [sda] 976773168 512-byte hardware sectors (500108 MB)
[    3.188140] sd 1:0:0:0: [sda] Write Protect is off
[    3.188140] sd 1:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    3.188140] sd 1:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    3.188140] sd 1:0:0:0: [sda] 976773168 512-byte hardware sectors (500108 MB)
[    3.188140] sd 1:0:0:0: [sda] Write Protect is off
[    3.188140] sd 1:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    3.188140] sd 1:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    3.188656]  sda: sda1 sda2 sda3 sda4 < sda5 sda6 sda7 sda8 sda9 >
[    3.226921] sd 1:0:0:0: [sda] Attached SCSI disk
[    3.226921] ACPI: PCI Interrupt 0000:00:1f.5[B] -> GSI 19 (level, low) -> IRQ 19
[    3.226921] ata_piix 0000:00:1f.5: MAP [ P0 -- P1 -- ]
[    3.226921] PCI: Setting latency timer of device 0000:00:1f.5 to 64
[    3.226921] scsi2 : ata_piix
[    3.287656] scsi3 : ata_piix
[    3.289563] ata3: SATA max UDMA/133 cmd 0xd400 ctl 0xd080 bmdma 0xc880 irq 19
[    3.289567] ata4: SATA max UDMA/133 cmd 0xd000 ctl 0xcc00 bmdma 0xc888 irq 19
[    3.745605] ata3: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[    3.789655] ata3.00: ATA-7: ST3500630AS, 3.AAK, max UDMA/133
[    3.789655] ata3.00: 976773168 sectors, multi 16: LBA48 NCQ (depth 0/32)
[    3.864655] ata3.00: configured for UDMA/133
[    4.180240] ata4: SATA link down (SStatus 0 SControl 300)
[    4.180209] scsi 2:0:0:0: Direct-Access     ATA      ST3500630AS      3.AA PQ: 0 ANSI: 5
[    4.180209] sd 2:0:0:0: [sdb] 976773168 512-byte hardware sectors (500108 MB)
[    4.180209] sd 2:0:0:0: [sdb] Write Protect is off
[    4.180209] sd 2:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[    4.180209] sd 2:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    4.180209] sd 2:0:0:0: [sdb] 976773168 512-byte hardware sectors (500108 MB)
[    4.213852] sd 2:0:0:0: [sdb] Write Protect is off
[    4.213854] sd 2:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[    4.213884] sd 2:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    4.213888]  sdb: sdb1 sdb2 sdb3 sdb4 < sdb5 sdb6 sdb7 >
[    4.246116] sd 2:0:0:0: [sdb] Attached SCSI disk
[    4.246116] insmod used greatest stack depth: 1148 bytes left
[    4.260281] ahci 0000:03:00.0: version 3.0
[    4.260281] ACPI: PCI Interrupt 0000:03:00.0[A] -> GSI 16 (level, low) -> IRQ 16
[    5.260311] ahci 0000:03:00.0: AHCI 0001.0000 32 slots 2 ports 3 Gbps 0x3 impl SATA mode
[    5.260315] ahci 0000:03:00.0: flags: 64bit ncq pm led clo pmp pio slum part 
[    5.260321] PCI: Setting latency timer of device 0000:03:00.0 to 64
[    5.261356] scsi4 : ahci
[    5.261356] scsi5 : ahci
[    5.261356] ata5: SATA max UDMA/133 abar m8192@0xfe9fe000 port 0xfe9fe100 irq 16
[    5.261356] ata6: SATA max UDMA/133 abar m8192@0xfe9fe000 port 0xfe9fe180 irq 16
[    5.566358] ata5: SATA link down (SStatus 0 SControl 300)
[    5.871677] ata6: SATA link down (SStatus 0 SControl 300)
[    6.026048] device-mapper: ioctl: 4.13.0-ioctl (2007-10-18) initialised: dm-devel@redhat.com
[    6.690848] kjournald starting.  Commit interval 5 seconds
[    6.690848] EXT3-fs: mounted filesystem with ordered data mode.
[    9.770960] input: PC Speaker as /class/input/input3
[    9.857281] iTCO_vendor_support: vendor-support=0
[    9.903118] i801_smbus 0000:00:1f.3: enabling device (0001 -> 0003)
[    9.903124] ACPI: PCI Interrupt 0000:00:1f.3[C] -> GSI 18 (level, low) -> IRQ 18
[    9.927558] ACPI: PCI Interrupt 0000:05:03.0[A] -> GSI 21 (level, low) -> IRQ 21
[    9.978713] ohci1394: fw-host0: OHCI-1394 1.1 (PCI): IRQ=[21]  MMIO=[feaff800-feafffff]  Max Packet=[2048]  IR/IT contexts=[4/8]
[   10.010710] ACPI: PCI Interrupt 0000:02:00.0[A] -> GSI 17 (level, low) -> IRQ 17
[   10.010722] PCI: Setting latency timer of device 0000:02:00.0 to 64
[   10.010747] sky2 0000:02:00.0: v1.21 addr 0xfe8fc000 irq 17 Yukon-EC Ultra (0xb4) rev 2
[   10.011112] sky2 eth0: addr 00:18:f3:b4:7e:ff
[   10.041175] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.03 (30-Apr-2008)
[   10.041269] iTCO_wdt: Found a ICH8 or ICH8R TCO device (Version=2, TCOBASE=0x0860)
[   10.041344] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0)
[   10.044561] input: Power Button (FF) as /class/input/input4
[   10.061422] ACPI: Power Button (FF) [PWRF]
[   10.061515] input: Power Button (CM) as /class/input/input5
[   10.077154] ACPI: Power Button (CM) [PWRB]
[   10.507084] Floppy drive(s): fd0 is 1.44M
[   10.522543] FDC 0 is a post-1991 82077
[   10.593405] ACPI: PCI Interrupt 0000:00:1b.0[A] -> GSI 22 (level, low) -> IRQ 22
[   10.593428] PCI: Setting latency timer of device 0000:00:1b.0 to 64
[   10.662802] sd 1:0:0:0: Attached scsi generic sg0 type 0
[   10.662827] sd 2:0:0:0: Attached scsi generic sg1 type 0
[   11.249131] ieee1394: Host added: ID:BUS[0-00:1023]  GUID[0011d80000f5cea6]
[   11.383670] usbcore: registered new interface driver snd-usb-audio
[   12.146359] lp: driver loaded but no devices found
[   12.190350] sonypi: Sony Programmable I/O Controller Driver v1.26.
[   13.620800] NET: Registered protocol family 10
[   13.621385] lo: Disabled Privacy Extensions
[   19.530640] md: Autodetecting RAID arrays.
[   19.530643] md: Scanned 0 and added 0 devices.
[   19.530645] md: autorun ...
[   19.530646] md: ... autorun DONE.
[   19.660443] device-mapper: multipath: version 1.0.5 loaded
[  341.923010] EXT3 FS on sda5, internal journal
[  342.112922] kjournald starting.  Commit interval 5 seconds
[  342.112922] EXT3 FS on dm-0, internal journal
[  342.112922] EXT3-fs: mounted filesystem with ordered data mode.
[  342.145612] kjournald starting.  Commit interval 5 seconds
[  342.145612] EXT3 FS on sdb1, internal journal
[  342.145612] EXT3-fs: mounted filesystem with ordered data mode.
[  342.168713] kjournald starting.  Commit interval 5 seconds
[  342.168713] EXT3 FS on sdb2, internal journal
[  342.168713] EXT3-fs: mounted filesystem with ordered data mode.
[  342.191700] kjournald starting.  Commit interval 5 seconds
[  342.192675] EXT3 FS on sdb7, internal journal
[  342.192675] EXT3-fs: mounted filesystem with ordered data mode.
[  342.912378] Adding 4192924k swap on /dev/sda7.  Priority:-1 extents:1 across:4192924k
[  343.943767] warning: process `kudzu' used the deprecated sysctl system call with 1.23.
[  353.148947] sky2 eth0: enabling interface
[  353.152136] ADDRCONF(NETDEV_UP): eth0: link is not ready
[  354.890103] sky2 eth0: Link is up at 100 Mbps, full duplex, flow control both
[  354.890103] ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[  356.326177] RPC: Registered udp transport module.
[  356.326177] RPC: Registered tcp transport module.
[  356.879829] warning: `dbus-daemon' uses 32-bit capabilities (legacy support in use)
[  357.075458] Bluetooth: Core ver 2.11
[  357.075902] NET: Registered protocol family 31
[  357.075902] Bluetooth: HCI device and connection manager initialized
[  357.075902] Bluetooth: HCI socket layer initialized
[  357.228653] Bluetooth: L2CAP ver 2.9
[  357.228653] Bluetooth: L2CAP socket layer initialized
[  357.478689] Bluetooth: RFCOMM socket layer initialized
[  357.478689] Bluetooth: RFCOMM TTY layer initialized
[  357.478689] Bluetooth: RFCOMM ver 1.8
[  357.922488] Bluetooth: HIDP (Human Interface Emulation) ver 1.2
[  358.105641] ip6_tables: (C) 2000-2006 Netfilter Core Team
[  358.310515] ip_tables: (C) 2000-2006 Netfilter Core Team
[  358.429485] nf_conntrack version 0.5.0 (16384 buckets, 65536 max)
[  365.948863] eth0: no IPv6 routers present
[  406.636127] loop: module loaded
[  508.068351] gnome-terminal invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  508.068359] Pid: 4003, comm: gnome-terminal Not tainted 2.6.26 #1
[  508.068374]  [<c015b64f>] oom_kill_process+0x42/0x183
[  508.068387]  [<c015ba76>] out_of_memory+0x157/0x188
[  508.068398]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  508.068410]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  508.068415]  [<c015da12>] __get_free_pages+0x12/0x21
[  508.068420]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  508.068425]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  508.068435]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  508.068442]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  508.068453]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  508.068461]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  508.068482]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  508.068493]  [<c0179485>] do_sync_write+0xab/0xe9
[  508.068498]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  508.068506]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  508.068514]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  508.068520]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  508.068527]  [<c0179be3>] vfs_write+0x9d/0x133
[  508.068533]  [<c017a1d8>] sys_write+0x3b/0x60
[  508.068538]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  508.068547]  =======================
[  508.068549] Mem-info:
[  508.068550] DMA per-cpu:
[  508.068552] CPU    0: hi:    0, btch:   1 usd:   0
[  508.068554] CPU    1: hi:    0, btch:   1 usd:   0
[  508.068556] Normal per-cpu:
[  508.068558] CPU    0: hi:  186, btch:  31 usd:   0
[  508.068560] CPU    1: hi:  186, btch:  31 usd:   0
[  508.068562] HighMem per-cpu:
[  508.068564] CPU    0: hi:  186, btch:  31 usd:   0
[  508.068566] CPU    1: hi:  186, btch:  31 usd:   0
[  508.068569] Active:51860 inactive:38012 dirty:4 writeback:175 unstable:0
[  508.068570]  free:504012 slab:2874 mapped:15100 pagetables:788 bounce:0
[  508.068573] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  508.068575] lowmem_reserve[]: 0 873 2968 2968
[  508.068580] Normal free:216020kB min:3744kB low:4680kB high:5616kB active:660kB inactive:1192kB present:894080kB pages_scanned:0 all_unreclaimable? no
[  508.068583] lowmem_reserve[]: 0 0 16760 16760
[  508.068588] HighMem free:1796472kB min:512kB low:2760kB high:5008kB active:206780kB inactive:150856kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  508.068591] lowmem_reserve[]: 0 0 0 0
[  508.068594] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  508.068604] Normal: 52411*4kB 685*8kB 9*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 216068kB
[  508.068614] HighMem: 2827*4kB 1751*8kB 1178*16kB 733*32kB 381*64kB 155*128kB 87*256kB 59*512kB 48*1024kB 17*2048kB 378*4096kB = 1796580kB
[  508.068624] 50820 total pagecache pages
[  508.068626] Swap cache: add 0, delete 0, find 0/0
[  508.068628] Free swap  = 4192924kB
[  508.068629] Total swap = 4192924kB
[  508.102251] 769936 pages of RAM
[  508.102251] 540560 pages of HIGHMEM
[  508.102251] 8147 reserved pages
[  508.102251] 71192 pages shared
[  508.102251] 0 pages swap cached
[  508.102251] 4 pages dirty
[  508.102251] 175 pages writeback
[  508.102251] 15100 pages mapped
[  508.102251] 2874 pages slab
[  508.102251] 788 pages pagetables
[  508.102251] Out of memory: kill process 4035 (run-mozilla.sh) score 32194 or a child
[  508.102251] Killed process 4041 (firefox-bin)

[-- Attachment #3: bug1 --]
[-- Type: application/octet-stream, Size: 124817 bytes --]

974] net_namespace: 660 bytes
[    0.165974] Booting paravirtualized kernel on bare hardware
[    0.166974] NET: Registered protocol family 16
[    0.166974] ACPI: bus type pci registered
[    0.166974] PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
[    0.166974] PCI: Not using MMCONFIG.
[    0.166974] PCI: PCI BIOS revision 3.00 entry at 0xf0031, last bus=5
[    0.166974] PCI: Using configuration type 1 for base access
[    0.166974] Setting up standard PCI resources
[    0.174648] ACPI: EC: Look up EC in DSDT
[    0.187140] ACPI: Interpreter enabled
[    0.187140] ACPI: (supports S0 S1 S3 S5)
[    0.187140] ACPI: Using IOAPIC for interrupt routing
[    0.187202] PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
[    0.190112] PCI: MCFG area at e0000000 reserved in ACPI motherboard resources
[    0.190115] PCI: Using MMCONFIG for extended config space
[    0.201138] ACPI: PCI Root Bridge [PCI0] (0000:00)
[    0.201783] pci 0000:00:1f.0: quirk: region 0800-087f claimed by ICH6 ACPI/GPIO/TCO
[    0.201787] pci 0000:00:1f.0: quirk: region 0480-04bf claimed by ICH6 GPIO
[    0.202836] PCI: Transparent bridge - 0000:00:1e.0
[    0.202866] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
[    0.203725] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P2._PRT]
[    0.203861] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P1._PRT]
[    0.203937] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P4._PRT]
[    0.204081] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P8._PRT]
[    0.204223] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P9._PRT]
[    0.222934] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 *11 12 14 15)
[    0.222934] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *10 11 12 14 15)
[    0.222934] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 7 10 11 12 14 15)
[    0.223072] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 10 11 12 14 *15)
[    0.223208] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled.
[    0.223344] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 11 12 *14 15)
[    0.223479] ACPI: PCI Interrupt Link [LNKG] (IRQs *3 4 5 6 7 10 11 12 14 15)
[    0.223884] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *7 10 11 12 14 15)
[    0.224203] ACPI Warning (tbutils-0217): Incorrect checksum in table [OEMB] - A2, should be 99 [20080321]
[    0.224203] Linux Plug and Play Support v0.97 (c) Adam Belay
[    0.224203] pnp: PnP ACPI init
[    0.224203] ACPI: bus type pnp registered
[    0.228571] pnp: PnP ACPI: found 16 devices
[    0.228573] ACPI: ACPI bus type pnp unregistered
[    0.229203] usbcore: registered new interface driver usbfs
[    0.229203] usbcore: registered new interface driver hub
[    0.229203] usbcore: registered new device driver usb
[    0.229203] PCI: Using ACPI for IRQ routing
[    0.231074] NetLabel: Initializing
[    0.231077] NetLabel:  domain hash size = 128
[    0.231078] NetLabel:  protocols = UNLABELED CIPSOv4
[    0.231098] NetLabel:  unlabeled traffic allowed by default
[    0.231104] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.231109] hpet0: 3 64-bit timers, 14318180 Hz
[    0.233118] system 00:01: iomem range 0xfed14000-0xfed19fff has been reserved
[    0.233130] system 00:08: ioport range 0x290-0x297 has been reserved
[    0.233138] system 00:09: ioport range 0x4d0-0x4d1 has been reserved
[    0.233141] system 00:09: ioport range 0x800-0x87f has been reserved
[    0.233145] system 00:09: ioport range 0x480-0x4bf has been reserved
[    0.233149] system 00:09: iomem range 0xffafe000-0xffb0cbff could not be reserved
[    0.233153] system 00:09: iomem range 0xffb00000-0xffbfffff could not be reserved
[    0.233157] system 00:09: iomem range 0xfed1c000-0xfed1ffff has been reserved
[    0.233161] system 00:09: iomem range 0xfed20000-0xfed8ffff has been reserved
[    0.233165] system 00:09: iomem range 0xfff00000-0xfffffffe could not be reserved
[    0.233168] system 00:09: iomem range 0xfebfe000-0xfebfec00 has been reserved
[    0.233177] system 00:0b: iomem range 0xfec00000-0xfec00fff has been reserved
[    0.233181] system 00:0b: iomem range 0xfee00000-0xfee00fff could not be reserved
[    0.233190] system 00:0e: iomem range 0xe0000000-0xefffffff has been reserved
[    0.233198] system 00:0f: iomem range 0x0-0x9ffff could not be reserved
[    0.233202] system 00:0f: iomem range 0xc0000-0xcffff could not be reserved
[    0.233206] system 00:0f: iomem range 0xe0000-0xfffff could not be reserved
[    0.233210] system 00:0f: iomem range 0x100000-0xbbffffff could not be reserved
[    0.264503] PCI: Bridge: 0000:00:01.0
[    0.264506]   IO window: 9000-9fff
[    0.264509]   MEM window: 0xf8700000-0xfe7fffff
[    0.264512]   PREFETCH window: 0x00000000bfe00000-0x00000000dfdfffff
[    0.264515] PCI: Bridge: 0000:00:1c.0
[    0.264517]   IO window: disabled.
[    0.264520]   MEM window: disabled.
[    0.264523]   PREFETCH window: 0x00000000dfe00000-0x00000000dfefffff
[    0.264524] PCI: Bridge: 0000:00:1c.4
[    0.264524]   IO window: b000-bfff
[    0.264524]   MEM window: 0xfe900000-0xfe9fffff
[    0.264524]   PREFETCH window: disabled.
[    0.264524] PCI: Bridge: 0000:00:1c.5
[    0.264524]   IO window: a000-afff
[    0.264524]   MEM window: 0xfe800000-0xfe8fffff
[    0.264524]   PREFETCH window: disabled.
[    0.264524] PCI: Bridge: 0000:00:1e.0
[    0.264524]   IO window: disabled.
[    0.264524]   MEM window: 0xfea00000-0xfeafffff
[    0.264524]   PREFETCH window: disabled.
[    0.264524] ACPI: PCI Interrupt 0000:00:01.0[A] -> GSI 16 (level, low) -> IRQ 16
[    0.264524] PCI: Setting latency timer of device 0000:00:01.0 to 64
[    0.264524] ACPI: PCI Interrupt 0000:00:1c.0[A] -> GSI 16 (level, low) -> IRQ 16
[    0.264524] PCI: Setting latency timer of device 0000:00:1c.0 to 64
[    0.264524] ACPI: PCI Interrupt 0000:00:1c.4[A] -> GSI 16 (level, low) -> IRQ 16
[    0.264524] PCI: Setting latency timer of device 0000:00:1c.4 to 64
[    0.264524] ACPI: PCI Interrupt 0000:00:1c.5[B] -> GSI 17 (level, low) -> IRQ 17
[    0.264524] PCI: Setting latency timer of device 0000:00:1c.5 to 64
[    0.264524] PCI: Setting latency timer of device 0000:00:1e.0 to 64
[    0.264524] NET: Registered protocol family 2
[    0.267699] IP route cache hash table entries: 32768 (order: 5, 131072 bytes)
[    0.267973] TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.268573] TCP bind hash table entries: 65536 (order: 7, 524288 bytes)
[    0.268812] TCP: Hash tables configured (established 131072 bind 65536)
[    0.268815] TCP reno registered
[    0.269845] NET: Registered protocol family 1
[    0.270000] checking if image is initramfs... it is
[    0.427473] debug: unmapping init memory f7dc2000..f7ff0000
[    0.427871] apm: BIOS version 1.2 Flags 0x03 (Driver version 1.16ac)
[    0.427871] apm: disabled - APM is not SMP safe.
[    0.427954] audit: initializing netlink socket (disabled)
[    0.427972] type=2000 audit(1224831837.425:1): initialized
[    0.434613] highmem bounce pool size: 64 pages
[    0.434613] Total HugeTLB memory allocated, 0
[    0.436623] VFS: Disk quotas dquot_6.5.1
[    0.437613] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[    0.437614] msgmni has been set to 1728
[    0.437614] SELinux:  Registering netfilter hooks
[    0.437614] io scheduler noop registered
[    0.437614] io scheduler anticipatory registered
[    0.437614] io scheduler deadline registered
[    0.437614] io scheduler cfq registered (default)
[    0.437614] pci 0000:01:00.0: Boot video device
[    0.437614] PCI: Setting latency timer of device 0000:00:01.0 to 64
[    0.437622] assign_interrupt_mode Found MSI capability
[    0.437645] Allocate Port Service[0000:00:01.0:pcie00]
[    0.438613] Allocate Port Service[0000:00:01.0:pcie03]
[    0.438613] PCI: Setting latency timer of device 0000:00:1c.0 to 64
[    0.438613] assign_interrupt_mode Found MSI capability
[    0.438613] Allocate Port Service[0000:00:1c.0:pcie00]
[    0.438613] Allocate Port Service[0000:00:1c.0:pcie02]
[    0.438613] Allocate Port Service[0000:00:1c.0:pcie03]
[    0.438613] PCI: Setting latency timer of device 0000:00:1c.4 to 64
[    0.438613] assign_interrupt_mode Found MSI capability
[    0.438613] Allocate Port Service[0000:00:1c.4:pcie00]
[    0.438613] Allocate Port Service[0000:00:1c.4:pcie02]
[    0.438614] Allocate Port Service[0000:00:1c.4:pcie03]
[    0.438614] PCI: Setting latency timer of device 0000:00:1c.5 to 64
[    0.438614] assign_interrupt_mode Found MSI capability
[    0.438614] Allocate Port Service[0000:00:1c.5:pcie00]
[    0.438614] Allocate Port Service[0000:00:1c.5:pcie02]
[    0.438614] Allocate Port Service[0000:00:1c.5:pcie03]
[    0.438614] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    0.439613] ACPI: ACPI0007:00 is registered as cooling_device0
[    0.440613] ACPI: ACPI0007:01 is registered as cooling_device1
[    0.443613] isapnp: Scanning for PnP cards...
[    0.504206] Switched to high resolution mode on CPU 1
[    0.504661] Switched to high resolution mode on CPU 0
[    0.799364] isapnp: No Plug & Play device found
[    0.801979] hpet_resources: 0xfed00000 is busy
[    0.802080] Non-volatile memory driver v1.2
[    0.802117] Linux agpgart interface v0.103
[    0.803405] Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
[    1.047456] serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    1.048406] 00:06: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    1.095379] brd: module loaded
[    1.095379] input: Macintosh mouse button emulation as /class/input/input0
[    1.095379] PNP: PS/2 Controller [PNP0303:PS2K,PNP0f03:PS2M] at 0x60,0x64 irq 1,12
[    1.098390] serio: i8042 KBD port at 0x60,0x64 irq 1
[    1.098396] serio: i8042 AUX port at 0x60,0x64 irq 12
[    1.099405] mice: PS/2 mouse device common for all mice
[    1.127394] input: AT Translated Set 2 keyboard as /class/input/input1
[    1.133637] cpuidle: using governor ladder
[    1.133637] cpuidle: using governor menu
[    1.133637] usbcore: registered new interface driver hiddev
[    1.133637] usbcore: registered new interface driver usbhid
[    1.133637] usbhid: v2.6:USB HID core driver
[    1.133637] TCP cubic registered
[    1.133637] Initializing XFRM netlink socket
[    1.133637] NET: Registered protocol family 17
[    1.134405] Starting balanced_irq
[    1.134405] Using IPI No-Shortcut mode
[    1.134405] registered taskstats version 1
[    1.134405] kmemtrace: fully up.
[    1.134570] debug: unmapping init memory c0495000..c04db000
[    1.134624] Write protecting the kernel text: 2340k
[    1.134639] Write protecting the kernel read-only data: 1084k
[    1.411758] USB Universal Host Controller Interface driver v3.0
[    1.411784] ACPI: PCI Interrupt 0000:00:1a.0[A] -> GSI 16 (level, low) -> IRQ 16
[    1.411792] PCI: Setting latency timer of device 0000:00:1a.0 to 64
[    1.411795] uhci_hcd 0000:00:1a.0: UHCI Host Controller
[    1.412758] uhci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    1.412758] uhci_hcd 0000:00:1a.0: irq 16, io base 0x0000dc00
[    1.412758] usb usb1: configuration #1 chosen from 1 choice
[    1.412758] hub 1-0:1.0: USB hub found
[    1.412758] hub 1-0:1.0: 2 ports detected
[    1.513632] ACPI: PCI Interrupt 0000:00:1a.1[B] -> GSI 17 (level, low) -> IRQ 17
[    1.513640] PCI: Setting latency timer of device 0000:00:1a.1 to 64
[    1.513644] uhci_hcd 0000:00:1a.1: UHCI Host Controller
[    1.513724] uhci_hcd 0000:00:1a.1: new USB bus registered, assigned bus number 2
[    1.513747] uhci_hcd 0000:00:1a.1: irq 17, io base 0x0000e000
[    1.513801] usb usb2: configuration #1 chosen from 1 choice
[    1.513801] hub 2-0:1.0: USB hub found
[    1.513801] hub 2-0:1.0: 2 ports detected
[    1.614265] ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 23 (level, low) -> IRQ 23
[    1.614273] PCI: Setting latency timer of device 0000:00:1d.0 to 64
[    1.614277] uhci_hcd 0000:00:1d.0: UHCI Host Controller
[    1.614373] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 3
[    1.614396] uhci_hcd 0000:00:1d.0: irq 23, io base 0x0000d480
[    1.614484] usb usb3: configuration #1 chosen from 1 choice
[    1.614532] hub 3-0:1.0: USB hub found
[    1.614539] hub 3-0:1.0: 2 ports detected
[    1.762076] ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 19
[    1.762084] PCI: Setting latency timer of device 0000:00:1d.1 to 64
[    1.762088] uhci_hcd 0000:00:1d.1: UHCI Host Controller
[    1.762178] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 4
[    1.762201] uhci_hcd 0000:00:1d.1: irq 19, io base 0x0000d800
[    1.762291] usb usb4: configuration #1 chosen from 1 choice
[    1.762337] hub 4-0:1.0: USB hub found
[    1.762344] hub 4-0:1.0: 2 ports detected
[    1.835776] input: ImPS/2 Generic Wheel Mouse as /class/input/input2
[    1.863168] ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 18
[    1.863176] PCI: Setting latency timer of device 0000:00:1d.2 to 64
[    1.863180] uhci_hcd 0000:00:1d.2: UHCI Host Controller
[    1.863281] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 5
[    1.863305] uhci_hcd 0000:00:1d.2: irq 18, io base 0x0000d880
[    1.863397] usb usb5: configuration #1 chosen from 1 choice
[    1.863443] hub 5-0:1.0: USB hub found
[    1.863450] hub 5-0:1.0: 2 ports detected
[    1.972783] insmod used greatest stack depth: 2192 bytes left
[    1.974337] ohci_hcd: 2006 August 04 USB 1.1 'Open' Host Controller (OHCI) Driver
[    1.975778] ACPI: PCI Interrupt 0000:00:1a.7[C] -> GSI 18 (level, low) -> IRQ 18
[    1.975778] PCI: Setting latency timer of device 0000:00:1a.7 to 64
[    1.975778] ehci_hcd 0000:00:1a.7: EHCI Host Controller
[    1.975778] ehci_hcd 0000:00:1a.7: new USB bus registered, assigned bus number 6
[    1.979679] ehci_hcd 0000:00:1a.7: debug port 1
[    1.979684] PCI: cache line size of 32 is not supported by device 0000:00:1a.7
[    1.979689] ehci_hcd 0000:00:1a.7: irq 18, io mem 0xfebffc00
[    1.988935] ehci_hcd 0000:00:1a.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
[    1.989778] usb usb6: configuration #1 chosen from 1 choice
[    1.989778] hub 6-0:1.0: USB hub found
[    1.989778] hub 6-0:1.0: 4 ports detected
[    2.090778] ACPI: PCI Interrupt 0000:00:1d.7[A] -> GSI 23 (level, low) -> IRQ 23
[    2.090778] PCI: Setting latency timer of device 0000:00:1d.7 to 64
[    2.090778] ehci_hcd 0000:00:1d.7: EHCI Host Controller
[    2.090778] ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 7
[    2.094852] ehci_hcd 0000:00:1d.7: debug port 1
[    2.094857] PCI: cache line size of 32 is not supported by device 0000:00:1d.7
[    2.094861] ehci_hcd 0000:00:1d.7: irq 23, io mem 0xfebff800
[    2.104579] ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
[    2.104959] usb usb7: configuration #1 chosen from 1 choice
[    2.104959] hub 7-0:1.0: USB hub found
[    2.104959] hub 7-0:1.0: 6 ports detected
[    2.234555] SCSI subsystem initialized
[    2.235555] Driver 'sd' needs updating - please use bus_type methods
[    2.237556] No dock devices found.
[    2.244554] libata version 3.00 loaded.
[    2.246554] ata_piix 0000:00:1f.2: version 2.12
[    2.246554] ACPI: PCI Interrupt 0000:00:1f.2[B] -> GSI 19 (level, low) -> IRQ 19
[    2.246554] ata_piix 0000:00:1f.2: MAP [ P0 P2 P1 P3 ]
[    2.246554] PCI: Setting latency timer of device 0000:00:1f.2 to 64
[    2.246554] scsi0 : ata_piix
[    2.246554] scsi1 : ata_piix
[    2.249188] ata1: SATA max UDMA/133 cmd 0xec00 ctl 0xe880 bmdma 0xe400 irq 19
[    2.249193] ata2: SATA max UDMA/133 cmd 0xe800 ctl 0xe480 bmdma 0xe408 irq 19
[    2.564301] ata1: SATA link down (SStatus 0 SControl 300)
[    3.019667] ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[    3.069222] ata2.00: ATA-7: ST3500630AS, 3.AAK, max UDMA/133
[    3.069222] ata2.00: 976773168 sectors, multi 16: LBA48 NCQ (depth 0/32)
[    3.144251] ata2.00: configured for UDMA/133
[    3.188140] scsi 1:0:0:0: Direct-Access     ATA      ST3500630AS      3.AA PQ: 0 ANSI: 5
[    3.188140] sd 1:0:0:0: [sda] 976773168 512-byte hardware sectors (500108 MB)
[    3.188140] sd 1:0:0:0: [sda] Write Protect is off
[    3.188140] sd 1:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    3.188140] sd 1:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    3.188140] sd 1:0:0:0: [sda] 976773168 512-byte hardware sectors (500108 MB)
[    3.188140] sd 1:0:0:0: [sda] Write Protect is off
[    3.188140] sd 1:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    3.188140] sd 1:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    3.188656]  sda: sda1 sda2 sda3 sda4 < sda5 sda6 sda7 sda8 sda9 >
[    3.226921] sd 1:0:0:0: [sda] Attached SCSI disk
[    3.226921] ACPI: PCI Interrupt 0000:00:1f.5[B] -> GSI 19 (level, low) -> IRQ 19
[    3.226921] ata_piix 0000:00:1f.5: MAP [ P0 -- P1 -- ]
[    3.226921] PCI: Setting latency timer of device 0000:00:1f.5 to 64
[    3.226921] scsi2 : ata_piix
[    3.287656] scsi3 : ata_piix
[    3.289563] ata3: SATA max UDMA/133 cmd 0xd400 ctl 0xd080 bmdma 0xc880 irq 19
[    3.289567] ata4: SATA max UDMA/133 cmd 0xd000 ctl 0xcc00 bmdma 0xc888 irq 19
[    3.745605] ata3: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[    3.789655] ata3.00: ATA-7: ST3500630AS, 3.AAK, max UDMA/133
[    3.789655] ata3.00: 976773168 sectors, multi 16: LBA48 NCQ (depth 0/32)
[    3.864655] ata3.00: configured for UDMA/133
[    4.180240] ata4: SATA link down (SStatus 0 SControl 300)
[    4.180209] scsi 2:0:0:0: Direct-Access     ATA      ST3500630AS      3.AA PQ: 0 ANSI: 5
[    4.180209] sd 2:0:0:0: [sdb] 976773168 512-byte hardware sectors (500108 MB)
[    4.180209] sd 2:0:0:0: [sdb] Write Protect is off
[    4.180209] sd 2:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[    4.180209] sd 2:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    4.180209] sd 2:0:0:0: [sdb] 976773168 512-byte hardware sectors (500108 MB)
[    4.213852] sd 2:0:0:0: [sdb] Write Protect is off
[    4.213854] sd 2:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[    4.213884] sd 2:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    4.213888]  sdb: sdb1 sdb2 sdb3 sdb4 < sdb5 sdb6 sdb7 >
[    4.246116] sd 2:0:0:0: [sdb] Attached SCSI disk
[    4.246116] insmod used greatest stack depth: 1148 bytes left
[    4.260281] ahci 0000:03:00.0: version 3.0
[    4.260281] ACPI: PCI Interrupt 0000:03:00.0[A] -> GSI 16 (level, low) -> IRQ 16
[    5.260311] ahci 0000:03:00.0: AHCI 0001.0000 32 slots 2 ports 3 Gbps 0x3 impl SATA mode
[    5.260315] ahci 0000:03:00.0: flags: 64bit ncq pm led clo pmp pio slum part 
[    5.260321] PCI: Setting latency timer of device 0000:03:00.0 to 64
[    5.261356] scsi4 : ahci
[    5.261356] scsi5 : ahci
[    5.261356] ata5: SATA max UDMA/133 abar m8192@0xfe9fe000 port 0xfe9fe100 irq 16
[    5.261356] ata6: SATA max UDMA/133 abar m8192@0xfe9fe000 port 0xfe9fe180 irq 16
[    5.566358] ata5: SATA link down (SStatus 0 SControl 300)
[    5.871677] ata6: SATA link down (SStatus 0 SControl 300)
[    6.026048] device-mapper: ioctl: 4.13.0-ioctl (2007-10-18) initialised: dm-devel@redhat.com
[    6.690848] kjournald starting.  Commit interval 5 seconds
[    6.690848] EXT3-fs: mounted filesystem with ordered data mode.
[    9.770960] input: PC Speaker as /class/input/input3
[    9.857281] iTCO_vendor_support: vendor-support=0
[    9.903118] i801_smbus 0000:00:1f.3: enabling device (0001 -> 0003)
[    9.903124] ACPI: PCI Interrupt 0000:00:1f.3[C] -> GSI 18 (level, low) -> IRQ 18
[    9.927558] ACPI: PCI Interrupt 0000:05:03.0[A] -> GSI 21 (level, low) -> IRQ 21
[    9.978713] ohci1394: fw-host0: OHCI-1394 1.1 (PCI): IRQ=[21]  MMIO=[feaff800-feafffff]  Max Packet=[2048]  IR/IT contexts=[4/8]
[   10.010710] ACPI: PCI Interrupt 0000:02:00.0[A] -> GSI 17 (level, low) -> IRQ 17
[   10.010722] PCI: Setting latency timer of device 0000:02:00.0 to 64
[   10.010747] sky2 0000:02:00.0: v1.21 addr 0xfe8fc000 irq 17 Yukon-EC Ultra (0xb4) rev 2
[   10.011112] sky2 eth0: addr 00:18:f3:b4:7e:ff
[   10.041175] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.03 (30-Apr-2008)
[   10.041269] iTCO_wdt: Found a ICH8 or ICH8R TCO device (Version=2, TCOBASE=0x0860)
[   10.041344] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0)
[   10.044561] input: Power Button (FF) as /class/input/input4
[   10.061422] ACPI: Power Button (FF) [PWRF]
[   10.061515] input: Power Button (CM) as /class/input/input5
[   10.077154] ACPI: Power Button (CM) [PWRB]
[   10.507084] Floppy drive(s): fd0 is 1.44M
[   10.522543] FDC 0 is a post-1991 82077
[   10.593405] ACPI: PCI Interrupt 0000:00:1b.0[A] -> GSI 22 (level, low) -> IRQ 22
[   10.593428] PCI: Setting latency timer of device 0000:00:1b.0 to 64
[   10.662802] sd 1:0:0:0: Attached scsi generic sg0 type 0
[   10.662827] sd 2:0:0:0: Attached scsi generic sg1 type 0
[   11.249131] ieee1394: Host added: ID:BUS[0-00:1023]  GUID[0011d80000f5cea6]
[   11.383670] usbcore: registered new interface driver snd-usb-audio
[   12.146359] lp: driver loaded but no devices found
[   12.190350] sonypi: Sony Programmable I/O Controller Driver v1.26.
[   13.620800] NET: Registered protocol family 10
[   13.621385] lo: Disabled Privacy Extensions
[   19.530640] md: Autodetecting RAID arrays.
[   19.530643] md: Scanned 0 and added 0 devices.
[   19.530645] md: autorun ...
[   19.530646] md: ... autorun DONE.
[   19.660443] device-mapper: multipath: version 1.0.5 loaded
[  341.923010] EXT3 FS on sda5, internal journal
[  342.112922] kjournald starting.  Commit interval 5 seconds
[  342.112922] EXT3 FS on dm-0, internal journal
[  342.112922] EXT3-fs: mounted filesystem with ordered data mode.
[  342.145612] kjournald starting.  Commit interval 5 seconds
[  342.145612] EXT3 FS on sdb1, internal journal
[  342.145612] EXT3-fs: mounted filesystem with ordered data mode.
[  342.168713] kjournald starting.  Commit interval 5 seconds
[  342.168713] EXT3 FS on sdb2, internal journal
[  342.168713] EXT3-fs: mounted filesystem with ordered data mode.
[  342.191700] kjournald starting.  Commit interval 5 seconds
[  342.192675] EXT3 FS on sdb7, internal journal
[  342.192675] EXT3-fs: mounted filesystem with ordered data mode.
[  342.912378] Adding 4192924k swap on /dev/sda7.  Priority:-1 extents:1 across:4192924k
[  343.943767] warning: process `kudzu' used the deprecated sysctl system call with 1.23.
[  353.148947] sky2 eth0: enabling interface
[  353.152136] ADDRCONF(NETDEV_UP): eth0: link is not ready
[  354.890103] sky2 eth0: Link is up at 100 Mbps, full duplex, flow control both
[  354.890103] ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[  356.326177] RPC: Registered udp transport module.
[  356.326177] RPC: Registered tcp transport module.
[  356.879829] warning: `dbus-daemon' uses 32-bit capabilities (legacy support in use)
[  357.075458] Bluetooth: Core ver 2.11
[  357.075902] NET: Registered protocol family 31
[  357.075902] Bluetooth: HCI device and connection manager initialized
[  357.075902] Bluetooth: HCI socket layer initialized
[  357.228653] Bluetooth: L2CAP ver 2.9
[  357.228653] Bluetooth: L2CAP socket layer initialized
[  357.478689] Bluetooth: RFCOMM socket layer initialized
[  357.478689] Bluetooth: RFCOMM TTY layer initialized
[  357.478689] Bluetooth: RFCOMM ver 1.8
[  357.922488] Bluetooth: HIDP (Human Interface Emulation) ver 1.2
[  358.105641] ip6_tables: (C) 2000-2006 Netfilter Core Team
[  358.310515] ip_tables: (C) 2000-2006 Netfilter Core Team
[  358.429485] nf_conntrack version 0.5.0 (16384 buckets, 65536 max)
[  365.948863] eth0: no IPv6 routers present
[  406.636127] loop: module loaded
[  508.068351] gnome-terminal invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  508.068359] Pid: 4003, comm: gnome-terminal Not tainted 2.6.26 #1
[  508.068374]  [<c015b64f>] oom_kill_process+0x42/0x183
[  508.068387]  [<c015ba76>] out_of_memory+0x157/0x188
[  508.068398]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  508.068410]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  508.068415]  [<c015da12>] __get_free_pages+0x12/0x21
[  508.068420]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  508.068425]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  508.068435]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  508.068442]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  508.068453]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  508.068461]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  508.068482]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  508.068493]  [<c0179485>] do_sync_write+0xab/0xe9
[  508.068498]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  508.068506]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  508.068514]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  508.068520]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  508.068527]  [<c0179be3>] vfs_write+0x9d/0x133
[  508.068533]  [<c017a1d8>] sys_write+0x3b/0x60
[  508.068538]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  508.068547]  =======================
[  508.068549] Mem-info:
[  508.068550] DMA per-cpu:
[  508.068552] CPU    0: hi:    0, btch:   1 usd:   0
[  508.068554] CPU    1: hi:    0, btch:   1 usd:   0
[  508.068556] Normal per-cpu:
[  508.068558] CPU    0: hi:  186, btch:  31 usd:   0
[  508.068560] CPU    1: hi:  186, btch:  31 usd:   0
[  508.068562] HighMem per-cpu:
[  508.068564] CPU    0: hi:  186, btch:  31 usd:   0
[  508.068566] CPU    1: hi:  186, btch:  31 usd:   0
[  508.068569] Active:51860 inactive:38012 dirty:4 writeback:175 unstable:0
[  508.068570]  free:504012 slab:2874 mapped:15100 pagetables:788 bounce:0
[  508.068573] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  508.068575] lowmem_reserve[]: 0 873 2968 2968
[  508.068580] Normal free:216020kB min:3744kB low:4680kB high:5616kB active:660kB inactive:1192kB present:894080kB pages_scanned:0 all_unreclaimable? no
[  508.068583] lowmem_reserve[]: 0 0 16760 16760
[  508.068588] HighMem free:1796472kB min:512kB low:2760kB high:5008kB active:206780kB inactive:150856kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  508.068591] lowmem_reserve[]: 0 0 0 0
[  508.068594] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  508.068604] Normal: 52411*4kB 685*8kB 9*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 216068kB
[  508.068614] HighMem: 2827*4kB 1751*8kB 1178*16kB 733*32kB 381*64kB 155*128kB 87*256kB 59*512kB 48*1024kB 17*2048kB 378*4096kB = 1796580kB
[  508.068624] 50820 total pagecache pages
[  508.068626] Swap cache: add 0, delete 0, find 0/0
[  508.068628] Free swap  = 4192924kB
[  508.068629] Total swap = 4192924kB
[  508.102251] 769936 pages of RAM
[  508.102251] 540560 pages of HIGHMEM
[  508.102251] 8147 reserved pages
[  508.102251] 71192 pages shared
[  508.102251] 0 pages swap cached
[  508.102251] 4 pages dirty
[  508.102251] 175 pages writeback
[  508.102251] 15100 pages mapped
[  508.102251] 2874 pages slab
[  508.102251] 788 pages pagetables
[  508.102251] Out of memory: kill process 4035 (run-mozilla.sh) score 32194 or a child
[  508.102251] Killed process 4041 (firefox-bin)
[  613.522965] opera invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  613.522972] Pid: 4164, comm: opera Not tainted 2.6.26 #1
[  613.522996]  [<c015b64f>] oom_kill_process+0x42/0x183
[  613.523009]  [<c015ba76>] out_of_memory+0x157/0x188
[  613.523017]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  613.523026]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  613.523030]  [<c015da12>] __get_free_pages+0x12/0x21
[  613.523034]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  613.523038]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  613.523048]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  613.523054]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  613.523062]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  613.523074]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  613.523086]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[  613.523091]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  613.523099]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  613.523182]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  613.523189]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  613.523196]  [<c01799fc>] do_readv_writev+0x85/0x140
[  613.523200]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[  613.523206]  [<c0122f35>] ? hrtick_set+0xcf/0xd7
[  613.523213]  [<c0343f96>] ? schedule+0x6c2/0x6f4
[  613.523220]  [<c0179af0>] vfs_writev+0x39/0x49
[  613.523225]  [<c0179f44>] sys_writev+0x3b/0x8e
[  613.523231]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  613.523237]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[  613.523245]  =======================
[  613.523247] Mem-info:
[  613.523248] DMA per-cpu:
[  613.523250] CPU    0: hi:    0, btch:   1 usd:   0
[  613.523252] CPU    1: hi:    0, btch:   1 usd:   0
[  613.523253] Normal per-cpu:
[  613.523255] CPU    0: hi:  186, btch:  31 usd:   0
[  613.523257] CPU    1: hi:  186, btch:  31 usd:   0
[  613.523259] HighMem per-cpu:
[  613.523260] CPU    0: hi:  186, btch:  31 usd:   0
[  613.523262] CPU    1: hi:  186, btch:  31 usd:   0
[  613.523265] Active:42235 inactive:38431 dirty:10 writeback:25 unstable:0
[  613.523266]  free:512654 slab:2759 mapped:15195 pagetables:747 bounce:0
[  613.523270] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  613.523272] lowmem_reserve[]: 0 873 2968 2968
[  613.523277] Normal free:214300kB min:3744kB low:4680kB high:5616kB active:464kB inactive:684kB present:894080kB pages_scanned:0 all_unreclaimable? no
[  613.523279] lowmem_reserve[]: 0 0 16760 16760
[  613.523965] HighMem free:1832760kB min:512kB low:2760kB high:5008kB active:168476kB inactive:153040kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  613.523967] lowmem_reserve[]: 0 0 0 0
[  613.523971] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  613.523979] Normal: 52365*4kB 469*8kB 20*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 214332kB
[  613.523987] HighMem: 18*4kB 373*8kB 671*16kB 1090*32kB 538*64kB 210*128kB 122*256kB 74*512kB 59*1024kB 22*2048kB 378*4096kB = 1832864kB
[  613.523996] 51403 total pagecache pages
[  613.523998] Swap cache: add 0, delete 0, find 0/0
[  613.524000] Free swap  = 4192924kB
[  613.524001] Total swap = 4192924kB
[  613.533067] 769936 pages of RAM
[  613.533069] 540560 pages of HIGHMEM
[  613.533070] 8147 reserved pages
[  613.533072] 65661 pages shared
[  613.533073] 0 pages swap cached
[  613.533074] 10 pages dirty
[  613.533076] 0 pages writeback
[  613.533077] 15195 pages mapped
[  613.533078] 2759 pages slab
[  613.533079] 747 pages pagetables
[  613.533082] Out of memory: kill process 3911 (nautilus) score 1995 or a child
[  613.533102] Killed process 3911 (nautilus)
[  614.628438] opera invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  614.628438] Pid: 4164, comm: opera Not tainted 2.6.26 #1
[  614.628438]  [<c015b64f>] oom_kill_process+0x42/0x183
[  614.628438]  [<c015ba76>] out_of_memory+0x157/0x188
[  614.628438]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  614.628438]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  614.628438]  [<c015da12>] __get_free_pages+0x12/0x21
[  614.628438]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  614.628438]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  614.628438]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  614.628438]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  614.628438]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  614.628438]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  614.628438]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  614.628438]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[  614.628438]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  614.628438]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  614.628438]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  614.628438]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  614.628438]  [<c01799fc>] do_readv_writev+0x85/0x140
[  614.628438]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[  614.628438]  [<c0140adc>] ? tick_program_event+0x31/0x55
[  614.628438]  [<c0179af0>] vfs_writev+0x39/0x49
[  614.628438]  [<c0179f44>] sys_writev+0x3b/0x8e
[  614.628438]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  614.628438]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[  614.628438]  =======================
[  614.628438] Mem-info:
[  614.628438] DMA per-cpu:
[  614.628438] CPU    0: hi:    0, btch:   1 usd:   0
[  614.628438] CPU    1: hi:    0, btch:   1 usd:   0
[  614.628438] Normal per-cpu:
[  614.628438] CPU    0: hi:  186, btch:  31 usd:   0
[  614.628438] CPU    1: hi:  186, btch:  31 usd:   0
[  614.628438] HighMem per-cpu:
[  614.628438] CPU    0: hi:  186, btch:  31 usd:   0
[  614.628438] CPU    1: hi:  186, btch:  31 usd:   0
[  614.628438] Active:40868 inactive:37500 dirty:0 writeback:75 unstable:0
[  614.628438]  free:514827 slab:2697 mapped:14513 pagetables:719 bounce:0
[  614.628438] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? yes
[  614.628438] lowmem_reserve[]: 0 873 2968 2968
[  614.628438] Normal free:214056kB min:3744kB low:4680kB high:5616kB active:240kB inactive:516kB present:894080kB pages_scanned:293 all_unreclaimable? no
[  614.628438] lowmem_reserve[]: 0 0 16760 16760
[  614.628438] HighMem free:1841696kB min:512kB low:2760kB high:5008kB active:163232kB inactive:149484kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  614.628438] lowmem_reserve[]: 0 0 0 0
[  614.628438] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  614.628438] Normal: 52417*4kB 441*8kB 8*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 214124kB
[  614.628438] HighMem: 285*4kB 556*8kB 748*16kB 1117*32kB 554*64kB 219*128kB 124*256kB 75*512kB 60*1024kB 22*2048kB 378*4096kB = 1841716kB
[  614.628438] 50271 total pagecache pages
[  614.628438] Swap cache: add 0, delete 0, find 0/0
[  614.628438] Free swap  = 4192924kB
[  614.628438] Total swap = 4192924kB
[  614.636426] 769936 pages of RAM
[  614.636428] 540560 pages of HIGHMEM
[  614.636429] 8147 reserved pages
[  614.636431] 58412 pages shared
[  614.636432] 0 pages swap cached
[  614.636433] 0 pages dirty
[  614.636434] 75 pages writeback
[  614.636436] 14513 pages mapped
[  614.636437] 2697 pages slab
[  614.636438] 719 pages pagetables
[  614.636441] Out of memory: kill process 3460 (hald) score 1943 or a child
[  614.636459] Killed process 3461 (hald-runner)
[  614.844871] opera invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  614.844871] Pid: 4164, comm: opera Not tainted 2.6.26 #1
[  614.844871]  [<c015b64f>] oom_kill_process+0x42/0x183
[  614.844871]  [<c015ba76>] out_of_memory+0x157/0x188
[  614.844871]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  614.844871]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  614.844871]  [<c015da12>] __get_free_pages+0x12/0x21
[  614.844871]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  614.844871]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  614.844871]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  614.844871]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  614.844871]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  614.844871]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  614.844871]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  614.844871]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[  614.844871]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  614.844871]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  614.844871]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  614.844871]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  614.844872]  [<c01799fc>] do_readv_writev+0x85/0x140
[  614.844872]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[  614.844872]  [<c0140adc>] ? tick_program_event+0x31/0x55
[  614.844872]  [<c0179af0>] vfs_writev+0x39/0x49
[  614.844872]  [<c0179f44>] sys_writev+0x3b/0x8e
[  614.844872]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  614.844872]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[  614.844872]  =======================
[  614.844872] Mem-info:
[  614.844872] DMA per-cpu:
[  614.844872] CPU    0: hi:    0, btch:   1 usd:   0
[  614.844872] CPU    1: hi:    0, btch:   1 usd:   0
[  614.844872] Normal per-cpu:
[  614.844872] CPU    0: hi:  186, btch:  31 usd:   0
[  614.844872] CPU    1: hi:  186, btch:  31 usd:   0
[  614.844872] HighMem per-cpu:
[  614.844872] CPU    0: hi:  186, btch:  31 usd:   0
[  614.844872] CPU    1: hi:  186, btch:  31 usd:   0
[  614.844872] Active:40105 inactive:37580 dirty:0 writeback:50 unstable:0
[  614.844872]  free:515599 slab:2697 mapped:14476 pagetables:719 bounce:0
[  614.844872] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? yes
[  614.844872] lowmem_reserve[]: 0 873 2968 2968
[  614.844872] Normal free:214044kB min:3744kB low:4680kB high:5616kB active:148kB inactive:836kB present:894080kB pages_scanned:320 all_unreclaimable? no
[  614.844872] lowmem_reserve[]: 0 0 16760 16760
[  614.844872] HighMem free:1844796kB min:512kB low:2760kB high:5008kB active:160272kB inactive:149484kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  614.844872] lowmem_reserve[]: 0 0 0 0
[  614.844872] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  614.844872] Normal: 52420*4kB 442*8kB 5*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 214096kB
[  614.844872] HighMem: 384*4kB 591*8kB 762*16kB 1126*32kB 561*64kB 223*128kB 128*256kB 75*512kB 60*1024kB 22*2048kB 378*4096kB = 1844888kB
[  614.844872] 50271 total pagecache pages
[  614.844872] Swap cache: add 0, delete 0, find 0/0
[  614.844872] Free swap  = 4192924kB
[  614.844872] Total swap = 4192924kB
[  614.855222] 769936 pages of RAM
[  614.855224] 540560 pages of HIGHMEM
[  614.855226] 8147 reserved pages
[  614.855227] 58043 pages shared
[  614.855228] 0 pages swap cached
[  614.855229] 0 pages dirty
[  614.855231] 25 pages writeback
[  614.855232] 14476 pages mapped
[  614.855233] 2697 pages slab
[  614.855234] 719 pages pagetables
[  614.855236] Out of memory: kill process 4164 (opera) score 1503 or a child
[  614.855255] Killed process 4164 (opera)
[  615.082200] wnck-applet invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  615.082207] Pid: 3987, comm: wnck-applet Not tainted 2.6.26 #1
[  615.082222]  [<c015b64f>] oom_kill_process+0x42/0x183
[  615.082235]  [<c015ba76>] out_of_memory+0x157/0x188
[  615.082246]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  615.082257]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  615.082263]  [<c015da12>] __get_free_pages+0x12/0x21
[  615.082268]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  615.082273]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  615.082292]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  615.082298]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  615.082306]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  615.082312]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  615.082322]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  615.082333]  [<c0179485>] do_sync_write+0xab/0xe9
[  615.082338]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  615.082346]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  615.082354]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  615.082360]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  615.082367]  [<c0179be3>] vfs_write+0x9d/0x133
[  615.082372]  [<c017a1d8>] sys_write+0x3b/0x60
[  615.082378]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  615.082384]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[  615.082391]  =======================
[  615.082393] Mem-info:
[  615.082394] DMA per-cpu:
[  615.082396] CPU    0: hi:    0, btch:   1 usd:   0
[  615.082398] CPU    1: hi:    0, btch:   1 usd:   0
[  615.082400] Normal per-cpu:
[  615.082402] CPU    0: hi:  186, btch:  31 usd:   0
[  615.082404] CPU    1: hi:  186, btch:  31 usd:   0
[  615.082405] HighMem per-cpu:
[  615.082408] CPU    0: hi:  186, btch:  31 usd:   0
[  615.082410] CPU    1: hi:  186, btch:  31 usd:   0
[  615.082413] Active:35473 inactive:37435 dirty:0 writeback:26 unstable:0
[  615.082414]  free:520362 slab:2696 mapped:12137 pagetables:689 bounce:0
[  615.082417] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  615.082419] lowmem_reserve[]: 0 873 2968 2968
[  615.082424] Normal free:214120kB min:3744kB low:4680kB high:5616kB active:440kB inactive:316kB present:894080kB pages_scanned:0 all_unreclaimable? no
[  615.082427] lowmem_reserve[]: 0 0 16760 16760
[  615.082432] HighMem free:1863772kB min:512kB low:2760kB high:5008kB active:141452kB inactive:149424kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  615.082435] lowmem_reserve[]: 0 0 0 0
[  615.082438] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  615.082448] Normal: 52427*4kB 448*8kB 3*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 214140kB
[  615.082457] HighMem: 1229*4kB 1496*8kB 1214*16kB 1107*32kB 561*64kB 226*128kB 125*256kB 77*512kB 61*1024kB 22*2048kB 378*4096kB = 1863796kB
[  615.082467] 50261 total pagecache pages
[  615.082470] Swap cache: add 0, delete 0, find 0/0
[  615.082471] Free swap  = 4192924kB
[  615.082473] Total swap = 4192924kB
[  615.090997] 769936 pages of RAM
[  615.090997] 540560 pages of HIGHMEM
[  615.090997] 8147 reserved pages
[  615.090997] 54691 pages shared
[  615.090997] 0 pages swap cached
[  615.090997] 0 pages dirty
[  615.090997] 1 pages writeback
[  615.090997] 12137 pages mapped
[  615.090997] 2696 pages slab
[  615.090997] 689 pages pagetables
[  615.090997] Out of memory: kill process 3992 (trashapplet) score 1368 or a child
[  615.091019] Killed process 3992 (trashapplet)
[  615.132450] wnck-applet invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  615.132450] Pid: 3987, comm: wnck-applet Not tainted 2.6.26 #1
[  615.132450]  [<c015b64f>] oom_kill_process+0x42/0x183
[  615.132450]  [<c015ba76>] out_of_memory+0x157/0x188
[  615.132450]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  615.132450]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  615.132450]  [<c015da12>] __get_free_pages+0x12/0x21
[  615.132450]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  615.132450]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  615.132450]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  615.132450]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  615.132450]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  615.132450]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  615.132450]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  615.132450]  [<c0179485>] do_sync_write+0xab/0xe9
[  615.132450]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  615.132450]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  615.132450]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  615.132450]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  615.132450]  [<c0179be3>] vfs_write+0x9d/0x133
[  615.132450]  [<c017a1d8>] sys_write+0x3b/0x60
[  615.132450]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  615.132450]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[  615.132450]  =======================
[  615.132450] Mem-info:
[  615.132450] DMA per-cpu:
[  615.132450] CPU    0: hi:    0, btch:   1 usd:   0
[  615.132450] CPU    1: hi:    0, btch:   1 usd:   0
[  615.132450] Normal per-cpu:
[  615.132450] CPU    0: hi:  186, btch:  31 usd:   0
[  615.132450] CPU    1: hi:  186, btch:  31 usd:   0
[  615.132450] HighMem per-cpu:
[  615.132450] CPU    0: hi:  186, btch:  31 usd:   0
[  615.132450] CPU    1: hi:  186, btch:  31 usd:   0
[  615.132450] Active:35086 inactive:37466 dirty:0 writeback:1 unstable:0
[  615.132450]  free:520720 slab:2696 mapped:12100 pagetables:652 bounce:0
[  615.132450] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  615.132450] lowmem_reserve[]: 0 873 2968 2968
[  615.132450] Normal free:214052kB min:3744kB low:4680kB high:5616kB active:372kB inactive:412kB present:894080kB pages_scanned:208 all_unreclaimable? no
[  615.133482] lowmem_reserve[]: 0 0 16760 16760
[  615.133487] HighMem free:1865272kB min:512kB low:2760kB high:5008kB active:139972kB inactive:149424kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  615.133491] lowmem_reserve[]: 0 0 0 0
[  615.133494] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  615.133750] Normal: 52424*4kB 451*8kB 3*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 214152kB
[  615.133759] HighMem: 1294*4kB 1524*8kB 1230*16kB 1117*32kB 565*64kB 228*128kB 125*256kB 77*512kB 61*1024kB 22*2048kB 378*4096kB = 1865368kB
[  615.133770] 50261 total pagecache pages
[  615.133772] Swap cache: add 0, delete 0, find 0/0
[  615.133774] Free swap  = 4192924kB
[  615.133776] Total swap = 4192924kB
[  615.140999] 769936 pages of RAM
[  615.141000] 540560 pages of HIGHMEM
[  615.141002] 8147 reserved pages
[  615.141003] 49132 pages shared
[  615.141004] 0 pages swap cached
[  615.141006] 25 pages dirty
[  615.141007] 26 pages writeback
[  615.141008] 12100 pages mapped
[  615.141010] 2696 pages slab
[  615.141011] 652 pages pagetables
[  615.141013] Out of memory: kill process 3909 (gnome-panel) score 1325 or a child
[  615.141031] Killed process 3909 (gnome-panel)
[  615.449695] wnck-applet invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  615.449695] Pid: 3987, comm: wnck-applet Not tainted 2.6.26 #1
[  615.449695]  [<c015b64f>] oom_kill_process+0x42/0x183
[  615.449695]  [<c015ba76>] out_of_memory+0x157/0x188
[  615.449695]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  615.449695]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  615.449695]  [<c015da12>] __get_free_pages+0x12/0x21
[  615.449695]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  615.449695]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  615.449695]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  615.449695]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  615.449695]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  615.449695]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  615.449695]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  615.449695]  [<c0179485>] do_sync_write+0xab/0xe9
[  615.449695]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  615.449695]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  615.449695]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  615.449695]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  615.449695]  [<c0179be3>] vfs_write+0x9d/0x133
[  615.449695]  [<c017a1d8>] sys_write+0x3b/0x60
[  615.449695]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  615.449695]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[  615.449695]  =======================
[  615.449695] Mem-info:
[  615.449695] DMA per-cpu:
[  615.449695] CPU    0: hi:    0, btch:   1 usd:   0
[  615.449695] CPU    1: hi:    0, btch:   1 usd:   0
[  615.449695] Normal per-cpu:
[  615.449695] CPU    0: hi:  186, btch:  31 usd:   0
[  615.449695] CPU    1: hi:  186, btch:  31 usd:   0
[  615.449695] HighMem per-cpu:
[  615.449695] CPU    0: hi:  186, btch:  31 usd:   0
[  615.449695] CPU    1: hi:  186, btch:  31 usd:   0
[  615.449695] Active:33980 inactive:37470 dirty:25 writeback:51 unstable:0
[  615.449695]  free:521887 slab:2696 mapped:11582 pagetables:689 bounce:0
[  615.449695] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? yes
[  615.449695] lowmem_reserve[]: 0 873 2968 2968
[  615.449695] Normal free:214120kB min:3744kB low:4680kB high:5616kB active:240kB inactive:476kB present:894080kB pages_scanned:400 all_unreclaimable? no
[  615.449695] lowmem_reserve[]: 0 0 16760 16760
[  615.449695] HighMem free:1869872kB min:512kB low:2760kB high:5008kB active:135680kB inactive:149276kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  615.449695] lowmem_reserve[]: 0 0 0 0
[  615.449695] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  615.449695] Normal: 52429*4kB 452*8kB 2*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 214164kB
[  615.449695] HighMem: 1560*4kB 1583*8kB 1263*16kB 1142*32kB 579*64kB 232*128kB 126*256kB 77*512kB 61*1024kB 22*2048kB 378*4096kB = 1869896kB
[  615.449695] 50175 total pagecache pages
[  615.449695] Swap cache: add 0, delete 0, find 0/0
[  615.449695] Free swap  = 4192924kB
[  615.449695] Total swap = 4192924kB
[  615.458052] 769936 pages of RAM
[  615.458054] 540560 pages of HIGHMEM
[  615.458055] 8147 reserved pages
[  615.458057] 42888 pages shared
[  615.458058] 0 pages swap cached
[  615.458059] 25 pages dirty
[  615.458061] 26 pages writeback
[  615.458062] 11582 pages mapped
[  615.458063] 2696 pages slab
[  615.458064] 689 pages pagetables
[  615.458067] Out of memory: kill process 3987 (wnck-applet) score 1278 or a child
[  615.458211] Killed process 3987 (wnck-applet)
[  615.488065] metacity invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  615.488065] Pid: 3904, comm: metacity Not tainted 2.6.26 #1
[  615.488065]  [<c015b64f>] oom_kill_process+0x42/0x183
[  615.488065]  [<c015ba76>] out_of_memory+0x157/0x188
[  615.488065]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  615.488065]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  615.488065]  [<c015da12>] __get_free_pages+0x12/0x21
[  615.488065]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  615.488065]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  615.488065]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  615.488065]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  615.488065]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  615.488065]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  615.488065]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  615.488065]  [<c0179485>] do_sync_write+0xab/0xe9
[  615.488065]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  615.488065]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  615.488065]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  615.488065]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  615.488065]  [<c0179be3>] vfs_write+0x9d/0x133
[  615.488065]  [<c017a1d8>] sys_write+0x3b/0x60
[  615.488065]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  615.488065]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[  615.488065]  =======================
[  615.488065] Mem-info:
[  615.488065] DMA per-cpu:
[  615.488065] CPU    0: hi:    0, btch:   1 usd:   0
[  615.488065] CPU    1: hi:    0, btch:   1 usd:   0
[  615.488065] Normal per-cpu:
[  615.488065] CPU    0: hi:  186, btch:  31 usd:  30
[  615.488065] CPU    1: hi:  186, btch:  31 usd:   0
[  615.488065] HighMem per-cpu:
[  615.488065] CPU    0: hi:  186, btch:  31 usd:   0
[  615.488065] CPU    1: hi:  186, btch:  31 usd:   0
[  615.488065] Active:33054 inactive:37402 dirty:25 writeback:26 unstable:0
[  615.488065]  free:522887 slab:2696 mapped:11286 pagetables:652 bounce:0
[  615.488065] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  615.488065] lowmem_reserve[]: 0 873 2968 2968
[  615.488070] Normal free:214120kB min:3744kB low:4680kB high:5616kB active:384kB inactive:480kB present:894080kB pages_scanned:0 all_unreclaimable? no
[  615.488070] lowmem_reserve[]: 0 0 16760 16760
[  615.488070] HighMem free:1873872kB min:512kB low:2760kB high:5008kB active:131832kB inactive:149128kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  615.488070] lowmem_reserve[]: 0 0 0 0
[  615.488070] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  615.488070] Normal: 52399*4kB 453*8kB 3*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 214068kB
[  615.488070] HighMem: 1661*4kB 1618*8kB 1279*16kB 1159*32kB 591*64kB 238*128kB 128*256kB 78*512kB 61*1024kB 22*2048kB 378*4096kB = 1873940kB
[  615.488070] 50027 total pagecache pages
[  615.488070] Swap cache: add 0, delete 0, find 0/0
[  615.488070] Free swap  = 4192924kB
[  615.488070] Total swap = 4192924kB
[  615.495649] 769936 pages of RAM
[  615.495651] 540560 pages of HIGHMEM
[  615.495652] 8147 reserved pages
[  615.495654] 29381 pages shared
[  615.495655] 0 pages swap cached
[  615.495656] 25 pages dirty
[  615.495658] 1 pages writeback
[  615.495659] 7105 pages mapped
[  615.495660] 2696 pages slab
[  615.495661] 615 pages pagetables
[  615.495664] Out of memory: kill process 4003 (gnome-terminal) score 1253 or a child
[  615.495682] Killed process 4015 (gnome-pty-helpe)
[  622.241557] Xorg invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  622.241563] Pid: 3685, comm: Xorg Not tainted 2.6.26 #1
[  622.241576]  [<c015b64f>] oom_kill_process+0x42/0x183
[  622.241587]  [<c015ba76>] out_of_memory+0x157/0x188
[  622.241595]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  622.241604]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  622.241608]  [<c015da12>] __get_free_pages+0x12/0x21
[  622.241612]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  622.241616]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  622.241624]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  622.241630]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  622.241638]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  622.241645]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  622.241655]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  622.241667]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[  622.241671]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  622.241680]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  622.241689]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  622.241695]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  622.241702]  [<c01799fc>] do_readv_writev+0x85/0x140
[  622.241706]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[  622.241712]  [<c0122f35>] ? hrtick_set+0xcf/0xd7
[  622.241719]  [<c0343f96>] ? schedule+0x6c2/0x6f4
[  622.241726]  [<c0179af0>] vfs_writev+0x39/0x49
[  622.241731]  [<c0179f44>] sys_writev+0x3b/0x8e
[  622.241736]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  622.241743]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[  622.241750]  =======================
[  622.241752] Mem-info:
[  622.241753] DMA per-cpu:
[  622.241755] CPU    0: hi:    0, btch:   1 usd:   0
[  622.241757] CPU    1: hi:    0, btch:   1 usd:   0
[  622.241759] Normal per-cpu:
[  622.241761] CPU    0: hi:  186, btch:  31 usd:   0
[  622.241762] CPU    1: hi:  186, btch:  31 usd:   0
[  622.241764] HighMem per-cpu:
[  622.241766] CPU    0: hi:  186, btch:  31 usd:   0
[  622.241767] CPU    1: hi:  186, btch:  31 usd:   0
[  622.241771] Active:35589 inactive:33497 dirty:106 writeback:13 unstable:0
[  622.241772]  free:524121 slab:2629 mapped:11964 pagetables:637 bounce:0
[  622.241775] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  622.241777] lowmem_reserve[]: 0 873 2968 2968
[  622.241782] Normal free:213484kB min:3744kB low:4680kB high:5616kB active:432kB inactive:724kB present:894080kB pages_scanned:0 all_unreclaimable? no
[  622.241785] lowmem_reserve[]: 0 0 16760 16760
[  622.241790] HighMem free:1879444kB min:512kB low:2760kB high:5008kB active:141924kB inactive:133264kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  622.241792] lowmem_reserve[]: 0 0 0 0
[  622.241796] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  622.241804] Normal: 52283*4kB 444*8kB 5*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 213564kB
[  622.241806] HighMem: 74*4kB 850*8kB 1668*16kB 1098*32kB 609*64kB 271*128kB 131*256kB 87*512kB 60*1024kB 24*2048kB 378*4096kB = 1879544kB
[  622.241806] 46239 total pagecache pages
[  622.241806] Swap cache: add 0, delete 0, find 0/0
[  622.241806] Free swap  = 4192924kB
[  622.241806] Total swap = 4192924kB
[  622.249084] 769936 pages of RAM
[  622.249086] 540560 pages of HIGHMEM
[  622.249088] 8147 reserved pages
[  622.249089] 43102 pages shared
[  622.249090] 0 pages swap cached
[  622.249092] 106 pages dirty
[  622.249093] 13 pages writeback
[  622.249094] 11964 pages mapped
[  622.249096] 2629 pages slab
[  622.249097] 637 pages pagetables
[  622.249100] Out of memory: kill process 4176 (nautilus) score 1989 or a child
[  622.249124] Killed process 4176 (nautilus)
[  623.286345] metacity invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  623.286345] Pid: 3904, comm: metacity Not tainted 2.6.26 #1
[  623.286345]  [<c015b64f>] oom_kill_process+0x42/0x183
[  623.286345]  [<c015ba76>] out_of_memory+0x157/0x188
[  623.286345]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  623.286345]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  623.286345]  [<c015da12>] __get_free_pages+0x12/0x21
[  623.286345]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  623.286345]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  623.286345]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  623.286345]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  623.286345]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  623.286345]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  623.286345]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  623.286345]  [<c0179485>] do_sync_write+0xab/0xe9
[  623.286345]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  623.286345]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  623.286345]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  623.286345]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  623.286345]  [<c0179be3>] vfs_write+0x9d/0x133
[  623.286345]  [<c017a1d8>] sys_write+0x3b/0x60
[  623.286345]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  623.286345]  =======================
[  623.286345] Mem-info:
[  623.286345] DMA per-cpu:
[  623.286345] CPU    0: hi:    0, btch:   1 usd:   0
[  623.286345] CPU    1: hi:    0, btch:   1 usd:   0
[  623.286345] Normal per-cpu:
[  623.286345] CPU    0: hi:  186, btch:  31 usd:   0
[  623.286345] CPU    1: hi:  186, btch:  31 usd:   0
[  623.286345] HighMem per-cpu:
[  623.286345] CPU    0: hi:  186, btch:  31 usd:   0
[  623.286345] CPU    1: hi:  186, btch:  31 usd:   0
[  623.286345] Active:33412 inactive:33195 dirty:3 writeback:15 unstable:0
[  623.286345]  free:526675 slab:2623 mapped:11374 pagetables:632 bounce:0
[  623.286345] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  623.286345] lowmem_reserve[]: 0 873 2968 2968
[  623.286345] Normal free:214008kB min:3744kB low:4680kB high:5616kB active:300kB inactive:352kB present:894080kB pages_scanned:0 all_unreclaimable? no
[  623.286345] lowmem_reserve[]: 0 0 16760 16760
[  623.286345] HighMem free:1889136kB min:512kB low:2760kB high:5008kB active:133348kB inactive:132428kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  623.286345] lowmem_reserve[]: 0 0 0 0
[  623.286345] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  623.286345] Normal: 52394*4kB 440*8kB 9*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 214040kB
[  623.286345] HighMem: 1319*4kB 1384*8kB 1667*16kB 1098*32kB 606*64kB 270*128kB 132*256kB 88*512kB 60*1024kB 24*2048kB 378*4096kB = 1889228kB
[  623.286345] 45695 total pagecache pages
[  623.286345] Swap cache: add 0, delete 0, find 0/0
[  623.286345] Free swap  = 4192924kB
[  623.286345] Total swap = 4192924kB
[  623.293446] 769936 pages of RAM
[  623.293449] 540560 pages of HIGHMEM
[  623.293450] 8147 reserved pages
[  623.293451] 36569 pages shared
[  623.293453] 0 pages swap cached
[  623.293454] 3 pages dirty
[  623.293455] 15 pages writeback
[  623.293457] 11374 pages mapped
[  623.293458] 2623 pages slab
[  623.293459] 632 pages pagetables
[  623.293462] Out of memory: kill process 4179 (gnome-panel) score 1282 or a child
[  623.293480] Killed process 4179 (gnome-panel)
[  625.315318] metacity invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  625.315324] Pid: 3904, comm: metacity Not tainted 2.6.26 #1
[  625.315337]  [<c015b64f>] oom_kill_process+0x42/0x183
[  625.315348]  [<c015ba76>] out_of_memory+0x157/0x188
[  625.315356]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  625.315365]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  625.315370]  [<c015da12>] __get_free_pages+0x12/0x21
[  625.315374]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  625.315378]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  625.315386]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  625.315392]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  625.315400]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  625.315407]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  625.315416]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  625.315428]  [<c0179485>] do_sync_write+0xab/0xe9
[  625.315432]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  625.315441]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  625.315449]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  625.315455]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  625.315463]  [<c0179be3>] vfs_write+0x9d/0x133
[  625.315468]  [<c017a1d8>] sys_write+0x3b/0x60
[  625.315474]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  625.315484]  =======================
[  625.315485] Mem-info:
[  625.315487] DMA per-cpu:
[  625.315489] CPU    0: hi:    0, btch:   1 usd:   0
[  625.315490] CPU    1: hi:    0, btch:   1 usd:   0
[  625.315492] Normal per-cpu:
[  625.315494] CPU    0: hi:  186, btch:  31 usd:   0
[  625.315496] CPU    1: hi:  186, btch:  31 usd:   0
[  625.315498] HighMem per-cpu:
[  625.315500] CPU    0: hi:  186, btch:  31 usd:   0
[  625.315502] CPU    1: hi:  186, btch:  31 usd:   0
[  625.315505] Active:33758 inactive:32704 dirty:145 writeback:0 unstable:0
[  625.315506]  free:526822 slab:2616 mapped:7538 pagetables:604 bounce:0
[  625.315903] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  625.315905] lowmem_reserve[]: 0 873 2968 2968
[  625.315911] Normal free:213368kB min:3744kB low:4680kB high:5616kB active:704kB inactive:620kB present:894080kB pages_scanned:0 all_unreclaimable? no
[  625.315913] lowmem_reserve[]: 0 0 16760 16760
[  625.315918] HighMem free:1890364kB min:512kB low:2760kB high:5008kB active:134328kB inactive:130196kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  625.315921] lowmem_reserve[]: 0 0 0 0
[  625.315924] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  625.315934] Normal: 52249*4kB 439*8kB 5*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 213388kB
[  625.315944] HighMem: 1171*4kB 1572*8kB 1668*16kB 1099*32kB 610*64kB 270*128kB 132*256kB 88*512kB 60*1024kB 24*2048kB 378*4096kB = 1890444kB
[  625.315953] 45489 total pagecache pages
[  625.315956] Swap cache: add 0, delete 0, find 0/0
[  625.315958] Free swap  = 4192924kB
[  625.315959] Total swap = 4192924kB
[  625.322990] 769936 pages of RAM
[  625.322993] 540560 pages of HIGHMEM
[  625.322994] 8147 reserved pages
[  625.322995] 33879 pages shared
[  625.322997] 0 pages swap cached
[  625.322998] 145 pages dirty
[  625.322999] 0 pages writeback
[  625.323001] 7538 pages mapped
[  625.323002] 2616 pages slab
[  625.323003] 604 pages pagetables
[  625.323006] Out of memory: kill process 4211 (nautilus) score 1396 or a child
[  625.323025] Killed process 4211 (nautilus)
[  625.539181] metacity invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  625.539181] Pid: 3904, comm: metacity Not tainted 2.6.26 #1
[  625.539181]  [<c015b64f>] oom_kill_process+0x42/0x183
[  625.539181]  [<c015ba76>] out_of_memory+0x157/0x188
[  625.539181]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  625.539181]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  625.539181]  [<c015da12>] __get_free_pages+0x12/0x21
[  625.539181]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  625.539181]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  625.539181]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  625.539181]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  625.539181]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  625.539181]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  625.539181]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  625.539181]  [<c0179485>] do_sync_write+0xab/0xe9
[  625.539181]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  625.539181]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  625.539181]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  625.539181]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  625.539181]  [<c0179be3>] vfs_write+0x9d/0x133
[  625.540136]  [<c017a1d8>] sys_write+0x3b/0x60
[  625.540143]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  625.540155]  =======================
[  625.540157] Mem-info:
[  625.540159] DMA per-cpu:
[  625.540162] CPU    0: hi:    0, btch:   1 usd:   0
[  625.540175] CPU    1: hi:    0, btch:   1 usd:   0
[  625.540176] Normal per-cpu:
[  625.540179] CPU    0: hi:  186, btch:  31 usd:   0
[  625.540181] CPU    1: hi:  186, btch:  31 usd:   0
[  625.540182] HighMem per-cpu:
[  625.540184] CPU    0: hi:  186, btch:  31 usd:   0
[  625.540186] CPU    1: hi:  186, btch:  31 usd:   0
[  625.540189] Active:33161 inactive:32705 dirty:0 writeback:100 unstable:0
[  625.540190]  free:527441 slab:2616 mapped:7168 pagetables:604 bounce:0
[  625.540193] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? yes
[  625.540196] lowmem_reserve[]: 0 873 2968 2968
[  625.540201] Normal free:213844kB min:3744kB low:4680kB high:5616kB active:240kB inactive:624kB present:894080kB pages_scanned:45 all_unreclaimable? no
[  625.540204] lowmem_reserve[]: 0 0 16760 16760
[  625.540209] HighMem free:1892364kB min:512kB low:2760kB high:5008kB active:132404kB inactive:130196kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  625.540212] lowmem_reserve[]: 0 0 0 0
[  625.540215] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  625.540225] Normal: 52382*4kB 440*8kB 5*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 213928kB
[  625.540234] HighMem: 1603*4kB 1594*8kB 1670*16kB 1100*32kB 610*64kB 270*128kB 132*256kB 88*512kB 60*1024kB 24*2048kB 378*4096kB = 1892412kB
[  625.540244] 45278 total pagecache pages
[  625.540246] Swap cache: add 0, delete 0, find 0/0
[  625.540248] Free swap  = 4192924kB
[  625.540250] Total swap = 4192924kB
[  625.550129] 769936 pages of RAM
[  625.550129] 540560 pages of HIGHMEM
[  625.550129] 8147 reserved pages
[  625.550129] 31966 pages shared
[  625.550129] 0 pages swap cached
[  625.550129] 0 pages dirty
[  625.550129] 75 pages writeback
[  625.550129] 7168 pages mapped
[  625.550129] 2616 pages slab
[  625.550129] 604 pages pagetables
[  625.550129] Out of memory: kill process 4003 (gnome-terminal) score 1234 or a child
[  625.550129] Killed process 4016 (bash)
[  625.597136] metacity invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  625.597136] Pid: 3904, comm: metacity Not tainted 2.6.26 #1
[  625.597161]  [<c015b64f>] oom_kill_process+0x42/0x183
[  625.597175]  [<c015ba76>] out_of_memory+0x157/0x188
[  625.597185]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  625.597197]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  625.597202]  [<c015da12>] __get_free_pages+0x12/0x21
[  625.597207]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  625.597213]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  625.597222]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  625.597229]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  625.597240]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  625.597248]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  625.597260]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  625.597275]  [<c0179485>] do_sync_write+0xab/0xe9
[  625.597281]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  625.597292]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  625.597302]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  625.597310]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  625.597319]  [<c0179be3>] vfs_write+0x9d/0x133
[  625.597325]  [<c017a1d8>] sys_write+0x3b/0x60
[  625.597333]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  625.597345]  =======================
[  625.597347] Mem-info:
[  625.597349] DMA per-cpu:
[  625.597352] CPU    0: hi:    0, btch:   1 usd:   0
[  625.597354] CPU    1: hi:    0, btch:   1 usd:   0
[  625.597356] Normal per-cpu:
[  625.597359] CPU    0: hi:  186, btch:  31 usd:   0
[  625.597362] CPU    1: hi:  186, btch:  31 usd:   0
[  625.597364] HighMem per-cpu:
[  625.597367] CPU    0: hi:  186, btch:  31 usd:   0
[  625.597444] CPU    1: hi:  186, btch:  31 usd:   0
[  625.597447] Active:33080 inactive:32676 dirty:0 writeback:50 unstable:0
[  625.597449]  free:527600 slab:2616 mapped:7020 pagetables:604 bounce:0
[  625.597452] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? yes
[  625.597454] lowmem_reserve[]: 0 873 2968 2968
[  625.597460] Normal free:213980kB min:3744kB low:4680kB high:5616kB active:88kB inactive:760kB present:894080kB pages_scanned:232 all_unreclaimable? no
[  625.597462] lowmem_reserve[]: 0 0 16760 16760
[  625.597468] HighMem free:1892864kB min:512kB low:2760kB high:5008kB active:132108kB inactive:130196kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  625.597470] lowmem_reserve[]: 0 0 0 0
[  625.597474] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  625.597483] Normal: 52397*4kB 440*8kB 7*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 214020kB
[  625.597493] HighMem: 1674*4kB 1611*8kB 1667*16kB 1096*32kB 609*64kB 273*128kB 132*256kB 88*512kB 60*1024kB 24*2048kB 378*4096kB = 1892976kB
[  625.597503] 45278 total pagecache pages
[  625.597506] Swap cache: add 0, delete 0, find 0/0
[  625.597508] Free swap  = 4192924kB
[  625.597509] Total swap = 4192924kB
[  625.605380] 769936 pages of RAM
[  625.605382] 540560 pages of HIGHMEM
[  625.605384] 8147 reserved pages
[  625.605385] 31376 pages shared
[  625.605386] 0 pages swap cached
[  625.605388] 0 pages dirty
[  625.605389] 50 pages writeback
[  625.605390] 7020 pages mapped
[  625.605391] 2616 pages slab
[  625.605393] 604 pages pagetables
[  625.605396] Out of memory: kill process 4003 (gnome-terminal) score 1187 or a child
[  625.605414] Killed process 4003 (gnome-terminal)
[  625.634897] Out of memory: kill process 3982 (gnome-power-man) score 983 or a child
[  625.634902] Killed process 3982 (gnome-power-man)
[  625.638917] Out of memory: kill process 3381 (xfs) score 970 or a child
[  625.638917] Killed process 3381 (xfs)
[  626.361388] Out of memory: kill process 4214 (gnome-panel) score 1262 or a child
[  626.361388] Killed process 4214 (gnome-panel)
[  632.359486] __ratelimit: 3 messages suppressed
[  632.359486] metacity invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  632.359486] Pid: 3904, comm: metacity Not tainted 2.6.26 #1
[  632.359486]  [<c015b64f>] oom_kill_process+0x42/0x183
[  632.359501]  [<c015ba76>] out_of_memory+0x157/0x188
[  632.359509]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  632.359518]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  632.359523]  [<c015da12>] __get_free_pages+0x12/0x21
[  632.359526]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  632.359530]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  632.359538]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  632.359544]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  632.359552]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  632.359559]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  632.359569]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  632.359580]  [<c0179485>] do_sync_write+0xab/0xe9
[  632.359585]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  632.359594]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  632.359603]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  632.359609]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  632.359616]  [<c0179be3>] vfs_write+0x9d/0x133
[  632.359622]  [<c017a1d8>] sys_write+0x3b/0x60
[  632.359627]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  632.359634]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[  632.359641]  =======================
[  632.359643] Mem-info:
[  632.359645] DMA per-cpu:
[  632.359647] CPU    0: hi:    0, btch:   1 usd:   0
[  632.359648] CPU    1: hi:    0, btch:   1 usd:   0
[  632.359650] Normal per-cpu:
[  632.359652] CPU    0: hi:  186, btch:  31 usd:   0
[  632.359654] CPU    1: hi:  186, btch:  31 usd:   0
[  632.359656] HighMem per-cpu:
[  632.359658] CPU    0: hi:  186, btch:  31 usd:   0
[  632.359660] CPU    1: hi:  186, btch:  31 usd:   0
[  632.359663] Active:24951 inactive:35860 dirty:41 writeback:1 unstable:0
[  632.359664]  free:532597 slab:2532 mapped:10676 pagetables:524 bounce:0
[  632.359667] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  632.359670] lowmem_reserve[]: 0 873 2968 2968
[  632.359675] Normal free:213056kB min:3744kB low:4680kB high:5616kB active:240kB inactive:1620kB present:894080kB pages_scanned:0 all_unreclaimable? no
[  632.359678] lowmem_reserve[]: 0 0 16760 16760
[  632.360471] HighMem free:1913776kB min:512kB low:2760kB high:5008kB active:99564kB inactive:141820kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  632.360474] lowmem_reserve[]: 0 0 0 0
[  632.360478] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  632.360487] Normal: 52164*4kB 443*8kB 9*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 213144kB
[  632.360497] HighMem: 133*4kB 46*8kB 871*16kB 1172*32kB 657*64kB 297*128kB 147*256kB 96*512kB 67*1024kB 28*2048kB 383*4096kB = 1913908kB
[  632.360507] 43570 total pagecache pages
[  632.360509] Swap cache: add 0, delete 0, find 0/0
[  632.360511] Free swap  = 4192924kB
[  632.360512] Total swap = 4192924kB
[  632.368275] 769936 pages of RAM
[  632.368275] 540560 pages of HIGHMEM
[  632.368275] 8147 reserved pages
[  632.368275] 32545 pages shared
[  632.368275] 0 pages swap cached
[  632.368275] 41 pages dirty
[  632.368275] 1 pages writeback
[  632.368275] 10676 pages mapped
[  632.368275] 2532 pages slab
[  632.368275] 524 pages pagetables
[  632.368275] Out of memory: kill process 4232 (gnome-panel) score 1282 or a child
[  632.368275] Killed process 4232 (gnome-panel)
[  632.578369] Out of memory: kill process 3448 (avahi-daemon) score 956 or a child
[  632.578369] Killed process 3449 (avahi-daemon)
[  632.581344] Out of memory: kill process 4206 (trashapplet) score 905 or a child
[  632.581344] Killed process 4206 (trashapplet)
[  635.836959] __ratelimit: 2 messages suppressed
[  635.836964] gnome-panel invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  635.836967] Pid: 4247, comm: gnome-panel Not tainted 2.6.26 #1
[  635.836980]  [<c015b64f>] oom_kill_process+0x42/0x183
[  635.836980]  [<c015ba76>] out_of_memory+0x157/0x188
[  635.836980]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  635.836980]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  635.836980]  [<c015da12>] __get_free_pages+0x12/0x21
[  635.836980]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  635.836980]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  635.836980]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  635.836980]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  635.836980]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  635.836980]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  635.836980]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  635.836980]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[  635.836980]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  635.836980]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  635.836980]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  635.836980]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  635.836980]  [<c01799fc>] do_readv_writev+0x85/0x140
[  635.836980]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[  635.836980]  [<c0140adc>] ? tick_program_event+0x31/0x55
[  635.836980]  [<c0179af0>] vfs_writev+0x39/0x49
[  635.836980]  [<c0179f44>] sys_writev+0x3b/0x8e
[  635.836980]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  635.836980]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[  635.836980]  =======================
[  635.836980] Mem-info:
[  635.836980] DMA per-cpu:
[  635.836980] CPU    0: hi:    0, btch:   1 usd:   0
[  635.836980] CPU    1: hi:    0, btch:   1 usd:   0
[  635.836980] Normal per-cpu:
[  635.836980] CPU    0: hi:  186, btch:  31 usd:   0
[  635.836980] CPU    1: hi:  186, btch:  31 usd:   0
[  635.836980] HighMem per-cpu:
[  635.836980] CPU    0: hi:  186, btch:  31 usd:   0
[  635.836980] CPU    1: hi:  186, btch:  31 usd:   0
[  635.836980] Active:29004 inactive:31533 dirty:137 writeback:1 unstable:0
[  635.836980]  free:532874 slab:2524 mapped:10572 pagetables:496 bounce:0
[  635.836980] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  635.836980] lowmem_reserve[]: 0 873 2968 2968
[  635.836980] Normal free:212516kB min:3744kB low:4680kB high:5616kB active:1008kB inactive:1416kB present:894080kB pages_scanned:0 all_unreclaimable? no
[  635.836980] lowmem_reserve[]: 0 0 16760 16760
[  635.836980] HighMem free:1915424kB min:512kB low:2760kB high:5008kB active:115008kB inactive:124716kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  635.836980] lowmem_reserve[]: 0 0 0 0
[  635.836980] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  635.836980] Normal: 52025*4kB 442*8kB 8*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 212564kB
[  635.836980] HighMem: 101*4kB 40*8kB 944*16kB 1174*32kB 659*64kB 298*128kB 148*256kB 96*512kB 67*1024kB 28*2048kB 383*4096kB = 1915476kB
[  635.836980] 43616 total pagecache pages
[  635.836980] Swap cache: add 0, delete 0, find 0/0
[  635.836980] Free swap  = 4192924kB
[  635.836980] Total swap = 4192924kB
[  635.844457] 769936 pages of RAM
[  635.844459] 540560 pages of HIGHMEM
[  635.844460] 8147 reserved pages
[  635.844462] 35054 pages shared
[  635.844463] 0 pages swap cached
[  635.844464] 137 pages dirty
[  635.844466] 1 pages writeback
[  635.844467] 10572 pages mapped
[  635.844468] 2524 pages slab
[  635.844469] 496 pages pagetables
[  635.844472] Out of memory: kill process 4247 (gnome-panel) score 1266 or a child
[  635.844489] Killed process 4247 (gnome-panel)
[  637.519271] Out of memory: kill process 4250 (gnome-panel) score 1272 or a child
[  637.519277] Killed process 4250 (gnome-panel)
[  638.997167] Out of memory: kill process 4253 (gnome-panel) score 1266 or a child
[  638.997173] Killed process 4253 (gnome-panel)
[  640.557571] Out of memory: kill process 4256 (gnome-panel) score 1266 or a child
[  640.557577] Killed process 4256 (gnome-panel)
[  642.094127] __ratelimit: 3 messages suppressed
[  642.094131] gnome-panel invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  642.094134] Pid: 4260, comm: gnome-panel Not tainted 2.6.26 #1
[  642.094147]  [<c015b64f>] oom_kill_process+0x42/0x183
[  642.094158]  [<c015ba76>] out_of_memory+0x157/0x188
[  642.094166]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  642.094175]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  642.094179]  [<c015da12>] __get_free_pages+0x12/0x21
[  642.094183]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  642.094187]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  642.094196]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  642.094201]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  642.094210]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  642.094216]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  642.094226]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  642.094237]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[  642.094262]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  642.094270]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  642.094279]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  642.094286]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  642.094292]  [<c01799fc>] do_readv_writev+0x85/0x140
[  642.094297]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[  642.094304]  [<c0140adc>] ? tick_program_event+0x31/0x55
[  642.094312]  [<c0179af0>] vfs_writev+0x39/0x49
[  642.094317]  [<c0179f44>] sys_writev+0x3b/0x8e
[  642.094322]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  642.094329]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[  642.094336]  =======================
[  642.094338] Mem-info:
[  642.094340] DMA per-cpu:
[  642.094341] CPU    0: hi:    0, btch:   1 usd:   0
[  642.094343] CPU    1: hi:    0, btch:   1 usd:   0
[  642.094345] Normal per-cpu:
[  642.094346] CPU    0: hi:  186, btch:  31 usd:   0
[  642.094348] CPU    1: hi:  186, btch:  31 usd:   0
[  642.094350] HighMem per-cpu:
[  642.094352] CPU    0: hi:  186, btch:  31 usd:   0
[  642.094354] CPU    1: hi:  186, btch:  31 usd:   0
[  642.094356] Active:29068 inactive:31577 dirty:158 writeback:0 unstable:0
[  642.094358]  free:532779 slab:2521 mapped:10600 pagetables:490 bounce:0
[  642.094361] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  642.094363] lowmem_reserve[]: 0 873 2968 2968
[  642.094368] Normal free:212292kB min:3744kB low:4680kB high:5616kB active:732kB inactive:1772kB present:894080kB pages_scanned:0 all_unreclaimable? no
[  642.094370] lowmem_reserve[]: 0 0 16760 16760
[  642.094375] HighMem free:1915268kB min:512kB low:2760kB high:5008kB active:115540kB inactive:124536kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  642.094378] lowmem_reserve[]: 0 0 0 0
[  642.094381] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  642.094390] Normal: 52024*4kB 439*8kB 0*16kB 1*32kB 1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 212344kB
[  642.094398] HighMem: 92*4kB 41*8kB 936*16kB 1174*32kB 659*64kB 298*128kB 148*256kB 96*512kB 67*1024kB 28*2048kB 383*4096kB = 1915320kB
[  642.094407] 43680 total pagecache pages
[  642.094409] Swap cache: add 0, delete 0, find 0/0
[  642.094410] Free swap  = 4192924kB
[  642.094412] Total swap = 4192924kB
[  642.101938] 769936 pages of RAM
[  642.101940] 540560 pages of HIGHMEM
[  642.101941] 8147 reserved pages
[  642.101942] 35217 pages shared
[  642.101944] 0 pages swap cached
[  642.101945] 158 pages dirty
[  642.101946] 0 pages writeback
[  642.101948] 10600 pages mapped
[  642.101949] 2521 pages slab
[  642.101950] 490 pages pagetables
[  642.101952] Out of memory: kill process 4260 (gnome-panel) score 1266 or a child
[  642.101970] Killed process 4260 (gnome-panel)
[  643.703387] Out of memory: kill process 4264 (gnome-panel) score 1266 or a child
[  643.703393] Killed process 4264 (gnome-panel)
[  645.552680] Out of memory: kill process 4268 (gnome-panel) score 1266 or a child
[  645.552701] Killed process 4268 (gnome-panel)
[  664.460940] __ratelimit: 2 messages suppressed
[  664.460940] metacity invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  664.460940] Pid: 3904, comm: metacity Not tainted 2.6.26 #1
[  664.460940]  [<c015b64f>] oom_kill_process+0x42/0x183
[  664.460940]  [<c015ba76>] out_of_memory+0x157/0x188
[  664.460940]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  664.460940]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  664.460940]  [<c015da12>] __get_free_pages+0x12/0x21
[  664.460940]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  664.460940]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  664.460940]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  664.460940]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  664.460940]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  664.460940]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  664.460940]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  664.460940]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[  664.460940]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  664.460940]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  664.460940]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  664.460940]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  664.460940]  [<c01799fc>] do_readv_writev+0x85/0x140
[  664.460940]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[  664.460940]  [<c0140adc>] ? tick_program_event+0x31/0x55
[  664.460940]  [<c0179af0>] vfs_writev+0x39/0x49
[  664.460940]  [<c0179f44>] sys_writev+0x3b/0x8e
[  664.460940]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  664.460940]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[  664.460940]  =======================
[  664.460940] Mem-info:
[  664.460940] DMA per-cpu:
[  664.460940] CPU    0: hi:    0, btch:   1 usd:   0
[  664.460940] CPU    1: hi:    0, btch:   1 usd:   0
[  664.460940] Normal per-cpu:
[  664.460940] CPU    0: hi:  186, btch:  31 usd:   0
[  664.460940] CPU    1: hi:  186, btch:  31 usd:   0
[  664.460940] HighMem per-cpu:
[  664.460940] CPU    0: hi:  186, btch:  31 usd:   0
[  664.460940] CPU    1: hi:  186, btch:  31 usd:   0
[  664.460940] Active:28421 inactive:32469 dirty:16 writeback:0 unstable:0
[  664.460940]  free:532567 slab:2521 mapped:10439 pagetables:475 bounce:0
[  664.460940] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  664.460940] lowmem_reserve[]: 0 873 2968 2968
[  664.460940] Normal free:209312kB min:3744kB low:4680kB high:5616kB active:188kB inactive:5256kB present:894080kB pages_scanned:0 all_unreclaimable? no
[  664.460940] lowmem_reserve[]: 0 0 16760 16760
[  664.460940] HighMem free:1917400kB min:512kB low:2760kB high:5008kB active:113496kB inactive:124620kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  664.460940] lowmem_reserve[]: 0 0 0 0
[  664.460940] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  664.460940] Normal: 52188*4kB 1*8kB 0*16kB 0*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 209400kB
[  664.460940] HighMem: 426*4kB 118*8kB 947*16kB 1174*32kB 659*64kB 298*128kB 148*256kB 96*512kB 67*1024kB 28*2048kB 383*4096kB = 1917448kB
[  664.460940] 44425 total pagecache pages
[  664.460940] Swap cache: add 0, delete 0, find 0/0
[  664.460940] Free swap  = 4192924kB
[  664.460940] Total swap = 4192924kB
[  664.470100] 769936 pages of RAM
[  664.470103] 540560 pages of HIGHMEM
[  664.470104] 8147 reserved pages
[  664.470105] 30095 pages shared
[  664.470107] 0 pages swap cached
[  664.470108] 16 pages dirty
[  664.470109] 0 pages writeback
[  664.470110] 10439 pages mapped
[  664.470112] 2521 pages slab
[  664.470113] 475 pages pagetables
[  664.470116] Out of memory: kill process 4207 (wnck-applet) score 986 or a child
[  664.470132] Killed process 4207 (wnck-applet)
[  664.509501] metacity invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  664.509501] Pid: 3904, comm: metacity Not tainted 2.6.26 #1
[  664.509501]  [<c015b64f>] oom_kill_process+0x42/0x183
[  664.509501]  [<c015ba76>] out_of_memory+0x157/0x188
[  664.509501]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  664.509501]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  664.509501]  [<c015da12>] __get_free_pages+0x12/0x21
[  664.509501]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  664.509501]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  664.509501]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  664.509501]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  664.509501]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  664.509501]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  664.509501]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  664.509501]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[  664.509501]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  664.509501]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  664.509501]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  664.509501]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  664.509501]  [<c01799fc>] do_readv_writev+0x85/0x140
[  664.509501]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[  664.509501]  [<c0140adc>] ? tick_program_event+0x31/0x55
[  664.509501]  [<c0179af0>] vfs_writev+0x39/0x49
[  664.509501]  [<c0179f44>] sys_writev+0x3b/0x8e
[  664.509501]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  664.509501]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[  664.509501]  =======================
[  664.509501] Mem-info:
[  664.509501] DMA per-cpu:
[  664.509501] CPU    0: hi:    0, btch:   1 usd:   0
[  664.509501] CPU    1: hi:    0, btch:   1 usd:   0
[  664.509501] Normal per-cpu:
[  664.509501] CPU    0: hi:  186, btch:  31 usd:   0
[  664.509501] CPU    1: hi:  186, btch:  31 usd:   0
[  664.509501] HighMem per-cpu:
[  664.509501] CPU    0: hi:  186, btch:  31 usd:   0
[  664.509501] CPU    1: hi:  186, btch:  31 usd:   0
[  664.509501] Active:27907 inactive:31184 dirty:16 writeback:0 unstable:0
[  664.509501]  free:534419 slab:2521 mapped:6184 pagetables:438 bounce:0
[  664.509501] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? yes
[  664.509501] lowmem_reserve[]: 0 873 2968 2968
[  664.509501] Normal free:214620kB min:3744kB low:4680kB high:5616kB active:56kB inactive:116kB present:894080kB pages_scanned:68 all_unreclaimable? no
[  664.509506] lowmem_reserve[]: 0 0 16760 16760
[  664.509512] HighMem free:1919500kB min:512kB low:2760kB high:5008kB active:111572kB inactive:124620kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  664.509514] lowmem_reserve[]: 0 0 0 0
[  664.509518] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  664.509526] Normal: 52618*4kB 440*8kB 1*16kB 0*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 214648kB
[  664.509534] HighMem: 557*4kB 233*8kB 985*16kB 1173*32kB 659*64kB 297*128kB 147*256kB 97*512kB 67*1024kB 28*2048kB 383*4096kB = 1919596kB
[  664.509543] 43014 total pagecache pages
[  664.509545] Swap cache: add 0, delete 0, find 0/0
[  664.509546] Free swap  = 4192924kB
[  664.509548] Total swap = 4192924kB
[  664.517494] 769936 pages of RAM
[  664.517494] 540560 pages of HIGHMEM
[  664.517494] 8147 reserved pages
[  664.517494] 23152 pages shared
[  664.517494] 0 pages swap cached
[  664.517494] 16 pages dirty
[  664.517494] 0 pages writeback
[  664.517494] 6184 pages mapped
[  664.517494] 2521 pages slab
[  664.517494] 438 pages pagetables
[  664.517494] Out of memory: kill process 3679 (gdm-binary) score 826 or a child
[  664.517494] Killed process 3685 (Xorg)
[  664.722224] escd[3954]: segfault at bfa00000 ip 005c7f87 sp bfa86188 error 4 in libc-2.5.so[55e000+13a000]
[  702.198555] Xorg invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  702.198562] Pid: 4288, comm: Xorg Not tainted 2.6.26 #1
[  702.198582]  [<c015b64f>] oom_kill_process+0x42/0x183
[  702.198596]  [<c015ba76>] out_of_memory+0x157/0x188
[  702.198605]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  702.198613]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  702.198618]  [<c015da12>] __get_free_pages+0x12/0x21
[  702.198623]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  702.198629]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  702.198639]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  702.198646]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  702.198656]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  702.198664]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  702.198676]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  702.198689]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[  702.198694]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  702.198702]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  702.198711]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  702.198718]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  702.198725]  [<c01799fc>] do_readv_writev+0x85/0x140
[  702.198729]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[  702.198736]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  702.198742]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  702.198750]  [<c0179af0>] vfs_writev+0x39/0x49
[  702.198755]  [<c0179f44>] sys_writev+0x3b/0x8e
[  702.198761]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  702.198771]  =======================
[  702.198773] Mem-info:
[  702.198775] DMA per-cpu:
[  702.198776] CPU    0: hi:    0, btch:   1 usd:   0
[  702.198778] CPU    1: hi:    0, btch:   1 usd:   0
[  702.198780] Normal per-cpu:
[  702.198782] CPU    0: hi:  186, btch:  31 usd:   0
[  702.198784] CPU    1: hi:  186, btch:  31 usd:   0
[  702.198785] HighMem per-cpu:
[  702.198787] CPU    0: hi:  186, btch:  31 usd:  29
[  702.198789] CPU    1: hi:  186, btch:  31 usd:   0
[  702.198792] Active:28814 inactive:31721 dirty:4 writeback:0 unstable:0
[  702.198793]  free:532900 slab:2224 mapped:10743 pagetables:576 bounce:0
[  702.198796] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  702.198799] lowmem_reserve[]: 0 873 2968 2968
[  702.198804] Normal free:211292kB min:3744kB low:4680kB high:5616kB active:1124kB inactive:2880kB present:894080kB pages_scanned:0 all_unreclaimable? no
[  702.198806] lowmem_reserve[]: 0 0 16760 16760
[  702.198811] HighMem free:1916752kB min:512kB low:2760kB high:5008kB active:114280kB inactive:124004kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  702.198814] lowmem_reserve[]: 0 0 0 0
[  702.198817] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  702.198826] Normal: 51788*4kB 440*8kB 5*16kB 0*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 211392kB
[  702.198960] HighMem: 8*4kB 8*8kB 464*16kB 235*32kB 22*64kB 18*128kB 126*256kB 118*512kB 85*1024kB 45*2048kB 397*4096kB = 1916736kB
[  702.198960] 42315 total pagecache pages
[  702.198960] Swap cache: add 0, delete 0, find 0/0
[  702.198960] Free swap  = 4192924kB
[  702.198960] Total swap = 4192924kB
[  702.206353] 769936 pages of RAM
[  702.206355] 540560 pages of HIGHMEM
[  702.206357] 8147 reserved pages
[  702.206358] 47941 pages shared
[  702.206359] 0 pages swap cached
[  702.206360] 4 pages dirty
[  702.206362] 0 pages writeback
[  702.206363] 10743 pages mapped
[  702.206364] 2224 pages slab
[  702.206366] 576 pages pagetables
[  702.206368] Out of memory: kill process 4427 (nautilus) score 1785 or a child
[  702.206385] Killed process 4427 (nautilus)
[  702.833368] wnck-applet invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  702.833368] Pid: 4492, comm: wnck-applet Not tainted 2.6.26 #1
[  702.833368]  [<c015b64f>] oom_kill_process+0x42/0x183
[  702.833368]  [<c015ba76>] out_of_memory+0x157/0x188
[  702.833368]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  702.833368]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  702.833368]  [<c015da12>] __get_free_pages+0x12/0x21
[  702.833368]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  702.833368]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  702.833368]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  702.833368]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  702.833368]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  702.833368]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  702.833368]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  702.833368]  [<c0179485>] do_sync_write+0xab/0xe9
[  702.833368]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  702.833368]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  702.833368]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  702.833368]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  702.833368]  [<c0179be3>] vfs_write+0x9d/0x133
[  702.833368]  [<c017a1d8>] sys_write+0x3b/0x60
[  702.833368]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  702.833368]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[  702.833368]  =======================
[  702.833368] Mem-info:
[  702.833368] DMA per-cpu:
[  702.833368] CPU    0: hi:    0, btch:   1 usd:   0
[  702.833368] CPU    1: hi:    0, btch:   1 usd:   0
[  702.833368] Normal per-cpu:
[  702.833368] CPU    0: hi:  186, btch:  31 usd:   0
[  702.833368] CPU    1: hi:  186, btch:  31 usd:   0
[  702.833368] HighMem per-cpu:
[  702.833368] CPU    0: hi:  186, btch:  31 usd:   0
[  702.833368] CPU    1: hi:  186, btch:  31 usd:   0
[  702.833368] Active:25941 inactive:30943 dirty:0 writeback:5 unstable:0
[  702.833368]  free:536620 slab:2225 mapped:10235 pagetables:553 bounce:0
[  702.833368] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  702.833368] lowmem_reserve[]: 0 873 2968 2968
[  702.833368] Normal free:214192kB min:3744kB low:4680kB high:5616kB active:360kB inactive:756kB present:894080kB pages_scanned:0 all_unreclaimable? no
[  702.833368] lowmem_reserve[]: 0 0 16760 16760
[  702.833368] HighMem free:1928732kB min:512kB low:2760kB high:5008kB active:103404kB inactive:123016kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  702.833368] lowmem_reserve[]: 0 0 0 0
[  702.833368] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  702.833368] Normal: 52388*4kB 466*8kB 23*16kB 0*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 214288kB
[  702.833368] HighMem: 582*4kB 506*8kB 758*16kB 242*32kB 28*64kB 20*128kB 127*256kB 118*512kB 85*1024kB 45*2048kB 397*4096kB = 1928840kB
[  702.833368] 41183 total pagecache pages
[  702.833368] Swap cache: add 0, delete 0, find 0/0
[  702.833368] Free swap  = 4192924kB
[  702.833368] Total swap = 4192924kB
[  702.840367] 769936 pages of RAM
[  702.840367] 540560 pages of HIGHMEM
[  702.840367] 8147 reserved pages
[  702.840367] 40860 pages shared
[  702.840367] 0 pages swap cached
[  702.840367] 0 pages dirty
[  702.840367] 5 pages writeback
[  702.840367] 10235 pages mapped
[  702.840367] 2225 pages slab
[  702.840367] 553 pages pagetables
[  702.840367] Out of memory: kill process 4425 (gnome-panel) score 1272 or a child
[  702.840367] Killed process 4425 (gnome-panel)
[  705.719085] Xorg invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  705.719091] Pid: 4288, comm: Xorg Not tainted 2.6.26 #1
[  705.719104]  [<c015b64f>] oom_kill_process+0x42/0x183
[  705.719115]  [<c015ba76>] out_of_memory+0x157/0x188
[  705.719123]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  705.719131]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  705.719136]  [<c015da12>] __get_free_pages+0x12/0x21
[  705.719140]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  705.719144]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  705.719152]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  705.719158]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  705.719166]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  705.719177]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  705.719188]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[  705.719193]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  705.719201]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  705.719210]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  705.719216]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  705.719222]  [<c01799fc>] do_readv_writev+0x85/0x140
[  705.719226]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[  705.719233]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  705.719241]  [<c0179af0>] vfs_writev+0x39/0x49
[  705.719247]  [<c0179f44>] sys_writev+0x3b/0x8e
[  705.719252]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  705.719261]  =======================
[  705.719263] Mem-info:
[  705.719265] DMA per-cpu:
[  705.719266] CPU    0: hi:    0, btch:   1 usd:   0
[  705.719268] CPU    1: hi:    0, btch:   1 usd:   0
[  705.719270] Normal per-cpu:
[  705.719272] CPU    0: hi:  186, btch:  31 usd:   0
[  705.719274] CPU    1: hi:  186, btch:  31 usd:   0
[  705.719275] HighMem per-cpu:
[  705.719277] CPU    0: hi:  186, btch:  31 usd:   0
[  705.719279] CPU    1: hi:  186, btch:  31 usd:   0
[  705.719282] Active:26605 inactive:30627 dirty:153 writeback:1 unstable:0
[  705.719283]  free:536236 slab:2221 mapped:10577 pagetables:524 bounce:0
[  705.719286] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  705.719289] lowmem_reserve[]: 0 873 2968 2968
[  705.719294] Normal free:212640kB min:3744kB low:4680kB high:5616kB active:792kB inactive:1728kB present:894080kB pages_scanned:0 all_unreclaimable? no
[  705.719296] lowmem_reserve[]: 0 0 16760 16760
[  705.719301] HighMem free:1928748kB min:512kB low:2760kB high:5008kB active:105628kB inactive:120780kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  705.719304] lowmem_reserve[]: 0 0 0 0
[  705.719307] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  705.719315] Normal: 52001*4kB 460*8kB 21*16kB 2*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 212724kB
[  705.719324] HighMem: 52*4kB 418*8kB 806*16kB 255*32kB 36*64kB 27*128kB 128*256kB 118*512kB 85*1024kB 45*2048kB 397*4096kB = 1928864kB
[  705.719332] 41278 total pagecache pages
[  705.719334] Swap cache: add 0, delete 0, find 0/0
[  705.719336] Free swap  = 4192924kB
[  705.719337] Total swap = 4192924kB
[  705.726693] 769936 pages of RAM
[  705.726695] 540560 pages of HIGHMEM
[  705.726697] 8147 reserved pages
[  705.726698] 37429 pages shared
[  705.726699] 0 pages swap cached
[  705.726701] 153 pages dirty
[  705.726830] 1 pages writeback
[  705.726830] 10577 pages mapped
[  705.726830] 2221 pages slab
[  705.726830] 524 pages pagetables
[  705.726830] Out of memory: kill process 4499 (gnome-panel) score 1272 or a child
[  705.726830] Killed process 4499 (gnome-panel)
[  708.593424] nautilus invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  708.593431] Pid: 4497, comm: nautilus Not tainted 2.6.26 #1
[  708.593445]  [<c015b64f>] oom_kill_process+0x42/0x183
[  708.593459]  [<c015ba76>] out_of_memory+0x157/0x188
[  708.593469]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  708.593480]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  708.593559]  [<c015da12>] __get_free_pages+0x12/0x21
[  708.593566]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  708.593571]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  708.593581]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  708.593588]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  708.593599]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  708.593607]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  708.593619]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  708.593634]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[  708.593640]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  708.593651]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  708.593661]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  708.593669]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  708.593677]  [<c01799fc>] do_readv_writev+0x85/0x140
[  708.593683]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[  708.593690]  [<c0122f35>] ? hrtick_set+0xcf/0xd7
[  708.593698]  [<c0343f96>] ? schedule+0x6c2/0x6f4
[  708.593782]  [<c0179af0>] vfs_writev+0x39/0x49
[  708.593787]  [<c0179f44>] sys_writev+0x3b/0x8e
[  708.593792]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  708.593799]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[  708.593806]  =======================
[  708.593808] Mem-info:
[  708.593809] DMA per-cpu:
[  708.593811] CPU    0: hi:    0, btch:   1 usd:   0
[  708.593813] CPU    1: hi:    0, btch:   1 usd:   0
[  708.593814] Normal per-cpu:
[  708.593816] CPU    0: hi:  186, btch:  31 usd:   0
[  708.593818] CPU    1: hi:  186, btch:  31 usd:   0
[  708.593819] HighMem per-cpu:
[  708.593821] CPU    0: hi:  186, btch:  31 usd:   0
[  708.593823] CPU    1: hi:  186, btch:  31 usd:   0
[  708.593826] Active:26747 inactive:30492 dirty:11 writeback:117 unstable:0
[  708.593827]  free:536177 slab:2218 mapped:10752 pagetables:555 bounce:0
[  708.593831] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? yes
[  708.593833] lowmem_reserve[]: 0 873 2968 2968
[  708.593838] Normal free:214120kB min:3744kB low:4680kB high:5616kB active:56kB inactive:796kB present:894080kB pages_scanned:328 all_unreclaimable? no
[  708.593841] lowmem_reserve[]: 0 0 16760 16760
[  708.593845] HighMem free:1927032kB min:512kB low:2760kB high:5008kB active:106932kB inactive:121172kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  708.593848] lowmem_reserve[]: 0 0 0 0
[  708.593852] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  708.593860] Normal: 52398*4kB 461*8kB 16*16kB 0*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 214176kB
[  708.593868] HighMem: 144*4kB 136*8kB 810*16kB 255*32kB 37*64kB 27*128kB 128*256kB 118*512kB 85*1024kB 45*2048kB 397*4096kB = 1927104kB
[  708.593877] 40991 total pagecache pages
[  708.593879] Swap cache: add 0, delete 0, find 0/0
[  708.593881] Free swap  = 4192924kB
[  708.593882] Total swap = 4192924kB
[  708.603913] 769936 pages of RAM
[  708.603913] 540560 pages of HIGHMEM
[  708.603913] 8147 reserved pages
[  708.603913] 41735 pages shared
[  708.603913] 0 pages swap cached
[  708.603913] 11 pages dirty
[  708.603913] 67 pages writeback
[  708.603913] 10752 pages mapped
[  708.603913] 2218 pages slab
[  708.603913] 555 pages pagetables
[  708.603913] Out of memory: kill process 4497 (nautilus) score 1748 or a child
[  708.603913] Killed process 4497 (nautilus)
[  710.528248] wnck-applet invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  710.528248] Pid: 4517, comm: wnck-applet Not tainted 2.6.26 #1
[  710.528248]  [<c015b64f>] oom_kill_process+0x42/0x183
[  710.528248]  [<c015ba76>] out_of_memory+0x157/0x188
[  710.528248]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  710.528248]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  710.528248]  [<c015da12>] __get_free_pages+0x12/0x21
[  710.528248]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  710.528248]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  710.528248]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  710.528248]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  710.528248]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  710.528248]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  710.528248]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  710.528248]  [<c0179485>] do_sync_write+0xab/0xe9
[  710.528248]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  710.528248]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  710.528248]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  710.528248]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  710.528248]  [<c0179be3>] vfs_write+0x9d/0x133
[  710.528248]  [<c017a1d8>] sys_write+0x3b/0x60
[  710.528248]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  710.528248]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[  710.528248]  =======================
[  710.528248] Mem-info:
[  710.528248] DMA per-cpu:
[  710.528248] CPU    0: hi:    0, btch:   1 usd:   0
[  710.528248] CPU    1: hi:    0, btch:   1 usd:   0
[  710.528248] Normal per-cpu:
[  710.528248] CPU    0: hi:  186, btch:  31 usd:   0
[  710.528248] CPU    1: hi:  186, btch:  31 usd:   0
[  710.528248] HighMem per-cpu:
[  710.528248] CPU    0: hi:  186, btch:  31 usd:   0
[  710.528248] CPU    1: hi:  186, btch:  31 usd:   0
[  710.528248] Active:26326 inactive:29416 dirty:14 writeback:25 unstable:0
[  710.528248]  free:537736 slab:2221 mapped:10481 pagetables:546 bounce:0
[  710.528248] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  710.528248] lowmem_reserve[]: 0 873 2968 2968
[  710.528248] Normal free:214760kB min:3744kB low:4680kB high:5616kB active:0kB inactive:340kB present:894080kB pages_scanned:0 all_unreclaimable? no
[  710.528248] lowmem_reserve[]: 0 0 16760 16760
[  710.528248] HighMem free:1932628kB min:512kB low:2760kB high:5008kB active:105304kB inactive:117324kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  710.528248] lowmem_reserve[]: 0 0 0 0
[  710.528248] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  710.528248] Normal: 52551*4kB 468*8kB 12*16kB 0*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 214780kB
[  710.528248] HighMem: 396*4kB 430*8kB 855*16kB 269*32kB 54*64kB 27*128kB 128*256kB 118*512kB 85*1024kB 45*2048kB 397*4096kB = 1932720kB
[  710.528248] 39708 total pagecache pages
[  710.528248] Swap cache: add 0, delete 0, find 0/0
[  710.528248] Free swap  = 4192924kB
[  710.528248] Total swap = 4192924kB
[  710.538173] 769936 pages of RAM
[  710.538173] 540560 pages of HIGHMEM
[  710.538173] 8147 reserved pages
[  710.538173] 41165 pages shared
[  710.538173] 0 pages swap cached
[  710.538173] 14 pages dirty
[  710.538173] 0 pages writeback
[  710.538173] 10481 pages mapped
[  710.538173] 2221 pages slab
[  710.538173] 546 pages pagetables
[  710.538173] Out of memory: kill process 4505 (gnome-panel) score 1274 or a child
[  710.538173] Killed process 4505 (gnome-panel)
[  710.538674] wnck-applet invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  710.538678] Pid: 4517, comm: wnck-applet Not tainted 2.6.26 #1
[  710.538692]  [<c015b64f>] oom_kill_process+0x42/0x183
[  710.538702]  [<c015ba76>] out_of_memory+0x157/0x188
[  710.538711]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  710.538720]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  710.538724]  [<c015da12>] __get_free_pages+0x12/0x21
[  710.538728]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  710.538732]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  710.538741]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  710.538747]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  710.538755]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  710.538761]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  710.538772]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  710.538783]  [<c0179485>] do_sync_write+0xab/0xe9
[  710.538788]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  710.538797]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  710.538806]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  710.538812]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  710.538820]  [<c0179be3>] vfs_write+0x9d/0x133
[  710.538825]  [<c017a1d8>] sys_write+0x3b/0x60
[  710.538831]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  710.538838]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[  710.538845]  =======================
[  710.538847] Mem-info:
[  710.538848] DMA per-cpu:
[  710.538850] CPU    0: hi:    0, btch:   1 usd:   0
[  710.538852] CPU    1: hi:    0, btch:   1 usd:   0
[  710.538854] Normal per-cpu:
[  710.538856] CPU    0: hi:  186, btch:  31 usd:   0
[  710.538858] CPU    1: hi:  186, btch:  31 usd:   0
[  710.538860] HighMem per-cpu:
[  710.538862] CPU    0: hi:  186, btch:  31 usd:   0
[  710.538863] CPU    1: hi:  186, btch:  31 usd:   0
[  710.538866] Active:25890 inactive:29356 dirty:14 writeback:0 unstable:0
[  710.538868]  free:538194 slab:2221 mapped:10370 pagetables:546 bounce:0
[  710.538871] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  710.538873] lowmem_reserve[]: 0 873 2968 2968
[  710.538879] Normal free:214692kB min:3744kB low:4680kB high:5616kB active:180kB inactive:100kB present:894080kB pages_scanned:0 all_unreclaimable? no
[  710.538881] lowmem_reserve[]: 0 0 16760 16760
[  710.538886] HighMem free:1934528kB min:512kB low:2760kB high:5008kB active:103380kB inactive:117324kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  710.538889] lowmem_reserve[]: 0 0 0 0
[  710.538892] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  710.538902] Normal: 52551*4kB 468*8kB 12*16kB 0*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 214780kB
[  710.538912] HighMem: 556*4kB 557*8kB 850*16kB 268*32kB 56*64kB 27*128kB 129*256kB 118*512kB 85*1024kB 45*2048kB 397*4096kB = 1934648kB
[  710.538922] 39708 total pagecache pages
[  710.538925] Swap cache: add 0, delete 0, find 0/0
[  710.538926] Free swap  = 4192924kB
[  710.538928] Total swap = 4192924kB
[  710.546172] 769936 pages of RAM
[  710.546172] 540560 pages of HIGHMEM
[  710.546172] 8147 reserved pages
[  710.546172] 35074 pages shared
[  710.546172] 0 pages swap cached
[  710.546172] 14 pages dirty
[  710.546172] 0 pages writeback
[  710.546172] 10370 pages mapped
[  710.546172] 2221 pages slab
[  710.546172] 509 pages pagetables
[  710.546172] Out of memory: kill process 4413 (scim-panel-gtk) score 1030 or a child
[  710.546172] Killed process 4413 (scim-panel-gtk)
[  710.957724] wnck-applet invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  710.957730] Pid: 4517, comm: wnck-applet Not tainted 2.6.26 #1
[  710.957745]  [<c015b64f>] oom_kill_process+0x42/0x183
[  710.957759]  [<c015ba76>] out_of_memory+0x157/0x188
[  710.957770]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  710.957781]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  710.957787]  [<c015da12>] __get_free_pages+0x12/0x21
[  710.957792]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  710.957797]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  710.957807]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  710.957814]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  710.958010]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  710.958018]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  710.958030]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  710.958045]  [<c0179485>] do_sync_write+0xab/0xe9
[  710.958051]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  710.958062]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  710.958082]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  710.958088]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  710.958095]  [<c0179be3>] vfs_write+0x9d/0x133
[  710.958100]  [<c017a1d8>] sys_write+0x3b/0x60
[  710.958106]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  710.958112]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[  710.958120]  =======================
[  710.958121] Mem-info:
[  710.958123] DMA per-cpu:
[  710.958125] CPU    0: hi:    0, btch:   1 usd:   0
[  710.958127] CPU    1: hi:    0, btch:   1 usd:   0
[  710.958128] Normal per-cpu:
[  710.958131] CPU    0: hi:  186, btch:  31 usd:   0
[  710.958132] CPU    1: hi:  186, btch:  31 usd:   5
[  710.958134] HighMem per-cpu:
[  710.958136] CPU    0: hi:  186, btch:  31 usd:   0
[  710.958138] CPU    1: hi:  186, btch:  31 usd:   0
[  710.958141] Active:25069 inactive:29349 dirty:7 writeback:12 unstable:0
[  710.958142]  free:539094 slab:2218 mapped:10224 pagetables:500 bounce:0
[  710.958145] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  710.958148] lowmem_reserve[]: 0 873 2968 2968
[  710.958153] Normal free:214636kB min:3744kB low:4680kB high:5616kB active:320kB inactive:188kB present:894080kB pages_scanned:64 all_unreclaimable? no
[  710.958156] lowmem_reserve[]: 0 0 16760 16760
[  710.958161] HighMem free:1938184kB min:512kB low:2760kB high:5008kB active:99956kB inactive:117208kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  710.958163] lowmem_reserve[]: 0 0 0 0
[  710.958167] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  710.958177] Normal: 52521*4kB 468*8kB 13*16kB 0*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 214676kB
[  710.958186] HighMem: 636*4kB 631*8kB 865*16kB 279*32kB 88*64kB 27*128kB 129*256kB 118*512kB 85*1024kB 45*2048kB 397*4096kB = 1938200kB
[  710.958196] 39711 total pagecache pages
[  710.958198] Swap cache: add 0, delete 0, find 0/0
[  710.958200] Free swap  = 4192924kB
[  710.958202] Total swap = 4192924kB
[  710.965796] 769936 pages of RAM
[  710.965796] 540560 pages of HIGHMEM
[  710.965796] 8147 reserved pages
[  710.965796] 34421 pages shared
[  710.965796] 0 pages swap cached
[  710.965796] 7 pages dirty
[  710.965796] 12 pages writeback
[  710.965796] 10224 pages mapped
[  710.965796] 2218 pages slab
[  710.965796] 500 pages pagetables
[  710.965796] Out of memory: kill process 4451 (nm-applet) score 988 or a child
[  710.965796] Killed process 4451 (nm-applet)
[  711.261179] metacity invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  711.261179] Pid: 4420, comm: metacity Not tainted 2.6.26 #1
[  711.261179]  [<c015b64f>] oom_kill_process+0x42/0x183
[  711.261179]  [<c015ba76>] out_of_memory+0x157/0x188
[  711.261179]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  711.261179]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  711.261179]  [<c015da12>] __get_free_pages+0x12/0x21
[  711.261179]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  711.261179]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  711.261179]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  711.261179]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  711.261179]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  711.261179]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  711.261179]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  711.261179]  [<c0179485>] do_sync_write+0xab/0xe9
[  711.261179]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  711.261179]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  711.261179]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  711.261179]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  711.261179]  [<c0179be3>] vfs_write+0x9d/0x133
[  711.261179]  [<c017a1d8>] sys_write+0x3b/0x60
[  711.261179]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  711.261179]  =======================
[  711.261179] Mem-info:
[  711.261179] DMA per-cpu:
[  711.261179] CPU    0: hi:    0, btch:   1 usd:   0
[  711.261179] CPU    1: hi:    0, btch:   1 usd:   0
[  711.261179] Normal per-cpu:
[  711.261179] CPU    0: hi:  186, btch:  31 usd:   0
[  711.261179] CPU    1: hi:  186, btch:  31 usd:   0
[  711.261179] HighMem per-cpu:
[  711.261179] CPU    0: hi:  186, btch:  31 usd:   0
[  711.261179] CPU    1: hi:  186, btch:  31 usd:   0
[  711.261179] Active:24734 inactive:29348 dirty:7 writeback:12 unstable:0
[  711.261179]  free:539402 slab:2218 mapped:10113 pagetables:500 bounce:0
[  711.261179] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[  711.261179] lowmem_reserve[]: 0 873 2968 2968
[  711.261179] Normal free:214568kB min:3744kB low:4680kB high:5616kB active:312kB inactive:184kB present:894080kB pages_scanned:0 all_unreclaimable? no
[  711.261179] lowmem_reserve[]: 0 0 16760 16760
[  711.261179] HighMem free:1939484kB min:512kB low:2760kB high:5008kB active:98624kB inactive:117208kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  711.261179] lowmem_reserve[]: 0 0 0 0
[  711.261179] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  711.261179] Normal: 52517*4kB 468*8kB 13*16kB 0*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 214660kB
[  711.261179] HighMem: 738*4kB 663*8kB 886*16kB 283*32kB 90*64kB 28*128kB 129*256kB 118*512kB 85*1024kB 45*2048kB 397*4096kB = 1939584kB
[  711.261179] 39711 total pagecache pages
[  711.261179] Swap cache: add 0, delete 0, find 0/0
[  711.261179] Free swap  = 4192924kB
[  711.261179] Total swap = 4192924kB
[  711.269434] 769936 pages of RAM
[  711.269436] 540560 pages of HIGHMEM
[  711.269437] 8147 reserved pages
[  711.269438] 28852 pages shared
[  711.269440] 0 pages swap cached
[  711.269441] 7 pages dirty
[  711.269442] 12 pages writeback
[  711.269443] 10113 pages mapped
[  711.269445] 2218 pages slab
[  711.269446] 500 pages pagetables
[  711.269448] Out of memory: kill process 4517 (wnck-applet) score 986 or a child
[  711.269465] Killed process 4517 (wnck-applet)
[  712.067094] metacity invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[  712.067100] Pid: 4420, comm: metacity Not tainted 2.6.26 #1
[  712.067115]  [<c015b64f>] oom_kill_process+0x42/0x183
[  712.067129]  [<c015ba76>] out_of_memory+0x157/0x188
[  712.067140]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[  712.067151]  [<c015d9fe>] __alloc_pages+0xa/0xc
[  712.067156]  [<c015da12>] __get_free_pages+0x12/0x21
[  712.067162]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[  712.067167]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[  712.067196]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[  712.067204]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[  712.067214]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[  712.067223]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[  712.067308]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[  712.067320]  [<c0179485>] do_sync_write+0xab/0xe9
[  712.067325]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[  712.067333]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[  712.067341]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[  712.067347]  [<c01e343d>] ? security_file_permission+0xf/0x11
[  712.067354]  [<c0179be3>] vfs_write+0x9d/0x133
[  712.067360]  [<c017a1d8>] sys_write+0x3b/0x60
[  712.067365]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[  712.067375]  =======================
[  712.067376] Mem-info:
[  712.067378] DMA per-cpu:
[  712.067380] CPU    0: hi:    0, btch:   1 usd:   0
[  712.067382] CPU    1: hi:    0, btch:   1 usd:   0
[  712.067383] Normal per-cpu:
[  712.067386] CPU    0: hi:  186, btch:  31 usd:   0
[  712.067387] CPU    1: hi:  186, btch:  31 usd:   0
[  712.067389] HighMem per-cpu:
[  712.067391] CPU    0: hi:  186, btch:  31 usd:   0
[  712.067393] CPU    1: hi:  186, btch:  31 usd:   0
[  712.067396] Active:24349 inactive:29009 dirty:25 writeback:50 unstable:0
[  712.067397]  free:540178 slab:2216 mapped:5947 pagetables:456 bounce:0
[  712.067400] DMA free:3556kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? yes
[  712.067403] lowmem_reserve[]: 0 873 2968 2968
[  712.067408] Normal free:214456kB min:3744kB low:4680kB high:5616kB active:288kB inactive:388kB present:894080kB pages_scanned:147 all_unreclaimable? no
[  712.067410] lowmem_reserve[]: 0 0 16760 16760
[  712.067416] HighMem free:1942700kB min:512kB low:2760kB high:5008kB active:97108kB inactive:115648kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[  712.067418] lowmem_reserve[]: 0 0 0 0
[  712.067422] DMA: 639*4kB 3*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 3556kB
[  712.067431] Normal: 52493*4kB 467*8kB 12*16kB 0*32kB 0*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 214540kB
[  712.067440] HighMem: 769*4kB 737*8kB 907*16kB 286*32kB 114*64kB 30*128kB 130*256kB 118*512kB 85*1024kB 45*2048kB 397*4096kB = 1942780kB
[  712.067450] 39162 total pagecache pages
[  712.067453] Swap cache: add 0, delete 0, find 0/0
[  712.067454] Free swap  = 4192924kB
[  712.067456] Total swap = 4192924kB
[  712.076668] 769936 pages of RAM
[  712.076671] 540560 pages of HIGHMEM
[  712.076672] 8147 reserved pages
[  712.076673] 24426 pages shared
[  712.076674] 0 pages swap cached
[  712.076676] 25 pages dirty
[  712.076677] 25 pages writeback
[  712.076678] 5947 pages mapped
[  712.076679] 2216 pages slab
[  712.076681] 456 pages pagetables
[  712.076683] Out of memory: kill process 4473 (gnome-power-man) score 981 or a child
[  712.076701] Killed process 4473 (gnome-power-man)
[  712.078170] Out of memory: kill process 3679 (gdm-binary) score 760 or a child
[  712.078170] Killed process 4288 (Xorg)
[  712.083864] Out of memory: kill process 3039 (dbus-daemon) score 713 or a child
[  712.083864] Killed process 3039 (dbus-daemon)
[  713.112790] Out of memory: kill process 3448 (avahi-daemon) score 637 or a child
[  713.112790] Killed process 3448 (avahi-daemon)
[  713.117470] Out of memory: kill process 4420 (metacity) score 601 or a child
[  713.117470] Killed process 4420 (metacity)
[  814.769214] __ratelimit: 5 messages suppressed
[  814.769222] scim-launcher[4415]: segfault at dfbc4ca8 ip b776c364 sp bfbc4be0 error 5 in x11.so[b7759000+32000]

[-- Attachment #4: bug2 --]
[-- Type: application/octet-stream, Size: 92479 bytes --]

[    0.000000] Linux version 2.6.26 (root@funnyman) (gcc version 4.1.2 20070626 (Red Hat 4.1.2-13)) #1 SMP Fri Oct 24 00:10:25 SGT 2008
[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  BIOS-e820: 0000000000000000 - 000000000009fc00 (usable)
[    0.000000]  BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved)
[    0.000000]  BIOS-e820: 00000000000e4000 - 0000000000100000 (reserved)
[    0.000000]  BIOS-e820: 0000000000100000 - 00000000bbf90000 (usable)
[    0.000000]  BIOS-e820: 00000000bbf90000 - 00000000bbf9e000 (ACPI data)
[    0.000000]  BIOS-e820: 00000000bbf9e000 - 00000000bbfe0000 (ACPI NVS)
[    0.000000]  BIOS-e820: 00000000bbfe0000 - 00000000bc000000 (reserved)
[    0.000000]  BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
[    0.000000]  BIOS-e820: 00000000ffb00000 - 0000000100000000 (reserved)
[    0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
[    0.000000] 2111MB HIGHMEM available.
[    0.000000] 896MB LOWMEM available.
[    0.000000] found SMP MP-table at [c00ff780] 000ff780
[    0.000000] Entering add_active_range(0, 0, 769936) 0 entries of 256 used
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA             0 ->     4096
[    0.000000]   Normal       4096 ->   229376
[    0.000000]   HighMem    229376 ->   769936
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[1] active PFN ranges
[    0.000000]     0:        0 ->   769936
[    0.000000] On node 0 totalpages: 769936
[    0.000000]   DMA zone: 32 pages used for memmap
[    0.000000]   DMA zone: 0 pages reserved
[    0.000000]   DMA zone: 4064 pages, LIFO batch:0
[    0.000000]   Normal zone: 1760 pages used for memmap
[    0.000000]   Normal zone: 223520 pages, LIFO batch:31
[    0.000000]   HighMem zone: 4224 pages used for memmap
[    0.000000]   HighMem zone: 536336 pages, LIFO batch:31
[    0.000000]   Movable zone: 0 pages used for memmap
[    0.000000] DMI 2.4 present.
[    0.000000] ACPI: RSDP 000FAE40, 0024 (r2 ACPIAM)
[    0.000000] ACPI: XSDT BBF90100, 0054 (r1 ÿÿÿÿÿÿ ÿÿÿÿÿÿÿÿ  1000722 MSFT       97)
[    0.000000] ACPI: FACP BBF90290, 00F4 (r3 MSTEST OEMFACP   1000722 MSFT       97)
[    0.000000] ACPI: DSDT BBF905C0, 8E63 (r1  A0667 A0667000        0 INTL 20060113)
[    0.000000] ACPI: FACS BBF9E000, 0040
[    0.000000] ACPI: APIC BBF90390, 006C (r1 MSTEST OEMAPIC   1000722 MSFT       97)
[    0.000000] ACPI: MCFG BBF90400, 003C (r1 MSTEST OEMMCFG   1000722 MSFT       97)
[    0.000000] ACPI: SLIC BBF90440, 0176 (r1 ÿÿÿÿÿÿ ÿÿÿÿÿÿÿÿ  1000722 MSFT       97)
[    0.000000] ACPI: OEMB BBF9E040, 007B (r1 MSTEST AMI_OEM   1000722 MSFT       97)
[    0.000000] ACPI: HPET BBF99430, 0038 (r1 MSTEST OEMHPET   1000722 MSFT       97)
[    0.000000] ACPI: PM-Timer IO Port: 0x808
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x82] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x83] disabled)
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ2 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Enabling APIC mode:  Flat.  Using 1 I/O APICs
[    0.000000] ACPI: HPET id: 0x8086a202 base: 0xfed00000
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] Allocating PCI resources starting at c0000000 (gap: bc000000:42e00000)
[    0.000000] SMP: Allowing 4 CPUs, 2 hotplug CPUs
[    0.000000] PERCPU: Allocating 41384 bytes of per cpu data
[    0.000000] NR_CPUS: 32, nr_cpu_ids: 4
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 763920
[    0.000000] Kernel command line: ro root=LABEL=/ rhgb quiet
[    0.000000] mapped APIC to ffffb000 (fee00000)
[    0.000000] mapped IOAPIC to ffffa000 (fec00000)
[    0.000000] Enabling fast FPU save and restore... done.
[    0.000000] Enabling unmasked SIMD FPU exception support... done.
[    0.000000] Initializing CPU#0
[    0.000000] CPU 0 irqstacks, hard=c04fe000 soft=c04de000
[    0.000000] PID hash table entries: 4096 (order: 12, 16384 bytes)
[    0.000000] Extended CMOS year: 2000
[    0.000000] Detected 2133.427 MHz processor.
[    0.000999] Console: colour VGA+ 80x25
[    0.000999] console [tty0] enabled
[    0.000999] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
[    0.000999] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
[    0.000999] Memory: 3046364k/3079744k available (2339k kernel code, 32196k reserved, 1307k data, 280k init, 2162240k highmem)
[    0.000999] virtual kernel memory layout:
[    0.000999]     fixmap  : 0xffc54000 - 0xfffff000   (3756 kB)
[    0.000999]     pkmap   : 0xff400000 - 0xff800000   (4096 kB)
[    0.000999]     vmalloc : 0xf8800000 - 0xff3fe000   ( 107 MB)
[    0.000999]     lowmem  : 0xc0000000 - 0xf8000000   ( 896 MB)
[    0.000999]       .init : 0xc0495000 - 0xc04db000   ( 280 kB)
[    0.000999]       .data : 0xc0348e50 - 0xc048fbc0   (1307 kB)
[    0.000999]       .text : 0xc0100000 - 0xc0348e50   (2339 kB)
[    0.000999] Checking if this processor honours the WP bit even in supervisor mode...Ok.
[    0.000999] CPA: page pool initialized 48 of 48 pages preallocated
[    0.000999] SLUB: Genslabs=12, HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000999] kmemtrace: early init successful.
[    0.000999] hpet clockevent registered
[    0.060857] Calibrating delay using timer specific routine.. 4269.36 BogoMIPS (lpj=2134681)
[    0.060881] Security Framework initialized
[    0.060887] SELinux:  Initializing.
[    0.060896] SELinux:  Starting in permissive mode
[    0.060900] selinux_register_security:  Registering secondary module capability
[    0.060902] Capability LSM initialized as secondary
[    0.060914] Mount-cache hash table entries: 512
[    0.060990] CPU: L1 I cache: 32K, L1 D cache: 32K
[    0.060990] CPU: L2 cache: 4096K
[    0.060990] CPU: Physical Processor ID: 0
[    0.060990] CPU: Processor Core ID: 0
[    0.060990] Intel machine check architecture supported.
[    0.060990] Intel machine check reporting enabled on CPU#0.
[    0.060990] using mwait in idle threads.
[    0.060990] Checking 'hlt' instruction... OK.
[    0.065989] ACPI: Core revision 20080321
[    0.077988] ENABLING IO-APIC IRQs
[    0.077988] ..TIMER: vector=0x31 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.087975] CPU0: Intel(R) Core(TM)2 CPU          6420  @ 2.13GHz stepping 06
[    0.091985] CPU 1 irqstacks, hard=c04ff000 soft=c04df000
[    0.091985] Booting processor 1/1 ip 6000
[    0.103984] Initializing CPU#1
[    0.103984] Calibrating delay using timer specific routine.. 4266.55 BogoMIPS (lpj=2133277)
[    0.103984] CPU: L1 I cache: 32K, L1 D cache: 32K
[    0.103984] CPU: L2 cache: 4096K
[    0.103984] CPU: Physical Processor ID: 0
[    0.103984] CPU: Processor Core ID: 1
[    0.103984] Intel machine check architecture supported.
[    0.103984] Intel machine check reporting enabled on CPU#1.
[    0.103984] x86 PAT enabled: cpu 1, old 0x7040600070406, new 0x7010600070106
[    0.164496] CPU1: Intel(R) Core(TM)2 CPU          6420  @ 2.13GHz stepping 06
[    0.164510] checking TSC synchronization [CPU#0 -> CPU#1]: passed.
[    0.165974] Brought up 2 CPUs
[    0.165974] Total of 2 processors activated (8535.91 BogoMIPS).
[    0.165974] CPU0 attaching sched-domain:
[    0.165974]  domain 0: span 0-1
[    0.165974]   groups: 0 1
[    0.165974] CPU1 attaching sched-domain:
[    0.165974]  domain 0: span 0-1
[    0.165974]   groups: 1 0
[    0.103984] khelper used greatest stack depth: 2728 bytes left
[    0.165974] net_namespace: 660 bytes
[    0.165974] Booting paravirtualized kernel on bare hardware
[    0.166974] NET: Registered protocol family 16
[    0.166974] ACPI: bus type pci registered
[    0.166974] PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
[    0.166974] PCI: Not using MMCONFIG.
[    0.166974] PCI: PCI BIOS revision 3.00 entry at 0xf0031, last bus=5
[    0.166974] PCI: Using configuration type 1 for base access
[    0.166974] Setting up standard PCI resources
[    0.174648] ACPI: EC: Look up EC in DSDT
[    0.187147] ACPI: Interpreter enabled
[    0.187147] ACPI: (supports S0 S1 S3 S5)
[    0.187147] ACPI: Using IOAPIC for interrupt routing
[    0.187209] PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
[    0.190118] PCI: MCFG area at e0000000 reserved in ACPI motherboard resources
[    0.190121] PCI: Using MMCONFIG for extended config space
[    0.201145] ACPI: PCI Root Bridge [PCI0] (0000:00)
[    0.201790] pci 0000:00:1f.0: quirk: region 0800-087f claimed by ICH6 ACPI/GPIO/TCO
[    0.201794] pci 0000:00:1f.0: quirk: region 0480-04bf claimed by ICH6 GPIO
[    0.202845] PCI: Transparent bridge - 0000:00:1e.0
[    0.202875] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
[    0.203733] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P2._PRT]
[    0.203869] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P1._PRT]
[    0.203944] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P4._PRT]
[    0.204088] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P8._PRT]
[    0.204229] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P9._PRT]
[    0.222941] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 *11 12 14 15)
[    0.222941] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *10 11 12 14 15)
[    0.222941] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 7 10 11 12 14 15)
[    0.223080] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 10 11 12 14 *15)
[    0.223216] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled.
[    0.223351] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 11 12 *14 15)
[    0.223487] ACPI: PCI Interrupt Link [LNKG] (IRQs *3 4 5 6 7 10 11 12 14 15)
[    0.223876] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *7 10 11 12 14 15)
[    0.224195] ACPI Warning (tbutils-0217): Incorrect checksum in table [OEMB] - A2, should be 99 [20080321]
[    0.224195] Linux Plug and Play Support v0.97 (c) Adam Belay
[    0.224195] pnp: PnP ACPI init
[    0.224195] ACPI: bus type pnp registered
[    0.228561] pnp: PnP ACPI: found 16 devices
[    0.228563] ACPI: ACPI bus type pnp unregistered
[    0.229195] usbcore: registered new interface driver usbfs
[    0.229195] usbcore: registered new interface driver hub
[    0.229195] usbcore: registered new device driver usb
[    0.229195] PCI: Using ACPI for IRQ routing
[    0.231078] NetLabel: Initializing
[    0.231081] NetLabel:  domain hash size = 128
[    0.231083] NetLabel:  protocols = UNLABELED CIPSOv4
[    0.231102] NetLabel:  unlabeled traffic allowed by default
[    0.231108] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.231114] hpet0: 3 64-bit timers, 14318180 Hz
[    0.233123] system 00:01: iomem range 0xfed14000-0xfed19fff has been reserved
[    0.233135] system 00:08: ioport range 0x290-0x297 has been reserved
[    0.233143] system 00:09: ioport range 0x4d0-0x4d1 has been reserved
[    0.233146] system 00:09: ioport range 0x800-0x87f has been reserved
[    0.233150] system 00:09: ioport range 0x480-0x4bf has been reserved
[    0.233154] system 00:09: iomem range 0xffafe000-0xffb0cbff could not be reserved
[    0.233158] system 00:09: iomem range 0xffb00000-0xffbfffff could not be reserved
[    0.233162] system 00:09: iomem range 0xfed1c000-0xfed1ffff has been reserved
[    0.233166] system 00:09: iomem range 0xfed20000-0xfed8ffff has been reserved
[    0.233170] system 00:09: iomem range 0xfff00000-0xfffffffe could not be reserved
[    0.233173] system 00:09: iomem range 0xfebfe000-0xfebfec00 has been reserved
[    0.233182] system 00:0b: iomem range 0xfec00000-0xfec00fff has been reserved
[    0.233186] system 00:0b: iomem range 0xfee00000-0xfee00fff could not be reserved
[    0.233195] system 00:0e: iomem range 0xe0000000-0xefffffff has been reserved
[    0.233203] system 00:0f: iomem range 0x0-0x9ffff could not be reserved
[    0.233206] system 00:0f: iomem range 0xc0000-0xcffff could not be reserved
[    0.233210] system 00:0f: iomem range 0xe0000-0xfffff could not be reserved
[    0.233214] system 00:0f: iomem range 0x100000-0xbbffffff could not be reserved
[    0.264518] PCI: Bridge: 0000:00:01.0
[    0.264521]   IO window: 9000-9fff
[    0.264524]   MEM window: 0xf8700000-0xfe7fffff
[    0.264526]   PREFETCH window: 0x00000000bfe00000-0x00000000dfdfffff
[    0.264530] PCI: Bridge: 0000:00:1c.0
[    0.264531]   IO window: disabled.
[    0.264535]   MEM window: disabled.
[    0.264538]   PREFETCH window: 0x00000000dfe00000-0x00000000dfefffff
[    0.264538] PCI: Bridge: 0000:00:1c.4
[    0.264538]   IO window: b000-bfff
[    0.264538]   MEM window: 0xfe900000-0xfe9fffff
[    0.264538]   PREFETCH window: disabled.
[    0.264538] PCI: Bridge: 0000:00:1c.5
[    0.264538]   IO window: a000-afff
[    0.264538]   MEM window: 0xfe800000-0xfe8fffff
[    0.264538]   PREFETCH window: disabled.
[    0.264538] PCI: Bridge: 0000:00:1e.0
[    0.264538]   IO window: disabled.
[    0.264538]   MEM window: 0xfea00000-0xfeafffff
[    0.264538]   PREFETCH window: disabled.
[    0.264538] ACPI: PCI Interrupt 0000:00:01.0[A] -> GSI 16 (level, low) -> IRQ 16
[    0.264538] PCI: Setting latency timer of device 0000:00:01.0 to 64
[    0.264538] ACPI: PCI Interrupt 0000:00:1c.0[A] -> GSI 16 (level, low) -> IRQ 16
[    0.264538] PCI: Setting latency timer of device 0000:00:1c.0 to 64
[    0.264538] ACPI: PCI Interrupt 0000:00:1c.4[A] -> GSI 16 (level, low) -> IRQ 16
[    0.264538] PCI: Setting latency timer of device 0000:00:1c.4 to 64
[    0.264538] ACPI: PCI Interrupt 0000:00:1c.5[B] -> GSI 17 (level, low) -> IRQ 17
[    0.264538] PCI: Setting latency timer of device 0000:00:1c.5 to 64
[    0.264538] PCI: Setting latency timer of device 0000:00:1e.0 to 64
[    0.264538] NET: Registered protocol family 2
[    0.267735] IP route cache hash table entries: 32768 (order: 5, 131072 bytes)
[    0.268007] TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.268588] TCP bind hash table entries: 65536 (order: 7, 524288 bytes)
[    0.268830] TCP: Hash tables configured (established 131072 bind 65536)
[    0.268832] TCP reno registered
[    0.269862] NET: Registered protocol family 1
[    0.270017] checking if image is initramfs... it is
[    0.427488] debug: unmapping init memory f7dc2000..f7ff0000
[    0.427863] apm: BIOS version 1.2 Flags 0x03 (Driver version 1.16ac)
[    0.427863] apm: disabled - APM is not SMP safe.
[    0.427962] audit: initializing netlink socket (disabled)
[    0.427979] type=2000 audit(1224835708.425:1): initialized
[    0.434582] highmem bounce pool size: 64 pages
[    0.434582] Total HugeTLB memory allocated, 0
[    0.436625] VFS: Disk quotas dquot_6.5.1
[    0.437582] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[    0.437617] msgmni has been set to 1728
[    0.437617] SELinux:  Registering netfilter hooks
[    0.437617] io scheduler noop registered
[    0.437617] io scheduler anticipatory registered
[    0.437617] io scheduler deadline registered
[    0.437617] io scheduler cfq registered (default)
[    0.437617] pci 0000:01:00.0: Boot video device
[    0.437617] PCI: Setting latency timer of device 0000:00:01.0 to 64
[    0.437636] assign_interrupt_mode Found MSI capability
[    0.437660] Allocate Port Service[0000:00:01.0:pcie00]
[    0.438583] Allocate Port Service[0000:00:01.0:pcie03]
[    0.438583] PCI: Setting latency timer of device 0000:00:1c.0 to 64
[    0.438583] assign_interrupt_mode Found MSI capability
[    0.438583] Allocate Port Service[0000:00:1c.0:pcie00]
[    0.438583] Allocate Port Service[0000:00:1c.0:pcie02]
[    0.438583] Allocate Port Service[0000:00:1c.0:pcie03]
[    0.438583] PCI: Setting latency timer of device 0000:00:1c.4 to 64
[    0.438583] assign_interrupt_mode Found MSI capability
[    0.438583] Allocate Port Service[0000:00:1c.4:pcie00]
[    0.438593] Allocate Port Service[0000:00:1c.4:pcie02]
[    0.438593] Allocate Port Service[0000:00:1c.4:pcie03]
[    0.438593] PCI: Setting latency timer of device 0000:00:1c.5 to 64
[    0.438593] assign_interrupt_mode Found MSI capability
[    0.438593] Allocate Port Service[0000:00:1c.5:pcie00]
[    0.438593] Allocate Port Service[0000:00:1c.5:pcie02]
[    0.438593] Allocate Port Service[0000:00:1c.5:pcie03]
[    0.438593] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    0.440151] ACPI: ACPI0007:00 is registered as cooling_device0
[    0.440582] ACPI: ACPI0007:01 is registered as cooling_device1
[    0.443582] isapnp: Scanning for PnP cards...
[    0.504198] Switched to high resolution mode on CPU 1
[    0.504653] Switched to high resolution mode on CPU 0
[    0.799300] isapnp: No Plug & Play device found
[    0.802086] hpet_resources: 0xfed00000 is busy
[    0.802189] Non-volatile memory driver v1.2
[    0.802225] Linux agpgart interface v0.103
[    0.802752] Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
[    1.047399] serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    1.048349] 00:06: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    1.094351] brd: module loaded
[    1.094351] input: Macintosh mouse button emulation as /class/input/input0
[    1.094351] PNP: PS/2 Controller [PNP0303:PS2K,PNP0f03:PS2M] at 0x60,0x64 irq 1,12
[    1.098331] serio: i8042 KBD port at 0x60,0x64 irq 1
[    1.098336] serio: i8042 AUX port at 0x60,0x64 irq 12
[    1.099348] mice: PS/2 mouse device common for all mice
[    1.127348] input: AT Translated Set 2 keyboard as /class/input/input1
[    1.133588] cpuidle: using governor ladder
[    1.133588] cpuidle: using governor menu
[    1.133588] usbcore: registered new interface driver hiddev
[    1.133588] usbcore: registered new interface driver usbhid
[    1.133588] usbhid: v2.6:USB HID core driver
[    1.133588] TCP cubic registered
[    1.133588] Initializing XFRM netlink socket
[    1.133588] NET: Registered protocol family 17
[    1.134348] Starting balanced_irq
[    1.134348] Using IPI No-Shortcut mode
[    1.134348] registered taskstats version 1
[    1.134348] kmemtrace: fully up.
[    1.134514] debug: unmapping init memory c0495000..c04db000
[    1.134568] Write protecting the kernel text: 2340k
[    1.134583] Write protecting the kernel read-only data: 1084k
[    1.473415] USB Universal Host Controller Interface driver v3.0
[    1.473415] ACPI: PCI Interrupt 0000:00:1a.0[A] -> GSI 16 (level, low) -> IRQ 16
[    1.473415] PCI: Setting latency timer of device 0000:00:1a.0 to 64
[    1.473415] uhci_hcd 0000:00:1a.0: UHCI Host Controller
[    1.473415] uhci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    1.473415] uhci_hcd 0000:00:1a.0: irq 16, io base 0x0000dc00
[    1.473415] usb usb1: configuration #1 chosen from 1 choice
[    1.473415] hub 1-0:1.0: USB hub found
[    1.473415] hub 1-0:1.0: 2 ports detected
[    1.574445] ACPI: PCI Interrupt 0000:00:1a.1[B] -> GSI 17 (level, low) -> IRQ 17
[    1.574445] PCI: Setting latency timer of device 0000:00:1a.1 to 64
[    1.574445] uhci_hcd 0000:00:1a.1: UHCI Host Controller
[    1.574445] uhci_hcd 0000:00:1a.1: new USB bus registered, assigned bus number 2
[    1.574445] uhci_hcd 0000:00:1a.1: irq 17, io base 0x0000e000
[    1.574445] usb usb2: configuration #1 chosen from 1 choice
[    1.574445] hub 2-0:1.0: USB hub found
[    1.574445] hub 2-0:1.0: 2 ports detected
[    1.674923] ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 23 (level, low) -> IRQ 23
[    1.674931] PCI: Setting latency timer of device 0000:00:1d.0 to 64
[    1.674935] uhci_hcd 0000:00:1d.0: UHCI Host Controller
[    1.675030] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 3
[    1.675054] uhci_hcd 0000:00:1d.0: irq 23, io base 0x0000d480
[    1.675141] usb usb3: configuration #1 chosen from 1 choice
[    1.675190] hub 3-0:1.0: USB hub found
[    1.675197] hub 3-0:1.0: 2 ports detected
[    1.822733] ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 19
[    1.822741] PCI: Setting latency timer of device 0000:00:1d.1 to 64
[    1.822745] uhci_hcd 0000:00:1d.1: UHCI Host Controller
[    1.822835] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 4
[    1.822858] uhci_hcd 0000:00:1d.1: irq 19, io base 0x0000d800
[    1.822949] usb usb4: configuration #1 chosen from 1 choice
[    1.822994] hub 4-0:1.0: USB hub found
[    1.823002] hub 4-0:1.0: 2 ports detected
[    1.882432] input: ImPS/2 Generic Wheel Mouse as /class/input/input2
[    1.923824] ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 18
[    1.923833] PCI: Setting latency timer of device 0000:00:1d.2 to 64
[    1.923836] uhci_hcd 0000:00:1d.2: UHCI Host Controller
[    1.923938] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 5
[    1.923962] uhci_hcd 0000:00:1d.2: irq 18, io base 0x0000d880
[    1.924054] usb usb5: configuration #1 chosen from 1 choice
[    1.924100] hub 5-0:1.0: USB hub found
[    1.924107] hub 5-0:1.0: 2 ports detected
[    2.024868] insmod used greatest stack depth: 2192 bytes left
[    2.026422] ohci_hcd: 2006 August 04 USB 1.1 'Open' Host Controller (OHCI) Driver
[    2.027728] ACPI: PCI Interrupt 0000:00:1a.7[C] -> GSI 18 (level, low) -> IRQ 18
[    2.027728] PCI: Setting latency timer of device 0000:00:1a.7 to 64
[    2.027728] ehci_hcd 0000:00:1a.7: EHCI Host Controller
[    2.027728] ehci_hcd 0000:00:1a.7: new USB bus registered, assigned bus number 6
[    2.031633] ehci_hcd 0000:00:1a.7: debug port 1
[    2.031638] PCI: cache line size of 32 is not supported by device 0000:00:1a.7
[    2.031643] ehci_hcd 0000:00:1a.7: irq 18, io mem 0xfebffc00
[    2.040892] ehci_hcd 0000:00:1a.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
[    2.041728] usb usb6: configuration #1 chosen from 1 choice
[    2.041728] hub 6-0:1.0: USB hub found
[    2.041728] hub 6-0:1.0: 4 ports detected
[    2.142728] ACPI: PCI Interrupt 0000:00:1d.7[A] -> GSI 23 (level, low) -> IRQ 23
[    2.142728] PCI: Setting latency timer of device 0000:00:1d.7 to 64
[    2.142728] ehci_hcd 0000:00:1d.7: EHCI Host Controller
[    2.142728] ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 7
[    2.146799] ehci_hcd 0000:00:1d.7: debug port 1
[    2.146804] PCI: cache line size of 32 is not supported by device 0000:00:1d.7
[    2.146809] ehci_hcd 0000:00:1d.7: irq 23, io mem 0xfebff800
[    2.156528] ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
[    2.156907] usb usb7: configuration #1 chosen from 1 choice
[    2.156907] hub 7-0:1.0: USB hub found
[    2.156907] hub 7-0:1.0: 6 ports detected
[    2.286503] SCSI subsystem initialized
[    2.287502] Driver 'sd' needs updating - please use bus_type methods
[    2.289386] No dock devices found.
[    2.296502] libata version 3.00 loaded.
[    2.298827] ata_piix 0000:00:1f.2: version 2.12
[    2.298827] ACPI: PCI Interrupt 0000:00:1f.2[B] -> GSI 19 (level, low) -> IRQ 19
[    2.298827] ata_piix 0000:00:1f.2: MAP [ P0 P2 P1 P3 ]
[    2.298827] PCI: Setting latency timer of device 0000:00:1f.2 to 64
[    2.298827] scsi0 : ata_piix
[    2.298827] scsi1 : ata_piix
[    2.301456] ata1: SATA max UDMA/133 cmd 0xec00 ctl 0xe880 bmdma 0xe400 irq 19
[    2.301456] ata2: SATA max UDMA/133 cmd 0xe800 ctl 0xe480 bmdma 0xe408 irq 19
[    2.616466] ata1: SATA link down (SStatus 0 SControl 300)
[    3.071620] ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[    3.121516] ata2.00: ATA-7: ST3500630AS, 3.AAK, max UDMA/133
[    3.121516] ata2.00: 976773168 sectors, multi 16: LBA48 NCQ (depth 0/32)
[    3.196547] ata2.00: configured for UDMA/133
[    3.242112] scsi 1:0:0:0: Direct-Access     ATA      ST3500630AS      3.AA PQ: 0 ANSI: 5
[    3.242265] sd 1:0:0:0: [sda] 976773168 512-byte hardware sectors (500108 MB)
[    3.242281] sd 1:0:0:0: [sda] Write Protect is off
[    3.242283] sd 1:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    3.242312] sd 1:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    3.242371] sd 1:0:0:0: [sda] 976773168 512-byte hardware sectors (500108 MB)
[    3.242387] sd 1:0:0:0: [sda] Write Protect is off
[    3.242390] sd 1:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    3.242418] sd 1:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    3.242422]  sda: sda1 sda2 sda3 sda4 < sda5 sda6 sda7 sda8 sda9 >
[    3.242371] sd 1:0:0:0: [sda] Attached SCSI disk
[    3.242371] ACPI: PCI Interrupt 0000:00:1f.5[B] -> GSI 19 (level, low) -> IRQ 19
[    3.242371] ata_piix 0000:00:1f.5: MAP [ P0 -- P1 -- ]
[    3.242371] PCI: Setting latency timer of device 0000:00:1f.5 to 64
[    3.242371] scsi2 : ata_piix
[    3.294774] scsi3 : ata_piix
[    3.333786] ata3: SATA max UDMA/133 cmd 0xd400 ctl 0xd080 bmdma 0xc880 irq 19
[    3.333790] ata4: SATA max UDMA/133 cmd 0xd000 ctl 0xcc00 bmdma 0xc888 irq 19
[    3.788939] ata3: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[    3.832769] ata3.00: ATA-7: ST3500630AS, 3.AAK, max UDMA/133
[    3.832769] ata3.00: 976773168 sectors, multi 16: LBA48 NCQ (depth 0/32)
[    3.907736] ata3.00: configured for UDMA/133
[    4.224168] ata4: SATA link down (SStatus 0 SControl 300)
[    4.224137] scsi 2:0:0:0: Direct-Access     ATA      ST3500630AS      3.AA PQ: 0 ANSI: 5
[    4.224137] sd 2:0:0:0: [sdb] 976773168 512-byte hardware sectors (500108 MB)
[    4.224137] sd 2:0:0:0: [sdb] Write Protect is off
[    4.224137] sd 2:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[    4.224137] sd 2:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    4.224137] sd 2:0:0:0: [sdb] 976773168 512-byte hardware sectors (500108 MB)
[    4.225696] sd 2:0:0:0: [sdb] Write Protect is off
[    4.225698] sd 2:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[    4.225728] sd 2:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    4.225732]  sdb: sdb1 sdb2 sdb3 sdb4 < sdb5 sdb6 sdb7 >
[    4.257100] sd 2:0:0:0: [sdb] Attached SCSI disk
[    4.257100] insmod used greatest stack depth: 1148 bytes left
[    4.280126] ahci 0000:03:00.0: version 3.0
[    4.280126] ACPI: PCI Interrupt 0000:03:00.0[A] -> GSI 16 (level, low) -> IRQ 16
[    5.280074] ahci 0000:03:00.0: AHCI 0001.0000 32 slots 2 ports 3 Gbps 0x3 impl SATA mode
[    5.280079] ahci 0000:03:00.0: flags: 64bit ncq pm led clo pmp pio slum part 
[    5.280085] PCI: Setting latency timer of device 0000:03:00.0 to 64
[    5.281126] scsi4 : ahci
[    5.281126] scsi5 : ahci
[    5.281126] ata5: SATA max UDMA/133 abar m8192@0xfe9fe000 port 0xfe9fe100 irq 16
[    5.281126] ata6: SATA max UDMA/133 abar m8192@0xfe9fe000 port 0xfe9fe180 irq 16
[    5.586125] ata5: SATA link down (SStatus 0 SControl 300)
[    5.891451] ata6: SATA link down (SStatus 0 SControl 300)
[    6.046814] device-mapper: ioctl: 4.13.0-ioctl (2007-10-18) initialised: dm-devel@redhat.com
[    6.702735] EXT3-fs: INFO: recovery required on readonly filesystem.
[    6.702739] EXT3-fs: write access will be enabled during recovery.
[    7.592486] kjournald starting.  Commit interval 5 seconds
[    7.592486] EXT3-fs: recovery complete.
[    7.592486] EXT3-fs: mounted filesystem with ordered data mode.
[   10.298028] input: PC Speaker as /class/input/input3
[   10.568464] i801_smbus 0000:00:1f.3: enabling device (0001 -> 0003)
[   10.568471] ACPI: PCI Interrupt 0000:00:1f.3[C] -> GSI 18 (level, low) -> IRQ 18
[   10.582560] iTCO_vendor_support: vendor-support=0
[   10.629824] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.03 (30-Apr-2008)
[   10.629895] iTCO_wdt: Found a ICH8 or ICH8R TCO device (Version=2, TCOBASE=0x0860)
[   10.629925] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0)
[   10.682604] ACPI: PCI Interrupt 0000:02:00.0[A] -> GSI 17 (level, low) -> IRQ 17
[   10.682615] PCI: Setting latency timer of device 0000:02:00.0 to 64
[   10.682640] sky2 0000:02:00.0: v1.21 addr 0xfe8fc000 irq 17 Yukon-EC Ultra (0xb4) rev 2
[   10.682995] sky2 eth0: addr 00:18:f3:b4:7e:ff
[   10.692043] ACPI: PCI Interrupt 0000:05:03.0[A] -> GSI 21 (level, low) -> IRQ 21
[   10.741965] ohci1394: fw-host0: OHCI-1394 1.1 (PCI): IRQ=[21]  MMIO=[feaff800-feafffff]  Max Packet=[2048]  IR/IT contexts=[4/8]
[   10.778036] input: Power Button (FF) as /class/input/input4
[   10.788413] ACPI: Power Button (FF) [PWRF]
[   10.788833] input: Power Button (CM) as /class/input/input5
[   10.802698] ACPI: Power Button (CM) [PWRB]
[   11.300653] ACPI: PCI Interrupt 0000:00:1b.0[A] -> GSI 22 (level, low) -> IRQ 22
[   11.300653] PCI: Setting latency timer of device 0000:00:1b.0 to 64
[   11.363615] Floppy drive(s): fd0 is 1.44M
[   11.379214] FDC 0 is a post-1991 82077
[   11.450050] sd 1:0:0:0: Attached scsi generic sg0 type 0
[   11.450077] sd 2:0:0:0: Attached scsi generic sg1 type 0
[   11.933177] usbcore: registered new interface driver snd-usb-audio
[   12.008359] ieee1394: Host added: ID:BUS[0-00:1023]  GUID[0011d80000f5cea6]
[   13.061098] lp: driver loaded but no devices found
[   13.104743] sonypi: Sony Programmable I/O Controller Driver v1.26.
[   14.313990] NET: Registered protocol family 10
[   14.314918] lo: Disabled Privacy Extensions
[   19.907602] md: Autodetecting RAID arrays.
[   19.907606] md: Scanned 0 and added 0 devices.
[   19.907608] md: autorun ...
[   19.907609] md: ... autorun DONE.
[   20.010712] device-mapper: multipath: version 1.0.5 loaded
[   22.792195] EXT3 FS on sda5, internal journal
[   22.841599] kjournald starting.  Commit interval 5 seconds
[   22.841599] EXT3 FS on dm-0, internal journal
[   22.841599] EXT3-fs: mounted filesystem with ordered data mode.
[   22.864076] kjournald starting.  Commit interval 5 seconds
[   22.864076] EXT3 FS on sdb1, internal journal
[   22.864076] EXT3-fs: mounted filesystem with ordered data mode.
[   22.878096] kjournald starting.  Commit interval 5 seconds
[   22.878096] EXT3 FS on sdb2, internal journal
[   22.878096] EXT3-fs: mounted filesystem with ordered data mode.
[   22.909013] kjournald starting.  Commit interval 5 seconds
[   22.909013] EXT3 FS on sdb7, internal journal
[   22.909013] EXT3-fs: mounted filesystem with ordered data mode.
[   23.254178] Adding 4192924k swap on /dev/sda7.  Priority:-1 extents:1 across:4192924k
[   23.867059] warning: process `kudzu' used the deprecated sysctl system call with 1.23.
[   32.264167] sky2 eth0: enabling interface
[   32.267244] ADDRCONF(NETDEV_UP): eth0: link is not ready
[   34.021787] sky2 eth0: Link is up at 100 Mbps, full duplex, flow control both
[   34.022822] ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   35.254096] RPC: Registered udp transport module.
[   35.254099] RPC: Registered tcp transport module.
[   35.677174] warning: `dbus-daemon' uses 32-bit capabilities (legacy support in use)
[   35.830545] Bluetooth: Core ver 2.11
[   35.830545] NET: Registered protocol family 31
[   35.830545] Bluetooth: HCI device and connection manager initialized
[   35.830545] Bluetooth: HCI socket layer initialized
[   35.888869] Bluetooth: L2CAP ver 2.9
[   35.888871] Bluetooth: L2CAP socket layer initialized
[   36.174458] Bluetooth: RFCOMM socket layer initialized
[   36.174458] Bluetooth: RFCOMM TTY layer initialized
[   36.174458] Bluetooth: RFCOMM ver 1.8
[   36.527596] Bluetooth: HIDP (Human Interface Emulation) ver 1.2
[   36.644954] ip6_tables: (C) 2000-2006 Netfilter Core Team
[   36.866640] ip_tables: (C) 2000-2006 Netfilter Core Team
[   36.962365] nf_conntrack version 0.5.0 (16384 buckets, 65536 max)
[   44.635596] eth0: no IPv6 routers present
[  175.815965] loop: module loaded
[21475.095572] firefox-bin invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[21475.095579] Pid: 6624, comm: firefox-bin Not tainted 2.6.26 #1
[21475.095593]  [<c015b64f>] oom_kill_process+0x42/0x183
[21475.095603]  [<c015ba76>] out_of_memory+0x157/0x188
[21475.095611]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[21475.095620]  [<c015d9fe>] __alloc_pages+0xa/0xc
[21475.095624]  [<c015da12>] __get_free_pages+0x12/0x21
[21475.095628]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[21475.095632]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[21475.095641]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[21475.095647]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[21475.095655]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[21475.095661]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[21475.095671]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[21475.095682]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[21475.095687]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[21475.095696]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[21475.095704]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21475.095710]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21475.095717]  [<c01799fc>] do_readv_writev+0x85/0x140
[21475.095721]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[21475.095728]  [<c0140adc>] ? tick_program_event+0x31/0x55
[21475.095735]  [<c0179af0>] vfs_writev+0x39/0x49
[21475.095740]  [<c0179f44>] sys_writev+0x3b/0x8e
[21475.095746]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[21475.095755]  =======================
[21475.095757] Mem-info:
[21475.095759] DMA per-cpu:
[21475.095761] CPU    0: hi:    0, btch:   1 usd:   0
[21475.095762] CPU    1: hi:    0, btch:   1 usd:   0
[21475.095764] Normal per-cpu:
[21475.095766] CPU    0: hi:  186, btch:  31 usd:   0
[21475.095768] CPU    1: hi:  186, btch:  31 usd:   0
[21475.095769] HighMem per-cpu:
[21475.095771] CPU    0: hi:  186, btch:  31 usd:   0
[21475.095773] CPU    1: hi:  186, btch:  31 usd:   0
[21475.095776] Active:195739 inactive:51101 dirty:58 writeback:0 unstable:0
[21475.095777]  free:359761 slab:3261 mapped:20476 pagetables:995 bounce:0
[21475.095780] DMA free:4584kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[21475.095782] lowmem_reserve[]: 0 873 2968 2968
[21475.095787] Normal free:268496kB min:3744kB low:4680kB high:5616kB active:8kB inactive:256kB present:894080kB pages_scanned:0 all_unreclaimable? no
[21475.095790] lowmem_reserve[]: 0 0 16760 16760
[21475.095795] HighMem free:1165964kB min:512kB low:2760kB high:5008kB active:782948kB inactive:204148kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[21475.095797] lowmem_reserve[]: 0 0 0 0
[21475.095800] DMA: 1132*4kB 5*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4584kB
[21475.095809] Normal: 63667*4kB 1604*8kB 11*16kB 1*32kB 1*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 268540kB
[21475.095817] HighMem: 9*4kB 946*8kB 2445*16kB 1725*32kB 899*64kB 690*128kB 457*256kB 249*512kB 82*1024kB 46*2048kB 121*4096kB = 1166052kB
[21475.095826] 71490 total pagecache pages
[21475.095828] Swap cache: add 0, delete 0, find 0/0
[21475.095829] Free swap  = 4192924kB
[21475.095831] Total swap = 4192924kB
[21475.103979] 769936 pages of RAM
[21475.103981] 540560 pages of HIGHMEM
[21475.103983] 8147 reserved pages
[21475.103984] 83931 pages shared
[21475.103985] 0 pages swap cached
[21475.103987] 58 pages dirty
[21475.103988] 0 pages writeback
[21475.103989] 20476 pages mapped
[21475.103991] 3261 pages slab
[21475.103992] 995 pages pagetables
[21475.103995] Out of memory: kill process 6618 (run-mozilla.sh) score 69179 or a child
[21475.104015] Killed process 6624 (firefox-bin)
[21476.753795] wnck-applet invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[21476.753801] Pid: 4586, comm: wnck-applet Not tainted 2.6.26 #1
[21476.753998]  [<c015b64f>] oom_kill_process+0x42/0x183
[21476.754009]  [<c015ba76>] out_of_memory+0x157/0x188
[21476.754017]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[21476.754026]  [<c015d9fe>] __alloc_pages+0xa/0xc
[21476.754030]  [<c015da12>] __get_free_pages+0x12/0x21
[21476.754034]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[21476.754038]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[21476.754046]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[21476.754052]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[21476.754061]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[21476.754067]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[21476.754077]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[21476.754089]  [<c0179485>] do_sync_write+0xab/0xe9
[21476.754094]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[21476.754102]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[21476.754111]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21476.754117]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21476.754125]  [<c0179be3>] vfs_write+0x9d/0x133
[21476.754130]  [<c017a1d8>] sys_write+0x3b/0x60
[21476.754136]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[21476.754143]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[21476.754150]  =======================
[21476.754152] Mem-info:
[21476.754153] DMA per-cpu:
[21476.754155] CPU    0: hi:    0, btch:   1 usd:   0
[21476.754157] CPU    1: hi:    0, btch:   1 usd:   0
[21476.754159] Normal per-cpu:
[21476.754161] CPU    0: hi:  186, btch:  31 usd:   0
[21476.754163] CPU    1: hi:  186, btch:  31 usd:   0
[21476.754165] HighMem per-cpu:
[21476.754167] CPU    0: hi:  186, btch:  31 usd:   0
[21476.754169] CPU    1: hi:  186, btch:  31 usd:   0
[21476.754172] Active:55714 inactive:48863 dirty:65 writeback:0 unstable:0
[21476.754173]  free:502317 slab:3204 mapped:12983 pagetables:734 bounce:0
[21476.754176] DMA free:4584kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[21476.754178] lowmem_reserve[]: 0 873 2968 2968
[21476.754184] Normal free:268544kB min:3744kB low:4680kB high:5616kB active:0kB inactive:200kB present:894080kB pages_scanned:0 all_unreclaimable? no
[21476.754186] lowmem_reserve[]: 0 0 16760 16760
[21476.754191] HighMem free:1736140kB min:512kB low:2760kB high:5008kB active:222856kB inactive:195252kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[21476.754194] lowmem_reserve[]: 0 0 0 0
[21476.754197] DMA: 1132*4kB 5*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4584kB
[21476.754207] Normal: 63743*4kB 1564*8kB 22*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 268668kB
[21476.754216] HighMem: 8641*4kB 6909*8kB 5306*16kB 3773*32kB 2219*64kB 1334*128kB 770*256kB 364*512kB 129*1024kB 53*2048kB 123*4096kB = 1736172kB
[21476.754226] 69077 total pagecache pages
[21476.754228] Swap cache: add 0, delete 0, find 0/0
[21476.754230] Free swap  = 4192924kB
[21476.754232] Total swap = 4192924kB
[21476.761679] 769936 pages of RAM
[21476.761679] 540560 pages of HIGHMEM
[21476.761679] 8147 reserved pages
[21476.761679] 66839 pages shared
[21476.761679] 0 pages swap cached
[21476.761679] 65 pages dirty
[21476.761679] 0 pages writeback
[21476.761679] 12983 pages mapped
[21476.761679] 3204 pages slab
[21476.761679] 734 pages pagetables
[21476.761679] Out of memory: kill process 4517 (nautilus) score 1993 or a child
[21476.761679] Killed process 4517 (nautilus)
[21482.899546] Xorg invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[21482.899553] Pid: 3723, comm: Xorg Not tainted 2.6.26 #1
[21482.899570]  [<c015b64f>] oom_kill_process+0x42/0x183
[21482.899581]  [<c015ba76>] out_of_memory+0x157/0x188
[21482.899590]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[21482.899652]  [<c015d9fe>] __alloc_pages+0xa/0xc
[21482.899652]  [<c015da12>] __get_free_pages+0x12/0x21
[21482.899652]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[21482.899652]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[21482.899652]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[21482.899652]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[21482.899652]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[21482.899652]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[21482.899652]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[21482.899652]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[21482.899652]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[21482.899652]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[21482.899652]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21482.899652]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21482.899652]  [<c01799fc>] do_readv_writev+0x85/0x140
[21482.899652]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[21482.899652]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21482.899657]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21482.899664]  [<c0179af0>] vfs_writev+0x39/0x49
[21482.899670]  [<c0179f44>] sys_writev+0x3b/0x8e
[21482.899675]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[21482.899685]  =======================
[21482.899687] Mem-info:
[21482.899688] DMA per-cpu:
[21482.899690] CPU    0: hi:    0, btch:   1 usd:   0
[21482.899692] CPU    1: hi:    0, btch:   1 usd:   0
[21482.899694] Normal per-cpu:
[21482.899696] CPU    0: hi:  186, btch:  31 usd:   0
[21482.899698] CPU    1: hi:  186, btch:  31 usd:   0
[21482.899699] HighMem per-cpu:
[21482.899701] CPU    0: hi:  186, btch:  31 usd:   0
[21482.899703] CPU    1: hi:  186, btch:  31 usd:   0
[21482.899706] Active:55117 inactive:40761 dirty:128 writeback:0 unstable:0
[21482.899707]  free:511048 slab:3097 mapped:12939 pagetables:739 bounce:0
[21482.899710] DMA free:4584kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[21482.899713] lowmem_reserve[]: 0 873 2968 2968
[21482.899718] Normal free:266544kB min:3744kB low:4680kB high:5616kB active:512kB inactive:1860kB present:894080kB pages_scanned:0 all_unreclaimable? no
[21482.899720] lowmem_reserve[]: 0 0 16760 16760
[21482.899725] HighMem free:1773064kB min:512kB low:2760kB high:5008kB active:219956kB inactive:161184kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[21482.899728] lowmem_reserve[]: 0 0 0 0
[21482.899731] DMA: 1132*4kB 5*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4584kB
[21482.899739] Normal: 63189*4kB 1558*8kB 31*16kB 1*32kB 1*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 266580kB
[21482.899748] HighMem: 2961*4kB 5284*8kB 4259*16kB 3334*32kB 2420*64kB 1564*128kB 849*256kB 416*512kB 133*1024kB 58*2048kB 123*4096kB = 1773140kB
[21482.899998] 59604 total pagecache pages
[21482.900000] Swap cache: add 0, delete 0, find 0/0
[21482.900002] Free swap  = 4192924kB
[21482.900004] Total swap = 4192924kB
[21482.907457] 769936 pages of RAM
[21482.907459] 540560 pages of HIGHMEM
[21482.907460] 8147 reserved pages
[21482.907461] 64600 pages shared
[21482.907463] 0 pages swap cached
[21482.907464] 128 pages dirty
[21482.907465] 0 pages writeback
[21482.907467] 12939 pages mapped
[21482.907468] 3097 pages slab
[21482.907469] 739 pages pagetables
[21482.907472] Out of memory: kill process 6946 (nautilus) score 1994 or a child
[21482.907491] Killed process 6946 (nautilus)
[21484.950984] Xorg invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[21484.950984] Pid: 3723, comm: Xorg Not tainted 2.6.26 #1
[21484.950984]  [<c015b64f>] oom_kill_process+0x42/0x183
[21484.950984]  [<c015ba76>] out_of_memory+0x157/0x188
[21484.950984]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[21484.950984]  [<c015d9fe>] __alloc_pages+0xa/0xc
[21484.950984]  [<c015da12>] __get_free_pages+0x12/0x21
[21484.950984]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[21484.950984]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[21484.950991]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[21484.950997]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[21484.951005]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[21484.951016]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[21484.951028]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[21484.951033]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[21484.951041]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[21484.951050]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21484.951056]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21484.951063]  [<c01799fc>] do_readv_writev+0x85/0x140
[21484.951067]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[21484.951073]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21484.951078]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21484.951085]  [<c0179af0>] vfs_writev+0x39/0x49
[21484.951090]  [<c0179f44>] sys_writev+0x3b/0x8e
[21484.951096]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[21484.951105]  =======================
[21484.951107] Mem-info:
[21484.951108] DMA per-cpu:
[21484.951110] CPU    0: hi:    0, btch:   1 usd:   0
[21484.951112] CPU    1: hi:    0, btch:   1 usd:   0
[21484.951114] Normal per-cpu:
[21484.951116] CPU    0: hi:  186, btch:  31 usd:  61
[21484.951118] CPU    1: hi:  186, btch:  31 usd:   0
[21484.951119] HighMem per-cpu:
[21484.951121] CPU    0: hi:  186, btch:  31 usd:   0
[21484.951123] CPU    1: hi:  186, btch:  31 usd:   0
[21484.951126] Active:54148 inactive:40330 dirty:62 writeback:1 unstable:0
[21484.951127]  free:512295 slab:3094 mapped:12845 pagetables:736 bounce:0
[21484.951131] DMA free:4584kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[21484.951133] lowmem_reserve[]: 0 873 2968 2968
[21484.951138] Normal free:267064kB min:3744kB low:4680kB high:5616kB active:548kB inactive:740kB present:894080kB pages_scanned:0 all_unreclaimable? no
[21484.951140] lowmem_reserve[]: 0 0 16760 16760
[21484.951145] HighMem free:1777532kB min:512kB low:2760kB high:5008kB active:216044kB inactive:160580kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[21484.951148] lowmem_reserve[]: 0 0 0 0
[21484.951151] DMA: 1132*4kB 5*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4584kB
[21484.951159] Normal: 63433*4kB 1559*8kB 2*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 267068kB
[21484.951168] HighMem: 3744*4kB 5218*8kB 4196*16kB 3293*32kB 2378*64kB 1564*128kB 854*256kB 423*512kB 133*1024kB 59*2048kB 123*4096kB = 1777648kB
[21484.951176] 59289 total pagecache pages
[21484.951179] Swap cache: add 0, delete 0, find 0/0
[21484.951180] Free swap  = 4192924kB
[21484.951182] Total swap = 4192924kB
[21484.958668] 769936 pages of RAM
[21484.958795] 540560 pages of HIGHMEM
[21484.958795] 8147 reserved pages
[21484.958795] 64062 pages shared
[21484.958795] 0 pages swap cached
[21484.958795] 62 pages dirty
[21484.958795] 1 pages writeback
[21484.958795] 12882 pages mapped
[21484.958795] 3094 pages slab
[21484.958795] 736 pages pagetables
[21484.958795] Out of memory: kill process 6964 (nautilus) score 2050 or a child
[21484.958795] Killed process 6964 (nautilus)
[21489.651904] Xorg invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[21489.651904] Pid: 3723, comm: Xorg Not tainted 2.6.26 #1
[21489.651904]  [<c015b64f>] oom_kill_process+0x42/0x183
[21489.651904]  [<c015ba76>] out_of_memory+0x157/0x188
[21489.651904]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[21489.651904]  [<c015d9fe>] __alloc_pages+0xa/0xc
[21489.651904]  [<c015da12>] __get_free_pages+0x12/0x21
[21489.651904]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[21489.651904]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[21489.651904]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[21489.651904]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[21489.651908]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[21489.651916]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[21489.651929]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[21489.651943]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[21489.651950]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[21489.651961]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[21489.651972]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21489.651980]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21489.651988]  [<c01799fc>] do_readv_writev+0x85/0x140
[21489.651993]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[21489.652001]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21489.652009]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21489.652017]  [<c0179af0>] vfs_writev+0x39/0x49
[21489.652024]  [<c0179f44>] sys_writev+0x3b/0x8e
[21489.652031]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[21489.652052]  =======================
[21489.652054] Mem-info:
[21489.652055] DMA per-cpu:
[21489.652057] CPU    0: hi:    0, btch:   1 usd:   0
[21489.652059] CPU    1: hi:    0, btch:   1 usd:   0
[21489.652061] Normal per-cpu:
[21489.652062] CPU    0: hi:  186, btch:  31 usd:   0
[21489.652064] CPU    1: hi:  186, btch:  31 usd:   0
[21489.652066] HighMem per-cpu:
[21489.652068] CPU    0: hi:  186, btch:  31 usd:   0
[21489.652069] CPU    1: hi:  186, btch:  31 usd:   0
[21489.652072] Active:55396 inactive:37498 dirty:12 writeback:126 unstable:0
[21489.652074]  free:513798 slab:2955 mapped:12986 pagetables:739 bounce:0
[21489.652077] DMA free:4584kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? yes
[21489.652079] lowmem_reserve[]: 0 873 2968 2968
[21489.652084] Normal free:267096kB min:3744kB low:4680kB high:5616kB active:48kB inactive:960kB present:894080kB pages_scanned:385 all_unreclaimable? no
[21489.652087] lowmem_reserve[]: 0 0 16760 16760
[21489.652092] HighMem free:1783512kB min:512kB low:2760kB high:5008kB active:221536kB inactive:149160kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[21489.652094] lowmem_reserve[]: 0 0 0 0
[21489.652098] DMA: 1132*4kB 5*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4584kB
[21489.652106] Normal: 63556*4kB 1507*8kB 4*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 267176kB
[21489.652114] HighMem: 2061*4kB 4567*8kB 3592*16kB 2860*32kB 2130*64kB 1530*128kB 881*256kB 458*512kB 145*1024kB 59*2048kB 129*4096kB = 1783660kB
[21489.652123] 56517 total pagecache pages
[21489.652125] Swap cache: add 0, delete 0, find 0/0
[21489.652127] Free swap  = 4192924kB
[21489.652128] Total swap = 4192924kB
[21489.659759] 769936 pages of RAM
[21489.659761] 540560 pages of HIGHMEM
[21489.659762] 8147 reserved pages
[21489.659764] 63258 pages shared
[21489.659765] 0 pages swap cached
[21489.659766] 12 pages dirty
[21489.659768] 76 pages writeback
[21489.659769] 12986 pages mapped
[21489.659770] 2955 pages slab
[21489.659772] 739 pages pagetables
[21489.659774] Out of memory: kill process 6976 (nautilus) score 2124 or a child
[21489.659794] Killed process 6976 (nautilus)
[21489.661913] Xorg invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[21489.661918] Pid: 3723, comm: Xorg Not tainted 2.6.26 #1
[21489.661932]  [<c015b64f>] oom_kill_process+0x42/0x183
[21489.661943]  [<c015ba76>] out_of_memory+0x157/0x188
[21489.661951]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[21489.661959]  [<c015d9fe>] __alloc_pages+0xa/0xc
[21489.661964]  [<c015da12>] __get_free_pages+0x12/0x21
[21489.661968]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[21489.661972]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[21489.661980]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[21489.661986]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[21489.661994]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[21489.662005]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[21489.662017]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[21489.662021]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[21489.662030]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[21489.662039]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21489.662045]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21489.662051]  [<c01799fc>] do_readv_writev+0x85/0x140
[21489.662055]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[21489.662061]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21489.662068]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21489.662075]  [<c0179af0>] vfs_writev+0x39/0x49
[21489.662080]  [<c0179f44>] sys_writev+0x3b/0x8e
[21489.662085]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[21489.662095]  =======================
[21489.662096] Mem-info:
[21489.662098] DMA per-cpu:
[21489.662100] CPU    0: hi:    0, btch:   1 usd:   0
[21489.662101] CPU    1: hi:    0, btch:   1 usd:   0
[21489.662103] Normal per-cpu:
[21489.662105] CPU    0: hi:  186, btch:  31 usd:   1
[21489.662107] CPU    1: hi:  186, btch:  31 usd:   0
[21489.662108] HighMem per-cpu:
[21489.662110] CPU    0: hi:  186, btch:  31 usd:   0
[21489.662112] CPU    1: hi:  186, btch:  31 usd:   0
[21489.662115] Active:54511 inactive:37427 dirty:12 writeback:76 unstable:0
[21489.662116]  free:514770 slab:2955 mapped:12616 pagetables:739 bounce:0
[21489.662119] DMA free:4584kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? yes
[21489.662121] lowmem_reserve[]: 0 873 2968 2968
[21489.662127] Normal free:267084kB min:3744kB low:4680kB high:5616kB active:504kB inactive:548kB present:894080kB pages_scanned:64 all_unreclaimable? no
[21489.662129] lowmem_reserve[]: 0 0 16760 16760
[21489.662134] HighMem free:1787412kB min:512kB low:2760kB high:5008kB active:217096kB inactive:149160kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[21489.662137] lowmem_reserve[]: 0 0 0 0
[21489.662140] DMA: 1132*4kB 5*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4584kB
[21489.662148] Normal: 63555*4kB 1507*8kB 3*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 267156kB
[21489.662157] HighMem: 2533*4kB 4380*8kB 3431*16kB 2743*32kB 2043*64kB 1478*128kB 877*256kB 461*512kB 154*1024kB 63*2048kB 130*4096kB = 1787524kB
[21489.662165] 56517 total pagecache pages
[21489.662167] Swap cache: add 0, delete 0, find 0/0
[21489.662169] Free swap  = 4192924kB
[21489.662171] Total swap = 4192924kB
[21489.669770] 769936 pages of RAM
[21489.669772] 540560 pages of HIGHMEM
[21489.669774] 8147 reserved pages
[21489.669775] 56389 pages shared
[21489.669776] 0 pages swap cached
[21489.669778] 12 pages dirty
[21489.669779] 76 pages writeback
[21489.669780] 12431 pages mapped
[21489.669782] 2955 pages slab
[21489.669783] 702 pages pagetables
[21489.669786] Out of memory: kill process 4591 (trashapplet) score 1512 or a child
[21489.669805] Killed process 4591 (trashapplet)
[21489.676740] Xorg invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[21489.676740] Pid: 3723, comm: Xorg Not tainted 2.6.26 #1
[21489.676740]  [<c015b64f>] oom_kill_process+0x42/0x183
[21489.676740]  [<c015ba76>] out_of_memory+0x157/0x188
[21489.676740]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[21489.676740]  [<c015d9fe>] __alloc_pages+0xa/0xc
[21489.676740]  [<c015da12>] __get_free_pages+0x12/0x21
[21489.676740]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[21489.676740]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[21489.676740]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[21489.676740]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[21489.676740]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[21489.676740]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[21489.676740]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[21489.676740]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[21489.676740]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[21489.676740]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21489.676740]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21489.676740]  [<c01799fc>] do_readv_writev+0x85/0x140
[21489.676740]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[21489.676740]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21489.676740]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21489.676740]  [<c0179af0>] vfs_writev+0x39/0x49
[21489.676740]  [<c0179f44>] sys_writev+0x3b/0x8e
[21489.676740]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[21489.676740]  =======================
[21489.676740] Mem-info:
[21489.676740] DMA per-cpu:
[21489.676740] CPU    0: hi:    0, btch:   1 usd:   0
[21489.676740] CPU    1: hi:    0, btch:   1 usd:   0
[21489.676740] Normal per-cpu:
[21489.676740] CPU    0: hi:  186, btch:  31 usd:  30
[21489.676740] CPU    1: hi:  186, btch:  31 usd:   0
[21489.676740] HighMem per-cpu:
[21489.676740] CPU    0: hi:  186, btch:  31 usd:   0
[21489.676740] CPU    1: hi:  186, btch:  31 usd:   0
[21489.676740] Active:52962 inactive:37204 dirty:12 writeback:76 unstable:0
[21489.676740]  free:516595 slab:2955 mapped:12431 pagetables:702 bounce:0
[21489.676740] DMA free:4584kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? yes
[21489.676740] lowmem_reserve[]: 0 873 2968 2968
[21489.676740] Normal free:267084kB min:3744kB low:4680kB high:5616kB active:524kB inactive:396kB present:894080kB pages_scanned:131 all_unreclaimable? no
[21489.676740] lowmem_reserve[]: 0 0 16760 16760
[21489.676740] HighMem free:1794712kB min:512kB low:2760kB high:5008kB active:211324kB inactive:148420kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[21489.676740] lowmem_reserve[]: 0 0 0 0
[21489.676740] DMA: 1132*4kB 5*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4584kB
[21489.676740] Normal: 63525*4kB 1508*8kB 6*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 267092kB
[21489.676740] HighMem: 3766*4kB 4327*8kB 3385*16kB 2696*32kB 2022*64kB 1459*128kB 881*256kB 460*512kB 160*1024kB 64*2048kB 130*4096kB = 1794720kB
[21489.676740] 56221 total pagecache pages
[21489.676740] Swap cache: add 0, delete 0, find 0/0
[21489.676740] Free swap  = 4192924kB
[21489.676740] Total swap = 4192924kB
[21489.685721] 769936 pages of RAM
[21489.685721] 540560 pages of HIGHMEM
[21489.685721] 8147 reserved pages
[21489.685721] 50989 pages shared
[21489.685721] 0 pages swap cached
[21489.685721] 12 pages dirty
[21489.685721] 76 pages writeback
[21489.685721] 12431 pages mapped
[21489.685721] 2955 pages slab
[21489.685721] 702 pages pagetables
[21489.685721] Out of memory: kill process 4515 (gnome-panel) score 1300 or a child
[21489.685721] Killed process 4515 (gnome-panel)
[21490.272205] metacity invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[21490.272205] Pid: 4510, comm: metacity Not tainted 2.6.26 #1
[21490.272205]  [<c015b64f>] oom_kill_process+0x42/0x183
[21490.272205]  [<c015ba76>] out_of_memory+0x157/0x188
[21490.272205]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[21490.272205]  [<c015d9fe>] __alloc_pages+0xa/0xc
[21490.272205]  [<c015da12>] __get_free_pages+0x12/0x21
[21490.272205]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[21490.272205]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[21490.272205]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[21490.272205]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[21490.272205]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[21490.272954]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[21490.272964]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[21490.272975]  [<c0179485>] do_sync_write+0xab/0xe9
[21490.272980]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[21490.272988]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[21490.272997]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21490.273003]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21490.273010]  [<c0179be3>] vfs_write+0x9d/0x133
[21490.273016]  [<c017a1d8>] sys_write+0x3b/0x60
[21490.273021]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[21490.273819]  =======================
[21490.273821] Mem-info:
[21490.273822] DMA per-cpu:
[21490.273824] CPU    0: hi:    0, btch:   1 usd:   0
[21490.273826] CPU    1: hi:    0, btch:   1 usd:   0
[21490.273828] Normal per-cpu:
[21490.273830] CPU    0: hi:  186, btch:  31 usd:   0
[21490.273832] CPU    1: hi:  186, btch:  31 usd:   0
[21490.273834] HighMem per-cpu:
[21490.273836] CPU    0: hi:  186, btch:  31 usd:   0
[21490.273838] CPU    1: hi:  186, btch:  31 usd:   0
[21490.273841] Active:50444 inactive:37022 dirty:12 writeback:51 unstable:0
[21490.273842]  free:519394 slab:2944 mapped:7278 pagetables:574 bounce:0
[21490.273845] DMA free:4584kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[21490.273848] lowmem_reserve[]: 0 873 2968 2968
[21490.273853] Normal free:267632kB min:3744kB low:4680kB high:5616kB active:284kB inactive:168kB present:894080kB pages_scanned:0 all_unreclaimable? no
[21490.273855] lowmem_reserve[]: 0 0 16760 16760
[21490.273861] HighMem free:1805360kB min:512kB low:2760kB high:5008kB active:201492kB inactive:147920kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[21490.273863] lowmem_reserve[]: 0 0 0 0
[21490.273867] DMA: 1132*4kB 5*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4584kB
[21490.273877] Normal: 63683*4kB 1510*8kB 4*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 267708kB
[21490.273886] HighMem: 4120*4kB 4444*8kB 3447*16kB 2707*32kB 2023*64kB 1454*128kB 877*256kB 467*512kB 161*1024kB 64*2048kB 131*4096kB = 1805520kB
[21490.273896] 55703 total pagecache pages
[21490.273899] Swap cache: add 0, delete 0, find 0/0
[21490.273900] Free swap  = 4192924kB
[21490.273902] Total swap = 4192924kB
[21490.281665] 769936 pages of RAM
[21490.281667] 540560 pages of HIGHMEM
[21490.281669] 8147 reserved pages
[21490.281670] 29958 pages shared
[21490.281671] 0 pages swap cached
[21490.281673] 12 pages dirty
[21490.281674] 26 pages writeback
[21490.281675] 7278 pages mapped
[21490.281677] 2944 pages slab
[21490.281678] 574 pages pagetables
[21490.281681] Out of memory: kill process 6136 (gnome-terminal) score 1250 or a child
[21490.281700] Killed process 6141 (gnome-pty-helpe)
[21490.283688] metacity invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[21490.283688] Pid: 4510, comm: metacity Not tainted 2.6.26 #1
[21490.283688]  [<c015b64f>] oom_kill_process+0x42/0x183
[21490.283688]  [<c015ba76>] out_of_memory+0x157/0x188
[21490.283688]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[21490.283688]  [<c015d9fe>] __alloc_pages+0xa/0xc
[21490.283688]  [<c015da12>] __get_free_pages+0x12/0x21
[21490.283688]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[21490.283688]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[21490.283688]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[21490.283688]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[21490.283688]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[21490.283688]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[21490.283688]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[21490.283688]  [<c0179485>] do_sync_write+0xab/0xe9
[21490.283688]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[21490.283688]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[21490.283688]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21490.283688]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21490.283688]  [<c0179be3>] vfs_write+0x9d/0x133
[21490.283688]  [<c017a1d8>] sys_write+0x3b/0x60
[21490.283688]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[21490.283688]  =======================
[21490.283688] Mem-info:
[21490.283688] DMA per-cpu:
[21490.283688] CPU    0: hi:    0, btch:   1 usd:   0
[21490.283688] CPU    1: hi:    0, btch:   1 usd:   0
[21490.283688] Normal per-cpu:
[21490.283688] CPU    0: hi:  186, btch:  31 usd:   0
[21490.283688] CPU    1: hi:  186, btch:  31 usd:   0
[21490.283688] HighMem per-cpu:
[21490.283688] CPU    0: hi:  186, btch:  31 usd:   0
[21490.283688] CPU    1: hi:  186, btch:  31 usd:   0
[21490.283688] Active:50413 inactive:37055 dirty:12 writeback:26 unstable:0
[21490.283688]  free:519419 slab:2944 mapped:7278 pagetables:574 bounce:0
[21490.283688] DMA free:4584kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? yes
[21490.283688] lowmem_reserve[]: 0 873 2968 2968
[21490.283698] Normal free:267632kB min:3744kB low:4680kB high:5616kB active:160kB inactive:300kB present:894080kB pages_scanned:174 all_unreclaimable? no
[21490.283701] lowmem_reserve[]: 0 0 16760 16760
[21490.283706] HighMem free:1805460kB min:512kB low:2760kB high:5008kB active:201492kB inactive:147920kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[21490.283709] lowmem_reserve[]: 0 0 0 0
[21490.283712] DMA: 1132*4kB 5*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4584kB
[21490.283722] Normal: 63681*4kB 1511*8kB 4*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 267708kB
[21490.283731] HighMem: 4123*4kB 4447*8kB 3449*16kB 2708*32kB 2023*64kB 1454*128kB 877*256kB 467*512kB 161*1024kB 64*2048kB 131*4096kB = 1805620kB
[21490.283742] 55703 total pagecache pages
[21490.283744] Swap cache: add 0, delete 0, find 0/0
[21490.283746] Free swap  = 4192924kB
[21490.283747] Total swap = 4192924kB
[21490.291751] 769936 pages of RAM
[21490.291754] 540560 pages of HIGHMEM
[21490.291755] 8147 reserved pages
[21490.291756] 29839 pages shared
[21490.291758] 0 pages swap cached
[21490.291759] 12 pages dirty
[21490.291760] 26 pages writeback
[21490.291762] 7278 pages mapped
[21490.291763] 2944 pages slab
[21490.291764] 574 pages pagetables
[21490.291767] Out of memory: kill process 6136 (gnome-terminal) score 1232 or a child
[21490.291785] Killed process 6142 (bash)
[21490.495220] metacity invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[21490.495220] Pid: 4510, comm: metacity Not tainted 2.6.26 #1
[21490.495220]  [<c015b64f>] oom_kill_process+0x42/0x183
[21490.495220]  [<c015ba76>] out_of_memory+0x157/0x188
[21490.495220]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[21490.495220]  [<c015d9fe>] __alloc_pages+0xa/0xc
[21490.495220]  [<c015da12>] __get_free_pages+0x12/0x21
[21490.495220]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[21490.495220]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[21490.495220]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[21490.495220]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[21490.495220]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[21490.495220]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[21490.495220]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[21490.495220]  [<c0179485>] do_sync_write+0xab/0xe9
[21490.495220]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[21490.495220]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[21490.495220]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21490.495220]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21490.495220]  [<c0179be3>] vfs_write+0x9d/0x133
[21490.495220]  [<c017a1d8>] sys_write+0x3b/0x60
[21490.495220]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[21490.495220]  =======================
[21490.495220] Mem-info:
[21490.495220] DMA per-cpu:
[21490.495220] CPU    0: hi:    0, btch:   1 usd:   0
[21490.495220] CPU    1: hi:    0, btch:   1 usd:   0
[21490.495220] Normal per-cpu:
[21490.495220] CPU    0: hi:  186, btch:  31 usd:   0
[21490.495220] CPU    1: hi:  186, btch:  31 usd:   0
[21490.495220] HighMem per-cpu:
[21490.495220] CPU    0: hi:  186, btch:  31 usd:   0
[21490.495220] CPU    1: hi:  186, btch:  31 usd: 163
[21490.495220] Active:48919 inactive:36804 dirty:1 writeback:15 unstable:0
[21490.495220]  free:521123 slab:2917 mapped:6885 pagetables:548 bounce:0
[21490.495220] DMA free:4584kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[21490.495220] lowmem_reserve[]: 0 873 2968 2968
[21490.495220] Normal free:267764kB min:3744kB low:4680kB high:5616kB active:308kB inactive:208kB present:894080kB pages_scanned:0 all_unreclaimable? no
[21490.495220] lowmem_reserve[]: 0 0 16760 16760
[21490.495220] HighMem free:1812244kB min:512kB low:2760kB high:5008kB active:195220kB inactive:146860kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[21490.495220] lowmem_reserve[]: 0 0 0 0
[21490.495220] DMA: 1132*4kB 5*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4584kB
[21490.495220] Normal: 63674*4kB 1513*8kB 11*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 267808kB
[21490.495220] HighMem: 4292*4kB 4355*8kB 3410*16kB 2674*32kB 1999*64kB 1446*128kB 871*256kB 472*512kB 161*1024kB 67*2048kB 132*4096kB = 1812552kB
[21490.495220] 55013 total pagecache pages
[21490.495220] Swap cache: add 0, delete 0, find 0/0
[21490.495220] Free swap  = 4192924kB
[21490.495220] Total swap = 4192924kB
[21490.512283] 769936 pages of RAM
[21490.512285] 540560 pages of HIGHMEM
[21490.512286] 8147 reserved pages
[21490.512287] 27137 pages shared
[21490.512289] 0 pages swap cached
[21490.512290] 1 pages dirty
[21490.512292] 15 pages writeback
[21490.512293] 6885 pages mapped
[21490.512294] 2899 pages slab
[21490.512295] 548 pages pagetables
[21490.512298] Out of memory: kill process 4573 (gnome-power-man) score 983 or a child
[21490.512316] Killed process 4573 (gnome-power-man)
[21494.483737] nautilus invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[21494.483737] Pid: 6995, comm: nautilus Not tainted 2.6.26 #1
[21494.483737]  [<c015b64f>] oom_kill_process+0x42/0x183
[21494.483738]  [<c015ba76>] out_of_memory+0x157/0x188
[21494.483738]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[21494.483738]  [<c015d9fe>] __alloc_pages+0xa/0xc
[21494.483738]  [<c015da12>] __get_free_pages+0x12/0x21
[21494.483738]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[21494.483738]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[21494.483738]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[21494.483738]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[21494.483738]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[21494.483738]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[21494.483738]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[21494.483738]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[21494.483738]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[21494.483738]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[21494.483738]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21494.483738]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21494.483738]  [<c01799fc>] do_readv_writev+0x85/0x140
[21494.483738]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[21494.483738]  [<c0140adc>] ? tick_program_event+0x31/0x55
[21494.483771]  [<c0179af0>] vfs_writev+0x39/0x49
[21494.483856]  [<c0179f44>] sys_writev+0x3b/0x8e
[21494.483872]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[21494.483879]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[21494.483887]  =======================
[21494.483888] Mem-info:
[21494.483890] DMA per-cpu:
[21494.483892] CPU    0: hi:    0, btch:   1 usd:   0
[21494.483894] CPU    1: hi:    0, btch:   1 usd:   0
[21494.483895] Normal per-cpu:
[21494.483897] CPU    0: hi:  186, btch:  31 usd:   0
[21494.483899] CPU    1: hi:  186, btch:  31 usd:   0
[21494.483900] HighMem per-cpu:
[21494.483902] CPU    0: hi:  186, btch:  31 usd:   0
[21494.483904] CPU    1: hi:  186, btch:  31 usd:   0
[21494.483907] Active:47477 inactive:36569 dirty:11 writeback:129 unstable:0
[21494.483908]  free:522948 slab:2862 mapped:11446 pagetables:546 bounce:0
[21494.483912] DMA free:4584kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? yes
[21494.483914] lowmem_reserve[]: 0 873 2968 2968
[21494.483919] Normal free:267364kB min:3744kB low:4680kB high:5616kB active:288kB inactive:776kB present:894080kB pages_scanned:156 all_unreclaimable? no
[21494.483922] lowmem_reserve[]: 0 0 16760 16760
[21494.483927] HighMem free:1819844kB min:512kB low:2760kB high:5008kB active:189620kB inactive:145500kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[21494.483929] lowmem_reserve[]: 0 0 0 0
[21494.483933] DMA: 1132*4kB 5*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4584kB
[21494.483941] Normal: 63582*4kB 1525*8kB 7*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 267472kB
[21494.483949] HighMem: 3195*4kB 4528*8kB 3469*16kB 2685*32kB 2017*64kB 1450*128kB 870*256kB 475*512kB 165*1024kB 68*2048kB 132*4096kB = 1819932kB
[21494.483958] 54529 total pagecache pages
[21494.483959] Swap cache: add 0, delete 0, find 0/0
[21494.483961] Free swap  = 4192924kB
[21494.483963] Total swap = 4192924kB
[21494.491657] 769936 pages of RAM
[21494.491660] 540560 pages of HIGHMEM
[21494.491661] 8147 reserved pages
[21494.491663] 37907 pages shared
[21494.491664] 0 pages swap cached
[21494.491665] 11 pages dirty
[21494.491667] 129 pages writeback
[21494.491668] 11446 pages mapped
[21494.491669] 2862 pages slab
[21494.491671] 546 pages pagetables
[21494.491673] Out of memory: kill process 6995 (nautilus) score 1761 or a child
[21494.491691] Killed process 6995 (nautilus)
[21497.235658] Xorg invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[21497.235658] Pid: 3723, comm: Xorg Not tainted 2.6.26 #1
[21497.235658]  [<c015b64f>] oom_kill_process+0x42/0x183
[21497.235658]  [<c015ba76>] out_of_memory+0x157/0x188
[21497.235658]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[21497.235658]  [<c015d9fe>] __alloc_pages+0xa/0xc
[21497.235658]  [<c015da12>] __get_free_pages+0x12/0x21
[21497.235658]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[21497.235658]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[21497.235658]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[21497.235658]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[21497.235658]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[21497.235658]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[21497.235658]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[21497.235658]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[21497.235658]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[21497.235658]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[21497.235658]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21497.235658]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21497.235658]  [<c01799fc>] do_readv_writev+0x85/0x140
[21497.235658]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[21497.235658]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21497.235658]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21497.235658]  [<c0179af0>] vfs_writev+0x39/0x49
[21497.235658]  [<c0179f44>] sys_writev+0x3b/0x8e
[21497.235658]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[21497.235658]  =======================
[21497.235658] Mem-info:
[21497.235658] DMA per-cpu:
[21497.235658] CPU    0: hi:    0, btch:   1 usd:   0
[21497.235658] CPU    1: hi:    0, btch:   1 usd:   0
[21497.235658] Normal per-cpu:
[21497.235658] CPU    0: hi:  186, btch:  31 usd:   0
[21497.235658] CPU    1: hi:  186, btch:  31 usd:   0
[21497.235658] HighMem per-cpu:
[21497.235658] CPU    0: hi:  186, btch:  31 usd:   0
[21497.235658] CPU    1: hi:  186, btch:  31 usd:   0
[21497.235658] Active:47405 inactive:35601 dirty:30 writeback:126 unstable:0
[21497.235658]  free:524014 slab:2845 mapped:11244 pagetables:561 bounce:0
[21497.235658] DMA free:4584kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? yes
[21497.235658] lowmem_reserve[]: 0 873 2968 2968
[21497.235658] Normal free:267552kB min:3744kB low:4680kB high:5616kB active:108kB inactive:704kB present:894080kB pages_scanned:192 all_unreclaimable? no
[21497.235658] lowmem_reserve[]: 0 0 16760 16760
[21497.235658] HighMem free:1823920kB min:512kB low:2760kB high:5008kB active:189336kB inactive:141896kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[21497.235658] lowmem_reserve[]: 0 0 0 0
[21497.235658] DMA: 1132*4kB 5*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4584kB
[21497.235658] Normal: 63623*4kB 1529*8kB 6*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 267652kB
[21497.235658] HighMem: 3418*4kB 4532*8kB 3472*16kB 2696*32kB 2030*64kB 1456*128kB 870*256kB 477*512kB 165*1024kB 68*2048kB 132*4096kB = 1823880kB
[21497.235658] 53320 total pagecache pages
[21497.235658] Swap cache: add 0, delete 0, find 0/0
[21497.235658] Free swap  = 4192924kB
[21497.235658] Total swap = 4192924kB
[21497.249092] 769936 pages of RAM
[21497.249092] 540560 pages of HIGHMEM
[21497.249092] 8147 reserved pages
[21497.249092] 38893 pages shared
[21497.249092] 0 pages swap cached
[21497.249092] 30 pages dirty
[21497.249092] 51 pages writeback
[21497.249092] 11244 pages mapped
[21497.249092] 2845 pages slab
[21497.249092] 561 pages pagetables
[21497.249092] Out of memory: kill process 6999 (gnome-panel) score 1284 or a child
[21497.249092] Killed process 6999 (gnome-panel)
[21497.250013] Xorg invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[21497.250017] Pid: 3723, comm: Xorg Not tainted 2.6.26 #1
[21497.250030]  [<c015b64f>] oom_kill_process+0x42/0x183
[21497.250041]  [<c015ba76>] out_of_memory+0x157/0x188
[21497.250048]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[21497.250057]  [<c015d9fe>] __alloc_pages+0xa/0xc
[21497.250095]  [<c015da12>] __get_free_pages+0x12/0x21
[21497.250095]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[21497.250095]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[21497.250095]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[21497.250095]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[21497.250095]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[21497.250095]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[21497.250095]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[21497.250095]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[21497.250095]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[21497.250095]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[21497.250095]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21497.250095]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21497.250095]  [<c01799fc>] do_readv_writev+0x85/0x140
[21497.250095]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[21497.250095]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21497.250095]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21497.250095]  [<c0179af0>] vfs_writev+0x39/0x49
[21497.250095]  [<c0179f44>] sys_writev+0x3b/0x8e
[21497.250095]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[21497.250095]  =======================
[21497.250095] Mem-info:
[21497.250095] DMA per-cpu:
[21497.250095] CPU    0: hi:    0, btch:   1 usd:   0
[21497.250095] CPU    1: hi:    0, btch:   1 usd:   0
[21497.250095] Normal per-cpu:
[21497.250095] CPU    0: hi:  186, btch:  31 usd:   0
[21497.250095] CPU    1: hi:  186, btch:  31 usd:   0
[21497.250095] HighMem per-cpu:
[21497.250095] CPU    0: hi:  186, btch:  31 usd:   0
[21497.250095] CPU    1: hi:  186, btch:  31 usd:  65
[21497.250095] Active:46692 inactive:35663 dirty:30 writeback:51 unstable:0
[21497.250095]  free:524614 slab:2845 mapped:10985 pagetables:524 bounce:0
[21497.250095] DMA free:4584kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[21497.250095] lowmem_reserve[]: 0 873 2968 2968
[21497.250095] Normal free:267552kB min:3744kB low:4680kB high:5616kB active:96kB inactive:756kB present:894080kB pages_scanned:0 all_unreclaimable? no
[21497.250095] lowmem_reserve[]: 0 0 16760 16760
[21497.250095] HighMem free:1826320kB min:512kB low:2760kB high:5008kB active:186672kB inactive:141896kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[21497.250095] lowmem_reserve[]: 0 0 0 0
[21497.250095] DMA: 1132*4kB 5*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4584kB
[21497.250095] Normal: 63623*4kB 1529*8kB 6*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 267652kB
[21497.250095] HighMem: 3761*4kB 4512*8kB 3470*16kB 2703*32kB 2038*64kB 1454*128kB 873*256kB 477*512kB 165*1024kB 68*2048kB 132*4096kB = 1826308kB
[21497.250095] 53320 total pagecache pages
[21497.250095] Swap cache: add 0, delete 0, find 0/0
[21497.250095] Free swap  = 4192924kB
[21497.250095] Total swap = 4192924kB
[21497.259254] 769936 pages of RAM
[21497.259257] 540560 pages of HIGHMEM
[21497.259258] 8147 reserved pages
[21497.259259] 32689 pages shared
[21497.259261] 0 pages swap cached
[21497.259262] 30 pages dirty
[21497.259263] 1 pages writeback
[21497.259265] 10985 pages mapped
[21497.259266] 2845 pages slab
[21497.259267] 524 pages pagetables
[21497.259270] Out of memory: kill process 7024 (wnck-applet) score 980 or a child
[21497.259288] Killed process 7024 (wnck-applet)
[21499.362148] gnome-panel invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[21499.362148] Pid: 7038, comm: gnome-panel Not tainted 2.6.26 #1
[21499.362148]  [<c015b64f>] oom_kill_process+0x42/0x183
[21499.362166]  [<c015ba76>] out_of_memory+0x157/0x188
[21499.363138]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[21499.363138]  [<c015d9fe>] __alloc_pages+0xa/0xc
[21499.363138]  [<c015da12>] __get_free_pages+0x12/0x21
[21499.363138]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[21499.363138]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[21499.363138]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[21499.363138]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[21499.363138]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[21499.363138]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[21499.363138]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[21499.363138]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[21499.363138]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[21499.363138]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[21499.363138]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21499.363138]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21499.363138]  [<c01799fc>] do_readv_writev+0x85/0x140
[21499.363138]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[21499.363138]  [<c0122f35>] ? hrtick_set+0xcf/0xd7
[21499.363138]  [<c0343f96>] ? schedule+0x6c2/0x6f4
[21499.363138]  [<c0179af0>] vfs_writev+0x39/0x49
[21499.363138]  [<c0179f44>] sys_writev+0x3b/0x8e
[21499.363138]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[21499.363138]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[21499.363138]  =======================
[21499.363138] Mem-info:
[21499.363138] DMA per-cpu:
[21499.363138] CPU    0: hi:    0, btch:   1 usd:   0
[21499.363138] CPU    1: hi:    0, btch:   1 usd:   0
[21499.363138] Normal per-cpu:
[21499.363138] CPU    0: hi:  186, btch:  31 usd:   0
[21499.363138] CPU    1: hi:  186, btch:  31 usd:   0
[21499.363138] HighMem per-cpu:
[21499.363138] CPU    0: hi:  186, btch:  31 usd:   0
[21499.363138] CPU    1: hi:  186, btch:  31 usd:   0
[21499.363138] Active:46846 inactive:35545 dirty:14 writeback:125 unstable:0
[21499.363138]  free:524606 slab:2834 mapped:11069 pagetables:545 bounce:0
[21499.363138] DMA free:4584kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? yes
[21499.363138] lowmem_reserve[]: 0 873 2968 2968
[21499.363138] Normal free:267620kB min:3744kB low:4680kB high:5616kB active:208kB inactive:508kB present:894080kB pages_scanned:130 all_unreclaimable? no
[21499.363138] lowmem_reserve[]: 0 0 16760 16760
[21499.363138] HighMem free:1826220kB min:512kB low:2760kB high:5008kB active:187276kB inactive:141536kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[21499.363138] lowmem_reserve[]: 0 0 0 0
[21499.363138] DMA: 1132*4kB 5*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4584kB
[21499.363138] Normal: 63624*4kB 1530*8kB 5*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 267648kB
[21499.363138] HighMem: 3630*4kB 4472*8kB 3443*16kB 2692*32kB 2032*64kB 1454*128kB 871*256kB 476*512kB 164*1024kB 68*2048kB 133*4096kB = 1826344kB
[21499.363138] 53255 total pagecache pages
[21499.363138] Swap cache: add 0, delete 0, find 0/0
[21499.363138] Free swap  = 4192924kB
[21499.363138] Total swap = 4192924kB
[21499.373292] 769936 pages of RAM
[21499.373292] 540560 pages of HIGHMEM
[21499.373292] 8147 reserved pages
[21499.373292] 32949 pages shared
[21499.373292] 0 pages swap cached
[21499.373292] 14 pages dirty
[21499.373292] 50 pages writeback
[21499.373292] 11069 pages mapped
[21499.373292] 2834 pages slab
[21499.373292] 545 pages pagetables
[21499.373292] Out of memory: kill process 7038 (gnome-panel) score 1266 or a child
[21499.373292] Killed process 7038 (gnome-panel)
[21501.648889] Out of memory: kill process 7042 (gnome-panel) score 1266 or a child
[21501.648895] Killed process 7042 (gnome-panel)
[21503.395242] __ratelimit: 1 messages suppressed
[21503.395242] gnome-panel invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[21503.395242] Pid: 7045, comm: gnome-panel Not tainted 2.6.26 #1
[21503.395242]  [<c015b64f>] oom_kill_process+0x42/0x183
[21503.395242]  [<c015ba76>] out_of_memory+0x157/0x188
[21503.395242]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[21503.395242]  [<c015d9fe>] __alloc_pages+0xa/0xc
[21503.395242]  [<c015da12>] __get_free_pages+0x12/0x21
[21503.395242]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[21503.395242]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[21503.395242]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[21503.395242]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[21503.395242]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[21503.395242]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[21503.395242]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[21503.395242]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[21503.395242]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[21503.395242]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[21503.395242]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21503.395242]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21503.395242]  [<c01799fc>] do_readv_writev+0x85/0x140
[21503.395242]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[21503.395242]  [<c0140adc>] ? tick_program_event+0x31/0x55
[21503.395242]  [<c0179af0>] vfs_writev+0x39/0x49
[21503.395242]  [<c0179f44>] sys_writev+0x3b/0x8e
[21503.395242]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[21503.395242]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[21503.395242]  =======================
[21503.395242] Mem-info:
[21503.395242] DMA per-cpu:
[21503.395242] CPU    0: hi:    0, btch:   1 usd:   0
[21503.395242] CPU    1: hi:    0, btch:   1 usd:   0
[21503.395242] Normal per-cpu:
[21503.395242] CPU    0: hi:  186, btch:  31 usd:   0
[21503.395242] CPU    1: hi:  186, btch:  31 usd:   0
[21503.395242] HighMem per-cpu:
[21503.395242] CPU    0: hi:  186, btch:  31 usd:   0
[21503.395242] CPU    1: hi:  186, btch:  31 usd:   0
[21503.395242] Active:46912 inactive:35530 dirty:17 writeback:120 unstable:0
[21503.395242]  free:524546 slab:2834 mapped:11075 pagetables:532 bounce:0
[21503.395242] DMA free:4584kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[21503.395242] lowmem_reserve[]: 0 873 2968 2968
[21503.395242] Normal free:267608kB min:3744kB low:4680kB high:5616kB active:260kB inactive:428kB present:894080kB pages_scanned:0 all_unreclaimable? no
[21503.395242] lowmem_reserve[]: 0 0 16760 16760
[21503.395242] HighMem free:1825992kB min:512kB low:2760kB high:5008kB active:187388kB inactive:141692kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[21503.395242] lowmem_reserve[]: 0 0 0 0
[21503.395242] DMA: 1132*4kB 5*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4584kB
[21503.395242] Normal: 63645*4kB 1530*8kB 2*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 267684kB
[21503.395242] HighMem: 3569*4kB 4469*8kB 3441*16kB 2693*32kB 2031*64kB 1455*128kB 871*256kB 476*512kB 164*1024kB 68*2048kB 133*4096kB = 1826140kB
[21503.395242] 53271 total pagecache pages
[21503.395242] Swap cache: add 0, delete 0, find 0/0
[21503.395242] Free swap  = 4192924kB
[21503.395242] Total swap = 4192924kB
[21503.407090] 769936 pages of RAM
[21503.407090] 540560 pages of HIGHMEM
[21503.407090] 8147 reserved pages
[21503.407090] 32928 pages shared
[21503.407090] 0 pages swap cached
[21503.407090] 17 pages dirty
[21503.407090] 70 pages writeback
[21503.407090] 11075 pages mapped
[21503.407090] 2834 pages slab
[21503.407090] 532 pages pagetables
[21503.407090] Out of memory: kill process 7045 (gnome-panel) score 1266 or a child
[21503.407090] Killed process 7045 (gnome-panel)
[21505.334462] Out of memory: kill process 7049 (gnome-panel) score 1266 or a child
[21505.334462] Killed process 7049 (gnome-panel)
[21507.003315] Out of memory: kill process 7052 (gnome-panel) score 1266 or a child
[21507.003321] Killed process 7052 (gnome-panel)
[21508.460436] Out of memory: kill process 7056 (gnome-panel) score 1266 or a child
[21508.460442] Killed process 7056 (gnome-panel)
[21510.555414] __ratelimit: 3 messages suppressed
[21510.555418] gnome-panel invoked oom-killer: gfp_mask=0x4d0, order=2, oomkilladj=0
[21510.555421] Pid: 7060, comm: gnome-panel Not tainted 2.6.26 #1
[21510.555435]  [<c015b64f>] oom_kill_process+0x42/0x183
[21510.555445]  [<c015ba76>] out_of_memory+0x157/0x188
[21510.555453]  [<c015d938>] __alloc_pages_internal+0x2e4/0x393
[21510.555462]  [<c015d9fe>] __alloc_pages+0xa/0xc
[21510.555467]  [<c015da12>] __get_free_pages+0x12/0x21
[21510.555471]  [<c01762b9>] __kmalloc_track_caller+0x30/0x10a
[21510.555475]  [<c02cf6c3>] ? sock_alloc_send_skb+0x71/0x197
[21510.555483]  [<c02d2cc0>] __alloc_skb+0x4f/0xfd
[21510.555489]  [<c02cf6c3>] sock_alloc_send_skb+0x71/0x197
[21510.555497]  [<c032d102>] unix_stream_sendmsg+0x13c/0x2a5
[21510.555504]  [<c01e695c>] ? avc_has_perm+0x3d/0x47
[21510.555513]  [<c02cd41e>] sock_aio_write+0xe2/0xef
[21510.555525]  [<c017939c>] do_sync_readv_writev+0xa1/0xdf
[21510.555530]  [<c01e741b>] ? file_has_perm+0x7c/0x85
[21510.555538]  [<c0138acd>] ? autoremove_wake_function+0x0/0x33
[21510.555547]  [<c01ea072>] ? selinux_file_permission+0xff/0x105
[21510.555553]  [<c01e343d>] ? security_file_permission+0xf/0x11
[21510.555559]  [<c01799fc>] do_readv_writev+0x85/0x140
[21510.555563]  [<c02cd33c>] ? sock_aio_write+0x0/0xef
[21510.555569]  [<c01e7235>] ? selinux_file_free_security+0x14/0x16
[21510.555574]  [<c018c64d>] ? mntput_no_expire+0x18/0xde
[21510.555582]  [<c0179af0>] vfs_writev+0x39/0x49
[21510.555586]  [<c0179f44>] sys_writev+0x3b/0x8e
[21510.555591]  [<c0103a2b>] sysenter_past_esp+0x78/0xb1
[21510.555598]  [<c0340000>] ? powernowk8_cpu_init+0xdc/0xbc6
[21510.555605]  =======================
[21510.555607] Mem-info:
[21510.555608] DMA per-cpu:
[21510.555610] CPU    0: hi:    0, btch:   1 usd:   0
[21510.555612] CPU    1: hi:    0, btch:   1 usd:   0
[21510.555614] Normal per-cpu:
[21510.555615] CPU    0: hi:  186, btch:  31 usd:   0
[21510.555617] CPU    1: hi:  186, btch:  31 usd:   0
[21510.555619] HighMem per-cpu:
[21510.555621] CPU    0: hi:  186, btch:  31 usd:   0
[21510.555622] CPU    1: hi:  186, btch:  31 usd:   0
[21510.555625] Active:47094 inactive:35896 dirty:144 writeback:1 unstable:0
[21510.555627]  free:523986 slab:2821 mapped:11054 pagetables:531 bounce:0
[21510.555630] DMA free:4584kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[21510.555632] lowmem_reserve[]: 0 873 2968 2968
[21510.555637] Normal free:265644kB min:3744kB low:4680kB high:5616kB active:988kB inactive:1692kB present:894080kB pages_scanned:0 all_unreclaimable? no
[21510.555640] lowmem_reserve[]: 0 0 16760 16760
[21510.555645] HighMem free:1825716kB min:512kB low:2760kB high:5008kB active:187388kB inactive:141892kB present:2145344kB pages_scanned:0 all_unreclaimable? no
[21510.555647] lowmem_reserve[]: 0 0 0 0
[21510.555651] DMA: 1132*4kB 5*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4584kB
[21510.555659] Normal: 63172*4kB 1524*8kB 0*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 265680kB
[21510.555667] HighMem: 3482*4kB 4464*8kB 3435*16kB 2687*32kB 2029*64kB 1453*128kB 872*256kB 477*512kB 164*1024kB 68*2048kB 133*4096kB = 1825848kB
[21510.555676] 53799 total pagecache pages
[21510.555678] Swap cache: add 0, delete 0, find 0/0
[21510.555680] Free swap  = 4192924kB
[21510.555681] Total swap = 4192924kB
[21510.563525] 769936 pages of RAM
[21510.563527] 540560 pages of HIGHMEM
[21510.563528] 8147 reserved pages
[21510.563530] 33418 pages shared
[21510.563531] 0 pages swap cached
[21510.563532] 144 pages dirty
[21510.563534] 1 pages writeback
[21510.563535] 11054 pages mapped
[21510.563536] 2821 pages slab
[21510.563538] 531 pages pagetables
[21510.563540] Out of memory: kill process 7060 (gnome-panel) score 1266 or a child
[21510.563557] Killed process 7060 (gnome-panel)
[21511.976726] Out of memory: kill process 7064 (gnome-panel) score 1266 or a child
[21511.976726] Killed process 7064 (gnome-panel)
[21513.735729] Out of memory: kill process 7069 (gnome-panel) score 1266 or a child
[21513.735735] Killed process 7069 (gnome-panel)

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PROBLEM] hard-lock with kmemtrace, relayfs, and splice
  2008-10-24  4:44           ` Peter Teoh
@ 2008-10-24 14:15             ` Pekka Enberg
  2008-10-25  0:56               ` Peter Teoh
  0 siblings, 1 reply; 16+ messages in thread
From: Pekka Enberg @ 2008-10-24 14:15 UTC (permalink / raw)
  To: Peter Teoh; +Cc: Eduard - Gabriel Munteanu, zanussi, jens.axboe, linux-kernel

On Fri, 2008-10-24 at 12:44 +0800, Peter Teoh wrote:
> after doing a
> 
> git clone git://repo.or.cz/linux-2.6/kmemtrace.git
> 
> I reboot the OS and encountered several application crashes.....the
> logs are as per attached....please comment.
> 
> for bug0 and bug1, the system go into a state of complete
> non-responsive, even connecting via SSH into the system becomes
> impossible, and bug0 and bug1 was generated just before it goes into
> this state.
> 
> for bug2, the mouse seemed to respond, i managed to output the dmesg
> (which is bug2 itself).
> 
> any comments?

Hmm, you're hitting out-of-memory. I can't immediately see how kmemtrace
is at fault here. Eduard, thoughts?


^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PROBLEM] hard-lock with kmemtrace, relayfs, and splice
  2008-10-24 14:15             ` Pekka Enberg
@ 2008-10-25  0:56               ` Peter Teoh
  2008-10-25 14:04                 ` Eduard - Gabriel Munteanu
  0 siblings, 1 reply; 16+ messages in thread
From: Peter Teoh @ 2008-10-25  0:56 UTC (permalink / raw)
  To: Pekka Enberg, Eduard - Gabriel Munteanu; +Cc: zanussi, jens.axboe, linux-kernel

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain; charset=GB2312, Size: 3806 bytes --]

ok.   just ignore it.   i think based on "git log" of"git://repo.or.cz/linux-2.6/kmemtrace.git":
commit 0441e5ff6ab71cf7a3e9ec3116f14d0fd7d20d51Author: Eduard - Gabriel Munteanu <eduard.munteanu@linux360.ro>Date:   Thu Jul 10 20:20:05 2008 +0300
    kmemtrace: SLOB hooks.
the repo seemed way out of date.   But a clone of Pekka's slab-2.6'stopic/kmemtrace branch have no problem.   The steps are as follows:
1.   git clone git://git.kernel.org/pub/scm/linux/kernel/git/penberg/slab-2.6.git2.   git checkout -m  origin/topic/kmemtrace3.   git checkout -b kmemtrace
git log gives:
commit 51b19be3535c8fbcce6b6f838d89b9a6a4cc5b92Author: Tom Zanussi <zanussi@comcast.net>Date:   Fri Oct 10 23:58:51 2008 -0500
    relayfs: fix infinite loop with splice()
But the userspace tool I still get it from: git://repo.or.cz/kmemtrace-user.git
Correct?
Now I have some problems:
a.   I would like to extract out all the commit as diff - may I knowhow to do that? ("git log" only gives the descriptive part).b.   boot-time memory profiling....how can it be done (or extractedout)?  (kmemtrace-user does not have that?)c.   please provide some pointers to documentation:   how do Iinterpret the following:
Allocation #83468 (CPU0) already exists!        by __kmalloc_track_caller+25        last touched by __kmalloc_track_callerAllocation #83740 (CPU0) already exists!        by __kmalloc_track_caller+25        last touched by __kmalloc_track_caller
For my purpose, I would like to trace how and where is memoryallocated - just one one single userspace program which access themmap("/dev/mem") to read the memory.   How can it be done?   "Tracingmemory" in my context will mean list all the kernel-function +memory-allocated-within-the-function + its-PFN-or-PTE-information (topinpoint the exact physical page).   My understanding is that thesecan be done, via checking the value of "current", as each userspaceprogram started will have a unique "current" context value, andtherefore within any kernel function, just check this value, to focustracing on just one particular userspace program.   Correct?
d.   The following:
/sys/kernel/debug/kmemtrace>ls -al×Ü¼Æ 0drwxr-xr-x 2 root root          0 2008-10-25 .drwxr-xr-x 9 root root          0 2008-10-25 ..-r-------- 1 root root          0 2008-10-25 abi_version-r-------- 1 root root 2946936192 2008-10-25 cpu0-r-------- 1 root root 1701263952 2008-10-25 cpu1-rw------- 1 root root          0 2008-10-25 enabled-r-------- 1 root root          0 2008-10-25 total_overruns
So the information is stored in memory, right?   Is it possible toreset it?   I don't want these information to clog up the memory.
e.   The balance between cpu0 and cpu1 does not seemed equal, anyimplications on the scheduler/ IO Scheduler?   or memory allocationscheduler (if there exists one :-))....sorry about that....myknowledge is limited.
On Fri, Oct 24, 2008 at 10:15 PM, Pekka Enberg <penberg@cs.helsinki.fi> wrote:> On Fri, 2008-10-24 at 12:44 +0800, Peter Teoh wrote:>> after doing a>>>> git clone git://repo.or.cz/linux-2.6/kmemtrace.git>>>> I reboot the OS and encountered several application crashes.....the>> logs are as per attached....please comment.>>>> for bug0 and bug1, the system go into a state of complete>> non-responsive, even connecting via SSH into the system becomes>> impossible, and bug0 and bug1 was generated just before it goes into>> this state.>>>> for bug2, the mouse seemed to respond, i managed to output the dmesg>> (which is bug2 itself).>>>> any comments?>> Hmm, you're hitting out-of-memory. I can't immediately see how kmemtrace> is at fault here. Eduard, thoughts?>>


-- Regards,Peter Teohÿôèº{.nÇ+‰·Ÿ®‰­†+%ŠËÿ±éݶ\x17¥Šwÿº{.nÇ+‰·¥Š{±þG«éÿŠ{ayº\x1dʇڙë,j\a­¢f£¢·hšïêÿ‘êçz_è®\x03(­éšŽŠÝ¢j"ú\x1a¶^[m§ÿÿ¾\a«þG«éÿ¢¸?™¨è­Ú&£ø§~á¶iO•æ¬z·švØ^\x14\x04\x1a¶^[m§ÿÿÃ\fÿ¶ìÿ¢¸?–I¥

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PROBLEM] hard-lock with kmemtrace, relayfs, and splice
  2008-10-25  0:56               ` Peter Teoh
@ 2008-10-25 14:04                 ` Eduard - Gabriel Munteanu
  0 siblings, 0 replies; 16+ messages in thread
From: Eduard - Gabriel Munteanu @ 2008-10-25 14:04 UTC (permalink / raw)
  To: Peter Teoh; +Cc: Pekka Enberg, zanussi, jens.axboe, linux-kernel

On Sat, Oct 25, 2008 at 08:56:07AM +0800, Peter Teoh wrote:
> ok.   just ignore it.   i think based on "git log" of
> "git://repo.or.cz/linux-2.6/kmemtrace.git":
> 
> commit 0441e5ff6ab71cf7a3e9ec3116f14d0fd7d20d51
> Author: Eduard - Gabriel Munteanu <eduard.munteanu@linux360.ro>
> Date:   Thu Jul 10 20:20:05 2008 +0300
> 
>     kmemtrace: SLOB hooks.
> 
> the repo seemed way out of date.   But a clone of Pekka's slab-2.6's
> topic/kmemtrace branch have no problem.   The steps are as follows:
> 
> 1.   git clone git://git.kernel.org/pub/scm/linux/kernel/git/penberg/slab-2.6.git
> 2.   git checkout -m  origin/topic/kmemtrace
> 3.   git checkout -b kmemtrace

Hi,

Yes, that repo may be outdated, please use Pekka's for the latest
working stuff.

> git log gives:
> 
> commit 51b19be3535c8fbcce6b6f838d89b9a6a4cc5b92
> Author: Tom Zanussi <zanussi@comcast.net>
> Date:   Fri Oct 10 23:58:51 2008 -0500
> 
>     relayfs: fix infinite loop with splice()
> 
> But the userspace tool I still get it from: git://repo.or.cz/kmemtrace-user.git
> 
> Correct?

Yes, I maintain this one and it's up-to-date.

> Now I have some problems:
> 
> a.   I would like to extract out all the commit as diff - may I know
> how to do that? ("git log" only gives the descriptive part).

You can use "git-log -p" to get diffs along with commit history.

> b.   boot-time memory profiling....how can it be done (or extracted
> out)?  (kmemtrace-user does not have that?)

If you enable kmemtrace at boot-time using the "kmemtrace.enabled=yes"
parameter, kmemtrace will start logging just after kmem_cache_init()
finishes. There are plans for making tracing possible even earlier,
however it involves quite a big rework of how relay allocates its
buffers.

> c.   please provide some pointers to documentation:   how do I
> interpret the following:
> 
> Allocation #83468 (CPU0) already exists!
>         by __kmalloc_track_caller+25
>         last touched by __kmalloc_track_caller
> Allocation #83740 (CPU0) already exists!
>         by __kmalloc_track_caller+25
>         last touched by __kmalloc_track_caller

The userspace app writes out those messages when it looks like a memory
region has been allocated twice. In reality, it's most likely a free
hasn't been traced (because a misc free function isn't traced).

> For my purpose, I would like to trace how and where is memory
> allocated - just one one single userspace program which access the
> mmap("/dev/mem") to read the memory.   How can it be done?   "Tracing
> memory" in my context will mean list all the kernel-function +
> memory-allocated-within-the-function + its-PFN-or-PTE-information (to
> pinpoint the exact physical page).   My understanding is that these
> can be done, via checking the value of "current", as each userspace
> program started will have a unique "current" context value, and
> therefore within any kernel function, just check this value, to focus
> tracing on just one particular userspace program.   Correct?

I have made provisions for exporting the whole stack trace, however it
is not yet implemented.

> d.   The following:
> 
> /sys/kernel/debug/kmemtrace>ls -al
> ???? 0
> drwxr-xr-x 2 root root          0 2008-10-25 .
> drwxr-xr-x 9 root root          0 2008-10-25 ..
> -r-------- 1 root root          0 2008-10-25 abi_version
> -r-------- 1 root root 2946936192 2008-10-25 cpu0
> -r-------- 1 root root 1701263952 2008-10-25 cpu1
> -rw------- 1 root root          0 2008-10-25 enabled
> -r-------- 1 root root          0 2008-10-25 total_overruns
> 
> So the information is stored in memory, right?   Is it possible to
> reset it?   I don't want these information to clog up the memory.

Relay uses fixed size buffers, so there is no point in clearing them.

> e.   The balance between cpu0 and cpu1 does not seemed equal, any
> implications on the scheduler/ IO Scheduler?   or memory allocation
> scheduler (if there exists one :-))....sorry about that....my
> knowledge is limited.

Much of the booting sequence is done on a single CPU, then the kernel
switches to SMP. It is natural to see one CPU log more allocations.

> -- 
> Regards,
> Peter Teoh

Thanks for testing.


	Cheers,
	Eduard


^ permalink raw reply	[flat|nested] 16+ messages in thread

end of thread, other threads:[~2008-10-25 14:04 UTC | newest]

Thread overview: 16+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2008-09-23 21:29 [ANNOUNCE] kmemtrace-user repo update Eduard - Gabriel Munteanu
     [not found] ` <1223386477.28348.42.camel@penberg-laptop>
     [not found]   ` <1223623191.8959.26.camel@penberg-laptop>
     [not found]     ` <1223628687.8959.37.camel@penberg-laptop>
     [not found]       ` <1223629803.8959.40.camel@penberg-laptop>
2008-10-10  9:42         ` [PROBLEM] hard-lock with kmemtrace, relayfs, and splice Pekka Enberg
2008-10-10 11:51           ` Eduard - Gabriel Munteanu
2008-10-11  4:58           ` Tom Zanussi
2008-10-11 18:17             ` Eduard - Gabriel Munteanu
2008-10-13  6:57             ` Pekka Enberg
2008-10-14  4:03               ` Tom Zanussi
2008-10-14  5:13                 ` Pekka Enberg
2008-10-14  5:46                   ` Tom Zanussi
2008-10-14  6:58                     ` Pekka Enberg
2008-10-14  7:30                     ` Eduard - Gabriel Munteanu
2008-10-14  7:05                   ` Pekka Enberg
2008-10-24  4:44           ` Peter Teoh
2008-10-24 14:15             ` Pekka Enberg
2008-10-25  0:56               ` Peter Teoh
2008-10-25 14:04                 ` Eduard - Gabriel Munteanu

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox