From: "Peter Trekels" <peter.trekels@quesd.com>
To: 'Andrew Morton' <akpm@linux-foundation.org>
Cc: bugzilla-daemon@bugzilla.kernel.org, linux-mm@kvack.org,
'Arnout Vandecappelle' <arnout@mind.be>
Subject: RE: [Bug 14403] New: Kernel freeze when going out of memory
Date: Fri, 16 Oct 2009 15:43:35 +0200 [thread overview]
Message-ID: <001101ca4e66$a9138560$fb3a9020$@trekels@quesd.com> (raw)
In-Reply-To: <200910161116.50893.arnout@mind.be>
[-- Attachment #1: Type: text/plain, Size: 5895 bytes --]
Hi,
We now succeeded in reproducing the freeze with a minimal set of running
tasks and modules:
- gettys
- ssh
- fillmem.py python script to fill memory (respawned by init when killed by
oom-killer)
- wget: to introduce network traffic (respawned by init when killed by
oom-killer)
- syslog
The freeze was introduced some time after we loaded the md-crypt and mptsas
modules (without mounting any drives). Before we loaded these modules the
system was running with the same set of processes for several hours and did
not freeze. Some modules like xfs, ipmi, ext2, ext3 were compiled in kernel
and not as module.
putty_before_freeze: huge logging before we noticed the freeze
putty_task_trace_frozen: State information in frozen state
putty_blocked_trace: blocked task list, backtrace of CPUs and memory info in
frozen state
We were not able to kill any tasks with SysRq-kIll.
Kind regards,
Peter Trekels
QuESD nv.
-----Original Message-----
From: Arnout Vandecappelle [mailto:arnout@mind.be]
Sent: Friday, October 16, 2009 11:17 AM
To: Andrew Morton
Cc: bugzilla-daemon@bugzilla.kernel.org; linux-mm@kvack.org; Peter Trekels
Subject: Re: [Bug 14403] New: Kernel freeze when going out of memory
On Friday 16 Oct 2009 01:33:45 Andrew Morton wrote:
> (switched to email. Please respond via emailed reply-to-all, not via
> the bugzilla web interface).
>
> On Wed, 14 Oct 2009 11:44:08 GMT
>
> bugzilla-daemon@bugzilla.kernel.org wrote:
> > http://bugzilla.kernel.org/show_bug.cgi?id=14403
> >
> > Summary: Kernel freeze when going out of memory
> > Product: Memory Management
> > Version: 2.5
> > Kernel Version: 2.6.24.6 through 2.6.31.1
> > Platform: All
> > OS/Version: Linux
> > Tree: Mainline
> > Status: NEW
> > Severity: high
> > Priority: P1
> > Component: Other
> > AssignedTo: akpm@linux-foundation.org
> > ReportedBy: arnout@mind.be
> > CC: arnout@mind.be
> > Regression: No
> >
> >
> > Created an attachment (id=23404)
> > --> (http://bugzilla.kernel.org/attachment.cgi?id=23404)
> > console log during freeze (bzip2)
> >
> > I get very frequent kernel freezes on two of my systems when they go
> > out of memory. This happens with all kernels I tried (2.6.24
> > through 2.6.31). These systems run a set of applications that
> > occupy most of the memory, they have no swap space, and they have
> > very high network and disk activity (xfs). The network chip varies
(tg3, bnx2, r8169).
> >
> > Symptoms are that no user processes make any progress, though SysRq
> > interaction is still possible. SysRq-I recovers the system (init
> > starts new gettys).
> >
> > During the freeze, there are a lot of page allocation failures from
> > the network interrupt handler. There doesn't seem to be any
> > invocation of the OOM killer (I can't find any 'kill process ...
> > score ...' messages), although before the freeze the OOM killer is
> > usually called successfully a couple of times. Note that the killed
> > processes are restarted soon after (but with lower memory consumption).
> >
> > During the freeze, pinging and arping the system is (usually) still
> > possible. There is very little traffic on the network interface,
> > most of it is broadcast. There are also TCP ACKs still going around.
> > The amount of page allocation failures seems to correspond more or
> > less with the amount of traffic on the interface, but it's hard to
> > be sure (serial line has delay and printks are not timestamped).
> > Still, some skb allocations must be successful or the ping would never
get a reply.
> >
> > Manual invocation of the OOM killer doesn't seem to do anything
> > (nothing is killed, no memory is freed).
> >
> > Attached is a long log taken over the serial console. In the
> > beginning there are some invocations of the OOM killer which bring
> > userspace back (as can be seen from the syslog output that appears after
a while).
> > Then, while the system is frozen there is a continuous stream of
> > page allocation failures (2158 in this hour). This log corresponds
> > to about 1 hour of frozen time (from 11:48 till 12:47). In this
> > time I did a couple of SysRq-T's, a SysRq-F with no results, a
> > SysRq-E with no results (not surprising since userspace is never
> > invoked), and finally a SysRq-I where the SysRq-M immediately before and
after show that it was successful.
> >
> > About the memory usage: 620MB is due to files in tmpfs that I
> > created in order to trigger the out of memory situation sooner.
>
> It would help if we could see the result of the sysrq-t output when
> the kernel is frozen.
>
> - enable and configure a serial console or netconsole
> (Documentation/networking/netconsole.txt)
>
> - boot with log_buf_len=1M
>
> - run `dmesg -n 7'
>
> - freeze the kernel
>
> - hit sysrq-t
>
> - send us the resulting output. Please don't let it get wordwrapped
> by your email client!
Hoi,
The SysRq-t output was already in my original bug report. For your
convenience, I've extracted just the SysRq-T part in the attached log. The
output was intermingled with some page allocation failures, but these I've
removed again. I've left in a few page allocation failures, hung tasks and
a SysRq-l for good measure.
I'm now trying to reproduce it with fewer processes and loaded modules.
Regards,
Arnout
--
Arnout Vandecappelle arnout at mind be
Senior Embedded Software Architect +32-16-286540
Essensium/Mind http://www.mind.be
G.Geenslaan 9, 3001 Leuven, Belgium BE 872 984 063 RPR Leuven
LinkedIn profile: http://www.linkedin.com/in/arnoutvandecappelle
GPG fingerprint: D206 D44B 5155 DF98 550D 3F2A 2213 88AA A1C7 C933
[-- Attachment #2: putty_blocked_trace.log --]
[-- Type: application/octet-stream, Size: 50059 bytes --]
=~=~=~=~=~=~=~=~=~=~=~= PuTTY log 2009.10.16 14:56:16 =~=~=~=~=~=~=~=~=~=~=~=
SysRq : Show Blocked State
task PC stack pid father
init D ffff88007fb79a48 0 1 0
ffff88007fb79a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88007fb76040 ffff88000c5fc9c0 ffff88007fb76380
000000037fb799e8 ffffffff8024ee66 ffff88007fb76380 ffff88007fb79a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8025a9b0>] ? wake_bit_function+0x0/0x40
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802138b9>] ? read_tsc+0x9/0x20
[<ffffffff802611e9>] ? getnstimeofday+0x59/0xe0
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff802ced0c>] ? sys_select+0x5c/0x110
[<ffffffff8054de79>] error_exit+0x0/0x51
scsi_eh_3 D 7fffffffffffffff 0 934 2
ffff8800364d7d60 0000000000000046 ffff880036ca2a88 ffff8800364d7cf0
ffffffff807bb000 ffff880036d8c100 ffff88007f070500 ffff880036d8c440
000000023758d388 ffff88003758d178 ffff880036d8c440 ffffffff803e9367
Call Trace:
[<ffffffff803e9367>] ? kobject_put+0x27/0x60
[<ffffffff8054bf05>] schedule_timeout+0xb5/0xf0
[<ffffffff80233d86>] ? dequeue_task+0x96/0xe0
[<ffffffff8054b1b5>] wait_for_common+0x145/0x170
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff8054b278>] wait_for_completion+0x18/0x20
[<ffffffffa0156a55>] command_abort+0x85/0xb0 [usb_storage]
[<ffffffffa0030d26>] scsi_error_handler+0x346/0x380 [scsi_mod]
[<ffffffff8023b5ad>] ? default_wake_function+0xd/0x10
[<ffffffffa00309e0>] ? scsi_error_handler+0x0/0x380 [scsi_mod]
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
usb-storage D ffff880036d97a20 0 935 2
ffff880036d97a10 0000000000000046 000000000000000c 0000000000000002
ffffffff807bb000 ffff88003647c0c0 ffff88001d132640 ffff88003647c400
0000000236d979c0 ffffffff8024ee66 ffff88003647c400 ffff880036d97a20
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054af27>] __sched_text_start+0x37/0x50
[<ffffffff80295c3c>] congestion_wait+0x6c/0x90
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8028ca35>] __alloc_pages_internal+0x2f5/0x4d0
[<ffffffff802b6d15>] kmem_getpages+0x85/0x190
[<ffffffff802b6f7c>] fallback_alloc+0x15c/0x1f0
[<ffffffff802b70a9>] ____cache_alloc_node+0x99/0x200
[<ffffffff8048d709>] ? usb_alloc_urb+0x19/0x50
[<ffffffff802b82b9>] __kmalloc+0x1e9/0x210
[<ffffffff8048d709>] usb_alloc_urb+0x19/0x50
[<ffffffff8048e302>] usb_sg_init+0x1a2/0x310
[<ffffffffa0157b2d>] usb_stor_bulk_transfer_sglist+0x7d/0xf0 [usb_storage]
[<ffffffffa0157c20>] usb_stor_bulk_srb+0x20/0x30 [usb_storage]
[<ffffffffa0157d4e>] usb_stor_Bulk_transport+0x11e/0x340 [usb_storage]
[<ffffffffa0157821>] usb_stor_invoke_transport+0x31/0x2c0 [usb_storage]
[<ffffffff8054b1c0>] ? wait_for_common+0x150/0x170
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffffa0156da9>] usb_stor_transparent_scsi_command+0x9/0x10 [usb_storage]
[<ffffffffa0159273>] usb_stor_control_thread+0x143/0x220 [usb_storage]
[<ffffffffa0159130>] ? usb_stor_control_thread+0x0/0x220 [usb_storage]
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
getty D ffff88003c5e1a48 0 15058 1
ffff88003c5e1a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff8800374da380 ffff88003c51c600 ffff8800374da6c0
000000023c5e19e8 ffffffff8024ee66 ffff8800374da6c0 ffff88003c5e1a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff8054b6ff>] ? thread_return+0x3d/0x64e
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802363ce>] ? __wake_up+0x4e/0x70
[<ffffffff80248cd2>] ? current_fs_time+0x22/0x30
[<ffffffff8044e4da>] ? tty_ldisc_deref+0x5a/0x80
[<ffffffff804467ea>] ? tty_read+0xca/0xf0
[<ffffffff802bf239>] ? vfs_read+0x129/0x180
[<ffffffff8054de79>] error_exit+0x0/0x51
getty D ffff88003c46da48 0 15059 1
ffff88003c46da38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff880036d223c0 ffff88003c56e980 ffff880036d22700
000000003c46d9e8 ffffffff8024ee66 ffff880036d22700 ffff88003c46da48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff8054b6ff>] ? thread_return+0x3d/0x64e
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802363ce>] ? __wake_up+0x4e/0x70
[<ffffffff80248cd2>] ? current_fs_time+0x22/0x30
[<ffffffff8044e4da>] ? tty_ldisc_deref+0x5a/0x80
[<ffffffff804467ea>] ? tty_read+0xca/0xf0
[<ffffffff802bf239>] ? vfs_read+0x129/0x180
[<ffffffff8054de79>] error_exit+0x0/0x51
wget D ffff88003c5b5a48 0 15140 1
ffff88003c5b5a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff880036d26940 ffff880000c44780 ffff880036d26c80
000000023c5b59e8 ffffffff8024ee66 ffff880036d26c80 ffff88003c5b5a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff804b81a2>] ? sock_common_recvmsg+0x32/0x50
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff803ae8a1>] ? security_file_permission+0x11/0x20
[<ffffffff802bef7c>] ? vfs_write+0x12c/0x190
[<ffffffff8054de79>] error_exit+0x0/0x51
wget D ffff88003c415a48 0 15141 1
ffff88003c415a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88003c56e980 ffff88000372e6c0 ffff88003c56ecc0
000000003c4159e8 ffffffff8024ee66 ffff88003c56ecc0 ffff88003c415a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8025a9b0>] ? wake_bit_function+0x0/0x40
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff803ae8a1>] ? security_file_permission+0x11/0x20
[<ffffffff802bef7c>] ? vfs_write+0x12c/0x190
[<ffffffff8054de79>] error_exit+0x0/0x51
wget D ffff8800378dda48 0 15142 1
ffff8800378dda38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff8800374c69c0 ffff88001d132640 ffff8800374c6d00
00000002378dd9e8 ffffffff8024ee66 ffff8800374c6d00 ffff8800378dda48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8025a9b0>] ? wake_bit_function+0x0/0x40
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff803ae8a1>] ? security_file_permission+0x11/0x20
[<ffffffff802bef7c>] ? vfs_write+0x12c/0x190
[<ffffffff8054de79>] error_exit+0x0/0x51
wget D ffff8800368b1a48 0 15143 1
ffff8800368b1a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88003749c040 ffff88003744c640 ffff88003749c380
00000001368b19e8 ffffffff8024ee66 ffff88003749c380 ffff8800368b1a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff804b81a2>] ? sock_common_recvmsg+0x32/0x50
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff803ae8a1>] ? security_file_permission+0x11/0x20
[<ffffffff802bef7c>] ? vfs_write+0x12c/0x190
[<ffffffff8054de79>] error_exit+0x0/0x51
wget D 0000000000000003 0 15167 1
ffff88003c475a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88003c4345c0 ffff880036d223c0 ffff88003c434900
000000003c4759e8 ffffffff8024ee66 ffff88003c434900 ffff88003c475a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff804b81a2>] ? sock_common_recvmsg+0x32/0x50
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff803ae8a1>] ? security_file_permission+0x11/0x20
[<ffffffff802bef7c>] ? vfs_write+0x12c/0x190
[<ffffffff8054de79>] error_exit+0x0/0x51
wget D ffffffff80560200 0 15168 1
ffff88003c4c9a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88003c480600 ffff88007fba0240 ffff88003c480940
000000013c4c99e8 000000010042481e ffff88003c480940 ffff88003c4c9a48
Call Trace:
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff804b81a2>] ? sock_common_recvmsg+0x32/0x50
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff803ae8a1>] ? security_file_permission+0x11/0x20
[<ffffffff802bef7c>] ? vfs_write+0x12c/0x190
[<ffffffff8054de79>] error_exit+0x0/0x51
wget D ffffffff80560200 0 15169 1
ffff88001d1359c8 0000000000000082 000000000000000c 0000000000000003
ffffffff807bb000 ffff88001d132640 ffff88007fbda340 ffff88001d132980
000000021d135978 0000000100424976 ffff88001d132980 ffff88001d1359d8
Call Trace:
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff802889dd>] out_of_memory+0x22d/0x2c0
[<ffffffff8028cbc9>] __alloc_pages_internal+0x489/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff804b81a2>] ? sock_common_recvmsg+0x32/0x50
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff803ae8a1>] ? security_file_permission+0x11/0x20
[<ffffffff802bef7c>] ? vfs_write+0x12c/0x190
[<ffffffff8054de79>] error_exit+0x0/0x51
wget D ffff880047f73a48 0 15170 1
ffff880047f73a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff880047f70680 ffff88003c4345c0 ffff880047f709c0
0000000047f739e8 ffffffff8024ee66 ffff880047f709c0 ffff880047f73a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff804b81a2>] ? sock_common_recvmsg+0x32/0x50
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff803ae8a1>] ? security_file_permission+0x11/0x20
[<ffffffff802bef7c>] ? vfs_write+0x12c/0x190
[<ffffffff8054de79>] error_exit+0x0/0x51
wget D ffff880003731a48 0 15171 1
ffff880003731a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88000372e6c0 ffff88007f2b2040 ffff88000372ea00
00000000037319e8 ffffffff8024ee66 ffff88000372ea00 ffff880003731a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff804b81a2>] ? sock_common_recvmsg+0x32/0x50
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff803ae8a1>] ? security_file_permission+0x11/0x20
[<ffffffff802bef7c>] ? vfs_write+0x12c/0x190
[<ffffffff8054de79>] error_exit+0x0/0x51
top D ffff88003c483a48 0 15329 15306
ffff88003c483a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88003744c640 ffff88003c480600 ffff88003744c980
000000013c4839e8 ffffffff8024ee66 ffff88003744c980 ffff88003c483a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8025a9b0>] ? wake_bit_function+0x0/0x40
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff802363ce>] ? __wake_up+0x4e/0x70
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8044878f>] ? tty_ioctl+0xef/0x920
[<ffffffff802138b9>] ? read_tsc+0x9/0x20
[<ffffffff802611e9>] ? getnstimeofday+0x59/0xe0
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff802ced0c>] ? sys_select+0x5c/0x110
[<ffffffff8054de79>] error_exit+0x0/0x51
bash D ffff880036de1a48 0 15426 15173
ffff880036de1a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88003c5aa440 ffff88007fb76040 ffff88003c5aa780
0000000336de19e8 ffffffff8024ee66 ffff88003c5aa780 ffff880036de1a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff8054b6ff>] ? thread_return+0x3d/0x64e
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802363ce>] ? __wake_up+0x4e/0x70
[<ffffffff80248cd2>] ? current_fs_time+0x22/0x30
[<ffffffff8044e4da>] ? tty_ldisc_deref+0x5a/0x80
[<ffffffff804467ea>] ? tty_read+0xca/0xf0
[<ffffffff802bf239>] ? vfs_read+0x129/0x180
[<ffffffff8054de79>] error_exit+0x0/0x51
fillmem.py D ffffffff80560200 0 15515 1
ffff88003c5bbb38 0000000000000082 ffff88003c5bbb68 ffffffff802eb0b4
ffffffff807bb000 ffff8800369cc2c0 ffffffff806b0340 ffff8800369cc600
000000003709c740 00000001003c1008 ffff8800369cc600 0000000000000000
Call Trace:
[<ffffffff802eb0b4>] ? mpage_readpages+0xf4/0x110
[<ffffffff80238ab8>] ? enqueue_task_fair+0x198/0x2d0
[<ffffffff803d69cc>] ? blk_unplug+0x5c/0x70
[<ffffffff8054bd47>] io_schedule+0x37/0x50
[<ffffffff802856b5>] sync_page+0x35/0x60
[<ffffffff8054bff2>] __wait_on_bit_lock+0x52/0xb0
[<ffffffff80285680>] ? sync_page+0x0/0x60
[<ffffffff80285664>] __lock_page+0x64/0x70
[<ffffffff8025a9b0>] ? wake_bit_function+0x0/0x40
[<ffffffff8028548b>] ? find_get_page+0x1b/0xb0
[<ffffffff80285818>] find_lock_page+0x58/0x70
[<ffffffff80285de4>] filemap_fault+0x144/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802b6741>] ? kfree_debugcheck+0x11/0x30
[<ffffffff802b6998>] ? cache_free_debugcheck+0x238/0x2c0
[<ffffffff8029d80c>] ? remove_vma+0x5c/0x80
[<ffffffff8029d790>] ? unmap_region+0x130/0x150
[<ffffffff803ecf60>] ? __up_write+0xe0/0x150
[<ffffffff8054de79>] error_exit+0x0/0x51
rsyslogd D ffff880036c05a48 0 15527 1
ffff880036c05a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88003698a480 ffff88003749c040 ffff88003698a7c0
0000000136c059e8 ffffffff8024ee66 ffff88003698a7c0 ffff880036c05a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8025a9b0>] ? wake_bit_function+0x0/0x40
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff80251151>] ? send_signal+0x131/0x2e0
[<ffffffff802138b9>] ? read_tsc+0x9/0x20
[<ffffffff802611e9>] ? getnstimeofday+0x59/0xe0
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff802ced0c>] ? sys_select+0x5c/0x110
[<ffffffff8054de79>] error_exit+0x0/0x51
rsyslogd D ffff8800379dfa48 0 15528 1
ffff8800379dfa38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff8800369163c0 ffff8800374c69c0 ffff880036916700
00000002379df9e8 ffffffff8024ee66 ffff880036916700 ffff8800379dfa48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025ac66>] ? remove_wait_queue+0x46/0x60
[<ffffffff802138b9>] ? read_tsc+0x9/0x20
[<ffffffff802611e9>] ? getnstimeofday+0x59/0xe0
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802683d6>] ? sys_futex+0xc6/0x170
[<ffffffff8054de79>] error_exit+0x0/0x51
fillmem.py D ffff880001025a18 0 15536 1
ffff88007f057b38 0000000000000082 ffff88007f057b68 ffffffff802eb0b4
ffffffff807bb000 ffff88003709c740 ffff88007fb921c0 ffff88003709ca80
0000000100000000 ffff880000002c00 ffff88003709ca80 000000000000aea4
Call Trace:
[<ffffffff802eb0b4>] ? mpage_readpages+0xf4/0x110
[<ffffffff803d69cc>] ? blk_unplug+0x5c/0x70
[<ffffffff8054bd47>] io_schedule+0x37/0x50
[<ffffffff802856b5>] sync_page+0x35/0x60
[<ffffffff8054bff2>] __wait_on_bit_lock+0x52/0xb0
[<ffffffff80285680>] ? sync_page+0x0/0x60
[<ffffffff80285664>] __lock_page+0x64/0x70
[<ffffffff8025a9b0>] ? wake_bit_function+0x0/0x40
[<ffffffff8028548b>] ? find_get_page+0x1b/0xb0
[<ffffffff80285818>] find_lock_page+0x58/0x70
[<ffffffff80285f81>] filemap_fault+0x2e1/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802b6741>] ? kfree_debugcheck+0x11/0x30
[<ffffffff802b6998>] ? cache_free_debugcheck+0x238/0x2c0
[<ffffffff8029d80c>] ? remove_vma+0x5c/0x80
[<ffffffff8029d790>] ? unmap_region+0x130/0x150
[<ffffffff803ecf60>] ? __up_write+0xe0/0x150
[<ffffffff8054de79>] error_exit+0x0/0x51
fillmem.py D ffff88003c5cda48 0 15539 1
ffff88003c5cda38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff8800369fa700 ffff88003688a380 ffff8800369faa40
000000013c5cd9e8 ffffffff8024ee66 ffff8800369faa40 ffff88003c5cda48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802b6741>] ? kfree_debugcheck+0x11/0x30
[<ffffffff802b6998>] ? cache_free_debugcheck+0x238/0x2c0
[<ffffffff8029d80c>] ? remove_vma+0x5c/0x80
[<ffffffff8029d790>] ? unmap_region+0x130/0x150
[<ffffffff803ecf60>] ? __up_write+0xe0/0x150
[<ffffffff8054de79>] error_exit+0x0/0x51
fillmem.py D ffff88001e8c1a48 0 15542 1
ffff88001e8c1a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88000c5fc9c0 ffff88003c5aa440 ffff88000c5fcd00
000000031e8c19e8 ffffffff8024ee66 ffff88000c5fcd00 ffff88001e8c1a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802b6741>] ? kfree_debugcheck+0x11/0x30
[<ffffffff802b6998>] ? cache_free_debugcheck+0x238/0x2c0
[<ffffffff8029d80c>] ? remove_vma+0x5c/0x80
[<ffffffff8029d790>] ? unmap_region+0x130/0x150
[<ffffffff803ecf60>] ? __up_write+0xe0/0x150
[<ffffffff8054de79>] error_exit+0x0/0x51
fillmem.py D ffff880001019a18 0 15543 1
ffff880000c59b38 0000000000000082 ffff880000c59b68 ffffffff802eb01b
ffffffff807bb000 ffff880052b22040 ffff88003c4ce980 ffff880052b22380
0000000000000000 ffff880000002c00 ffff880052b22380 0000000000000001
Call Trace:
[<ffffffff802eb01b>] ? mpage_readpages+0x5b/0x110
[<ffffffff803d69cc>] ? blk_unplug+0x5c/0x70
[<ffffffff8054bd47>] io_schedule+0x37/0x50
[<ffffffff802856b5>] sync_page+0x35/0x60
[<ffffffff8054bff2>] __wait_on_bit_lock+0x52/0xb0
[<ffffffff80285680>] ? sync_page+0x0/0x60
[<ffffffff80285664>] __lock_page+0x64/0x70
[<ffffffff8025a9b0>] ? wake_bit_function+0x0/0x40
[<ffffffff8028548b>] ? find_get_page+0x1b/0xb0
[<ffffffff80285818>] find_lock_page+0x58/0x70
[<ffffffff80285f81>] filemap_fault+0x2e1/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802b6741>] ? kfree_debugcheck+0x11/0x30
[<ffffffff802b6998>] ? cache_free_debugcheck+0x238/0x2c0
[<ffffffff8029d80c>] ? remove_vma+0x5c/0x80
[<ffffffff8029d790>] ? unmap_region+0x130/0x150
[<ffffffff803ecf60>] ? __up_write+0xe0/0x150
[<ffffffff8054de79>] error_exit+0x0/0x51
fillmem.py D ffff880000c1fa48 0 15544 1
ffff880000c1fa38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff880000c44780 ffff8800369163c0 ffff880000c44ac0
0000000200c1f9e8 ffffffff8024ee66 ffff880000c44ac0 ffff880000c1fa48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802b6741>] ? kfree_debugcheck+0x11/0x30
[<ffffffff802b6998>] ? cache_free_debugcheck+0x238/0x2c0
[<ffffffff8029d80c>] ? remove_vma+0x5c/0x80
[<ffffffff8029d790>] ? unmap_region+0x130/0x150
[<ffffffff803ecf60>] ? __up_write+0xe0/0x150
[<ffffffff8054de79>] error_exit+0x0/0x51
fillmem.py D ffffffff80560200 0 15545 1
ffff880000c29b38 0000000000000082 ffff880000c29b68 ffffffff802eb0b4
ffffffff807bb000 ffff880000c267c0 ffffffff806b0340 ffff880000c26b00
0000000000000000 00000001003c1010 ffff880000c26b00 000000000006581d
Call Trace:
[<ffffffff802eb0b4>] ? mpage_readpages+0xf4/0x110
[<ffffffff803d69cc>] ? blk_unplug+0x5c/0x70
[<ffffffff8054bd47>] io_schedule+0x37/0x50
[<ffffffff802856b5>] sync_page+0x35/0x60
[<ffffffff8054bff2>] __wait_on_bit_lock+0x52/0xb0
[<ffffffff80285680>] ? sync_page+0x0/0x60
[<ffffffff80285664>] __lock_page+0x64/0x70
[<ffffffff8025a9b0>] ? wake_bit_function+0x0/0x40
[<ffffffff8028548b>] ? find_get_page+0x1b/0xb0
[<ffffffff80285818>] find_lock_page+0x58/0x70
[<ffffffff80285de4>] filemap_fault+0x144/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802cb1bb>] ? do_filp_open+0x21b/0x970
[<ffffffff802b6741>] ? kfree_debugcheck+0x11/0x30
[<ffffffff8054b6ff>] ? thread_return+0x3d/0x64e
[<ffffffff8054de79>] error_exit+0x0/0x51
fillmem.py D ffff880000c4fa48 0 15546 1
ffff880000c4fa38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88003688a380 ffff88003698a480 ffff88003688a6c0
0000000100c4f9e8 ffffffff8024ee66 ffff88003688a6c0 ffff880000c4fa48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802b6741>] ? kfree_debugcheck+0x11/0x30
[<ffffffff802b6998>] ? cache_free_debugcheck+0x238/0x2c0
[<ffffffff8029d80c>] ? remove_vma+0x5c/0x80
[<ffffffff8029d790>] ? unmap_region+0x130/0x150
[<ffffffff803ecf60>] ? __up_write+0xe0/0x150
[<ffffffff8054de79>] error_exit+0x0/0x51
Sched Debug Version: v0.07, 2.6.28.10-v3500-1 #1
now at 17678452.158630 msecs
.sysctl_sched_latency : 60.000000
.sysctl_sched_min_granularity : 12.000000
.sysctl_sched_wakeup_granularity : 15.000000
.sysctl_sched_child_runs_first : 0.000001
.sysctl_sched_features : 24191
cpu#0, 2493.893 MHz
.nr_running : 0
.load : 0
.nr_switches : 30583934
.nr_load_updates : 3597917
.nr_uninterruptible : -2955
.jiffies : 4299311921
.next_balance : 4299.311923
.curr->pid : 0
.clock : 17678512.057829
.cpu_load[0] : 0
.cpu_load[1] : 0
.cpu_load[2] : 0
.cpu_load[3] : 0
.cpu_load[4] : 0
.yld_exp_empty : 0
.yld_act_empty : 0
.yld_both_empty : 0
.yld_count : 5504
.sched_switch : 0
.sched_count : 56577258
.sched_goidle : 12180257
.ttwu_count : 17887065
.ttwu_local : 13898895
.bkl_count : 1964
cfs_rq[0]:
.exec_clock : 1803304.234698
.MIN_vruntime : 0.000001
.min_vruntime : 1704775222.663274
.max_vruntime : 0.000001
.spread : 0.000000
.spread0 : 0.000000
.nr_running : 0
.load : 0
.nr_spread_over : 7907094
rt_rq[0]:
.rt_nr_running : 0
.rt_throttled : 0
.rt_time : 0.000000
.rt_runtime : 950.000000
runnable tasks:
task PID tree-key switches prio exec-runtime sum-exec sum-sleep
----------------------------------------------------------------------------------------------------------
cpu#1, 2493.893 MHz
.nr_running : 0
.load : 0
.nr_switches : 28460501
.nr_load_updates : 3100508
.nr_uninterruptible : 2133
.jiffies : 4299311962
.next_balance : 4299.311134
.curr->pid : 0
.clock : 17675348.557085
.cpu_load[0] : 0
.cpu_load[1] : 0
.cpu_load[2] : 0
.cpu_load[3] : 0
.cpu_load[4] : 0
.yld_exp_empty : 0
.yld_act_empty : 0
.yld_both_empty : 0
.yld_count : 16468
.sched_switch : 0
.sched_count : 44186003
.sched_goidle : 11180814
.ttwu_count : 16606035
.ttwu_local : 13491917
.bkl_count : 7654
cfs_rq[1]:
.exec_clock : 1714271.470004
.MIN_vruntime : 0.000001
.min_vruntime : 2760178909.337745
.max_vruntime : 0.000001
.spread : 0.000000
.spread0 : 1055403614.312384
.nr_running : 0
.load : 0
.nr_spread_over : 6877817
rt_rq[1]:
.rt_nr_running : 0
.rt_throttled : 0
.rt_time : 0.000000
.rt_runtime : 950.000000
runnable tasks:
task PID tree-key switches prio exec-runtime sum-exec sum-sleep
----------------------------------------------------------------------------------------------------------
cpu#2, 2493.893 MHz
.nr_running : 0
.load : 0
.nr_switches : 27246046
.nr_load_updates : 3183709
.nr_uninterruptible : -145
.jiffies : 4299312002
.next_balance : 4299.312004
.curr->pid : 0
.clock : 17678837.059540
.cpu_load[0] : 0
.cpu_load[1] : 0
.cpu_load[2] : 0
.cpu_load[3] : 0
.cpu_load[4] : 0
.yld_exp_empty : 0
.yld_act_empty : 0
.yld_both_empty : 0
.yld_count : 3629
.sched_switch : 0
.sched_count : 35109110
.sched_goidle : 10349434
.ttwu_count : 16272135
.ttwu_local : 13367503
.bkl_count : 2861
cfs_rq[2]:
.exec_clock : 1691778.789339
.MIN_vruntime : 0.000001
.min_vruntime : 1682204616.724638
.max_vruntime : 0.000001
.spread : 0.000000
.spread0 : -22570693.347924
.nr_running : 0
.load : 0
.nr_spread_over : 3654489
rt_rq[2]:
.rt_nr_running : 0
.rt_throttled : 0
.rt_time : 0.000000
.rt_runtime : 950.000000
runnable tasks:
task PID tree-key switches prio exec-runtime sum-exec sum-sleep
----------------------------------------------------------------------------------------------------------
cpu#3, 2493.893 MHz
.nr_running : 0
.load : 0
.nr_switches : 29592152
.nr_load_updates : 3522754
.nr_uninterruptible : 994
.jiffies : 4299312043
.next_balance : 4299.312045
.curr->pid : 0
.clock : 17679001.054926
.cpu_load[0] : 0
.cpu_load[1] : 0
.cpu_load[2] : 0
.cpu_load[3] : 0
.cpu_load[4] : 0
.yld_exp_empty : 0
.yld_act_empty : 0
.yld_both_empty : 0
.yld_count : 4720
.sched_switch : 0
.sched_count : 43265219
.sched_goidle : 11685559
.ttwu_count : 17095422
.ttwu_local : 13201458
.bkl_count : 3914
cfs_rq[3]:
.exec_clock : 1863186.701648
.MIN_vruntime : 0.000001
.min_vruntime : 2661464428.164819
.max_vruntime : 0.000001
.spread : 0.000000
.spread0 : 956689101.784306
.nr_running : 0
.load : 0
.nr_spread_over : 6369857
rt_rq[3]:
.rt_nr_running : 0
.rt_throttled : 0
.rt_time : 0.000000
.rt_runtime : 950.000000
runnable tasks:
task PID tree-key switches prio exec-runtime sum-exec sum-sleep
----------------------------------------------------------------------------------------------------------
SysRq : Show backtrace of all active CPUs
CPU0:
CPU 0:
Modules linked in: mptsas mptscsih mptbase scsi_transport_sas dm_crypt dm_mod hid_cherry video output ipv6 bridge stp llc sd_mod usbhid hid piix usb_storage ide_core ehci_hcd uhci_hcd bnx2 zlib_inflate scsi_mod processor thermal_sys [last unloaded: fan]
Pid: 0, comm: swapper Not tainted 2.6.28.10-v3500-1 #1
RIP: 0010:[<ffffffff80214610>] [<ffffffff80214610>] mwait_idle+0x40/0x50
RSP: 0000:ffffffff8074df48 EFLAGS: 00000246
RAX: 0000000000000000 RBX: ffffffff8074df48 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffffff806b3d30
RBP: ffffffff8074df48 R08: 0000000000000000 R09: 000000010042564b
R10: 0000000000000000 R11: 0000000000000000 R12: ffffffff802601e3
R13: ffffffff8074ded8 R14: ffffffff807c2b40 R15: ffff880001019b40
FS: 0000000000000000(0000) GS:ffffffff807d1040(0000) knlGS:0000000000000000
CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 00007f176a4f1970 CR3: 0000000037927000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff8020b382>] ? enter_idle+0x22/0x30
[<ffffffff8020b3ee>] cpu_idle+0x5e/0xb0
[<ffffffff8053a3e1>] rest_init+0x61/0x70
ksoftirqd/3: page allocation failure. order:1, mode:0x20
Pid: 13, comm: ksoftirqd/3 Not tainted 2.6.28.10-v3500-1 #1
Call Trace:
<IRQ> [<ffffffff8028cb0e>] __alloc_pages_internal+0x3ce/0x4d0
[<ffffffff802b6d15>] kmem_getpages+0x85/0x190
[<ffffffff802b6f7c>] fallback_alloc+0x15c/0x1f0
[<ffffffff802b70a9>] ____cache_alloc_node+0x99/0x200
[<ffffffff80465c05>] ? ipmi_alloc_smi_msg+0x15/0x40
[<ffffffff802b8449>] kmem_cache_alloc+0x169/0x190
[<ffffffff80465c05>] ipmi_alloc_smi_msg+0x15/0x40
[<ffffffff8046adeb>] smi_event_handler+0x1bb/0x540
[<ffffffff802363ce>] ? __wake_up+0x4e/0x70
[<ffffffff8046b693>] smi_timeout+0x43/0x100
[<ffffffff8046b650>] ? smi_timeout+0x0/0x100
[<ffffffff8024e70f>] run_timer_softirq+0x13f/0x210
[<ffffffff80249c14>] __do_softirq+0x94/0x160
[<ffffffff8020d53c>] call_softirq+0x1c/0x30
<EOI> [<ffffffff8020ee65>] do_softirq+0x45/0x80
[<ffffffff802495da>] ksoftirqd+0x6a/0x100
[<ffffffff80249570>] ? ksoftirqd+0x0/0x100
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 174
CPU 1: hi: 186, btch: 31 usd: 172
CPU 2: hi: 186, btch: 31 usd: 145
CPU 3: hi: 186, btch: 31 usd: 183
Active_anon:375770 active_file:0 inactive_anon:125455
inactive_file:67 unevictable:3 dirty:0 writeback:0 unstable:0
free:2517 slab:5645 mapped:1 pagetables:529 bounce:0
Node 0 DMA free:7940kB min:24kB low:28kB high:36kB active_anon:896kB inactive_anon:924kB active_file:0kB inactive_file:0kB unevictable:0kB present:9000kB pages_scanned:3188 all_unreclaimable? yes
lowmem_reserve[]: 0 2003 2003 2003
Node 0 DMA32 free:2128kB min:5712kB low:7140kB high:8568kB active_anon:1502184kB inactive_anon:500896kB active_file:0kB inactive_file:268kB unevictable:12kB present:2052092kB pages_scanned:5920508 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 11*4kB 3*8kB 8*16kB 2*32kB 2*64kB 3*128kB 2*256kB 3*512kB 3*1024kB 1*2048kB 0*4096kB = 7940kB
Node 0 DMA32: 8*4kB 6*8kB 0*16kB 4*32kB 8*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2128kB
477766 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
524231 pages RAM
9154 pages reserved
70 pages shared
511068 pages non-shared
SysRq : Show backtrace of all active CPUs
CPU3:
CPU 3:
Modules linked in: mptsas mptscsih mptbase scsi_transport_sas dm_crypt dm_mod hid_cherry video output ipv6 bridge stp llc sd_mod usbhid hid piix usb_storage ide_core ehci_hcd uhci_hcd bnx2 zlib_inflate scsi_mod processor thermal_sys [last unloaded: fan]
Pid: 0, comm: swapper Not tainted 2.6.28.10-v3500-1 #1
RIP: 0010:[<ffffffff80214610>] [<ffffffff80214610>] mwait_idle+0x40/0x50
RSP: 0000:ffff88007f037f18 EFLAGS: 00000246
RAX: 0000000000000000 RBX: ffff88007f037f18 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffffff806b3d30
RBP: ffff88007f037f18 R08: 0000000000000000 R09: 000000010042632b
R10: 28f5c28f5c28f5c3 R11: 0000000000000003 R12: ffffffff802601e3
R13: ffff88007f037ea8 R14: ffffffff807c2b40 R15: ffff88000103db40
FS: 0000000000000000(0000) GS:ffff88007f010898(0000) knlGS:0000000000000000
CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 00007fd5bb332970 CR3: 000000003793e000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff8020b382>] ? enter_idle+0x22/0x30
[<ffffffff8020b3ee>] cpu_idle+0x5e/0xb0
[<ffffffff80547bc7>] start_secondary+0x152/0x1ab
SysRq : Show Memory
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 174
CPU 1: hi: 186, btch: 31 usd: 172
CPU 2: hi: 186, btch: 31 usd: 145
CPU 3: hi: 186, btch: 31 usd: 183
Active_anon:375770 active_file:0 inactive_anon:125455
inactive_file:67 unevictable:3 dirty:0 writeback:0 unstable:0
free:2517 slab:5645 mapped:1 pagetables:529 bounce:0
Node 0 DMA free:7940kB min:24kB low:28kB high:36kB active_anon:896kB inactive_anon:924kB active_file:0kB inactive_file:0kB unevictable:0kB present:9000kB pages_scanned:3188 all_unreclaimable? yes
lowmem_reserve[]: 0 2003 2003 2003
Node 0 DMA32 free:2128kB min:5712kB low:7140kB high:8568kB active_anon:1502184kB inactive_anon:500896kB active_file:0kB inactive_file:268kB unevictable:12kB present:2052092kB pages_scanned:5920508 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 11*4kB 3*8kB 8*16kB 2*32kB 2*64kB 3*128kB 2*256kB 3*512kB 3*1024kB 1*2048kB 0*4096kB = 7940kB
Node 0 DMA32: 8*4kB 6*8kB 0*16kB 4*32kB 8*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2128kB
477766 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
524231 pages RAM
9154 pages reserved
70 pages shared
511068 pages non-shared
[-- Attachment #3: putty_task_trace_frozen.log --]
[-- Type: application/octet-stream, Size: 95208 bytes --]
=~=~=~=~=~=~=~=~=~=~=~= PuTTY log 2009.10.16 14:54:40 =~=~=~=~=~=~=~=~=~=~=~=
SysRq : Show State
task PC stack pid father
init D ffff88007fb79a48 0 1 0
ffff88007fb79a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88007fb76040 ffff88003c5aa440 ffff88007fb76380
000000037fb799e8 ffffffff8024ee66 ffff88007fb76380 ffff88007fb79a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8025a9b0>] ? wake_bit_function+0x0/0x40
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802138b9>] ? read_tsc+0x9/0x20
[<ffffffff802611e9>] ? getnstimeofday+0x59/0xe0
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff802ced0c>] ? sys_select+0x5c/0x110
[<ffffffff8054de79>] error_exit+0x0/0x51
kthreadd S ffffffff80560200 0 2 0
ffff88007fb7ded0 0000000000000046 0000000000000082 ffff8800378e7a58
ffffffff807bb000 ffff88007fb7a080 ffffffff806b0340 ffff88007fb7a3c0
000000007fb7de60 00000001003a3a21 ffff88007fb7a3c0 ffffffff8023428a
Call Trace:
[<ffffffff8023428a>] ? __wake_up_common+0x5a/0x90
[<ffffffff8025a548>] kthreadd+0x198/0x1a0
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a3b0>] ? kthreadd+0x0/0x1a0
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
migration/0 S ffffffff80560200 0 3 2
ffff88007fb83ed0 0000000000000046 ffff88007fb83e40 ffffffff80233df8
ffffffff807bb000 ffff88007fb800c0 ffffffff806b0340 ffff88007fb80400
00000000802346db 00000001003c1f71 ffff88007fb80400 ffff88000102c5a0
Call Trace:
[<ffffffff80233df8>] ? activate_task+0x28/0x40
[<ffffffff802347ef>] ? move_one_task_fair+0x8f/0xc0
[<ffffffff8023f934>] migration_thread+0x1e4/0x290
[<ffffffff8023f750>] ? migration_thread+0x0/0x290
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
ksoftirqd/0 S 0000000000000001 0 4 2
ffff88007fb87f00 0000000000000046 ffff88007f2b2040 ffff88007fb84448
ffffffff807bb000 ffff88007fb84100 ffff88007f068480 ffff88007fb84440
000000000037a0be 0000000100409f9c ffff88007fb84440 ffff88007fb87fd8
Call Trace:
[<ffffffff803e9460>] ? kobject_release+0x0/0xa0
[<ffffffff80249625>] ksoftirqd+0xb5/0x100
[<ffffffff80249570>] ? ksoftirqd+0x0/0x100
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
watchdog/0 S 00000000000003b2 0 5 2
ffff88007fb8bed0 0000000000000046 ffff88007fb8be50 0000000000000282
ffffffff807bb000 ffff88007fb88140 ffff88007f068480 ffff88007fb88480
0000000001019b40 ffffffff807c2b40 ffff88007fb88480 ffffffff802601e3
Call Trace:
[<ffffffff802601e3>] ? sched_clock_cpu+0x143/0x190
[<ffffffff8027d82d>] watchdog+0x7d/0x230
[<ffffffff8027d7b0>] ? watchdog+0x0/0x230
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
migration/1 S ffffffff80560200 0 6 2
ffff88007fb91ed0 0000000000000046 0000000000000082 ffff880036925e50
ffffffff807bb000 ffff88007fb8e180 ffff88007fba0240 ffff88007fb8e4c0
000000017fb91e60 00000001003aed61 ffff88007fb8e4c0 ffffffff8023428a
Call Trace:
[<ffffffff8023428a>] ? __wake_up_common+0x5a/0x90
[<ffffffff8023f934>] migration_thread+0x1e4/0x290
[<ffffffff8023f750>] ? migration_thread+0x0/0x290
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
ksoftirqd/1 S 0000000000000001 0 7 2
ffff88007fb99f00 0000000000000046 ffff88003688a380 ffff88007fb92508
ffffffff807bb000 ffff88007fb921c0 ffff8800369fa700 ffff88007fb92500
0000000100000020 00000001004106f9 ffff88007fb92500 ffff88007fb99fd8
Call Trace:
[<ffffffff803e9460>] ? kobject_release+0x0/0xa0
[<ffffffff80249625>] ksoftirqd+0xb5/0x100
[<ffffffff80249570>] ? ksoftirqd+0x0/0x100
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
watchdog/1 S ffffffff80560200 0 8 2
ffff88007fb9ded0 0000000000000046 ffff88007fb9de50 0000000000000282
ffffffff807bb000 ffff88007fb9a200 ffff88007fba0240 ffff88007fb9a540
0000000101025b40 00000000fffedc40 ffff88007fb9a540 ffffffff802601e3
Call Trace:
[<ffffffff802601e3>] ? sched_clock_cpu+0x143/0x190
[<ffffffff8027d7b0>] ? watchdog+0x0/0x230
[<ffffffff8027d7b0>] ? watchdog+0x0/0x230
[<ffffffff8027d82d>] watchdog+0x7d/0x230
[<ffffffff8027d7b0>] ? watchdog+0x0/0x230
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
migration/2 S ffffffff80560200 0 9 2
ffff88007fbcbed0 0000000000000046 ffff88007fbcbe40 ffffffff80233df8
ffffffff807bb000 ffff88007fbc8280 ffff88007fbda340 ffff88007fbc85c0
00000002802346db 00000001003c1f75 ffff88007fbc85c0 ffff8800010145a0
Call Trace:
[<ffffffff80233df8>] ? activate_task+0x28/0x40
[<ffffffff802347ef>] ? move_one_task_fair+0x8f/0xc0
[<ffffffff8023f934>] migration_thread+0x1e4/0x290
[<ffffffff8023f750>] ? migration_thread+0x0/0x290
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
ksoftirqd/2 S 0000000000000001 0 10 2
ffff88007fbd3f00 0000000000000046 ffff8800374c69c0 ffff88007fbd0608
ffffffff807bb000 ffff88007fbd02c0 ffff88001d132640 ffff88007fbd0600
0000000200000010 000000010040ea2a ffff88007fbd0600 ffff88007fbd3fd8
Call Trace:
[<ffffffff803e9460>] ? kobject_release+0x0/0xa0
[<ffffffff80249625>] ksoftirqd+0xb5/0x100
[<ffffffff80249570>] ? ksoftirqd+0x0/0x100
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
watchdog/2 S ffffffff8027d7b0 0 11 2
ffff88007fbd9ed0 0000000000000046 ffff88007fbd9e50 0000000000000282
ffffffff807bb000 ffff88007fbd6300 ffff88007fbd02c0 ffff88007fbd6640
0000000201031b40 ffffffff807c2b40 ffff88007fbd6640 ffffffff802601e3
Call Trace:
[<ffffffff802601e3>] ? sched_clock_cpu+0x143/0x190
[<ffffffff8027d7b0>] ? watchdog+0x0/0x230
[<ffffffff8027d7b0>] ? watchdog+0x0/0x230
[<ffffffff8027d82d>] watchdog+0x7d/0x230
[<ffffffff8027d7b0>] ? watchdog+0x0/0x230
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
migration/3 S ffffffff80560200 0 12 2
ffff88007f007ed0 0000000000000046 0000000000000082 ffff880000c4fe50
ffffffff807bb000 ffff88007f004380 ffff88007f034440 ffff88007f0046c0
000000037f007e60 00000001003be5de ffff88007f0046c0 ffffffff8023428a
Call Trace:
[<ffffffff8023428a>] ? __wake_up_common+0x5a/0x90
[<ffffffff8023f934>] migration_thread+0x1e4/0x290
[<ffffffff8023f750>] ? migration_thread+0x0/0x290
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
ksoftirqd/3 S 0000000000000001 0 13 2
ffff88007f02ff00 0000000000000046 ffff88007fb76040 ffff88007f02c708
ffffffff807bb000 ffff88007f02c3c0 ffff88003c5aa440 ffff88007f02c700
0000000300000000 00000001004184f3 ffff88007f02c700 ffff88007f02ffd8
Call Trace:
[<ffffffff80249625>] ksoftirqd+0xb5/0x100
[<ffffffff80249570>] ? ksoftirqd+0x0/0x100
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
watchdog/3 S ffffffff80560200 0 14 2
ffff88007f033ed0 0000000000000046 ffff88007f033e50 0000000000000282
ffffffff807bb000 ffff88007f030400 ffff88007f034440 ffff88007f030740
000000030103db40 00000000fffedc7a ffff88007f030740 ffffffff802601e3
Call Trace:
[<ffffffff802601e3>] ? sched_clock_cpu+0x143/0x190
[<ffffffff8027d7b0>] ? watchdog+0x0/0x230
[<ffffffff8027d7b0>] ? watchdog+0x0/0x230
[<ffffffff8027d82d>] watchdog+0x7d/0x230
[<ffffffff8027d7b0>] ? watchdog+0x0/0x230
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
events/0 S ffff88007f010768 0 15 2
ffff88007f06bec0 0000000000000046 ffff88007f06be20 ffffffff8025728c
ffffffff807bb000 ffff88007f068480 ffff88007f2b2040 ffff88007f0687c0
00000000807bf7b0 000000000000003a ffff88007f0687c0 ffff880001016760
Call Trace:
[<ffffffff8025728c>] ? queue_delayed_work+0x1c/0x30
[<ffffffff802b9e40>] ? cache_reap+0x0/0x280
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
events/1 S ffff88007f0106d0 0 16 2
ffff88007f06fec0 0000000000000046 0000000000000000 0000000000000000
ffffffff807bb000 ffff88007f06c4c0 ffff88003749c040 ffff88007f06c800
000000017f0106d8 ffff88007fb7df00 ffff88007f06c800 ffffffff80256ed5
Call Trace:
[<ffffffff80256ed5>] ? queue_delayed_work_on+0x95/0xc0
[<ffffffff8025728c>] ? queue_delayed_work+0x1c/0x30
[<ffffffff802572b9>] ? schedule_delayed_work+0x19/0x20
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
events/2 S ffff88007f010638 0 17 2
ffff88007f073ec0 0000000000000046 0000000000000000 0000000000000000
ffffffff807bb000 ffff88007f070500 ffff88001d132640 ffff88007f070840
000000027f010640 ffff88007fb7df00 ffff88007f070840 ffffffff80256ed5
Call Trace:
[<ffffffff80256ed5>] ? queue_delayed_work_on+0x95/0xc0
[<ffffffff8025728c>] ? queue_delayed_work+0x1c/0x30
[<ffffffff802572b9>] ? schedule_delayed_work+0x19/0x20
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
events/3 S ffff88007f0105a0 0 18 2
ffff88007f079ec0 0000000000000046 0000000000000000 ffff88007a5fd2b8
ffffffff807bb000 ffff88007f076540 ffff88000c5fc9c0 ffff88007f076880
0000000336c24c18 ffff880036c24b98 ffff88007f076880 ffff880036c24b00
Call Trace:
[<ffffffff8044eba0>] ? flush_to_ldisc+0x0/0x1f0
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
khelper S ffffffff80560200 0 19 2
ffff88007f07dec0 0000000000000046 0000000000000000 ffff88007f07c000
ffffffff807bb000 ffff88007f07a580 ffff88007f034440 ffff88007f07a8c0
00000003802561f0 000000010024a619 ffff88007f07a8c0 0000000000000010
Call Trace:
[<ffffffff80255e14>] ? __call_usermodehelper+0x64/0x80
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
kstop/0 S ffff88007f010d58 0 22 2
ffff88007f08bec0 0000000000000046 ffff88007f08be50 ffffffff8023428a
ffffffff807bb000 ffff88007f088640 ffff88007f2b2040 ffff88007f088980
000000007f010d60 0000000000000286 ffff88007f088980 ffffffff802362fa
Call Trace:
[<ffffffff8023428a>] ? __wake_up_common+0x5a/0x90
[<ffffffff802362fa>] ? complete+0x4a/0x60
[<ffffffff80256960>] ? wq_barrier_func+0x0/0x10
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
kstop/1 S ffff88007f010cc0 0 23 2
ffff88007f091ec0 0000000000000046 ffff88007fb7dee0 ffff88007fb7df00
ffffffff807bb000 ffff88007f08e680 ffff880036d1a280 ffff88007f08e9c0
00000001807c2280 00000001000df93b ffff88007f08e9c0 0000000000000000
Call Trace:
[<ffffffff803e7bfe>] ? __first_cpu+0xe/0x20
[<ffffffff80278361>] ? stop_cpu+0xa1/0xf0
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
kstop/2 S ffffffff80560200 0 24 2
ffff88007f095ec0 0000000000000046 ffff88007fb7dee0 ffff88007fb7df00
ffffffff807bb000 ffff88007f0926c0 ffff88007fbda340 ffff88007f092a00
00000002807c2280 00000001000df93c ffff88007f092a00 0000000000000000
Call Trace:
[<ffffffff803e7bfe>] ? __first_cpu+0xe/0x20
[<ffffffff80278361>] ? stop_cpu+0xa1/0xf0
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
kstop/3 S ffff88007f010b90 0 25 2
ffff88007f099ec0 0000000000000046 ffff88007fb7dee0 ffff88007fb7df00
ffffffff807bb000 ffff88007f096700 ffff8800374c64c0 ffff88007f096a40
00000003807c2280 00000001000df92a ffff88007f096a40 0000000000000000
Call Trace:
[<ffffffff803e7bfe>] ? __first_cpu+0xe/0x20
[<ffffffff80278361>] ? stop_cpu+0xa1/0xf0
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
kblockd/0 S ffff88007f0dd430 0 94 2
ffff88007f1edec0 0000000000000046 ffff88007f1ede60 ffffffffa0031fc1
ffffffff807bb000 ffff88007f1ea480 ffff88003647c0c0 ffff88007f1ea7c0
0000000000000282 ffff88007f0dd438 ffff88007f1ea7c0 ffff88007fb7df00
Call Trace:
[<ffffffffa0031fc1>] ? scsi_request_fn+0xd1/0x4a0 [scsi_mod]
[<ffffffff803e34ab>] ? cfq_kick_queue+0x3b/0x50
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
kblockd/1 S ffffffff80560200 0 95 2
ffff88007f1f1ec0 0000000000000046 ffff88007f1f1e60 ffffffffa0031fc1
ffffffff807bb000 ffff88007f1ee4c0 ffff88007fba0240 ffff88007f1ee800
0000000100000282 00000001003c1010 ffff88007f1ee800 ffff88007fb7df00
Call Trace:
[<ffffffffa0031fc1>] ? scsi_request_fn+0xd1/0x4a0 [scsi_mod]
[<ffffffff803e34ab>] ? cfq_kick_queue+0x3b/0x50
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
kblockd/2 S ffffffff80560200 0 96 2
ffff88007f1f5ec0 0000000000000046 ffff88007f1f5e60 ffffffffa0031fc1
ffffffff807bb000 ffff88007f1f2500 ffff88007fbda340 ffff88007f1f2840
0000000200000282 00000001003c1003 ffff88007f1f2840 ffff88007fb7df00
Call Trace:
[<ffffffffa0031fc1>] ? scsi_request_fn+0xd1/0x4a0 [scsi_mod]
[<ffffffff803e34ab>] ? cfq_kick_queue+0x3b/0x50
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
kblockd/3 S ffffffff80560200 0 97 2
ffff88007f1fbec0 0000000000000046 ffff88007f1fbe60 ffffffffa0031fc1
ffffffff807bb000 ffff88007f1f8540 ffff88007f034440 ffff88007f1f8880
0000000300000282 00000001003c100f ffff88007f1f8880 ffff88007fb7df00
Call Trace:
[<ffffffffa0031fc1>] ? scsi_request_fn+0xd1/0x4a0 [scsi_mod]
[<ffffffff803e34ab>] ? cfq_kick_queue+0x3b/0x50
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
kacpid S ffffffff80560200 0 99 2
ffff88007f223ec0 0000000000000046 ffff88007fb7dee0 ffff88007fb7df00
ffffffff807bb000 ffff88007f220580 ffff88007fba0240 ffff88007f2208c0
00000001807c2280 00000000fffedb8b ffff88007f2208c0 0000000000000000
Call Trace:
[<ffffffff8054b6ff>] ? thread_return+0x3d/0x64e
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
kacpi_notify S ffffffff80560200 0 100 2
ffff88007f227ec0 0000000000000046 ffff88007fb7dee0 ffff88007fb7df00
ffffffff807bb000 ffff88007f2245c0 ffff88007fba0240 ffff88007f224900
00000001807c2280 00000000fffedb8b ffff88007f224900 0000000000000000
Call Trace:
[<ffffffff8054b6ff>] ? thread_return+0x3d/0x64e
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
ksuspend_usbd S ffffffff80560200 0 187 2
ffff88007f2efec0 0000000000000046 ffff8800374a5400 0000000000000000
ffffffff807bb000 ffff88007f2ec5c0 ffff88007f034440 ffff88007f2ec900
0000000336db8ae8 00000001000ad63c ffff88007f2ec900 ffffffff80490160
Call Trace:
[<ffffffff80490160>] ? usb_autopm_do_device+0xc0/0x110
[<ffffffff80490930>] ? usb_autosuspend_work+0x0/0x20
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
khubd S ffffffff80560200 0 193 2
ffff88007f195da0 0000000000000046 ffff8800375d8b08 ffff880036db8508
ffffffff807bb000 ffff88007f1be340 ffff88007fbda340 ffff88007f1be680
000000027f195d50 00000001000ad447 ffff88007f1be680 00000000ffffffed
Call Trace:
[<ffffffff80490709>] ? usb_autopm_do_interface+0xa9/0x120
[<ffffffff8048a19e>] hub_thread+0xdde/0x13b0
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff804893c0>] ? hub_thread+0x0/0x13b0
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
kseriod S ffff8800379ff560 0 196 2
ffff88007f19feb0 0000000000000046 ffff88007f19fe40 ffffffff802b6998
ffffffff807bb000 ffff88007f1ba300 ffff88007f2b2040 ffff88007f1ba640
000000027f19fec0 0000000000000286 ffff88007f1ba640 0000000000000286
Call Trace:
[<ffffffff802b6998>] ? cache_free_debugcheck+0x238/0x2c0
[<ffffffff8047d430>] ? __driver_attach+0x0/0xa0
[<ffffffff8049f436>] serio_thread+0x356/0x400
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8049f0e0>] ? serio_thread+0x0/0x400
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
kswapd0 S ffffffff80560200 0 267 2
ffff880037861de0 0000000000000046 000000000000000c 000000000007a62c
ffffffff807bb000 ffff88007f2b8080 ffffffff806b0340 ffff88007f2b83c0
0000000037861d80 000000010041eaa8 ffff88007f2b83c0 ffffffff806c8840
Call Trace:
[<ffffffff8025e809>] ? up_read+0x9/0x10
[<ffffffff80292fc7>] ? shrink_slab+0x147/0x180
[<ffffffff802939fb>] kswapd+0x72b/0x740
[<ffffffff802932d0>] ? kswapd+0x0/0x740
[<ffffffff80290b50>] ? isolate_pages_global+0x0/0x250
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff802932d0>] ? kswapd+0x0/0x740
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
aio/0 S ffffffff80560200 0 268 2
ffff880037865ec0 0000000000000046 ffff88007fb7dee0 ffff88007fb7df00
ffffffff807bb000 ffff88007f2bc0c0 ffffffff806b0340 ffff88007f2bc400
00000000807c2280 00000000fffee649 ffff88007f2bc400 0000000000000000
Call Trace:
[<ffffffff8054b6ff>] ? thread_return+0x3d/0x64e
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
aio/1 S ffffffff80560200 0 269 2
ffff880037867ec0 0000000000000046 ffff88007fb7dee0 ffff88007fb7df00
ffffffff807bb000 ffff88007f2aa980 ffff88007fba0240 ffff88007f2aacc0
00000001807c2280 00000000fffee649 ffff88007f2aacc0 0000000000000000
Call Trace:
[<ffffffff8054b6ff>] ? thread_return+0x3d/0x64e
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
aio/2 S ffffffff80560200 0 270 2
ffff880037869ec0 0000000000000046 ffff88007fb7dee0 ffff88007fb7df00
ffffffff807bb000 ffff88007f0ae6c0 ffff88007fbda340 ffff88007f0aea00
00000002807c2280 00000000fffee649 ffff88007f0aea00 0000000000000000
Call Trace:
[<ffffffff8054b6ff>] ? thread_return+0x3d/0x64e
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
aio/3 S ffffffff80560200 0 271 2
ffff88003786dec0 0000000000000046 ffff88007fb7dee0 ffff88007fb7df00
ffffffff807bb000 ffff88003786a1c0 ffff88007f034440 ffff88003786a500
00000003807c2280 00000000fffee670 ffff88003786a500 0000000000000000
Call Trace:
[<ffffffff8054b6ff>] ? thread_return+0x3d/0x64e
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
xfs_mru_cache S ffffffff80560200 0 272 2
ffff88003782bec0 0000000000000046 ffff88007fb7dee0 ffff88007fb7df00
ffffffff807bb000 ffff88007f18a380 ffff88007fba0240 ffff88007f18a6c0
00000001807c2280 00000000fffee658 ffff88007f18a6c0 0000000000000000
Call Trace:
[<ffffffff8054b6ff>] ? thread_return+0x3d/0x64e
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
xfslogd/0 S ffff880037852b50 0 273 2
ffff88007f14bec0 0000000000000046 ffff88007f14be20 ffffffff803956dc
ffffffff807bb000 ffff88007f18e3c0 ffff880079c5e080 ffff88007f18e700
000000007f14be70 00000001000ce73f ffff88007f18e700 ffffffff803955c0
Call Trace:
[<ffffffff803956dc>] ? xfs_buf_ioend+0x7c/0xb0
[<ffffffff803955c0>] ? xfs_buf_iodone_work+0x0/0xa0
[<ffffffff803955eb>] ? xfs_buf_iodone_work+0x2b/0xa0
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
xfslogd/1 S ffffffff80560200 0 274 2
ffff88007f147ec0 0000000000000046 ffff88007f147e20 ffffffff803956dc
ffffffff807bb000 ffff88007f2e8580 ffff88007fba0240 ffff88007f2e88c0
000000017f147e70 00000001000ce740 ffff88007f2e88c0 ffffffff803955c0
Call Trace:
[<ffffffff803956dc>] ? xfs_buf_ioend+0x7c/0xb0
[<ffffffff803955c0>] ? xfs_buf_iodone_work+0x0/0xa0
[<ffffffff803955eb>] ? xfs_buf_iodone_work+0x2b/0xa0
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
xfslogd/2 S ffffffff80560200 0 275 2
ffff88007f1c3ec0 0000000000000046 ffff88007f1c3e20 ffffffff803956dc
ffffffff807bb000 ffff88007f2f0600 ffff88007fbda340 ffff88007f2f0940
000000027f1c3e70 00000001000ce740 ffff88007f2f0940 ffffffff803955c0
Call Trace:
[<ffffffff803956dc>] ? xfs_buf_ioend+0x7c/0xb0
[<ffffffff803955c0>] ? xfs_buf_iodone_work+0x0/0xa0
[<ffffffff803955eb>] ? xfs_buf_iodone_work+0x2b/0xa0
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
xfslogd/3 S ffffffff80560200 0 276 2
ffff88007f1c7ec0 0000000000000046 ffff88007f1c7e40 ffffffff8037aa47
ffffffff807bb000 ffff88007f1ae240 ffff88007f034440 ffff88007f1ae580
000000037f1c7e70 00000001000ce743 ffff88007f1ae580 ffff88002582e628
Call Trace:
[<ffffffff8037aa47>] ? xlog_state_done_syncing+0x77/0xa0
[<ffffffff803955c0>] ? xfs_buf_iodone_work+0x0/0xa0
[<ffffffff803955eb>] ? xfs_buf_iodone_work+0x2b/0xa0
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
xfsdatad/0 S ffffffff80560200 0 277 2
ffff880037877ec0 0000000000000046 ffff880037859938 ffff88007fb7df00
ffffffff807bb000 ffff88007f2e4540 ffffffff806b0340 ffff88007f2e4880
0000000000000000 00000001000ce72c ffff88007f2e4880 ffffffff80391e2f
Call Trace:
[<ffffffff80391e2f>] ? xfs_destroy_ioend+0x5f/0x90
[<ffffffff80391f90>] ? xfs_end_bio_written+0x0/0x30
[<ffffffff80391fb0>] ? xfs_end_bio_written+0x20/0x30
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
xfsdatad/1 S ffffffff80560200 0 278 2
ffff880037821ec0 0000000000000046 ffff8800378598a0 ffff88007fb7df00
ffffffff807bb000 ffff88007f192400 ffff88007fba0240 ffff88007f192740
0000000100000000 00000001000ce72d ffff88007f192740 ffffffff80391e2f
Call Trace:
[<ffffffff80391e2f>] ? xfs_destroy_ioend+0x5f/0x90
[<ffffffff80391f90>] ? xfs_end_bio_written+0x0/0x30
[<ffffffff80391fb0>] ? xfs_end_bio_written+0x20/0x30
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
xfsdatad/2 S ffffffff80560200 0 279 2
ffff880037823ec0 0000000000000046 ffff880037859808 ffff88007fb7df00
ffffffff807bb000 ffff88007f196440 ffff88007fbda340 ffff88007f196780
0000000200000000 00000001000ce72c ffff88007f196780 ffffffff80391e2f
Call Trace:
[<ffffffff80391e2f>] ? xfs_destroy_ioend+0x5f/0x90
[<ffffffff80391f90>] ? xfs_end_bio_written+0x0/0x30
[<ffffffff80391fb0>] ? xfs_end_bio_written+0x20/0x30
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
xfsdatad/3 S ffffffff80560200 0 280 2
ffff880037803ec0 0000000000000046 ffff880037859770 ffff88007fb7df00
ffffffff807bb000 ffff88007f2c0100 ffff88007f034440 ffff88007f2c0440
0000000300000000 00000001000ce72d ffff88007f2c0440 ffffffff80391e2f
Call Trace:
[<ffffffff80391e2f>] ? xfs_destroy_ioend+0x5f/0x90
[<ffffffff80391f90>] ? xfs_end_bio_written+0x0/0x30
[<ffffffff80391fb0>] ? xfs_end_bio_written+0x20/0x30
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
kipmi0 S ffffffff80560200 0 384 2
ffff880037893e90 0000000000000046 ffffffff80466dd0 ffff88007f80a5e8
ffffffff807bb000 ffff88007f2b2040 ffffffff806b0340 ffff88007f2b2380
0000000037893e40 000000010041eaa8 ffff88007f2b2380 ffff880037893ea0
Call Trace:
[<ffffffff80466dd0>] ? free_smi_msg+0x10/0x20
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8046abe9>] ? start_next_msg+0xf9/0x140
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf99>] schedule_timeout_interruptible+0x19/0x20
[<ffffffff8046b61d>] ipmi_thread+0x6d/0xa0
[<ffffffff8046b5b0>] ? ipmi_thread+0x0/0xa0
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
scsi_eh_3 D 7fffffffffffffff 0 934 2
ffff8800364d7d60 0000000000000046 ffff880036ca2a88 ffff8800364d7cf0
ffffffff807bb000 ffff880036d8c100 ffff88007f070500 ffff880036d8c440
000000023758d388 ffff88003758d178 ffff880036d8c440 ffffffff803e9367
Call Trace:
[<ffffffff803e9367>] ? kobject_put+0x27/0x60
[<ffffffff8054bf05>] schedule_timeout+0xb5/0xf0
[<ffffffff80233d86>] ? dequeue_task+0x96/0xe0
[<ffffffff8054b1b5>] wait_for_common+0x145/0x170
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff8054b278>] wait_for_completion+0x18/0x20
[<ffffffffa0156a55>] command_abort+0x85/0xb0 [usb_storage]
[<ffffffffa0030d26>] scsi_error_handler+0x346/0x380 [scsi_mod]
[<ffffffff8023b5ad>] ? default_wake_function+0xd/0x10
[<ffffffffa00309e0>] ? scsi_error_handler+0x0/0x380 [scsi_mod]
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
usb-storage D ffff880036d97a20 0 935 2
ffff880036d97a10 0000000000000046 000000000000000c 0000000000000002
ffffffff807bb000 ffff88003647c0c0 ffff88001d132640 ffff88003647c400
0000000236d979c0 ffffffff8024ee66 ffff88003647c400 ffff880036d97a20
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054af27>] __sched_text_start+0x37/0x50
[<ffffffff80295c3c>] congestion_wait+0x6c/0x90
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8028ca35>] __alloc_pages_internal+0x2f5/0x4d0
[<ffffffff802b6d15>] kmem_getpages+0x85/0x190
[<ffffffff802b6f7c>] fallback_alloc+0x15c/0x1f0
[<ffffffff802b70a9>] ____cache_alloc_node+0x99/0x200
[<ffffffff8048d709>] ? usb_alloc_urb+0x19/0x50
[<ffffffff802b82b9>] __kmalloc+0x1e9/0x210
[<ffffffff8048d709>] usb_alloc_urb+0x19/0x50
[<ffffffff8048e302>] usb_sg_init+0x1a2/0x310
[<ffffffffa0157b2d>] usb_stor_bulk_transfer_sglist+0x7d/0xf0 [usb_storage]
[<ffffffffa0157c20>] usb_stor_bulk_srb+0x20/0x30 [usb_storage]
[<ffffffffa0157d4e>] usb_stor_Bulk_transport+0x11e/0x340 [usb_storage]
[<ffffffffa0157821>] usb_stor_invoke_transport+0x31/0x2c0 [usb_storage]
[<ffffffff8054b1c0>] ? wait_for_common+0x150/0x170
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffffa0156da9>] usb_stor_transparent_scsi_command+0x9/0x10 [usb_storage]
[<ffffffffa0159273>] usb_stor_control_thread+0x143/0x220 [usb_storage]
[<ffffffffa0159130>] ? usb_stor_control_thread+0x0/0x220 [usb_storage]
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
hid_compat S ffff880036dfd210 0 1009 2
ffff880036c69ec0 0000000000000046 ffff88007fb7dee0 ffff88007fb7df00
ffffffff807bb000 ffff8800369540c0 ffff880037a54140 ffff880036954400
00000002807c2280 0000000000000000 ffff880036954400 0000000000000000
Call Trace:
[<ffffffff8054b6ff>] ? thread_return+0x3d/0x64e
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
scsi_eh_4 S ffffffff80560200 0 1040 2
ffff880036c31e70 0000000000000046 ffff880036cb6580 ffff880036cb65b8
ffffffff807bb000 ffff880036cb6580 ffff88007fbda340 ffff880036cb68c0
000000020103d280 00000000fffef083 ffff880036cb68c0 00000000000003f1
Call Trace:
[<ffffffff80233d86>] ? dequeue_task+0x96/0xe0
[<ffffffffa0030a54>] scsi_error_handler+0x74/0x380 [scsi_mod]
[<ffffffffa00309e0>] ? scsi_error_handler+0x0/0x380 [scsi_mod]
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
usb-storage S 7fffffffffffffff 0 1041 2
ffff8800374cbdd0 0000000000000046 ffff8800374cbd70 ffffffffa0157196
ffffffff807bb000 ffff8800378ac5c0 ffff88007fbd02c0 ffff8800378ac900
000000027fbd02f8 0000000000000001 ffff8800378ac900 ffffffff80238be4
Call Trace:
[<ffffffffa0157196>] ? usb_stor_msg_common+0x126/0x180 [usb_storage]
[<ffffffff80238be4>] ? enqueue_task_fair+0x2c4/0x2d0
[<ffffffff802337a9>] ? wakeup_preempt_entity+0x59/0x60
[<ffffffff8054bf05>] schedule_timeout+0xb5/0xf0
[<ffffffff8023b426>] ? try_to_wake_up+0x106/0x280
[<ffffffffa0157976>] ? usb_stor_invoke_transport+0x186/0x2c0 [usb_storage]
[<ffffffff8054b1b5>] wait_for_common+0x145/0x170
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff8054b238>] wait_for_completion_interruptible+0x18/0x30
[<ffffffffa0159197>] usb_stor_control_thread+0x67/0x220 [usb_storage]
[<ffffffffa0159130>] ? usb_stor_control_thread+0x0/0x220 [usb_storage]
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
kjournald S ffffffff80560200 0 1306 2
ffff8800368cfea0 0000000000000046 00000000368cfe00 ffff88000ff63044
ffffffff807bb000 ffff8800375ec600 ffff88007f034440 ffff8800375ec940
0000000337065838 000000010039519f ffff8800375ec940 ffff8800374029c8
Call Trace:
[<ffffffff8032f943>] kjournald+0x213/0x230
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8032f730>] ? kjournald+0x0/0x230
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
kjournald S ffffffff80560200 0 2290 2
ffff880036d53ea0 0000000000000046 ffff880036d53e00 0000000000000005
ffffffff807bb000 ffff8800378ea4c0 ffff88007fba0240 ffff8800378ea800
0000000136d53e60 00000000ffff0611 ffff8800378ea800 ffff8800374027b0
Call Trace:
[<ffffffff8032f943>] kjournald+0x213/0x230
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8032f730>] ? kjournald+0x0/0x230
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
getty D ffff88003c5e1a48 0 15058 1
ffff88003c5e1a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff8800374da380 ffff88003c51c600 ffff8800374da6c0
000000023c5e19e8 ffffffff8024ee66 ffff8800374da6c0 ffff88003c5e1a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff8054b6ff>] ? thread_return+0x3d/0x64e
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802363ce>] ? __wake_up+0x4e/0x70
[<ffffffff80248cd2>] ? current_fs_time+0x22/0x30
[<ffffffff8044e4da>] ? tty_ldisc_deref+0x5a/0x80
[<ffffffff804467ea>] ? tty_read+0xca/0xf0
[<ffffffff802bf239>] ? vfs_read+0x129/0x180
[<ffffffff8054de79>] error_exit+0x0/0x51
getty D ffff88003c46da48 0 15059 1
ffff88003c46da38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff880036d223c0 ffff88000372e6c0 ffff880036d22700
000000003c46d9e8 ffffffff8024ee66 ffff880036d22700 ffff88003c46da48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff8054b6ff>] ? thread_return+0x3d/0x64e
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802363ce>] ? __wake_up+0x4e/0x70
[<ffffffff80248cd2>] ? current_fs_time+0x22/0x30
[<ffffffff8044e4da>] ? tty_ldisc_deref+0x5a/0x80
[<ffffffff804467ea>] ? tty_read+0xca/0xf0
[<ffffffff802bf239>] ? vfs_read+0x129/0x180
[<ffffffff8054de79>] error_exit+0x0/0x51
getty S ffffffff80560200 0 15060 1
ffff88003c583d78 0000000000000082 ffff8800365f2b10 0000000000000000
ffffffff807bb000 ffff880036cf0400 ffff88007fbda340 ffff880036cf0740
000000023c583de8 00000001001fb343 ffff880036cf0740 0000000000000202
Call Trace:
[<ffffffff8054bf05>] schedule_timeout+0xb5/0xf0
[<ffffffff802445cd>] ? release_console_sem+0x1bd/0x210
[<ffffffff8025ad29>] ? add_wait_queue+0x49/0x60
[<ffffffff8044b2ed>] n_tty_read+0x59d/0x920
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff8044e513>] ? tty_ldisc_ref_wait+0x13/0xb0
[<ffffffff804467c9>] tty_read+0xa9/0xf0
[<ffffffff802bf1d8>] vfs_read+0xc8/0x180
[<ffffffff802bf380>] sys_read+0x50/0x90
[<ffffffff8020c2eb>] system_call_fastpath+0x16/0x1b
getty S 7fffffffffffffff 0 15061 1
ffff8800375bdd78 0000000000000082 ffff8800365f2098 0000000000000000
ffffffff807bb000 ffff88003755c440 ffff8800374da380 ffff88003755c780
00000000375bdde8 ffffffff8045a38d ffff88003755c780 0000000000000202
Call Trace:
[<ffffffff8045a38d>] ? do_con_write+0x19d/0x22d0
[<ffffffff8054bf05>] schedule_timeout+0xb5/0xf0
[<ffffffff802445cd>] ? release_console_sem+0x1bd/0x210
[<ffffffff8025ad29>] ? add_wait_queue+0x49/0x60
[<ffffffff8044b2ed>] n_tty_read+0x59d/0x920
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff8044e513>] ? tty_ldisc_ref_wait+0x13/0xb0
[<ffffffff804467c9>] tty_read+0xa9/0xf0
[<ffffffff802bf1d8>] vfs_read+0xc8/0x180
[<ffffffff802bf380>] sys_read+0x50/0x90
[<ffffffff8020c2eb>] system_call_fastpath+0x16/0x1b
getty S ffffffff80560200 0 15062 1
ffff88003750fd78 0000000000000082 ffff8800365f22b0 0000000000000000
ffffffff807bb000 ffff88003c5b0480 ffff88007f034440 ffff88003c5b07c0
000000033750fde8 00000001001fb343 ffff88003c5b07c0 0000000000000202
Call Trace:
[<ffffffff8054bf05>] schedule_timeout+0xb5/0xf0
[<ffffffff802445cd>] ? release_console_sem+0x1bd/0x210
[<ffffffff8025ad29>] ? add_wait_queue+0x49/0x60
[<ffffffff8044b2ed>] n_tty_read+0x59d/0x920
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff8044e513>] ? tty_ldisc_ref_wait+0x13/0xb0
[<ffffffff804467c9>] tty_read+0xa9/0xf0
[<ffffffff802bf1d8>] vfs_read+0xc8/0x180
[<ffffffff802bf380>] sys_read+0x50/0x90
[<ffffffff8020c2eb>] system_call_fastpath+0x16/0x1b
wget D ffff88003c5b5a48 0 15140 1
ffff88003c5b5a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff880036d26940 ffff8800369163c0 ffff880036d26c80
000000023c5b59e8 ffffffff8024ee66 ffff880036d26c80 ffff88003c5b5a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff804b81a2>] ? sock_common_recvmsg+0x32/0x50
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff803ae8a1>] ? security_file_permission+0x11/0x20
[<ffffffff802bef7c>] ? vfs_write+0x12c/0x190
[<ffffffff8054de79>] error_exit+0x0/0x51
wget D ffff88003c415a48 0 15141 1
ffff88003c415a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88003c56e980 ffff880036d223c0 ffff88003c56ecc0
000000003c4159e8 ffffffff8024ee66 ffff88003c56ecc0 ffff88003c415a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8025a9b0>] ? wake_bit_function+0x0/0x40
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff803ae8a1>] ? security_file_permission+0x11/0x20
[<ffffffff802bef7c>] ? vfs_write+0x12c/0x190
[<ffffffff8054de79>] error_exit+0x0/0x51
wget D ffff8800378dda48 0 15142 1
ffff8800378dda38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff8800374c69c0 ffff880036d26940 ffff8800374c6d00
00000002378dd9e8 ffffffff8024ee66 ffff8800374c6d00 ffff8800378dda48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8025a9b0>] ? wake_bit_function+0x0/0x40
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff803ae8a1>] ? security_file_permission+0x11/0x20
[<ffffffff802bef7c>] ? vfs_write+0x12c/0x190
[<ffffffff8054de79>] error_exit+0x0/0x51
wget D ffff8800368b1a48 0 15143 1
ffff8800368b1a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88003749c040 ffff8800369fa700 ffff88003749c380
00000001368b19e8 ffffffff8024ee66 ffff88003749c380 ffff8800368b1a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff804b81a2>] ? sock_common_recvmsg+0x32/0x50
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff803ae8a1>] ? security_file_permission+0x11/0x20
[<ffffffff802bef7c>] ? vfs_write+0x12c/0x190
[<ffffffff8054de79>] error_exit+0x0/0x51
sshd S 0000000000000000 0 15149 1
ffff880036c47978 0000000000000082 ffff880036c478e8 ffffffff802e6581
ffffffff807bb000 ffff880036c401c0 ffff88004aac2400 ffff880036c40500
0000000336c47928 ffffffff803d5b6b ffff880036c40500 ffff880036d8f808
Call Trace:
[<ffffffff802e6581>] ? bio_phys_segments+0x21/0x30
[<ffffffff803d5b6b>] ? __elv_add_request+0x7b/0xd0
[<ffffffff803d8927>] ? __make_request+0xf7/0x4b0
[<ffffffff8054c6fd>] schedule_hrtimeout_range+0x10d/0x130
[<ffffffff8025ad29>] ? add_wait_queue+0x49/0x60
[<ffffffff802cee3d>] ? __pollwait+0x7d/0x110
[<ffffffff804f2930>] ? tcp_poll+0x20/0x180
[<ffffffff802ce60c>] do_select+0x4ec/0x6a0
[<ffffffff802cedc0>] ? __pollwait+0x0/0x110
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff8028c823>] ? __alloc_pages_internal+0xe3/0x4d0
[<ffffffff8022e982>] ? ptep_set_access_flags+0x22/0x30
[<ffffffff80297dc0>] ? do_wp_page+0x3c0/0x640
[<ffffffff802ce978>] core_sys_select+0x1b8/0x2e0
[<ffffffff8022b179>] ? do_page_fault+0x2f9/0x960
[<ffffffff802cf6ba>] ? __d_free+0x3a/0x60
[<ffffffff802cf730>] ? d_free+0x50/0x60
[<ffffffff802d6bba>] ? mntput_no_expire+0x2a/0x140
[<ffffffff802cecfa>] sys_select+0x4a/0x110
[<ffffffff8020c2eb>] system_call_fastpath+0x16/0x1b
wget D ffff88003c475a48 0 15167 1
ffff88003c475a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88003c4345c0 ffff88003c56e980 ffff88003c434900
000000003c4759e8 ffffffff8024ee66 ffff88003c434900 ffff88003c475a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff804b81a2>] ? sock_common_recvmsg+0x32/0x50
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff803ae8a1>] ? security_file_permission+0x11/0x20
[<ffffffff802bef7c>] ? vfs_write+0x12c/0x190
[<ffffffff8054de79>] error_exit+0x0/0x51
wget D ffffffff80560200 0 15168 1
ffff88003c4c9a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88003c480600 ffff88007fba0240 ffff88003c480940
000000013c4c99e8 000000010041eaa8 ffff88003c480940 ffff88003c4c9a48
Call Trace:
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff804b81a2>] ? sock_common_recvmsg+0x32/0x50
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff803ae8a1>] ? security_file_permission+0x11/0x20
[<ffffffff802bef7c>] ? vfs_write+0x12c/0x190
[<ffffffff8054de79>] error_exit+0x0/0x51
wget D ffffffff80560200 0 15169 1
ffff88001d1359c8 0000000000000082 000000000000000c 0000000000000003
ffffffff807bb000 ffff88001d132640 ffff88007fbda340 ffff88001d132980
000000021d135978 000000010041eaa8 ffff88001d132980 ffff88001d1359d8
Call Trace:
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff802889dd>] out_of_memory+0x22d/0x2c0
[<ffffffff8028cbc9>] __alloc_pages_internal+0x489/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff804b81a2>] ? sock_common_recvmsg+0x32/0x50
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff803ae8a1>] ? security_file_permission+0x11/0x20
[<ffffffff802bef7c>] ? vfs_write+0x12c/0x190
[<ffffffff8054de79>] error_exit+0x0/0x51
wget D ffff880047f73a48 0 15170 1
ffff880047f73a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff880047f70680 ffff88003c4345c0 ffff880047f709c0
0000000047f739e8 ffffffff8024ee66 ffff880047f709c0 ffff880047f73a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff804b81a2>] ? sock_common_recvmsg+0x32/0x50
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff803ae8a1>] ? security_file_permission+0x11/0x20
[<ffffffff802bef7c>] ? vfs_write+0x12c/0x190
[<ffffffff8054de79>] error_exit+0x0/0x51
wget D ffff880003731a48 0 15171 1
ffff880003731a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88000372e6c0 ffff88007f2b8080 ffff88000372ea00
00000000037319e8 ffffffff8024ee66 ffff88000372ea00 ffff880003731a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff804b81a2>] ? sock_common_recvmsg+0x32/0x50
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff803ae8a1>] ? security_file_permission+0x11/0x20
[<ffffffff802bef7c>] ? vfs_write+0x12c/0x190
[<ffffffff8054de79>] error_exit+0x0/0x51
login S ffffffff80560200 0 15173 1
ffff880037541e68 0000000000000082 00000000006085e8 0000000000000007
ffffffff807bb000 ffff880036cf2180 ffff88007f034440 ffff880036cf24c0
000000033c5aa478 000000010030797d ffff880036cf24c0 ffff880036cf2180
Call Trace:
[<ffffffff80247396>] do_wait+0x276/0x350
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff80247506>] sys_wait4+0x96/0xf0
[<ffffffff8020c2eb>] system_call_fastpath+0x16/0x1b
sshd S ffffffff80560200 0 15183 15149
ffff88001ac31978 0000000000000082 ffff88007e84a2b0 ffff880036480560
ffffffff807bb000 ffff88003c4447c0 ffffffff806b0340 ffff88003c444b00
000000001ac31928 00000001003b202f ffff88003c444b00 ffff880036480560
Call Trace:
[<ffffffff8054c6fd>] schedule_hrtimeout_range+0x10d/0x130
[<ffffffff8044e4da>] ? tty_ldisc_deref+0x5a/0x80
[<ffffffff8044668e>] ? tty_poll+0x8e/0x90
[<ffffffff802ce60c>] do_select+0x4ec/0x6a0
[<ffffffff802cedc0>] ? __pollwait+0x0/0x110
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff8050028d>] ? tcp_event_new_data_sent+0x8d/0xa0
[<ffffffff8050328d>] ? __tcp_push_pending_frames+0x26d/0x9a0
[<ffffffff8054dcef>] ? _spin_unlock_bh+0xf/0x20
[<ffffffff804b8e27>] ? release_sock+0xb7/0xd0
[<ffffffff804f6105>] ? tcp_sendmsg+0x8f5/0xbf0
[<ffffffff804b59c2>] ? sock_aio_write+0x172/0x190
[<ffffffff802ce978>] core_sys_select+0x1b8/0x2e0
[<ffffffff802be451>] ? do_sync_write+0xf1/0x140
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80248cd2>] ? current_fs_time+0x22/0x30
[<ffffffff802cecfa>] sys_select+0x4a/0x110
[<ffffffff802bf0d0>] ? sys_write+0x50/0x90
[<ffffffff8020c2eb>] system_call_fastpath+0x16/0x1b
bash S ffffffff80560200 0 15185 15183
ffff880021c51d78 0000000000000082 0000000000000001 ffffffff8022e982
ffffffff807bb000 ffff880036cf6800 ffff88007fba0240 ffff880036cf6b40
0000000100000000 00000001003b202f ffff880036cf6b40 ffff880036c38a88
Call Trace:
[<ffffffff8022e982>] ? ptep_set_access_flags+0x22/0x30
[<ffffffff802363ce>] ? __wake_up+0x4e/0x70
[<ffffffff8054bf05>] schedule_timeout+0xb5/0xf0
[<ffffffff8025ad29>] ? add_wait_queue+0x49/0x60
[<ffffffff8044b2ed>] n_tty_read+0x59d/0x920
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff8044e513>] ? tty_ldisc_ref_wait+0x13/0xb0
[<ffffffff804467c9>] tty_read+0xa9/0xf0
[<ffffffff802bf1d8>] vfs_read+0xc8/0x180
[<ffffffff802bf380>] sys_read+0x50/0x90
[<ffffffff8020c2eb>] system_call_fastpath+0x16/0x1b
sshd S ffffffff80560200 0 15304 15149
ffff88004aac5978 0000000000000082 ffff88007e84a2b0 ffff880036480560
ffffffff807bb000 ffff88004aac2400 ffff88007fba0240 ffff88004aac2740
000000014aac5928 00000001003c1000 ffff88004aac2740 ffff880036480560
Call Trace:
[<ffffffff8054c6fd>] schedule_hrtimeout_range+0x10d/0x130
[<ffffffff8044e4da>] ? tty_ldisc_deref+0x5a/0x80
[<ffffffff8044668e>] ? tty_poll+0x8e/0x90
[<ffffffff802ce60c>] do_select+0x4ec/0x6a0
[<ffffffff802cedc0>] ? __pollwait+0x0/0x110
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff8050028d>] ? tcp_event_new_data_sent+0x8d/0xa0
[<ffffffff8050328d>] ? __tcp_push_pending_frames+0x26d/0x9a0
[<ffffffff8054dcef>] ? _spin_unlock_bh+0xf/0x20
[<ffffffff804b8e27>] ? release_sock+0xb7/0xd0
[<ffffffff804f6105>] ? tcp_sendmsg+0x8f5/0xbf0
[<ffffffff804b59c2>] ? sock_aio_write+0x172/0x190
[<ffffffff802ce978>] core_sys_select+0x1b8/0x2e0
[<ffffffff802be451>] ? do_sync_write+0xf1/0x140
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80248cd2>] ? current_fs_time+0x22/0x30
[<ffffffff802cecfa>] sys_select+0x4a/0x110
[<ffffffff802bf0d0>] ? sys_write+0x50/0x90
[<ffffffff8020c2eb>] system_call_fastpath+0x16/0x1b
bash S ffffffff80560200 0 15306 15304
ffff88001fcd7e68 0000000000000082 0000000000f29188 0000000000000007
ffffffff807bb000 ffff88001fcd4480 ffff88007f034440 ffff88001fcd47c0
000000031fcd7e18 0000000100239603 ffff88001fcd47c0 ffffffff802462f6
Call Trace:
[<ffffffff802462f6>] ? session_of_pgrp+0x16/0x50
[<ffffffff80448f54>] ? tty_ioctl+0x8b4/0x920
[<ffffffff80247396>] do_wait+0x276/0x350
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff80247506>] sys_wait4+0x96/0xf0
[<ffffffff8020c2eb>] system_call_fastpath+0x16/0x1b
top D ffff88003c483a48 0 15329 15306
ffff88003c483a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88003744c640 ffff88003c480600 ffff88003744c980
000000013c4839e8 ffffffff8024ee66 ffff88003744c980 ffff88003c483a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8025a9b0>] ? wake_bit_function+0x0/0x40
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff802363ce>] ? __wake_up+0x4e/0x70
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8044878f>] ? tty_ioctl+0xef/0x920
[<ffffffff802138b9>] ? read_tsc+0x9/0x20
[<ffffffff802611e9>] ? getnstimeofday+0x59/0xe0
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff802ced0c>] ? sys_select+0x5c/0x110
[<ffffffff8054de79>] error_exit+0x0/0x51
bash D ffff880036de1a48 0 15426 15173
ffff880036de1a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88003c5aa440 ffff88000c5fc9c0 ffff88003c5aa780
0000000336de19e8 ffffffff8024ee66 ffff88003c5aa780 ffff880036de1a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff8054b6ff>] ? thread_return+0x3d/0x64e
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802363ce>] ? __wake_up+0x4e/0x70
[<ffffffff80248cd2>] ? current_fs_time+0x22/0x30
[<ffffffff8044e4da>] ? tty_ldisc_deref+0x5a/0x80
[<ffffffff804467ea>] ? tty_read+0xca/0xf0
[<ffffffff802bf239>] ? vfs_read+0x129/0x180
[<ffffffff8054de79>] error_exit+0x0/0x51
pdflush S 0000000000000001 0 15450 2
ffff88003c4f9ec0 0000000000000046 ffff88003c4f9e50 000000010041eabb
ffffffff807bb000 ffff88003c4ce980 ffff88007f076540 ffff88003c4cecc0
000000033c4f9ec0 ffffffff8028dc06 ffff88003c4cecc0 0000000000000000
Call Trace:
[<ffffffff8028dc06>] ? wb_kupdate+0x106/0x130
[<ffffffff8028e715>] pdflush+0x105/0x220
[<ffffffff8028e610>] ? pdflush+0x0/0x220
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
kstriped S ffffffff80560200 0 15488 2
ffff88003795fec0 0000000000000046 ffff88007fb7dee0 ffff88007fb7df00
ffffffff807bb000 ffff8800368e86c0 ffff88007fba0240 ffff8800368e8a00
00000001807c2280 000000010038ff6a ffff8800368e8a00 0000000000000000
Call Trace:
[<ffffffff8054b6ff>] ? thread_return+0x3d/0x64e
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
pdflush S ffffffff80560200 0 15500 2
ffff88000b25dec0 0000000000000046 0000000000000000 ffff88000b25de40
ffffffff807bb000 ffff880047310940 ffff88007fba0240 ffff880047310c80
0000000100000000 00000001004174dc ffff880047310c80 0000000000000000
Call Trace:
[<ffffffff8028e715>] pdflush+0x105/0x220
[<ffffffff8028e610>] ? pdflush+0x0/0x220
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
mpt_poll_0 S ffff88007a4f0768 0 15510 2
ffff88007aadfec0 0000000000000046 0000000000000086 ffff880019dcb000
ffffffff807bb000 ffff88003401c1c0 ffff88007f06c4c0 ffff88003401c500
000000017aadfe50 ffffffff80256ed5 ffff88003401c500 0000000000000246
Call Trace:
[<ffffffff80256ed5>] ? queue_delayed_work_on+0x95/0xc0
[<ffffffffa02deb27>] ? mpt_fault_reset_work+0x87/0x170 [mptbase]
[<ffffffffa02deaa0>] ? mpt_fault_reset_work+0x0/0x170 [mptbase]
[<ffffffff802566f5>] worker_thread+0xe5/0x120
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff80256610>] ? worker_thread+0x0/0x120
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
scsi_eh_6 S ffffffff80560200 0 15511 2
ffff88004c2f5e70 0000000000000046 ffff880036962200 ffff880036962238
ffffffff807bb000 ffff880036962200 ffff88007f034440 ffff880036962540
0000000300000001 00000001003a3a20 ffff880036962540 0000000000003c96
Call Trace:
[<ffffffff80233d86>] ? dequeue_task+0x96/0xe0
[<ffffffffa0030a54>] scsi_error_handler+0x74/0x380 [scsi_mod]
[<ffffffffa00309e0>] ? scsi_error_handler+0x0/0x380 [scsi_mod]
[<ffffffff8025a599>] kthread+0x49/0x90
[<ffffffff8020d1d9>] child_rip+0xa/0x11
[<ffffffff8025a550>] ? kthread+0x0/0x90
[<ffffffff8020d1cf>] ? child_rip+0x0/0x11
fillmem.py D ffffffff80560200 0 15515 1
ffff88003c5bbb38 0000000000000082 ffff88003c5bbb68 ffffffff802eb0b4
ffffffff807bb000 ffff8800369cc2c0 ffffffff806b0340 ffff8800369cc600
000000003709c740 00000001003c1008 ffff8800369cc600 0000000000000000
Call Trace:
[<ffffffff802eb0b4>] ? mpage_readpages+0xf4/0x110
[<ffffffff80238ab8>] ? enqueue_task_fair+0x198/0x2d0
[<ffffffff803d69cc>] ? blk_unplug+0x5c/0x70
[<ffffffff8054bd47>] io_schedule+0x37/0x50
[<ffffffff802856b5>] sync_page+0x35/0x60
[<ffffffff8054bff2>] __wait_on_bit_lock+0x52/0xb0
[<ffffffff80285680>] ? sync_page+0x0/0x60
[<ffffffff80285664>] __lock_page+0x64/0x70
[<ffffffff8025a9b0>] ? wake_bit_function+0x0/0x40
[<ffffffff8028548b>] ? find_get_page+0x1b/0xb0
[<ffffffff80285818>] find_lock_page+0x58/0x70
[<ffffffff80285de4>] filemap_fault+0x144/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802b6741>] ? kfree_debugcheck+0x11/0x30
[<ffffffff802b6998>] ? cache_free_debugcheck+0x238/0x2c0
[<ffffffff8029d80c>] ? remove_vma+0x5c/0x80
[<ffffffff8029d790>] ? unmap_region+0x130/0x150
[<ffffffff803ecf60>] ? __up_write+0xe0/0x150
[<ffffffff8054de79>] error_exit+0x0/0x51
rsyslogd D ffff880036c05a48 0 15527 1
ffff880036c05a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88003698a480 ffff88003744c640 ffff88003698a7c0
0000000136c059e8 ffffffff8024ee66 ffff88003698a7c0 ffff880036c05a48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8025a9b0>] ? wake_bit_function+0x0/0x40
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff80251151>] ? send_signal+0x131/0x2e0
[<ffffffff802138b9>] ? read_tsc+0x9/0x20
[<ffffffff802611e9>] ? getnstimeofday+0x59/0xe0
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802cd707>] ? poll_select_copy_remaining+0xf7/0x150
[<ffffffff802ced0c>] ? sys_select+0x5c/0x110
[<ffffffff8054de79>] error_exit+0x0/0x51
rsyslogd D ffff8800379dfa48 0 15528 1
ffff8800379dfa38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff8800369163c0 ffff880000c44780 ffff880036916700
00000002379df9e8 ffffffff8024ee66 ffff880036916700 ffff8800379dfa48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff8025ac66>] ? remove_wait_queue+0x46/0x60
[<ffffffff802138b9>] ? read_tsc+0x9/0x20
[<ffffffff802611e9>] ? getnstimeofday+0x59/0xe0
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff802683d6>] ? sys_futex+0xc6/0x170
[<ffffffff8054de79>] error_exit+0x0/0x51
rsyslogd S ffffffff80560200 0 15529 1
ffff88003693b978 0000000000000082 6b6b6b6b6b6b6b6b 6b6b6b6b6b6b6b6b
ffffffff807bb000 ffff8800369c25c0 ffff88007fba0240 ffff8800369c2900
000000016b6b6b6b 00000001003abbf9 ffff8800369c2900 6b6b6b6b6b6b6b6b
Call Trace:
[<ffffffff8054c6fd>] schedule_hrtimeout_range+0x10d/0x130
[<ffffffff8052bca8>] ? unix_dgram_poll+0x118/0x1d0
[<ffffffff802ce60c>] do_select+0x4ec/0x6a0
[<ffffffff802cedc0>] ? __pollwait+0x0/0x110
[<ffffffff8023b5a0>] ? default_wake_function+0x0/0x10
[<ffffffff80294ced>] ? zone_statistics+0x7d/0xa0
[<ffffffff8028c226>] ? get_page_from_freelist+0x4c6/0x700
[<ffffffff8028548b>] ? find_get_page+0x1b/0xb0
[<ffffffff802857e5>] ? find_lock_page+0x25/0x70
[<ffffffff80285ee0>] ? filemap_fault+0x240/0x440
[<ffffffff802857b2>] ? unlock_page+0x22/0x30
[<ffffffff802977a4>] ? __do_fault+0x1f4/0x450
[<ffffffff802ce978>] core_sys_select+0x1b8/0x2e0
[<ffffffff8022b179>] ? do_page_fault+0x2f9/0x960
[<ffffffff802cecfa>] sys_select+0x4a/0x110
[<ffffffff8020c2eb>] system_call_fastpath+0x16/0x1b
rsyslogd D ffff88003c51fa48 0 15530 1
ffff88003c51fa38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88003c51c600 ffff88003647c0c0 ffff88003c51c940
000000023c51f9e8 ffffffff8024ee66 ffff88003c51c940 ffff88003c51fa48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff802373b1>] ? dequeue_task_fair+0x281/0x290
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802453d8>] ? do_syslog+0x3a8/0x480
[<ffffffff8025a970>] ? autoremove_wake_function+0x0/0x40
[<ffffffff803049a3>] ? pde_users_dec+0x23/0x60
[<ffffffff80304d02>] ? proc_reg_read+0x82/0xb0
[<ffffffff802bf239>] ? vfs_read+0x129/0x180
[<ffffffff8054de79>] error_exit+0x0/0x51
fillmem.py D ffff880001025a18 0 15536 1
ffff88007f057b38 0000000000000082 ffff88007f057b68 ffffffff802eb0b4
ffffffff807bb000 ffff88003709c740 ffff88007fb921c0 ffff88003709ca80
0000000100000000 ffff880000002c00 ffff88003709ca80 000000000000aea4
Call Trace:
[<ffffffff802eb0b4>] ? mpage_readpages+0xf4/0x110
[<ffffffff803d69cc>] ? blk_unplug+0x5c/0x70
[<ffffffff8054bd47>] io_schedule+0x37/0x50
[<ffffffff802856b5>] sync_page+0x35/0x60
[<ffffffff8054bff2>] __wait_on_bit_lock+0x52/0xb0
[<ffffffff80285680>] ? sync_page+0x0/0x60
[<ffffffff80285664>] __lock_page+0x64/0x70
[<ffffffff8025a9b0>] ? wake_bit_function+0x0/0x40
[<ffffffff8028548b>] ? find_get_page+0x1b/0xb0
[<ffffffff80285818>] find_lock_page+0x58/0x70
[<ffffffff80285f81>] filemap_fault+0x2e1/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802b6741>] ? kfree_debugcheck+0x11/0x30
[<ffffffff802b6998>] ? cache_free_debugcheck+0x238/0x2c0
[<ffffffff8029d80c>] ? remove_vma+0x5c/0x80
[<ffffffff8029d790>] ? unmap_region+0x130/0x150
[<ffffffff803ecf60>] ? __up_write+0xe0/0x150
[<ffffffff8054de79>] error_exit+0x0/0x51
fillmem.py D ffff88003c5cda48 0 15539 1
ffff88003c5cda38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff8800369fa700 ffff88003698a480 ffff8800369faa40
000000013c5cd9e8 ffffffff8024ee66 ffff8800369faa40 ffff88003c5cda48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802b6741>] ? kfree_debugcheck+0x11/0x30
[<ffffffff802b6998>] ? cache_free_debugcheck+0x238/0x2c0
[<ffffffff8029d80c>] ? remove_vma+0x5c/0x80
[<ffffffff8029d790>] ? unmap_region+0x130/0x150
[<ffffffff803ecf60>] ? __up_write+0xe0/0x150
[<ffffffff8054de79>] error_exit+0x0/0x51
fillmem.py D ffffffff80560200 0 15542 1
ffff88001e8c1a38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88000c5fc9c0 ffff88007f034440 ffff88000c5fcd00
000000031e8c19e8 000000010041eaa8 ffff88000c5fcd00 ffff88001e8c1a48
Call Trace:
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802b6741>] ? kfree_debugcheck+0x11/0x30
[<ffffffff802b6998>] ? cache_free_debugcheck+0x238/0x2c0
[<ffffffff8029d80c>] ? remove_vma+0x5c/0x80
[<ffffffff8029d790>] ? unmap_region+0x130/0x150
[<ffffffff803ecf60>] ? __up_write+0xe0/0x150
[<ffffffff8054de79>] error_exit+0x0/0x51
fillmem.py D ffff880001019a18 0 15543 1
ffff880000c59b38 0000000000000082 ffff880000c59b68 ffffffff802eb01b
ffffffff807bb000 ffff880052b22040 ffff88003c4ce980 ffff880052b22380
0000000000000000 ffff880000002c00 ffff880052b22380 0000000000000001
Call Trace:
[<ffffffff802eb01b>] ? mpage_readpages+0x5b/0x110
[<ffffffff803d69cc>] ? blk_unplug+0x5c/0x70
[<ffffffff8054bd47>] io_schedule+0x37/0x50
[<ffffffff802856b5>] sync_page+0x35/0x60
[<ffffffff8054bff2>] __wait_on_bit_lock+0x52/0xb0
[<ffffffff80285680>] ? sync_page+0x0/0x60
[<ffffffff80285664>] __lock_page+0x64/0x70
[<ffffffff8025a9b0>] ? wake_bit_function+0x0/0x40
[<ffffffff8028548b>] ? find_get_page+0x1b/0xb0
[<ffffffff80285818>] find_lock_page+0x58/0x70
[<ffffffff80285f81>] filemap_fault+0x2e1/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802b6741>] ? kfree_debugcheck+0x11/0x30
[<ffffffff802b6998>] ? cache_free_debugcheck+0x238/0x2c0
[<ffffffff8029d80c>] ? remove_vma+0x5c/0x80
[<ffffffff8029d790>] ? unmap_region+0x130/0x150
[<ffffffff803ecf60>] ? __up_write+0xe0/0x150
[<ffffffff8054de79>] error_exit+0x0/0x51
fillmem.py D ffff880000c1fa48 0 15544 1
ffff880000c1fa38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff880000c44780 ffff8800374da380 ffff880000c44ac0
0000000200c1f9e8 ffffffff8024ee66 ffff880000c44ac0 ffff880000c1fa48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802b6741>] ? kfree_debugcheck+0x11/0x30
[<ffffffff802b6998>] ? cache_free_debugcheck+0x238/0x2c0
[<ffffffff8029d80c>] ? remove_vma+0x5c/0x80
[<ffffffff8029d790>] ? unmap_region+0x130/0x150
[<ffffffff803ecf60>] ? __up_write+0xe0/0x150
[<ffffffff8054de79>] error_exit+0x0/0x51
fillmem.py D ffffffff80560200 0 15545 1
ffff880000c29b38 0000000000000082 ffff880000c29b68 ffffffff802eb0b4
ffffffff807bb000 ffff880000c267c0 ffffffff806b0340 ffff880000c26b00
0000000000000000 00000001003c1010 ffff880000c26b00 000000000006581d
Call Trace:
[<ffffffff802eb0b4>] ? mpage_readpages+0xf4/0x110
[<ffffffff803d69cc>] ? blk_unplug+0x5c/0x70
[<ffffffff8054bd47>] io_schedule+0x37/0x50
[<ffffffff802856b5>] sync_page+0x35/0x60
[<ffffffff8054bff2>] __wait_on_bit_lock+0x52/0xb0
[<ffffffff80285680>] ? sync_page+0x0/0x60
[<ffffffff80285664>] __lock_page+0x64/0x70
[<ffffffff8025a9b0>] ? wake_bit_function+0x0/0x40
[<ffffffff8028548b>] ? find_get_page+0x1b/0xb0
[<ffffffff80285818>] find_lock_page+0x58/0x70
[<ffffffff80285de4>] filemap_fault+0x144/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802cb1bb>] ? do_filp_open+0x21b/0x970
[<ffffffff802b6741>] ? kfree_debugcheck+0x11/0x30
[<ffffffff8054b6ff>] ? thread_return+0x3d/0x64e
[<ffffffff8054de79>] error_exit+0x0/0x51
fillmem.py D ffff880000c4fa48 0 15546 1
ffff880000c4fa38 0000000000000082 000000000007a62d 0000000000000080
ffffffff807bb000 ffff88003688a380 ffff88003749c040 ffff88003688a6c0
0000000100c4f9e8 ffffffff8024ee66 ffff88003688a6c0 ffff880000c4fa48
Call Trace:
[<ffffffff8024ee66>] ? lock_timer_base+0x36/0x70
[<ffffffff8024f05f>] ? __mod_timer+0xaf/0xd0
[<ffffffff8054bece>] schedule_timeout+0x7e/0xf0
[<ffffffff8024ea20>] ? process_timeout+0x0/0x10
[<ffffffff8054bf59>] schedule_timeout_uninterruptible+0x19/0x20
[<ffffffff8028caaa>] __alloc_pages_internal+0x36a/0x4d0
[<ffffffff802af976>] alloc_pages_current+0x76/0xf0
[<ffffffff802858bb>] __page_cache_alloc+0xb/0x10
[<ffffffff8028ea8a>] __do_page_cache_readahead+0xca/0x200
[<ffffffff8028ec1e>] do_page_cache_readahead+0x5e/0x90
[<ffffffff80285fda>] filemap_fault+0x33a/0x440
[<ffffffff80297600>] __do_fault+0x50/0x450
[<ffffffff80299688>] handle_mm_fault+0x1b8/0x7b0
[<ffffffff8022b157>] do_page_fault+0x2d7/0x960
[<ffffffff802b6741>] ? kfree_debugcheck+0x11/0x30
[<ffffffff802b6998>] ? cache_free_debugcheck+0x238/0x2c0
[<ffffffff8029d80c>] ? remove_vma+0x5c/0x80
[<ffffffff8029d790>] ? unmap_region+0x130/0x150
[<ffffffff803ecf60>] ? __up_write+0xe0/0x150
[<ffffffff8054de79>] error_exit+0x0/0x51
Sched Debug Version: v0.07, 2.6.28.10-v3500-1 #1
now at 17587045.481053 msecs
.sysctl_sched_latency : 60.000000
.sysctl_sched_min_granularity : 12.000000
.sysctl_sched_wakeup_granularity : 15.000000
.sysctl_sched_child_runs_first : 0.000001
.sysctl_sched_features : 24191
cpu#0, 2493.893 MHz
.nr_running : 0
.load : 0
.nr_switches : 30245934
.nr_load_updates : 3575284
.nr_uninterruptible : -2955
.jiffies : 4299287207
.next_balance : 4299.287208
.curr->pid : 0
.clock : 17579645.529189
.cpu_load[0] : 0
.cpu_load[1] : 0
.cpu_load[2] : 0
.cpu_load[3] : 0
.cpu_load[4] : 0
.yld_exp_empty : 0
.yld_act_empty : 0
.yld_both_empty : 0
.yld_count : 5504
.sched_switch : 0
.sched_count : 56195672
.sched_goidle : 12070740
.ttwu_count : 17658581
.ttwu_local : 13757400
.bkl_count : 1964
cfs_rq[0]:
.exec_clock : 1801658.327698
.MIN_vruntime : 0.000001
.min_vruntime : 1704749189.346223
.max_vruntime : 0.000001
.spread : 0.000000
.spread0 : 0.000000
.nr_running : 0
.load : 0
.nr_spread_over : 7907094
rt_rq[0]:
.rt_nr_running : 0
.rt_throttled : 0
.rt_time : 0.000000
.rt_runtime : 950.000000
runnable tasks:
task PID tree-key switches prio exec-runtime sum-exec sum-sleep
----------------------------------------------------------------------------------------------------------
cpu#1, 2493.893 MHz
.nr_running : 0
.load : 0
.nr_switches : 28307319
.nr_load_updates : 3078483
.nr_uninterruptible : 2133
.jiffies : 4299287207
.next_balance : 4299.287208
.curr->pid : 0
.clock : 17587268.500677
.cpu_load[0] : 0
.cpu_load[1] : 0
.cpu_load[2] : 0
.cpu_load[3] : 0
.cpu_load[4] : 0
.yld_exp_empty : 0
.yld_act_empty : 0
.yld_both_empty : 0
.yld_count : 16468
.sched_switch : 0
.sched_count : 44032773
.sched_goidle : 11158921
.ttwu_count : 16474698
.ttwu_local : 13360580
.bkl_count : 7654
cfs_rq[1]:
.exec_clock : 1713186.290426
.MIN_vruntime : 0.000001
.min_vruntime : 2760178724.371280
.max_vruntime : 0.000001
.spread : 0.000000
.spread0 : 1055429535.025057
.nr_running : 0
.load : 0
.nr_spread_over : 6877817
rt_rq[1]:
.rt_nr_running : 0
.rt_throttled : 0
.rt_time : 0.000000
.rt_runtime : 950.000000
runnable tasks:
task PID tree-key switches prio exec-runtime sum-exec sum-sleep
----------------------------------------------------------------------------------------------------------
cpu#2, 2493.893 MHz
.nr_running : 0
.load : 0
.nr_switches : 27059579
.nr_load_updates : 3160858
.nr_uninterruptible : -145
.jiffies : 4299287207
.next_balance : 4299.287208
.curr->pid : 0
.clock : 17587429.006513
.cpu_load[0] : 0
.cpu_load[1] : 0
.cpu_load[2] : 0
.cpu_load[3] : 0
.cpu_load[4] : 0
.yld_exp_empty : 0
.yld_act_empty : 0
.yld_both_empty : 0
.yld_count : 3629
.sched_switch : 0
.sched_count : 34922472
.sched_goidle : 10326659
.ttwu_count : 16108305
.ttwu_local : 13203666
.bkl_count : 2861
cfs_rq[2]:
.exec_clock : 1690371.871627
.MIN_vruntime : 0.000001
.min_vruntime : 1682204253.144613
.max_vruntime : 0.000001
.spread : 0.000000
.spread0 : -22544936.201610
.nr_running : 0
.load : 0
.nr_spread_over : 3654489
rt_rq[2]:
.rt_nr_running : 0
.rt_throttled : 0
.rt_time : 0.000000
.rt_runtime : 950.000000
runnable tasks:
task PID tree-key switches prio exec-runtime sum-exec sum-sleep
----------------------------------------------------------------------------------------------------------
cpu#3, 2493.893 MHz
.nr_running : 0
.load : 0
.nr_switches : 28973615
.nr_load_updates : 3499963
.nr_uninterruptible : 994
.jiffies : 4299287207
.next_balance : 4299.287208
.curr->pid : 0
.clock : 17587593.506511
.cpu_load[0] : 0
.cpu_load[1] : 0
.cpu_load[2] : 0
.cpu_load[3] : 0
.cpu_load[4] : 0
.yld_exp_empty : 0
.yld_act_empty : 0
.yld_both_empty : 0
.yld_count : 4720
.sched_switch : 0
.sched_count : 42646289
.sched_goidle : 11426202
.ttwu_count : 16748929
.ttwu_local : 13110087
.bkl_count : 3914
cfs_rq[3]:
.exec_clock : 1861663.003349
.MIN_vruntime : 0.000001
.min_vruntime : 2661464134.268597
.max_vruntime : 0.000001
.spread : 0.000000
.spread0 : 956714944.922374
.nr_running : 0
.load : 0
.nr_spread_over : 6369857
rt_rq[3]:
.rt_nr_running : 0
.rt_throttled : 0
.rt_time : 0.000000
.rt_runtime : 950.000000
runnable tasks:
task PID tree-key switches prio exec-runtime sum-exec sum-sleep
----------------------------------------------------------------------------------------------------------
swapper: page allocation failure. order:1, mode:0x20
Pid: 0, comm: swapper Not tainted 2.6.28.10-v3500-1 #1
Call Trace:
<IRQ> [<ffffffff8028cb0e>] __alloc_pages_internal+0x3ce/0x4d0
[<ffffffff802b6d15>] kmem_getpages+0x85/0x190
[<ffffffff802b6f7c>] fallback_alloc+0x15c/0x1f0
[<ffffffff802b70a9>] ____cache_alloc_node+0x99/0x200
[<ffffffff80465c05>] ? ipmi_alloc_smi_msg+0x15/0x40
[<ffffffff802b8449>] kmem_cache_alloc+0x169/0x190
[<ffffffff80465c05>] ipmi_alloc_smi_msg+0x15/0x40
[<ffffffff8046adeb>] smi_event_handler+0x1bb/0x540
[<ffffffff8046b693>] smi_timeout+0x43/0x100
[<ffffffff8046b650>] ? smi_timeout+0x0/0x100
[<ffffffff8024e70f>] run_timer_softirq+0x13f/0x210
[<ffffffff8025e519>] ? ktime_get_ts+0x59/0x60
[<ffffffff80263a3f>] ? clockevents_program_event+0x4f/0x90
[<ffffffff80249c14>] __do_softirq+0x94/0x160
[<ffffffff8020d53c>] call_softirq+0x1c/0x30
[<ffffffff8020ee65>] do_softirq+0x45/0x80
[<ffffffff802498ed>] irq_exit+0x8d/0xa0
[<ffffffff8021f7a8>] smp_apic_timer_interrupt+0x88/0xc0
[<ffffffff8020cf8b>] apic_timer_interrupt+0x6b/0x70
<EOI> [<ffffffff80214610>] ? mwait_idle+0x40/0x50
[<ffffffff8020b382>] ? enter_idle+0x22/0x30
[<ffffffff8020b3ee>] ? cpu_idle+0x5e/0xb0
[<ffffffff80547bc7>] ? start_secondary+0x152/0x1ab
Mem-Info:
Node 0 DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
CPU 2: hi: 0, btch: 1 usd: 0
CPU 3: hi: 0, btch: 1 usd: 0
Node 0 DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 174
CPU 1: hi: 186, btch: 31 usd: 172
CPU 2: hi: 186, btch: 31 usd: 145
CPU 3: hi: 186, btch: 31 usd: 183
Active_anon:375770 active_file:0 inactive_anon:125455
inactive_file:67 unevictable:3 dirty:0 writeback:0 unstable:0
free:2517 slab:5645 mapped:1 pagetables:529 bounce:0
Node 0 DMA free:7940kB min:24kB low:28kB high:36kB active_anon:896kB inactive_anon:924kB active_file:0kB inactive_file:0kB unevictable:0kB present:9000kB pages_scanned:3188 all_unreclaimable? yes
lowmem_reserve[]: 0 2003 2003 2003
Node 0 DMA32 free:2128kB min:5712kB low:7140kB high:8568kB active_anon:1502184kB inactive_anon:500896kB active_file:0kB inactive_file:268kB unevictable:12kB present:2052092kB pages_scanned:5920508 all_unreclaimable? yes
lowmem_reserve[]: 0 0 0 0
Node 0 DMA: 11*4kB 3*8kB 8*16kB 2*32kB 2*64kB 3*128kB 2*256kB 3*512kB 3*1024kB 1*2048kB 0*4096kB = 7940kB
Node 0 DMA32: 8*4kB 6*8kB 0*16kB 4*32kB 8*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2128kB
477766 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap = 0kB
Total swap = 0kB
524231 pages RAM
9154 pages reserved
70 pages shared
511068 pages non-shared
[-- Attachment #4: putty_before_freeze.log.bz2 --]
[-- Type: application/octet-stream, Size: 186009 bytes --]
next prev parent reply other threads:[~2009-10-16 13:43 UTC|newest]
Thread overview: 4+ messages / expand[flat|nested] mbox.gz Atom feed top
[not found] <bug-14403-27@http.bugzilla.kernel.org/>
2009-10-15 23:33 ` [Bug 14403] New: Kernel freeze when going out of memory Andrew Morton
2009-10-16 9:16 ` Arnout Vandecappelle
2009-10-16 13:43 ` Peter Trekels [this message]
2009-10-16 13:43 ` Peter Trekels
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='001101ca4e66$a9138560$fb3a9020$@trekels@quesd.com' \
--to=peter.trekels@quesd.com \
--cc=akpm@linux-foundation.org \
--cc=arnout@mind.be \
--cc=bugzilla-daemon@bugzilla.kernel.org \
--cc=linux-mm@kvack.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).