public inbox for linux-xfs@vger.kernel.org
 help / color / mirror / Atom feed
* Re: 2.6.23.1: mdadm/raid5 hung/d-state (md3_raid5 stuck in endless loop?)
       [not found] <Pine.LNX.4.64.0711040658180.30831@p34.internal.lan>
@ 2007-11-04 12:39 ` Justin Piszcz
       [not found] ` <472DBF8C.2060508@msgid.tls.msk.ru>
       [not found] ` <18222.16003.92062.970530@notabene.brown>
  2 siblings, 0 replies; 8+ messages in thread
From: Justin Piszcz @ 2007-11-04 12:39 UTC (permalink / raw)
  To: linux-kernel, linux-raid; +Cc: xfs

Time to reboot, before reboot:

top - 07:30:23 up 13 days, 13:33, 10 users,  load average: 16.00, 15.99, 14.96
Tasks: 221 total,   7 running, 209 sleeping,   0 stopped,   5 zombie
Cpu(s):  0.0%us, 25.5%sy,  0.0%ni, 74.5%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Mem:   8039432k total,  1744356k used,  6295076k free,      164k buffers
Swap: 16787768k total,      160k used, 16787608k free,   616960k cached

   PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
   688 root      15  -5     0    0    0 R  100  0.0 121:21.43 md3_raid5
   273 root      20   0     0    0    0 D    0  0.0  14:40.68 pdflush
   274 root      20   0     0    0    0 D    0  0.0  13:00.93 pdflush

# cat /proc/fs/xfs/stat
extent_alloc 301974 256068291 310513 240764389
abt 1900173 15346352 738568 731314
blk_map 276979807 235589732 864002 211245834 591619 513439614 0
bmbt 50717 367726 14177 11846
dir 3818065 361561 359723 975628
trans 48452 2648064 570998
ig 6034530 2074424 43153 3960106 0 3869384 460831
log 282781 10454333 3028 399803 173488
push_ail 3267594 0 1620 2611 730365 0 4476 0 10269 0
xstrat 291940 0
rw 61423078 103732605
attr 0 0 0 0
icluster 312958 97323 419837
vnodes 90721 4019823 0 1926744 3929102 3929102 3929102 0
buf 14678900 11027087 3651843 25743 760449 0 0 15775888 280425
xpc 966925905920 1047628533165 1162276949815
debug 0

# cat meminfo
MemTotal:      8039432 kB
MemFree:       6287000 kB
Buffers:           164 kB
Cached:         617072 kB
SwapCached:          0 kB
Active:         178404 kB
Inactive:       589880 kB
SwapTotal:    16787768 kB
SwapFree:     16787608 kB
Dirty:          494280 kB
Writeback:       86004 kB
AnonPages:      151240 kB
Mapped:          17092 kB
Slab:           259696 kB
SReclaimable:   170876 kB
SUnreclaim:      88820 kB
PageTables:      11448 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  20807484 kB
Committed_AS:   353536 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     15468 kB
VmallocChunk: 34359722699 kB

# echo 3 > /proc/sys/vm/drop_caches

# cat /proc/meminfo
MemTotal:      8039432 kB
MemFree:       6418352 kB
Buffers:            32 kB
Cached:         597908 kB
SwapCached:          0 kB
Active:         172028 kB
Inactive:       579808 kB
SwapTotal:    16787768 kB
SwapFree:     16787608 kB
Dirty:          494312 kB
Writeback:       86004 kB
AnonPages:      154104 kB
Mapped:          17416 kB
Slab:           144072 kB
SReclaimable:    53100 kB
SUnreclaim:      90972 kB
PageTables:      11832 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  20807484 kB
Committed_AS:   360748 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     15468 kB
VmallocChunk: 34359722699 kB

Nothing is actually happening on the device itself however.

Device:         rrqm/s   wrqm/s     r/s     w/s    rkB/s    wkB/s avgrq-sz 
avgqu-sz   await  svctm  %util
sda               0.00     0.00    0.00    0.00     0.00     0.00     0.00 
0.00    0.00   0.00   0.00
sdb               0.00     0.00    0.00    0.00     0.00     0.00     0.00 
0.00    0.00   0.00   0.00
sdc               0.00     0.00    0.00    0.00     0.00     0.00     0.00 
0.00    0.00   0.00   0.00
sdd               0.00     0.00    0.00    0.00     0.00     0.00     0.00 
0.00    0.00   0.00   0.00
sde               0.00     0.00    0.00    0.00     0.00     0.00     0.00 
0.00    0.00   0.00   0.00
sdf               0.00     0.00    0.00    0.00     0.00     0.00     0.00 
0.00    0.00   0.00   0.00
sdg               0.00     0.00    0.00    0.00     0.00     0.00     0.00 
0.00    0.00   0.00   0.00
sdh               0.00     0.00    0.00    0.00     0.00     0.00     0.00 
0.00    0.00   0.00   0.00
sdi               0.00     0.00    0.00    0.00     0.00     0.00     0.00 
0.00    0.00   0.00   0.00
sdj               0.00     0.00    0.00    0.00     0.00     0.00     0.00 
0.00    0.00   0.00   0.00
sdk               0.00     0.00    0.00    0.00     0.00     0.00     0.00 
0.00    0.00   0.00   0.00
sdl               0.00     0.00    0.00    0.00     0.00     0.00     0.00 
0.00    0.00   0.00   0.00
md0               0.00     0.00    0.00    0.00     0.00     0.00     0.00 
0.00    0.00   0.00   0.00
md3               0.00     0.00    0.00    0.00     0.00     0.00     0.00 
0.00    0.00   0.00   0.00
md2               0.00     0.00    0.00    0.00     0.00     0.00     0.00 
0.00    0.00   0.00   0.00
md1               0.00     0.00    0.00    0.00     0.00     0.00     0.00 
0.00    0.00   0.00   0.00

# vmstat 1
procs -----------memory---------- ---swap-- -----io---- -system-- 
----cpu----
  r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
  6  0    160 6420244     32 600092    0    0   221   227    5    1  1  1 98  0
  6  0    160 6420228     32 600120    0    0     0     0 1015  142  0 25 75  0
  6  0    160 6420228     32 600120    0    0     0     0 1005  127  0 25 75  0
  6  0    160 6420228     32 600120    0    0     0    41 1022  151  0 26 74  0
  6  0    160 6420228     32 600120    0    0     0     0 1011  131  0 25 75  0
  6  0    160 6420228     32 600120    0    0     0     0 1013  124  0 25 75  0
  6  0    160 6420228     32 600120    0    0     0     0 1042  129  0 25 75  0

# uname -mr
2.6.23.1 x86_64

# cat /proc/vmstat
nr_free_pages 1598911
nr_inactive 146381
nr_active 42724
nr_anon_pages 37181
nr_mapped 4097
nr_file_pages 151975
nr_dirty 123572
nr_writeback 21501
nr_slab_reclaimable 16152
nr_slab_unreclaimable 24284
nr_page_table_pages 2823
nr_unstable 0
nr_bounce 0
nr_vmscan_write 20712
pgpgin 1015377151
pgpgout 1043634578
pswpin 0
pswpout 40
pgalloc_dma 4
pgalloc_dma32 319052932
pgalloc_normal 621945603
pgalloc_movable 0
pgfree 942598566
pgactivate 31123819
pgdeactivate 18438560
pgfault 360236898
pgmajfault 16158
pgrefill_dma 0
pgrefill_dma32 11683348
pgrefill_normal 18799274
pgrefill_movable 0
pgsteal_dma 0
pgsteal_dma32 176658679
pgsteal_normal 233628315
pgsteal_movable 0
pgscan_kswapd_dma 0
pgscan_kswapd_dma32 164181746
pgscan_kswapd_normal 217338820
pgscan_kswapd_movable 0
pgscan_direct_dma 0
pgscan_direct_dma32 13074075
pgscan_direct_normal 17342937
pgscan_direct_movable 0
pginodesteal 332816
slabs_scanned 12368000
kswapd_steal 380216091
kswapd_inodesteal 9858653
pageoutrun 1167045
allocstall 68454
pgrotated 40

# cat /proc/zoneinfo
Node 0, zone      DMA
   pages free     2601
         min      3
         low      3
         high     4
         scanned  0 (a: 11 i: 12)
         spanned  4096
         present  2486
     nr_free_pages 2601
     nr_inactive  0
     nr_active    0
     nr_anon_pages 0
     nr_mapped    1
     nr_file_pages 0
     nr_dirty     0
     nr_writeback 0
     nr_slab_reclaimable 0
     nr_slab_unreclaimable 4
     nr_page_table_pages 0
     nr_unstable  0
     nr_bounce    0
     nr_vmscan_write 0
         protection: (0, 3246, 7917, 7917)
   pagesets
     cpu: 0 pcp: 0
               count: 0
               high:  0
               batch: 1
     cpu: 0 pcp: 1
               count: 0
               high:  0
               batch: 1
   vm stats threshold: 6
     cpu: 1 pcp: 0
               count: 0
               high:  0
               batch: 1
     cpu: 1 pcp: 1
               count: 0
               high:  0
               batch: 1
   vm stats threshold: 6
     cpu: 2 pcp: 0
               count: 0
               high:  0
               batch: 1
     cpu: 2 pcp: 1
               count: 0
               high:  0
               batch: 1
   vm stats threshold: 6
     cpu: 3 pcp: 0
               count: 0
               high:  0
               batch: 1
     cpu: 3 pcp: 1
               count: 0
               high:  0
               batch: 1
   vm stats threshold: 6
   all_unreclaimable: 1
   prev_priority:     12
   start_pfn:         0
Node 0, zone    DMA32
   pages free     699197
         min      1166
         low      1457
         high     1749
         scanned  0 (a: 14 i: 0)
         spanned  1044480
         present  831104
     nr_free_pages 699197
     nr_inactive  38507
     nr_active    11855
     nr_anon_pages 11228
     nr_mapped    612
     nr_file_pages 39127
     nr_dirty     38462
     nr_writeback 34
     nr_slab_reclaimable 8164
     nr_slab_unreclaimable 4747
     nr_page_table_pages 756
     nr_unstable  0
     nr_bounce    0
     nr_vmscan_write 6132
         protection: (0, 0, 4671, 4671)
   pagesets
     cpu: 0 pcp: 0
               count: 183
               high:  186
               batch: 31
     cpu: 0 pcp: 1
               count: 52
               high:  62
               batch: 15
   vm stats threshold: 36
     cpu: 1 pcp: 0
               count: 23
               high:  186
               batch: 31
     cpu: 1 pcp: 1
               count: 14
               high:  62
               batch: 15
   vm stats threshold: 36
     cpu: 2 pcp: 0
               count: 173
               high:  186
               batch: 31
     cpu: 2 pcp: 1
               count: 61
               high:  62
               batch: 15
   vm stats threshold: 36
     cpu: 3 pcp: 0
               count: 95
               high:  186
               batch: 31
     cpu: 3 pcp: 1
               count: 57
               high:  62
               batch: 15
   vm stats threshold: 36
   all_unreclaimable: 0
   prev_priority:     12
   start_pfn:         4096
Node 0, zone   Normal
   pages free     897091
         min      1678
         low      2097
         high     2517
         scanned  0 (a: 29 i: 0)
         spanned  1212416
         present  1195840
     nr_free_pages 897091
     nr_inactive  107874
     nr_active    30878
     nr_anon_pages 25956
     nr_mapped    3484
     nr_file_pages 112857
     nr_dirty     85110
     nr_writeback 21467
     nr_slab_reclaimable 7988
     nr_slab_unreclaimable 19546
     nr_page_table_pages 2067
     nr_unstable  0
     nr_bounce    0
     nr_vmscan_write 14580
         protection: (0, 0, 0, 0)
   pagesets
     cpu: 0 pcp: 0
               count: 124
               high:  186
               batch: 31
     cpu: 0 pcp: 1
               count: 1
               high:  62
               batch: 15
   vm stats threshold: 42
     cpu: 1 pcp: 0
               count: 68
               high:  186
               batch: 31
     cpu: 1 pcp: 1
               count: 9
               high:  62
               batch: 15
   vm stats threshold: 42
     cpu: 2 pcp: 0
               count: 79
               high:  186
               batch: 31
     cpu: 2 pcp: 1
               count: 10
               high:  62
               batch: 15
   vm stats threshold: 42
     cpu: 3 pcp: 0
               count: 47
               high:  186
               batch: 31
     cpu: 3 pcp: 1
               count: 60
               high:  62
               batch: 15
   vm stats threshold: 42
   all_unreclaimable: 0
   prev_priority:     12
   start_pfn:         1048576

On Sun, 4 Nov 2007, Justin Piszcz wrote:

> # ps auxww | grep D
> USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
> root       273  0.0  0.0      0     0 ?        D    Oct21  14:40 [pdflush]
> root       274  0.0  0.0      0     0 ?        D    Oct21  13:00 [pdflush]
>
> After several days/weeks, this is the second time this has happened, while 
> doing regular file I/O (decompressing a file), everything on the device went 
> into D-state.
>
> # mdadm -D /dev/md3
> /dev/md3:
>        Version : 00.90.03
>  Creation Time : Wed Aug 22 10:38:53 2007
>     Raid Level : raid5
>     Array Size : 1318680576 (1257.59 GiB 1350.33 GB)
>  Used Dev Size : 146520064 (139.73 GiB 150.04 GB)
>   Raid Devices : 10
>  Total Devices : 10
> Preferred Minor : 3
>    Persistence : Superblock is persistent
>
>    Update Time : Sun Nov  4 06:38:29 2007
>          State : active
> Active Devices : 10
> Working Devices : 10
> Failed Devices : 0
>  Spare Devices : 0
>
>         Layout : left-symmetric
>     Chunk Size : 1024K
>
>           UUID : e37a12d1:1b0b989a:083fb634:68e9eb49
>         Events : 0.4309
>
>    Number   Major   Minor   RaidDevice State
>       0       8       33        0      active sync   /dev/sdc1
>       1       8       49        1      active sync   /dev/sdd1
>       2       8       65        2      active sync   /dev/sde1
>       3       8       81        3      active sync   /dev/sdf1
>       4       8       97        4      active sync   /dev/sdg1
>       5       8      113        5      active sync   /dev/sdh1
>       6       8      129        6      active sync   /dev/sdi1
>       7       8      145        7      active sync   /dev/sdj1
>       8       8      161        8      active sync   /dev/sdk1
>       9       8      177        9      active sync   /dev/sdl1
>
> If I wanted to find out what is causing this, what type of debugging would I 
> have to enable to track it down?  Any attempt to read/write files on the 
> devices fails (also going into d-state).  Is there any useful information I 
> can get currently before rebooting the machine?
>
> # pwd
> /sys/block/md3/md
> # ls
> array_state      dev-sdj1/         rd2@              stripe_cache_active
> bitmap_set_bits  dev-sdk1/         rd3@              stripe_cache_size
> chunk_size       dev-sdl1/         rd4@              suspend_hi
> component_size   layout            rd5@              suspend_lo
> dev-sdc1/        level             rd6@              sync_action
> dev-sdd1/        metadata_version  rd7@              sync_completed
> dev-sde1/        mismatch_cnt      rd8@              sync_speed
> dev-sdf1/        new_dev           rd9@              sync_speed_max
> dev-sdg1/        raid_disks        reshape_position  sync_speed_min
> dev-sdh1/        rd0@              resync_start
> dev-sdi1/        rd1@              safe_mode_delay
> # cat array_state
> active-idle
> # cat mismatch_cnt
> 0
> # cat stripe_cache_active
> 1
> # cat stripe_cache_size
> 16384
> # cat sync_action
> idle
> # cat /proc/mdstat
> Personalities : [raid1] [raid6] [raid5] [raid4]
> md1 : active raid1 sdb2[1] sda2[0]
>      136448 blocks [2/2] [UU]
>
> md2 : active raid1 sdb3[1] sda3[0]
>      129596288 blocks [2/2] [UU]
>
> md3 : active raid5 sdl1[9] sdk1[8] sdj1[7] sdi1[6] sdh1[5] sdg1[4] sdf1[3] 
> sde1[2] sdd1[1] sdc1[0]
>      1318680576 blocks level 5, 1024k chunk, algorithm 2 [10/10] 
> [UUUUUUUUUU]
>
> md0 : active raid1 sdb1[1] sda1[0]
>      16787776 blocks [2/2] [UU]
>
> unused devices: <none>
> #
>
> Justin.
>

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: 2.6.23.1: mdadm/raid5 hung/d-state
       [not found] ` <472DBF8C.2060508@msgid.tls.msk.ru>
@ 2007-11-04 12:52   ` Justin Piszcz
  2007-11-04 14:55     ` Michael Tokarev
  0 siblings, 1 reply; 8+ messages in thread
From: Justin Piszcz @ 2007-11-04 12:52 UTC (permalink / raw)
  To: Michael Tokarev; +Cc: linux-kernel, linux-raid, xfs



On Sun, 4 Nov 2007, Michael Tokarev wrote:

> Justin Piszcz wrote:
>> # ps auxww | grep D
>> USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
>> root       273  0.0  0.0      0     0 ?        D    Oct21  14:40 [pdflush]
>> root       274  0.0  0.0      0     0 ?        D    Oct21  13:00 [pdflush]
>>
>> After several days/weeks, this is the second time this has happened,
>> while doing regular file I/O (decompressing a file), everything on the
>> device went into D-state.
>
> The next time you come across something like that, do a SysRq-T dump and
> post that.  It shows a stack trace of all processes - and in particular,
> where exactly each task is stuck.
>
> /mjt
>

Yes I got it before I rebooted, ran that and then dmesg > file.

Here it is:

[1172609.665902]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172609.668768]  ffffffff80747dc0 ffff81015c3aa918 ffff810091c899b4 ffff810091c899a8
[1172609.668871] Call Trace:
[1172609.674472]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172609.677362]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172609.680243]  [<ffffffff8027b528>] do_select+0x468/0x560
[1172609.683105]  [<ffffffff8027bbc0>] __pollwait+0x0/0x130
[1172609.685969]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.688851]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.691712]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.694534]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.697324]  [<ffffffff8050bd41>] skb_copy_datagram_iovec+0x1a1/0x260
[1172609.700103]  [<ffffffff80592da9>] _spin_lock_bh+0x9/0x20
[1172609.702856]  [<ffffffff80505743>] release_sock+0x13/0xb0
[1172609.705598]  [<ffffffff80547700>] tcp_recvmsg+0x370/0x940
[1172609.708303]  [<ffffffff80505080>] sock_common_recvmsg+0x30/0x50
[1172609.710999]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172609.713694]  [<ffffffff8027b829>] core_sys_select+0x209/0x300
[1172609.716397]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172609.719112]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.721824]  [<ffffffff8022b51e>] current_fs_time+0x1e/0x30
[1172609.724525]  [<ffffffff803e3582>] tty_ldisc_deref+0x52/0x80
[1172609.727215]  [<ffffffff8027bdc1>] sys_select+0xd1/0x1c0
[1172609.729880]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172609.732517] 
[1172609.735115] bash          S 0000000000000000     0 30959  30958
[1172609.737742]  ffff810091c8be88 0000000000000086 0000000000000000 ffff8101ea172e20
[1172609.740404]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172609.743087]  ffffffff80747dc0 ffff81015c3ab028 ffff810091c8be54 ffff810091c8be48
[1172609.743190] Call Trace:
[1172609.748404]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172609.751071]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172609.753714]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.756345]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172609.758967] 
[1172609.761522] sr            S 0000000000000000     0 30966  30959
[1172609.764123]  ffff810122d7de88 0000000000000082 0000000000000000 ffff8101eab3ee20
[1172609.766769]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172609.769442]  ffffffff80747dc0 ffff8101ea173028 ffff810122d7de54 ffff810122d7de48
[1172609.769545] Call Trace:
[1172609.774734]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172609.777369]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.779999]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172609.782616] 
[1172609.785168] screen        S 0000000000000000     0 30972  30966
[1172609.787768]  ffff810144597f68 0000000000000086 ffff810144597f30 00000000ffffffff
[1172609.790416]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172609.793085]  ffffffff80747dc0 ffff8101eab3f028 ffff810144597f34 ffff810144597f28
[1172609.793188] Call Trace:
[1172609.798381]  [<ffffffff8022b0c5>] alarm_setitimer+0x35/0x70
[1172609.801049]  [<ffffffff80232a09>] sys_pause+0x19/0x30
[1172609.803705]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172609.806361] 
[1172609.808980] sshd          S 0000000000000000     0 30973   7582
[1172609.811659]  ffff810084003bf8 0000000000000082 0000000000000000 ffffffff80508e74
[1172609.814376]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172609.817104]  ffffffff80747dc0 ffff8101ea172208 ffff810084003bc4 ffff810084003bb8
[1172609.817207] Call Trace:
[1172609.822530]  [<ffffffff80508e74>] skb_queue_tail+0x24/0x60
[1172609.825292]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172609.828060]  [<ffffffff8023ae53>] prepare_to_wait+0x23/0x80
[1172609.830820]  [<ffffffff80575ac6>] unix_stream_recvmsg+0x386/0x550
[1172609.833587]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172609.836344]  [<ffffffff80277aa0>] link_path_walk+0x80/0xf0
[1172609.839074]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172609.841794]  [<ffffffff8026b5f9>] get_unused_fd_flags+0x79/0x120
[1172609.844488]  [<ffffffff8026d349>] do_sync_read+0xd9/0x120
[1172609.847161]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172609.849848]  [<ffffffff8026b7cf>] __dentry_open+0x11f/0x1b0
[1172609.852541]  [<ffffffff8026b96a>] do_filp_open+0x3a/0x50
[1172609.855235]  [<ffffffff8026dcf7>] vfs_read+0x157/0x160
[1172609.857922]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172609.860620]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172609.863343] 
[1172609.866063] sshd          S 0000000000000000     0 30975  30973
[1172609.868838]  ffff810175c219e8 0000000000000086 ffff810175c219b0 0000000000000002
[1172609.871649]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172609.874490]  ffffffff80747dc0 ffff81021b27d738 ffff810175c219b4 ffff810175c219a8
[1172609.874594] Call Trace:
[1172609.880153]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172609.883020]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172609.885890]  [<ffffffff8027b528>] do_select+0x468/0x560
[1172609.888742]  [<ffffffff8027bbc0>] __pollwait+0x0/0x130
[1172609.891581]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.894430]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.897258]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.900060]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.902841]  [<ffffffff80267609>] add_partial+0x19/0x60
[1172609.905606]  [<ffffffff80268a0d>] __slab_free+0x15d/0x310
[1172609.908363]  [<ffffffff80592da9>] _spin_lock_bh+0x9/0x20
[1172609.911093]  [<ffffffff80505743>] release_sock+0x13/0xb0
[1172609.913795]  [<ffffffff80547700>] tcp_recvmsg+0x370/0x940
[1172609.916486]  [<ffffffff80505080>] sock_common_recvmsg+0x30/0x50
[1172609.919151]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172609.921799]  [<ffffffff8027b829>] core_sys_select+0x209/0x300
[1172609.924455]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172609.927122]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.929786]  [<ffffffff8022b51e>] current_fs_time+0x1e/0x30
[1172609.932438]  [<ffffffff803e3582>] tty_ldisc_deref+0x52/0x80
[1172609.935083]  [<ffffffff8027bdc1>] sys_select+0xd1/0x1c0
[1172609.937702]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172609.940292] 
[1172609.942843] bash          S 0000000000000000     0 30976  30975
[1172609.945423]  ffff8101bf371e88 0000000000000082 0000000000000000 ffff81021e322710
[1172609.948037]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172609.950671]  ffffffff80747dc0 ffff8101882bf738 ffff8101bf371e54 ffff8101bf371e48
[1172609.950774] Call Trace:
[1172609.955888]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172609.958505]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172609.961098]  [<ffffffff8027a520>] vfs_ioctl+0x220/0x2c0
[1172609.963662]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.966234]  [<ffffffff8027a609>] sys_ioctl+0x49/0x80
[1172609.968766]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172609.971279] 
[1172609.973759] screen        S 0000000000000000     0 30991  30976
[1172609.976308]  ffff8101a8329f68 0000000000000086 0000000000000000 00000000ffffffff
[1172609.978892]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172609.981501]  ffffffff80747dc0 ffff81021e322918 ffff8101a8329f34 ffff8101a8329f28
[1172609.981605] Call Trace:
[1172609.986634]  [<ffffffff8022b0c5>] alarm_setitimer+0x35/0x70
[1172609.989220]  [<ffffffff80232a09>] sys_pause+0x19/0x30
[1172609.991766]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172609.994292] 
[1172609.996787] screen        D ffff8100a18ff800     0 30992  30991
[1172609.999344]  ffff8101a854dd28 0000000000000086 ffff81022854ddb7 ffff8101a854dcd8
[1172610.001953]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.004574]  ffffffff80747dc0 ffff810170233028 ffffffff80656bcb ffffffff8021f8bc
[1172610.004677] Call Trace:
[1172610.009752]  [<ffffffff8021f8bc>] task_rq_lock+0x4c/0x90
[1172610.012366]  [<ffffffff8021fb88>] try_to_wake_up+0x68/0x3b0
[1172610.014981]  [<ffffffff80590f9d>] wait_for_completion+0x7d/0xc0
[1172610.017594]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.020208]  [<ffffffff8023706a>] flush_cpu_workqueue+0x6a/0x90
[1172610.022828]  [<ffffffff802371b0>] wq_barrier_func+0x0/0x10
[1172610.025447]  [<ffffffff80237183>] flush_workqueue+0x33/0x50
[1172610.028076]  [<ffffffff803e633f>] release_dev+0x44f/0x750
[1172610.030710]  [<ffffffff80284847>] mntput_no_expire+0x27/0xb0
[1172610.033339]  [<ffffffff803e6651>] tty_release+0x11/0x20
[1172610.035958]  [<ffffffff8026e531>] __fput+0xb1/0x1a0
[1172610.038547]  [<ffffffff8026b544>] filp_close+0x54/0x90
[1172610.041106]  [<ffffffff8026ccc6>] sys_close+0x96/0x100
[1172610.043652]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.046160] 
[1172610.048618] bash          ? 0000000000000000     0 30993  30992
[1172610.051135]  ffff8101aa2a3ee8 0000000000000046 ffff8101aa2a3eb0 0000000000000011
[1172610.053708]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.056312]  ffffffff80747dc0 ffff810170233738 ffff8101aa2a3eb4 ffff8101aa2a3ea8
[1172610.056415] Call Trace:
[1172610.061510]  [<ffffffff8022a18e>] do_exit+0x5be/0x8a0
[1172610.064172]  [<ffffffff8022a49c>] do_group_exit+0x2c/0x80
[1172610.066859]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.069537] 
[1172610.072190] sshd          S 0000000000000000     0  7001   7582
[1172610.074908]  ffff8100792b1bf8 0000000000000082 0000000000000000 ffff8101e9c51b80
[1172610.077679]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.080477]  ffffffff80747dc0 ffff8102234ff738 ffff8100792b1bc4 ffff8100792b1bb8
[1172610.080580] Call Trace:
[1172610.086042]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172610.088861]  [<ffffffff8023ae53>] prepare_to_wait+0x23/0x80
[1172610.091673]  [<ffffffff80575ac6>] unix_stream_recvmsg+0x386/0x550
[1172610.094492]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.097318]  [<ffffffff80277aa0>] link_path_walk+0x80/0xf0
[1172610.100148]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172610.102976]  [<ffffffff8026b5f9>] get_unused_fd_flags+0x79/0x120
[1172610.105822]  [<ffffffff8026d349>] do_sync_read+0xd9/0x120
[1172610.108651]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.111495]  [<ffffffff8026b7cf>] __dentry_open+0x11f/0x1b0
[1172610.114319]  [<ffffffff8026b96a>] do_filp_open+0x3a/0x50
[1172610.117118]  [<ffffffff8026dcf7>] vfs_read+0x157/0x160
[1172610.119902]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172610.122638]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.125360] 
[1172610.128056] sshd          S 0000000000000000     0  7003   7001
[1172610.130818]  ffff8100675a39e8 0000000000000082 ffff8100675a39b0 0000000000000002
[1172610.133623]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.136446]  ffffffff80747dc0 ffff810225459028 ffff8100675a39b4 ffff8100675a39a8
[1172610.136549] Call Trace:
[1172610.142064]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172610.144899]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172610.147716]  [<ffffffff8027b528>] do_select+0x468/0x560
[1172610.150495]  [<ffffffff8027bbc0>] __pollwait+0x0/0x130
[1172610.153260]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.156005]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.158707]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.161378]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.164026]  [<ffffffff8050bd41>] skb_copy_datagram_iovec+0x1a1/0x260
[1172610.166675]  [<ffffffff80592da9>] _spin_lock_bh+0x9/0x20
[1172610.169315]  [<ffffffff80505743>] release_sock+0x13/0xb0
[1172610.171917]  [<ffffffff80547700>] tcp_recvmsg+0x370/0x940
[1172610.174494]  [<ffffffff80505080>] sock_common_recvmsg+0x30/0x50
[1172610.177085]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172610.179638]  [<ffffffff8027b829>] core_sys_select+0x209/0x300
[1172610.182178]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.184734]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.187290]  [<ffffffff8022b51e>] current_fs_time+0x1e/0x30
[1172610.189837]  [<ffffffff803e3582>] tty_ldisc_deref+0x52/0x80
[1172610.192370]  [<ffffffff8027bdc1>] sys_select+0xd1/0x1c0
[1172610.194900]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.197426] 
[1172610.199919] bash          S 000000000000000e     0  7004   7003
[1172610.202470]  ffff8100cc263e88 0000000000000082 80000000804ca065 ffff81022367f530
[1172610.205071]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.207699]  ffffffff80747dc0 ffff8102234fe918 ffff8100cc263e38 ffff810035a16348
[1172610.207802] Call Trace:
[1172610.212949]  [<ffffffff8021cb22>] do_page_fault+0x202/0x890
[1172610.215618]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172610.218263]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172610.220900]  [<ffffffff8027a520>] vfs_ioctl+0x220/0x2c0
[1172610.223509]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.226109]  [<ffffffff8027a609>] sys_ioctl+0x49/0x80
[1172610.228693]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.231240] 
[1172610.233746] aur           S 0000000000000000     0  7014   7004
[1172610.236319]  ffff810098071e88 0000000000000086 ffff810098071e50 ffffffff80232c93
[1172610.238941]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.241566]  ffffffff80747dc0 ffff81022367f738 ffff810098071e54 ffff810098071e48
[1172610.241669] Call Trace:
[1172610.246766]  [<ffffffff80232c93>] get_signal_to_deliver+0x73/0x470
[1172610.249380]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172610.251983]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.254563]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.257122] 
[1172610.259648] aur           S 0000000000000004     0  7066   7014
[1172610.262226]  ffff810085231e88 0000000000000086 ffff8101ea314ce8 ffffffff80232c93
[1172610.264844]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.267471]  ffffffff80747dc0 ffff8101ea314918 ffffffff802302ce ffffffff8020b3d6
[1172610.267574] Call Trace:
[1172610.272674]  [<ffffffff80232c93>] get_signal_to_deliver+0x73/0x470
[1172610.275315]  [<ffffffff802302ce>] recalc_sigpending+0xe/0x30
[1172610.277948]  [<ffffffff8020b3d6>] do_notify_resume+0x536/0x7a0
[1172610.280577]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172610.283199]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.285840]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.288491] 
[1172610.291116] unrar         D ffff8100aa785c80     0  7135   7066
[1172610.293792]  ffff8101ecf4ddb8 0000000000000086 ffff8101ecf4dd80 0000000000000000
[1172610.296525]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.299256]  ffffffff80747dc0 ffff81021e53f028 ffff8101ecf4dd84 ffff8101ecf4dd78
[1172610.299359] Call Trace:
[1172610.304629]  [<ffffffff80385635>] vn_iowait+0x75/0xa0
[1172610.307301]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.309979]  [<ffffffff8036d19c>] xfs_trans_alloc+0x9c/0xb0
[1172610.312653]  [<ffffffff80357fb5>] xfs_itruncate_start+0x35/0xe0
[1172610.315340]  [<ffffffff80372c3a>] xfs_free_eofblocks+0x17a/0x280
[1172610.318032]  [<ffffffff80377e74>] xfs_release+0x134/0x1e0
[1172610.320711]  [<ffffffff8037ed7a>] xfs_file_release+0x1a/0x30
[1172610.323417]  [<ffffffff8026e531>] __fput+0xb1/0x1a0
[1172610.326144]  [<ffffffff8026b544>] filp_close+0x54/0x90
[1172610.328895]  [<ffffffff8026ccc6>] sys_close+0x96/0x100
[1172610.331631]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.334353] 
[1172610.337050] sshd          D 0000000000000000     0  7187   7582
[1172610.339811]  ffff81002b62fd28 0000000000000086 ffff81002b62fcf0 ffff81002b62fcd8
[1172610.342618]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.345448]  ffffffff80747dc0 ffff8101ccda3028 ffff81002b62fcf4 ffff81002b62fce8
[1172610.345551] Call Trace:
[1172610.351072]  [<ffffffff80590f9d>] wait_for_completion+0x7d/0xc0
[1172610.353915]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.356765]  [<ffffffff8023706a>] flush_cpu_workqueue+0x6a/0x90
[1172610.359622]  [<ffffffff802371b0>] wq_barrier_func+0x0/0x10
[1172610.362477]  [<ffffffff80237183>] flush_workqueue+0x33/0x50
[1172610.365337]  [<ffffffff803e633f>] release_dev+0x44f/0x750
[1172610.368184]  [<ffffffff8026c04a>] sys_fchmodat+0x6a/0x120
[1172610.371026]  [<ffffffff803e6651>] tty_release+0x11/0x20
[1172610.373843]  [<ffffffff8026e531>] __fput+0xb1/0x1a0
[1172610.376628]  [<ffffffff8026b544>] filp_close+0x54/0x90
[1172610.379402]  [<ffffffff8026ccc6>] sys_close+0x96/0x100
[1172610.382135]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.384846] 
[1172610.387529] sshd          ? 0000000000000000     0  7218   7187
[1172610.390280]  ffff81013bd7bee8 0000000000000046 ffff81013bd7beb0 0000000000000011
[1172610.393084]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.395907]  ffffffff80747dc0 ffff8101bf6ae918 ffff81013bd7beb4 ffff81013bd7bea8
[1172610.396010] Call Trace:
[1172610.401528]  [<ffffffff8022246c>] __cond_resched+0x1c/0x50
[1172610.404362]  [<ffffffff8022a18e>] do_exit+0x5be/0x8a0
[1172610.407192]  [<ffffffff8022a49c>] do_group_exit+0x2c/0x80
[1172610.409993]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.412776] 
[1172610.415520] sshd          S 0000000000000000     0  7236   7582
[1172610.418293]  ffff8101e4a89bf8 0000000000000082 ffff8101e4a89bc0 ffff81013bf542c0
[1172610.421090]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.423898]  ffffffff80747dc0 ffff810168684208 ffff8101e4a89bc4 ffff8101e4a89bb8
[1172610.424001] Call Trace:
[1172610.429474]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172610.432284]  [<ffffffff8023ae53>] prepare_to_wait+0x23/0x80
[1172610.435096]  [<ffffffff80575ac6>] unix_stream_recvmsg+0x386/0x550
[1172610.437896]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.440690]  [<ffffffff80277aa0>] link_path_walk+0x80/0xf0
[1172610.443487]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172610.446249]  [<ffffffff8026b5f9>] get_unused_fd_flags+0x79/0x120
[1172610.448997]  [<ffffffff8026d349>] do_sync_read+0xd9/0x120
[1172610.451737]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.454491]  [<ffffffff8026b7cf>] __dentry_open+0x11f/0x1b0
[1172610.457244]  [<ffffffff8026b96a>] do_filp_open+0x3a/0x50
[1172610.459989]  [<ffffffff8026dcf7>] vfs_read+0x157/0x160
[1172610.462724]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172610.465430]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.468131] 
[1172610.470765] sshd          S 0000000000000000     0  7238   7236
[1172610.473440]  ffff810046e1f9e8 0000000000000082 ffff810046e1f9b0 0000000000000002
[1172610.476161]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.478873]  ffffffff80747dc0 ffff810168685028 ffff810046e1f9b4 ffff810046e1f9a8
[1172610.478975] Call Trace:
[1172610.484236]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172610.486940]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172610.489645]  [<ffffffff8027b528>] do_select+0x468/0x560
[1172610.492340]  [<ffffffff8027bbc0>] __pollwait+0x0/0x130
[1172610.495030]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.497738]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.500417]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.503076]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.505711]  [<ffffffff8050bd41>] skb_copy_datagram_iovec+0x1a1/0x260
[1172610.508366]  [<ffffffff80592da9>] _spin_lock_bh+0x9/0x20
[1172610.511004]  [<ffffffff80505743>] release_sock+0x13/0xb0
[1172610.513638]  [<ffffffff80547700>] tcp_recvmsg+0x370/0x940
[1172610.516245]  [<ffffffff80505080>] sock_common_recvmsg+0x30/0x50
[1172610.518841]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172610.521423]  [<ffffffff8027b829>] core_sys_select+0x209/0x300
[1172610.523974]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.526518]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.529058]  [<ffffffff8022b51e>] current_fs_time+0x1e/0x30
[1172610.531592]  [<ffffffff803e3582>] tty_ldisc_deref+0x52/0x80
[1172610.534118]  [<ffffffff8027bdc1>] sys_select+0xd1/0x1c0
[1172610.536645]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.539162] 
[1172610.541651] bash          S 000000000000000e     0  7239   7238
[1172610.544203]  ffff8100aae5fe88 0000000000000082 80000001bab2c065 ffff810145b6ae20
[1172610.546809]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.549446]  ffffffff80747dc0 ffff810168685738 ffff8100aae5fe38 ffff810065785f18
[1172610.549550] Call Trace:
[1172610.554709]  [<ffffffff8021cb22>] do_page_fault+0x202/0x890
[1172610.557368]  [<ffffffff8021ed69>] update_curr+0x109/0x120
[1172610.560022]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172610.562647]  [<ffffffff805907c6>] __sched_text_start+0x166/0x23d
[1172610.565267]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172610.567871]  [<ffffffff8027a520>] vfs_ioctl+0x220/0x2c0
[1172610.570435]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.572998]  [<ffffffff8027a609>] sys_ioctl+0x49/0x80
[1172610.575555]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.578118] 
[1172610.580652] sshd          S 0000000000000000     0  7248   7582
[1172610.583235]  ffff8101120d5bf8 0000000000000082 ffff8101120d5bc0 ffff81001e998dc0
[1172610.585865]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.588489]  ffffffff80747dc0 ffff810130906208 ffff8101120d5bc4 ffff8101120d5bb8
[1172610.588592] Call Trace:
[1172610.593666]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172610.596253]  [<ffffffff8023ae53>] prepare_to_wait+0x23/0x80
[1172610.598824]  [<ffffffff80575ac6>] unix_stream_recvmsg+0x386/0x550
[1172610.601405]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.603992]  [<ffffffff80277aa0>] link_path_walk+0x80/0xf0
[1172610.606571]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172610.609138]  [<ffffffff8026b5f9>] get_unused_fd_flags+0x79/0x120
[1172610.611720]  [<ffffffff8026d349>] do_sync_read+0xd9/0x120
[1172610.614293]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.616883]  [<ffffffff8026b7cf>] __dentry_open+0x11f/0x1b0
[1172610.619463]  [<ffffffff8026b96a>] do_filp_open+0x3a/0x50
[1172610.622029]  [<ffffffff8026dcf7>] vfs_read+0x157/0x160
[1172610.624594]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172610.627144]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.629703] 
[1172610.632237] sshd          S 0000000000000000     0  7250   7248
[1172610.634822]  ffff810126f3d9e8 0000000000000086 ffff810126f3d9b0 0000000000000002
[1172610.637453]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.640086]  ffffffff80747dc0 ffff810130907028 ffff810126f3d9b4 ffff810126f3d9a8
[1172610.640190] Call Trace:
[1172610.645268]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172610.647857]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172610.650429]  [<ffffffff8027b528>] do_select+0x468/0x560
[1172610.652990]  [<ffffffff8027bbc0>] __pollwait+0x0/0x130
[1172610.655552]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.658131]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.660680]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.663230]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.665779]  [<ffffffff8050bd41>] skb_copy_datagram_iovec+0x1a1/0x260
[1172610.668368]  [<ffffffff80592da9>] _spin_lock_bh+0x9/0x20
[1172610.670946]  [<ffffffff80505743>] release_sock+0x13/0xb0
[1172610.673510]  [<ffffffff80547700>] tcp_recvmsg+0x370/0x940
[1172610.676075]  [<ffffffff80505080>] sock_common_recvmsg+0x30/0x50
[1172610.678653]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172610.681222]  [<ffffffff8027b829>] core_sys_select+0x209/0x300
[1172610.683798]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.686386]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.688970]  [<ffffffff8022b51e>] current_fs_time+0x1e/0x30
[1172610.691546]  [<ffffffff803e3582>] tty_ldisc_deref+0x52/0x80
[1172610.694114]  [<ffffffff8027bdc1>] sys_select+0xd1/0x1c0
[1172610.696683]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.699244] 
[1172610.701782] bash          S 000000000000000e     0  7251   7250
[1172610.704370]  ffff810121e8de88 0000000000000086 800000008e47c065 ffff8101afbec710
[1172610.707005]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.709641]  ffffffff80747dc0 ffff810130907738 ffff810121e8de38 ffff8101e65ef9d8
[1172610.709744] Call Trace:
[1172610.714827]  [<ffffffff8021cb22>] do_page_fault+0x202/0x890
[1172610.717419]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172610.719979]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172610.722535]  [<ffffffff8027a520>] vfs_ioctl+0x220/0x2c0
[1172610.725088]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.727650]  [<ffffffff8027a609>] sys_ioctl+0x49/0x80
[1172610.730203]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.732759] 
[1172610.735278] su            S 0000000000000000     0  7269   7251
[1172610.737850]  ffff8101a5007e88 0000000000000086 ffff8101a5007e50 ffff8100219c0e20
[1172610.740475]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.743107]  ffffffff80747dc0 ffff8101afbec918 ffff8101a5007e54 ffff8101a5007e48
[1172610.743210] Call Trace:
[1172610.748316]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172610.750913]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.753518]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.756084] 
[1172610.758600] bash          S 0000000000000000     0  7270   7269
[1172610.761175]  ffff81014bc9be88 0000000000000086 ffff81014bc9be50 ffff810139e7c000
[1172610.763792]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.766419]  ffffffff80747dc0 ffff8100219c1028 ffff81014bc9be54 ffff81014bc9be48
[1172610.766521] Call Trace:
[1172610.771636]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172610.774264]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172610.776885]  [<ffffffff8027a520>] vfs_ioctl+0x220/0x2c0
[1172610.779492]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.782107]  [<ffffffff8027a609>] sys_ioctl+0x49/0x80
[1172610.784719]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.787329] 
[1172610.789920] sshd          S 0000000000000000     0  7278   7582
[1172610.792579]  ffff810194cf5bf8 0000000000000086 ffff810194cf5bc0 ffff810010755600
[1172610.795276]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.797987]  ffffffff80747dc0 ffff81002d667738 ffff810194cf5bc4 ffff810194cf5bb8
[1172610.798090] Call Trace:
[1172610.803311]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172610.805992]  [<ffffffff8023ae53>] prepare_to_wait+0x23/0x80
[1172610.808641]  [<ffffffff80575ac6>] unix_stream_recvmsg+0x386/0x550
[1172610.811284]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.813937]  [<ffffffff80277aa0>] link_path_walk+0x80/0xf0
[1172610.816593]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172610.819250]  [<ffffffff8026b5f9>] get_unused_fd_flags+0x79/0x120
[1172610.821914]  [<ffffffff8026d349>] do_sync_read+0xd9/0x120
[1172610.824602]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.827337]  [<ffffffff8026b7cf>] __dentry_open+0x11f/0x1b0
[1172610.830101]  [<ffffffff8026b96a>] do_filp_open+0x3a/0x50
[1172610.832855]  [<ffffffff8026dcf7>] vfs_read+0x157/0x160
[1172610.835593]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172610.838321]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.841049] 
[1172610.843744] sshd          S 0000000000000000     0  7280   7278
[1172610.846501]  ffff81013acb39e8 0000000000000082 ffff81013acb39b0 0000000000000002
[1172610.849305]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.852125]  ffffffff80747dc0 ffff81011060e918 ffff81013acb39b4 ffff81013acb39a8
[1172610.852228] Call Trace:
[1172610.857719]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172610.860553]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172610.863393]  [<ffffffff8027b528>] do_select+0x468/0x560
[1172610.866228]  [<ffffffff8027bbc0>] __pollwait+0x0/0x130
[1172610.869046]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.871874]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.874652]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.877377]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.880068]  [<ffffffff80267609>] add_partial+0x19/0x60
[1172610.882722]  [<ffffffff80268a0d>] __slab_free+0x15d/0x310
[1172610.885354]  [<ffffffff80592da9>] _spin_lock_bh+0x9/0x20
[1172610.887984]  [<ffffffff80505743>] release_sock+0x13/0xb0
[1172610.890616]  [<ffffffff80547700>] tcp_recvmsg+0x370/0x940
[1172610.893251]  [<ffffffff80505080>] sock_common_recvmsg+0x30/0x50
[1172610.895887]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172610.898512]  [<ffffffff8027b829>] core_sys_select+0x209/0x300
[1172610.901144]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.903780]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.906421]  [<ffffffff8022b51e>] current_fs_time+0x1e/0x30
[1172610.909040]  [<ffffffff803e3582>] tty_ldisc_deref+0x52/0x80
[1172610.911632]  [<ffffffff8027bdc1>] sys_select+0xd1/0x1c0
[1172610.914215]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.916754] 
[1172610.919253] bash          S 000000000000000e     0  7281   7280
[1172610.921808]  ffff8101919e3e88 0000000000000082 80000001542be065 ffff8100867c7530
[1172610.924409]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.927021]  ffffffff80747dc0 ffff81011060f028 ffff8101919e3e38 ffff8101aae8a930
[1172610.927124] Call Trace:
[1172610.932186]  [<ffffffff8021cb22>] do_page_fault+0x202/0x890
[1172610.934771]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172610.937337]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172610.939863]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.942391]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.944923] 
[1172610.947429] su            S 0000000000000000     0  7288   7281
[1172610.949987]  ffff81004e873e88 0000000000000086 ffff81004e873e50 ffff81011060f530
[1172610.952588]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.955214]  ffffffff80747dc0 ffff8100867c7738 ffff81004e873e54 ffff81004e873e48
[1172610.955317] Call Trace:
[1172610.960412]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172610.963007]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.965602]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.968186] 
[1172610.970703] bash          S 0000000000000000     0  7289   7288
[1172610.973262]  ffff810043dbfdb8 0000000000000082 ffff810043dbfd80 0000000000000fee
[1172610.975867]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.978487]  ffffffff80747dc0 ffff81011060f738 ffff810043dbfd84 ffff810043dbfd78
[1172610.978590] Call Trace:
[1172610.983666]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172610.986293]  [<ffffffff8023af8c>] add_wait_queue+0x1c/0x60
[1172610.988916]  [<ffffffff803e9bf8>] read_chan+0x228/0x6f0
[1172610.991531]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.994156]  [<ffffffff803e6710>] tty_read+0xb0/0x100
[1172610.996766]  [<ffffffff8026dc65>] vfs_read+0xc5/0x160
[1172610.999359]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172611.001936]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.004527] 
[1172611.007092] strace        S 0000000000000000     0  7319   7270
[1172611.009707]  ffff8101534a9e88 0000000000000086 ffff8101534a9e50 0000000000000092
[1172611.012368]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.015032]  ffffffff80747dc0 ffff810139e7c208 ffff8101534a9e54 ffff8101534a9e48
[1172611.015135] Call Trace:
[1172611.020281]  [<ffffffff80231215>] __group_send_sig_info+0x75/0xa0
[1172611.022914]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172611.025526]  [<ffffffff80231aa1>] kill_pid_info+0x51/0x90
[1172611.028133]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.030760]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.033389] 
[1172611.035983] rm            D 0000000000000000     0  7463   7239
[1172611.038664]  ffff8101254a3b08 0000000000000086 ffff8101254a3ad0 ffffffff80592c6c
[1172611.041422]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.044223]  ffffffff80747dc0 ffff810145b6b028 ffff8101254a3ad4 ffff8101254a3ac8
[1172611.044326] Call Trace:
[1172611.049792]  [<ffffffff80592c6c>] __down+0x10c/0x11f
[1172611.052604]  [<ffffffff80592c07>] __down+0xa7/0x11f
[1172611.055405]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.058227]  [<ffffffff80592886>] __down_failed+0x35/0x3a
[1172611.061044]  [<ffffffff8037c09e>] xfs_buf_lock+0x3e/0x40
[1172611.063866]  [<ffffffff80367be5>] xfs_getsb+0x15/0x40
[1172611.066676]  [<ffffffff8036e2da>] xfs_trans_getsb+0x5a/0xb0
[1172611.069478]  [<ffffffff8036d1bf>] xfs_trans_apply_sb_deltas+0xf/0x370
[1172611.072281]  [<ffffffff8036d5be>] _xfs_trans_commit+0x9e/0x3c0
[1172611.075085]  [<ffffffff8039c301>] __up_read+0x21/0xb0
[1172611.077884]  [<ffffffff80327522>] xfs_free_extent+0xe2/0x110
[1172611.080690]  [<ffffffff80379e9c>] kmem_zone_alloc+0x5c/0xd0
[1172611.083499]  [<ffffffff80379e9c>] kmem_zone_alloc+0x5c/0xd0
[1172611.086267]  [<ffffffff80379f42>] kmem_zone_zalloc+0x32/0x50
[1172611.089024]  [<ffffffff80357c9b>] xfs_itruncate_finish+0xdb/0x320
[1172611.091768]  [<ffffffff80378311>] xfs_inactive+0x3f1/0x520
[1172611.094486]  [<ffffffff80384629>] xfs_fs_clear_inode+0xa9/0x100
[1172611.097203]  [<ffffffff802821e8>] clear_inode+0x58/0xf0
[1172611.099883]  [<ffffffff80282369>] generic_delete_inode+0xe9/0xf0
[1172611.102557]  [<ffffffff802783fa>] do_unlinkat+0x14a/0x1c0
[1172611.105235]  [<ffffffff8059301d>] error_exit+0x0/0x84
[1172611.107916]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.110592] 
[1172611.113232] pickup        S 0000000000000000     0  7573  30580
[1172611.115922]  ffff81021d34be58 0000000000000086 ffff81021d34be20 0000000000000000
[1172611.118661]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.121398]  ffffffff80747dc0 ffff8101964af028 ffff81021d34be24 ffff81021d34be18
[1172611.121501] Call Trace:
[1172611.126801]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172611.129501]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172611.132189]  [<ffffffff8029af2d>] sys_epoll_wait+0x1bd/0x4e0
[1172611.134877]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.137570]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.140247] 
[1172611.142890] bash          D 0000000000000000     0  8896      1
[1172611.145570]  ffff8101cdf07ac8 0000000000000046 ffff8101cdf07a90 ffff810226a79800
[1172611.148276]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.150995]  ffffffff80747dc0 ffff810114417738 ffff8101cdf07a94 ffff8101cdf07a88
[1172611.151098] Call Trace:
[1172611.156317]  [<ffffffff80590f9d>] wait_for_completion+0x7d/0xc0
[1172611.159006]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.161706]  [<ffffffff8023706a>] flush_cpu_workqueue+0x6a/0x90
[1172611.164401]  [<ffffffff802371b0>] wq_barrier_func+0x0/0x10
[1172611.167086]  [<ffffffff80237183>] flush_workqueue+0x33/0x50
[1172611.169785]  [<ffffffff803e633f>] release_dev+0x44f/0x750
[1172611.172499]  [<ffffffff805907c6>] __sched_text_start+0x166/0x23d
[1172611.175232]  [<ffffffff803e6651>] tty_release+0x11/0x20
[1172611.177948]  [<ffffffff8026e531>] __fput+0xb1/0x1a0
[1172611.180652]  [<ffffffff8026b544>] filp_close+0x54/0x90
[1172611.183331]  [<ffffffff80228971>] put_files_struct+0xb1/0xd0
[1172611.185991]  [<ffffffff80229d79>] do_exit+0x1a9/0x8a0
[1172611.188636]  [<ffffffff80230c85>] __dequeue_signal+0x165/0x1f0
[1172611.191258]  [<ffffffff8022a49c>] do_group_exit+0x2c/0x80
[1172611.193857]  [<ffffffff80232ee7>] get_signal_to_deliver+0x2c7/0x470
[1172611.196464]  [<ffffffff8020af65>] do_notify_resume+0xc5/0x7a0
[1172611.199077]  [<ffffffff80230992>] send_signal+0x62/0x1f0
[1172611.201678]  [<ffffffff80231215>] __group_send_sig_info+0x75/0xa0
[1172611.204289]  [<ffffffff80231a2e>] group_send_sig_info+0x6e/0x90
[1172611.206890]  [<ffffffff8020b984>] sys_rt_sigreturn+0x324/0x3d0
[1172611.209498]  [<ffffffff802322be>] sys_rt_sigaction+0x8e/0xc0
[1172611.212068]  [<ffffffff8020bd66>] int_signal+0x12/0x17
[1172611.214618] 
[1172611.217129] su            ? 0000000000000000     0  8903   8896
[1172611.219666]  ffff8101e685dee8 0000000000000046 ffff8101e685deb0 0000000000000011
[1172611.222241]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.224859]  ffffffff80747dc0 ffff8101158e9028 ffff8101e685deb4 ffff8101e685dea8
[1172611.224962] Call Trace:
[1172611.230051]  [<ffffffff8022a18e>] do_exit+0x5be/0x8a0
[1172611.232666]  [<ffffffff8022a49c>] do_group_exit+0x2c/0x80
[1172611.235284]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.237904] 
[1172611.240493] bash          D ffff8101bfb7e600     0  8977      1
[1172611.243132]  ffff810106e37ac8 0000000000000046 ffff810106e37c08 ffff810226a79800
[1172611.245831]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.248548]  ffffffff80747dc0 ffff81018e79d738 0000000000000000 0000000000000000
[1172611.248652] Call Trace:
[1172611.253996]  [<ffffffff80590f9d>] wait_for_completion+0x7d/0xc0
[1172611.256787]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.259581]  [<ffffffff8023706a>] flush_cpu_workqueue+0x6a/0x90
[1172611.262374]  [<ffffffff802371b0>] wq_barrier_func+0x0/0x10
[1172611.265167]  [<ffffffff80237183>] flush_workqueue+0x33/0x50
[1172611.267952]  [<ffffffff803e633f>] release_dev+0x44f/0x750
[1172611.270733]  [<ffffffff803e6651>] tty_release+0x11/0x20
[1172611.273502]  [<ffffffff8026e531>] __fput+0xb1/0x1a0
[1172611.276259]  [<ffffffff8026b544>] filp_close+0x54/0x90
[1172611.279016]  [<ffffffff80228971>] put_files_struct+0xb1/0xd0
[1172611.281764]  [<ffffffff80229d79>] do_exit+0x1a9/0x8a0
[1172611.284504]  [<ffffffff80230c85>] __dequeue_signal+0x165/0x1f0
[1172611.287232]  [<ffffffff8022a49c>] do_group_exit+0x2c/0x80
[1172611.289939]  [<ffffffff80232ee7>] get_signal_to_deliver+0x2c7/0x470
[1172611.292654]  [<ffffffff8020af65>] do_notify_resume+0xc5/0x7a0
[1172611.295338]  [<ffffffff80230992>] send_signal+0x62/0x1f0
[1172611.298000]  [<ffffffff80231215>] __group_send_sig_info+0x75/0xa0
[1172611.300678]  [<ffffffff80231a2e>] group_send_sig_info+0x6e/0x90
[1172611.303357]  [<ffffffff8020b984>] sys_rt_sigreturn+0x324/0x3d0
[1172611.306036]  [<ffffffff802322be>] sys_rt_sigaction+0x8e/0xc0
[1172611.308696]  [<ffffffff8020bd66>] int_signal+0x12/0x17
[1172611.311338] 
[1172611.313951] su            ? 0000000000000000     0  8984   8977
[1172611.316601]  ffff810151203ee8 0000000000000046 ffff810151203eb0 0000000000000011
[1172611.319282]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.321981]  ffffffff80747dc0 ffff81021a284918 ffff810151203eb4 ffff810151203ea8
[1172611.322083] Call Trace:
[1172611.327263]  [<ffffffff8022a18e>] do_exit+0x5be/0x8a0
[1172611.329910]  [<ffffffff8022a49c>] do_group_exit+0x2c/0x80
[1172611.332547]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.335180] 
[1172611.337787] sshd          S 0000000000000000     0  9072   7582
[1172611.340453]  ffff81012ee91bf8 0000000000000082 ffff81012ee91bc0 ffff8101b0d95080
[1172611.343161]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.345879]  ffffffff80747dc0 ffff8101cb862918 ffff81012ee91bc4 ffff81012ee91bb8
[1172611.345982] Call Trace:
[1172611.351307]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172611.354060]  [<ffffffff8023ae53>] prepare_to_wait+0x23/0x80
[1172611.356818]  [<ffffffff80575ac6>] unix_stream_recvmsg+0x386/0x550
[1172611.359584]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172611.362359]  [<ffffffff80277aa0>] link_path_walk+0x80/0xf0
[1172611.365126]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172611.367882]  [<ffffffff8026b5f9>] get_unused_fd_flags+0x79/0x120
[1172611.370649]  [<ffffffff8026d349>] do_sync_read+0xd9/0x120
[1172611.373404]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172611.376174]  [<ffffffff8021e992>] pick_next_task_fair+0x42/0x70
[1172611.378939]  [<ffffffff805907c6>] __sched_text_start+0x166/0x23d
[1172611.381719]  [<ffffffff8026b96a>] do_filp_open+0x3a/0x50
[1172611.384497]  [<ffffffff8026dcf7>] vfs_read+0x157/0x160
[1172611.387260]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172611.390008]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.392729] 
[1172611.395395] sshd          S 0000000000000000     0  9074   9072
[1172611.398114]  ffff8101677179e8 0000000000000086 ffff8101677179b0 0000000000000002
[1172611.400847]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.403591]  ffffffff80747dc0 ffff8101cb863738 ffff8101677179b4 ffff8101677179a8
[1172611.403694] Call Trace:
[1172611.409063]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172611.411822]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172611.414587]  [<ffffffff8027b528>] do_select+0x468/0x560
[1172611.417307]  [<ffffffff8027bbc0>] __pollwait+0x0/0x130
[1172611.420004]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.422704]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.425339]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.427923]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.430472]  [<ffffffff80267609>] add_partial+0x19/0x60
[1172611.433013]  [<ffffffff80268a0d>] __slab_free+0x15d/0x310
[1172611.435547]  [<ffffffff80592da9>] _spin_lock_bh+0x9/0x20
[1172611.438080]  [<ffffffff80505743>] release_sock+0x13/0xb0
[1172611.440607]  [<ffffffff80547700>] tcp_recvmsg+0x370/0x940
[1172611.443136]  [<ffffffff80505080>] sock_common_recvmsg+0x30/0x50
[1172611.445679]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172611.448224]  [<ffffffff8027b829>] core_sys_select+0x209/0x300
[1172611.450769]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172611.453330]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.455892]  [<ffffffff8022b51e>] current_fs_time+0x1e/0x30
[1172611.458451]  [<ffffffff803e3582>] tty_ldisc_deref+0x52/0x80
[1172611.460996]  [<ffffffff8027bdc1>] sys_select+0xd1/0x1c0
[1172611.463530]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.466056] 
[1172611.468545] bash          S 0000000000000000     0  9075   9074
[1172611.471088]  ffff8101a8d01db8 0000000000000086 ffff8101a8d01d80 0000000000000ff5
[1172611.473676]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.476296]  ffffffff80747dc0 ffff81010f26c208 ffff8101a8d01d84 ffff8101a8d01d78
[1172611.476398] Call Trace:
[1172611.481491]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172611.484118]  [<ffffffff8023af8c>] add_wait_queue+0x1c/0x60
[1172611.486724]  [<ffffffff803e9bf8>] read_chan+0x228/0x6f0
[1172611.489303]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.491890]  [<ffffffff803e6710>] tty_read+0xb0/0x100
[1172611.494437]  [<ffffffff8026dc65>] vfs_read+0xc5/0x160
[1172611.496960]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172611.499471]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.501978] 
[1172611.504443] sshd          S 0000000000000000     0  9477   7582
[1172611.506967]  ffff810122bb5bf8 0000000000000082 ffff810122bb5bc0 ffff810102e23600
[1172611.509518]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.512071]  ffffffff80747dc0 ffff81019b72e918 ffff810122bb5bc4 ffff810122bb5bb8
[1172611.512174] Call Trace:
[1172611.517102]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172611.519615]  [<ffffffff8023ae53>] prepare_to_wait+0x23/0x80
[1172611.522128]  [<ffffffff80575ac6>] unix_stream_recvmsg+0x386/0x550
[1172611.524648]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172611.527170]  [<ffffffff80277aa0>] link_path_walk+0x80/0xf0
[1172611.529681]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172611.532193]  [<ffffffff8026b5f9>] get_unused_fd_flags+0x79/0x120
[1172611.534712]  [<ffffffff8026d349>] do_sync_read+0xd9/0x120
[1172611.537222]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172611.539741]  [<ffffffff8021e992>] pick_next_task_fair+0x42/0x70
[1172611.542257]  [<ffffffff805907c6>] __sched_text_start+0x166/0x23d
[1172611.544776]  [<ffffffff8026b96a>] do_filp_open+0x3a/0x50
[1172611.547286]  [<ffffffff8026dcf7>] vfs_read+0x157/0x160
[1172611.549793]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172611.552298]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.554805] 
[1172611.557268] sshd          S 0000000000000000     0  9479   9477
[1172611.559791]  ffff8101d7f7b9e8 0000000000000082 ffff8101d7f7b9b0 0000000000000002
[1172611.562340]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.564892]  ffffffff80747dc0 ffff81019b72f738 ffff8101d7f7b9b4 ffff8101d7f7b9a8
[1172611.564995] Call Trace:
[1172611.569926]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172611.572443]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172611.574957]  [<ffffffff8027b528>] do_select+0x468/0x560
[1172611.577469]  [<ffffffff8027bbc0>] __pollwait+0x0/0x130
[1172611.579979]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.582500]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.585023]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.587546]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.590069]  [<ffffffff8050bd41>] skb_copy_datagram_iovec+0x1a1/0x260
[1172611.592602]  [<ffffffff80592da9>] _spin_lock_bh+0x9/0x20
[1172611.595136]  [<ffffffff80505743>] release_sock+0x13/0xb0
[1172611.597669]  [<ffffffff80547700>] tcp_recvmsg+0x370/0x940
[1172611.600206]  [<ffffffff80505080>] sock_common_recvmsg+0x30/0x50
[1172611.602755]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172611.605295]  [<ffffffff8027b829>] core_sys_select+0x209/0x300
[1172611.607838]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172611.610396]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.612949]  [<ffffffff8022b51e>] current_fs_time+0x1e/0x30
[1172611.615496]  [<ffffffff803e3582>] tty_ldisc_deref+0x52/0x80
[1172611.618033]  [<ffffffff8027bdc1>] sys_select+0xd1/0x1c0
[1172611.620569]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.623100] 
[1172611.625606] bash          S 7fffffffffffffff     0  9480   9479
[1172611.628160]  ffff8101d7ed1db8 0000000000000086 000000000000000b 0000000000000ff5
[1172611.630773]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.633395]  ffffffff80747dc0 ffff8101cb7ee208 0000000000000000 ffff8101657c8018
[1172611.633497] Call Trace:
[1172611.638557]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172611.641136]  [<ffffffff8023af8c>] add_wait_queue+0x1c/0x60
[1172611.643699]  [<ffffffff803e9bf8>] read_chan+0x228/0x6f0
[1172611.646256]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.648829]  [<ffffffff803e6710>] tty_read+0xb0/0x100
[1172611.651389]  [<ffffffff8026dc65>] vfs_read+0xc5/0x160
[1172611.653928]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172611.656463]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.659013] 
[1172611.661536] su            S 0000000000000000     0  9613      1
[1172611.664103]  ffff8101c3c57e88 0000000000000086 ffff8101c3c57e50 ffff810117ac0000
[1172611.666717]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.669327]  ffffffff80747dc0 ffff810106581028 ffff8101c3c57e54 ffff8101c3c57e48
[1172611.669430] Call Trace:
[1172611.674472]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172611.677029]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.679584]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.682132] 
[1172611.684643] bash          S 000000000000000e     0  9614   9613
[1172611.687205]  ffff8101ebc27e88 0000000000000082 80000001df3f8065 ffff8101a86f6710
[1172611.689809]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.692439]  ffffffff80747dc0 ffff810117ac0208 ffff8101ebc27e38 ffff8101786d7a80
[1172611.692542] Call Trace:
[1172611.697656]  [<ffffffff8021cb22>] do_page_fault+0x202/0x890
[1172611.700289]  [<ffffffff8021ed69>] update_curr+0x109/0x120
[1172611.702917]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172611.705533]  [<ffffffff805907c6>] __sched_text_start+0x166/0x23d
[1172611.708163]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172611.710787]  [<ffffffff8027a520>] vfs_ioctl+0x220/0x2c0
[1172611.713422]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.716078]  [<ffffffff8027a609>] sys_ioctl+0x49/0x80
[1172611.718716]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.721349] 
[1172611.723928] bash          D ffff81017bb82900     0  9632      1
[1172611.726540]  ffff8101514abac8 0000000000000046 ffff8101514abc08 ffff810226a79800
[1172611.729205]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.731857]  ffffffff80747dc0 ffff810136f4c918 ffff810007139a50 ffff810004cd4a50
[1172611.731960] Call Trace:
[1172611.737092]  [<ffffffff80590f9d>] wait_for_completion+0x7d/0xc0
[1172611.739754]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.742431]  [<ffffffff8023706a>] flush_cpu_workqueue+0x6a/0x90
[1172611.745109]  [<ffffffff802371b0>] wq_barrier_func+0x0/0x10
[1172611.747812]  [<ffffffff80237183>] flush_workqueue+0x33/0x50
[1172611.750540]  [<ffffffff803e633f>] release_dev+0x44f/0x750
[1172611.753296]  [<ffffffff805907c6>] __sched_text_start+0x166/0x23d
[1172611.756058]  [<ffffffff803e6651>] tty_release+0x11/0x20
[1172611.758805]  [<ffffffff8026e531>] __fput+0xb1/0x1a0
[1172611.761549]  [<ffffffff8026b544>] filp_close+0x54/0x90
[1172611.764295]  [<ffffffff80228971>] put_files_struct+0xb1/0xd0
[1172611.767039]  [<ffffffff80229d79>] do_exit+0x1a9/0x8a0
[1172611.769781]  [<ffffffff80230c85>] __dequeue_signal+0x165/0x1f0
[1172611.772533]  [<ffffffff8022a49c>] do_group_exit+0x2c/0x80
[1172611.775279]  [<ffffffff80232ee7>] get_signal_to_deliver+0x2c7/0x470
[1172611.778032]  [<ffffffff8020af65>] do_notify_resume+0xc5/0x7a0
[1172611.780784]  [<ffffffff80230992>] send_signal+0x62/0x1f0
[1172611.783537]  [<ffffffff80231215>] __group_send_sig_info+0x75/0xa0
[1172611.786308]  [<ffffffff80231a2e>] group_send_sig_info+0x6e/0x90
[1172611.789086]  [<ffffffff8020b984>] sys_rt_sigreturn+0x324/0x3d0
[1172611.791858]  [<ffffffff802322be>] sys_rt_sigaction+0x8e/0xc0
[1172611.794615]  [<ffffffff8020bd66>] int_signal+0x12/0x17
[1172611.797334] 
[1172611.799993] su            ? 0000000000000000     0  9639   9632
[1172611.802704]  ffff8101b98afee8 0000000000000046 ffff8101b98afeb0 0000000000000011
[1172611.805431]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.808166]  ffffffff80747dc0 ffff8101243a7028 ffff8101b98afeb4 ffff8101b98afea8
[1172611.808269] Call Trace:
[1172611.813600]  [<ffffffff8022a18e>] do_exit+0x5be/0x8a0
[1172611.816333]  [<ffffffff8022a49c>] do_group_exit+0x2c/0x80
[1172611.819057]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.821794] 
[1172611.824519] mdadm         D 0000000000000000     0  9783   9614
[1172611.827312]  ffff8101aea09a18 0000000000000082 ffff8101aea099e0 ffff8101aea09998
[1172611.830142]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.832994]  ffffffff80747dc0 ffff8101a86f6918 ffff8101aea099e4 ffff8101aea099d8
[1172611.833098] Call Trace:
[1172611.838611]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172611.841427]  [<ffffffff80247ee0>] sync_page+0x0/0x50
[1172611.844200]  [<ffffffff80591348>] io_schedule+0x28/0x40
[1172611.846961]  [<ffffffff80247f1b>] sync_page+0x3b/0x50
[1172611.849716]  [<ffffffff8059181a>] __wait_on_bit_lock+0x4a/0x80
[1172611.852476]  [<ffffffff80247ebf>] __lock_page+0x5f/0x70
[1172611.855220]  [<ffffffff8023acf0>] wake_bit_function+0x0/0x30
[1172611.857968]  [<ffffffff8024f08a>] pagevec_lookup_tag+0x1a/0x30
[1172611.860699]  [<ffffffff8024d991>] write_cache_pages+0x191/0x340
[1172611.863407]  [<ffffffff8024d370>] __writepage+0x0/0x30
[1172611.866104]  [<ffffffff8024db90>] do_writepages+0x20/0x40
[1172611.868763]  [<ffffffff8028c179>] __writeback_single_inode+0x2d9/0x400
[1172611.871430]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172611.874087]  [<ffffffff8028c6ca>] sync_sb_inodes+0x21a/0x300
[1172611.876755]  [<ffffffff8028c851>] sync_inodes_sb+0xa1/0xc0
[1172611.879405]  [<ffffffff8026f08b>] __fsync_super+0xb/0x70
[1172611.882049]  [<ffffffff8026f0f9>] fsync_super+0x9/0x20
[1172611.884692]  [<ffffffff80291486>] fsync_bdev+0x26/0x60
[1172611.887318]  [<ffffffff803929a7>] blkdev_ioctl+0x1c7/0x7a0
[1172611.889939]  [<ffffffff802560f1>] handle_mm_fault+0x1a1/0x8a0
[1172611.892573]  [<ffffffff804b072a>] md_open+0x6a/0x90
[1172611.895186]  [<ffffffff802962e0>] blkdev_open+0x0/0x90
[1172611.897799]  [<ffffffff8039c301>] __up_read+0x21/0xb0
[1172611.900374]  [<ffffffff8021cb22>] do_page_fault+0x202/0x890
[1172611.902936]  [<ffffffff8029631c>] blkdev_open+0x3c/0x90
[1172611.905489]  [<ffffffff8029548b>] block_ioctl+0x1b/0x30
[1172611.907994]  [<ffffffff8027a28f>] do_ioctl+0x2f/0xa0
[1172611.910470]  [<ffffffff8027a520>] vfs_ioctl+0x220/0x2c0
[1172611.912938]  [<ffffffff8027a609>] sys_ioctl+0x49/0x80
[1172611.915381]  [<ffffffff8059301d>] error_exit+0x0/0x84
[1172611.917816]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.920256] 
[1172611.922661] sshd          S 0000000000000000     0  9793   7582
[1172611.925122]  ffff8101a7fabbf8 0000000000000086 ffff8101a7fabbc0 ffff8101cd1f1600
[1172611.927626]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.930154]  ffffffff80747dc0 ffff8101536d0918 ffff8101a7fabbc4 ffff8101a7fabbb8
[1172611.930258] Call Trace:
[1172611.935198]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172611.937753]  [<ffffffff8023ae53>] prepare_to_wait+0x23/0x80
[1172611.940308]  [<ffffffff80575ac6>] unix_stream_recvmsg+0x386/0x550
[1172611.942871]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172611.945439]  [<ffffffff80277aa0>] link_path_walk+0x80/0xf0
[1172611.947997]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172611.950553]  [<ffffffff8026b5f9>] get_unused_fd_flags+0x79/0x120
[1172611.953111]  [<ffffffff8026d349>] do_sync_read+0xd9/0x120
[1172611.955662]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172611.958225]  [<ffffffff8021e992>] pick_next_task_fair+0x42/0x70
[1172611.960800]  [<ffffffff805907c6>] __sched_text_start+0x166/0x23d
[1172611.963379]  [<ffffffff8026b96a>] do_filp_open+0x3a/0x50
[1172611.965946]  [<ffffffff8026dcf7>] vfs_read+0x157/0x160
[1172611.968507]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172611.971029]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.973523] 
[1172611.975978] sshd          S 0000000000000000     0  9795   9793
[1172611.978461]  ffff81021f41d9e8 0000000000000082 ffff81021f41d9b0 0000000000000002
[1172611.980981]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.983533]  ffffffff80747dc0 ffff8101536d1738 ffff81021f41d9b4 ffff81021f41d9a8
[1172611.983636] Call Trace:
[1172611.988598]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172611.991157]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172611.993698]  [<ffffffff8027b528>] do_select+0x468/0x560
[1172611.996208]  [<ffffffff8027bbc0>] __pollwait+0x0/0x130
[1172611.998705]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.001178]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.003617]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.006034]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.008424]  [<ffffffff80267609>] add_partial+0x19/0x60
[1172612.010813]  [<ffffffff80268a0d>] __slab_free+0x15d/0x310
[1172612.013194]  [<ffffffff80592da9>] _spin_lock_bh+0x9/0x20
[1172612.015567]  [<ffffffff80505743>] release_sock+0x13/0xb0
[1172612.017935]  [<ffffffff80547700>] tcp_recvmsg+0x370/0x940
[1172612.020296]  [<ffffffff80505080>] sock_common_recvmsg+0x30/0x50
[1172612.022667]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172612.025029]  [<ffffffff8027b829>] core_sys_select+0x209/0x300
[1172612.027401]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172612.029774]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.032143]  [<ffffffff8022b51e>] current_fs_time+0x1e/0x30
[1172612.034510]  [<ffffffff803e3582>] tty_ldisc_deref+0x52/0x80
[1172612.036880]  [<ffffffff8027bdc1>] sys_select+0xd1/0x1c0
[1172612.039245]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172612.041607] 
[1172612.043951] bash          S 000000000000000e     0  9796   9795
[1172612.046358]  ffff81013de09e88 0000000000000086 8000000104441065 ffff8101125a2710
[1172612.048809]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172612.051282]  ffffffff80747dc0 ffff81014da80208 ffff81013de09e38 ffff8101eab7d5e8
[1172612.051385] Call Trace:
[1172612.056215]  [<ffffffff8021cb22>] do_page_fault+0x202/0x890
[1172612.058715]  [<ffffffff8021ed69>] update_curr+0x109/0x120
[1172612.061212]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172612.063714]  [<ffffffff805907c6>] __sched_text_start+0x166/0x23d
[1172612.066238]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172612.068760]  [<ffffffff8027a520>] vfs_ioctl+0x220/0x2c0
[1172612.071291]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.073847]  [<ffffffff8027a609>] sys_ioctl+0x49/0x80
[1172612.076399]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172612.078935] 
[1172612.081438] su            S 0000000000000000     0  9804   9796
[1172612.083976]  ffff810184fdbe88 0000000000000082 ffff810184fdbe50 ffff810120808000
[1172612.086547]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172612.089126]  ffffffff80747dc0 ffff8101125a2918 ffff810184fdbe54 ffff810184fdbe48
[1172612.089229] Call Trace:
[1172612.094170]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172612.096703]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.099244]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172612.101772] 
[1172612.104264] bash          S 0000000000000000     0  9805   9804
[1172612.106820]  ffff8101e88f7db8 0000000000000082 ffff8101e88f7d80 0000000000000ff9
[1172612.109419]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172612.112036]  ffffffff80747dc0 ffff810120808208 ffff8101e88f7d84 ffff8101e88f7d78
[1172612.112139] Call Trace:
[1172612.117216]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172612.119833]  [<ffffffff8023af8c>] add_wait_queue+0x1c/0x60
[1172612.122446]  [<ffffffff803e9bf8>] read_chan+0x228/0x6f0
[1172612.125058]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.127700]  [<ffffffff803e6710>] tty_read+0xb0/0x100
[1172612.130342]  [<ffffffff8026dc65>] vfs_read+0xc5/0x160
[1172612.132958]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172612.135554]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172612.138121] 
[1172612.140634] smtpd         S 0000000000000000     0  9847  30580
[1172612.143203]  ffff8101a6e25e58 0000000000000086 ffff8101a6e25e20 ffff81022583d318
[1172612.145786]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172612.148371]  ffffffff80747dc0 ffff8101d859a208 ffff8101a6e25e24 ffff8101a6e25e18
[1172612.148474] Call Trace:
[1172612.153514]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172612.156129]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172612.158743]  [<ffffffff8029af2d>] sys_epoll_wait+0x1bd/0x4e0
[1172612.161385]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.164066]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172612.166774] 
[1172612.169446] smtpd         S ffff81022583d318     0  9963  30580
[1172612.172187]  ffff8101c5f69eb8 0000000000000082 0000000000000000 ffffffff00000001
[1172612.174990]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172612.177819]  ffffffff80747dc0 ffff810105b04918 0000000000000000 000000008bcec672
[1172612.177922] Call Trace:
[1172612.183467]  [<ffffffff8022b4c9>] ns_to_timeval+0x9/0x40
[1172612.186321]  [<ffffffff8027da7d>] flock_lock_file_wait+0x14d/0x300
[1172612.189190]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172612.192057]  [<ffffffff8027e7ab>] sys_flock+0x16b/0x180
[1172612.194913]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172612.197759] 
[1172612.200578] cleanup       S 0000000000000000     0  9966  30580
[1172612.203466]  ffff8101b50b7e58 0000000000000082 ffff8101b50b7e20 ffff8101a496a828
[1172612.206409]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172612.209358]  ffffffff80747dc0 ffff810132074208 ffff8101b50b7e24 ffff8101b50b7e18
[1172612.209460] Call Trace:
[1172612.215203]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172612.218127]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172612.221046]  [<ffffffff8029af2d>] sys_epoll_wait+0x1bd/0x4e0
[1172612.223934]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.226813]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172612.229693] 
[1172612.232543] local         S 0000000000000000     0  9967  30580
[1172612.235450]  ffff8101c7bf9e58 0000000000000086 ffff8101c7bf9e20 0000000000000000
[1172612.238401]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172612.241380]  ffffffff80747dc0 ffff8101b11bd738 ffff8101c7bf9e24 ffff8101c7bf9e18
[1172612.241483] Call Trace:
[1172612.247296]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172612.250292]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172612.253278]  [<ffffffff8029af2d>] sys_epoll_wait+0x1bd/0x4e0
[1172612.256265]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.259237]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172612.262188]

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: 2.6.23.1: mdadm/raid5 hung/d-state
  2007-11-04 12:52   ` 2.6.23.1: mdadm/raid5 hung/d-state Justin Piszcz
@ 2007-11-04 14:55     ` Michael Tokarev
  2007-11-04 14:59       ` Justin Piszcz
                         ` (2 more replies)
  0 siblings, 3 replies; 8+ messages in thread
From: Michael Tokarev @ 2007-11-04 14:55 UTC (permalink / raw)
  To: Justin Piszcz; +Cc: linux-kernel, linux-raid, xfs

Justin Piszcz wrote:
> On Sun, 4 Nov 2007, Michael Tokarev wrote:
[]
>> The next time you come across something like that, do a SysRq-T dump and
>> post that.  It shows a stack trace of all processes - and in particular,
>> where exactly each task is stuck.

> Yes I got it before I rebooted, ran that and then dmesg > file.
> 
> Here it is:
> 
> [1172609.665902]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
> [1172609.668768]  ffffffff80747dc0 ffff81015c3aa918 ffff810091c899b4 ffff810091c899a8

That's only partial list.  All the kernel threads - which are most important
in this context - aren't shown.  You ran out of dmesg buffer, and the most
interesting entries was at the beginning.  If your /var/log partition is
working, the stuff should be in /var/log/kern.log or equivalent.  If it's
not working, there is a way to capture the info still, by stopping syslogd,
cat'ing /proc/kmsg to some tmpfs file and scp'ing it elsewhere.

/mjt

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: 2.6.23.1: mdadm/raid5 hung/d-state
  2007-11-04 14:55     ` Michael Tokarev
@ 2007-11-04 14:59       ` Justin Piszcz
  2007-11-04 18:17       ` BERTRAND Joël
  2007-11-04 21:40       ` David Greaves
  2 siblings, 0 replies; 8+ messages in thread
From: Justin Piszcz @ 2007-11-04 14:59 UTC (permalink / raw)
  To: Michael Tokarev; +Cc: linux-kernel, linux-raid, xfs



On Sun, 4 Nov 2007, Michael Tokarev wrote:

> Justin Piszcz wrote:
>> On Sun, 4 Nov 2007, Michael Tokarev wrote:
> []
>>> The next time you come across something like that, do a SysRq-T dump and
>>> post that.  It shows a stack trace of all processes - and in particular,
>>> where exactly each task is stuck.
>
>> Yes I got it before I rebooted, ran that and then dmesg > file.
>>
>> Here it is:
>>
>> [1172609.665902]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
>> [1172609.668768]  ffffffff80747dc0 ffff81015c3aa918 ffff810091c899b4 ffff810091c899a8
>
> That's only partial list.  All the kernel threads - which are most important
> in this context - aren't shown.  You ran out of dmesg buffer, and the most
> interesting entries was at the beginning.  If your /var/log partition is
> working, the stuff should be in /var/log/kern.log or equivalent.  If it's
> not working, there is a way to capture the info still, by stopping syslogd,
> cat'ing /proc/kmsg to some tmpfs file and scp'ing it elsewhere.
>
> /mjt
>

Will do that the next time it happens, thanks.

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: 2.6.23.1: mdadm/raid5 hung/d-state
  2007-11-04 14:55     ` Michael Tokarev
  2007-11-04 14:59       ` Justin Piszcz
@ 2007-11-04 18:17       ` BERTRAND Joël
  2007-11-04 21:40       ` David Greaves
  2 siblings, 0 replies; 8+ messages in thread
From: BERTRAND Joël @ 2007-11-04 18:17 UTC (permalink / raw)
  To: Michael Tokarev; +Cc: Justin Piszcz, linux-kernel, linux-raid, xfs

Michael Tokarev wrote:
> Justin Piszcz wrote:
>> On Sun, 4 Nov 2007, Michael Tokarev wrote:
> []
>>> The next time you come across something like that, do a SysRq-T dump and
>>> post that.  It shows a stack trace of all processes - and in particular,
>>> where exactly each task is stuck.
> 
>> Yes I got it before I rebooted, ran that and then dmesg > file.
>>
>> Here it is:
>>
>> [1172609.665902]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
>> [1172609.668768]  ffffffff80747dc0 ffff81015c3aa918 ffff810091c899b4 ffff810091c899a8
> 
> That's only partial list.  All the kernel threads - which are most important
> in this context - aren't shown.  You ran out of dmesg buffer, and the most
> interesting entries was at the beginning.  If your /var/log partition is
> working, the stuff should be in /var/log/kern.log or equivalent.  If it's
> not working, there is a way to capture the info still, by stopping syslogd,
> cat'ing /proc/kmsg to some tmpfs file and scp'ing it elsewhere.

	I have reported some days ago the same bug . I can reproduced it 
without any trouble :-(.

	Configuration : 2.6.23 linux kernel with iscsi-target on sparc64/smp 
(sun4v). Following output was crated by echo t > /proc/sysrq-trigger and 
echo x > /proc/sysrq-trigger. I is a  and paste from /var/log/syslog and 
I hope I haven't done any mistake...

Nov  4 18:55:56 poulenc kernel: SysRq : Show State
Nov  4 18:55:56 poulenc kernel:   task                        PC stack 
  pid father
Nov  4 18:55:56 poulenc kernel: init          S 00000000004c7d68     0 
    1      0
Nov  4 18:55:56 poulenc kernel: Call Trace:
Nov  4 18:55:56 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:55:56 poulenc kernel:  [00000000004c7d68] do_select+0x3d0/0x420
Nov  4 18:55:56 poulenc kernel:  [00000000004eccb8] 
compat_core_sys_select+0x160/0x200
Nov  4 18:55:56 poulenc kernel:  [00000000004eef74] 
compat_sys_select+0xbc/0x1a0
Nov  4 18:55:56 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:55:56 poulenc kernel:  [00000000000150b8] 0x150c0
Nov  4 18:55:56 poulenc kernel: kthreadd      S 00000000004273d0     0 
    2      0
Nov  4 18:55:56 poulenc kernel: Call Trace:
Nov  4 18:55:56 poulenc kernel:  [0000000000478fe8] kthreadd+0x1b0/0x1c0
Nov  4 18:55:56 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:56 poulenc kernel:  [000000000067d404] rest_init+0x2c/0x60
Nov  4 18:55:56 poulenc kernel: migration/0   S 0000000000478ce0     0 
    3      2
Nov  4 18:55:56 poulenc kernel: Call Trace:
Nov  4 18:55:56 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:55:56 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:56 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:56 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:56 poulenc kernel: ksoftirqd/0   S 0000000000478ce0     0 
    4      2
Nov  4 18:55:56 poulenc kernel: Call Trace:
Nov  4 18:55:56 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:55:56 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:56 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:57 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:57 poulenc kernel: watchdog/0    S 0000000000478ce0     0 
    5      2
Nov  4 18:55:57 poulenc kernel: Call Trace:
Nov  4 18:55:57 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:55:57 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:57 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:57 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:57 poulenc kernel: migration/1   S 0000000000478ce0     0 
    6      2
Nov  4 18:55:57 poulenc kernel: Call Trace:
Nov  4 18:55:57 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:55:57 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:57 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:57 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:57 poulenc kernel: ksoftirqd/1   S 0000000000478ce0     0 
    7      2
Nov  4 18:55:57 poulenc kernel: Call Trace:
Nov  4 18:55:57 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:55:57 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:57 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:57 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:57 poulenc kernel: watchdog/1    S 0000000000478ce0     0 
    8      2
Nov  4 18:55:57 poulenc kernel: Call Trace:
Nov  4 18:55:57 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:55:57 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:57 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:57 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:57 poulenc kernel: migration/2   S 0000000000478ce0     0 
    9      2
Nov  4 18:55:57 poulenc kernel: Call Trace:
Nov  4 18:55:57 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:55:57 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:57 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:57 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:57 poulenc kernel: ksoftirqd/2   S 0000000000478ce0     0 
   10      2
Nov  4 18:55:57 poulenc kernel: Call Trace:
Nov  4 18:55:57 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:55:57 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:57 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:57 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:57 poulenc kernel: watchdog/2    S 0000000000478ce0     0 
   11      2
Nov  4 18:55:57 poulenc kernel: Call Trace:
Nov  4 18:55:57 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:55:57 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:57 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:57 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:57 poulenc kernel: migration/3   R  running task        0 
   12      2
Nov  4 18:55:57 poulenc kernel: ksoftirqd/3   S 0000000000478ce0     0 
   13      2
Nov  4 18:55:57 poulenc kernel: Call Trace:
Nov  4 18:55:57 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:55:57 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:57 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:58 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:58 poulenc kernel: watchdog/3    S 0000000000478ce0     0 
   14      2
Nov  4 18:55:58 poulenc kernel: Call Trace:
Nov  4 18:55:58 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:55:58 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:58 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:58 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:58 poulenc kernel: migration/4   S 0000000000478ce0     0 
   15      2
Nov  4 18:55:58 poulenc kernel: Call Trace:
Nov  4 18:55:58 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:55:58 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:58 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:58 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:58 poulenc kernel: ksoftirqd/4   S 0000000000478ce0     0 
   16      2
Nov  4 18:55:58 poulenc kernel: Call Trace:
Nov  4 18:55:58 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:55:58 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:58 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:58 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:58 poulenc kernel: watchdog/4    S 0000000000478ce0     0 
   17      2
Nov  4 18:55:58 poulenc kernel: Call Trace:
Nov  4 18:55:58 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:55:58 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:58 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:58 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:58 poulenc kernel: migration/5   S 0000000000478ce0     0 
   18      2
Nov  4 18:55:58 poulenc kernel: Call Trace:
Nov  4 18:55:58 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:55:58 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:58 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:58 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:58 poulenc kernel: ksoftirqd/5   S 0000000000478ce0     0 
   19      2
Nov  4 18:55:58 poulenc kernel: Call Trace:
Nov  4 18:55:58 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:55:58 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:58 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:58 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:58 poulenc kernel: watchdog/5    S 0000000000478ce0     0 
   20      2
Nov  4 18:55:58 poulenc kernel: Call Trace:
Nov  4 18:55:58 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:55:58 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:58 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:58 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:58 poulenc kernel: migration/6   S 0000000000478ce0     0 
   21      2
Nov  4 18:55:58 poulenc kernel: Call Trace:
Nov  4 18:55:58 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:55:58 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:58 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:59 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:59 poulenc kernel: ksoftirqd/6   S 0000000000478ce0     0 
   22      2
Nov  4 18:55:59 poulenc kernel: Call Trace:
Nov  4 18:55:59 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:55:59 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:59 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:59 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:59 poulenc kernel: watchdog/6    S 0000000000478ce0     0 
   23      2
Nov  4 18:55:59 poulenc kernel: Call Trace:
Nov  4 18:55:59 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:55:59 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:59 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:59 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:59 poulenc kernel: migration/7   S 0000000000478ce0     0 
   24      2
Nov  4 18:55:59 poulenc kernel: Call Trace:
Nov  4 18:55:59 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:55:59 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:59 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:59 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:59 poulenc kernel: ksoftirqd/7   S 0000000000478ce0     0 
   25      2
Nov  4 18:55:59 poulenc kernel: Call Trace:
Nov  4 18:55:59 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:55:59 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:59 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:59 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:59 poulenc kernel: watchdog/7    S 0000000000478ce0     0 
   26      2
Nov  4 18:55:59 poulenc kernel: Call Trace:
Nov  4 18:55:59 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:55:59 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:59 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:59 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:59 poulenc kernel: migration/8   S 0000000000478ce0     0 
   27      2
Nov  4 18:55:59 poulenc kernel: Call Trace:
Nov  4 18:55:59 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:55:59 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:59 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:59 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:59 poulenc kernel: ksoftirqd/8   S 0000000000478ce0     0 
   28      2
Nov  4 18:55:59 poulenc kernel: Call Trace:
Nov  4 18:55:59 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:55:59 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:59 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:59 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:55:59 poulenc kernel: watchdog/8    S 0000000000478ce0     0 
   29      2
Nov  4 18:55:59 poulenc kernel: Call Trace:
Nov  4 18:55:59 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:55:59 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:55:59 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:55:59 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:00 poulenc kernel: migration/9   S 0000000000478ce0     0 
   30      2
Nov  4 18:56:00 poulenc kernel: Call Trace:
Nov  4 18:56:00 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:56:00 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:00 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:00 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:00 poulenc kernel: ksoftirqd/9   S 0000000000478ce0     0 
   31      2
Nov  4 18:56:00 poulenc kernel: Call Trace:
Nov  4 18:56:00 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:56:00 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:00 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:00 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:00 poulenc kernel: watchdog/9    S 0000000000478ce0     0 
   32      2
Nov  4 18:56:00 poulenc kernel: Call Trace:
Nov  4 18:56:00 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:56:00 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:00 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:00 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:00 poulenc kernel: migration/10  S 0000000000478ce0     0 
   33      2
Nov  4 18:56:00 poulenc kernel: Call Trace:
Nov  4 18:56:00 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:56:00 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:00 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:00 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:00 poulenc kernel: ksoftirqd/10  S 0000000000478ce0     0 
   34      2
Nov  4 18:56:00 poulenc kernel: Call Trace:
Nov  4 18:56:00 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:56:00 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:00 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:00 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:00 poulenc kernel: watchdog/10   S 0000000000478ce0     0 
   35      2
Nov  4 18:56:00 poulenc kernel: Call Trace:
Nov  4 18:56:00 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:56:00 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:00 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:00 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:00 poulenc kernel: migration/11  S 0000000000478ce0     0 
   36      2
Nov  4 18:56:00 poulenc kernel: Call Trace:
Nov  4 18:56:00 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:56:00 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:00 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:00 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:00 poulenc kernel: ksoftirqd/11  S 0000000000478ce0     0 
   37      2
Nov  4 18:56:00 poulenc kernel: Call Trace:
Nov  4 18:56:00 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:56:00 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:01 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:01 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:01 poulenc kernel: watchdog/11   S 0000000000478ce0     0 
   38      2
Nov  4 18:56:01 poulenc kernel: Call Trace:
Nov  4 18:56:01 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:56:01 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:01 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:01 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:01 poulenc kernel: migration/12  S 0000000000478ce0     0 
   39      2
Nov  4 18:56:01 poulenc kernel: Call Trace:
Nov  4 18:56:01 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:56:01 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:01 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:01 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:01 poulenc kernel: ksoftirqd/12  S 0000000000478ce0     0 
   40      2
Nov  4 18:56:01 poulenc kernel: Call Trace:
Nov  4 18:56:01 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:56:01 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:01 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:01 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:01 poulenc kernel: watchdog/12   S 0000000000478ce0     0 
   41      2
Nov  4 18:56:01 poulenc kernel: Call Trace:
Nov  4 18:56:01 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:56:01 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:01 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:01 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:01 poulenc kernel: migration/13  S 0000000000478ce0     0 
   42      2
Nov  4 18:56:01 poulenc kernel: Call Trace:
Nov  4 18:56:01 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:56:01 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:01 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:01 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:01 poulenc kernel: ksoftirqd/13  S 0000000000478ce0     0 
   43      2
Nov  4 18:56:01 poulenc kernel: Call Trace:
Nov  4 18:56:01 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:56:01 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:01 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:01 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:01 poulenc kernel: watchdog/13   S 0000000000478ce0     0 
   44      2
Nov  4 18:56:01 poulenc kernel: Call Trace:
Nov  4 18:56:01 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:56:01 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:01 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:01 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:02 poulenc kernel: migration/14  S 0000000000478ce0     0 
   45      2
Nov  4 18:56:02 poulenc kernel: Call Trace:
Nov  4 18:56:02 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:56:02 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:02 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:02 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:02 poulenc kernel: ksoftirqd/14  S 0000000000478ce0     0 
   46      2
Nov  4 18:56:02 poulenc kernel: Call Trace:
Nov  4 18:56:02 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:56:02 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:02 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:02 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:02 poulenc kernel: watchdog/14   S 0000000000478ce0     0 
   47      2
Nov  4 18:56:02 poulenc kernel: Call Trace:
Nov  4 18:56:02 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:56:02 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:02 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:02 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:02 poulenc kernel: migration/15  S 0000000000478ce0     0 
   48      2
Nov  4 18:56:02 poulenc kernel: Call Trace:
Nov  4 18:56:02 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:56:02 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:02 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:02 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:02 poulenc kernel: ksoftirqd/15  S 0000000000478ce0     0 
   49      2
Nov  4 18:56:02 poulenc kernel: Call Trace:
Nov  4 18:56:02 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:56:02 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:02 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:02 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:02 poulenc kernel: watchdog/15   S 0000000000478ce0     0 
   50      2
Nov  4 18:56:02 poulenc kernel: Call Trace:
Nov  4 18:56:02 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:56:02 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:02 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:02 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:02 poulenc kernel: migration/16  S 0000000000478ce0     0 
   51      2
Nov  4 18:56:03 poulenc kernel: Call Trace:
Nov  4 18:56:03 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:56:03 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:03 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:03 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:03 poulenc kernel: ksoftirqd/16  S 0000000000478ce0     0 
   52      2
Nov  4 18:56:03 poulenc kernel: Call Trace:
Nov  4 18:56:03 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:56:03 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:03 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:03 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:03 poulenc kernel: watchdog/16   S 0000000000478ce0     0 
   53      2
Nov  4 18:56:03 poulenc kernel: Call Trace:
Nov  4 18:56:03 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:56:03 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:03 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:03 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:03 poulenc kernel: migration/17  R  running task        0 
   54      2
Nov  4 18:56:03 poulenc kernel: ksoftirqd/17  R  running task        0 
   55      2
Nov  4 18:56:03 poulenc kernel: watchdog/17   S 0000000000478ce0     0 
   56      2
Nov  4 18:56:03 poulenc kernel: Call Trace:
Nov  4 18:56:03 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:56:03 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:03 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:03 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:03 poulenc kernel: migration/18  S 0000000000478ce0     0 
   57      2
Nov  4 18:56:03 poulenc kernel: Call Trace:
Nov  4 18:56:03 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:56:03 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:03 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:03 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:03 poulenc kernel: ksoftirqd/18  S 0000000000478ce0     0 
   58      2
Nov  4 18:56:03 poulenc kernel: Call Trace:
Nov  4 18:56:03 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:56:03 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:04 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:04 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:04 poulenc kernel: watchdog/18   S 0000000000478ce0     0 
   59      2
Nov  4 18:56:04 poulenc kernel: Call Trace:
Nov  4 18:56:04 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:56:04 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:04 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:04 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:04 poulenc kernel: migration/19  S 0000000000478ce0     0 
   60      2
Nov  4 18:56:04 poulenc kernel: Call Trace:
Nov  4 18:56:04 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:56:04 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:04 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:04 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:04 poulenc kernel: ksoftirqd/19  S 0000000000478ce0     0 
   61      2
Nov  4 18:56:04 poulenc kernel: Call Trace:
Nov  4 18:56:04 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:56:04 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:04 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:04 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:04 poulenc kernel: watchdog/19   S 0000000000478ce0     0 
   62      2
Nov  4 18:56:04 poulenc kernel: Call Trace:
Nov  4 18:56:04 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:56:04 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:04 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:04 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:04 poulenc kernel: migration/20  S 0000000000478ce0     0 
   63      2
Nov  4 18:56:04 poulenc kernel: Call Trace:
Nov  4 18:56:04 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:56:04 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:04 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:04 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:04 poulenc kernel: ksoftirqd/20  S 0000000000478ce0     0 
   64      2
Nov  4 18:56:04 poulenc kernel: Call Trace:
Nov  4 18:56:04 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:56:04 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:04 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:04 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:04 poulenc kernel: watchdog/20   S 0000000000478ce0     0 
   65      2
Nov  4 18:56:04 poulenc kernel: Call Trace:
Nov  4 18:56:04 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:56:04 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:04 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:04 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:04 poulenc kernel: migration/21  S 0000000000478ce0     0 
   66      2
Nov  4 18:56:04 poulenc kernel: Call Trace:
Nov  4 18:56:04 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:56:04 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:04 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:05 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:05 poulenc kernel: ksoftirqd/21  S 0000000000478ce0     0 
   67      2
Nov  4 18:56:05 poulenc kernel: Call Trace:
Nov  4 18:56:05 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:56:05 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:05 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:05 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:05 poulenc kernel: watchdog/21   S 0000000000478ce0     0 
   68      2
Nov  4 18:56:05 poulenc kernel: Call Trace:
Nov  4 18:56:05 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:56:05 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:05 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:05 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:05 poulenc kernel: migration/22  S 0000000000478ce0     0 
   69      2
Nov  4 18:56:05 poulenc kernel: Call Trace:
Nov  4 18:56:05 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:56:05 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:05 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:05 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:05 poulenc kernel: ksoftirqd/22  S 0000000000478ce0     0 
   70      2
Nov  4 18:56:05 poulenc kernel: Call Trace:
Nov  4 18:56:05 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:56:05 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:05 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:05 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:05 poulenc kernel: watchdog/22   S 0000000000478ce0     0 
   71      2
Nov  4 18:56:05 poulenc kernel: Call Trace:
Nov  4 18:56:05 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:56:05 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:05 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:05 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:05 poulenc kernel: migration/23  S 0000000000478ce0     0 
   72      2
Nov  4 18:56:05 poulenc kernel: Call Trace:
Nov  4 18:56:05 poulenc kernel:  [000000000045e60c] 
migration_thread+0x174/0x360
Nov  4 18:56:05 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:05 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:05 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:05 poulenc kernel: ksoftirqd/23  S 0000000000478ce0     0 
   73      2
Nov  4 18:56:05 poulenc kernel: Call Trace:
Nov  4 18:56:05 poulenc kernel:  [00000000004683c0] ksoftirqd+0xa8/0xc0
Nov  4 18:56:05 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:05 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:06 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:06 poulenc kernel: watchdog/23   S 0000000000478ce0     0 
   74      2
Nov  4 18:56:06 poulenc kernel: Call Trace:
Nov  4 18:56:06 poulenc kernel:  [000000000048f9e0] watchdog+0x48/0x80
Nov  4 18:56:06 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:06 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:06 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:06 poulenc kernel: events/0      S 0000000000478ce0     0 
   75      2
Nov  4 18:56:06 poulenc kernel: Call Trace:
Nov  4 18:56:06 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:06 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:06 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:06 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:06 poulenc kernel: events/1      S 0000000000478ce0     0 
   76      2
Nov  4 18:56:06 poulenc kernel: Call Trace:
Nov  4 18:56:06 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:06 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:06 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:06 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:06 poulenc kernel: events/2      S 0000000000478ce0     0 
   77      2
Nov  4 18:56:06 poulenc kernel: Call Trace:
Nov  4 18:56:06 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:06 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:06 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:06 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:06 poulenc kernel: events/3      R  running task        0 
   78      2
Nov  4 18:56:06 poulenc kernel: events/4      S 0000000000478ce0     0 
   79      2
Nov  4 18:56:06 poulenc kernel: Call Trace:
Nov  4 18:56:06 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:06 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:06 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:06 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:06 poulenc kernel: events/5      S 0000000000478ce0     0 
   80      2
Nov  4 18:56:06 poulenc kernel: Call Trace:
Nov  4 18:56:06 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:06 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:06 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:06 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:06 poulenc kernel: events/6      S 0000000000478ce0     0 
   81      2
Nov  4 18:56:06 poulenc kernel: Call Trace:
Nov  4 18:56:06 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:06 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:06 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:06 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:06 poulenc kernel: events/7      S 0000000000478ce0     0 
   82      2
Nov  4 18:56:06 poulenc kernel: Call Trace:
Nov  4 18:56:06 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:06 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:06 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:06 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:07 poulenc kernel: events/8      S 0000000000478ce0     0 
   83      2
Nov  4 18:56:07 poulenc kernel: Call Trace:
Nov  4 18:56:07 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:07 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:07 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:07 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:07 poulenc kernel: events/9      S 0000000000478ce0     0 
   84      2
Nov  4 18:56:07 poulenc kernel: Call Trace:
Nov  4 18:56:07 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:07 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:07 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:07 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:07 poulenc kernel: events/10     S 0000000000478ce0     0 
   85      2
Nov  4 18:56:07 poulenc kernel: Call Trace:
Nov  4 18:56:07 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:07 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:07 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:07 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:07 poulenc kernel: events/11     S 0000000000478ce0     0 
   86      2
Nov  4 18:56:07 poulenc kernel: Call Trace:
Nov  4 18:56:07 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:07 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:07 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:07 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:07 poulenc kernel: events/12     S 0000000000478ce0     0 
   87      2
Nov  4 18:56:07 poulenc kernel: Call Trace:
Nov  4 18:56:07 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:07 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:07 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:07 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:07 poulenc kernel: events/13     S 0000000000478ce0     0 
   88      2
Nov  4 18:56:07 poulenc kernel: Call Trace:
Nov  4 18:56:07 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:07 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:07 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:07 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:07 poulenc kernel: events/14     S 0000000000478ce0     0 
   89      2
Nov  4 18:56:07 poulenc kernel: Call Trace:
Nov  4 18:56:07 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:07 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:07 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:07 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:07 poulenc kernel: events/15     S 0000000000478ce0     0 
   90      2
Nov  4 18:56:07 poulenc kernel: Call Trace:
Nov  4 18:56:07 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:07 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:07 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:07 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:07 poulenc kernel: events/16     S 0000000000478ce0     0 
   91      2
Nov  4 18:56:08 poulenc kernel: Call Trace:
Nov  4 18:56:08 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:08 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:08 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:08 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:08 poulenc kernel: events/17     S 0000000000478ce0     0 
   92      2
Nov  4 18:56:08 poulenc kernel: Call Trace:
Nov  4 18:56:08 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:08 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:08 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:08 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:08 poulenc kernel: events/18     S 0000000000478ce0     0 
   93      2
Nov  4 18:56:08 poulenc kernel: Call Trace:
Nov  4 18:56:08 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:08 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:08 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:08 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:08 poulenc kernel: events/19     S 0000000000478ce0     0 
   94      2
Nov  4 18:56:08 poulenc kernel: Call Trace:
Nov  4 18:56:08 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:08 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:08 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:08 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:08 poulenc kernel: events/20     S 0000000000478ce0     0 
   95      2
Nov  4 18:56:08 poulenc kernel: Call Trace:
Nov  4 18:56:08 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:08 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:08 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:08 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:08 poulenc kernel: events/21     S 0000000000478ce0     0 
   96      2
Nov  4 18:56:08 poulenc kernel: Call Trace:
Nov  4 18:56:08 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:08 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:08 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:08 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:08 poulenc kernel: events/22     S 0000000000478ce0     0 
   97      2
Nov  4 18:56:08 poulenc kernel: Call Trace:
Nov  4 18:56:08 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:08 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:08 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:08 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:08 poulenc kernel: events/23     S 0000000000478ce0     0 
   98      2
Nov  4 18:56:08 poulenc kernel: Call Trace:
Nov  4 18:56:08 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:08 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:08 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:08 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:08 poulenc kernel: khelper       S 0000000000478ce0     0 
   99      2
Nov  4 18:56:08 poulenc kernel: Call Trace:
Nov  4 18:56:08 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:08 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:08 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:08 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:09 poulenc kernel: kblockd/0     S 0000000000478ce0     0 
  247      2
Nov  4 18:56:09 poulenc kernel: Call Trace:
Nov  4 18:56:09 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:09 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:09 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:09 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:09 poulenc kernel: kblockd/1     S 0000000000478ce0     0 
  248      2
Nov  4 18:56:09 poulenc kernel: Call Trace:
Nov  4 18:56:09 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:09 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:09 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:09 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:09 poulenc kernel: kblockd/2     S 0000000000478ce0     0 
  249      2
Nov  4 18:56:09 poulenc kernel: Call Trace:
Nov  4 18:56:09 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:09 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:09 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:09 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:09 poulenc kernel: kblockd/3     R  running task        0 
  250      2
Nov  4 18:56:09 poulenc kernel: kblockd/4     S 0000000000478ce0     0 
  251      2
Nov  4 18:56:09 poulenc kernel: Call Trace:
Nov  4 18:56:09 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:09 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:09 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:09 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:09 poulenc kernel: kblockd/5     S 0000000000478ce0     0 
  252      2
Nov  4 18:56:09 poulenc kernel: Call Trace:
Nov  4 18:56:09 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:09 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:09 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:09 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:09 poulenc kernel: kblockd/6     S 0000000000478ce0     0 
  253      2
Nov  4 18:56:09 poulenc kernel: Call Trace:
Nov  4 18:56:09 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:09 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:09 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:10 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:10 poulenc kernel: kblockd/7     S 0000000000478ce0     0 
  254      2
Nov  4 18:56:10 poulenc kernel: Call Trace:
Nov  4 18:56:10 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:10 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:10 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:10 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:10 poulenc kernel: kblockd/8     S 0000000000478ce0     0 
  255      2
Nov  4 18:56:10 poulenc kernel: Call Trace:
Nov  4 18:56:10 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:10 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:10 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:10 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:10 poulenc kernel: kblockd/9     S 0000000000478ce0     0 
  256      2
Nov  4 18:56:10 poulenc kernel: Call Trace:
Nov  4 18:56:10 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:10 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:10 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:10 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:10 poulenc kernel: kblockd/10    S 0000000000478ce0     0 
  257      2
Nov  4 18:56:10 poulenc kernel: Call Trace:
Nov  4 18:56:10 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:10 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:10 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:10 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:10 poulenc kernel: kblockd/11    S 0000000000478ce0     0 
  258      2
Nov  4 18:56:10 poulenc kernel: Call Trace:
Nov  4 18:56:10 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:10 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:10 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:10 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:10 poulenc kernel: kblockd/12    S 0000000000478ce0     0 
  259      2
Nov  4 18:56:10 poulenc kernel: Call Trace:
Nov  4 18:56:10 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:10 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:10 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:10 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:10 poulenc kernel: kblockd/13    S 0000000000478ce0     0 
  260      2
Nov  4 18:56:10 poulenc kernel: Call Trace:
Nov  4 18:56:10 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:10 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:10 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:10 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:10 poulenc kernel: kblockd/14    S 0000000000478ce0     0 
  261      2
Nov  4 18:56:10 poulenc kernel: Call Trace:
Nov  4 18:56:10 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:10 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:10 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:11 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:11 poulenc kernel: kblockd/15    S 0000000000478ce0     0 
  262      2
Nov  4 18:56:11 poulenc kernel: Call Trace:
Nov  4 18:56:11 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:11 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:11 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:11 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:11 poulenc kernel: kblockd/16    S 0000000000478ce0     0 
  263      2
Nov  4 18:56:11 poulenc kernel: Call Trace:
Nov  4 18:56:11 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:11 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:11 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:11 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:11 poulenc kernel: kblockd/17    S 0000000000478ce0     0 
  264      2
Nov  4 18:56:11 poulenc kernel: Call Trace:
Nov  4 18:56:11 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:11 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:11 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:11 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:11 poulenc kernel: kblockd/18    S 0000000000478ce0     0 
  265      2
Nov  4 18:56:11 poulenc kernel: Call Trace:
Nov  4 18:56:11 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:11 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:11 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:11 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:11 poulenc kernel: kblockd/19    S 0000000000478ce0     0 
  266      2
Nov  4 18:56:11 poulenc kernel: Call Trace:
Nov  4 18:56:11 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:11 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:11 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:11 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:11 poulenc kernel: kblockd/20    S 0000000000478ce0     0 
  267      2
Nov  4 18:56:11 poulenc kernel: Call Trace:
Nov  4 18:56:11 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:11 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:11 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:11 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:11 poulenc kernel: kblockd/21    S 0000000000478ce0     0 
  268      2
Nov  4 18:56:11 poulenc kernel: Call Trace:
Nov  4 18:56:11 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:12 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:12 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:12 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:12 poulenc kernel: kblockd/22    S 0000000000478ce0     0 
  269      2
Nov  4 18:56:12 poulenc kernel: Call Trace:
Nov  4 18:56:12 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:12 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:12 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:12 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:12 poulenc kernel: kblockd/23    S 0000000000478ce0     0 
  270      2
Nov  4 18:56:12 poulenc kernel: Call Trace:
Nov  4 18:56:12 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:12 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:12 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:12 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:12 poulenc kernel: pdflush       S 0000000000478ce0     0 
  294      2
Nov  4 18:56:12 poulenc kernel: Call Trace:
Nov  4 18:56:12 poulenc kernel:  [000000000049a420] pdflush+0xc8/0x200
Nov  4 18:56:12 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:12 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:12 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:12 poulenc kernel: pdflush       S 0000000000478ce0     0 
  295      2
Nov  4 18:56:12 poulenc kernel: Call Trace:
Nov  4 18:56:12 poulenc kernel:  [000000000049a420] pdflush+0xc8/0x200
Nov  4 18:56:12 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:12 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:12 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:12 poulenc kernel: kswapd0       S 0000000000478ce0     0 
  296      2
Nov  4 18:56:12 poulenc kernel: Call Trace:
Nov  4 18:56:12 poulenc kernel:  [000000000049e778] kswapd+0x540/0x560
Nov  4 18:56:12 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:12 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:12 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:12 poulenc kernel: aio/0         S 0000000000478ce0     0 
  297      2
Nov  4 18:56:12 poulenc kernel: Call Trace:
Nov  4 18:56:12 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:12 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:12 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:12 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:12 poulenc kernel: aio/1         S 0000000000478ce0     0 
  298      2
Nov  4 18:56:12 poulenc kernel: Call Trace:
Nov  4 18:56:12 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:13 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:13 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:13 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:13 poulenc kernel: aio/2         S 0000000000478ce0     0 
  299      2
Nov  4 18:56:13 poulenc kernel: Call Trace:
Nov  4 18:56:13 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:13 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:13 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:13 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:13 poulenc kernel: aio/3         S 0000000000478ce0     0 
  300      2
Nov  4 18:56:13 poulenc kernel: Call Trace:
Nov  4 18:56:13 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:13 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:13 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:13 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:13 poulenc kernel: aio/4         S 0000000000478ce0     0 
  301      2
Nov  4 18:56:13 poulenc kernel: Call Trace:
Nov  4 18:56:13 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:13 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:13 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:13 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:13 poulenc kernel: aio/5         S 0000000000478ce0     0 
  302      2
Nov  4 18:56:13 poulenc kernel: Call Trace:
Nov  4 18:56:13 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:13 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:13 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:13 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:13 poulenc kernel: aio/6         S 0000000000478ce0     0 
  303      2
Nov  4 18:56:13 poulenc kernel: Call Trace:
Nov  4 18:56:13 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:13 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:13 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:13 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:13 poulenc kernel: aio/7         S 0000000000478ce0     0 
  304      2
Nov  4 18:56:13 poulenc kernel: Call Trace:
Nov  4 18:56:13 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:13 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:13 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:13 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:14 poulenc kernel: aio/8         S 0000000000478ce0     0 
  305      2
Nov  4 18:56:14 poulenc kernel: Call Trace:
Nov  4 18:56:14 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:14 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:14 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:14 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:14 poulenc kernel: aio/9         S 0000000000478ce0     0 
  306      2
Nov  4 18:56:14 poulenc kernel: Call Trace:
Nov  4 18:56:14 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:14 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:14 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:14 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:14 poulenc kernel: aio/10        S 0000000000478ce0     0 
  307      2
Nov  4 18:56:14 poulenc kernel: Call Trace:
Nov  4 18:56:14 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:14 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:14 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:14 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:14 poulenc kernel: aio/11        S 0000000000478ce0     0 
  308      2
Nov  4 18:56:14 poulenc kernel: Call Trace:
Nov  4 18:56:14 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:14 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:14 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:14 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:14 poulenc kernel: aio/12        S 0000000000478ce0     0 
  309      2
Nov  4 18:56:14 poulenc kernel: Call Trace:
Nov  4 18:56:15 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:15 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:15 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:15 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:15 poulenc kernel: aio/13        S 0000000000478ce0     0 
  310      2
Nov  4 18:56:15 poulenc kernel: Call Trace:
Nov  4 18:56:15 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:15 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:15 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:15 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:15 poulenc kernel: aio/14        S 0000000000478ce0     0 
  311      2
Nov  4 18:56:15 poulenc kernel: Call Trace:
Nov  4 18:56:15 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:15 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:15 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:15 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:15 poulenc kernel: aio/15        S 0000000000478ce0     0 
  312      2
Nov  4 18:56:15 poulenc kernel: Call Trace:
Nov  4 18:56:15 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:15 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:15 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:15 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:15 poulenc kernel: aio/16        S 0000000000478ce0     0 
  313      2
Nov  4 18:56:15 poulenc kernel: Call Trace:
Nov  4 18:56:15 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:15 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:15 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:15 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:15 poulenc kernel: aio/17        S 0000000000478ce0     0 
  314      2
Nov  4 18:56:15 poulenc kernel: Call Trace:
Nov  4 18:56:15 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:15 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:15 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:15 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:15 poulenc kernel: aio/18        S 0000000000478ce0     0 
  315      2
Nov  4 18:56:15 poulenc kernel: Call Trace:
Nov  4 18:56:15 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:15 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:15 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:16 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:16 poulenc kernel: aio/19        S 0000000000478ce0     0 
  316      2
Nov  4 18:56:16 poulenc kernel: Call Trace:
Nov  4 18:56:16 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:16 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:16 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:16 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:16 poulenc kernel: aio/20        S 0000000000478ce0     0 
  317      2
Nov  4 18:56:16 poulenc kernel: Call Trace:
Nov  4 18:56:16 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:16 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:16 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:16 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:16 poulenc kernel: aio/21        S 0000000000478ce0     0 
  318      2
Nov  4 18:56:16 poulenc kernel: Call Trace:
Nov  4 18:56:16 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:16 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:16 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:16 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:16 poulenc kernel: aio/22        S 0000000000478ce0     0 
  319      2
Nov  4 18:56:16 poulenc kernel: Call Trace:
Nov  4 18:56:16 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:16 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:16 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:16 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:16 poulenc kernel: aio/23        S 0000000000478ce0     0 
  320      2
Nov  4 18:56:16 poulenc kernel: Call Trace:
Nov  4 18:56:16 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:16 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:16 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:16 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:16 poulenc kernel: scsi_tgtd/0   S 0000000000478ce0     0 
  911      2
Nov  4 18:56:16 poulenc kernel: Call Trace:
Nov  4 18:56:16 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:16 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:16 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:17 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:17 poulenc kernel: scsi_tgtd/1   S 0000000000478ce0     0 
  912      2
Nov  4 18:56:17 poulenc kernel: Call Trace:
Nov  4 18:56:17 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:17 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:17 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:17 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:17 poulenc kernel: scsi_tgtd/2   S 0000000000478ce0     0 
  913      2
Nov  4 18:56:17 poulenc kernel: Call Trace:
Nov  4 18:56:17 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:17 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:17 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:17 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:17 poulenc kernel: scsi_tgtd/3   S 0000000000478ce0     0 
  914      2
Nov  4 18:56:17 poulenc kernel: Call Trace:
Nov  4 18:56:17 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:17 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:17 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:17 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:17 poulenc kernel: scsi_tgtd/4   S 0000000000478ce0     0 
  915      2
Nov  4 18:56:17 poulenc kernel: Call Trace:
Nov  4 18:56:17 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:17 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:17 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:17 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:17 poulenc kernel: scsi_tgtd/5   S 0000000000478ce0     0 
  916      2
Nov  4 18:56:17 poulenc kernel: Call Trace:
Nov  4 18:56:17 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:17 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:17 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:17 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:17 poulenc kernel: scsi_tgtd/6   S 0000000000478ce0     0 
  917      2
Nov  4 18:56:17 poulenc kernel: Call Trace:
Nov  4 18:56:17 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:17 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:17 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:17 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:17 poulenc kernel: scsi_tgtd/7   S 0000000000478ce0     0 
  918      2
Nov  4 18:56:17 poulenc kernel: Call Trace:
Nov  4 18:56:17 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:17 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:17 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:17 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:17 poulenc kernel: scsi_tgtd/8   S 0000000000478ce0     0 
  919      2
Nov  4 18:56:17 poulenc kernel: Call Trace:
Nov  4 18:56:17 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:17 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:17 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:17 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:18 poulenc kernel: scsi_tgtd/9   S 0000000000478ce0     0 
  920      2
Nov  4 18:56:18 poulenc kernel: Call Trace:
Nov  4 18:56:18 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:18 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:18 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:18 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:18 poulenc kernel: scsi_tgtd/10  S 0000000000478ce0     0 
  921      2
Nov  4 18:56:18 poulenc kernel: Call Trace:
Nov  4 18:56:18 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:18 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:18 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:18 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:18 poulenc kernel: scsi_tgtd/11  S 0000000000478ce0     0 
  922      2
Nov  4 18:56:18 poulenc kernel: Call Trace:
Nov  4 18:56:18 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:18 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:18 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:18 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:18 poulenc kernel: scsi_tgtd/12  S 0000000000478ce0     0 
  923      2
Nov  4 18:56:18 poulenc kernel: Call Trace:
Nov  4 18:56:18 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:18 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:18 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:18 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:18 poulenc kernel: scsi_tgtd/13  S 0000000000478ce0     0 
  924      2
Nov  4 18:56:18 poulenc kernel: Call Trace:
Nov  4 18:56:18 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:18 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:18 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:18 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:18 poulenc kernel: scsi_tgtd/14  S 0000000000478ce0     0 
  925      2
Nov  4 18:56:18 poulenc kernel: Call Trace:
Nov  4 18:56:18 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:18 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:18 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:18 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:18 poulenc kernel: scsi_tgtd/15  S 0000000000478ce0     0 
  926      2
Nov  4 18:56:18 poulenc kernel: Call Trace:
Nov  4 18:56:18 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:18 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:18 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:18 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:18 poulenc kernel: scsi_tgtd/16  S 0000000000478ce0     0 
  927      2
Nov  4 18:56:19 poulenc kernel: Call Trace:
Nov  4 18:56:19 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:19 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:19 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:19 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:19 poulenc kernel: scsi_tgtd/17  S 0000000000478ce0     0 
  928      2
Nov  4 18:56:19 poulenc kernel: Call Trace:
Nov  4 18:56:19 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:19 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:19 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:19 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:19 poulenc kernel: scsi_tgtd/18  S 0000000000478ce0     0 
  929      2
Nov  4 18:56:19 poulenc kernel: Call Trace:
Nov  4 18:56:19 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:19 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:19 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:19 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:19 poulenc kernel: scsi_tgtd/19  S 0000000000478ce0     0 
  930      2
Nov  4 18:56:19 poulenc kernel: Call Trace:
Nov  4 18:56:19 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:19 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:19 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:19 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:19 poulenc kernel: scsi_tgtd/20  S 0000000000478ce0     0 
  931      2
Nov  4 18:56:19 poulenc kernel: Call Trace:
Nov  4 18:56:19 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:19 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:19 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:19 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:19 poulenc kernel: scsi_tgtd/21  S 0000000000478ce0     0 
  932      2
Nov  4 18:56:19 poulenc kernel: Call Trace:
Nov  4 18:56:19 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:19 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:19 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:19 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:19 poulenc kernel: scsi_tgtd/22  S 0000000000478ce0     0 
  933      2
Nov  4 18:56:19 poulenc kernel: Call Trace:
Nov  4 18:56:20 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:20 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:20 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:20 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:20 poulenc kernel: scsi_tgtd/23  S 0000000000478ce0     0 
  934      2
Nov  4 18:56:20 poulenc kernel: Call Trace:
Nov  4 18:56:20 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:20 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:20 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:20 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:20 poulenc kernel: scsi_eh_0     S 0000000000478ce0     0 
  947      2
Nov  4 18:56:20 poulenc kernel: Call Trace:
Nov  4 18:56:20 poulenc kernel:  [00000000005ae0a0] 
scsi_error_handler+0x48/0x5a0
Nov  4 18:56:20 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:20 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:20 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:20 poulenc kernel: md0_raid1     S 00000000005f2ee8     0 
  991      2
Nov  4 18:56:20 poulenc kernel: Call Trace:
Nov  4 18:56:20 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:20 poulenc kernel:  [00000000005f2ee8] md_thread+0xf0/0x140
Nov  4 18:56:20 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:20 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:20 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:20 poulenc kernel: kjournald     S 0000000000478ce0     0 
  993      2
Nov  4 18:56:20 poulenc kernel: Call Trace:
Nov  4 18:56:20 poulenc kernel:  [000000000052da18] kjournald+0x1c0/0x1e0
Nov  4 18:56:20 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:20 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:20 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:20 poulenc kernel: udevd         S 00000000004c7d68     0 
1091      1
Nov  4 18:56:20 poulenc kernel: Call Trace:
Nov  4 18:56:20 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:20 poulenc kernel:  [00000000004c7d68] do_select+0x3d0/0x420
Nov  4 18:56:20 poulenc kernel:  [00000000004eccb8] 
compat_core_sys_select+0x160/0x200
Nov  4 18:56:20 poulenc kernel:  [00000000004eeee4] 
compat_sys_select+0x2c/0x1a0
Nov  4 18:56:20 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:20 poulenc kernel:  [0000000000013590] 0x13598
Nov  4 18:56:20 poulenc kernel: scsi_eh_1     S 0000000000478ce0     0 
1985      2
Nov  4 18:56:20 poulenc kernel: Call Trace:
Nov  4 18:56:20 poulenc kernel:  [00000000005ae0a0] 
scsi_error_handler+0x48/0x5a0
Nov  4 18:56:20 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:20 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:20 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:20 poulenc kernel: scsi_eh_2     S 0000000000478ce0     0 
2093      2
Nov  4 18:56:20 poulenc kernel: Call Trace:
Nov  4 18:56:21 poulenc kernel:  [00000000005ae0a0] 
scsi_error_handler+0x48/0x5a0
Nov  4 18:56:21 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:21 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:21 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:21 poulenc kernel: ksnapd        S 0000000000478ce0     0 
2718      2
Nov  4 18:56:21 poulenc kernel: Call Trace:
Nov  4 18:56:21 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:21 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:21 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:21 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:21 poulenc kernel: md6_raid1     S 00000000005f2ee8     0 
2731      2
Nov  4 18:56:21 poulenc kernel: Call Trace:
Nov  4 18:56:21 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:21 poulenc kernel:  [00000000005f2ee8] md_thread+0xf0/0x140
Nov  4 18:56:21 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:21 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:21 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:21 poulenc kernel: md1_raid1     S 00000000005f2ee8     0 
2748      2
Nov  4 18:56:21 poulenc kernel: Call Trace:
Nov  4 18:56:21 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:21 poulenc kernel:  [00000000005f2ee8] md_thread+0xf0/0x140
Nov  4 18:56:21 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:21 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:21 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:21 poulenc kernel: md2_raid1     S 00000000005f2ee8     0 
2753      2
Nov  4 18:56:21 poulenc kernel: Call Trace:
Nov  4 18:56:21 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:21 poulenc kernel:  [00000000005f2ee8] md_thread+0xf0/0x140
Nov  4 18:56:21 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:21 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:21 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:21 poulenc kernel: md3_raid1     S 00000000005f2ee8     0 
2758      2
Nov  4 18:56:21 poulenc kernel: Call Trace:
Nov  4 18:56:21 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:21 poulenc kernel:  [00000000005f2ee8] md_thread+0xf0/0x140
Nov  4 18:56:21 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:21 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:21 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:22 poulenc kernel: md4_raid1     S 00000000005f2ee8     0 
2763      2
Nov  4 18:56:22 poulenc kernel: Call Trace:
Nov  4 18:56:22 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:22 poulenc kernel:  [00000000005f2ee8] md_thread+0xf0/0x140
Nov  4 18:56:22 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:22 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:22 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:22 poulenc kernel: md5_raid1     S 00000000005f2ee8     0 
2768      2
Nov  4 18:56:22 poulenc kernel: Call Trace:
Nov  4 18:56:22 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:22 poulenc kernel:  [00000000005f2ee8] md_thread+0xf0/0x140
Nov  4 18:56:22 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:22 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:22 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:22 poulenc kernel: kjournald     S 0000000000478ce0     0 
2857      2
Nov  4 18:56:22 poulenc kernel: Call Trace:
Nov  4 18:56:22 poulenc kernel:  [000000000052da18] kjournald+0x1c0/0x1e0
Nov  4 18:56:22 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:22 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:22 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:22 poulenc kernel: kjournald     S 0000000000478ce0     0 
2870      2
Nov  4 18:56:22 poulenc kernel: Call Trace:
Nov  4 18:56:22 poulenc kernel:  [000000000052da18] kjournald+0x1c0/0x1e0
Nov  4 18:56:22 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:22 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:22 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:22 poulenc kernel: kjournald     S 0000000000478ce0     0 
2871      2
Nov  4 18:56:22 poulenc kernel: Call Trace:
Nov  4 18:56:22 poulenc kernel:  [000000000052da18] kjournald+0x1c0/0x1e0
Nov  4 18:56:22 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:22 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:22 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:22 poulenc kernel: kjournald     S 0000000000478ce0     0 
2872      2
Nov  4 18:56:22 poulenc kernel: Call Trace:
Nov  4 18:56:22 poulenc kernel:  [000000000052da18] kjournald+0x1c0/0x1e0
Nov  4 18:56:22 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:22 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:22 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:23 poulenc kernel: kjournald     S 0000000000478ce0     0 
2873      2
Nov  4 18:56:23 poulenc kernel: Call Trace:
Nov  4 18:56:23 poulenc kernel:  [000000000052da18] kjournald+0x1c0/0x1e0
Nov  4 18:56:23 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:23 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:23 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:23 poulenc kernel: portmap       S 00000000004c776c     0 
2994      1
Nov  4 18:56:23 poulenc kernel: Call Trace:
Nov  4 18:56:23 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:56:23 poulenc kernel:  [00000000004c776c] do_sys_poll+0x234/0x400
Nov  4 18:56:23 poulenc kernel:  [00000000004c7960] sys_poll+0x28/0x60
Nov  4 18:56:23 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:23 poulenc kernel:  [00000000700025b8] 0x700025c0
Nov  4 18:56:23 poulenc kernel: rpc.statd     S 00000000004c7d68     0 
3006      1
Nov  4 18:56:23 poulenc kernel: Call Trace:
Nov  4 18:56:23 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:23 poulenc kernel:  [00000000004c7d68] do_select+0x3d0/0x420
Nov  4 18:56:23 poulenc kernel:  [00000000004eccb8] 
compat_core_sys_select+0x160/0x200
Nov  4 18:56:23 poulenc kernel:  [00000000004eeee4] 
compat_sys_select+0x2c/0x1a0
Nov  4 18:56:23 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:23 poulenc kernel:  [00000000000143f4] 0x143fc
Nov  4 18:56:23 poulenc kernel: rpciod/0      S 0000000000478ce0     0 
3035      2
Nov  4 18:56:23 poulenc kernel: Call Trace:
Nov  4 18:56:23 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:23 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:23 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:23 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:23 poulenc kernel: rpciod/1      S 0000000000478ce0     0 
3036      2
Nov  4 18:56:23 poulenc kernel: Call Trace:
Nov  4 18:56:23 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:23 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:23 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:23 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:23 poulenc kernel: rpciod/2      S 0000000000478ce0     0 
3037      2
Nov  4 18:56:23 poulenc kernel: Call Trace:
Nov  4 18:56:23 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:23 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:23 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:23 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:23 poulenc kernel: rpciod/3      S 0000000000478ce0     0 
3038      2
Nov  4 18:56:23 poulenc kernel: Call Trace:
Nov  4 18:56:23 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:23 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:23 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:23 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:24 poulenc kernel: rpciod/4      S 0000000000478ce0     0 
3039      2
Nov  4 18:56:24 poulenc kernel: Call Trace:
Nov  4 18:56:24 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:24 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:24 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:24 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:24 poulenc kernel: rpciod/5      S 0000000000478ce0     0 
3040      2
Nov  4 18:56:24 poulenc kernel: Call Trace:
Nov  4 18:56:24 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:24 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:24 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:24 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:24 poulenc kernel: rpciod/6      S 0000000000478ce0     0 
3041      2
Nov  4 18:56:24 poulenc kernel: Call Trace:
Nov  4 18:56:24 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:24 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:24 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:24 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:24 poulenc kernel: rpciod/7      S 0000000000478ce0     0 
3042      2
Nov  4 18:56:24 poulenc kernel: Call Trace:
Nov  4 18:56:24 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:24 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:24 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:24 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:24 poulenc kernel: rpciod/8      S 0000000000478ce0     0 
3043      2
Nov  4 18:56:24 poulenc kernel: Call Trace:
Nov  4 18:56:24 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:24 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:24 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:24 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:24 poulenc kernel: rpciod/9      S 0000000000478ce0     0 
3044      2
Nov  4 18:56:24 poulenc kernel: Call Trace:
Nov  4 18:56:24 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:24 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:24 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:24 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:24 poulenc kernel: rpciod/10     S 0000000000478ce0     0 
3045      2
Nov  4 18:56:24 poulenc kernel: Call Trace:
Nov  4 18:56:24 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:24 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:24 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:24 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:24 poulenc kernel: rpciod/11     S 0000000000478ce0     0 
3046      2
Nov  4 18:56:24 poulenc kernel: Call Trace:
Nov  4 18:56:24 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:24 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:24 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:24 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:24 poulenc kernel: rpciod/12     S 0000000000478ce0     0 
3047      2
Nov  4 18:56:24 poulenc kernel: Call Trace:
Nov  4 18:56:25 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:25 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:25 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:25 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:25 poulenc kernel: rpciod/13     S 0000000000478ce0     0 
3048      2
Nov  4 18:56:25 poulenc kernel: Call Trace:
Nov  4 18:56:25 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:25 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:25 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:25 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:25 poulenc kernel: rpciod/14     S 0000000000478ce0     0 
3049      2
Nov  4 18:56:25 poulenc kernel: Call Trace:
Nov  4 18:56:25 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:25 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:25 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:25 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:25 poulenc kernel: rpciod/15     S 0000000000478ce0     0 
3050      2
Nov  4 18:56:25 poulenc kernel: Call Trace:
Nov  4 18:56:25 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:25 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:25 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:25 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:25 poulenc kernel: rpciod/16     S 0000000000478ce0     0 
3051      2
Nov  4 18:56:25 poulenc kernel: Call Trace:
Nov  4 18:56:25 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:25 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:25 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:25 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:25 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:25 poulenc kernel: rpciod/17     S 0000000000478ce0     0 
3052      2
Nov  4 18:56:25 poulenc kernel: Call Trace:
Nov  4 18:56:25 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:25 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:25 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:25 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:25 poulenc kernel: rpciod/18     S 0000000000478ce0     0 
3053      2
Nov  4 18:56:25 poulenc kernel: Call Trace:
Nov  4 18:56:25 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:25 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:25 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:25 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:25 poulenc kernel: rpciod/19     S 0000000000478ce0     0 
3054      2
Nov  4 18:56:25 poulenc kernel: Call Trace:
Nov  4 18:56:25 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:25 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:25 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:25 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:26 poulenc kernel: rpciod/20     S 0000000000478ce0     0 
3055      2
Nov  4 18:56:26 poulenc kernel: Call Trace:
Nov  4 18:56:26 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:26 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:26 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:26 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:26 poulenc kernel: rpciod/21     S 0000000000478ce0     0 
3056      2
Nov  4 18:56:26 poulenc kernel: Call Trace:
Nov  4 18:56:26 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:26 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:26 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:26 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:26 poulenc kernel: rpciod/22     S 0000000000478ce0     0 
3057      2
Nov  4 18:56:26 poulenc kernel: Call Trace:
Nov  4 18:56:26 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:26 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:26 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:26 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:26 poulenc kernel: rpciod/23     S 0000000000478ce0     0 
3058      2
Nov  4 18:56:26 poulenc kernel: Call Trace:
Nov  4 18:56:26 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:26 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:26 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:26 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:26 poulenc kernel: rpc.idmapd    S 00000000004ea8fc     0 
3139      1
Nov  4 18:56:26 poulenc kernel: Call Trace:
Nov  4 18:56:26 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:26 poulenc kernel:  [00000000004ea8fc] 
sys_epoll_wait+0x144/0x480
Nov  4 18:56:26 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:26 poulenc kernel:  [00000000f7f2515c] 0xf7f25164
Nov  4 18:56:26 poulenc kernel: syslogd       S 00000000004c7d68     0 
3244      1
Nov  4 18:56:26 poulenc kernel: Call Trace:
Nov  4 18:56:26 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:26 poulenc kernel:  [00000000004c7d68] do_select+0x3d0/0x420
Nov  4 18:56:26 poulenc kernel:  [00000000004eccb8] 
compat_core_sys_select+0x160/0x200
Nov  4 18:56:26 poulenc kernel:  [00000000004eeee4] 
compat_sys_select+0x2c/0x1a0
Nov  4 18:56:26 poulenc kernel:  [000000000002a32c] 0x2a334
Nov  4 18:56:26 poulenc kernel:  [0000000000014910] 0x14918
Nov  4 18:56:26 poulenc kernel: klogd         R  running task        0 
3254      1
Nov  4 18:56:26 poulenc kernel: named         S 00000000004061d4     0 
3270      1
Nov  4 18:56:26 poulenc kernel: Call Trace:
Nov  4 18:56:26 poulenc kernel:  [000000000048b6d0] 
compat_sys_rt_sigsuspend+0x98/0xe0
Nov  4 18:56:26 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:26 poulenc kernel:  [00000000f79bb0b0] 0xf79bb0b8
Nov  4 18:56:26 poulenc kernel: named         S 00000000004833bc     0 
3271      1
Nov  4 18:56:26 poulenc kernel: Call Trace:
Nov  4 18:56:26 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:27 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:27 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:27 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:27 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:27 poulenc kernel: named         S 00000000004833bc     0 
3272      1
Nov  4 18:56:27 poulenc kernel: Call Trace:
Nov  4 18:56:27 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:27 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:27 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:27 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:27 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:27 poulenc kernel: named         S 00000000004833bc     0 
3273      1
Nov  4 18:56:27 poulenc kernel: Call Trace:
Nov  4 18:56:27 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:27 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:27 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:27 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:27 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:27 poulenc kernel: named         S 00000000004833bc     0 
3274      1
Nov  4 18:56:27 poulenc kernel: Call Trace:
Nov  4 18:56:27 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:27 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:27 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:27 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:27 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:27 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:27 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:27 poulenc kernel: named         S 00000000004833bc     0 
3275      1
Nov  4 18:56:27 poulenc kernel: Call Trace:
Nov  4 18:56:27 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:27 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:27 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:27 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:27 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:27 poulenc kernel: named         S 00000000004833bc     0 
3276      1
Nov  4 18:56:27 poulenc kernel: Call Trace:
Nov  4 18:56:27 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:27 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:27 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:27 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:27 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:27 poulenc kernel: named         S 00000000004833bc     0 
3277      1
Nov  4 18:56:27 poulenc kernel: Call Trace:
Nov  4 18:56:27 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:28 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:28 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:28 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:28 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:28 poulenc kernel: named         S 00000000004833bc     0 
3278      1
Nov  4 18:56:28 poulenc kernel: Call Trace:
Nov  4 18:56:28 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:28 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:28 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:28 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:28 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:28 poulenc kernel: named         S 00000000004833bc     0 
3279      1
Nov  4 18:56:28 poulenc kernel: Call Trace:
Nov  4 18:56:28 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:28 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:28 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:28 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:28 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:28 poulenc kernel: named         S 00000000004833bc     0 
3280      1
Nov  4 18:56:28 poulenc kernel: Call Trace:
Nov  4 18:56:28 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:28 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:28 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:28 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:28 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:28 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:28 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:28 poulenc kernel: named         S 00000000004833bc     0 
3281      1
Nov  4 18:56:28 poulenc kernel: Call Trace:
Nov  4 18:56:28 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:28 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:28 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:28 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:28 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:28 poulenc kernel: named         S 00000000004833bc     0 
3282      1
Nov  4 18:56:28 poulenc kernel: Call Trace:
Nov  4 18:56:28 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:28 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:28 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:29 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:29 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:29 poulenc kernel: named         S 00000000004833bc     0 
3283      1
Nov  4 18:56:29 poulenc kernel: Call Trace:
Nov  4 18:56:29 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:29 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:29 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:29 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:29 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:29 poulenc kernel: named         S 00000000004833bc     0 
3284      1
Nov  4 18:56:29 poulenc kernel: Call Trace:
Nov  4 18:56:29 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:29 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:29 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:29 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:29 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:29 poulenc kernel: named         S 00000000004833bc     0 
3285      1
Nov  4 18:56:29 poulenc kernel: Call Trace:
Nov  4 18:56:29 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:29 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:29 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:29 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:29 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:29 poulenc kernel: named         S 00000000004833bc     0 
3286      1
Nov  4 18:56:29 poulenc kernel: Call Trace:
Nov  4 18:56:29 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:29 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:29 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:29 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:29 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:29 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:29 poulenc kernel: named         S 00000000004833bc     0 
3287      1
Nov  4 18:56:29 poulenc kernel: Call Trace:
Nov  4 18:56:29 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:29 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:29 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:29 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:29 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:29 poulenc kernel: named         S 00000000004833bc     0 
3288      1
Nov  4 18:56:29 poulenc kernel: Call Trace:
Nov  4 18:56:29 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:29 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:29 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:29 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:30 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:30 poulenc kernel: named         S 00000000004833bc     0 
3289      1
Nov  4 18:56:30 poulenc kernel: Call Trace:
Nov  4 18:56:30 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:30 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:30 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:30 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:30 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:30 poulenc kernel: named         S 00000000004833bc     0 
3290      1
Nov  4 18:56:30 poulenc kernel: Call Trace:
Nov  4 18:56:30 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:30 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:30 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:30 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:30 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:30 poulenc kernel: named         S 00000000004833bc     0 
3291      1
Nov  4 18:56:30 poulenc kernel: Call Trace:
Nov  4 18:56:30 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:30 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:30 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:30 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:30 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:30 poulenc kernel: named         S 00000000004833bc     0 
3292      1
Nov  4 18:56:30 poulenc kernel: Call Trace:
Nov  4 18:56:30 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:30 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:30 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:30 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:30 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:30 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:30 poulenc kernel: named         S 00000000004833bc     0 
3293      1
Nov  4 18:56:30 poulenc kernel: Call Trace:
Nov  4 18:56:30 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:30 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:30 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:30 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:30 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:30 poulenc kernel: named         S 00000000004833bc     0 
3294      1
Nov  4 18:56:30 poulenc kernel: Call Trace:
Nov  4 18:56:30 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:30 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:31 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:31 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:31 poulenc kernel:  [00000000f7afb2e4] 0xf7afb2ec
Nov  4 18:56:31 poulenc kernel: named         S 00000000004833bc     0 
3295      1
Nov  4 18:56:31 poulenc kernel: Call Trace:
Nov  4 18:56:31 poulenc kernel:  [0000000000482e1c] futex_wait+0x1c4/0x2c0
Nov  4 18:56:31 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:31 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:31 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:31 poulenc kernel:  [00000000f7afb638] 0xf7afb640
Nov  4 18:56:31 poulenc kernel: named         S 00000000004c7d68     0 
3296      1
Nov  4 18:56:31 poulenc kernel: Call Trace:
Nov  4 18:56:31 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:31 poulenc kernel:  [00000000004c7d68] do_select+0x3d0/0x420
Nov  4 18:56:31 poulenc kernel:  [00000000004eccb8] 
compat_core_sys_select+0x160/0x200
Nov  4 18:56:31 poulenc kernel:  [00000000004eeee4] 
compat_sys_select+0x2c/0x1a0
Nov  4 18:56:31 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:31 poulenc kernel:  [00000000f7a60070] 0xf7a60078
Nov  4 18:56:31 poulenc kernel: rpc.bootparam S 00000000004c776c     0 
3518      1
Nov  4 18:56:31 poulenc kernel: Call Trace:
Nov  4 18:56:31 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:56:31 poulenc kernel:  [00000000004c776c] do_sys_poll+0x234/0x400
Nov  4 18:56:31 poulenc kernel:  [00000000004c7960] sys_poll+0x28/0x60
Nov  4 18:56:31 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:31 poulenc kernel:  [0000000000011bbc] 0x11bc4
Nov  4 18:56:31 poulenc kernel: hddtemp       S 00000000004c7d68     0 
3576      1
Nov  4 18:56:31 poulenc kernel: Call Trace:
Nov  4 18:56:31 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:31 poulenc kernel:  [00000000004c7d68] do_select+0x3d0/0x420
Nov  4 18:56:31 poulenc kernel:  [00000000004eccb8] 
compat_core_sys_select+0x160/0x200
Nov  4 18:56:31 poulenc kernel:  [00000000004eeee4] 
compat_sys_select+0x2c/0x1a0
Nov  4 18:56:31 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:31 poulenc kernel:  [000000000001223c] 0x12244
Nov  4 18:56:31 poulenc kernel: lockd         S 000000001008aff4     0 
3681      2
Nov  4 18:56:31 poulenc kernel: Call Trace:
Nov  4 18:56:31 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:31 poulenc kernel:  [000000001008aff4] svc_recv+0x21c/0x4e0 
[sunrpc]
Nov  4 18:56:31 poulenc kernel:  [00000000100baef8] lockd+0x120/0x300 
[lockd]
Nov  4 18:56:31 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:32 poulenc kernel:  [0000000010087e10] 
__svc_create_thread+0x118/0x220 [sunrpc]
Nov  4 18:56:32 poulenc kernel: nfsd4         S 0000000000478ce0     0 
3682      2
Nov  4 18:56:32 poulenc kernel: Call Trace:
Nov  4 18:56:32 poulenc kernel:  [0000000000474c5c] worker_thread+0xa4/0xe0
Nov  4 18:56:32 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:32 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:32 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:32 poulenc kernel: nfsd          S 000000001008aff4     0 
3683      2
Nov  4 18:56:32 poulenc kernel: Call Trace:
Nov  4 18:56:32 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:56:32 poulenc kernel:  [000000001008aff4] svc_recv+0x21c/0x4e0 
[sunrpc]
Nov  4 18:56:32 poulenc kernel:  [0000000010150aac] nfsd+0xb4/0x300 [nfsd]
Nov  4 18:56:32 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:32 poulenc kernel:  [0000000010087e10] 
__svc_create_thread+0x118/0x220 [sunrpc]
Nov  4 18:56:32 poulenc kernel: rpc.mountd    S 00000000004c7d68     0 
3694      1
Nov  4 18:56:32 poulenc kernel: Call Trace:
Nov  4 18:56:32 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:32 poulenc kernel:  [00000000004c7d68] do_select+0x3d0/0x420
Nov  4 18:56:32 poulenc kernel:  [00000000004eccb8] 
compat_core_sys_select+0x160/0x200
Nov  4 18:56:32 poulenc kernel:  [00000000004eeee4] 
compat_sys_select+0x2c/0x1a0
Nov  4 18:56:32 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:32 poulenc kernel:  [0000000000016708] 0x16710
Nov  4 18:56:32 poulenc kernel: iscsid        S 000000000048c0d4     0 
3785      1
Nov  4 18:56:32 poulenc kernel: Call Trace:
Nov  4 18:56:32 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:56:32 poulenc kernel:  [000000000048c0d4] 
compat_sys_nanosleep+0x7c/0xe0
Nov  4 18:56:32 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:32 poulenc kernel:  [00000000f7ec168c] 0xf7ec1694
Nov  4 18:56:32 poulenc kernel: iscsid        S 00000000004c776c     0 
3786      1
Nov  4 18:56:32 poulenc kernel: Call Trace:
Nov  4 18:56:32 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:56:32 poulenc kernel:  [00000000004c776c] do_sys_poll+0x234/0x400
Nov  4 18:56:32 poulenc kernel:  [00000000004c7960] sys_poll+0x28/0x60
Nov  4 18:56:32 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:32 poulenc kernel:  [0000000000045bf0] 0x45bf8
Nov  4 18:56:32 poulenc kernel: inetd         S 00000000004c7d68     0 
3802      1
Nov  4 18:56:32 poulenc kernel: Call Trace:
Nov  4 18:56:32 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:32 poulenc kernel:  [00000000004c7d68] do_select+0x3d0/0x420
Nov  4 18:56:32 poulenc kernel:  [00000000004eccb8] 
compat_core_sys_select+0x160/0x200
Nov  4 18:56:32 poulenc kernel:  [00000000004eeee4] 
compat_sys_select+0x2c/0x1a0
Nov  4 18:56:32 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:32 poulenc kernel:  [00000000000155d8] 0x155e0
Nov  4 18:56:32 poulenc kernel: rarpd         S 00000000004c776c     0 
3809      1
Nov  4 18:56:32 poulenc kernel: Call Trace:
Nov  4 18:56:32 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:56:33 poulenc kernel:  [00000000004c776c] do_sys_poll+0x234/0x400
Nov  4 18:56:33 poulenc kernel:  [00000000004c7960] sys_poll+0x28/0x60
Nov  4 18:56:33 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:33 poulenc kernel:  [00000000f7da7234] 0xf7da723c
Nov  4 18:56:33 poulenc kernel: smartd        S 000000000048c0d4     0 
3814      1
Nov  4 18:56:33 poulenc kernel: Call Trace:
Nov  4 18:56:33 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:56:33 poulenc kernel:  [000000000048c0d4] 
compat_sys_nanosleep+0x7c/0xe0
Nov  4 18:56:33 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:33 poulenc kernel:  [00000000f7c5d68c] 0xf7c5d694
Nov  4 18:56:33 poulenc kernel: snmpd         S 00000000004c7d68     0 
3823      1
Nov  4 18:56:33 poulenc kernel: Call Trace:
Nov  4 18:56:33 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:56:33 poulenc kernel:  [00000000004c7d68] do_select+0x3d0/0x420
Nov  4 18:56:33 poulenc kernel:  [00000000004eccb8] 
compat_core_sys_select+0x160/0x200
Nov  4 18:56:33 poulenc kernel:  [00000000004eef74] 
compat_sys_select+0xbc/0x1a0
Nov  4 18:56:33 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:33 poulenc kernel:  [0000000000012e64] 0x12e6c
Nov  4 18:56:33 poulenc kernel: sendmail-mta  S 00000000004c7d68     0 
3880      1
Nov  4 18:56:33 poulenc kernel: Call Trace:
Nov  4 18:56:33 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:56:33 poulenc kernel:  [00000000004c7d68] do_select+0x3d0/0x420
Nov  4 18:56:33 poulenc kernel:  [00000000004eccb8] 
compat_core_sys_select+0x160/0x200
Nov  4 18:56:33 poulenc kernel:  [00000000004eef74] 
compat_sys_select+0xbc/0x1a0
Nov  4 18:56:33 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:33 poulenc kernel:  [000000007003b1d8] 0x7003b1e0
Nov  4 18:56:33 poulenc kernel: ntpd          S 00000000004c7d68     0 
3909      1
Nov  4 18:56:33 poulenc kernel: Call Trace:
Nov  4 18:56:33 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:33 poulenc kernel:  [00000000004c7d68] do_select+0x3d0/0x420
Nov  4 18:56:33 poulenc kernel:  [00000000004eccb8] 
compat_core_sys_select+0x160/0x200
Nov  4 18:56:33 poulenc kernel:  [00000000004eeee4] 
compat_sys_select+0x2c/0x1a0
Nov  4 18:56:33 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:33 poulenc kernel:  [000000000001aea8] 0x1aeb0
Nov  4 18:56:33 poulenc kernel: mdadm         S 00000000004c7d68     0 
3922      1
Nov  4 18:56:33 poulenc kernel: Call Trace:
Nov  4 18:56:33 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:56:33 poulenc kernel:  [00000000004c7d68] do_select+0x3d0/0x420
Nov  4 18:56:33 poulenc kernel:  [00000000004eccb8] 
compat_core_sys_select+0x160/0x200
Nov  4 18:56:33 poulenc kernel:  [00000000004eef74] 
compat_sys_select+0xbc/0x1a0
Nov  4 18:56:33 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:33 poulenc kernel:  [0000000000016cc0] 0x16cc8
Nov  4 18:56:33 poulenc kernel: rsync         S 00000000004c7d68     0 
3943      1
Nov  4 18:56:34 poulenc kernel: Call Trace:
Nov  4 18:56:34 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:34 poulenc kernel:  [00000000004c7d68] do_select+0x3d0/0x420
Nov  4 18:56:34 poulenc kernel:  [00000000004eccb8] 
compat_core_sys_select+0x160/0x200
Nov  4 18:56:34 poulenc kernel:  [00000000004eeee4] 
compat_sys_select+0x2c/0x1a0
Nov  4 18:56:34 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:34 poulenc kernel:  [0000000000035418] 0x35420
Nov  4 18:56:34 poulenc kernel: atd           S 000000000048c0d4     0 
3959      1
Nov  4 18:56:34 poulenc kernel: Call Trace:
Nov  4 18:56:34 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:56:34 poulenc kernel:  [000000000048c0d4] 
compat_sys_nanosleep+0x7c/0xe0
Nov  4 18:56:34 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:34 poulenc kernel:  [00000000f7e6d68c] 0xf7e6d694
Nov  4 18:56:34 poulenc kernel: cron          S 000000000048c0d4     0 
3966      1
Nov  4 18:56:34 poulenc kernel: Call Trace:
Nov  4 18:56:34 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:56:34 poulenc kernel:  [000000000048c0d4] 
compat_sys_nanosleep+0x7c/0xe0
Nov  4 18:56:34 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:34 poulenc kernel:  [00000000f7df968c] 0xf7df9694
Nov  4 18:56:34 poulenc kernel: watchdog      S 000000000048c0d4     0 
3976      1
Nov  4 18:56:34 poulenc kernel: Call Trace:
Nov  4 18:56:34 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:56:34 poulenc kernel:  [000000000048c0d4] 
compat_sys_nanosleep+0x7c/0xe0
Nov  4 18:56:34 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:34 poulenc kernel:  [00000000f7e4568c] 0xf7e45694
Nov  4 18:56:34 poulenc kernel: apache2       S 00000000004c7d68     0 
3994      1
Nov  4 18:56:34 poulenc kernel: Call Trace:
Nov  4 18:56:34 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:56:34 poulenc kernel:  [00000000004c7d68] do_select+0x3d0/0x420
Nov  4 18:56:34 poulenc kernel:  [00000000004eccb8] 
compat_core_sys_select+0x160/0x200
Nov  4 18:56:34 poulenc kernel:  [00000000004eef74] 
compat_sys_select+0xbc/0x1a0
Nov  4 18:56:34 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:34 poulenc kernel:  [00000000f7be6c74] 0xf7be6c7c
Nov  4 18:56:34 poulenc kernel: fail2ban-serv S 00000000004c7d68     0 
4011      1
Nov  4 18:56:34 poulenc kernel: Call Trace:
Nov  4 18:56:34 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:56:34 poulenc kernel:  [00000000004c7d68] do_select+0x3d0/0x420
Nov  4 18:56:34 poulenc kernel:  [00000000004eccb8] 
compat_core_sys_select+0x160/0x200
Nov  4 18:56:34 poulenc kernel:  [00000000004eef74] 
compat_sys_select+0xbc/0x1a0
Nov  4 18:56:34 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:34 poulenc kernel:  [00000000f7dc0070] 0xf7dc0078
Nov  4 18:56:34 poulenc kernel: fail2ban-serv S 00000000004c776c     0 
4012      1
Nov  4 18:56:34 poulenc kernel: Call Trace:
Nov  4 18:56:34 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:56:34 poulenc kernel:  [00000000004c776c] do_sys_poll+0x234/0x400
Nov  4 18:56:34 poulenc kernel:  [00000000004c7960] sys_poll+0x28/0x60
Nov  4 18:56:34 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:34 poulenc kernel:  [00000000f7dbd0d4] 0xf7dbd0dc
Nov  4 18:56:34 poulenc kernel: fail2ban-serv S 00000000004c7d68     0 
4038      1
Nov  4 18:56:34 poulenc kernel: Call Trace:
Nov  4 18:56:34 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:56:34 poulenc kernel:  [00000000004c7d68] do_select+0x3d0/0x420
Nov  4 18:56:35 poulenc kernel:  [00000000004eccb8] 
compat_core_sys_select+0x160/0x200
Nov  4 18:56:35 poulenc kernel:  [00000000004eef74] 
compat_sys_select+0xbc/0x1a0
Nov  4 18:56:35 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:35 poulenc kernel:  [00000000f7dc0070] 0xf7dc0078
Nov  4 18:56:35 poulenc kernel: fail2ban-serv S 00000000004c7d68     0 
4039      1
Nov  4 18:56:35 poulenc kernel: Call Trace:
Nov  4 18:56:35 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:56:35 poulenc kernel:  [00000000004c7d68] do_select+0x3d0/0x420
Nov  4 18:56:35 poulenc kernel:  [00000000004eccb8] 
compat_core_sys_select+0x160/0x200
Nov  4 18:56:35 poulenc kernel:  [00000000004eef74] 
compat_sys_select+0xbc/0x1a0
Nov  4 18:56:35 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:35 poulenc kernel:  [00000000f7dc0070] 0xf7dc0078
Nov  4 18:56:35 poulenc kernel: apache2       S 00000000004ea8fc     0 
4071   3994
Nov  4 18:56:35 poulenc kernel: Call Trace:
Nov  4 18:56:35 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:35 poulenc kernel:  [00000000004ea8fc] 
sys_epoll_wait+0x144/0x480
Nov  4 18:56:35 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:35 poulenc kernel:  [00000000f7be2710] 0xf7be2718
Nov  4 18:56:35 poulenc kernel: apache2       S 00000000004061d4     0 
4072   3994
Nov  4 18:56:35 poulenc kernel: Call Trace:
Nov  4 18:56:35 poulenc kernel:  [00000000005333bc] 
sys_semtimedop+0x564/0x660
Nov  4 18:56:35 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:35 poulenc kernel:  [00000000f7bdaea8] 0xf7bdaeb0
Nov  4 18:56:35 poulenc kernel: apache2       S 00000000004061d4     0 
4073   3994
Nov  4 18:56:35 poulenc kernel: Call Trace:
Nov  4 18:56:35 poulenc kernel:  [00000000005333bc] 
sys_semtimedop+0x564/0x660
Nov  4 18:56:35 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:35 poulenc kernel:  [00000000f7bdaea8] 0xf7bdaeb0
Nov  4 18:56:35 poulenc kernel: apache2       S 00000000004061d4     0 
4074   3994
Nov  4 18:56:35 poulenc kernel: Call Trace:
Nov  4 18:56:35 poulenc kernel:  [00000000005333bc] 
sys_semtimedop+0x564/0x660
Nov  4 18:56:35 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:35 poulenc kernel:  [00000000f7bdaea8] 0xf7bdaeb0
Nov  4 18:56:35 poulenc kernel: apache2       S 00000000004061d4     0 
4075   3994
Nov  4 18:56:35 poulenc kernel: Call Trace:
Nov  4 18:56:35 poulenc kernel:  [00000000005333bc] 
sys_semtimedop+0x564/0x660
Nov  4 18:56:35 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:35 poulenc kernel:  [00000000f7bdaea8] 0xf7bdaeb0
Nov  4 18:56:35 poulenc kernel: login         S 000000000048bda8     0 
4146      1
Nov  4 18:56:35 poulenc kernel: Call Trace:
Nov  4 18:56:35 poulenc kernel:  [00000000004656dc] do_wait+0x264/0xda0
Nov  4 18:56:36 poulenc kernel:  [000000000048bda8] 
compat_sys_wait4+0xb0/0xc0
Nov  4 18:56:36 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:36 poulenc kernel:  [00000000f7df3234] 0xf7df323c
Nov  4 18:56:36 poulenc kernel: bash          R  running task        0 
4173   4146
Nov  4 18:56:36 poulenc kernel: sshd          S 00000000004c7d68     0 
4330      1
Nov  4 18:56:36 poulenc kernel: Call Trace:
Nov  4 18:56:36 poulenc kernel:  [000000000067ec30] 
schedule_timeout+0x78/0xc0
Nov  4 18:56:36 poulenc kernel:  [00000000004c7d68] do_select+0x3d0/0x420
Nov  4 18:56:36 poulenc kernel:  [00000000004eccb8] 
compat_core_sys_select+0x160/0x200
Nov  4 18:56:36 poulenc kernel:  [00000000004eeee4] 
compat_sys_select+0x2c/0x1a0
Nov  4 18:56:36 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:36 poulenc kernel:  [0000000070017e1c] 0x70017e24
Nov  4 18:56:36 poulenc kernel: md_d0_raid5   R  running task        0 
4462      2
Nov  4 18:56:36 poulenc kernel: ietd          S 000000000067dac4     0 
8227      1
Nov  4 18:56:36 poulenc kernel: Call Trace:
Nov  4 18:56:36 poulenc kernel:  [000000000067d9dc] 
__down_interruptible+0xa4/0x1c0
Nov  4 18:56:36 poulenc kernel:  [000000000067dac4] 
__down_interruptible+0x18c/0x1c0
Nov  4 18:56:36 poulenc kernel:  [00000000102204d0] ioctl+0x58/0x5e0 
[iscsi_trgt]
Nov  4 18:56:36 poulenc kernel:  [00000000004f0484] 
compat_sys_ioctl+0x14c/0x460
Nov  4 18:56:36 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:36 poulenc kernel:  [000000000001532c] 0x15334
Nov  4 18:56:36 poulenc kernel: istd1         R  running task        0 
8228      2
Nov  4 18:56:36 poulenc kernel: istiod1       D 00000000102262c8     0 
8229      2
Nov  4 18:56:36 poulenc kernel: Call Trace:
Nov  4 18:56:36 poulenc kernel:  [000000000067e4cc] 
wait_for_completion+0x74/0xe0
Nov  4 18:56:36 poulenc kernel:  [00000000102262c8] 
blockio_make_request+0x1d0/0x24c [iscsi_trgt]
Nov  4 18:56:36 poulenc kernel:  [000000001021a140] tio_write+0x28/0x80 
[iscsi_trgt]
Nov  4 18:56:36 poulenc kernel:  [0000000010223df8] 
build_write_response+0x40/0xe0 [iscsi_trgt]
Nov  4 18:56:36 poulenc kernel:  [000000001021e444] 
send_scsi_rsp+0xc/0x120 [iscsi_trgt]
Nov  4 18:56:36 poulenc kernel:  [0000000010223c30] 
disk_execute_cmnd+0x158/0x220 [iscsi_trgt]
Nov  4 18:56:36 poulenc kernel:  [0000000010220330] 
worker_thread+0x118/0x1a0 [iscsi_trgt]
Nov  4 18:56:36 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:36 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:36 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:36 poulenc kernel: istiod1       D 00000000102262c8     0 
8230      2
Nov  4 18:56:36 poulenc kernel: Call Trace:
Nov  4 18:56:36 poulenc kernel:  [000000000067e4cc] 
wait_for_completion+0x74/0xe0
Nov  4 18:56:36 poulenc kernel:  [00000000102262c8] 
blockio_make_request+0x1d0/0x24c [iscsi_trgt]
Nov  4 18:56:36 poulenc kernel:  [000000001021a140] tio_write+0x28/0x80 
[iscsi_trgt]
Nov  4 18:56:36 poulenc kernel:  [0000000010223df8] 
build_write_response+0x40/0xe0 [iscsi_trgt]
Nov  4 18:56:36 poulenc kernel:  [000000001021e444] 
send_scsi_rsp+0xc/0x120 [iscsi_trgt]
Nov  4 18:56:36 poulenc kernel:  [0000000010223c30] 
disk_execute_cmnd+0x158/0x220 [iscsi_trgt]
Nov  4 18:56:36 poulenc kernel:  [0000000010220330] 
worker_thread+0x118/0x1a0 [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:37 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:37 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:37 poulenc kernel: istiod1       D 00000000102262c8     0 
8231      2
Nov  4 18:56:37 poulenc kernel: Call Trace:
Nov  4 18:56:37 poulenc kernel:  [000000000067e4cc] 
wait_for_completion+0x74/0xe0
Nov  4 18:56:37 poulenc kernel:  [00000000102262c8] 
blockio_make_request+0x1d0/0x24c [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [000000001021a140] tio_write+0x28/0x80 
[iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [0000000010223df8] 
build_write_response+0x40/0xe0 [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [000000001021e444] 
send_scsi_rsp+0xc/0x120 [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [0000000010223c30] 
disk_execute_cmnd+0x158/0x220 [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [0000000010220330] 
worker_thread+0x118/0x1a0 [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:37 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:37 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:37 poulenc kernel: istiod1       D 00000000102262c8     0 
8232      2
Nov  4 18:56:37 poulenc kernel: Call Trace:
Nov  4 18:56:37 poulenc kernel:  [000000000067e4cc] 
wait_for_completion+0x74/0xe0
Nov  4 18:56:37 poulenc kernel:  [00000000102262c8] 
blockio_make_request+0x1d0/0x24c [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [000000001021a140] tio_write+0x28/0x80 
[iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [0000000010223df8] 
build_write_response+0x40/0xe0 [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [000000001021e444] 
send_scsi_rsp+0xc/0x120 [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [0000000010223c30] 
disk_execute_cmnd+0x158/0x220 [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [0000000010220330] 
worker_thread+0x118/0x1a0 [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:37 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:37 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:37 poulenc kernel: istiod1       D 00000000102262c8     0 
8233      2
Nov  4 18:56:37 poulenc kernel: Call Trace:
Nov  4 18:56:37 poulenc kernel:  [000000000067e4cc] 
wait_for_completion+0x74/0xe0
Nov  4 18:56:37 poulenc kernel:  [00000000102262c8] 
blockio_make_request+0x1d0/0x24c [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [000000001021a140] tio_write+0x28/0x80 
[iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [0000000010223df8] 
build_write_response+0x40/0xe0 [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [000000001021e444] 
send_scsi_rsp+0xc/0x120 [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [0000000010223c30] 
disk_execute_cmnd+0x158/0x220 [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [0000000010220330] 
worker_thread+0x118/0x1a0 [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:37 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:37 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:37 poulenc kernel: istiod1       D 00000000102262c8     0 
8234      2
Nov  4 18:56:37 poulenc kernel: Call Trace:
Nov  4 18:56:37 poulenc kernel:  [000000000067e4cc] 
wait_for_completion+0x74/0xe0
Nov  4 18:56:37 poulenc kernel:  [00000000102262c8] 
blockio_make_request+0x1d0/0x24c [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [000000001021a140] tio_write+0x28/0x80 
[iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [0000000010223df8] 
build_write_response+0x40/0xe0 [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [000000001021e444] 
send_scsi_rsp+0xc/0x120 [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [0000000010223c30] 
disk_execute_cmnd+0x158/0x220 [iscsi_trgt]
Nov  4 18:56:37 poulenc kernel:  [0000000010220330] 
worker_thread+0x118/0x1a0 [iscsi_trgt]
Nov  4 18:56:38 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:38 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:38 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:38 poulenc kernel: istiod1       D 00000000102262c8     0 
8235      2
Nov  4 18:56:38 poulenc kernel: Call Trace:
Nov  4 18:56:38 poulenc kernel:  [000000000067e4cc] 
wait_for_completion+0x74/0xe0
Nov  4 18:56:38 poulenc kernel:  [00000000102262c8] 
blockio_make_request+0x1d0/0x24c [iscsi_trgt]
Nov  4 18:56:38 poulenc kernel:  [000000001021a140] tio_write+0x28/0x80 
[iscsi_trgt]
Nov  4 18:56:38 poulenc kernel:  [0000000010223df8] 
build_write_response+0x40/0xe0 [iscsi_trgt]
Nov  4 18:56:38 poulenc kernel:  [000000001021e444] 
send_scsi_rsp+0xc/0x120 [iscsi_trgt]
Nov  4 18:56:38 poulenc kernel:  [0000000010223c30] 
disk_execute_cmnd+0x158/0x220 [iscsi_trgt]
Nov  4 18:56:38 poulenc kernel:  [0000000010220330] 
worker_thread+0x118/0x1a0 [iscsi_trgt]
Nov  4 18:56:38 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:38 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:38 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:38 poulenc kernel: istiod1       D 00000000102262c8     0 
8236      2
Nov  4 18:56:38 poulenc kernel: Call Trace:
Nov  4 18:56:38 poulenc kernel:  [000000000067e4cc] 
wait_for_completion+0x74/0xe0
Nov  4 18:56:38 poulenc kernel:  [00000000102262c8] 
blockio_make_request+0x1d0/0x24c [iscsi_trgt]
Nov  4 18:56:38 poulenc kernel:  [000000001021a140] tio_write+0x28/0x80 
[iscsi_trgt]
Nov  4 18:56:38 poulenc kernel:  [0000000010223df8] 
build_write_response+0x40/0xe0 [iscsi_trgt]
Nov  4 18:56:38 poulenc kernel:  [000000001021e444] 
send_scsi_rsp+0xc/0x120 [iscsi_trgt]
Nov  4 18:56:38 poulenc kernel:  [0000000010223c30] 
disk_execute_cmnd+0x158/0x220 [iscsi_trgt]
Nov  4 18:56:38 poulenc kernel:  [0000000010220330] 
worker_thread+0x118/0x1a0 [iscsi_trgt]
Nov  4 18:56:38 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:38 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:38 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:38 poulenc kernel: identd        S 00000000004c776c     0 
8394   3802
Nov  4 18:56:38 poulenc kernel: Call Trace:
Nov  4 18:56:38 poulenc kernel:  [000000000067ec0c] 
schedule_timeout+0x54/0xc0
Nov  4 18:56:38 poulenc kernel:  [00000000004c776c] do_sys_poll+0x234/0x400
Nov  4 18:56:38 poulenc kernel:  [00000000004c7960] sys_poll+0x28/0x60
Nov  4 18:56:38 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:38 poulenc kernel:  [00000000f7ce50d4] 0xf7ce50dc
Nov  4 18:56:38 poulenc kernel: identd        S 00000000004833bc     0 
8395   3802
Nov  4 18:56:38 poulenc kernel: Call Trace:
Nov  4 18:56:38 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:38 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:38 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:38 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:38 poulenc kernel:  [00000000f7ee72e4] 0xf7ee72ec
Nov  4 18:56:38 poulenc kernel: identd        S 00000000004833bc     0 
8396   3802
Nov  4 18:56:38 poulenc kernel: Call Trace:
Nov  4 18:56:38 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:38 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:38 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:38 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:38 poulenc kernel:  [00000000f7ee72e4] 0xf7ee72ec
Nov  4 18:56:38 poulenc kernel: identd        S 00000000004833bc     0 
8397   3802
Nov  4 18:56:38 poulenc kernel: Call Trace:
Nov  4 18:56:39 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:39 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:39 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:39 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:39 poulenc kernel:  [00000000f7ee72e4] 0xf7ee72ec
Nov  4 18:56:39 poulenc kernel: identd        S 00000000004833bc     0 
8398   3802
Nov  4 18:56:39 poulenc kernel: Call Trace:
Nov  4 18:56:39 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:39 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:39 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:39 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:39 poulenc kernel:  [00000000f7ee72e4] 0xf7ee72ec
Nov  4 18:56:39 poulenc kernel: identd        S 00000000004833bc     0 
8399   3802
Nov  4 18:56:39 poulenc kernel: Call Trace:
Nov  4 18:56:39 poulenc kernel:  [0000000000482ec0] futex_wait+0x268/0x2c0
Nov  4 18:56:39 poulenc kernel:  [00000000004833bc] do_futex+0x64/0xbc0
Nov  4 18:56:39 poulenc kernel:  [00000000004843fc] 
compat_sys_futex+0x64/0x120
Nov  4 18:56:39 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:39 poulenc kernel:  [00000000f7ee72e4] 0xf7ee72ec
Nov  4 18:56:39 poulenc kernel: watchdog      ? 0000000000466d4c     0 
8412   3976
Nov  4 18:56:39 poulenc kernel: Call Trace:
Nov  4 18:56:39 poulenc kernel:  [00000000004669f0] do_exit+0x6d8/0xa00
Nov  4 18:56:39 poulenc kernel:  [0000000000466d4c] do_group_exit+0x34/0xa0
Nov  4 18:56:39 poulenc kernel:  [00000000004061d4] 
linux_sparc_syscall32+0x3c/0x40
Nov  4 18:56:39 poulenc kernel:  [000000000001b264] 0x1b26c
Nov  4 18:56:46 poulenc kernel: SysRq : Show Blocked State
Nov  4 18:56:46 poulenc kernel:   task                        PC stack 
  pid father
Nov  4 18:56:46 poulenc kernel: istiod1       D 00000000102262c8     0 
8229      2
Nov  4 18:56:46 poulenc kernel: Call Trace:
Nov  4 18:56:46 poulenc kernel:  [000000000067e4cc] 
wait_for_completion+0x74/0xe0
Nov  4 18:56:46 poulenc kernel:  [00000000102262c8] 
blockio_make_request+0x1d0/0x24c [iscsi_trgt]
Nov  4 18:56:46 poulenc kernel:  [000000001021a140] tio_write+0x28/0x80 
[iscsi_trgt]
Nov  4 18:56:46 poulenc kernel:  [0000000010223df8] 
build_write_response+0x40/0xe0 [iscsi_trgt]
Nov  4 18:56:47 poulenc kernel:  [000000001021e444] 
send_scsi_rsp+0xc/0x120 [iscsi_trgt]
Nov  4 18:56:47 poulenc kernel:  [0000000010223c30] 
disk_execute_cmnd+0x158/0x220 [iscsi_trgt]
Nov  4 18:56:47 poulenc kernel:  [0000000010220330] 
worker_thread+0x118/0x1a0 [iscsi_trgt]
Nov  4 18:56:47 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:47 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:47 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:47 poulenc kernel: istiod1       D 00000000102262c8     0 
8230      2
Nov  4 18:56:47 poulenc kernel: Call Trace:
Nov  4 18:56:47 poulenc kernel:  [000000000067e4cc] 
wait_for_completion+0x74/0xe0
Nov  4 18:56:47 poulenc kernel:  [00000000102262c8] 
blockio_make_request+0x1d0/0x24c [iscsi_trgt]
Nov  4 18:56:47 poulenc kernel:  [000000001021a140] tio_write+0x28/0x80 
[iscsi_trgt]
Nov  4 18:56:47 poulenc kernel:  [0000000010223df8] 
build_write_response+0x40/0xe0 [iscsi_trgt]
Nov  4 18:56:47 poulenc kernel:  [000000001021e444] 
send_scsi_rsp+0xc/0x120 [iscsi_trgt]
Nov  4 18:56:47 poulenc kernel:  [0000000010223c30] 
disk_execute_cmnd+0x158/0x220 [iscsi_trgt]
Nov  4 18:56:47 poulenc kernel:  [0000000010220330] 
worker_thread+0x118/0x1a0 [iscsi_trgt]
Nov  4 18:56:47 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:47 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:47 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:47 poulenc kernel: istiod1       D 00000000102262c8     0 
8231      2
Nov  4 18:56:47 poulenc kernel: Call Trace:
Nov  4 18:56:47 poulenc kernel:  [000000000067e4cc] 
wait_for_completion+0x74/0xe0
Nov  4 18:56:47 poulenc kernel:  [00000000102262c8] 
blockio_make_request+0x1d0/0x24c [iscsi_trgt]
Nov  4 18:56:47 poulenc kernel:  [000000001021a140] tio_write+0x28/0x80 
[iscsi_trgt]
Nov  4 18:56:47 poulenc kernel:  [0000000010223df8] 
build_write_response+0x40/0xe0 [iscsi_trgt]
Nov  4 18:56:47 poulenc kernel:  [000000001021e444] 
send_scsi_rsp+0xc/0x120 [iscsi_trgt]
Nov  4 18:56:47 poulenc kernel:  [0000000010223c30] 
disk_execute_cmnd+0x158/0x220 [iscsi_trgt]
Nov  4 18:56:47 poulenc kernel:  [0000000010220330] 
worker_thread+0x118/0x1a0 [iscsi_trgt]
Nov  4 18:56:47 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:47 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:47 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:47 poulenc kernel: istiod1       D 00000000102262c8     0 
8232      2
Nov  4 18:56:47 poulenc kernel: Call Trace:
Nov  4 18:56:47 poulenc kernel:  [000000000067e4cc] 
wait_for_completion+0x74/0xe0
Nov  4 18:56:47 poulenc kernel:  [00000000102262c8] 
blockio_make_request+0x1d0/0x24c [iscsi_trgt]
Nov  4 18:56:47 poulenc kernel:  [000000001021a140] tio_write+0x28/0x80 
[iscsi_trgt]
Nov  4 18:56:47 poulenc kernel:  [0000000010223df8] 
build_write_response+0x40/0xe0 [iscsi_trgt]
Nov  4 18:56:47 poulenc kernel:  [000000001021e444] 
send_scsi_rsp+0xc/0x120 [iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [0000000010223c30] 
disk_execute_cmnd+0x158/0x220 [iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [0000000010220330] 
worker_thread+0x118/0x1a0 [iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:48 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:48 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:48 poulenc kernel: istiod1       D 00000000102262c8     0 
8233      2
Nov  4 18:56:48 poulenc kernel: Call Trace:
Nov  4 18:56:48 poulenc kernel:  [000000000067e4cc] 
wait_for_completion+0x74/0xe0
Nov  4 18:56:48 poulenc kernel:  [00000000102262c8] 
blockio_make_request+0x1d0/0x24c [iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [000000001021a140] tio_write+0x28/0x80 
[iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [0000000010223df8] 
build_write_response+0x40/0xe0 [iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [000000001021e444] 
send_scsi_rsp+0xc/0x120 [iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [0000000010223c30] 
disk_execute_cmnd+0x158/0x220 [iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [0000000010220330] 
worker_thread+0x118/0x1a0 [iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:48 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:48 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:48 poulenc kernel: istiod1       D 00000000102262c8     0 
8234      2
Nov  4 18:56:48 poulenc kernel: Call Trace:
Nov  4 18:56:48 poulenc kernel:  [000000000067e4cc] 
wait_for_completion+0x74/0xe0
Nov  4 18:56:48 poulenc kernel:  [00000000102262c8] 
blockio_make_request+0x1d0/0x24c [iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [000000001021a140] tio_write+0x28/0x80 
[iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [0000000010223df8] 
build_write_response+0x40/0xe0 [iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [000000001021e444] 
send_scsi_rsp+0xc/0x120 [iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [0000000010223c30] 
disk_execute_cmnd+0x158/0x220 [iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [0000000010220330] 
worker_thread+0x118/0x1a0 [iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:48 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:48 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:48 poulenc kernel: istiod1       D 00000000102262c8     0 
8235      2
Nov  4 18:56:48 poulenc kernel: Call Trace:
Nov  4 18:56:48 poulenc kernel:  [000000000067e4cc] 
wait_for_completion+0x74/0xe0
Nov  4 18:56:48 poulenc kernel:  [00000000102262c8] 
blockio_make_request+0x1d0/0x24c [iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [000000001021a140] tio_write+0x28/0x80 
[iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [0000000010223df8] 
build_write_response+0x40/0xe0 [iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [000000001021e444] 
send_scsi_rsp+0xc/0x120 [iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [0000000010223c30] 
disk_execute_cmnd+0x158/0x220 [iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [0000000010220330] 
worker_thread+0x118/0x1a0 [iscsi_trgt]
Nov  4 18:56:48 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:48 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:48 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0
Nov  4 18:56:49 poulenc kernel: istiod1       D 00000000102262c8     0 
8236      2
Nov  4 18:56:49 poulenc kernel: Call Trace:
Nov  4 18:56:49 poulenc kernel:  [000000000067e4cc] 
wait_for_completion+0x74/0xe0
Nov  4 18:56:49 poulenc kernel:  [00000000102262c8] 
blockio_make_request+0x1d0/0x24c [iscsi_trgt]
Nov  4 18:56:49 poulenc kernel:  [000000001021a140] tio_write+0x28/0x80 
[iscsi_trgt]
Nov  4 18:56:49 poulenc kernel:  [0000000010223df8] 
build_write_response+0x40/0xe0 [iscsi_trgt]
Nov  4 18:56:49 poulenc kernel:  [000000001021e444] 
send_scsi_rsp+0xc/0x120 [iscsi_trgt]
Nov  4 18:56:49 poulenc kernel:  [0000000010223c30] 
disk_execute_cmnd+0x158/0x220 [iscsi_trgt]
Nov  4 18:56:49 poulenc kernel:  [0000000010220330] 
worker_thread+0x118/0x1a0 [iscsi_trgt]
Nov  4 18:56:49 poulenc kernel:  [0000000000478ce0] kthread+0x48/0x80
Nov  4 18:56:49 poulenc kernel:  [00000000004273d0] kernel_thread+0x38/0x60
Nov  4 18:56:49 poulenc kernel:  [0000000000478f80] kthreadd+0x148/0x1c0

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: 2.6.23.1: mdadm/raid5 hung/d-state
  2007-11-04 14:55     ` Michael Tokarev
  2007-11-04 14:59       ` Justin Piszcz
  2007-11-04 18:17       ` BERTRAND Joël
@ 2007-11-04 21:40       ` David Greaves
  2 siblings, 0 replies; 8+ messages in thread
From: David Greaves @ 2007-11-04 21:40 UTC (permalink / raw)
  To: Michael Tokarev; +Cc: Justin Piszcz, linux-kernel, linux-raid, xfs

Michael Tokarev wrote:
> Justin Piszcz wrote:
>> On Sun, 4 Nov 2007, Michael Tokarev wrote:
> []
>>> The next time you come across something like that, do a SysRq-T dump and
>>> post that.  It shows a stack trace of all processes - and in particular,
>>> where exactly each task is stuck.
> 
>> Yes I got it before I rebooted, ran that and then dmesg > file.
>>
>> Here it is:
>>
>> [1172609.665902]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
>> [1172609.668768]  ffffffff80747dc0 ffff81015c3aa918 ffff810091c899b4 ffff810091c899a8
> 
> That's only partial list.  All the kernel threads - which are most important
> in this context - aren't shown.  You ran out of dmesg buffer, and the most
> interesting entries was at the beginning.  If your /var/log partition is
> working, the stuff should be in /var/log/kern.log or equivalent.  If it's
> not working, there is a way to capture the info still, by stopping syslogd,
> cat'ing /proc/kmsg to some tmpfs file and scp'ing it elsewhere.

or netconsole is actually pretty easy and incredibly useful in this kind of
situation even if there's no disk at all :)

David

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: 2.6.23.1: mdadm/raid5 hung/d-state
       [not found]                 ` <18227.33346.994456.270194@fisica.ufpr.br>
@ 2007-11-09  9:14                   ` Justin Piszcz
  2007-11-09 14:09                     ` Fabiano Silva
  0 siblings, 1 reply; 8+ messages in thread
From: Justin Piszcz @ 2007-11-09  9:14 UTC (permalink / raw)
  To: Carlos Carvalho
  Cc: Jeff Lessem, root, Dan Williams, BERTRAND Joël, Neil Brown,
	linux-kernel, linux-raid, xfs



On Thu, 8 Nov 2007, Carlos Carvalho wrote:

> Jeff Lessem (Jeff@Lessem.org) wrote on 6 November 2007 22:00:
> >Dan Williams wrote:
> > > The following patch, also attached, cleans up cases where the code looks
> > > at sh->ops.pending when it should be looking at the consistent
> > > stack-based snapshot of the operations flags.
> >
> >I tried this patch (against a stock 2.6.23), and it did not work for
> >me.  Not only did I/O to the effected RAID5 & XFS partition stop, but
> >also I/O to all other disks.  I was not able to capture any debugging
> >information, but I should be able to do that tomorrow when I can hook
> >a serial console to the machine.
> >
> >I'm not sure if my problem is identical to these others, as mine only
> >seems to manifest with RAID5+XFS.  The RAID rebuilds with no problem,
> >and I've not had any problems with RAID5+ext3.
>
> Us too! We're stuck trying to build a disk server with several disks
> in a raid5 array, and the rsync from the old machine stops writing to
> the new filesystem. It only happens under heavy IO. We can make it
> lock without rsync, using 8 simultaneous dd's to the array. All IO
> stops, including the resync after a newly created raid or after an
> unclean reboot.
>
> We could not trigger the problem with ext3 or reiser3; it only happens
> with xfs.
> -
> To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>

Including XFS mailing list as well can you provide more information to 
them?

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: 2.6.23.1: mdadm/raid5 hung/d-state
  2007-11-09  9:14                   ` Justin Piszcz
@ 2007-11-09 14:09                     ` Fabiano Silva
  0 siblings, 0 replies; 8+ messages in thread
From: Fabiano Silva @ 2007-11-09 14:09 UTC (permalink / raw)
  To: Justin Piszcz
  Cc: Carlos Carvalho, Jeff Lessem, root, Dan Williams,
	BERTRAND Joël, Neil Brown, linux-kernel, linux-raid, xfs

[-- Attachment #1: Type: text/plain, Size: 2201 bytes --]

On Nov 9, 2007 7:14 AM, Justin Piszcz <jpiszcz@lucidpixels.com> wrote:
>
>
>
> On Thu, 8 Nov 2007, Carlos Carvalho wrote:
>
> > Jeff Lessem (Jeff@Lessem.org) wrote on 6 November 2007 22:00:
> > >Dan Williams wrote:
> > > > The following patch, also attached, cleans up cases where the code looks
> > > > at sh->ops.pending when it should be looking at the consistent
> > > > stack-based snapshot of the operations flags.
> > >
> > >I tried this patch (against a stock 2.6.23), and it did not work for
> > >me.  Not only did I/O to the effected RAID5 & XFS partition stop, but
> > >also I/O to all other disks.  I was not able to capture any debugging
> > >information, but I should be able to do that tomorrow when I can hook
> > >a serial console to the machine.
> > >
> > >I'm not sure if my problem is identical to these others, as mine only
> > >seems to manifest with RAID5+XFS.  The RAID rebuilds with no problem,
> > >and I've not had any problems with RAID5+ext3.
> >
> > Us too! We're stuck trying to build a disk server with several disks
> > in a raid5 array, and the rsync from the old machine stops writing to
> > the new filesystem. It only happens under heavy IO. We can make it
> > lock without rsync, using 8 simultaneous dd's to the array. All IO
> > stops, including the resync after a newly created raid or after an
> > unclean reboot.
> >
> > We could not trigger the problem with ext3 or reiser3; it only happens
> > with xfs.

In our case all process using md4, including md4_resync, stay in D state.
Call Trace:
  [<ffffffff803615ac>] __generic_unplug_device+0x13/0x24
  [<ffffffff803622cf>] generic_unplug_device+0x18/0x28
  [<ffffffff803f2cf7>] get_active_stripe+0x22b/0x472
...
see dmesg (sysrq t) attached.

We can reproduce this problem in two machines with the same configuration:
  - 2 x Dual-Core Opteron 2.8GHz
  - 8GB memory
  - 3ware 9000 with 10 x 750GB sata disks
  - Debian Etch x86_64
  - raid5 + xfs (/dev/md4)
in all these stock kernel's:
  - 2.6.22.11, 2.6.22.12, 2.6.23.1, 2.6.24-rc2
running:
  - for i in f{0..7}; do (dd bs=1M count=100000 if=/dev/zero of=$i &); done

If we increase /sys/block/md4/md/stripe_cache_size the device and process
back to work.

[-- Attachment #2: dmesg_sysrq_t.txt.gz --]
[-- Type: application/x-gzip, Size: 114342 bytes --]

^ permalink raw reply	[flat|nested] 8+ messages in thread

end of thread, other threads:[~2007-11-09 14:37 UTC | newest]

Thread overview: 8+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
     [not found] <Pine.LNX.4.64.0711040658180.30831@p34.internal.lan>
2007-11-04 12:39 ` 2.6.23.1: mdadm/raid5 hung/d-state (md3_raid5 stuck in endless loop?) Justin Piszcz
     [not found] ` <472DBF8C.2060508@msgid.tls.msk.ru>
2007-11-04 12:52   ` 2.6.23.1: mdadm/raid5 hung/d-state Justin Piszcz
2007-11-04 14:55     ` Michael Tokarev
2007-11-04 14:59       ` Justin Piszcz
2007-11-04 18:17       ` BERTRAND Joël
2007-11-04 21:40       ` David Greaves
     [not found] ` <18222.16003.92062.970530@notabene.brown>
     [not found]   ` <Pine.LNX.4.64.0711041651250.23496@p34.internal.lan>
     [not found]     ` <e9c3a7c20711051035m78ba90ck68f4fbc10480462a@mail.gmail.com>
     [not found]       ` <Pine.LNX.4.64.0711051335450.11422@p34.internal.lan>
     [not found]         ` <e9c3a7c20711051619u7054aab9l208b604b9e58fb61@mail.gmail.com>
     [not found]           ` <47303FB8.7000801@systella.fr>
     [not found]             ` <1194398700.2970.18.camel@dwillia2-linux.ch.intel.com>
     [not found]               ` <47314653.80905@Lessem.org>
     [not found]                 ` <18227.33346.994456.270194@fisica.ufpr.br>
2007-11-09  9:14                   ` Justin Piszcz
2007-11-09 14:09                     ` Fabiano Silva

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox