Re: More latency regressions with 2.6.11-rc4-RT-V0.7.39-02

Lee Revell
2005-02-23T20:31:21Z

[-- Attachment #1: Type: text/plain, Size: 349 bytes --]

On Wed, 2005-02-23 at 20:06 +0000, Hugh Dickins wrote:
> >
> > Thanks, your patch fixes the copy_pte_range latency.
>
> Great, if the previous patch fixed that latency then this new one
> will too, no need to report on that; but please get rid of the old
> patch before it leaks too many of your pages.

clear_page_range is also problematic.

Lee

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: trace7.txt --]
[-- Type: text/plain; name=trace7.txt; charset=ANSI_X3.4-1968, Size: 49938 bytes --]

preemption latency trace v1.1.4 on 2.6.11-rc4-RT-V0.7.39-02
--------------------------------------------------------------------
latency: 313 µs, #291/291, CPU#0 | (M:preempt VP:0, KP:1, SP:1 HP:1 #P:1)
-----------------
| task: ksoftirqd/0-2 (uid:0 nice:-10 policy:0 rt_prio:0)
-----------------

_------=> CPU#
/ _-----=> irqs-off
| / _----=> need-resched
|| / _---=> hardirq/softirq
||| / _--=> preempt-depth
|||| /
||||| delay
cmd pid ||||| time | caller
\ / ||||| \ | /
(T1/#0) cc1plus 3510 0 9 00000002 00000000 [0000188528469818] 0.000ms (+811152.283ms): <70316363> (<0073756c>)
(T1/#2) cc1plus 3510 0 9 00000002 00000002 [0000188528470164] 0.000ms (+0.000ms): __trace_start_sched_wakeup+0x96/0xc0 <c012cbe6> (try_to_wake_up+0x81/0x150 <c010f911>)
(T1/#3) cc1plus 3510 0 9 00000000 00000003 [0000188528470660] 0.001ms (+0.000ms): wake_up_process+0x1c/0x30 <c010f9fc> (do_softirq+0x4b/0x60 <c01042fb>)
(T6/#4) cc1plus-3510 0dn.2 2µs+< (1)
(T1/#5) cc1plus 3510 0 2 00000002 00000005 [0000188528521949] 0.086ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#6) cc1plus 3510 0 2 00000002 00000006 [0000188528522356] 0.087ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#7) cc1plus 3510 0 2 00000002 00000007 [0000188528522777] 0.088ms (+0.001ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#8) cc1plus 3510 0 2 00000002 00000008 [0000188528523382] 0.089ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#9) cc1plus 3510 0 2 00000002 00000009 [0000188528523695] 0.089ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#10) cc1plus 3510 0 2 00000002 0000000a [0000188528523952] 0.090ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#11) cc1plus 3510 0 2 00000002 0000000b [0000188528524216] 0.090ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#12) cc1plus 3510 0 2 00000002 0000000c [0000188528524975] 0.091ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#13) cc1plus 3510 0 2 00000002 0000000d [0000188528525518] 0.092ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#14) cc1plus 3510 0 2 00000002 0000000e [0000188528525878] 0.093ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#15) cc1plus 3510 0 2 00000002 0000000f [0000188528526264] 0.093ms (+0.000ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#16) cc1plus 3510 0 2 00000002 00000010 [0000188528526791] 0.094ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#17) cc1plus 3510 0 2 00000002 00000011 [0000188528527169] 0.095ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#18) cc1plus 3510 0 2 00000002 00000012 [0000188528527426] 0.095ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#19) cc1plus 3510 0 2 00000002 00000013 [0000188528527898] 0.096ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#20) cc1plus 3510 0 2 00000002 00000014 [0000188528528616] 0.097ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#21) cc1plus 3510 0 2 00000002 00000015 [0000188528529086] 0.098ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#22) cc1plus 3510 0 2 00000002 00000016 [0000188528529446] 0.099ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#23) cc1plus 3510 0 2 00000002 00000017 [0000188528529833] 0.099ms (+0.000ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#24) cc1plus 3510 0 2 00000002 00000018 [0000188528530360] 0.100ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#25) cc1plus 3510 0 2 00000002 00000019 [0000188528530665] 0.101ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#26) cc1plus 3510 0 2 00000002 0000001a [0000188528530922] 0.101ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#27) cc1plus 3510 0 2 00000002 0000001b [0000188528531186] 0.102ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#28) cc1plus 3510 0 2 00000002 0000001c [0000188528531904] 0.103ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#29) cc1plus 3510 0 2 00000002 0000001d [0000188528532309] 0.103ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#30) cc1plus 3510 0 2 00000002 0000001e [0000188528532669] 0.104ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#31) cc1plus 3510 0 2 00000002 0000001f [0000188528533055] 0.105ms (+0.000ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#32) cc1plus 3510 0 2 00000002 00000020 [0000188528533582] 0.106ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#33) cc1plus 3510 0 2 00000002 00000021 [0000188528533887] 0.106ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#34) cc1plus 3510 0 2 00000002 00000022 [0000188528534144] 0.107ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#35) cc1plus 3510 0 2 00000002 00000023 [0000188528534408] 0.107ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#36) cc1plus 3510 0 2 00000002 00000024 [0000188528535126] 0.108ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#37) cc1plus 3510 0 2 00000002 00000025 [0000188528535531] 0.109ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#38) cc1plus 3510 0 2 00000002 00000026 [0000188528535891] 0.109ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#39) cc1plus 3510 0 2 00000002 00000027 [0000188528536277] 0.110ms (+0.000ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#40) cc1plus 3510 0 2 00000002 00000028 [0000188528536804] 0.111ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#41) cc1plus 3510 0 2 00000002 00000029 [0000188528537109] 0.111ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#42) cc1plus 3510 0 2 00000002 0000002a [0000188528537366] 0.112ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#43) cc1plus 3510 0 2 00000002 0000002b [0000188528537630] 0.112ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#44) cc1plus 3510 0 3 00000003 0000002c [0000188528538238] 0.113ms (+0.000ms): free_pages_bulk+0xe/0x200 <c0138fde> (free_hot_cold_page+0x103/0x130 <c01395d3>)
(T1/#45) cc1plus 3510 0 3 00000004 0000002d [0000188528538772] 0.114ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#46) cc1plus 3510 0 3 00000004 0000002e [0000188528539128] 0.115ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#47) cc1plus 3510 0 3 00000004 0000002f [0000188528539654] 0.116ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#48) cc1plus 3510 0 3 00000004 00000030 [0000188528540010] 0.116ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#49) cc1plus 3510 0 3 00000004 00000031 [0000188528540515] 0.117ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#50) cc1plus 3510 0 3 00000004 00000032 [0000188528540871] 0.118ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#51) cc1plus 3510 0 3 00000004 00000033 [0000188528541384] 0.119ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#52) cc1plus 3510 0 3 00000004 00000034 [0000188528541740] 0.119ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#53) cc1plus 3510 0 3 00000004 00000035 [0000188528542243] 0.120ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#54) cc1plus 3510 0 3 00000004 00000036 [0000188528542690] 0.121ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#55) cc1plus 3510 0 3 00000004 00000037 [0000188528543212] 0.122ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#56) cc1plus 3510 0 3 00000004 00000038 [0000188528543568] 0.122ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#57) cc1plus 3510 0 3 00000004 00000039 [0000188528544045] 0.123ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#58) cc1plus 3510 0 3 00000004 0000003a [0000188528544401] 0.124ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#59) cc1plus 3510 0 3 00000004 0000003b [0000188528544806] 0.124ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#60) cc1plus 3510 0 3 00000004 0000003c [0000188528545162] 0.125ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#61) cc1plus 3510 0 3 00000004 0000003d [0000188528545567] 0.126ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#62) cc1plus 3510 0 3 00000004 0000003e [0000188528545923] 0.126ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#63) cc1plus 3510 0 3 00000004 0000003f [0000188528546353] 0.127ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#64) cc1plus 3510 0 3 00000004 00000040 [0000188528546709] 0.127ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#65) cc1plus 3510 0 3 00000004 00000041 [0000188528547211] 0.128ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#66) cc1plus 3510 0 3 00000004 00000042 [0000188528547567] 0.129ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#67) cc1plus 3510 0 3 00000004 00000043 [0000188528548041] 0.130ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#68) cc1plus 3510 0 3 00000004 00000044 [0000188528548397] 0.130ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#69) cc1plus 3510 0 3 00000004 00000045 [0000188528548916] 0.131ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#70) cc1plus 3510 0 3 00000004 00000046 [0000188528549272] 0.132ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#71) cc1plus 3510 0 3 00000004 00000047 [0000188528549688] 0.132ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#72) cc1plus 3510 0 3 00000004 00000048 [0000188528550044] 0.133ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#73) cc1plus 3510 0 3 00000004 00000049 [0000188528550449] 0.134ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#74) cc1plus 3510 0 3 00000004 0000004a [0000188528550805] 0.134ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#75) cc1plus 3510 0 3 00000004 0000004b [0000188528551286] 0.135ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#76) cc1plus 3510 0 3 00000004 0000004c [0000188528551642] 0.136ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#77) cc1plus 3510 0 3 00000003 0000004d [0000188528552147] 0.136ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (free_pages_bulk+0x1e5/0x200 <c01391b5>)
(T1/#78) cc1plus 3510 0 2 00000002 0000004e [0000188528552606] 0.137ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#79) cc1plus 3510 0 2 00000002 0000004f [0000188528553011] 0.138ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#80) cc1plus 3510 0 2 00000002 00000050 [0000188528553386] 0.139ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#81) cc1plus 3510 0 2 00000002 00000051 [0000188528553768] 0.139ms (+0.000ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#82) cc1plus 3510 0 2 00000002 00000052 [0000188528554309] 0.140ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#83) cc1plus 3510 0 2 00000002 00000053 [0000188528554599] 0.141ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#84) cc1plus 3510 0 2 00000002 00000054 [0000188528554856] 0.141ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#85) cc1plus 3510 0 2 00000002 00000055 [0000188528555120] 0.141ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#86) cc1plus 3510 0 2 00000002 00000056 [0000188528555860] 0.143ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#87) cc1plus 3510 0 2 00000002 00000057 [0000188528556332] 0.143ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#88) cc1plus 3510 0 2 00000002 00000058 [0000188528556707] 0.144ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#89) cc1plus 3510 0 2 00000002 00000059 [0000188528557089] 0.145ms (+0.000ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#90) cc1plus 3510 0 2 00000002 0000005a [0000188528557616] 0.146ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#91) cc1plus 3510 0 2 00000002 0000005b [0000188528557921] 0.146ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#92) cc1plus 3510 0 2 00000002 0000005c [0000188528558178] 0.147ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#93) cc1plus 3510 0 2 00000002 0000005d [0000188528558442] 0.147ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#94) cc1plus 3510 0 2 00000002 0000005e [0000188528559160] 0.148ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#95) cc1plus 3510 0 2 00000002 0000005f [0000188528559565] 0.149ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#96) cc1plus 3510 0 2 00000002 00000060 [0000188528559925] 0.149ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#97) cc1plus 3510 0 2 00000002 00000061 [0000188528560311] 0.150ms (+0.000ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#98) cc1plus 3510 0 2 00000002 00000062 [0000188528560838] 0.151ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#99) cc1plus 3510 0 2 00000002 00000063 [0000188528561143] 0.151ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#100) cc1plus 3510 0 2 00000002 00000064 [0000188528561400] 0.152ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#101) cc1plus 3510 0 2 00000002 00000065 [0000188528561664] 0.152ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#102) cc1plus 3510 0 2 00000002 00000066 [0000188528562382] 0.154ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#103) cc1plus 3510 0 2 00000002 00000067 [0000188528562787] 0.154ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#104) cc1plus 3510 0 2 00000002 00000068 [0000188528563147] 0.155ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#105) cc1plus 3510 0 2 00000002 00000069 [0000188528563533] 0.155ms (+0.000ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#106) cc1plus 3510 0 2 00000002 0000006a [0000188528564060] 0.156ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#107) cc1plus 3510 0 2 00000002 0000006b [0000188528564365] 0.157ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#108) cc1plus 3510 0 2 00000002 0000006c [0000188528564622] 0.157ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#109) cc1plus 3510 0 2 00000002 0000006d [0000188528564886] 0.158ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#110) cc1plus 3510 0 2 00000002 0000006e [0000188528565604] 0.159ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#111) cc1plus 3510 0 2 00000002 0000006f [0000188528566009] 0.160ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#112) cc1plus 3510 0 2 00000002 00000070 [0000188528566369] 0.160ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#113) cc1plus 3510 0 2 00000002 00000071 [0000188528566724] 0.161ms (+0.000ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#114) cc1plus 3510 0 2 00000002 00000072 [0000188528567251] 0.162ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#115) cc1plus 3510 0 2 00000002 00000073 [0000188528567556] 0.162ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#116) cc1plus 3510 0 2 00000002 00000074 [0000188528567813] 0.163ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#117) cc1plus 3510 0 2 00000002 00000075 [0000188528568077] 0.163ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#118) cc1plus 3510 0 2 00000002 00000076 [0000188528568795] 0.164ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#119) cc1plus 3510 0 2 00000002 00000077 [0000188528569200] 0.165ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#120) cc1plus 3510 0 2 00000002 00000078 [0000188528569560] 0.165ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#121) cc1plus 3510 0 2 00000002 00000079 [0000188528569946] 0.166ms (+0.000ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#122) cc1plus 3510 0 2 00000002 0000007a [0000188528570473] 0.167ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#123) cc1plus 3510 0 2 00000002 0000007b [0000188528570778] 0.167ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#124) cc1plus 3510 0 2 00000002 0000007c [0000188528571035] 0.168ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#125) cc1plus 3510 0 2 00000002 0000007d [0000188528571299] 0.168ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#126) cc1plus 3510 0 2 00000002 0000007e [0000188528572017] 0.170ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#127) cc1plus 3510 0 2 00000002 0000007f [0000188528572422] 0.170ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#128) cc1plus 3510 0 2 00000002 00000080 [0000188528572782] 0.171ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#129) cc1plus 3510 0 2 00000002 00000081 [0000188528573218] 0.172ms (+0.000ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#130) cc1plus 3510 0 2 00000002 00000082 [0000188528573745] 0.172ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#131) cc1plus 3510 0 2 00000002 00000083 [0000188528574122] 0.173ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#132) cc1plus 3510 0 2 00000002 00000084 [0000188528574379] 0.173ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#133) cc1plus 3510 0 2 00000002 00000085 [0000188528574643] 0.174ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#134) cc1plus 3510 0 2 00000002 00000086 [0000188528575361] 0.175ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#135) cc1plus 3510 0 2 00000002 00000087 [0000188528575810] 0.176ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#136) cc1plus 3510 0 2 00000002 00000088 [0000188528576170] 0.176ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#137) cc1plus 3510 0 2 00000002 00000089 [0000188528576525] 0.177ms (+0.001ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#138) cc1plus 3510 0 2 00000002 0000008a [0000188528577148] 0.178ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#139) cc1plus 3510 0 2 00000002 0000008b [0000188528577530] 0.179ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#140) cc1plus 3510 0 2 00000002 0000008c [0000188528577872] 0.179ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#141) cc1plus 3510 0 2 00000002 0000008d [0000188528578219] 0.180ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#142) cc1plus 3510 0 2 00000002 0000008e [0000188528579020] 0.181ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#143) cc1plus 3510 0 2 00000002 0000008f [0000188528579510] 0.182ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#144) cc1plus 3510 0 2 00000002 00000090 [0000188528579951] 0.183ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#145) cc1plus 3510 0 2 00000002 00000091 [0000188528580473] 0.184ms (+0.001ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#146) cc1plus 3510 0 2 00000002 00000092 [0000188528581085] 0.185ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#147) cc1plus 3510 0 2 00000002 00000093 [0000188528581472] 0.185ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#148) cc1plus 3510 0 2 00000002 00000094 [0000188528581810] 0.186ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#149) cc1plus 3510 0 2 00000002 00000095 [0000188528582226] 0.187ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#150) cc1plus 3510 0 2 00000002 00000096 [0000188528583025] 0.188ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#151) cc1plus 3510 0 2 00000002 00000097 [0000188528583515] 0.189ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#152) cc1plus 3510 0 2 00000002 00000098 [0000188528583961] 0.189ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#153) cc1plus 3510 0 2 00000002 00000099 [0000188528584424] 0.190ms (+0.001ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#154) cc1plus 3510 0 2 00000002 0000009a [0000188528585027] 0.191ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#155) cc1plus 3510 0 2 00000002 0000009b [0000188528585419] 0.192ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#156) cc1plus 3510 0 2 00000002 0000009c [0000188528585761] 0.192ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#157) cc1plus 3510 0 2 00000002 0000009d [0000188528586112] 0.193ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#158) cc1plus 3510 0 2 00000002 0000009e [0000188528586913] 0.194ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#159) cc1plus 3510 0 2 00000002 0000009f [0000188528587403] 0.195ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#160) cc1plus 3510 0 2 00000002 000000a0 [0000188528587849] 0.196ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#161) cc1plus 3510 0 2 00000002 000000a1 [0000188528588281] 0.197ms (+0.001ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#162) cc1plus 3510 0 2 00000002 000000a2 [0000188528588888] 0.198ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#163) cc1plus 3510 0 2 00000002 000000a3 [0000188528589275] 0.198ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#164) cc1plus 3510 0 2 00000002 000000a4 [0000188528589613] 0.199ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#165) cc1plus 3510 0 2 00000002 000000a5 [0000188528589964] 0.199ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#166) cc1plus 3510 0 2 00000002 000000a6 [0000188528590760] 0.201ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#167) cc1plus 3510 0 2 00000002 000000a7 [0000188528591246] 0.202ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#168) cc1plus 3510 0 2 00000002 000000a8 [0000188528591687] 0.202ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#169) cc1plus 3510 0 2 00000002 000000a9 [0000188528592146] 0.203ms (+0.001ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#170) cc1plus 3510 0 2 00000002 000000aa [0000188528592749] 0.204ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#171) cc1plus 3510 0 2 00000002 000000ab [0000188528593141] 0.205ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#172) cc1plus 3510 0 2 00000002 000000ac [0000188528593474] 0.205ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#173) cc1plus 3510 0 2 00000002 000000ad [0000188528593816] 0.206ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#174) cc1plus 3510 0 2 00000002 000000ae [0000188528594608] 0.207ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#175) cc1plus 3510 0 2 00000002 000000af [0000188528595112] 0.208ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#176) cc1plus 3510 0 2 00000002 000000b0 [0000188528595548] 0.209ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#177) cc1plus 3510 0 2 00000002 000000b1 [0000188528595976] 0.209ms (+0.001ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#178) cc1plus 3510 0 2 00000002 000000b2 [0000188528596588] 0.210ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#179) cc1plus 3510 0 2 00000002 000000b3 [0000188528596970] 0.211ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#180) cc1plus 3510 0 2 00000002 000000b4 [0000188528597308] 0.212ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#181) cc1plus 3510 0 2 00000002 000000b5 [0000188528597645] 0.212ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#182) cc1plus 3510 0 2 00000002 000000b6 [0000188528598433] 0.214ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#183) cc1plus 3510 0 2 00000002 000000b7 [0000188528598923] 0.214ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#184) cc1plus 3510 0 2 00000002 000000b8 [0000188528599355] 0.215ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#185) cc1plus 3510 0 2 00000002 000000b9 [0000188528599769] 0.216ms (+0.000ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#186) cc1plus 3510 0 2 00000002 000000ba [0000188528600368] 0.217ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#187) cc1plus 3510 0 2 00000002 000000bb [0000188528600755] 0.217ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#188) cc1plus 3510 0 2 00000002 000000bc [0000188528601083] 0.218ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#189) cc1plus 3510 0 2 00000002 000000bd [0000188528601416] 0.218ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#190) cc1plus 3510 0 2 00000002 000000be [0000188528602217] 0.220ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#191) cc1plus 3510 0 2 00000002 000000bf [0000188528602699] 0.221ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#192) cc1plus 3510 0 2 00000002 000000c0 [0000188528603135] 0.221ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#193) cc1plus 3510 0 2 00000002 000000c1 [0000188528603500] 0.222ms (+0.001ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#194) cc1plus 3510 0 2 00000002 000000c2 [0000188528604103] 0.223ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#195) cc1plus 3510 0 2 00000002 000000c3 [0000188528604494] 0.224ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#196) cc1plus 3510 0 2 00000002 000000c4 [0000188528604836] 0.224ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#197) cc1plus 3510 0 2 00000002 000000c5 [0000188528605183] 0.225ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#198) cc1plus 3510 0 2 00000002 000000c6 [0000188528605984] 0.226ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#199) cc1plus 3510 0 2 00000002 000000c7 [0000188528606461] 0.227ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#200) cc1plus 3510 0 2 00000002 000000c8 [0000188528606902] 0.228ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#201) cc1plus 3510 0 2 00000002 000000c9 [0000188528607253] 0.228ms (+0.001ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#202) cc1plus 3510 0 2 00000002 000000ca [0000188528607856] 0.229ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#203) cc1plus 3510 0 2 00000002 000000cb [0000188528608243] 0.230ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#204) cc1plus 3510 0 2 00000002 000000cc [0000188528608571] 0.230ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#205) cc1plus 3510 0 2 00000002 000000cd [0000188528608904] 0.231ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#206) cc1plus 3510 0 3 00000003 000000ce [0000188528609579] 0.232ms (+0.000ms): free_pages_bulk+0xe/0x200 <c0138fde> (free_hot_cold_page+0x103/0x130 <c01395d3>)
(T1/#207) cc1plus 3510 0 3 00000004 000000cf [0000188528610178] 0.233ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#208) cc1plus 3510 0 3 00000004 000000d0 [0000188528610610] 0.234ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#209) cc1plus 3510 0 3 00000004 000000d1 [0000188528611181] 0.235ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#210) cc1plus 3510 0 3 00000004 000000d2 [0000188528611613] 0.235ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#211) cc1plus 3510 0 3 00000004 000000d3 [0000188528612144] 0.236ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#212) cc1plus 3510 0 3 00000004 000000d4 [0000188528612585] 0.237ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#213) cc1plus 3510 0 3 00000004 000000d5 [0000188528613085] 0.238ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#214) cc1plus 3510 0 3 00000004 000000d6 [0000188528613535] 0.239ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#215) cc1plus 3510 0 3 00000004 000000d7 [0000188528614120] 0.240ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#216) cc1plus 3510 0 3 00000004 000000d8 [0000188528614556] 0.240ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#217) cc1plus 3510 0 3 00000004 000000d9 [0000188528615132] 0.241ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#218) cc1plus 3510 0 3 00000004 000000da [0000188528615560] 0.242ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#219) cc1plus 3510 0 3 00000004 000000db [0000188528616145] 0.243ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#220) cc1plus 3510 0 3 00000004 000000dc [0000188528616577] 0.244ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#221) cc1plus 3510 0 3 00000004 000000dd [0000188528617135] 0.245ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#222) cc1plus 3510 0 3 00000004 000000de [0000188528617571] 0.245ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#223) cc1plus 3510 0 3 00000004 000000df [0000188528618143] 0.246ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#224) cc1plus 3510 0 3 00000004 000000e0 [0000188528618579] 0.247ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#225) cc1plus 3510 0 3 00000004 000000e1 [0000188528619137] 0.248ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#226) cc1plus 3510 0 3 00000004 000000e2 [0000188528619578] 0.249ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#227) cc1plus 3510 0 3 00000004 000000e3 [0000188528620150] 0.250ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#228) cc1plus 3510 0 3 00000004 000000e4 [0000188528620586] 0.250ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#229) cc1plus 3510 0 3 00000004 000000e5 [0000188528621140] 0.251ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#230) cc1plus 3510 0 3 00000004 000000e6 [0000188528621581] 0.252ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#231) cc1plus 3510 0 3 00000004 000000e7 [0000188528622134] 0.253ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#232) cc1plus 3510 0 3 00000004 000000e8 [0000188528622566] 0.254ms (+0.001ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#233) cc1plus 3510 0 3 00000004 000000e9 [0000188528623174] 0.255ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#234) cc1plus 3510 0 3 00000004 000000ea [0000188528623615] 0.255ms (+0.001ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#235) cc1plus 3510 0 3 00000004 000000eb [0000188528624267] 0.256ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#236) cc1plus 3510 0 3 00000004 000000ec [0000188528624704] 0.257ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#237) cc1plus 3510 0 3 00000004 000000ed [0000188528625289] 0.258ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#238) cc1plus 3510 0 3 00000004 000000ee [0000188528625833] 0.259ms (+0.001ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#239) cc1plus 3510 0 3 00000004 000000ef [0000188528626481] 0.260ms (+0.001ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#240) cc1plus 3510 0 3 00000004 000000f0 [0000188528627134] 0.261ms (+0.001ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#241) cc1plus 3510 0 3 00000004 000000f1 [0000188528627822] 0.262ms (+0.001ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#242) cc1plus 3510 0 3 00000004 000000f2 [0000188528628524] 0.264ms (+0.001ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#243) cc1plus 3510 0 3 00000004 000000f3 [0000188528629226] 0.265ms (+0.001ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#244) cc1plus 3510 0 3 00000004 000000f4 [0000188528629919] 0.266ms (+0.001ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#245) cc1plus 3510 0 3 00000004 000000f5 [0000188528630558] 0.267ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0xc0/0x200 <c0139090>)
(T1/#246) cc1plus 3510 0 3 00000004 000000f6 [0000188528630999] 0.268ms (+0.001ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#247) cc1plus 3510 0 3 00000004 000000f7 [0000188528631715] 0.269ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#248) cc1plus 3510 0 3 00000004 000000f8 [0000188528632241] 0.270ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#249) cc1plus 3510 0 3 00000004 000000f9 [0000188528632759] 0.271ms (+0.001ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#250) cc1plus 3510 0 3 00000004 000000fa [0000188528633393] 0.272ms (+0.001ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#251) cc1plus 3510 0 3 00000004 000000fb [0000188528634154] 0.273ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#252) cc1plus 3510 0 3 00000004 000000fc [0000188528634703] 0.274ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#253) cc1plus 3510 0 3 00000004 000000fd [0000188528635297] 0.275ms (+0.001ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#254) cc1plus 3510 0 3 00000004 000000fe [0000188528635963] 0.276ms (+0.000ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#255) cc1plus 3510 0 3 00000004 000000ff [0000188528636507] 0.277ms (+0.001ms): bad_range+0xb/0x60 <c0138eeb> (free_pages_bulk+0x114/0x200 <c01390e4>)
(T1/#256) cc1plus 3510 0 3 00000003 00000100 [0000188528637160] 0.278ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (free_pages_bulk+0x1e5/0x200 <c01391b5>)
(T1/#257) cc1plus 3510 0 2 00000002 00000101 [0000188528637700] 0.279ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#258) cc1plus 3510 0 2 00000002 00000102 [0000188528638181] 0.280ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#259) cc1plus 3510 0 2 00000002 00000103 [0000188528638640] 0.280ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#260) cc1plus 3510 0 2 00000002 00000104 [0000188528639081] 0.281ms (+0.001ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#261) cc1plus 3510 0 2 00000002 00000105 [0000188528639693] 0.282ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#262) cc1plus 3510 0 2 00000002 00000106 [0000188528640053] 0.283ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#263) cc1plus 3510 0 2 00000002 00000107 [0000188528640382] 0.283ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#264) cc1plus 3510 0 2 00000002 00000108 [0000188528640719] 0.284ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#265) cc1plus 3510 0 2 00000002 00000109 [0000188528641547] 0.285ms (+0.006ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#266) cc1plus 3510 0 2 00000002 0000010a [0000188528645458] 0.292ms (+0.000ms): __mod_page_state+0xa/0x30 <c013a09a> (clear_page_range+0x183/0x1d0 <c0142873>)
(T1/#267) cc1plus 3510 0 2 00000002 0000010b [0000188528645908] 0.292ms (+0.000ms): free_page_and_swap_cache+0x9/0x70 <c014bbb9> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#268) cc1plus 3510 0 2 00000002 0000010c [0000188528646353] 0.293ms (+0.001ms): __page_cache_release+0xb/0xc0 <c013ed4b> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#269) cc1plus 3510 0 2 00000002 0000010d [0000188528646956] 0.294ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (__page_cache_release+0xad/0xc0 <c013eded>)
(T1/#270) cc1plus 3510 0 2 00000002 0000010e [0000188528647348] 0.295ms (+0.000ms): free_hot_page+0x8/0x10 <c0139608> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#271) cc1plus 3510 0 2 00000002 0000010f [0000188528647681] 0.295ms (+0.000ms): free_hot_cold_page+0xe/0x130 <c01394de> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#272) cc1plus 3510 0 2 00000002 00000110 [0000188528648032] 0.296ms (+0.001ms): __mod_page_state+0xa/0x30 <c013a09a> (free_hot_cold_page+0x2a/0x130 <c01394fa>)
(T1/#273) cc1plus 3510 0 2 00000002 00000111 [0000188528648824] 0.297ms (+0.001ms): preempt_schedule+0xa/0x70 <c027d0fa> (clear_page_range+0x1a0/0x1d0 <c0142890>)
(T1/#274) cc1plus 3510 0 2 00000002 00000112 [0000188528649746] 0.299ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (exit_mmap+0x190/0x1b0 <c0148100>)
(T1/#275) cc1plus 3510 0 2 00000001 00000113 [0000188528650210] 0.300ms (+0.000ms): preempt_schedule+0xa/0x70 <c027d0fa> (exit_mmap+0x164/0x1b0 <c01480d4>)
(T1/#276) cc1plus 3510 0 2 00000000 00000114 [0000188528650714] 0.300ms (+0.001ms): preempt_schedule+0xa/0x70 <c027d0fa> (exit_mmap+0x15d/0x1b0 <c01480cd>)
(T1/#277) cc1plus 3510 0 3 00000000 00000115 [0000188528651386] 0.302ms (+0.000ms): __schedule+0xe/0x630 <c027c9be> (preempt_schedule+0x4f/0x70 <c027d13f>)
(T1/#278) cc1plus 3510 0 3 00000000 00000116 [0000188528651843] 0.302ms (+0.000ms): profile_hit+0x9/0x50 <c0115749> (__schedule+0x3a/0x630 <c027c9ea>)
(T1/#279) cc1plus 3510 0 3 00000001 00000117 [0000188528652284] 0.303ms (+0.001ms): sched_clock+0xe/0xe0 <c010c3ae> (__schedule+0x62/0x630 <c027ca12>)
(T1/#280) cc1plus 3510 0 3 00000002 00000118 [0000188528653099] 0.304ms (+0.000ms): dequeue_task+0xa/0x50 <c010f4ea> (__schedule+0x1ab/0x630 <c027cb5b>)
(T1/#281) cc1plus 3510 0 3 00000002 00000119 [0000188528653508] 0.305ms (+0.000ms): recalc_task_prio+0xc/0x1a0 <c010f64c> (__schedule+0x1c5/0x630 <c027cb75>)
(T1/#282) cc1plus 3510 0 3 00000002 0000011a [0000188528653895] 0.306ms (+0.000ms): effective_prio+0x8/0x50 <c010f5f8> (recalc_task_prio+0xa6/0x1a0 <c010f6e6>)
(T1/#283) cc1plus 3510 0 3 00000002 0000011b [0000188528654291] 0.306ms (+0.000ms): enqueue_task+0xa/0x80 <c010f53a> (__schedule+0x1cc/0x630 <c027cb7c>)
(T4/#284) [ => cc1plus ] 0.307ms (+0.000ms)
(T1/#285) <...> 2 0 1 00000002 0000011d [0000188528655354] 0.308ms (+0.000ms): __switch_to+0xb/0x1a0 <c0100f5b> (__schedule+0x2bd/0x630 <c027cc6d>)
(T3/#286) <...>-2 0d..2 309µs : __schedule+0x2ea/0x630 <c027cc9a> <cc1plus-3510> (7d 69):
(T1/#287) <...> 2 0 1 00000002 0000011f [0000188528656152] 0.310ms (+0.000ms): finish_task_switch+0xc/0x90 <c010fdec> (__schedule+0x2f6/0x630 <c027cca6>)
(T1/#288) <...> 2 0 1 00000001 00000120 [0000188528656584] 0.310ms (+0.000ms): trace_stop_sched_switched+0xa/0x150 <c012cc1a> (finish_task_switch+0x43/0x90 <c010fe23>)
(T3/#289) <...>-2 0d..1 311µs : trace_stop_sched_switched+0x42/0x150 <c012cc52> <<...>-2> (69 0):
(T1/#290) <...> 2 0 1 00000001 00000122 [0000188528657710] 0.312ms (+0.000ms): trace_stop_sched_switched+0xfe/0x150 <c012cd0e> (finish_task_switch+0x43/0x90 <c010fe23>)

vim:ft=help