All of lore.kernel.org
 help / color / mirror / Atom feed
From: Manuel Huber <manuel.h87@gmail.com>
To: Gilles Chanteperdrix <gilles.chanteperdrix@xenomai.org>,
	xenomai@xenomai.org
Subject: Re: [Xenomai] Decrease Latency (below 10 us) on x32 or x32_64?
Date: Tue, 02 Apr 2013 19:49:28 +0200	[thread overview]
Message-ID: <515B1A28.6070802@gmail.com> (raw)
In-Reply-To: <5154A702.8060307@xenomai.org>

Hello!

Okay, I miss-configured the last kernel, HPET was still on. Now I compiled
one version on 32bit and one on 64bit. Sorry for the delay, I had some
issues with 64bit (RTL8169 card doesn't work; I have to check what's the
problem (I will open another thread for this, but maybe it's just related
to our machine because there is an on-board chip that may cause the
problem...). I've included two trace-files, one for 32bits and one for
64bits, both with HPET disabled.

I also checked the C1 Setting in BIOS and the kernel configuration:

|---------------------------+----------|
| AMD C1E Support           | Disabled |
| AMD K8 Cool&Quiet control | Disabled |
|---------------------------+----------|
| HPET Support              | Disabled |
|---------------------------+----------|

> You would probably have better latencies with using Xenomai on only one
> core. But 36us with the tracer on does not look so bad, does it?

Is it enough to boot the kernel with isolcpus=cpu-id and then run the
latency tool with the -c option or do I have to restrict IRQ's to the
specific cpu-id? Do I have to adjust /proc/irq/<some-number>/smp_affinity,
or is there some other thing I have to do?

So, the timing of the system is awesome most of the time. I just wanted to
clarify, whether there is a problem with my setup, or it's normal. It would
be cool to get rid of let's say all above 10µs. It just rarely happens, but
it does.

These were the results (tracer disabled) of a test in single/vga mode
(nouveau driver not in use), with heavy stress on the system (nice -20; 10
instances of burnK7) and IRQ mode (latency -t 2) for 1 hour. (I have
already posted them, just to point out the problem)

Thanks again for your help!

Statistics
----------

|-----+---------+---------+---------+---------+-----+-------------------|
| RTH | lat min | lat avg | lat max | overrun | msw | time              |
| RTS |  -3.386 |  -2.725 |  19.469 |       0 |   0 | 01:00:00/01:00:00 |
|-----+---------+---------+---------+---------+-----+-------------------|

|-----+-------+----------+---------+--------|
| HSH | param |  samples | average | stddev |
| HSS | min   |     3599 |  29.278 |  1.983 |
| HSS | avg   | 35994101 |  26.799 |  0.940 |
| HSS | max   |     3599 |  35.500 | 13.080 |
|-----+-------+----------+---------+--------|

Histogram
---------

+-----+--------+
|0    |1       |
+-----+--------+
|0.05 |2289    |
+-----+--------+
|0.15 |2305    |
+-----+--------+
|0.25 |2363    |
+-----+--------+
|0.35 |2327    |
+-----+--------+
|0.45 |2311    |
+-----+--------+
|0.55 |2334    |
+-----+--------+
|0.65 |2446    |
+-----+--------+
|0.75 |2551    |
+-----+--------+
|0.85 |2502    |
+-----+--------+
|0.95 |2561    |
+-----+--------+
|1.05 |2694    |
+-----+--------+
|1.15 |2721    |
+-----+--------+
|1.25 |2726    |
+-----+--------+
|1.35 |2907    |
+-----+--------+
|1.45 |3203    |
+-----+--------+
|1.55 |4114    |
+-----+--------+
|1.65 |4049    |
+-----+--------+
|1.75 |3856    |
+-----+--------+
|1.85 |4423    |
+-----+--------+
|1.95 |5150    |
+-----+--------+
|2.05 |6381    |
+-----+--------+
|2.15 |9045    |
+-----+--------+
|2.25 |17539   |
+-----+--------+
|2.35 |51949   |
+-----+--------+
|2.45 |167344  |
+-----+--------+
|2.55 |444769  |
+-----+--------+
|2.65 |6966129 |
+-----+--------+
|2.75 |25850498|
+-----+--------+
|2.85 |2407380 |
+-----+--------+
|2.95 |3263    |
+-----+--------+
|3.05 |2117    |
+-----+--------+
|3.15 |1878    |
+-----+--------+
|3.25 |1655    |
+-----+--------+
|3.35 |951     |
+-----+--------+
|3.45 |221     |
+-----+--------+
|3.55 |227     |
+-----+--------+
|3.65 |272     |
+-----+--------+
|3.75 |303     |
+-----+--------+
|3.85 |367     |
+-----+--------+
|3.95 |355     |
+-----+--------+
|4.05 |238     |
+-----+--------+
|4.15 |362     |
+-----+--------+
|4.25 |467     |
+-----+--------+
|4.35 |69      |
+-----+--------+
|4.45 |38      |
+-----+--------+
|4.55 |33      |
+-----+--------+
|4.65 |32      |
+-----+--------+
|4.75 |31      |
+-----+--------+
|4.85 |24      |
+-----+--------+
|4.95 |26      |
+-----+--------+
|5.05 |18      |
+-----+--------+
|5.15 |22      |
+-----+--------+
|5.25 |11      |
+-----+--------+
|5.35 |21      |
+-----+--------+
|5.45 |11      |
+-----+--------+
|5.55 |23      |
+-----+--------+
|5.65 |23      |
+-----+--------+
|5.75 |10      |
+-----+--------+
|5.85 |16      |
+-----+--------+
|5.95 |9       |
+-----+--------+
|6.05 |11      |
+-----+--------+
|6.15 |7       |
+-----+--------+
|6.25 |3       |
+-----+--------+
|6.35 |7       |
+-----+--------+
|6.45 |15      |
+-----+--------+
|6.55 |8       |
+-----+--------+
|6.65 |11      |
+-----+--------+
|6.75 |7       |
+-----+--------+
|6.85 |7       |
+-----+--------+
|6.95 |6       |
+-----+--------+
|7.05 |4       |
+-----+--------+
|7.15 |1       |
+-----+--------+
|7.25 |5       |
+-----+--------+
|7.35 |6       |
+-----+--------+
|7.45 |4       |
+-----+--------+
|7.55 |8       |
+-----+--------+
|7.65 |2       |
+-----+--------+
|7.75 |6       |
+-----+--------+
|7.85 |2       |
+-----+--------+
|7.95 |3       |
+-----+--------+
|8.15 |1       |
+-----+--------+
|8.45 |1       |
+-----+--------+
|8.55 |1       |
+-----+--------+
|9.15 |1       |
+-----+--------+
|9.65 |1       |
+-----+--------+
|10.15|1       |
+-----+--------+
|10.55|2       |
+-----+--------+
|10.65|1       |
+-----+--------+
|11.25|1       |
+-----+--------+
|11.35|1       |
+-----+--------+
|12.75|2       |
+-----+--------+
|13.75|1       |
+-----+--------+
|14.15|1       |
+-----+--------+
|15.35|1       |
+-----+--------+
|15.65|1       |
+-----+--------+
|16.95|1       |
+-----+--------+
|19.45|1       |
+-----+--------+
|19.5 |1       |
+-----+--------+

-------------- next part --------------
I-pipe trace results
--------------------
name: 'plain-vga_300_32b_nohpet'

[parameters]
enable = 1
verbose = 1
pre_trace_points = 10
back_trace_points = 1000
post_trace_points = 10


[frozen]
I-pipe frozen back-tracing service on 3.5.7-trace3-nohpet/ipipe release #3
------------------------------------------------------------
CPU: 0, Freeze: 1161030721374 cycles, Trace Points: 1000 (+10)
Calibrated minimum trace-point overhead: 0.077 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
:|   +begin   0x000000ef  -936	  0.233  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -935	  0.275  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -935	  0.216  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -935	  0.222  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -935	  0.339  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -934	  0.418  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -934	  0.259  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -934	  0.205  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -933	  0.250  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1168] -<?>-   99  -933	  0.344  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -933	  0.242  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-838   -933	  0.205  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -932	  0.245  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -932	  0.438  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -932	  0.375  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -931	  0.232  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -931	  0.517  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -931	  0.815  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1168] -<?>-   99  -930	  0.544  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -929	  0.342  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -929	  0.259  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -929	  0.382  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -928	  0.310  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -928	  0.263  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -928+   1.014  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -927	  0.229  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -926	  0.229  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -926	  0.338  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -926	  0.253  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -926	  0.254  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -925	  0.280  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -925	  0.218  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -925	  0.248  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -925	  0.205  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -924	  0.200  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -924	  0.214  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -924	  0.368  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  # func                -924	  0.284  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -923	  0.298  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1168] -<?>-   99  -923	  0.238  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -923	  0.543  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -922	  0.627  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -922	  0.641  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -921	  0.373  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -921	  0.592  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -920	  0.245  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -920	  0.259  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -920	  0.243  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -919	  0.266  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -919	  0.263  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -919	  0.264  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -919	  0.244  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -918	  0.245  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -918	  0.240  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -918	  0.227  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -918	  0.189  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -917	  0.208  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -917	  0.290  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -917	  0.244  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -917	  0.196  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -916	  0.235  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -916	  0.338  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -916	  0.241  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -916	  0.249  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -915	  0.240  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -915	  0.235  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -915	  0.251  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -915	  0.248  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -914	  0.234  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -914	  0.210  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -914	  0.250  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -914	  0.242  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -913	  0.200  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -913	  0.208  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -913	  0.276  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -913	  0.254  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -913	  0.199  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -912	  0.247  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -912	  0.236  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -912	  0.247  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -912	  0.288  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -911	  0.198  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -911	  0.249  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -911!  75.176  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -836	  0.259  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -835	  0.276  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -835	  0.216  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -835	  0.222  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -835	  0.350  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -834	  0.413  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -834	  0.259  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -834	  0.205  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -833	  0.263  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1168] -<?>-   99  -833	  0.344  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -833	  0.245  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-738   -833	  0.211  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -832	  0.240  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -832	  0.432  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -832	  0.380  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -831	  0.228  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -831	  0.525  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -831	  0.816  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1168] -<?>-   99  -830	  0.550  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -829	  0.341  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -829	  0.260  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -829	  0.396  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -828	  0.307  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -828	  0.263  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -828+   1.032  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -827	  0.239  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -826	  0.232  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -826	  0.338  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -826	  0.256  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -826	  0.254  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -825	  0.283  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -825	  0.224  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -825	  0.244  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -825	  0.196  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -824	  0.209  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -824	  0.201  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -824	  0.364  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  # func                -824	  0.292  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -823	  0.315  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1168] -<?>-   99  -823	  0.273  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -823	  0.516  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -822	  0.562  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -822	  0.667  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -821	  0.393  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -821	  0.590  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -820	  0.248  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -820	  0.255  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -819	  0.256  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -819	  0.257  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -819	  0.254  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -819	  0.256  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -818	  0.243  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -818	  0.238  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -818	  0.260  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -818	  0.235  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -817	  0.199  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -817	  0.198  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -817	  0.283  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -817	  0.243  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -817	  0.197  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -816	  0.237  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -816	  0.333  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -816	  0.234  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -816	  0.246  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -815	  0.241  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -815	  0.230  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -815	  0.249  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -815	  0.248  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -814	  0.234  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -814	  0.210  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -814	  0.258  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -814	  0.281  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -813	  0.192  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -813	  0.193  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -813	  0.278  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -813	  0.252  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -812	  0.204  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -812	  0.287  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -812	  0.241  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -812	  0.253  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -811	  0.297  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -811	  0.198  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -811	  0.259  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -811!  75.037  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -736	  0.232  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -735	  0.280  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -735	  0.205  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -735	  0.229  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -735	  0.341  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -734	  0.425  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -734	  0.253  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -734	  0.215  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -733	  0.247  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1168] -<?>-   99  -733	  0.324  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -733	  0.260  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-638   -733	  0.203  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -732	  0.235  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -732	  0.431  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -732	  0.375  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -731	  0.225  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -731	  0.514  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -731	  0.737  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1168] -<?>-   99  -730	  0.543  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -729	  0.344  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -729	  0.251  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -729	  0.403  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -728	  0.307  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -728	  0.267  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -728+   1.019  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -727	  0.220  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -727	  0.217  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -726	  0.306  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -726	  0.225  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -726	  0.220  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -726	  0.253  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -725	  0.223  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -725	  0.212  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -725	  0.197  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -725	  0.202  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -724	  0.204  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -724	  0.364  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  # func                -724	  0.297  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -724	  0.299  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1168] -<?>-   99  -723	  0.239  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -723	  0.518  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -723	  0.560  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -722	  0.659  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -721	  0.378  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -721	  0.592  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -720	  0.258  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -720	  0.257  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -720	  0.251  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -720	  0.260  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -719	  0.261  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -719	  0.260  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -719	  0.245  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -719	  0.240  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -718	  0.257  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -718	  0.233  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -718	  0.226  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -718	  0.198  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -717	  0.291  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -717	  0.246  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -717	  0.196  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -717	  0.234  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -716	  0.325  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -716	  0.234  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -716	  0.246  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -716	  0.236  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -715	  0.226  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -715	  0.250  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -715	  0.248  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -715	  0.234  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -714	  0.210  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -714	  0.243  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -714	  0.244  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -714	  0.200  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -714	  0.208  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -713	  0.276  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -713	  0.254  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -713	  0.199  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -713	  0.247  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -712	  0.236  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -712	  0.254  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -712	  0.286  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -712	  0.202  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -711	  0.253  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -711!  75.469  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -636	  0.229  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -635	  0.280  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -635	  0.205  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -635	  0.229  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -635	  0.347  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -634	  0.420  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -634	  0.253  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -634	  0.215  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -633	  0.247  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1168] -<?>-   99  -633	  0.338  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -633	  0.258  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-538   -633	  0.217  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -632	  0.250  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -632	  0.437  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -632	  0.380  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -631	  0.224  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -631	  0.527  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -631	  0.742  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1168] -<?>-   99  -630	  0.547  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -629	  0.341  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -629	  0.251  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -629	  0.403  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -628	  0.319  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -628	  0.266  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -628+   1.052  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -627	  0.217  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -626	  0.219  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -626	  0.301  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -626	  0.217  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -626	  0.223  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -625	  0.251  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -625	  0.225  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -625	  0.235  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -625	  0.195  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -625	  0.198  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -624	  0.207  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -624	  0.363  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  # func                -624	  0.284  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -624	  0.300  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1168] -<?>-   99  -623	  0.240  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -623	  0.523  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -622	  0.562  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -622	  0.663  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -621	  0.392  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -621	  0.584  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -620	  0.248  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -620	  0.255  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -620	  0.249  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -619	  0.263  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -619	  0.257  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -619	  0.256  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -619	  0.241  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -618	  0.241  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -618	  0.256  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -618	  0.236  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -618	  0.189  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -618	  0.195  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -617	  0.284  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -617	  0.249  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -617	  0.199  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -617	  0.236  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -616	  0.329  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -616	  0.234  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -616	  0.246  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -616	  0.242  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -615	  0.239  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -615	  0.250  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -615	  0.248  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -615	  0.234  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -614	  0.210  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -614	  0.243  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -614	  0.243  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -614	  0.235  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -613	  0.201  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -613	  0.288  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -613	  0.247  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -613	  0.209  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -612	  0.245  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -612	  0.229  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -612	  0.247  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -612	  0.286  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -611	  0.199  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -611	  0.259  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -611!  75.416  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -536	  0.229  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -535	  0.280  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -535	  0.205  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -535	  0.229  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -535	  0.347  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -534	  0.419  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -534	  0.254  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -534	  0.215  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -533	  0.252  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1168] -<?>-   99  -533	  0.336  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -533	  0.247  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-438   -533	  0.204  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -532	  0.245  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -532	  0.429  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -532	  0.375  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -531	  0.225  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -531	  0.500  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -531	  0.737  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1168] -<?>-   99  -530	  0.543  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -529	  0.344  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -529	  0.251  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -529	  0.403  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -528	  0.309  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -528	  0.266  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -528+   1.029  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -527	  0.220  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -526	  0.205  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -526	  0.306  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -526	  0.217  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -526	  0.223  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -526	  0.249  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -525	  0.225  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -525	  0.225  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -525	  0.193  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -525	  0.191  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -524	  0.204  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -524	  0.362  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  # func                -524	  0.297  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -524	  0.299  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1168] -<?>-   99  -523	  0.247  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -523	  0.554  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -522	  0.564  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -522	  0.650  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -521	  0.379  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -521	  0.586  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -520	  0.252  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -520	  0.259  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -520	  0.256  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -520	  0.260  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -519	  0.255  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -519	  0.264  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -519	  0.244  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -518	  0.241  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -518	  0.256  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -518	  0.237  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -518	  0.223  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -518	  0.199  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -517	  0.281  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -517	  0.249  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -517	  0.196  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -517	  0.234  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -516	  0.331  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -516	  0.234  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -516	  0.246  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -516	  0.242  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -515	  0.230  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -515	  0.252  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -515	  0.245  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -515	  0.234  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -514	  0.210  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -514	  0.243  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -514	  0.244  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -514	  0.200  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -513	  0.208  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -513	  0.276  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -513	  0.249  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -513	  0.205  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -513	  0.249  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -512	  0.229  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -512	  0.247  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -512	  0.286  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -512	  0.199  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -511	  0.255  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -511!  75.391  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -436	  0.228  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -435	  0.280  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -435	  0.205  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -435	  0.229  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -435	  0.355  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -434	  0.419  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -434	  0.254  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -434	  0.214  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -433	  0.254  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1168] -<?>-   99  -433	  0.338  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -433	  0.258  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-338   -433	  0.206  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -432	  0.244  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -432	  0.442  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -432	  0.381  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -431	  0.226  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -431	  0.515  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -431	  0.738  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1168] -<?>-   99  -430	  0.564  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -429	  0.341  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -429	  0.251  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -429	  0.395  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -428	  0.310  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -428	  0.264  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -428+   1.004  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -427	  0.249  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -426	  0.219  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -426	  0.301  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -426	  0.217  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -426	  0.218  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -426	  0.245  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -425	  0.223  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -425	  0.232  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -425	  0.201  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -425	  0.196  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -424	  0.205  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -424	  0.364  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  # func                -424	  0.297  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -424	  0.309  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1168] -<?>-   99  -423	  0.239  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -423	  0.518  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -422	  0.560  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -422	  0.659  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -421	  0.395  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -421	  0.597  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -420	  0.261  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -420	  0.257  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -420	  0.255  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -420	  0.257  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -419	  0.254  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -419	  0.256  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -419	  0.244  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -418	  0.241  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -418	  0.255  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -418	  0.236  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -418	  0.189  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -418	  0.195  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -417	  0.284  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -417	  0.249  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -417	  0.204  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -417	  0.231  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -416	  0.329  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -416	  0.235  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -416	  0.249  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -416	  0.242  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -415	  0.230  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -415	  0.268  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -415	  0.251  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -415	  0.226  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -414	  0.208  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -414	  0.262  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -414	  0.270  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -414	  0.193  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -413	  0.193  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -413	  0.278  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -413	  0.252  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -413	  0.204  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -413	  0.248  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -412	  0.230  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -412	  0.247  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -412	  0.286  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -411	  0.199  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -411	  0.259  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -411!  75.408  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -336	  0.233  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -335	  0.279  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -335	  0.216  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -335	  0.222  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -335	  0.350  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -334	  0.428  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -334	  0.260  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -334	  0.215  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -333	  0.241  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1168] -<?>-   99  -333	  0.412  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -333	  0.244  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-238   -333	  0.205  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -332	  0.238  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -332	  0.437  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -332	  0.379  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -331	  0.229  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -331	  0.515  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -331	  0.815  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1168] -<?>-   99  -330	  0.542  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -329	  0.341  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -329	  0.260  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -329	  0.382  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -328	  0.310  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -328	  0.263  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -328+   1.013  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -327	  0.229  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -326	  0.229  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -326	  0.337  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -326	  0.254  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -326	  0.254  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -325	  0.280  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -325	  0.225  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -325	  0.226  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -325	  0.192  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -324	  0.198  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -324	  0.203  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -324	  0.369  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  # func                -324	  0.294  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -323	  0.298  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1168] -<?>-   99  -323	  0.247  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -323	  0.529  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -322	  0.579  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -322	  0.643  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -321	  0.372  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -321	  0.586  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -320	  0.240  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -320	  0.259  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -320	  0.243  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -319	  0.266  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -319	  0.254  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -319	  0.256  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -319	  0.241  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -318	  0.241  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -318	  0.256  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -318	  0.237  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -318	  0.205  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -317	  0.201  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -317	  0.285  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -317	  0.247  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -317	  0.204  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -316	  0.227  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -316	  0.338  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -316	  0.241  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -316	  0.252  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -315	  0.235  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -315	  0.238  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -315	  0.257  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -315	  0.256  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -314	  0.231  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -314	  0.210  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -314	  0.258  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -314	  0.270  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -313	  0.193  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -313	  0.193  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -313	  0.284  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -313	  0.252  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -312	  0.195  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -312	  0.250  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -312	  0.236  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -312	  0.247  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -312	  0.288  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -311	  0.198  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -311	  0.249  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -311!  75.134  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -236	  0.230  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -235	  0.276  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -235	  0.206  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -235	  0.221  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -235	  0.337  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -234	  0.416  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -234	  0.259  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -234	  0.215  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -233	  0.244  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1168] -<?>-   99  -233	  0.417  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -233	  0.247  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-138   -233	  0.205  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -232	  0.244  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -232	  0.446  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -232	  0.380  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -231	  0.228  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -231	  0.521  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -231	  0.816  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1168] -<?>-   99  -230	  0.542  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -229	  0.343  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -229	  0.260  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -229	  0.382  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -228	  0.310  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -228	  0.263  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -228+   1.023  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -227	  0.228  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -226	  0.226  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -226	  0.332  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -226	  0.247  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -226	  0.251  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -225	  0.285  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -225	  0.227  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -225	  0.231  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -225	  0.200  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -224	  0.220  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -224	  0.206  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -224	  0.367  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  # func                -224	  0.294  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -223	  0.299  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1168] -<?>-   99  -223	  0.247  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -223	  0.521  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -222	  0.621  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -222	  0.642  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -221	  0.377  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -221	  0.592  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -220	  0.276  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -220	  0.270  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -219	  0.256  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -219	  0.263  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -219	  0.255  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -219	  0.263  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -218	  0.242  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -218	  0.248  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -218	  0.240  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -218	  0.231  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -217	  0.199  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -217	  0.198  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -217	  0.283  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -217	  0.255  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -216	  0.224  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -216	  0.241  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -216	  0.337  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -216	  0.236  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -215	  0.253  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -215	  0.246  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -215	  0.227  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -215	  0.253  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -214	  0.265  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -214	  0.225  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -214	  0.210  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -214	  0.241  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -214	  0.249  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -213	  0.201  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -213	  0.208  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -213	  0.289  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -213	  0.245  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -212	  0.212  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -212	  0.256  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -212	  0.231  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -212	  0.252  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -211	  0.293  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -211	  0.207  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -211	  0.250  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -211!  74.976  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -136	  0.232  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -135	  0.283  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -135	  0.216  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -135	  0.221  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -135	  0.342  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -134	  0.439  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -134	  0.257  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -134	  0.217  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -133	  0.247  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1168] -<?>-   99  -133	  0.354  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -133	  0.260  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-38    -133	  0.198  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -132	  0.230  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -132	  0.476  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -132	  0.396  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -131	  0.214  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -131	  0.509  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -131	  0.833  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1168] -<?>-   99  -130	  0.544  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -129	  0.358  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -129	  0.239  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -129	  0.375  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -128	  0.310  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -128	  0.266  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -128+   1.024  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -127	  0.227  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -126	  0.233  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -126	  0.323  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -126	  0.240  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -126	  0.233  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -125	  0.266  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -125	  0.237  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -125	  0.234  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -125	  0.213  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -124	  0.222  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -124	  0.220  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -124	  0.388  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  # func                -124	  0.292  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -123	  0.302  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1168] -<?>-   99  -123	  0.228  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -123	  0.279  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -122	  0.279  xntimer_next_local_shot+0x9 (__xnpod_schedule+0x1e0)
:|  # event   tick@-107   -122	  0.211  xntimer_next_local_shot+0xbd (__xnpod_schedule+0x1e0)
:|  # func                -122	  0.231  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -122	  0.504  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -121	  0.623  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -121	  0.648  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -120	  0.366  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -120	  0.591  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -119	  0.251  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -119	  0.259  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -118	  0.264  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -118	  0.267  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -118	  0.254  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -118	  0.256  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -117	  0.240  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -117	  0.241  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -117	  0.255  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -117	  0.232  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -116	  0.204  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -116	  0.198  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -116	  0.291  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -116	  0.244  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -116	  0.196  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -115	  0.235  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -115	  0.338  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -115	  0.241  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -115	  0.249  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -114	  0.240  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -114	  0.235  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -114	  0.257  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -114	  0.256  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -113	  0.231  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -113	  0.233  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -113	  0.259  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -113	  0.244  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -112	  0.199  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -112	  0.205  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -112	  0.283  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -112	  0.248  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -111	  0.196  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -111	  0.248  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -111	  0.234  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -111	  0.253  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -110	  0.296  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -110	  0.196  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -110	  0.257  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -110+   4.796  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -105	  0.233  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -105+   1.861  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -103	  0.342  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -102	  0.311  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -102	  0.442  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -102	  0.558  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -101	  0.376  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -101	  0.353  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-38    -100	  0.332  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -100	  0.513  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -100	  0.754  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                 -99	  0.302  xnintr_host_tick+0x4 (xnintr_clock_handler+0x151)
:|  # func                 -99	  0.553  __ipipe_set_irq_pending+0x6 (xnintr_host_tick+0x50)
:|   +func                 -98	  0.407  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +func                 -98	  0.521  __ipipe_do_sync_stage+0x9 (__ipipe_do_sync_pipeline+0x63)
:|   #end     0x80000000   -97	  0.289  hard_local_irq_enable+0x14 (__ipipe_do_sync_stage+0xbd)
:    #func                 -97	  0.278  __ipipe_do_IRQ+0x5 (__ipipe_do_sync_stage+0x137)
:    #func                 -96	  0.311  __ipipe_get_ioapic_irq_vector+0x3 (__ipipe_do_IRQ+0x1d)
:    #func                 -96	  0.279  smp_apic_timer_interrupt+0x5 (__ipipe_do_IRQ+0x42)
:    #func                 -96	  0.280  irq_enter+0x4 (smp_apic_timer_interrupt+0x21)
:|   #begin   0x80000001   -96	  0.334  debug_smp_processor_id+0x36 (irq_enter+0xe)
:|   #end     0x80000001   -95	  0.317  debug_smp_processor_id+0x82 (irq_enter+0xe)
:    #func                 -95	  0.338  rcu_irq_enter+0x9 (irq_enter+0x15)
:|   #begin   0x80000001   -95	  0.320  debug_smp_processor_id+0x36 (rcu_irq_enter+0x4d)
:|   #end     0x80000001   -94	  0.303  debug_smp_processor_id+0x82 (rcu_irq_enter+0x4d)
:    #func                 -94	  0.286  rcu_idle_exit_common+0x5 (rcu_irq_enter+0x9e)
:|   #begin   0x80000001   -94	  0.334  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001   -93	  0.326  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                 -93	  0.303  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -93	  0.261  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -92	  0.387  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -92	  0.370  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -92	  0.290  local_bh_disable+0x3 (irq_enter+0x39)
:    #func                 -91	  0.289  add_preempt_count+0x4 (local_bh_disable+0x12)
:    #func                 -91	  0.291  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -91	  0.358  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -90	  0.327  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -90	  0.304  tick_check_idle+0x9 (irq_enter+0x40)
:    #func                 -90	  0.284  tick_check_oneshot_broadcast+0x3 (tick_check_idle+0x1b)
:    #func                 -90	  0.392  ktime_get+0x9 (tick_check_idle+0x3a)
:    #func                 -89	  0.297  tick_nohz_stop_idle+0x4 (tick_check_idle+0x50)
:    #func                 -89	  0.272  update_ts_time_stats+0x9 (tick_nohz_stop_idle+0x20)
:    #func                 -89	  0.339  nr_iowait_cpu+0x3 (update_ts_time_stats+0x31)
:    #func                 -88	  0.272  _local_bh_enable+0x3 (irq_enter+0x45)
:    #func                 -88	  0.347  __local_bh_enable+0x4 (_local_bh_enable+0x12)
:    #func                 -88	  0.312  sub_preempt_count+0x3 (__local_bh_enable+0x83)
:    #func                 -87	  0.353  add_preempt_count+0x4 (irq_enter+0x4f)
:    #func                 -87	  0.327  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -87	  0.412  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -86	  0.387  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:|   #begin   0x80000001   -86	  0.341  debug_smp_processor_id+0x36 (smp_apic_timer_interrupt+0x26)
:|   #end     0x80000001   -86	  0.349  debug_smp_processor_id+0x82 (smp_apic_timer_interrupt+0x26)
:    #func                 -85	  0.288  tick_nohz_handler+0x9 (smp_apic_timer_interrupt+0x58)
:|   #begin   0x80000001   -85	  0.337  debug_smp_processor_id+0x36 (tick_nohz_handler+0x1b)
:|   #end     0x80000001   -85	  0.327  debug_smp_processor_id+0x82 (tick_nohz_handler+0x1b)
:|   #begin   0x80000001   -84	  0.355  debug_smp_processor_id+0x36 (tick_nohz_handler+0x30)
:|   #end     0x80000001   -84	  0.307  debug_smp_processor_id+0x82 (tick_nohz_handler+0x30)
:    #func                 -84	  0.379  ktime_get+0x9 (tick_nohz_handler+0x38)
:    #func                 -83	  0.288  update_root_process_times+0x4 (tick_nohz_handler+0x81)
:    #func                 -83	  0.276  update_process_times+0x6 (update_root_process_times+0x24)
:|   #begin   0x80000001   -83	  0.331  debug_smp_processor_id+0x36 (update_process_times+0x19)
:|   #end     0x80000001   -82	  0.306  debug_smp_processor_id+0x82 (update_process_times+0x19)
:    #func                 -82	  0.317  account_process_tick+0x6 (update_process_times+0x24)
:|   #begin   0x80000001   -82	  0.335  debug_smp_processor_id+0x36 (account_process_tick+0x19)
:|   #end     0x80000001   -81	  0.366  debug_smp_processor_id+0x82 (account_process_tick+0x19)
:    #func                 -81	  0.307  account_idle_time+0x6 (account_process_tick+0x76)
:|   #begin   0x80000001   -81	  0.328  debug_smp_processor_id+0x36 (account_idle_time+0x1c)
:|   #end     0x80000001   -80	  0.345  debug_smp_processor_id+0x82 (account_idle_time+0x1c)
:|   #begin   0x80000001   -80	  0.357  debug_smp_processor_id+0x36 (account_idle_time+0x28)
:|   #end     0x80000001   -80	  0.378  debug_smp_processor_id+0x82 (account_idle_time+0x28)
:    #func                 -79	  0.251  run_local_timers+0x3 (update_process_times+0x29)
:    #func                 -79	  0.296  hrtimer_run_queues+0x9 (run_local_timers+0xd)
:|   #begin   0x80000001   -79	  0.331  debug_smp_processor_id+0x36 (hrtimer_run_queues+0x1b)
:|   #end     0x80000001   -78	  0.320  debug_smp_processor_id+0x82 (hrtimer_run_queues+0x1b)
:    #func                 -78	  0.326  get_xtime_and_monotonic_and_sleep_offset+0x6 (hrtimer_run_queues+0x58)
:    #func                 -78	  0.251  _raw_spin_lock+0x4 (hrtimer_run_queues+0xc9)
:    #func                 -77	  0.267  add_preempt_count+0x4 (_raw_spin_lock+0x15)
:    #func                 -77	  0.262  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -77	  0.394  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -77	  0.380  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -76	  0.262  _raw_spin_unlock+0x3 (hrtimer_run_queues+0x267)
:    #func                 -76	  0.339  sub_preempt_count+0x3 (_raw_spin_unlock+0x15)
:    #func                 -76	  0.323  raise_softirq+0x4 (run_local_timers+0x17)
:    #func                 -75	  0.279  __raise_softirq_irqoff+0x5 (raise_softirq_irqoff+0x8)
:    #func                 -75	  0.277  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -75	  0.286  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -74	  0.390  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -74	  0.385  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -74	  0.272  rcu_check_callbacks+0x5 (update_process_times+0x32)
:    #func                 -73	  0.265  rcu_is_cpu_rrupt_from_idle+0x4 (rcu_check_callbacks+0x21)
:|   #begin   0x80000001   -73	  0.376  debug_smp_processor_id+0x36 (rcu_is_cpu_rrupt_from_idle+0x13)
:|   #end     0x80000001   -73	  0.326  debug_smp_processor_id+0x82 (rcu_is_cpu_rrupt_from_idle+0x13)
:    #func                 -72	  0.328  __rcu_pending+0x9 (rcu_check_callbacks+0xc3)
:    #func                 -72	  0.295  __rcu_pending+0x9 (rcu_check_callbacks+0xdd)
:    #func                 -72	  0.439  __rcu_pending+0x9 (rcu_check_callbacks+0xf7)
:    #func                 -71	  0.362  raise_softirq+0x4 (rcu_check_callbacks+0x105)
:    #func                 -71	  0.301  __raise_softirq_irqoff+0x5 (raise_softirq_irqoff+0x8)
:    #func                 -71	  0.285  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -70	  0.285  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -70	  0.394  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -70	  0.361  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -69	  0.282  printk_tick+0x5 (update_process_times+0x37)
:|   #begin   0x80000001   -69	  0.394  debug_smp_processor_id+0x36 (irq_work_run+0x10)
:|   #end     0x80000001   -69	  0.328  debug_smp_processor_id+0x82 (irq_work_run+0x10)
:    #func                 -68	  0.315  scheduler_tick+0x9 (update_process_times+0x51)
:|   #begin   0x80000001   -68	  0.344  debug_smp_processor_id+0x36 (scheduler_tick+0x18)
:|   #end     0x80000001   -68	  0.306  debug_smp_processor_id+0x82 (scheduler_tick+0x18)
:    #func                 -67	  0.287  _raw_spin_lock+0x4 (scheduler_tick+0x36)
:    #func                 -67	  0.310  add_preempt_count+0x4 (_raw_spin_lock+0x15)
:    #func                 -67	  0.295  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -66	  0.416  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -66	  0.380  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -66	  0.414  update_rq_clock+0x6 (scheduler_tick+0x3d)
:|   #begin   0x80000001   -65	  0.357  debug_smp_processor_id+0x36 (__cycles_2_ns+0x17)
:|   #end     0x80000001   -65	  0.374  debug_smp_processor_id+0x82 (__cycles_2_ns+0x17)
:    #func                 -64	  0.338  __update_cpu_load+0x9 (scheduler_tick+0x54)
:    #func                 -64	  0.303  sched_avg_update+0x9 (__update_cpu_load+0xa5)
:    #func                 -64	  0.288  task_tick_idle+0x3 (scheduler_tick+0x9e)
:    #func                 -64	  0.295  _raw_spin_unlock+0x3 (scheduler_tick+0xa5)
:    #func                 -63	  0.404  sub_preempt_count+0x3 (_raw_spin_unlock+0x15)
:|   #begin   0x80000001   -63	  0.327  debug_smp_processor_id+0x36 (perf_event_task_tick+0x13)
:|   #end     0x80000001   -63	  0.378  debug_smp_processor_id+0x82 (perf_event_task_tick+0x13)
:    #func                 -62	  0.288  trigger_load_balance+0x9 (scheduler_tick+0xeb)
:    #func                 -62	  0.313  idle_cpu+0x3 (trigger_load_balance+0x4e)
:    #func                 -62	  0.404  run_posix_cpu_timers+0x9 (update_process_times+0x58)
:    #func                 -61	  0.362  hrtimer_forward+0xc (tick_nohz_handler+0xa8)
:    #func                 -61	  0.296  ktime_add_safe+0x8 (hrtimer_forward+0xfb)
:    #func                 -60	  0.285  ktime_add_safe+0x8 (hrtimer_forward+0x114)
:    #func                 -60	  0.275  tick_program_event+0x4 (tick_nohz_handler+0xb5)
:    #func                 -60	  0.282  clockevents_program_event+0x9 (tick_program_event+0x24)
:    #func                 -60	  0.440  ktime_get+0x9 (clockevents_program_event+0x71)
:    #func                 -59	  0.354  xnarch_next_htick_shot+0x5 (clockevents_program_event+0xd8)
:|   #begin   0x80000000   -59	  0.525  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  *#func                 -58	  0.322  xntimer_start_aperiodic+0x9 (xnarch_next_htick_shot+0x42)
:|  *#func                 -58	  0.564  xnarch_ns_to_tsc+0x9 (xntimer_start_aperiodic+0x78)
:|  *#func                 -57	  0.364  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|   #end     0x80000000   -57	  0.358  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:    #func                 -57	  0.290  irq_exit+0x3 (smp_apic_timer_interrupt+0x5d)
:    #func                 -56	  0.288  sub_preempt_count+0x3 (irq_exit+0x12)
:    #func                 -56	  0.328  do_softirq+0x9 (irq_exit+0x3a)
:    #func                 -56	  0.290  __do_softirq+0x9 (do_softirq+0x86)
:    #func                 -56	  0.268  add_preempt_count+0x4 (__do_softirq+0x1f)
:    #func                 -55	  0.317  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -55	  0.387  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -55	  0.368  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:|   #begin   0x80000001   -54	  0.317  debug_smp_processor_id+0x36 (__do_softirq+0x24)
:|   #end     0x80000001   -54	  0.319  debug_smp_processor_id+0x82 (__do_softirq+0x24)
:    #func                 -54	  0.269  ipipe_unstall_root+0x3 (__do_softirq+0x43)
:|   #begin   0x80000000   -53	  0.315  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -53	  0.490  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -52	  0.319  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                 -52	  0.276  run_timer_softirq+0x9 (__do_softirq+0xa4)
:    +func                 -52	  0.295  hrtimer_run_pending+0x3 (run_timer_softirq+0x1a)
:    +func                 -52	  0.294  tick_check_oneshot_change+0x6 (hrtimer_run_pending+0x12)
:|   +begin   0x80000001   -51	  0.313  debug_smp_processor_id+0x36 (tick_check_oneshot_change+0x17)
:|   +end     0x80000001   -51	  0.418  debug_smp_processor_id+0x82 (tick_check_oneshot_change+0x17)
:    +func                 -51	  0.335  _raw_spin_lock_irq+0x4 (run_timer_softirq+0x2f)
:    #func                 -50	  0.283  add_preempt_count+0x4 (_raw_spin_lock_irq+0x28)
:    #func                 -50	  0.295  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -50	  0.422  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -49	  0.430  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -49	  0.284  _raw_spin_unlock_irq+0x3 (run_timer_softirq+0x219)
:    #func                 -48	  0.288  ipipe_unstall_root+0x3 (_raw_spin_unlock_irq+0x10)
:|   #begin   0x80000000   -48	  0.313  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -48	  0.464  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -47	  0.303  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                 -47	  0.323  sub_preempt_count+0x3 (_raw_spin_unlock_irq+0x1a)
:    +func                 -47	  0.355  rcu_bh_qs+0x3 (__do_softirq+0x118)
:    +func                 -46	  0.358  rcu_process_callbacks+0x4 (__do_softirq+0xa4)
:|   +begin   0x80000001   -46	  0.327  debug_smp_processor_id+0x36 (rcu_process_callbacks+0x1d)
:|   +end     0x80000001   -46	  0.305  debug_smp_processor_id+0x82 (rcu_process_callbacks+0x1d)
:    +func                 -45	  0.310  __rcu_process_callbacks+0x9 (rcu_process_callbacks+0x35)
:    +func                 -45	  0.329  force_quiescent_state+0x9 (__rcu_process_callbacks+0x57)
:    +func                 -45	  0.307  rcu_process_gp_end+0x6 (__rcu_process_callbacks+0x61)
:    #func                 -44	  0.331  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -44	  0.315  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -44	  0.418  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -43	  0.352  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -43	  0.294  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000   -43	  0.326  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -42	  0.425  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -42	  0.331  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                 -42	  0.378  check_for_new_grace_period+0x9 (__rcu_process_callbacks+0x6b)
:    #func                 -41	  0.261  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -41	  0.270  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -41	  0.351  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -40	  0.314  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -40	  0.300  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000   -40	  0.336  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -39	  0.445  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -39	  0.303  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001   -39	  0.354  debug_smp_processor_id+0x36 (rcu_process_callbacks+0x3a)
:|   +end     0x80000001   -38	  0.307  debug_smp_processor_id+0x82 (rcu_process_callbacks+0x3a)
:    +func                 -38	  0.317  __rcu_process_callbacks+0x9 (rcu_process_callbacks+0x52)
:    +func                 -38	  0.286  force_quiescent_state+0x9 (__rcu_process_callbacks+0x57)
:    +func                 -37	  0.347  rcu_process_gp_end+0x6 (__rcu_process_callbacks+0x61)
:    #func                 -37	  0.347  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -37+   1.002  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x000000ef   -36	  0.360  apic_timer_interrupt+0x37 (__ipipe_trace+0x527)
:|   #func                 -35	  0.374  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   #func                 -35	  0.326  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   #func                 -35	  0.333  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   #func                 -34	  0.568  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  #*func                 -34+   1.291  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  #*func                 -33!  17.026  __xnlock_spin+0x9 (T.1241+0x47)
:|  #*func                 -15	  0.342  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  #*func                 -15	  0.291  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  #*func                 -15	  0.356  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  #*[ 1168] -<?>-   99   -15	  0.438  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  #*func                 -14	  0.310  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  #*event   tick@61      -14	  0.282  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  #*func                 -13	  0.307  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  #*func                 -13	  0.523  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  #*func                 -13	  0.490  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  #*[    0] -<?>-   -1   -12	  0.268  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  #*func                 -12	  0.699  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  #*func                 -11	  0.937  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  #*[ 1168] -<?>-   99   -10	  0.735  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  #*func                 -10	  0.496  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  #*func                  -9	  0.319  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  +*end     0x80000000    -9	  0.564  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  +*begin   0x80000001    -8	  0.490  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  +*end     0x80000001    -8	  0.393  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  +*begin   0x80000001    -7+   1.430  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   +*func                  -6	  0.329  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   +*func                  -5	  0.352  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  +*begin   0x80000001    -5	  0.429  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  +*end     0x80000001    -5	  0.348  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   +*func                  -4	  0.295  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  +*begin   0x80000001    -4	  0.379  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  +*end     0x80000001    -4	  0.325  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   +*func                  -3	  0.390  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   +*func                  -3	  0.298  xnshadow_sys_trace+0x6 (hisyscall_event+0x11b)
:   +*func                  -3	  0.404  ipipe_trace_frozen_reset+0x6 (xnshadow_sys_trace+0x5c)
:   +*func                  -2	  0.310  __ipipe_global_path_lock+0x9 (ipipe_trace_frozen_reset+0x1a)
:   +*func                  -2	  0.342  __ipipe_spin_lock_irqsave+0x5 (__ipipe_global_path_lock+0x1d)
:|  +*begin   0x80000001    -2+   1.274  hard_local_irq_save+0x16 (__ipipe_spin_lock_irqsave+0x11)
:|  #*func                   0	  0.459  __ipipe_spin_unlock_irqcomplete+0x4 (__ipipe_global_path_unlock+0x62)
:|  +*end     0x80000001     0	  0.371  hard_local_irq_restore+0x15 (__ipipe_spin_unlock_irqcomplete+0x24)
<   +*freeze  0x00006bee     0	  0.327  xnshadow_sys_trace+0x65 (hisyscall_event+0x11b)
 |  +*begin   0x80000001     0	  0.448  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
 |  +*end     0x80000001     0	  0.325  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
 |  +*begin   0x80000001     1	  1.071  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
    +*func                   2	  0.306  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
    +*func                   2	  0.270  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
 |  +*begin   0x80000001     2	  0.431  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
 |  +*end     0x80000001     3	  0.340  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
    +*func                   3	  0.286  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
 |  +*begin   0x80000001     3	  0.338  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
 |  +*end     0x80000001     4	  0.000  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)


[max]
I-pipe worst-case tracing service on 3.5.7-trace3-nohpet/ipipe release #3
-------------------------------------------------------------
CPU: 0, Begin: 333249077817 cycles, Trace Points: 8 (-10/+5), Length: 3880 us
Calibrated minimum trace-point overhead: 0.077 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
     #func                  -3	  0.245  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
 |   #begin   0x80000001    -2	  0.344  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
 |   #end     0x80000001    -2	  0.314  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
     #func                  -2	  0.260  default_idle+0x3 (cpu_idle+0x5d)
 |   #begin   0x80000001    -1	  0.320  debug_smp_processor_id+0x36 (default_idle+0xd)
 |   #end     0x80000001    -1	  0.307  debug_smp_processor_id+0x82 (default_idle+0xd)
 |   #begin   0x80000001    -1	  0.325  debug_smp_processor_id+0x36 (default_idle+0x1e)
 |   #end     0x80000001     0	  0.391  debug_smp_processor_id+0x82 (default_idle+0x1e)
     #func                   0	  0.257  __ipipe_halt_root+0x3 (default_idle+0x48)
 |   #begin   0x80000000     0	  0.347  __ipipe_halt_root+0x1a (default_idle+0x48)
>|   +end     0x8000000e     0! 3877.882  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +func                3877	  0.471  __ipipe_handle_irq+0x9 (reschedule_interrupt+0x3e)
:|   +func                3878	  0.434  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                3878	  0.491  __ipipe_ack_apic+0x3 (__ipipe_dispatch_irq+0xa4)
:|   +func                3879	  0.594  __ipipe_set_irq_pending+0x6 (__ipipe_dispatch_irq+0x19a)
:|   +func                3879	  0.510  __ipipe_do_sync_pipeline+0x4 (__ipipe_sync_pipeline+0x1c)
:|   +func                3880	  0.527  __ipipe_do_sync_stage+0x9 (__ipipe_do_sync_pipeline+0x63)
<|   #end     0x80000000  3880	  0.456  hard_local_irq_enable+0x14 (__ipipe_do_sync_stage+0xbd)
     #func                3881	  0.397  __ipipe_do_IRQ+0x5 (__ipipe_do_sync_stage+0x137)
     #func                3881	  0.477  __ipipe_get_ioapic_irq_vector+0x3 (__ipipe_do_IRQ+0x1d)
     #func                3882	  0.334  smp_reschedule_interrupt+0x3 (__ipipe_do_IRQ+0x42)
     #func                3882	  0.377  scheduler_ipi+0x4 (smp_reschedule_interrupt+0x14)
 |   #begin   0x80000001  3882	  0.000  debug_smp_processor_id+0x36 (scheduler_ipi+0x13)
-------------- next part --------------
I-pipe trace results
--------------------
name: 'plain-vga_300_no_usb'

[parameters]
enable = 1
verbose = 1
pre_trace_points = 10
back_trace_points = 1000
post_trace_points = 10


[frozen]
I-pipe frozen back-tracing service on 3.5.7-trace/ipipe release #3
------------------------------------------------------------
CPU: 0, Freeze: 32787094157468 cycles, Trace Points: 1000 (+10)
Calibrated minimum trace-point overhead: 0.078 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
:|  # func               -1126	  0.468  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func               -1125	  0.322  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000 -1125	  0.487  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001 -1125	  0.409  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001 -1124	  0.357  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001 -1124+   1.300  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func               -1123	  0.271  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func               -1122	  0.278  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001 -1122	  0.384  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001 -1122	  0.309  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func               -1121	  0.281  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001 -1121	  0.340  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001 -1121	  0.295  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func               -1120	  0.270  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func               -1120	  0.254  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func               -1120	  0.264  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func               -1120	  0.284  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000 -1119	  0.511  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func               -1119	  0.368  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func               -1118	  0.408  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99 -1118	  0.311  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func               -1118	  0.633  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func               -1117	  0.705  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1 -1116	  0.818  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func               -1116	  0.506  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef -1115	  0.737  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001 -1114	  0.353  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001 -1114	  0.347  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001 -1114	  0.322  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001 -1113	  0.341  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func               -1113	  0.322  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001 -1113	  0.349  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001 -1112	  0.317  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func               -1112	  0.320  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001 -1112	  0.320  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001 -1111	  0.312  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func               -1111	  0.263  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func               -1111	  0.285  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001 -1111	  0.369  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001 -1110	  0.327  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func               -1110	  0.254  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000 -1110	  0.308  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func               -1109	  0.420  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000 -1109	  0.317  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001 -1109	  0.317  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001 -1108	  0.319  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func               -1108	  0.305  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func               -1108	  0.326  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001 -1107	  0.325  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001 -1107	  0.300  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func               -1107	  0.273  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001 -1106	  0.335  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001 -1106	  0.373  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func               -1106	  0.265  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func               -1105	  0.259  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001 -1105	  0.366  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001 -1105	  0.337  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func               -1104	  0.266  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001 -1104	  0.330  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001 -1104	  0.321  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001 -1103	  0.338  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001 -1103	  0.383  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func               -1103	  0.252  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000 -1103	  0.330  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e -1102!  68.125  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef -1034	  0.310  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func               -1034	  0.361  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func               -1033	  0.284  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func               -1033	  0.288  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func               -1033	  0.454  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func               -1032	  0.545  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func               -1032	  0.320  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func               -1031	  0.292  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func               -1031	  0.301  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99 -1031	  0.476  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func               -1030	  0.318  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-937  -1030	  0.254  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func               -1030	  0.295  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func               -1030	  0.572  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func               -1029	  0.483  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1 -1028	  0.269  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func               -1028	  0.637  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func               -1028+   1.019  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99 -1027	  0.639  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func               -1026	  0.468  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func               -1025	  0.315  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000 -1025	  0.475  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001 -1025	  0.412  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001 -1024	  0.344  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001 -1024+   1.304  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func               -1023	  0.278  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func               -1022	  0.279  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001 -1022	  0.384  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001 -1022	  0.309  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func               -1021	  0.280  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001 -1021	  0.326  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001 -1021	  0.301  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func               -1020	  0.274  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func               -1020	  0.246  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func               -1020	  0.251  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func               -1020	  0.269  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000 -1019	  0.480  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func               -1019	  0.348  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func               -1019	  0.367  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99 -1018	  0.320  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func               -1018	  0.645  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func               -1017	  0.707  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1 -1017	  0.842  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func               -1016	  0.488  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef -1015	  0.732  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001 -1014	  0.326  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001 -1014	  0.310  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001 -1014	  0.320  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001 -1014	  0.339  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func               -1013	  0.344  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001 -1013	  0.349  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001 -1012	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func               -1012	  0.335  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001 -1012	  0.336  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001 -1011	  0.298  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func               -1011	  0.286  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func               -1011	  0.260  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001 -1011	  0.371  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001 -1010	  0.322  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func               -1010	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000 -1010	  0.312  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func               -1009	  0.428  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000 -1009	  0.323  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001 -1009	  0.331  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001 -1008	  0.323  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func               -1008	  0.305  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func               -1008	  0.326  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001 -1007	  0.328  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001 -1007	  0.320  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func               -1007	  0.273  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001 -1006	  0.335  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001 -1006	  0.373  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func               -1006	  0.254  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func               -1005	  0.251  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001 -1005	  0.378  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001 -1005	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func               -1005	  0.266  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001 -1004	  0.317  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001 -1004	  0.314  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001 -1004	  0.346  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001 -1003	  0.384  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func               -1003	  0.252  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000 -1003	  0.330  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e -1002!  68.190  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -934	  0.310  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -934	  0.361  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -933	  0.269  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -933	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -933	  0.453  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -932	  0.548  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -932	  0.313  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -932	  0.290  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -931	  0.315  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -931	  0.434  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -931	  0.319  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-837   -930	  0.254  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -930	  0.294  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -930	  0.572  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -929	  0.503  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -929	  0.271  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -928	  0.648  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -928+   1.012  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -927	  0.640  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -926	  0.468  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -926	  0.310  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -925	  0.478  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -925	  0.452  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -924	  0.337  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -924+   1.296  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -923	  0.279  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -922	  0.295  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -922	  0.400  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -922	  0.307  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -921	  0.278  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -921	  0.341  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -921	  0.322  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -920	  0.285  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -920	  0.263  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -920	  0.261  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -920	  0.282  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -919	  0.488  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -919	  0.343  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -919	  0.363  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -918	  0.310  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -918	  0.634  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -917	  0.779  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -916	  0.856  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -916	  0.487  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -915	  0.732  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -914	  0.331  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -914	  0.336  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -914	  0.321  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -913	  0.339  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -913	  0.326  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -913	  0.349  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -912	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -912	  0.319  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -912	  0.320  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -911	  0.313  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -911	  0.253  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -911	  0.257  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -911	  0.377  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -910	  0.322  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -910	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -910	  0.313  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -909	  0.420  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -909	  0.322  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -909	  0.331  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -908	  0.323  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -908	  0.305  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -908	  0.326  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -907	  0.328  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -907	  0.309  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -907	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -906	  0.332  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -906	  0.373  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -906	  0.265  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -905	  0.259  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -905	  0.370  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -905	  0.322  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -904	  0.278  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -904	  0.332  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -904	  0.321  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -904	  0.349  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -903	  0.383  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -903	  0.252  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -903	  0.325  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -902!  68.134  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -834	  0.310  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -834	  0.361  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -833	  0.284  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -833	  0.288  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -833	  0.431  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -832	  0.539  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -832	  0.320  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -832	  0.292  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -831	  0.300  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -831	  0.476  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -830	  0.318  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-737   -830	  0.254  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -830	  0.295  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -830	  0.575  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -829	  0.484  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -829	  0.268  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -828	  0.640  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -828+   1.019  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -827	  0.639  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -826	  0.468  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -825	  0.315  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -825	  0.476  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -825	  0.412  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -824	  0.344  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -824+   1.299  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -823	  0.279  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -822	  0.278  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -822	  0.384  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -822	  0.309  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -821	  0.281  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -821	  0.326  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -821	  0.301  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -820	  0.283  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -820	  0.256  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -820	  0.260  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -820	  0.264  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -819	  0.487  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -819	  0.345  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -819	  0.366  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -818	  0.302  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -818	  0.645  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -817	  0.706  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -817	  0.842  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -816	  0.488  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -815	  0.732  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -814	  0.326  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -814	  0.342  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -814	  0.321  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -814	  0.339  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -813	  0.344  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -813	  0.348  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -812	  0.323  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -812	  0.335  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -812	  0.332  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -811	  0.298  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -811	  0.277  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -811	  0.269  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -811	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -810	  0.329  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -810	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -810	  0.324  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -809	  0.428  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -809	  0.313  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -809	  0.322  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -808	  0.312  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -808	  0.298  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -808	  0.322  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -807	  0.336  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -807	  0.309  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -807	  0.273  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -806	  0.335  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -806	  0.373  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -806	  0.265  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -805	  0.259  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -805	  0.370  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -805	  0.325  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -805	  0.266  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -804	  0.335  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -804	  0.321  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -804	  0.338  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -803	  0.383  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -803	  0.248  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -803	  0.320  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -802!  68.284  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -734	  0.310  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -734	  0.361  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -733	  0.269  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -733	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -733	  0.449  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -732	  0.545  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -732	  0.323  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -731	  0.320  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -731	  0.302  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -731	  0.459  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -730	  0.350  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-637   -730	  0.248  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -730	  0.295  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -729	  0.559  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -729	  0.473  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -728	  0.272  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -728	  0.655  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -728+   1.014  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -727	  0.642  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -726	  0.469  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -725	  0.317  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -725	  0.483  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -725	  0.412  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -724	  0.340  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -724+   1.327  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -723	  0.297  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -722	  0.298  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -722	  0.384  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -722	  0.300  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -721	  0.273  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -721	  0.324  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -721	  0.301  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -720	  0.280  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -720	  0.257  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -720	  0.292  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -720	  0.272  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -719	  0.478  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -719	  0.342  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -718	  0.417  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -718	  0.317  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -718	  0.630  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -717	  0.713  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -716	  0.845  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -715	  0.487  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -715	  0.738  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -714	  0.328  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -714	  0.340  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -714	  0.321  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -713	  0.339  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -713	  0.344  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -713	  0.349  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -712	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -712	  0.335  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -712	  0.332  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -711	  0.324  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -711	  0.272  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -711	  0.260  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -710	  0.380  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -710	  0.329  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -710	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -709	  0.320  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -709	  0.414  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -709	  0.317  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -708	  0.317  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -708	  0.323  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -708	  0.305  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -707	  0.326  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -707	  0.328  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -707	  0.309  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -706	  0.273  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -706	  0.335  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -706	  0.373  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -705	  0.265  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -705	  0.259  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -705	  0.370  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -705	  0.325  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -704	  0.266  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -704	  0.330  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -704	  0.321  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -703	  0.338  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -703	  0.383  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -703	  0.252  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -702	  0.330  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -702!  67.989  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -634	  0.310  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -634	  0.361  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -633	  0.284  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -633	  0.288  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -633	  0.448  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -632	  0.559  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -632	  0.316  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -631	  0.281  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -631	  0.300  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -631	  0.422  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -630	  0.321  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-537   -630	  0.254  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -630	  0.295  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -630	  0.572  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -629	  0.483  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -629	  0.269  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -628	  0.637  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -628+   1.019  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -627	  0.639  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -626	  0.468  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -626	  0.315  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -625	  0.476  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -625	  0.412  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -624	  0.344  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -624+   1.329  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -623	  0.283  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -622	  0.278  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -622	  0.384  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -622	  0.309  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -621	  0.280  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -621	  0.326  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -621	  0.301  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -620	  0.283  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -620	  0.256  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -620	  0.260  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -620	  0.264  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -619	  0.487  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -619	  0.345  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -619	  0.366  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -618	  0.303  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -618	  0.644  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -617	  0.713  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -617	  0.835  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -616	  0.487  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -615	  0.732  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -615	  0.326  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -614	  0.342  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -614	  0.321  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -614	  0.339  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -613	  0.344  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -613	  0.349  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -612	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -612	  0.335  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -612	  0.332  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -611	  0.298  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -611	  0.277  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -611	  0.260  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -611	  0.375  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -610	  0.322  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -610	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -610	  0.321  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -609	  0.431  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -609	  0.313  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -609	  0.322  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -608	  0.329  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -608	  0.305  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -608	  0.326  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -607	  0.328  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -607	  0.309  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -607	  0.273  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -606	  0.361  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -606	  0.376  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -606	  0.260  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -605	  0.251  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -605	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -605	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -604	  0.267  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -604	  0.330  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -604	  0.314  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -604	  0.347  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -603	  0.385  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -603	  0.259  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -603	  0.334  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -602!  68.191  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -534	  0.312  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -534	  0.358  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -533	  0.274  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -533	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -533	  0.453  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -532	  0.621  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -532	  0.324  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -531	  0.282  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -531	  0.309  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -531	  0.422  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -530	  0.309  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-437   -530	  0.262  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -530	  0.286  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -530	  0.566  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -529	  0.474  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -529	  0.270  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -528	  0.640  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -528+   1.013  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -527	  0.638  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -526	  0.469  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -525	  0.316  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -525	  0.490  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -525	  0.410  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -524	  0.337  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -524+   1.297  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -523	  0.274  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -522	  0.280  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -522	  0.389  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -522	  0.299  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -521	  0.276  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -521	  0.324  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -521	  0.314  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -520	  0.288  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -520	  0.255  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -520	  0.249  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -520	  0.268  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -519	  0.502  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -519	  0.353  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -519	  0.398  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -518	  0.315  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -518	  0.639  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -517	  0.718  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -516	  0.838  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -516	  0.491  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -515	  0.746  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -514	  0.341  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -514	  0.310  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -514	  0.332  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -513	  0.328  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -513	  0.345  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -513	  0.353  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -512	  0.320  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -512	  0.336  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -512	  0.314  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -511	  0.305  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -511	  0.285  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -511	  0.255  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -511	  0.378  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -510	  0.323  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -510	  0.254  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -510	  0.312  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -509	  0.415  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -509	  0.319  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -509	  0.329  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -508	  0.321  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -508	  0.310  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -508	  0.332  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -507	  0.320  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -507	  0.311  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -507	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -506	  0.332  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -506	  0.369  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -506	  0.248  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -505	  0.272  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -505	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -505	  0.334  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -504	  0.270  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -504	  0.319  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -504	  0.314  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -504	  0.347  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -503	  0.379  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -503	  0.259  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -503	  0.334  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -502!  68.117  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -434	  0.307  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -434	  0.358  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -433	  0.274  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -433	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -433	  0.420  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -432	  0.618  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -432	  0.323  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -432	  0.282  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -431	  0.302  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -431	  0.430  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -431	  0.314  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-337   -430	  0.255  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -430	  0.302  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -430	  0.572  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -429	  0.502  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -429	  0.276  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -428	  0.640  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -428+   1.016  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -427	  0.638  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -426	  0.469  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -426	  0.316  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -425	  0.466  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -425	  0.410  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -424	  0.336  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -424+   1.302  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -423	  0.274  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -422	  0.280  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -422	  0.389  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -422	  0.291  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -421	  0.276  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -421	  0.324  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -421	  0.302  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -421	  0.310  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -420	  0.286  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -420	  0.260  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -420	  0.311  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -419	  0.478  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -419	  0.347  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -419	  0.409  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -418	  0.305  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -418	  0.643  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -417	  0.711  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -416	  0.838  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -416	  0.488  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -415	  0.735  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -414	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -414	  0.305  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -414	  0.332  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -413	  0.383  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -413	  0.337  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -413	  0.341  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -412	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -412	  0.339  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -412	  0.315  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -411	  0.296  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -411	  0.281  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -411	  0.263  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -411	  0.369  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -410	  0.322  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -410	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -410	  0.317  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -409	  0.429  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -409	  0.304  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -409	  0.330  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -408	  0.324  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -408	  0.310  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -408	  0.332  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -407	  0.320  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -407	  0.311  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -407	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -406	  0.332  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -406	  0.376  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -406	  0.260  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -405	  0.251  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -405	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -405	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -404	  0.266  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -404	  0.317  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -404	  0.314  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -404	  0.346  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -403	  0.379  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -403	  0.259  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -403	  0.330  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -402!  68.232  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -334	  0.307  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -334	  0.358  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -333	  0.274  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -333	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -333	  0.433  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -332	  0.543  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -332	  0.324  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -332	  0.282  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -331	  0.312  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -331	  0.424  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -330	  0.317  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-237   -330	  0.258  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -330	  0.305  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -330	  0.569  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -329	  0.545  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -328	  0.276  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -328	  0.652  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -328+   1.018  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -327	  0.639  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -326	  0.469  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -325	  0.317  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -325	  0.506  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -325	  0.405  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -324	  0.337  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -324+   1.299  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -323	  0.274  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -322	  0.280  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -322	  0.389  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -322	  0.291  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -321	  0.274  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -321	  0.324  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -321	  0.306  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -320	  0.286  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -320	  0.249  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -320	  0.269  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -320	  0.273  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -319	  0.493  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -319	  0.353  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -318	  0.391  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -318	  0.315  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -318	  0.638  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -317	  0.731  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -316	  0.854  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -316	  0.527  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -315	  0.740  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -314	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -314	  0.343  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -314	  0.321  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -313	  0.340  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -313	  0.337  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -313	  0.341  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -312	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -312	  0.336  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -312	  0.315  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -311	  0.308  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -311	  0.274  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -311	  0.267  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -310	  0.378  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -310	  0.309  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -310	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -310	  0.317  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -309	  0.429  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -309	  0.299  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -308	  0.336  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -308	  0.324  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -308	  0.299  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -308	  0.322  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -307	  0.321  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -307	  0.310  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -307	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -306	  0.333  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -306	  0.380  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -306	  0.260  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -305	  0.251  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -305	  0.373  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -305	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -304	  0.269  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -304	  0.325  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -304	  0.314  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -303	  0.347  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -303	  0.379  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -303	  0.259  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -302	  0.334  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -302!  68.109  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -234	  0.307  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -234	  0.358  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -233	  0.274  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -233	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -233	  0.443  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -232	  0.621  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -232	  0.323  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -231	  0.282  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -231	  0.302  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -231	  0.430  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -230	  0.314  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-137   -230	  0.255  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -230	  0.302  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -230	  0.572  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -229	  0.503  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -228	  0.281  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -228	  0.659  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -228+   1.021  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -226	  0.638  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -226	  0.469  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -225	  0.316  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -225	  0.462  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -225	  0.410  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -224	  0.337  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -224+   1.301  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -223	  0.271  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -222	  0.280  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -222	  0.389  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -222	  0.291  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -221	  0.274  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -221	  0.324  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -221	  0.302  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -220	  0.310  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -220	  0.253  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -220	  0.259  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -220	  0.303  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -219	  0.481  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -219	  0.344  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -218	  0.363  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -218	  0.307  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -218	  0.648  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -217	  0.708  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -216	  0.837  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -216	  0.488  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -215	  0.735  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -214	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -214	  0.343  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -214	  0.332  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -213	  0.337  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -213	  0.337  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -213	  0.342  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -212	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -212	  0.336  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -212	  0.325  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -211	  0.305  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -211	  0.281  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -211	  0.263  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -211	  0.369  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -210	  0.322  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -210	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -210	  0.317  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -209	  0.430  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -209	  0.299  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -209	  0.336  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -208	  0.329  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -208	  0.305  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -208	  0.332  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -207	  0.320  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -207	  0.308  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -207	  0.264  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -206	  0.336  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -206	  0.376  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -206	  0.260  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -205	  0.251  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -205	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -205	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -204	  0.269  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -204	  0.320  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -204	  0.314  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -204	  0.345  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -203	  0.382  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -203	  0.259  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -203	  0.334  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -202!  68.112  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -134	  0.307  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -134	  0.358  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -133	  0.274  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -133	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -133	  0.453  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -132	  0.647  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -132	  0.337  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -131	  0.257  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -131	  0.316  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -131	  0.437  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -130	  0.334  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-72    -130	  0.258  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -130	  0.293  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -130	  0.574  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -129	  0.474  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -128	  0.270  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -128	  0.639  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -128+   1.018  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -127	  0.638  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -126	  0.469  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -125	  0.316  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -125	  0.462  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -125	  0.447  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -124	  0.348  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -124+   1.297  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -123	  0.276  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -122	  0.270  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -122	  0.389  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -122	  0.291  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -121	  0.274  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -121	  0.335  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -121	  0.295  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -120	  0.285  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -120	  0.257  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -120	  0.260  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -120	  0.268  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -119	  0.475  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -119	  0.344  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -119	  0.364  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -118	  0.316  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -118	  0.638  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -117	  0.704  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -117	  0.850  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -116	  0.508  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -115	  0.735  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -114	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -114	  0.341  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -114	  0.331  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -113	  0.302  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -113	  0.353  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -113	  0.339  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -112	  0.302  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -112	  0.335  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -112	  0.315  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -111	  0.280  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -111	  0.284  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -111	  0.318  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -111	  0.373  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -110	  0.309  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -110	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -110	  0.317  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -109	  0.429  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -109	  0.299  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -109	  0.336  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -108	  0.317  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -108	  0.296  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -108	  0.322  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -107	  0.321  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -107	  0.310  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -107	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -106	  0.332  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -106	  0.376  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -106	  0.260  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -105	  0.251  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -105	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -105	  0.337  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -105	  0.263  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -104	  0.332  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -104	  0.347  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -104	  0.350  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -103	  0.393  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -103	  0.259  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -103	  0.327  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -102!  33.416  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef   -69	  0.307  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                 -69	  0.358  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                 -68	  0.282  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                 -68	  0.298  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                 -68	  0.431  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                 -67	  0.611  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                 -67	  0.332  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                 -66	  0.446  xnsched_watchdog_handler+0x5 (xntimer_tick_aperiodic+0x78)
:|  # func                 -66	  0.320  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-37     -65	  0.253  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                 -65	  0.300  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                 -65	  0.779  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|   +func                 -64	  0.461  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef   -64	  0.743  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001   -63	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001   -63	  0.325  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001   -62	  0.359  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001   -62	  0.333  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                 -62	  0.324  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001   -61	  0.348  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001   -61	  0.322  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                 -61	  0.403  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001   -60	  0.352  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001   -60	  0.305  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                 -59	  0.257  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -59	  0.255  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -59	  0.375  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -59	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -58	  0.251  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000   -58	  0.302  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -58	  0.441  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -57	  0.313  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001   -57	  0.332  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001   -57	  0.322  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                 -56	  0.310  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                 -56	  0.332  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001   -56	  0.320  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001   -55	  0.311  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                 -55	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001   -55	  0.332  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001   -54	  0.321  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                 -54	  0.262  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -54	  0.249  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -54	  0.373  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -53	  0.333  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -53	  0.272  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001   -53	  0.325  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001   -52	  0.304  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001   -52	  0.332  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001   -52	  0.374  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                 -51	  0.251  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000   -51	  0.342  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e   -51!  16.602  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef   -34+   2.157  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                 -32	  0.471  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                 -31	  0.382  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                 -31	  0.396  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                 -31	  0.611  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                 -30	  0.697  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                 -29	  0.392  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                 -29	  0.534  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                 -28	  0.867  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99   -28	  0.698  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                 -27	  0.933  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@62      -26	  0.639  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                 -25	  0.717  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                 -25+   1.843  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                 -23+   1.286  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # func                 -21+   6.100  __xnlock_spin+0x9 (T.1349+0x55)
:|  # [    0] -<?>-   -1   -15	  0.361  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                 -15	  0.808  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                 -14+   1.508  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99   -13	  0.861  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                 -12	  0.608  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                 -11	  0.398  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000   -11	  0.707  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001   -10	  0.543  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001   -10	  0.465  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001    -9+   1.824  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                  -7	  0.403  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                  -7	  0.358  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001    -7	  0.522  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001    -6	  0.402  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                  -6	  0.416  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001    -5	  0.422  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001    -5	  0.411  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                  -4	  0.509  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                  -4	  0.519  xnshadow_sys_trace+0x6 (hisyscall_event+0x11b)
:   + func                  -3	  0.404  ipipe_trace_frozen_reset+0x6 (xnshadow_sys_trace+0x5c)
:   + func                  -3	  0.394  __ipipe_global_path_lock+0x9 (ipipe_trace_frozen_reset+0x1a)
:   + func                  -3	  0.395  __ipipe_spin_lock_irqsave+0x5 (__ipipe_global_path_lock+0x1d)
:|  + begin   0x80000001    -2+   1.533  hard_local_irq_save+0x16 (__ipipe_spin_lock_irqsave+0x11)
:|  # func                  -1	  0.586  __ipipe_spin_unlock_irqcomplete+0x4 (__ipipe_global_path_unlock+0x62)
:|  + end     0x80000001     0	  0.487  hard_local_irq_restore+0x15 (__ipipe_spin_unlock_irqcomplete+0x24)
<   + freeze  0x00006128     0	  0.538  xnshadow_sys_trace+0x65 (hisyscall_event+0x11b)
 |  + begin   0x80000001     0	  0.502  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
 |  + end     0x80000001     1	  0.465  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
 |  + begin   0x80000001     1	  1.384  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
    + func                   2	  0.377  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
    + func                   3	  0.332  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
 |  + begin   0x80000001     3	  0.502  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
 |  + end     0x80000001     4	  1.121  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
    + func                   5	  0.294  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
 |  + begin   0x80000001     5	  0.299  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
 |  + end     0x80000001     5	  0.000  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)


[max]
I-pipe worst-case tracing service on 3.5.7-trace/ipipe release #3
-------------------------------------------------------------
CPU: 0, Begin: 32286795377514 cycles, Trace Points: 17 (-10/+5), Length: 3854 us
Calibrated minimum trace-point overhead: 0.078 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
     #func                  -4	  0.351  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
 |   #begin   0x80000001    -4	  0.450  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
 |   #end     0x80000001    -4	  0.495  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
     #func                  -3	  0.397  default_idle+0x3 (cpu_idle+0x5d)
 |   #begin   0x80000001    -3	  0.437  debug_smp_processor_id+0x36 (default_idle+0xd)
 |   #end     0x80000001    -2	  0.425  debug_smp_processor_id+0x82 (default_idle+0xd)
 |   #begin   0x80000001    -2	  0.439  debug_smp_processor_id+0x36 (default_idle+0x1e)
 |   #end     0x80000001    -1	  0.509  debug_smp_processor_id+0x82 (default_idle+0x1e)
     #func                  -1	  0.388  __ipipe_halt_root+0x3 (default_idle+0x48)
 |   #begin   0x80000000    -1	  1.048  __ipipe_halt_root+0x1a (default_idle+0x48)
>|   +end     0x8000000e     0! 3842.189  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +func                3842	  0.621  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                3842	  0.478  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                3843	  0.430  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                3843	  0.700  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                3844+   1.266  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                3845+   3.607  __xnlock_spin+0x9 (T.1249+0x47)
:|  # func                3849	  0.569  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                3849	  0.406  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@599884 3850	  0.403  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                3850	  0.408  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                3851	  0.672  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                3851	  0.400  xnintr_host_tick+0x4 (xnintr_clock_handler+0x151)
:|  # func                3852	  0.723  __ipipe_set_irq_pending+0x6 (xnintr_host_tick+0x50)
:|   +func                3852	  0.643  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +func                3853	  0.508  __ipipe_do_sync_stage+0x9 (__ipipe_do_sync_pipeline+0x63)
<|   #end     0x80000000  3854	  0.472  hard_local_irq_enable+0x14 (__ipipe_do_sync_stage+0xbd)
     #func                3854	  0.454  __ipipe_do_IRQ+0x5 (__ipipe_do_sync_stage+0x137)
     #func                3854	  0.407  __ipipe_get_ioapic_irq_vector+0x3 (__ipipe_do_IRQ+0x1d)
     #func                3855	  0.362  smp_apic_timer_interrupt+0x5 (__ipipe_do_IRQ+0x42)
     #func                3855	  0.365  irq_enter+0x4 (smp_apic_timer_interrupt+0x21)
 |   #begin   0x80000001  3856	  0.000  debug_smp_processor_id+0x36 (irq_enter+0xe)

  reply	other threads:[~2013-04-02 17:49 UTC|newest]

Thread overview: 12+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-03-19 20:14 [Xenomai] Decrease Latency (below 10 us) on x32 or x32_64? Manuel Huber
2013-03-19 20:46 ` Gilles Chanteperdrix
2013-03-26 10:18   ` Manuel Huber
2013-03-26 11:57     ` Gilles Chanteperdrix
2013-03-28 10:06       ` Manuel Huber
2013-03-28 12:46         ` Gilles Chanteperdrix
2013-03-28 13:04           ` Manuel Huber
2013-03-28 20:24             ` Gilles Chanteperdrix
2013-04-02 17:49               ` Manuel Huber [this message]
2013-04-02 22:20                 ` Gilles Chanteperdrix
2013-04-13 16:42   ` Gilles Chanteperdrix
2013-04-18  5:51     ` Manuel Huber

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=515B1A28.6070802@gmail.com \
    --to=manuel.h87@gmail.com \
    --cc=gilles.chanteperdrix@xenomai.org \
    --cc=xenomai@xenomai.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.