All of lore.kernel.org
 help / color / mirror / Atom feed
* [Xenomai-help] Interrupt priorities and handling problems
@ 2008-05-23 17:56 Bosko Radivojevic
  2008-05-23 19:08 ` Gilles Chanteperdrix
  2008-05-25 14:31 ` Gilles Chanteperdrix
  0 siblings, 2 replies; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-23 17:56 UTC (permalink / raw)
  To: xenomai-help

Hi all!

Before I ask my questions, I'll remind about my environment:
AT91SAM9260 based board (ARM), Xenomai 2.4.3, Kernel 2.6.24, I-Pipe
1.9-01. We have external interrupt source connected to PIO line (IRQ1
line) which should 'wake up' our code every 1ms. For the sake of
performances, we create interrupt handler in kernel space.

1. Two interrupts instead of one

Somehow, ISR get called twice for every single interrupt, at the
falling edge. I've tried to set interrupt source type (setting some
registers directly on the microcontroller) but whatever I set, ISR
call happens at the falling edge. The second comes right after the
first one, but not together.

When I tried to handle interrupt from the userspace, rt_intr_wait() returns
1, so it looks like "second" interrupt comes a little bit later. If I
generate more (n) interrupts during handling one, the next
rt_intr_wait() returns n*2+1. This +1 is the second interrupt that
came right after the handled one.

The quite weird thing is that sometimes (not so often, like every 1
hour) ISR is called just once. Where should I start digging?


2. Ethernet activity makes system unpredictable

Delay at interrupt reaction and, more important, duration of handling
function is pretty the same during long period of time if there is no
Ethernet activity (DM9000, GPIO IRQ 82). I can understand why we get
longer delays on interrupt reaction with Ethernet activity, but I
can't understand why exactly the same code takes more time to
complete.

We calculate ISR duration by setting one of the pins to 1 at the
beginning and setting back to 0 at the end, using at91_sys_write
macros (macros for raw_writel). We use logic port analyzer for
displaying pins status.

Without Ethernet activity irq handler lasts around 170us. With
Ethernet activity it lasts up to 280us!

That sync signal is kind of "sign of God" for us and our need is to
threat it with the highest priority possible. In one of the mails on
the list, Gilles explained that from I-Pipe 1.8 interrupt priorities
on ARM are defined at the software level. Is there a way to raise
priority of "my IRQ" over all others? Ethernet activity, timer & co
are less important than having good and predictable reactions on our
interrupt.

Thanks.


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-23 17:56 [Xenomai-help] Interrupt priorities and handling problems Bosko Radivojevic
@ 2008-05-23 19:08 ` Gilles Chanteperdrix
  2008-05-23 19:34   ` Bosko Radivojevic
  2008-05-25 14:31 ` Gilles Chanteperdrix
  1 sibling, 1 reply; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-23 19:08 UTC (permalink / raw)
  To: Bosko Radivojevic; +Cc: xenomai-help

Bosko Radivojevic wrote:
 > Hi all!
 > 
 > Before I ask my questions, I'll remind about my environment:
 > AT91SAM9260 based board (ARM), Xenomai 2.4.3, Kernel 2.6.24, I-Pipe
 > 1.9-01. We have external interrupt source connected to PIO line (IRQ1
 > line) which should 'wake up' our code every 1ms. For the sake of
 > performances, we create interrupt handler in kernel space.
 > 
 > 2. Ethernet activity makes system unpredictable
 > 
 > Delay at interrupt reaction and, more important, duration of handling
 > function is pretty the same during long period of time if there is no
 > Ethernet activity (DM9000, GPIO IRQ 82). I can understand why we get
 > longer delays on interrupt reaction with Ethernet activity, but I
 > can't understand why exactly the same code takes more time to
 > complete.
 > 
 > We calculate ISR duration by setting one of the pins to 1 at the
 > beginning and setting back to 0 at the end, using at91_sys_write
 > macros (macros for raw_writel). We use logic port analyzer for
 > displaying pins status.
 > 
 > Without Ethernet activity irq handler lasts around 170us. With
 > Ethernet activity it lasts up to 280us!

Due to the way you measure the interrupt duration, and since preemption
of interrupt handler by another interrupt handler is completely
excluded (unless you mistakenly re-enable interrupts in your interrupt
handler), what you observe is probably an indirect effect
such as cache thrashing. The best way to know is either to measure some
short sections with rt_timer_tsc, or to do some measurements with the
I-pipe tracer.

 > 
 > That sync signal is kind of "sign of God" for us and our need is to
 > threat it with the highest priority possible. In one of the mails on
 > the list, Gilles explained that from I-Pipe 1.8 interrupt priorities
 > on ARM are defined at the software level. Is there a way to raise
 > priority of "my IRQ" over all others? Ethernet activity, timer & co
 > are less important than having good and predictable reactions on our
 > interrupt.

Interrupt priority only matters when two interrupts are pending at the
same time. If ethernet interrupt is treated at Linux level, then it is
fully preemptible by Xenomai, if it is a real-time interrupt, then it
may well trigger before you receive your periodic interrupt, so the
worst case interrupt latency of the periodic interrupt is at least the
duration of the ethernet interrupt (and vice-versa). Changing the
interrupt priority, will not change interrupt latency. What you can do
to improve situation is:
- re-enable interrupts in the ethernet interrupt handler
- rewrite the ethernet driver to only poll periodically hardware to
  handle any pending packet instead of being interrupt driven, and
  arrange for this not to happen at the same time as when the
  periodic interrupt is triggered.
But as far as I understood, your problem is not the interrupt latency,
but rather the ISR duration, and changing the interrupt priority will
not change this at all.

-- 


					    Gilles.


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-23 19:08 ` Gilles Chanteperdrix
@ 2008-05-23 19:34   ` Bosko Radivojevic
  2008-05-23 19:42     ` Gilles Chanteperdrix
  0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-23 19:34 UTC (permalink / raw)
  To: Gilles Chanteperdrix; +Cc: xenomai-help

> Interrupt priority only matters when two interrupts are pending at the
> same time. If ethernet interrupt is treated at Linux level, then it is
> fully preemptible by Xenomai,

Ethernet is handled by Linux (dm9000 driver).

> - re-enable interrupts in the ethernet interrupt handler

What will happen with interrupted ethernet interrupt handler? :)

> But as far as I understood, your problem is not the interrupt latency,
> but rather the ISR duration, and changing the interrupt priority will
> not change this at all.

Both latency and duration are my problems. But, I had some explanation
for latency problem (irqs disabled during Eth handler).

Thanks.


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-23 19:34   ` Bosko Radivojevic
@ 2008-05-23 19:42     ` Gilles Chanteperdrix
  2008-05-23 19:48       ` Bosko Radivojevic
  0 siblings, 1 reply; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-23 19:42 UTC (permalink / raw)
  To: Bosko Radivojevic; +Cc: xenomai-help

Bosko Radivojevic wrote:
 > > Interrupt priority only matters when two interrupts are pending at the
 > > same time. If ethernet interrupt is treated at Linux level, then it is
 > > fully preemptible by Xenomai,
 > 
 > Ethernet is handled by Linux (dm9000 driver).

Then what I have said is irrelevant, your interrupt handler is fully
preemptible by Xenomai.

 > 
 > > - re-enable interrupts in the ethernet interrupt handler
 > 
 > What will happen with interrupted ethernet interrupt handler? :)
 > 
 > > But as far as I understood, your problem is not the interrupt latency,
 > > but rather the ISR duration, and changing the interrupt priority will
 > > not change this at all.
 > 
 > Both latency and duration are my problems. But, I had some explanation
 > for latency problem (irqs disabled during Eth handler).

How are they disabled ? If they are disabled using Linux functions, then
they are really enabled for Adeos, that is one of the intended effects
of the Adeos patch.

-- 


					    Gilles.


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-23 19:42     ` Gilles Chanteperdrix
@ 2008-05-23 19:48       ` Bosko Radivojevic
  2008-05-23 19:49         ` Gilles Chanteperdrix
  0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-23 19:48 UTC (permalink / raw)
  To: Gilles Chanteperdrix; +Cc: xenomai-help

On Fri, May 23, 2008 at 9:42 PM, Gilles Chanteperdrix
<gilles.chanteperdrix@xenomai.org> wrote:

> Then what I have said is irrelevant, your interrupt handler is fully
> preemptible by Xenomai.

Great :)

> How are they disabled ? If they are disabled using Linux functions, then
> they are really enabled for Adeos, that is one of the intended effects
> of the Adeos patch.

OK, I missed that fact. So, why do I see latency than, at all?


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-23 19:48       ` Bosko Radivojevic
@ 2008-05-23 19:49         ` Gilles Chanteperdrix
  2008-05-23 19:51           ` Bosko Radivojevic
  0 siblings, 1 reply; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-23 19:49 UTC (permalink / raw)
  To: Bosko Radivojevic; +Cc: xenomai-help

Bosko Radivojevic wrote:
 > On Fri, May 23, 2008 at 9:42 PM, Gilles Chanteperdrix
 > <gilles.chanteperdrix@xenomai.org> wrote:
 > 
 > > Then what I have said is irrelevant, your interrupt handler is fully
 > > preemptible by Xenomai.
 > 
 > Great :)
 > 
 > > How are they disabled ? If they are disabled using Linux functions, then
 > > they are really enabled for Adeos, that is one of the intended effects
 > > of the Adeos patch.
 > 
 > OK, I missed that fact. So, why do I see latency than, at all?

Only the tracer can tell.

-- 


					    Gilles.


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-23 19:49         ` Gilles Chanteperdrix
@ 2008-05-23 19:51           ` Bosko Radivojevic
  0 siblings, 0 replies; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-23 19:51 UTC (permalink / raw)
  To: Gilles Chanteperdrix; +Cc: xenomai-help

On Fri, May 23, 2008 at 9:49 PM, Gilles Chanteperdrix
<gilles.chanteperdrix@xenomai.org> wrote:

> Only the tracer can tell.

OK, will do that and send report :)


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-23 17:56 [Xenomai-help] Interrupt priorities and handling problems Bosko Radivojevic
  2008-05-23 19:08 ` Gilles Chanteperdrix
@ 2008-05-25 14:31 ` Gilles Chanteperdrix
  2008-05-26 13:26   ` Bosko Radivojevic
  1 sibling, 1 reply; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-25 14:31 UTC (permalink / raw)
  To: Bosko Radivojevic; +Cc: xenomai-help

[-- Attachment #1: message body and .signature --]
[-- Type: text/plain, Size: 1254 bytes --]

Bosko Radivojevic wrote:
 > Hi all!
 > 
 > Before I ask my questions, I'll remind about my environment:
 > AT91SAM9260 based board (ARM), Xenomai 2.4.3, Kernel 2.6.24, I-Pipe
 > 1.9-01. We have external interrupt source connected to PIO line (IRQ1
 > line) which should 'wake up' our code every 1ms. For the sake of
 > performances, we create interrupt handler in kernel space.
 > 
 > 1. Two interrupts instead of one
 > 
 > Somehow, ISR get called twice for every single interrupt, at the
 > falling edge. I've tried to set interrupt source type (setting some
 > registers directly on the microcontroller) but whatever I set, ISR
 > call happens at the falling edge. The second comes right after the
 > first one, but not together.
 > 
 > When I tried to handle interrupt from the userspace, rt_intr_wait() returns
 > 1, so it looks like "second" interrupt comes a little bit later. If I
 > generate more (n) interrupts during handling one, the next
 > rt_intr_wait() returns n*2+1. This +1 is the second interrupt that
 > came right after the handled one.
 > 
 > The quite weird thing is that sometimes (not so often, like every 1
 > hour) ISR is called just once. Where should I start digging?

Does the following patch help ?

-- 


					    Gilles.

[-- Attachment #2: xeno-arm-use-mask-unmask-instead-of-enable-disable.diff --]
[-- Type: text/plain, Size: 949 bytes --]

Index: include/asm-arm/wrappers.h
===================================================================
--- include/asm-arm/wrappers.h	(revision 3873)
+++ include/asm-arm/wrappers.h	(working copy)
@@ -64,8 +64,8 @@ typedef irqreturn_t (*rthal_irq_host_han
 extern void (*fp_init)(union fp_state *);
 #else /* >= 2.6.19 */
 #define rthal_irq_desc_lock(irq) (&rthal_irq_descp(irq)->lock)
-#define rthal_irq_chip_enable(irq)   ({ rthal_irq_descp(irq)->chip->enable(irq); 0; })
-#define rthal_irq_chip_disable(irq)  ({ rthal_irq_descp(irq)->chip->disable(irq); 0; })
+#define rthal_irq_chip_enable(irq)   ({ rthal_irq_descp(irq)->chip->unmask(irq); 0; })
+#define rthal_irq_chip_disable(irq)  ({ rthal_irq_descp(irq)->chip->mask(irq); 0; })
 #define rthal_irq_chip_end(irq)      ({ rthal_irq_descp(irq)->ipipe_end(irq, rthal_irq_descp(irq)); 0; })
 typedef irq_handler_t rthal_irq_host_handler_t;
 #define rthal_mark_irq_disabled(irq) do {              \

^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-25 14:31 ` Gilles Chanteperdrix
@ 2008-05-26 13:26   ` Bosko Radivojevic
  2008-05-26 16:29     ` Bosko Radivojevic
  0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-26 13:26 UTC (permalink / raw)
  To: Gilles Chanteperdrix; +Cc: xenomai-help

Unfortunately, no. Tried with:
 -  xenomai-trunk and xenomai-2.4.2 on 2.6.24.3 kernel
 -  xenomai-2.4.2 on 2.6.20.21 kernel

I'll try tracer in the next hours.

On Sun, May 25, 2008 at 4:31 PM, Gilles Chanteperdrix
<gilles.chanteperdrix@xenomai.org> wrote:
> Bosko Radivojevic wrote:
>  > Hi all!
>  >
>  > Before I ask my questions, I'll remind about my environment:
>  > AT91SAM9260 based board (ARM), Xenomai 2.4.3, Kernel 2.6.24, I-Pipe
>  > 1.9-01. We have external interrupt source connected to PIO line (IRQ1
>  > line) which should 'wake up' our code every 1ms. For the sake of
>  > performances, we create interrupt handler in kernel space.
>  >
>  > 1. Two interrupts instead of one
>  >
>  > Somehow, ISR get called twice for every single interrupt, at the
>  > falling edge. I've tried to set interrupt source type (setting some
>  > registers directly on the microcontroller) but whatever I set, ISR
>  > call happens at the falling edge. The second comes right after the
>  > first one, but not together.
>  >
>  > When I tried to handle interrupt from the userspace, rt_intr_wait() returns
>  > 1, so it looks like "second" interrupt comes a little bit later. If I
>  > generate more (n) interrupts during handling one, the next
>  > rt_intr_wait() returns n*2+1. This +1 is the second interrupt that
>  > came right after the handled one.
>  >
>  > The quite weird thing is that sometimes (not so often, like every 1
>  > hour) ISR is called just once. Where should I start digging?
>
> Does the following patch help ?
>
> --
>
>
>                                            Gilles.
>
> Index: include/asm-arm/wrappers.h
> ===================================================================
> --- include/asm-arm/wrappers.h  (revision 3873)
> +++ include/asm-arm/wrappers.h  (working copy)
> @@ -64,8 +64,8 @@ typedef irqreturn_t (*rthal_irq_host_han
>  extern void (*fp_init)(union fp_state *);
>  #else /* >= 2.6.19 */
>  #define rthal_irq_desc_lock(irq) (&rthal_irq_descp(irq)->lock)
> -#define rthal_irq_chip_enable(irq)   ({ rthal_irq_descp(irq)->chip->enable(irq); 0; })
> -#define rthal_irq_chip_disable(irq)  ({ rthal_irq_descp(irq)->chip->disable(irq); 0; })
> +#define rthal_irq_chip_enable(irq)   ({ rthal_irq_descp(irq)->chip->unmask(irq); 0; })
> +#define rthal_irq_chip_disable(irq)  ({ rthal_irq_descp(irq)->chip->mask(irq); 0; })
>  #define rthal_irq_chip_end(irq)      ({ rthal_irq_descp(irq)->ipipe_end(irq, rthal_irq_descp(irq)); 0; })
>  typedef irq_handler_t rthal_irq_host_handler_t;
>  #define rthal_mark_irq_disabled(irq) do {              \
>
>


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-26 13:26   ` Bosko Radivojevic
@ 2008-05-26 16:29     ` Bosko Radivojevic
  2008-05-26 16:47       ` Gilles Chanteperdrix
  0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-26 16:29 UTC (permalink / raw)
  To: Gilles Chanteperdrix; +Cc: xenomai-help

[-- Attachment #1: Type: text/plain, Size: 615 bytes --]

Hi Gilles,

I've enabled tracer, as documented on Xenomai site. Well, to be
honest, I dont see much from the output :) I've put
xntrace_user_freeze (1, 1) in the handler to happen at the 1000th
iteration. At the beginning of the interrupt handler one IO PIN is set
to 1 and set back to 0 at the end. In the meantime, there is only for
().

Attached file osc1.jpg is screen shot of USB Osciloscope when there is
no Ethernet activity. osc2.jpg is good example of what happens when
there is Ethernet activity (this time ping -f from PC box in the same
LAN as Device).

Do you see anything in those .txt files?

Thanx.

[-- Attachment #2: osc1.jpg --]
[-- Type: image/jpeg, Size: 59032 bytes --]

[-- Attachment #3: osc2.jpg --]
[-- Type: image/jpeg, Size: 60149 bytes --]

[-- Attachment #4: frozen3.txt --]
[-- Type: text/plain, Size: 97663 bytes --]

I-pipe frozen back-tracing service on 2.6.24.3/ipipe-1.9-00
------------------------------------------------------------
CPU: 0, Freeze: 6446305569 cycles, Trace Points: 100 (+1000)
Calibrated minimum trace-point overhead: 1.500 us

 +----- Hard IRQs ('|': locked)
 |+---- <unused>
 ||+--- <unused>
 |||+-- Xenomai
 ||||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||||                        +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||||                        |        +- NMI noise ('N')
 |||||                        |        |
      Type    User Val.   Time    Delay  Function (Parent)
:    +func                -665+   6.250  sock_wfree+0x10 (skb_release_all+0xd0)
:|   +begin   0x80000001  -658+   7.500  sock_wfree+0x44 (skb_release_all+0xd0)
:|   +end     0x80000001  -651+   5.500  sock_wfree+0x58 (skb_release_all+0xd0)
:    +func                -645+   8.250  sock_def_write_space+0x10 (sock_wfree+0x74)
:|   +begin   0x80000001  -637+   8.000  sock_wfree+0x94 (skb_release_all+0xd0)
:|   +end     0x80000001  -629+   5.500  sock_wfree+0xa8 (skb_release_all+0xd0)
:    +func                -624+   5.750  skb_release_data+0x10 (skb_release_all+0xd8)
:    +func                -618+   6.750  kfree+0x10 (skb_release_data+0xdc)
:|   +begin   0x80000001  -611+   7.500  kfree+0x4c (skb_release_data+0xdc)
:|   #end     0x80000001  -604+   6.750  kfree+0x60 (skb_release_data+0xdc)
:    #func                -597+   5.750  __ipipe_restore_root+0x10 (kfree+0xfc)
:    #func                -591+   6.750  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
:|   #begin   0x80000000  -584+   6.750  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
:|   +func                -578+   7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
:|   +end     0x80000000  -571+   6.750  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
:    +func                -564+   7.000  kmem_cache_free+0x10 (__kfree_skb+0x108)
:|   +begin   0x80000001  -557+   7.250  kmem_cache_free+0x48 (__kfree_skb+0x108)
:|   #end     0x80000001  -550+   5.750  kmem_cache_free+0x5c (__kfree_skb+0x108)
:    #func                -544+   5.500  __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
:    #func                -538+   6.750  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
:|   #begin   0x80000000  -532+   6.250  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
:|   +func                -525+   6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
:|   +end     0x80000000  -519+   9.000  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
:|   +begin   0x80000001  -510+   7.750  __qdisc_run+0x174 (dev_queue_xmit+0x19c)
:|   +end     0x80000001  -502+   5.750  __qdisc_run+0x188 (dev_queue_xmit+0x19c)
:    +func                -496+   5.250  local_bh_enable+0x10 (dev_queue_xmit+0x26c)
:    +func                -491+   6.500  ipipe_check_context+0x10 (local_bh_enable+0x58)
:    +func                -484+   7.750  ipipe_check_context+0x10 (local_bh_enable+0x98)
:    +func                -477+   5.500  local_bh_enable+0x10 (dev_queue_xmit+0x26c)
:    +func                -471+   5.750  ipipe_check_context+0x10 (local_bh_enable+0x58)
:    +func                -465+   7.000  ipipe_check_context+0x10 (local_bh_enable+0x98)
:    +func                -458+   5.500  ip_cork_release+0x10 (ip_push_pending_frames+0x454)
:    +func                -453+   7.250  kfree+0x10 (ip_cork_release+0x28)
:|   +begin   0x80000001  -446+   7.250  ip_cork_release+0x80 (ip_push_pending_frames+0x454)
:|   +end     0x80000001  -438+   7.750  ip_cork_release+0x94 (ip_push_pending_frames+0x454)
:|   +begin   0x80000001  -431+   7.750  icmp_reply+0x190 (icmp_echo+0x60)
:|   +end     0x80000001  -423+   5.250  icmp_reply+0x1a4 (icmp_echo+0x60)
:    +func                -418+   5.250  icmp_xmit_unlock+0x10 (icmp_reply+0x1bc)
:    +func                -412+   5.750  local_bh_enable+0x10 (icmp_xmit_unlock+0x14)
:    +func                -407+   6.000  ipipe_check_context+0x10 (local_bh_enable+0x58)
:    +func                -401+   7.500  ipipe_check_context+0x10 (local_bh_enable+0x98)
:    +func                -393+   5.750  kfree_skb+0x10 (icmp_rcv+0x158)
:    +func                -387+   5.500  __kfree_skb+0x10 (kfree_skb+0x80)
:    +func                -382+   7.250  skb_release_all+0x10 (__kfree_skb+0x18)
:|   +begin   0x80000001  -375+   7.250  skb_release_all+0x64 (__kfree_skb+0x18)
:|   +end     0x80000001  -367+   6.000  skb_release_all+0x78 (__kfree_skb+0x18)
:    +func                -361+   6.000  skb_release_data+0x10 (skb_release_all+0xd8)
:    +func                -355+   6.750  kfree+0x10 (skb_release_data+0xdc)
:|   +begin   0x80000001  -349+   7.500  kfree+0x4c (skb_release_data+0xdc)
:|   #end     0x80000001  -341+   5.750  kfree+0x60 (skb_release_data+0xdc)
:    #func                -335+   5.500  __ipipe_restore_root+0x10 (kfree+0xfc)
:    #func                -330+   6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
:|   #begin   0x80000000  -323+   6.750  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
:|   +func                -317+   6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
:|   +end     0x80000000  -310+   6.500  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
:    +func                -303+   6.500  kmem_cache_free+0x10 (__kfree_skb+0x108)
:|   +begin   0x80000001  -297+   7.250  kmem_cache_free+0x48 (__kfree_skb+0x108)
:|   #end     0x80000001  -290+   6.250  kmem_cache_free+0x5c (__kfree_skb+0x108)
:    #func                -283+   5.750  __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
:    #func                -278+   6.750  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
:|   #begin   0x80000000  -271+   6.250  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
:|   +func                -265+   6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
:|   +end     0x80000000  -258+  10.000  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
:|   +begin   0x80000001  -248+   8.250  process_backlog+0x168 (net_rx_action+0xac)
:|   +end     0x80000001  -240+   7.000  process_backlog+0x17c (net_rx_action+0xac)
:|   +begin   0x80000001  -233+   7.250  process_backlog+0x60 (net_rx_action+0xac)
:|   #end     0x80000001  -225+   7.500  process_backlog+0x74 (net_rx_action+0xac)
:|   #begin   0x80000001  -218+   7.500  process_backlog+0x134 (net_rx_action+0xac)
:|   #end     0x80000001  -210+   5.250  process_backlog+0x148 (net_rx_action+0xac)
:    #func                -205+   6.000  __ipipe_unstall_root+0x10 (process_backlog+0x150)
:|   #func                -199+   7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
:|   #begin   0xffffffff  -192+   6.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
:|   #func                -185+   5.500  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
:|   #func                -180+   5.250  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
:|   #func                -175+   6.000  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
:|   #func                -169+   5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
:|   #func                -163+   6.000  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
:|   #func                -157+   5.250  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
:|   #func                -152+   6.000  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
:|   #func                -146+   6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
:|  #*func                -139+   7.250  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
:|  #*func                -132+   8.500  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
:|  #*func                -123!  14.250  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
:|  #*func                -109+   7.750  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
:|  #*func                -101+   5.250  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
:|  #*func                 -96+   5.750  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
:|  #*func                 -90+   9.500  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
:|   #func                 -81+   7.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
:|   #end     0xffffffff   -73+   5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
:|   #func                 -68+   6.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
:|   #begin   0xffffffff   -61+   6.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
:|   #func                 -55+   5.500  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
:|   #func                 -49!  12.250  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
:|   #func                 -37+   5.250  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
:|   #func                 -32+   5.750  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
:|   #func                 -26+   5.750  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
:|   #func                 -20+   6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
:|  #*func                 -14+   6.250  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
:|  #*func                  -8+   8.250  <bf0071fc> (xnintr_irq_handler+0x44)
<|  #*freeze  0x00000001     0    6.750  <bf007230> (xnintr_irq_handler+0x44)
 |  #*func                   6    5.750  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func                  12    8.000  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func                  20    7.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                  27    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff    35    7.250  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   #begin   0x80000000    42    5.500  __ipipe_unstall_root+0x30 (process_backlog+0x150)
 |   +func                  47    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000    54    7.500  __ipipe_unstall_root+0x68 (process_backlog+0x150)
 |   +begin   0x80000001    62    6.500  net_rx_action+0x118 (__do_softirq+0x60)
 |   #end     0x80000001    68    5.500  net_rx_action+0x12c (__do_softirq+0x60)
     #func                  74    6.750  __ipipe_unstall_root+0x10 (net_rx_action+0x208)
 |   #begin   0x80000000    81    5.750  __ipipe_unstall_root+0x30 (net_rx_action+0x208)
 |   +func                  86    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000    93    6.750  __ipipe_unstall_root+0x68 (net_rx_action+0x208)
 |   +begin   0x80000001   100    6.500  __do_softirq+0xa8 (irq_exit+0x50)
 |   #end     0x80000001   107    6.000  __do_softirq+0xbc (irq_exit+0x50)
     #func                 113    5.750  _local_bh_enable+0x10 (__do_softirq+0xfc)
     #func                 118    8.000  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
 |   #begin   0x80000000   126    8.750  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000   135    6.250  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func                 141    5.750  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                 147    5.500  irq_enter+0x10 (__exception_text_start+0x38)
     #func                 153    6.000  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                 159    6.000  handle_simple_irq+0x10 (__exception_text_start+0x48)
     #func                 165    5.750  handle_IRQ_event+0x10 (handle_simple_irq+0x64)
     #func                 170    6.250  __ipipe_unstall_root+0x10 (handle_IRQ_event+0x28)
 |   #begin   0x80000000   177    5.500  __ipipe_unstall_root+0x30 (handle_IRQ_event+0x28)
 |   +func                 182    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000   189    5.750  __ipipe_unstall_root+0x68 (handle_IRQ_event+0x28)
     +func                 195    7.500  dm9000_interrupt+0x14 (handle_IRQ_event+0x40)
 |   +func                 202    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff   209    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                 215    5.750  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func                 221   10.750  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func                 232    7.250  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func                 239    6.250  __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
 |   +func                 245    5.500  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
 |   +func                 251    5.750  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func                 256    7.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                 263    7.000  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +func                 270    7.000  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff   277    7.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func                 285    6.750  dm9000_inblk_16bit+0x10 (dm9000_interrupt+0xbc)
     +func                 292    6.000  __alloc_skb+0x10 (dm9000_interrupt+0x120)
     +func                 298    7.000  kmem_cache_alloc+0x10 (__alloc_skb+0x34)
 |   +begin   0x80000001   305    6.250  kmem_cache_alloc+0x58 (__alloc_skb+0x34)
 |   #end     0x80000001   311    6.000  kmem_cache_alloc+0x6c (__alloc_skb+0x34)
     #func                 317    5.500  __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
     #func                 322    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000   329    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                 334    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000   341    6.250  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func                 348    8.500  __kmalloc+0x10 (__alloc_skb+0x54)
 |   +begin   0x80000001   356    6.500  __kmalloc+0x94 (__alloc_skb+0x54)
 |   #end     0x80000001   363    6.000  __kmalloc+0xa8 (__alloc_skb+0x54)
     #func                 369    5.750  __ipipe_restore_root+0x10 (__kmalloc+0xf8)
     #func                 374    6.250  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000   381    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                 386    7.250  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000   393    8.250  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func                 402   17.500  dm9000_inblk_16bit+0x10 (dm9000_interrupt+0x19c)
     +func                 419    7.000  eth_type_trans+0x10 (dm9000_interrupt+0x1b4)
     +func                 426    7.250  netif_rx+0x14 (dm9000_interrupt+0x1c0)
 |   +begin   0x80000001   433    6.750  netif_rx+0x88 (dm9000_interrupt+0x1c0)
 |   #end     0x80000001   440    7.000  netif_rx+0x9c (dm9000_interrupt+0x1c0)
 |   #begin   0x80000001   447    6.250  netif_rx+0x1ac (dm9000_interrupt+0x1c0)
 |   #end     0x80000001   453    6.000  netif_rx+0x1c0 (dm9000_interrupt+0x1c0)
     #func                 459    7.000  __napi_schedule+0x10 (netif_rx+0x1d4)
 |   #begin   0x80000001   466    6.500  __napi_schedule+0x44 (netif_rx+0x1d4)
 |   #end     0x80000001   473    5.250  __napi_schedule+0x58 (netif_rx+0x1d4)
     #func                 478    6.750  __ipipe_restore_root+0x10 (__napi_schedule+0xa4)
 |   #begin   0x80000001   485    6.750  __ipipe_restore_root+0x48 (__napi_schedule+0xa4)
 |   #end     0x80000001   492    6.750  __ipipe_restore_root+0x5c (__napi_schedule+0xa4)
 |   #begin   0x80000001   498    6.500  netif_rx+0x108 (dm9000_interrupt+0x1c0)
 |   #end     0x80000001   505    6.000  netif_rx+0x11c (dm9000_interrupt+0x1c0)
     #func                 511    5.250  __ipipe_restore_root+0x10 (netif_rx+0x16c)
     #func                 516    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000   523    5.250  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                 528    7.250  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000   535    9.000  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
 |   +begin   0x80000001   544    6.500  dm9000_interrupt+0x2b0 (handle_IRQ_event+0x40)
 |   +end     0x80000001   551    8.500  dm9000_interrupt+0x2c4 (handle_IRQ_event+0x40)
 |   +begin   0x80000001   559    6.750  handle_IRQ_event+0x9c (handle_simple_irq+0x64)
 |   #end     0x80000001   566    6.250  handle_IRQ_event+0xb0 (handle_simple_irq+0x64)
     #func                 572    6.000  note_interrupt+0x14 (handle_simple_irq+0x84)
 |   #func                 578    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff   585    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                 590    6.250  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   #func                 597    5.750  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                 602    5.750  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   #func                 608    6.000  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   #func                 614    6.250  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   #func                 620    5.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   #func                 626    5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   #func                 632    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                 638    6.250  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                 644    9.000  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  #*func                 653   14.000  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  #*func                 667    7.500  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  #*func                 675    5.500  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  #*func                 680    6.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  #*func                 687    9.250  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   #func                 696    7.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #end     0xffffffff   704    5.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   #func                 709    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff   716    5.250  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                 721    5.750  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func                 727   12.250  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func                 739    6.000  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func                 745    5.500  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                 751    5.750  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func                 756    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                 763    6.500  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                 769    8.000  <bf0071fc> (xnintr_irq_handler+0x44)
 |  #*func                 777    5.750  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func                 783    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func                 791    7.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                 799    6.750  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff   805    8.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func                 814    6.000  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                 820    6.000  ipipe_check_context+0x10 (irq_exit+0x18)
     #func                 826    5.500  __do_softirq+0x10 (irq_exit+0x50)
     #func                 831    6.250  ipipe_check_context+0x10 (__do_softirq+0x20)
     #func                 838    6.750  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
 |   #begin   0x80000000   844    5.250  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
 |   +func                 850    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000   856    6.750  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
     +func                 863    7.250  net_rx_action+0x10 (__do_softirq+0x60)
 |   +begin   0x80000001   870    6.250  net_rx_action+0x50 (__do_softirq+0x60)
 |   #end     0x80000001   877    5.750  net_rx_action+0x64 (__do_softirq+0x60)
     #func                 882    6.750  __ipipe_unstall_root+0x10 (net_rx_action+0x88)
 |   #begin   0x80000000   889    5.500  __ipipe_unstall_root+0x30 (net_rx_action+0x88)
 |   +func                 895    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000   901    5.500  __ipipe_unstall_root+0x68 (net_rx_action+0x88)
     +func                 907    7.000  process_backlog+0x10 (net_rx_action+0xac)
 |   +begin   0x80000001   914    6.750  process_backlog+0x60 (net_rx_action+0xac)
 |   #end     0x80000001   921    5.750  process_backlog+0x74 (net_rx_action+0xac)
     #func                 926    6.250  __ipipe_unstall_root+0x10 (process_backlog+0xb4)
 |   #begin   0x80000000   933    5.750  __ipipe_unstall_root+0x30 (process_backlog+0xb4)
 |   +func                 938    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000   945    5.500  __ipipe_unstall_root+0x68 (process_backlog+0xb4)
     +func                 951    8.500  netif_receive_skb+0x14 (process_backlog+0xc0)
     +func                 959    9.250  ip_rcv+0x14 (netif_receive_skb+0x290)
     +func                 969    5.750  ip_route_input+0x14 (ip_rcv+0x238)
     +func                 974   10.250  rt_hash_code+0x10 (ip_route_input+0x38)
 |   +begin   0x80000001   985    6.250  ip_route_input+0xcc (ip_rcv+0x238)
 |   +end     0x80000001   991    6.750  ip_route_input+0xe0 (ip_rcv+0x238)
     +func                 998    7.250  ip_local_deliver+0x10 (ip_rcv+0x538)
     +func                1005    6.000  icmp_rcv+0x10 (ip_local_deliver+0xd8)
     +func                1011    5.250  __skb_checksum_complete+0x10 (icmp_rcv+0x64)
     +func                1016    5.500  __skb_checksum_complete_head+0x10 (__skb_checksum_complete+0x18)
     +func                1022    9.500  skb_checksum+0x14 (__skb_checksum_complete_head+0x24)
     +func                1031    7.000  icmp_echo+0x14 (icmp_rcv+0x138)
     +func                1038    6.000  icmp_reply+0x14 (icmp_echo+0x60)
     +func                1044    7.250  ip_options_echo+0x14 (icmp_reply+0x3c)
     +func                1051    5.500  local_bh_disable+0x10 (icmp_reply+0x48)
     +func                1057    7.500  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func                1064    5.250  ip_route_output_key+0x10 (icmp_reply+0xc8)
     +func                1070    6.000  ip_route_output_flow+0x10 (ip_route_output_key+0x1c)
     +func                1076    5.750  __ip_route_output_key+0x14 (ip_route_output_flow+0x1c)
     +func                1081    6.250  rt_hash_code+0x10 (__ip_route_output_key+0x30)
     +func                1088    5.500  local_bh_disable+0x10 (__ip_route_output_key+0x38)
     +func                1093    8.750  ipipe_check_context+0x10 (local_bh_disable+0x18)
 |   +begin   0x80000001  1102    6.750  __ip_route_output_key+0xdc (ip_route_output_flow+0x1c)
 |   +end     0x80000001  1109    5.500  __ip_route_output_key+0xf0 (ip_route_output_flow+0x1c)
     +func                1114    5.500  local_bh_enable+0x10 (__ip_route_output_key+0x11c)
     +func                1120    6.000  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func                1126    7.750  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func                1133    5.750  icmp_push_reply+0x14 (icmp_reply+0x140)
     +func                1139    6.750  ip_append_data+0x14 (icmp_push_reply+0x50)
 |   +begin   0x80000001  1146    6.750  ip_append_data+0xd0 (icmp_push_reply+0x50)
 |   +end     0x80000001  1153    9.250  ip_append_data+0xe8 (icmp_push_reply+0x50)
     +func                1162    6.750  sock_alloc_send_skb+0x14 (ip_append_data+0x550)
     +func                1169    6.000  __alloc_skb+0x10 (sock_alloc_send_skb+0x94)
     +func                1175    7.000  kmem_cache_alloc+0x10 (__alloc_skb+0x34)
 |   +begin   0x80000001  1182    6.500  kmem_cache_alloc+0x58 (__alloc_skb+0x34)
 |   #end     0x80000001  1188    6.250  kmem_cache_alloc+0x6c (__alloc_skb+0x34)
     #func                1194    5.500  __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
     #func                1200    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000  1206    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                1212    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  1219    6.000  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func                1225    8.250  __kmalloc+0x10 (__alloc_skb+0x54)
 |   +begin   0x80000001  1233    6.750  __kmalloc+0x94 (__alloc_skb+0x54)
 |   #end     0x80000001  1240    5.750  __kmalloc+0xa8 (__alloc_skb+0x54)
     #func                1245    5.500  __ipipe_restore_root+0x10 (__kmalloc+0xf8)
     #func                1251    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000  1257    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                1263    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  1270    8.750  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
 |   +begin   0x80000001  1279    6.750  sock_alloc_send_skb+0x2a4 (ip_append_data+0x550)
 |   +end     0x80000001  1285    7.250  sock_alloc_send_skb+0x2b8 (ip_append_data+0x550)
 |   +begin   0x80000001  1293    6.500  sock_alloc_send_skb+0x2f8 (ip_append_data+0x550)
 |   +end     0x80000001  1299    6.500  sock_alloc_send_skb+0x30c (ip_append_data+0x550)
     +func                1306    5.750  icmp_glue_bits+0x14 (ip_append_data+0x6c0)
     +func                1311   11.500  skb_copy_and_csum_bits+0x14 (icmp_glue_bits+0x38)
     +func                1323    8.000  ip_push_pending_frames+0x14 (icmp_push_reply+0xfc)
     +func                1331    6.500  __ip_select_ident+0x10 (ip_push_pending_frames+0x300)
     +func                1337    5.500  local_bh_disable+0x10 (__ip_select_ident+0x54)
     +func                1343    7.500  ipipe_check_context+0x10 (local_bh_disable+0x18)
 |   +func                1350    7.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  1358    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                1363    6.000  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func                1369    5.750  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                1375    5.500  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func                1380    5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func                1386    6.500  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func                1393    5.750  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func                1398    6.250  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func                1405    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                1411    7.000  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                1418   10.000  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func                1428   14.250  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func                1442    7.250  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func                1450    5.750  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func                1455    6.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func                1462    9.250  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func                1471    6.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                1477    7.500  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff  1485    5.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +func                1490    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  1497    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                1502    6.250  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func                1509   12.000  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func                1521    5.500  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func                1526    5.750  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                1532    5.750  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func                1538    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                1544    6.250  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                1550    7.750  <bf0071fc> (xnintr_irq_handler+0x44)
 |  # func                1558    5.750  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  # func                1564    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   +func                1572    6.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                1578    6.750  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +func                1585    7.000  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff  1592    6.250  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func                1598    5.500  local_bh_enable+0x10 (__ip_select_ident+0x68)
     +func                1604    5.750  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func                1610    8.250  ipipe_check_context+0x10 (local_bh_enable+0x98)
 |   +begin   0x80000001  1618    6.500  ip_push_pending_frames+0x3b0 (icmp_push_reply+0xfc)
 |   +end     0x80000001  1624    5.500  ip_push_pending_frames+0x3c4 (icmp_push_reply+0xfc)
     +func                1630    7.000  icmp_out_count+0x10 (ip_push_pending_frames+0x3e4)
     +func                1637    6.250  ip_output+0x10 (ip_push_pending_frames+0x3f4)
     +func                1643    8.500  ip_finish_output+0x10 (ip_output+0x54)
     +func                1652    7.000  neigh_resolve_output+0x14 (ip_finish_output+0x26c)
     +func                1659    5.250  local_bh_disable+0x10 (neigh_resolve_output+0x20c)
     +func                1664    6.500  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func                1670    9.000  eth_header+0x10 (neigh_resolve_output+0x258)
     +func                1679    5.500  local_bh_enable+0x10 (neigh_resolve_output+0x268)
     +func                1685    5.750  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func                1691    6.500  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func                1697    6.500  dev_queue_xmit+0x10 (neigh_resolve_output+0x280)
     +func                1704    5.750  local_bh_disable+0x10 (dev_queue_xmit+0x110)
     +func                1709    6.750  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func                1716    6.500  dev_hard_start_xmit+0x14 (dev_queue_xmit+0x1e4)
     +func                1723    8.000  bond_xmit_roundrobin+0x10 (dev_hard_start_xmit+0x1ec)
     +func                1731    5.750  bond_dev_queue_xmit+0x10 (bond_xmit_roundrobin+0xe0)
     +func                1736    6.000  dev_queue_xmit+0x10 (bond_dev_queue_xmit+0x1bc)
     +func                1742    5.750  local_bh_disable+0x10 (dev_queue_xmit+0x110)
     +func                1748    6.500  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func                1755    8.500  pfifo_fast_enqueue+0x10 (dev_queue_xmit+0x138)
 |   +begin   0x80000001  1763    6.500  dev_queue_xmit+0x174 (bond_dev_queue_xmit+0x1bc)
 |   +end     0x80000001  1770    6.000  dev_queue_xmit+0x188 (bond_dev_queue_xmit+0x1bc)
     +func                1776    5.500  __qdisc_run+0x10 (dev_queue_xmit+0x19c)
     +func                1781    6.250  pfifo_fast_dequeue+0x10 (__qdisc_run+0x38)
     +func                1787    6.000  dev_hard_start_xmit+0x14 (__qdisc_run+0x5c)
     +func                1793    7.250  dm9000_start_xmit+0x10 (dev_hard_start_xmit+0x1ec)
 |   +begin   0x80000001  1801    6.500  dm9000_start_xmit+0x5c (dev_hard_start_xmit+0x1ec)
 |   #end     0x80000001  1807    5.750  dm9000_start_xmit+0x70 (dev_hard_start_xmit+0x1ec)
     #func                1813   16.750  dm9000_outblk_16bit+0x10 (dm9000_start_xmit+0x9c)
     #func                1830    5.750  __ipipe_restore_root+0x10 (dm9000_start_xmit+0x174)
     #func                1835    8.000  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #func                1843    7.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  1851    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                1856    6.500  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func                1863   11.250  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func                1874    7.750  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func                1882    6.250  __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
 |   #func                1888    6.000  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
 |   #func                1894    6.250  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func                1900    7.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                1908    7.000  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff  1915    7.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   #begin   0x80000000  1922    5.750  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                1928    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  1935    5.500  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func                1940    5.750  kfree_skb+0x10 (dm9000_start_xmit+0x17c)
     +func                1946    5.500  __kfree_skb+0x10 (kfree_skb+0x80)
     +func                1952    6.500  skb_release_all+0x10 (__kfree_skb+0x18)
 |   +begin   0x80000001  1958    6.250  skb_release_all+0x64 (__kfree_skb+0x18)
 |   +end     0x80000001  1964    6.000  skb_release_all+0x78 (__kfree_skb+0x18)
     +func                1970    6.500  sock_wfree+0x10 (skb_release_all+0xd0)
 |   +begin   0x80000001  1977    6.750  sock_wfree+0x44 (skb_release_all+0xd0)
 |   +end     0x80000001  1984    5.250  sock_wfree+0x58 (skb_release_all+0xd0)
     +func                1989    7.750  sock_def_write_space+0x10 (sock_wfree+0x74)
 |   +begin   0x80000001  1997    6.750  sock_wfree+0x94 (skb_release_all+0xd0)
 |   +end     0x80000001  2003    5.500  sock_wfree+0xa8 (skb_release_all+0xd0)
     +func                2009    5.750  skb_release_data+0x10 (skb_release_all+0xd8)
     +func                2015    6.750  kfree+0x10 (skb_release_data+0xdc)
 |   +begin   0x80000001  2021    6.500  kfree+0x4c (skb_release_data+0xdc)
 |   #end     0x80000001  2028    6.500  kfree+0x60 (skb_release_data+0xdc)
     #func                2034    5.250  __ipipe_restore_root+0x10 (kfree+0xfc)
     #func                2040    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000  2046    5.750  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                2052    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  2059    6.500  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func                2065    6.750  kmem_cache_free+0x10 (__kfree_skb+0x108)
 |   +begin   0x80000001  2072    6.500  kmem_cache_free+0x48 (__kfree_skb+0x108)
 |   #end     0x80000001  2078    5.750  kmem_cache_free+0x5c (__kfree_skb+0x108)
     #func                2084    5.250  __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
     #func                2089    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000  2096    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                2101    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  2108    8.250  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
 |   +begin   0x80000001  2116    6.500  __qdisc_run+0x174 (dev_queue_xmit+0x19c)
 |   +end     0x80000001  2123    6.250  __qdisc_run+0x188 (dev_queue_xmit+0x19c)
 |   +func                2129    6.750  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  2136    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                2142    5.750  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func                2147    6.000  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                2153    5.500  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func                2159    5.500  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func                2164    6.500  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func                2171    5.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func                2176    6.000  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func                2182    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                2189    7.250  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                2196    8.750  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func                2205   14.750  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func                2220    7.250  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func                2227    5.750  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func                2233    6.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func                2239    9.500  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func                2248    6.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                2254    7.750  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff  2262    5.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +func                2268    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  2274    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                2280    5.500  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func                2285   12.250  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func                2298    5.750  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func                2303    5.500  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                2309    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func                2315    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                2321    6.500  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                2328    7.750  <bf0071fc> (xnintr_irq_handler+0x44)
 |  # func                2336    5.750  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  # func                2341    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   +func                2350    6.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                2356    7.000  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +func                2363    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff  2370    6.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func                2377    5.250  local_bh_enable+0x10 (dev_queue_xmit+0x26c)
     +func                2382    6.000  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func                2388    7.250  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func                2395    5.750  local_bh_enable+0x10 (dev_queue_xmit+0x26c)
     +func                2401    5.750  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func                2407    7.250  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func                2414    5.500  ip_cork_release+0x10 (ip_push_pending_frames+0x454)
     +func                2420    7.250  kfree+0x10 (ip_cork_release+0x28)
 |   +begin   0x80000001  2427    6.500  ip_cork_release+0x80 (ip_push_pending_frames+0x454)
 |   +end     0x80000001  2433    8.250  ip_cork_release+0x94 (ip_push_pending_frames+0x454)
 |   +begin   0x80000001  2442    6.500  icmp_reply+0x190 (icmp_echo+0x60)
 |   +end     0x80000001  2448    5.750  icmp_reply+0x1a4 (icmp_echo+0x60)
     +func                2454    5.250  icmp_xmit_unlock+0x10 (icmp_reply+0x1bc)
     +func                2459    5.250  local_bh_enable+0x10 (icmp_xmit_unlock+0x14)
     +func                2464    6.000  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func                2470    7.000  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func                2477    5.750  kfree_skb+0x10 (icmp_rcv+0x158)
     +func                2483    5.500  __kfree_skb+0x10 (kfree_skb+0x80)
     +func                2489    7.000  skb_release_all+0x10 (__kfree_skb+0x18)
 |   +begin   0x80000001  2496    6.500  skb_release_all+0x64 (__kfree_skb+0x18)
 |   +end     0x80000001  2502    5.750  skb_release_all+0x78 (__kfree_skb+0x18)
     +func                2508    6.000  skb_release_data+0x10 (skb_release_all+0xd8)
     +func                2514    6.750  kfree+0x10 (skb_release_data+0xdc)
 |   +begin   0x80000001  2521    6.500  kfree+0x4c (skb_release_data+0xdc)
 |   #end     0x80000001  2527    6.000  kfree+0x60 (skb_release_data+0xdc)
     #func                2533    5.250  __ipipe_restore_root+0x10 (kfree+0xfc)
     #func                2538    6.750  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000  2545    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                2551    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  2558    6.000  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func                2564    7.000  kmem_cache_free+0x10 (__kfree_skb+0x108)
 |   +begin   0x80000001  2571    6.500  kmem_cache_free+0x48 (__kfree_skb+0x108)
 |   #end     0x80000001  2577    5.750  kmem_cache_free+0x5c (__kfree_skb+0x108)
     #func                2583    5.250  __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
     #func                2588    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000  2595    5.750  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                2600    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  2607    9.750  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
 |   +begin   0x80000001  2617    7.000  process_backlog+0x168 (net_rx_action+0xac)
 |   +end     0x80000001  2624    7.250  process_backlog+0x17c (net_rx_action+0xac)
 |   +begin   0x80000001  2631    6.500  process_backlog+0x60 (net_rx_action+0xac)
 |   #end     0x80000001  2638    7.000  process_backlog+0x74 (net_rx_action+0xac)
 |   #begin   0x80000001  2645    6.500  process_backlog+0x134 (net_rx_action+0xac)
 |   #end     0x80000001  2651    5.500  process_backlog+0x148 (net_rx_action+0xac)
     #func                2657    6.250  __ipipe_unstall_root+0x10 (process_backlog+0x150)
 |   #begin   0x80000000  2663    5.500  __ipipe_unstall_root+0x30 (process_backlog+0x150)
 |   +func                2669    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  2676    7.750  __ipipe_unstall_root+0x68 (process_backlog+0x150)
 |   +begin   0x80000001  2683    6.500  net_rx_action+0x118 (__do_softirq+0x60)
 |   #end     0x80000001  2690    5.500  net_rx_action+0x12c (__do_softirq+0x60)
     #func                2695    6.500  __ipipe_unstall_root+0x10 (net_rx_action+0x208)
 |   #begin   0x80000000  2702    6.000  __ipipe_unstall_root+0x30 (net_rx_action+0x208)
 |   +func                2708    7.250  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  2715    7.250  __ipipe_unstall_root+0x68 (net_rx_action+0x208)
 |   +begin   0x80000001  2722    6.500  __do_softirq+0xa8 (irq_exit+0x50)
 |   #end     0x80000001  2729    5.750  __do_softirq+0xbc (irq_exit+0x50)
     #func                2735    6.250  _local_bh_enable+0x10 (__do_softirq+0xfc)
     #func                2741    8.000  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
 |   #begin   0x80000000  2749    8.500  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  2757    6.250  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func                2764    6.000  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                2770    5.750  irq_enter+0x10 (__exception_text_start+0x38)
     #func                2775    6.250  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                2782    6.250  handle_simple_irq+0x10 (__exception_text_start+0x48)
     #func                2788    5.500  handle_IRQ_event+0x10 (handle_simple_irq+0x64)
     #func                2793    6.250  __ipipe_unstall_root+0x10 (handle_IRQ_event+0x28)
 |   #begin   0x80000000  2800    5.750  __ipipe_unstall_root+0x30 (handle_IRQ_event+0x28)
 |   +func                2805    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  2812    5.500  __ipipe_unstall_root+0x68 (handle_IRQ_event+0x28)
     +func                2818    7.750  dm9000_interrupt+0x14 (handle_IRQ_event+0x40)
 |   +func                2826    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  2833    6.250  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                2839    5.750  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func                2845   10.750  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func                2855    7.250  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func                2863    6.500  __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
 |   +func                2869    5.500  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
 |   +func                2875    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func                2881    6.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                2887    7.000  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +func                2894    7.000  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff  2901    5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +func                2906    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  2913    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                2919    6.000  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func                2925    6.000  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                2931    5.750  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func                2937    5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func                2943    6.000  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func                2949    5.250  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func                2954    6.000  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func                2960    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                2966    6.750  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                2973    8.750  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func                2982   15.000  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func                2997    7.500  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func                3004    5.500  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func                3010    6.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func                3016    9.750  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func                3026    6.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                3033    7.750  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff  3040    5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +func                3046    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  3053    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                3058    5.250  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func                3064   12.000  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func                3076    6.000  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func                3082    5.750  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                3087    5.750  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func                3093    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                3099    6.500  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                3106    8.500  <bf0071fc> (xnintr_irq_handler+0x44)
 |  # func                3114    5.500  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  # func                3120    8.500  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   +func                3128    6.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                3135    7.250  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +func                3142    7.000  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff  3149    7.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func                3157    7.000  dm9000_inblk_16bit+0x10 (dm9000_interrupt+0xbc)
     +func                3164    5.500  __alloc_skb+0x10 (dm9000_interrupt+0x120)
     +func                3169    6.750  kmem_cache_alloc+0x10 (__alloc_skb+0x34)
 |   +begin   0x80000001  3176    6.500  kmem_cache_alloc+0x58 (__alloc_skb+0x34)
 |   #end     0x80000001  3183    6.000  kmem_cache_alloc+0x6c (__alloc_skb+0x34)
     #func                3189    5.500  __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
     #func                3194    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000  3201    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                3206    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  3213    6.250  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func                3219    8.250  __kmalloc+0x10 (__alloc_skb+0x54)
 |   +begin   0x80000001  3228    6.500  __kmalloc+0x94 (__alloc_skb+0x54)
 |   #end     0x80000001  3234    6.250  __kmalloc+0xa8 (__alloc_skb+0x54)
     #func                3240    5.750  __ipipe_restore_root+0x10 (__kmalloc+0xf8)
     #func                3246    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000  3253    5.250  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                3258    7.250  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  3265    8.250  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func                3273   17.500  dm9000_inblk_16bit+0x10 (dm9000_interrupt+0x19c)
     +func                3291    7.000  eth_type_trans+0x10 (dm9000_interrupt+0x1b4)
     +func                3298    7.500  netif_rx+0x14 (dm9000_interrupt+0x1c0)
 |   +begin   0x80000001  3305    6.500  netif_rx+0x88 (dm9000_interrupt+0x1c0)
 |   #end     0x80000001  3312    7.000  netif_rx+0x9c (dm9000_interrupt+0x1c0)
 |   #begin   0x80000001  3319    6.500  netif_rx+0x1ac (dm9000_interrupt+0x1c0)
 |   #end     0x80000001  3325    5.500  netif_rx+0x1c0 (dm9000_interrupt+0x1c0)
     #func                3331    7.000  __napi_schedule+0x10 (netif_rx+0x1d4)
 |   #begin   0x80000001  3338    6.500  __napi_schedule+0x44 (netif_rx+0x1d4)
 |   #end     0x80000001  3344    5.250  __napi_schedule+0x58 (netif_rx+0x1d4)
     #func                3350    7.000  __ipipe_restore_root+0x10 (__napi_schedule+0xa4)
 |   #begin   0x80000001  3357    6.750  __ipipe_restore_root+0x48 (__napi_schedule+0xa4)
 |   #end     0x80000001  3363    6.750  __ipipe_restore_root+0x5c (__napi_schedule+0xa4)
 |   #begin   0x80000001  3370    6.500  netif_rx+0x108 (dm9000_interrupt+0x1c0)
 |   #end     0x80000001  3377    5.750  netif_rx+0x11c (dm9000_interrupt+0x1c0)
     #func                3382    5.500  __ipipe_restore_root+0x10 (netif_rx+0x16c)
     #func                3388    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000  3394    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                3400    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  3407    9.000  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
 |   +begin   0x80000001  3416    7.250  dm9000_interrupt+0x2b0 (handle_IRQ_event+0x40)
 |   +end     0x80000001  3423    8.250  dm9000_interrupt+0x2c4 (handle_IRQ_event+0x40)
 |   +begin   0x80000001  3431    6.750  handle_IRQ_event+0x9c (handle_simple_irq+0x64)
 |   #end     0x80000001  3438    6.000  handle_IRQ_event+0xb0 (handle_simple_irq+0x64)
     #func                3444    6.750  note_interrupt+0x14 (handle_simple_irq+0x84)
     #func                3451    5.500  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                3456    6.750  ipipe_check_context+0x10 (irq_exit+0x18)
     #func                3463    5.500  __do_softirq+0x10 (irq_exit+0x50)
     #func                3469    5.750  ipipe_check_context+0x10 (__do_softirq+0x20)
     #func                3474    6.250  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
 |   #begin   0x80000000  3481    5.500  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
 |   +func                3486    7.250  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  3493    6.500  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
     +func                3500    7.000  net_rx_action+0x10 (__do_softirq+0x60)
 |   +begin   0x80000001  3507    7.000  net_rx_action+0x50 (__do_softirq+0x60)
 |   #end     0x80000001  3514    5.750  net_rx_action+0x64 (__do_softirq+0x60)
     #func                3520    6.500  __ipipe_unstall_root+0x10 (net_rx_action+0x88)
 |   #begin   0x80000000  3526    6.000  __ipipe_unstall_root+0x30 (net_rx_action+0x88)
 |   +func                3532    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  3539    5.750  __ipipe_unstall_root+0x68 (net_rx_action+0x88)
     +func                3545    6.500  process_backlog+0x10 (net_rx_action+0xac)
 |   +begin   0x80000001  3551    6.250  process_backlog+0x60 (net_rx_action+0xac)
 |   #end     0x80000001  3558    5.750  process_backlog+0x74 (net_rx_action+0xac)
     #func                3563    6.500  __ipipe_unstall_root+0x10 (process_backlog+0xb4)
 |   #begin   0x80000000  3570    5.750  __ipipe_unstall_root+0x30 (process_backlog+0xb4)
 |   +func                3576    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  3582    5.500  __ipipe_unstall_root+0x68 (process_backlog+0xb4)
     +func                3588    9.000  netif_receive_skb+0x14 (process_backlog+0xc0)
     +func                3597    8.500  ip_rcv+0x14 (netif_receive_skb+0x290)
     +func                3605    5.500  ip_route_input+0x14 (ip_rcv+0x238)
     +func                3611   10.250  rt_hash_code+0x10 (ip_route_input+0x38)
 |   +begin   0x80000001  3621    6.500  ip_route_input+0xcc (ip_rcv+0x238)
 |   +end     0x80000001  3628    7.000  ip_route_input+0xe0 (ip_rcv+0x238)
     +func                3635    7.500  ip_local_deliver+0x10 (ip_rcv+0x538)
     +func                3642    6.250  icmp_rcv+0x10 (ip_local_deliver+0xd8)
     +func                3648    5.750  __skb_checksum_complete+0x10 (icmp_rcv+0x64)
     +func                3654    5.250  __skb_checksum_complete_head+0x10 (__skb_checksum_complete+0x18)
     +func                3659    9.500  skb_checksum+0x14 (__skb_checksum_complete_head+0x24)
     +func                3669    7.250  icmp_echo+0x14 (icmp_rcv+0x138)
     +func                3676    7.750  icmp_reply+0x14 (icmp_echo+0x60)
 |   +func                3684    7.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  3691    6.250  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                3697    6.250  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func                3704    6.000  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                3710    6.000  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func                3716    5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func                3721    6.750  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func                3728    5.750  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func                3734    5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func                3740    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                3746    6.750  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                3753    9.000  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func                3762   15.000  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func                3777    7.250  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func                3784    5.750  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func                3790    6.500  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func                3796    8.750  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func                3805    6.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                3812    7.500  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff  3819    5.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +func                3825    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  3831    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                3837    5.750  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func                3843   12.500  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func                3855    5.750  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func                3861    5.250  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                3866    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func                3872    6.000  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                3878    6.250  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                3884    8.250  <bf0071fc> (xnintr_irq_handler+0x44)
 |  # func                3893    5.500  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  # func                3898    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   +func                3906    6.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                3913    6.750  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +func                3919    7.500  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff  3927    7.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func                3934    6.500  ip_options_echo+0x14 (icmp_reply+0x3c)
     +func                3941    5.250  local_bh_disable+0x10 (icmp_reply+0x48)
     +func                3946    8.000  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func                3954    5.500  ip_route_output_key+0x10 (icmp_reply+0xc8)
     +func                3960    5.250  ip_route_output_flow+0x10 (ip_route_output_key+0x1c)
     +func                3965    5.250  __ip_route_output_key+0x14 (ip_route_output_flow+0x1c)
     +func                3970    6.250  rt_hash_code+0x10 (__ip_route_output_key+0x30)
     +func                3976    5.500  local_bh_disable+0x10 (__ip_route_output_key+0x38)
     +func                3982    9.000  ipipe_check_context+0x10 (local_bh_disable+0x18)
 |   +begin   0x80000001  3991    6.250  __ip_route_output_key+0xdc (ip_route_output_flow+0x1c)
 |   +end     0x80000001  3997    5.500  __ip_route_output_key+0xf0 (ip_route_output_flow+0x1c)
     +func                4003    5.750  local_bh_enable+0x10 (__ip_route_output_key+0x11c)
     +func                4008    5.750  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func                4014    7.500  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func                4022    6.000  icmp_push_reply+0x14 (icmp_reply+0x140)
     +func                4028    7.000  ip_append_data+0x14 (icmp_push_reply+0x50)
 |   +begin   0x80000001  4035    6.500  ip_append_data+0xd0 (icmp_push_reply+0x50)
 |   +end     0x80000001  4041    9.500  ip_append_data+0xe8 (icmp_push_reply+0x50)
     +func                4051    6.750  sock_alloc_send_skb+0x14 (ip_append_data+0x550)
     +func                4057    5.750  __alloc_skb+0x10 (sock_alloc_send_skb+0x94)
     +func                4063    6.750  kmem_cache_alloc+0x10 (__alloc_skb+0x34)
 |   +begin   0x80000001  4070    6.500  kmem_cache_alloc+0x58 (__alloc_skb+0x34)
 |   #end     0x80000001  4076    6.000  kmem_cache_alloc+0x6c (__alloc_skb+0x34)
     #func                4082    6.000  __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
     #func                4088    6.250  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000  4095    5.750  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                4100    7.250  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  4108    6.000  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func                4114    8.750  __kmalloc+0x10 (__alloc_skb+0x54)
 |   +begin   0x80000001  4122    6.250  __kmalloc+0x94 (__alloc_skb+0x54)
 |   #end     0x80000001  4129    6.000  __kmalloc+0xa8 (__alloc_skb+0x54)
     #func                4135    5.500  __ipipe_restore_root+0x10 (__kmalloc+0xf8)
     #func                4140    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000  4147    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                4152    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  4159    9.250  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
 |   +begin   0x80000001  4168    6.250  sock_alloc_send_skb+0x2a4 (ip_append_data+0x550)
 |   +end     0x80000001  4175    6.750  sock_alloc_send_skb+0x2b8 (ip_append_data+0x550)
 |   +begin   0x80000001  4181    6.500  sock_alloc_send_skb+0x2f8 (ip_append_data+0x550)
 |   +end     0x80000001  4188    7.000  sock_alloc_send_skb+0x30c (ip_append_data+0x550)
     +func                4195    5.500  icmp_glue_bits+0x14 (ip_append_data+0x6c0)
     +func                4200   11.000  skb_copy_and_csum_bits+0x14 (icmp_glue_bits+0x38)
     +func                4211    7.500  ip_push_pending_frames+0x14 (icmp_push_reply+0xfc)
     +func                4219    6.250  __ip_select_ident+0x10 (ip_push_pending_frames+0x300)
     +func                4225    5.500  local_bh_disable+0x10 (__ip_select_ident+0x54)
     +func                4231    6.250  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func                4237    5.750  local_bh_enable+0x10 (__ip_select_ident+0x68)
     +func                4243    5.750  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func                4248    8.000  ipipe_check_context+0x10 (local_bh_enable+0x98)
 |   +begin   0x80000001  4256    6.500  ip_push_pending_frames+0x3b0 (icmp_push_reply+0xfc)
 |   +end     0x80000001  4263    5.500  ip_push_pending_frames+0x3c4 (icmp_push_reply+0xfc)
     +func                4268    7.000  icmp_out_count+0x10 (ip_push_pending_frames+0x3e4)
     +func                4275    6.000  ip_output+0x10 (ip_push_pending_frames+0x3f4)
     +func                4281    8.250  ip_finish_output+0x10 (ip_output+0x54)
     +func                4290    6.500  neigh_resolve_output+0x14 (ip_finish_output+0x26c)
     +func                4296    6.000  local_bh_disable+0x10 (neigh_resolve_output+0x20c)
     +func                4302    6.000  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func                4308    8.750  eth_header+0x10 (neigh_resolve_output+0x258)
     +func                4317    5.500  local_bh_enable+0x10 (neigh_resolve_output+0x268)
     +func                4322    6.000  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func                4328    6.500  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func                4335    6.250  dev_queue_xmit+0x10 (neigh_resolve_output+0x280)
     +func                4341    5.500  local_bh_disable+0x10 (dev_queue_xmit+0x110)
     +func                4347    6.750  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func                4353    6.250  dev_hard_start_xmit+0x14 (dev_queue_xmit+0x1e4)
     +func                4360    9.500  bond_xmit_roundrobin+0x10 (dev_hard_start_xmit+0x1ec)
     +func                4369    6.250  bond_dev_queue_xmit+0x10 (bond_xmit_roundrobin+0xe0)
     +func                4375    6.250  dev_queue_xmit+0x10 (bond_dev_queue_xmit+0x1bc)
     +func                4382    6.000  local_bh_disable+0x10 (dev_queue_xmit+0x110)
     +func                4388    6.250  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func                4394    8.250  pfifo_fast_enqueue+0x10 (dev_queue_xmit+0x138)
 |   +begin   0x80000001  4402    6.500  dev_queue_xmit+0x174 (bond_dev_queue_xmit+0x1bc)
 |   +end     0x80000001  4409    5.250  dev_queue_xmit+0x188 (bond_dev_queue_xmit+0x1bc)
     +func                4414    5.500  __qdisc_run+0x10 (dev_queue_xmit+0x19c)
     +func                4419    6.500  pfifo_fast_dequeue+0x10 (__qdisc_run+0x38)
     +func                4426    6.500  dev_hard_start_xmit+0x14 (__qdisc_run+0x5c)
     +func                4432    7.000  dm9000_start_xmit+0x10 (dev_hard_start_xmit+0x1ec)
 |   +begin   0x80000001  4439    6.250  dm9000_start_xmit+0x5c (dev_hard_start_xmit+0x1ec)
 |   #end     0x80000001  4446    5.750  dm9000_start_xmit+0x70 (dev_hard_start_xmit+0x1ec)
     #func                4451    8.000  dm9000_outblk_16bit+0x10 (dm9000_start_xmit+0x9c)
 |   #func                4459    7.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  4467    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                4472    6.000  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   #func                4478    6.250  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                4484    5.750  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   #func                4490    5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   #func                4496    6.250  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   #func                4502    5.750  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   #func                4508    5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   #func                4514    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                4520    7.000  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                4527    9.500  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  #*func                4537   15.000  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  #*func                4552    7.250  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  #*func                4559    5.500  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  #*func                4564    7.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  #*func                4572    9.500  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   #func                4581    7.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #end     0xffffffff  4589    5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   #func                4594    6.750  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  4601    5.250  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                4606    5.750  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func                4612   12.000  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func                4624    6.000  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func                4630    5.750  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                4636    5.500  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func                4641    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                4648    7.000  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                4655    8.500  <bf0071fc> (xnintr_irq_handler+0x44)
 |  #*func                4663    6.000  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func                4669    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func                4678    8.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                4686    6.750  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff  4692   18.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func                4711    5.750  __ipipe_restore_root+0x10 (dm9000_start_xmit+0x174)
     #func                4717    6.000  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #func                4723    6.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  4729    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                4734    6.250  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func                4741   11.000  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func                4752    6.750  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func                4758    6.250  __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
 |   #func                4765    5.750  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
 |   #func                4770    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func                4776    7.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                4784    7.500  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff  4791    8.000  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   #begin   0x80000000  4799    6.250  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                4805    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  4812    5.500  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func                4818    5.500  kfree_skb+0x10 (dm9000_start_xmit+0x17c)
     +func                4823    5.750  __kfree_skb+0x10 (kfree_skb+0x80)
     +func                4829    6.750  skb_release_all+0x10 (__kfree_skb+0x18)
 |   +begin   0x80000001  4836    6.500  skb_release_all+0x64 (__kfree_skb+0x18)
 |   +end     0x80000001  4842    5.750  skb_release_all+0x78 (__kfree_skb+0x18)
     +func                4848    6.500  sock_wfree+0x10 (skb_release_all+0xd0)
 |   +begin   0x80000001  4854    7.000  sock_wfree+0x44 (skb_release_all+0xd0)
 |   +end     0x80000001  4861    5.750  sock_wfree+0x58 (skb_release_all+0xd0)
     +func                4867    8.000  sock_def_write_space+0x10 (sock_wfree+0x74)
 |   +begin   0x80000001  4875    7.500  sock_wfree+0x94 (skb_release_all+0xd0)
 |   +end     0x80000001  4883    5.500  sock_wfree+0xa8 (skb_release_all+0xd0)
     +func                4888    5.750  skb_release_data+0x10 (skb_release_all+0xd8)
     +func                4894    6.750  kfree+0x10 (skb_release_data+0xdc)
 |   +begin   0x80000001  4901    6.250  kfree+0x4c (skb_release_data+0xdc)
 |   #end     0x80000001  4907    6.500  kfree+0x60 (skb_release_data+0xdc)
     #func                4913    5.250  __ipipe_restore_root+0x10 (kfree+0xfc)
     #func                4919    6.750  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000  4925    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                4931    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  4938    6.500  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func                4944    6.750  kmem_cache_free+0x10 (__kfree_skb+0x108)
 |   +begin   0x80000001  4951    6.750  kmem_cache_free+0x48 (__kfree_skb+0x108)
 |   #end     0x80000001  4958    5.500  kmem_cache_free+0x5c (__kfree_skb+0x108)
     #func                4963    5.250  __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
     #func                4969    6.750  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000  4975    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                4981    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  4988    8.750  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
 |   +begin   0x80000001  4996    6.500  __qdisc_run+0x174 (dev_queue_xmit+0x19c)
 |   +end     0x80000001  5003    5.750  __qdisc_run+0x188 (dev_queue_xmit+0x19c)
     +func                5009    5.500  local_bh_enable+0x10 (dev_queue_xmit+0x26c)
     +func                5014    6.000  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func                5020    7.750  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func                5028    6.000  local_bh_enable+0x10 (dev_queue_xmit+0x26c)
     +func                5034    6.000  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func                5040    7.250  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func                5047    5.750  ip_cork_release+0x10 (ip_push_pending_frames+0x454)
     +func                5053    7.000  kfree+0x10 (ip_cork_release+0x28)
 |   +begin   0x80000001  5060    6.500  ip_cork_release+0x80 (ip_push_pending_frames+0x454)
 |   +end     0x80000001  5066    7.750  ip_cork_release+0x94 (ip_push_pending_frames+0x454)
 |   +begin   0x80000001  5074    6.500  icmp_reply+0x190 (icmp_echo+0x60)
 |   +end     0x80000001  5081    5.500  icmp_reply+0x1a4 (icmp_echo+0x60)
     +func                5086    5.250  icmp_xmit_unlock+0x10 (icmp_reply+0x1bc)
     +func                5091    5.250  local_bh_enable+0x10 (icmp_xmit_unlock+0x14)
     +func                5097    6.000  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func                5103    7.000  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func                5110    5.500  kfree_skb+0x10 (icmp_rcv+0x158)
     +func                5115    5.250  __kfree_skb+0x10 (kfree_skb+0x80)
     +func                5120    7.250  skb_release_all+0x10 (__kfree_skb+0x18)
 |   +begin   0x80000001  5128    6.500  skb_release_all+0x64 (__kfree_skb+0x18)
 |   +end     0x80000001  5134    6.000  skb_release_all+0x78 (__kfree_skb+0x18)
     +func                5140    6.000  skb_release_data+0x10 (skb_release_all+0xd8)
     +func                5146    6.750  kfree+0x10 (skb_release_data+0xdc)
 |   +begin   0x80000001  5153    6.750  kfree+0x4c (skb_release_data+0xdc)
 |   #end     0x80000001  5160    6.000  kfree+0x60 (skb_release_data+0xdc)
     #func                5166    5.250  __ipipe_restore_root+0x10 (kfree+0xfc)
     #func                5171    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000  5177    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                5183    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  5190    6.000  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func                5196    6.500  kmem_cache_free+0x10 (__kfree_skb+0x108)
 |   +begin   0x80000001  5202    6.750  kmem_cache_free+0x48 (__kfree_skb+0x108)
 |   #end     0x80000001  5209    6.000  kmem_cache_free+0x5c (__kfree_skb+0x108)
     #func                5215    5.250  __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
     #func                5220    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000  5227    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                5232    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  5239    6.750  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
 |   +func                5246    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  5253    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                5259    5.750  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func                5264    5.250  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                5270    6.000  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func                5276    5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func                5281    6.250  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func                5288    5.250  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func                5293    6.000  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func                5299    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                5305    6.500  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                5312    8.750  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func                5321   14.500  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func                5335    7.500  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func                5343    5.500  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func                5348    6.000  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func                5354    9.250  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func                5363    6.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                5370    7.250  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff  5377    5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +func                5383    6.750  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  5390    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                5395    5.750  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func                5401   12.000  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func                5413    6.000  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func                5419    5.750  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                5425    5.500  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func                5430    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                5436    6.750  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                5443    8.250  <bf0071fc> (xnintr_irq_handler+0x44)
 |  # func                5451    5.500  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  # func                5457    8.000  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   +func                5465    6.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                5472    7.500  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +func                5479    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff  5486   10.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +begin   0x80000001  5497    7.000  process_backlog+0x168 (net_rx_action+0xac)
 |   +end     0x80000001  5504    7.250  process_backlog+0x17c (net_rx_action+0xac)
 |   +begin   0x80000001  5511    6.500  process_backlog+0x60 (net_rx_action+0xac)
 |   #end     0x80000001  5518    7.250  process_backlog+0x74 (net_rx_action+0xac)
 |   #begin   0x80000001  5525    6.750  process_backlog+0x134 (net_rx_action+0xac)
 |   #end     0x80000001  5532    5.500  process_backlog+0x148 (net_rx_action+0xac)
     #func                5537    6.500  __ipipe_unstall_root+0x10 (process_backlog+0x150)
 |   #begin   0x80000000  5544    5.500  __ipipe_unstall_root+0x30 (process_backlog+0x150)
 |   +func                5549    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  5556    7.750  __ipipe_unstall_root+0x68 (process_backlog+0x150)
 |   +begin   0x80000001  5564    6.250  net_rx_action+0x118 (__do_softirq+0x60)
 |   #end     0x80000001  5570    5.750  net_rx_action+0x12c (__do_softirq+0x60)
     #func                5576    6.500  __ipipe_unstall_root+0x10 (net_rx_action+0x208)
 |   #begin   0x80000000  5582    6.250  __ipipe_unstall_root+0x30 (net_rx_action+0x208)
 |   +func                5589    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  5595    7.000  __ipipe_unstall_root+0x68 (net_rx_action+0x208)
 |   +begin   0x80000001  5602    6.500  __do_softirq+0xa8 (irq_exit+0x50)
 |   #end     0x80000001  5609    6.000  __do_softirq+0xbc (irq_exit+0x50)
     #func                5615    6.000  _local_bh_enable+0x10 (__do_softirq+0xfc)
     #func                5621    8.000  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
 |   #begin   0x80000000  5629    8.250  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  5637    5.750  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func                5643    6.250  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                5649    5.500  irq_enter+0x10 (__exception_text_start+0x38)
     #func                5655    6.000  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                5661    6.250  handle_simple_irq+0x10 (__exception_text_start+0x48)
     #func                5667    5.500  handle_IRQ_event+0x10 (handle_simple_irq+0x64)
     #func                5672    6.500  __ipipe_unstall_root+0x10 (handle_IRQ_event+0x28)
 |   #begin   0x80000000  5679    5.500  __ipipe_unstall_root+0x30 (handle_IRQ_event+0x28)
 |   +func                5684    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  5691    5.750  __ipipe_unstall_root+0x68 (handle_IRQ_event+0x28)
     +func                5697    8.000  dm9000_interrupt+0x14 (handle_IRQ_event+0x40)
 |   +func                5705    7.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  5712    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                5718    5.500  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func                5724   11.250  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func                5735    7.250  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func                5742    7.000  __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
 |   +func                5749    5.500  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
 |   +func                5755    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func                5761    6.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                5767    7.000  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +func                5774    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff  5781    7.250  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func                5788    7.250  dm9000_inblk_16bit+0x10 (dm9000_interrupt+0xbc)
     +func                5796    6.000  __alloc_skb+0x10 (dm9000_interrupt+0x120)
     +func                5802    6.750  kmem_cache_alloc+0x10 (__alloc_skb+0x34)
 |   +begin   0x80000001  5808    6.500  kmem_cache_alloc+0x58 (__alloc_skb+0x34)
 |   #end     0x80000001  5815    6.000  kmem_cache_alloc+0x6c (__alloc_skb+0x34)
     #func                5821    5.500  __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
     #func                5826    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000  5833    5.250  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                5838    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  5845    6.250  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func                5851    8.250  __kmalloc+0x10 (__alloc_skb+0x54)
 |   +begin   0x80000001  5860    6.750  __kmalloc+0x94 (__alloc_skb+0x54)
 |   #end     0x80000001  5866    5.750  __kmalloc+0xa8 (__alloc_skb+0x54)
     #func                5872    5.500  __ipipe_restore_root+0x10 (__kmalloc+0xf8)
     #func                5878    6.750  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000  5884    5.250  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                5890    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  5897    8.500  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func                5905   17.250  dm9000_inblk_16bit+0x10 (dm9000_interrupt+0x19c)
     +func                5922    6.750  eth_type_trans+0x10 (dm9000_interrupt+0x1b4)
     +func                5929    7.500  netif_rx+0x14 (dm9000_interrupt+0x1c0)
 |   +begin   0x80000001  5937    6.500  netif_rx+0x88 (dm9000_interrupt+0x1c0)
 |   #end     0x80000001  5943    6.750  netif_rx+0x9c (dm9000_interrupt+0x1c0)
 |   #begin   0x80000001  5950    6.500  netif_rx+0x1ac (dm9000_interrupt+0x1c0)
 |   #end     0x80000001  5956    5.500  netif_rx+0x1c0 (dm9000_interrupt+0x1c0)
     #func                5962    7.000  __napi_schedule+0x10 (netif_rx+0x1d4)
 |   #begin   0x80000001  5969    6.250  __napi_schedule+0x44 (netif_rx+0x1d4)
 |   #end     0x80000001  5975    5.500  __napi_schedule+0x58 (netif_rx+0x1d4)
     #func                5981    6.750  __ipipe_restore_root+0x10 (__napi_schedule+0xa4)
 |   #begin   0x80000001  5987    7.250  __ipipe_restore_root+0x48 (__napi_schedule+0xa4)
 |   #end     0x80000001  5995    6.500  __ipipe_restore_root+0x5c (__napi_schedule+0xa4)
 |   #begin   0x80000001  6001    6.500  netif_rx+0x108 (dm9000_interrupt+0x1c0)
 |   #end     0x80000001  6008    6.500  netif_rx+0x11c (dm9000_interrupt+0x1c0)
 |   #func                6014    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  6021    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                6027    5.750  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   #func                6032    5.750  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                6038    5.750  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   #func                6044    5.500  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   #func                6049    6.250  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   #func                6056    5.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   #func                6061    6.000  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   #func                6067    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                6074    6.750  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                6080    9.750  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  #*func                6090   14.500  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  #*func                6105    7.000  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  #*func                6112    5.250  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  #*func                6117    6.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  #*func                6123    9.500  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   #func                6133    8.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #end     0xffffffff  6141    5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   #func                6146    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  6153    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                6158    5.750  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func                6164   11.750  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func                6176    6.000  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func                6182    5.500  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                6187    5.500  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func                6193    6.000  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                6199    6.250  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                6205    8.250  <bf0071fc> (xnintr_irq_handler+0x44)
 |  #*func                6213    5.500  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func                6219    8.000  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func                6227    8.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                6235    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff  6242    6.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func                6249    5.250  __ipipe_restore_root+0x10 (netif_rx+0x16c)
     #func                6254    6.750  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000  6261    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func                6266    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  6273    8.750  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
 |   +begin   0x80000001  6282    6.750  dm9000_interrupt+0x2b0 (handle_IRQ_event+0x40)
 |   +end     0x80000001  6289    8.750  dm9000_interrupt+0x2c4 (handle_IRQ_event+0x40)
 |   +begin   0x80000001  6298    7.000  handle_IRQ_event+0x9c (handle_simple_irq+0x64)
 |   #end     0x80000001  6305    5.750  handle_IRQ_event+0xb0 (handle_simple_irq+0x64)
     #func                6310    7.000  note_interrupt+0x14 (handle_simple_irq+0x84)
     #func                6317    6.000  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                6323    6.250  ipipe_check_context+0x10 (irq_exit+0x18)
     #func                6330    5.250  __do_softirq+0x10 (irq_exit+0x50)
     #func                6335    5.750  ipipe_check_context+0x10 (__do_softirq+0x20)
     #func                6341    6.750  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
 |   #begin   0x80000000  6347    5.500  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
 |   +func                6353    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  6360    6.750  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
     +func                6366    7.000  net_rx_action+0x10 (__do_softirq+0x60)
 |   +begin   0x80000001  6373    6.250  net_rx_action+0x50 (__do_softirq+0x60)
 |   #end     0x80000001  6380    5.500  net_rx_action+0x64 (__do_softirq+0x60)
     #func                6385    6.500  __ipipe_unstall_root+0x10 (net_rx_action+0x88)
 |   #begin   0x80000000  6392    6.250  __ipipe_unstall_root+0x30 (net_rx_action+0x88)
 |   +func                6398    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  6405    5.750  __ipipe_unstall_root+0x68 (net_rx_action+0x88)
     +func                6411    6.500  process_backlog+0x10 (net_rx_action+0xac)
 |   +begin   0x80000001  6417    6.500  process_backlog+0x60 (net_rx_action+0xac)
 |   #end     0x80000001  6424    5.750  process_backlog+0x74 (net_rx_action+0xac)
     #func                6429    6.250  __ipipe_unstall_root+0x10 (process_backlog+0xb4)
 |   #begin   0x80000000  6436    5.750  __ipipe_unstall_root+0x30 (process_backlog+0xb4)
 |   +func                6441    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  6448    5.500  __ipipe_unstall_root+0x68 (process_backlog+0xb4)
     +func                6454    9.000  netif_receive_skb+0x14 (process_backlog+0xc0)
     +func                6463    9.250  ip_rcv+0x14 (netif_receive_skb+0x290)
     +func                6472    5.750  ip_route_input+0x14 (ip_rcv+0x238)
     +func                6478    9.750  rt_hash_code+0x10 (ip_route_input+0x38)
 |   +begin   0x80000001  6488    6.250  ip_route_input+0xcc (ip_rcv+0x238)
 |   +end     0x80000001  6494    7.750  ip_route_input+0xe0 (ip_rcv+0x238)
     +func                6502    7.250  ip_local_deliver+0x10 (ip_rcv+0x538)
     +func                6509    6.000  icmp_rcv+0x10 (ip_local_deliver+0xd8)
     +func                6515    5.250  __skb_checksum_complete+0x10 (icmp_rcv+0x64)
     +func                6520    5.500  __skb_checksum_complete_head+0x10 (__skb_checksum_complete+0x18)
     +func                6526   10.250  skb_checksum+0x14 (__skb_checksum_complete_head+0x24)
     +func                6536    5.750  icmp_echo+0x14 (icmp_rcv+0x138)
     +func                6542    6.500  icmp_reply+0x14 (icmp_echo+0x60)
     +func                6548    7.000  ip_options_echo+0x14 (icmp_reply+0x3c)
     +func                6555    5.500  local_bh_disable+0x10 (icmp_reply+0x48)
     +func                6561    7.250  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func                6568    5.250  ip_route_output_key+0x10 (icmp_reply+0xc8)
     +func                6573    5.750  ip_route_output_flow+0x10 (ip_route_output_key+0x1c)
     +func                6579    5.500  __ip_route_output_key+0x14 (ip_route_output_flow+0x1c)
     +func                6584    6.250  rt_hash_code+0x10 (__ip_route_output_key+0x30)
     +func                6591    5.250  local_bh_disable+0x10 (__ip_route_output_key+0x38)
     +func                6596    9.000  ipipe_check_context+0x10 (local_bh_disable+0x18)
 |   +begin   0x80000001  6605    6.750  __ip_route_output_key+0xdc (ip_route_output_flow+0x1c)
 |   +end     0x80000001  6612    5.500  __ip_route_output_key+0xf0 (ip_route_output_flow+0x1c)
     +func                6617    5.500  local_bh_enable+0x10 (__ip_route_output_key+0x11c)
     +func                6623    5.750  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func                6628    8.000  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func                6636    5.750  icmp_push_reply+0x14 (icmp_reply+0x140)
     +func                6642    6.750  ip_append_data+0x14 (icmp_push_reply+0x50)
 |   +begin   0x80000001  6649    6.500  ip_append_data+0xd0 (icmp_push_reply+0x50)
 |   +end     0x80000001  6655    9.250  ip_append_data+0xe8 (icmp_push_reply+0x50)
     +func                6665    7.000  sock_alloc_send_skb+0x14 (ip_append_data+0x550)
     +func                6672    5.750  __alloc_skb+0x10 (sock_alloc_send_skb+0x94)
     +func                6677    6.750  kmem_cache_alloc+0x10 (__alloc_skb+0x34)
 |   +begin   0x80000001  6684    6.750  kmem_cache_alloc+0x58 (__alloc_skb+0x34)
 |   #end     0x80000001  6691    5.750  kmem_cache_alloc+0x6c (__alloc_skb+0x34)
     #func                6697    5.250  __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
     #func                6702    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000  6708    0.000  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)

[-- Attachment #5: max3.txt --]
[-- Type: text/plain, Size: 90910 bytes --]

I-pipe worst-case tracing service on 2.6.24.3/ipipe-1.9-00
------------------------------------------------------------
CPU: 0, Begin: 6446335856 cycles, Trace Points: 19 (-1000/+2), Length: 999 us
Calibrated minimum trace-point overhead: 1.500 us

 +----- Hard IRQs ('|': locked)
 |+---- <unused>
 ||+--- <unused>
 |||+-- Xenomai
 ||||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||||                        +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||||                        |        +- NMI noise ('N')
 |||||                        |        |
      Type    User Val.   Time    Delay  Function (Parent)
 |  #*func               -7559    8.000  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func               -7551    7.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func               -7544    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff -7536    7.250  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   #begin   0x80000000 -7529    5.500  __ipipe_unstall_root+0x30 (process_backlog+0x150)
 |   +func               -7524    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -7517    7.500  __ipipe_unstall_root+0x68 (process_backlog+0x150)
 |   +begin   0x80000001 -7509    6.500  net_rx_action+0x118 (__do_softirq+0x60)
 |   #end     0x80000001 -7503    5.500  net_rx_action+0x12c (__do_softirq+0x60)
     #func               -7497    6.750  __ipipe_unstall_root+0x10 (net_rx_action+0x208)
 |   #begin   0x80000000 -7490    5.750  __ipipe_unstall_root+0x30 (net_rx_action+0x208)
 |   +func               -7485    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -7478    6.750  __ipipe_unstall_root+0x68 (net_rx_action+0x208)
 |   +begin   0x80000001 -7471    6.500  __do_softirq+0xa8 (irq_exit+0x50)
 |   #end     0x80000001 -7464    6.000  __do_softirq+0xbc (irq_exit+0x50)
     #func               -7458    5.750  _local_bh_enable+0x10 (__do_softirq+0xfc)
     #func               -7453    8.000  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
 |   #begin   0x80000000 -7445    8.750  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000 -7436    6.250  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func               -7430    5.750  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func               -7424    5.500  irq_enter+0x10 (__exception_text_start+0x38)
     #func               -7418    6.000  ipipe_check_context+0x10 (irq_enter+0x18)
     #func               -7412    6.000  handle_simple_irq+0x10 (__exception_text_start+0x48)
     #func               -7406    5.750  handle_IRQ_event+0x10 (handle_simple_irq+0x64)
     #func               -7401    6.250  __ipipe_unstall_root+0x10 (handle_IRQ_event+0x28)
 |   #begin   0x80000000 -7394    5.500  __ipipe_unstall_root+0x30 (handle_IRQ_event+0x28)
 |   +func               -7389    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -7382    5.750  __ipipe_unstall_root+0x68 (handle_IRQ_event+0x28)
     +func               -7376    7.500  dm9000_interrupt+0x14 (handle_IRQ_event+0x40)
 |   +func               -7369    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff -7362    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func               -7356    5.750  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func               -7350   10.750  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func               -7339    7.250  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func               -7332    6.250  __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
 |   +func               -7326    5.500  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
 |   +func               -7320    5.750  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func               -7315    7.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func               -7308    7.000  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +func               -7301    7.000  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff -7294    7.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func               -7286    6.750  dm9000_inblk_16bit+0x10 (dm9000_interrupt+0xbc)
     +func               -7279    6.000  __alloc_skb+0x10 (dm9000_interrupt+0x120)
     +func               -7273    7.000  kmem_cache_alloc+0x10 (__alloc_skb+0x34)
 |   +begin   0x80000001 -7266    6.250  kmem_cache_alloc+0x58 (__alloc_skb+0x34)
 |   #end     0x80000001 -7260    6.000  kmem_cache_alloc+0x6c (__alloc_skb+0x34)
     #func               -7254    5.500  __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
     #func               -7249    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -7242    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -7237    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -7230    6.250  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func               -7223    8.500  __kmalloc+0x10 (__alloc_skb+0x54)
 |   +begin   0x80000001 -7215    6.500  __kmalloc+0x94 (__alloc_skb+0x54)
 |   #end     0x80000001 -7208    6.000  __kmalloc+0xa8 (__alloc_skb+0x54)
     #func               -7202    5.750  __ipipe_restore_root+0x10 (__kmalloc+0xf8)
     #func               -7197    6.250  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -7190    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -7185    7.250  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -7178    8.250  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func               -7169   17.500  dm9000_inblk_16bit+0x10 (dm9000_interrupt+0x19c)
     +func               -7152    7.000  eth_type_trans+0x10 (dm9000_interrupt+0x1b4)
     +func               -7145    7.250  netif_rx+0x14 (dm9000_interrupt+0x1c0)
 |   +begin   0x80000001 -7138    6.750  netif_rx+0x88 (dm9000_interrupt+0x1c0)
 |   #end     0x80000001 -7131    7.000  netif_rx+0x9c (dm9000_interrupt+0x1c0)
 |   #begin   0x80000001 -7124    6.250  netif_rx+0x1ac (dm9000_interrupt+0x1c0)
 |   #end     0x80000001 -7118    6.000  netif_rx+0x1c0 (dm9000_interrupt+0x1c0)
     #func               -7112    7.000  __napi_schedule+0x10 (netif_rx+0x1d4)
 |   #begin   0x80000001 -7105    6.500  __napi_schedule+0x44 (netif_rx+0x1d4)
 |   #end     0x80000001 -7098    5.250  __napi_schedule+0x58 (netif_rx+0x1d4)
     #func               -7093    6.750  __ipipe_restore_root+0x10 (__napi_schedule+0xa4)
 |   #begin   0x80000001 -7086    6.750  __ipipe_restore_root+0x48 (__napi_schedule+0xa4)
 |   #end     0x80000001 -7079    6.750  __ipipe_restore_root+0x5c (__napi_schedule+0xa4)
 |   #begin   0x80000001 -7073    6.500  netif_rx+0x108 (dm9000_interrupt+0x1c0)
 |   #end     0x80000001 -7066    6.000  netif_rx+0x11c (dm9000_interrupt+0x1c0)
     #func               -7060    5.250  __ipipe_restore_root+0x10 (netif_rx+0x16c)
     #func               -7055    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -7048    5.250  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -7043    7.250  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -7036    9.000  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
 |   +begin   0x80000001 -7027    6.500  dm9000_interrupt+0x2b0 (handle_IRQ_event+0x40)
 |   +end     0x80000001 -7020    8.500  dm9000_interrupt+0x2c4 (handle_IRQ_event+0x40)
 |   +begin   0x80000001 -7012    6.750  handle_IRQ_event+0x9c (handle_simple_irq+0x64)
 |   #end     0x80000001 -7005    6.250  handle_IRQ_event+0xb0 (handle_simple_irq+0x64)
     #func               -6999    6.000  note_interrupt+0x14 (handle_simple_irq+0x84)
 |   #func               -6993    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff -6986    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func               -6981    6.250  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   #func               -6974    5.750  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   #func               -6969    5.750  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   #func               -6963    6.000  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   #func               -6957    6.250  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   #func               -6951    5.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   #func               -6945    5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   #func               -6939    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func               -6933    6.250  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func               -6927    9.000  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  #*func               -6918   14.000  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  #*func               -6904    7.500  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  #*func               -6896    5.500  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  #*func               -6891    6.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  #*func               -6884    9.250  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   #func               -6875    7.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #end     0xffffffff -6867    5.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   #func               -6862    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff -6855    5.250  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func               -6850    5.750  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func               -6844   12.250  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func               -6832    6.000  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func               -6826    5.500  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   #func               -6820    5.750  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func               -6815    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func               -6808    6.500  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func               -6802    8.000  <bf0071fc> (xnintr_irq_handler+0x44)
 |  #*func               -6794    5.750  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func               -6788    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func               -6780    7.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func               -6772    6.750  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff -6766    8.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func               -6757    6.000  irq_exit+0x10 (__exception_text_start+0x4c)
     #func               -6751    6.000  ipipe_check_context+0x10 (irq_exit+0x18)
     #func               -6745    5.500  __do_softirq+0x10 (irq_exit+0x50)
     #func               -6740    6.250  ipipe_check_context+0x10 (__do_softirq+0x20)
     #func               -6733    6.750  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
 |   #begin   0x80000000 -6727    5.250  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
 |   +func               -6721    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -6715    6.750  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
     +func               -6708    7.250  net_rx_action+0x10 (__do_softirq+0x60)
 |   +begin   0x80000001 -6701    6.250  net_rx_action+0x50 (__do_softirq+0x60)
 |   #end     0x80000001 -6694    5.750  net_rx_action+0x64 (__do_softirq+0x60)
     #func               -6689    6.750  __ipipe_unstall_root+0x10 (net_rx_action+0x88)
 |   #begin   0x80000000 -6682    5.500  __ipipe_unstall_root+0x30 (net_rx_action+0x88)
 |   +func               -6676    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -6670    5.500  __ipipe_unstall_root+0x68 (net_rx_action+0x88)
     +func               -6664    7.000  process_backlog+0x10 (net_rx_action+0xac)
 |   +begin   0x80000001 -6657    6.750  process_backlog+0x60 (net_rx_action+0xac)
 |   #end     0x80000001 -6650    5.750  process_backlog+0x74 (net_rx_action+0xac)
     #func               -6645    6.250  __ipipe_unstall_root+0x10 (process_backlog+0xb4)
 |   #begin   0x80000000 -6638    5.750  __ipipe_unstall_root+0x30 (process_backlog+0xb4)
 |   +func               -6633    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -6626    5.500  __ipipe_unstall_root+0x68 (process_backlog+0xb4)
     +func               -6620    8.500  netif_receive_skb+0x14 (process_backlog+0xc0)
     +func               -6612    9.250  ip_rcv+0x14 (netif_receive_skb+0x290)
     +func               -6602    5.750  ip_route_input+0x14 (ip_rcv+0x238)
     +func               -6597   10.250  rt_hash_code+0x10 (ip_route_input+0x38)
 |   +begin   0x80000001 -6586    6.250  ip_route_input+0xcc (ip_rcv+0x238)
 |   +end     0x80000001 -6580    6.750  ip_route_input+0xe0 (ip_rcv+0x238)
     +func               -6573    7.250  ip_local_deliver+0x10 (ip_rcv+0x538)
     +func               -6566    6.000  icmp_rcv+0x10 (ip_local_deliver+0xd8)
     +func               -6560    5.250  __skb_checksum_complete+0x10 (icmp_rcv+0x64)
     +func               -6555    5.500  __skb_checksum_complete_head+0x10 (__skb_checksum_complete+0x18)
     +func               -6549    9.500  skb_checksum+0x14 (__skb_checksum_complete_head+0x24)
     +func               -6540    7.000  icmp_echo+0x14 (icmp_rcv+0x138)
     +func               -6533    6.000  icmp_reply+0x14 (icmp_echo+0x60)
     +func               -6527    7.250  ip_options_echo+0x14 (icmp_reply+0x3c)
     +func               -6520    5.500  local_bh_disable+0x10 (icmp_reply+0x48)
     +func               -6514    7.500  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func               -6507    5.250  ip_route_output_key+0x10 (icmp_reply+0xc8)
     +func               -6501    6.000  ip_route_output_flow+0x10 (ip_route_output_key+0x1c)
     +func               -6495    5.750  __ip_route_output_key+0x14 (ip_route_output_flow+0x1c)
     +func               -6490    6.250  rt_hash_code+0x10 (__ip_route_output_key+0x30)
     +func               -6483    5.500  local_bh_disable+0x10 (__ip_route_output_key+0x38)
     +func               -6478    8.750  ipipe_check_context+0x10 (local_bh_disable+0x18)
 |   +begin   0x80000001 -6469    6.750  __ip_route_output_key+0xdc (ip_route_output_flow+0x1c)
 |   +end     0x80000001 -6462    5.500  __ip_route_output_key+0xf0 (ip_route_output_flow+0x1c)
     +func               -6457    5.500  local_bh_enable+0x10 (__ip_route_output_key+0x11c)
     +func               -6451    6.000  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func               -6445    7.750  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func               -6438    5.750  icmp_push_reply+0x14 (icmp_reply+0x140)
     +func               -6432    6.750  ip_append_data+0x14 (icmp_push_reply+0x50)
 |   +begin   0x80000001 -6425    6.750  ip_append_data+0xd0 (icmp_push_reply+0x50)
 |   +end     0x80000001 -6418    9.250  ip_append_data+0xe8 (icmp_push_reply+0x50)
     +func               -6409    6.750  sock_alloc_send_skb+0x14 (ip_append_data+0x550)
     +func               -6402    6.000  __alloc_skb+0x10 (sock_alloc_send_skb+0x94)
     +func               -6396    7.000  kmem_cache_alloc+0x10 (__alloc_skb+0x34)
 |   +begin   0x80000001 -6389    6.500  kmem_cache_alloc+0x58 (__alloc_skb+0x34)
 |   #end     0x80000001 -6383    6.250  kmem_cache_alloc+0x6c (__alloc_skb+0x34)
     #func               -6377    5.500  __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
     #func               -6371    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -6365    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -6359    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -6352    6.000  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func               -6346    8.250  __kmalloc+0x10 (__alloc_skb+0x54)
 |   +begin   0x80000001 -6338    6.750  __kmalloc+0x94 (__alloc_skb+0x54)
 |   #end     0x80000001 -6331    5.750  __kmalloc+0xa8 (__alloc_skb+0x54)
     #func               -6326    5.500  __ipipe_restore_root+0x10 (__kmalloc+0xf8)
     #func               -6320    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -6314    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -6308    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -6301    8.750  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
 |   +begin   0x80000001 -6292    6.750  sock_alloc_send_skb+0x2a4 (ip_append_data+0x550)
 |   +end     0x80000001 -6286    7.250  sock_alloc_send_skb+0x2b8 (ip_append_data+0x550)
 |   +begin   0x80000001 -6278    6.500  sock_alloc_send_skb+0x2f8 (ip_append_data+0x550)
 |   +end     0x80000001 -6272    6.500  sock_alloc_send_skb+0x30c (ip_append_data+0x550)
     +func               -6265    5.750  icmp_glue_bits+0x14 (ip_append_data+0x6c0)
     +func               -6260   11.500  skb_copy_and_csum_bits+0x14 (icmp_glue_bits+0x38)
     +func               -6248    8.000  ip_push_pending_frames+0x14 (icmp_push_reply+0xfc)
     +func               -6240    6.500  __ip_select_ident+0x10 (ip_push_pending_frames+0x300)
     +func               -6234    5.500  local_bh_disable+0x10 (__ip_select_ident+0x54)
     +func               -6228    7.500  ipipe_check_context+0x10 (local_bh_disable+0x18)
 |   +func               -6221    7.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff -6213    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func               -6208    6.000  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func               -6202    5.750  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func               -6196    5.500  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func               -6191    5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func               -6185    6.500  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func               -6178    5.750  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func               -6173    6.250  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func               -6166    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func               -6160    7.000  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func               -6153   10.000  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func               -6143   14.250  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func               -6129    7.250  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func               -6121    5.750  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func               -6116    6.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func               -6109    9.250  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func               -6100    6.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func               -6094    7.500  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff -6086    5.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +func               -6081    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff -6074    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func               -6069    6.250  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func               -6062   12.000  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func               -6050    5.500  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func               -6045    5.750  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   +func               -6039    5.750  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func               -6033    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func               -6027    6.250  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func               -6021    7.750  <bf0071fc> (xnintr_irq_handler+0x44)
 |  # func               -6013    5.750  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  # func               -6007    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   +func               -5999    6.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func               -5993    6.750  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +func               -5986    7.000  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff -5979    6.250  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func               -5973    5.500  local_bh_enable+0x10 (__ip_select_ident+0x68)
     +func               -5967    5.750  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func               -5961    8.250  ipipe_check_context+0x10 (local_bh_enable+0x98)
 |   +begin   0x80000001 -5953    6.500  ip_push_pending_frames+0x3b0 (icmp_push_reply+0xfc)
 |   +end     0x80000001 -5947    5.500  ip_push_pending_frames+0x3c4 (icmp_push_reply+0xfc)
     +func               -5941    7.000  icmp_out_count+0x10 (ip_push_pending_frames+0x3e4)
     +func               -5934    6.250  ip_output+0x10 (ip_push_pending_frames+0x3f4)
     +func               -5928    8.500  ip_finish_output+0x10 (ip_output+0x54)
     +func               -5919    7.000  neigh_resolve_output+0x14 (ip_finish_output+0x26c)
     +func               -5912    5.250  local_bh_disable+0x10 (neigh_resolve_output+0x20c)
     +func               -5907    6.500  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func               -5901    9.000  eth_header+0x10 (neigh_resolve_output+0x258)
     +func               -5892    5.500  local_bh_enable+0x10 (neigh_resolve_output+0x268)
     +func               -5886    5.750  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func               -5880    6.500  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func               -5874    6.500  dev_queue_xmit+0x10 (neigh_resolve_output+0x280)
     +func               -5867    5.750  local_bh_disable+0x10 (dev_queue_xmit+0x110)
     +func               -5862    6.750  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func               -5855    6.500  dev_hard_start_xmit+0x14 (dev_queue_xmit+0x1e4)
     +func               -5848    8.000  bond_xmit_roundrobin+0x10 (dev_hard_start_xmit+0x1ec)
     +func               -5840    5.750  bond_dev_queue_xmit+0x10 (bond_xmit_roundrobin+0xe0)
     +func               -5835    6.000  dev_queue_xmit+0x10 (bond_dev_queue_xmit+0x1bc)
     +func               -5829    5.750  local_bh_disable+0x10 (dev_queue_xmit+0x110)
     +func               -5823    6.500  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func               -5816    8.500  pfifo_fast_enqueue+0x10 (dev_queue_xmit+0x138)
 |   +begin   0x80000001 -5808    6.500  dev_queue_xmit+0x174 (bond_dev_queue_xmit+0x1bc)
 |   +end     0x80000001 -5801    6.000  dev_queue_xmit+0x188 (bond_dev_queue_xmit+0x1bc)
     +func               -5795    5.500  __qdisc_run+0x10 (dev_queue_xmit+0x19c)
     +func               -5790    6.250  pfifo_fast_dequeue+0x10 (__qdisc_run+0x38)
     +func               -5784    6.000  dev_hard_start_xmit+0x14 (__qdisc_run+0x5c)
     +func               -5778    7.250  dm9000_start_xmit+0x10 (dev_hard_start_xmit+0x1ec)
 |   +begin   0x80000001 -5770    6.500  dm9000_start_xmit+0x5c (dev_hard_start_xmit+0x1ec)
 |   #end     0x80000001 -5764    5.750  dm9000_start_xmit+0x70 (dev_hard_start_xmit+0x1ec)
     #func               -5758   16.750  dm9000_outblk_16bit+0x10 (dm9000_start_xmit+0x9c)
     #func               -5741    5.750  __ipipe_restore_root+0x10 (dm9000_start_xmit+0x174)
     #func               -5736    8.000  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #func               -5728    7.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff -5720    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func               -5715    6.500  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func               -5708   11.250  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func               -5697    7.750  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func               -5689    6.250  __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
 |   #func               -5683    6.000  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
 |   #func               -5677    6.250  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func               -5671    7.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func               -5663    7.000  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff -5656    7.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   #begin   0x80000000 -5649    5.750  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -5643    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -5636    5.500  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func               -5631    5.750  kfree_skb+0x10 (dm9000_start_xmit+0x17c)
     +func               -5625    5.500  __kfree_skb+0x10 (kfree_skb+0x80)
     +func               -5619    6.500  skb_release_all+0x10 (__kfree_skb+0x18)
 |   +begin   0x80000001 -5613    6.250  skb_release_all+0x64 (__kfree_skb+0x18)
 |   +end     0x80000001 -5607    6.000  skb_release_all+0x78 (__kfree_skb+0x18)
     +func               -5601    6.500  sock_wfree+0x10 (skb_release_all+0xd0)
 |   +begin   0x80000001 -5594    6.750  sock_wfree+0x44 (skb_release_all+0xd0)
 |   +end     0x80000001 -5587    5.250  sock_wfree+0x58 (skb_release_all+0xd0)
     +func               -5582    7.750  sock_def_write_space+0x10 (sock_wfree+0x74)
 |   +begin   0x80000001 -5574    6.750  sock_wfree+0x94 (skb_release_all+0xd0)
 |   +end     0x80000001 -5568    5.500  sock_wfree+0xa8 (skb_release_all+0xd0)
     +func               -5562    5.750  skb_release_data+0x10 (skb_release_all+0xd8)
     +func               -5556    6.750  kfree+0x10 (skb_release_data+0xdc)
 |   +begin   0x80000001 -5550    6.500  kfree+0x4c (skb_release_data+0xdc)
 |   #end     0x80000001 -5543    6.500  kfree+0x60 (skb_release_data+0xdc)
     #func               -5537    5.250  __ipipe_restore_root+0x10 (kfree+0xfc)
     #func               -5531    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -5525    5.750  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -5519    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -5512    6.500  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func               -5506    6.750  kmem_cache_free+0x10 (__kfree_skb+0x108)
 |   +begin   0x80000001 -5499    6.500  kmem_cache_free+0x48 (__kfree_skb+0x108)
 |   #end     0x80000001 -5493    5.750  kmem_cache_free+0x5c (__kfree_skb+0x108)
     #func               -5487    5.250  __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
     #func               -5482    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -5475    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -5470    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -5463    8.250  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
 |   +begin   0x80000001 -5455    6.500  __qdisc_run+0x174 (dev_queue_xmit+0x19c)
 |   +end     0x80000001 -5448    6.250  __qdisc_run+0x188 (dev_queue_xmit+0x19c)
 |   +func               -5442    6.750  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff -5435    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func               -5429    5.750  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func               -5424    6.000  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func               -5418    5.500  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func               -5412    5.500  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func               -5407    6.500  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func               -5400    5.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func               -5395    6.000  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func               -5389    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func               -5382    7.250  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func               -5375    8.750  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func               -5366   14.750  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func               -5351    7.250  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func               -5344    5.750  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func               -5338    6.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func               -5332    9.500  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func               -5323    6.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func               -5317    7.750  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff -5309    5.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +func               -5303    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff -5297    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func               -5291    5.500  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func               -5286   12.250  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func               -5273    5.750  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func               -5268    5.500  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   +func               -5262    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func               -5256    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func               -5250    6.500  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func               -5243    7.750  <bf0071fc> (xnintr_irq_handler+0x44)
 |  # func               -5235    5.750  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  # func               -5230    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   +func               -5221    6.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func               -5215    7.000  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +func               -5208    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff -5201    6.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func               -5194    5.250  local_bh_enable+0x10 (dev_queue_xmit+0x26c)
     +func               -5189    6.000  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func               -5183    7.250  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func               -5176    5.750  local_bh_enable+0x10 (dev_queue_xmit+0x26c)
     +func               -5170    5.750  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func               -5164    7.250  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func               -5157    5.500  ip_cork_release+0x10 (ip_push_pending_frames+0x454)
     +func               -5151    7.250  kfree+0x10 (ip_cork_release+0x28)
 |   +begin   0x80000001 -5144    6.500  ip_cork_release+0x80 (ip_push_pending_frames+0x454)
 |   +end     0x80000001 -5138    8.250  ip_cork_release+0x94 (ip_push_pending_frames+0x454)
 |   +begin   0x80000001 -5129    6.500  icmp_reply+0x190 (icmp_echo+0x60)
 |   +end     0x80000001 -5123    5.750  icmp_reply+0x1a4 (icmp_echo+0x60)
     +func               -5117    5.250  icmp_xmit_unlock+0x10 (icmp_reply+0x1bc)
     +func               -5112    5.250  local_bh_enable+0x10 (icmp_xmit_unlock+0x14)
     +func               -5107    6.000  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func               -5101    7.000  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func               -5094    5.750  kfree_skb+0x10 (icmp_rcv+0x158)
     +func               -5088    5.500  __kfree_skb+0x10 (kfree_skb+0x80)
     +func               -5082    7.000  skb_release_all+0x10 (__kfree_skb+0x18)
 |   +begin   0x80000001 -5075    6.500  skb_release_all+0x64 (__kfree_skb+0x18)
 |   +end     0x80000001 -5069    5.750  skb_release_all+0x78 (__kfree_skb+0x18)
     +func               -5063    6.000  skb_release_data+0x10 (skb_release_all+0xd8)
     +func               -5057    6.750  kfree+0x10 (skb_release_data+0xdc)
 |   +begin   0x80000001 -5050    6.500  kfree+0x4c (skb_release_data+0xdc)
 |   #end     0x80000001 -5044    6.000  kfree+0x60 (skb_release_data+0xdc)
     #func               -5038    5.250  __ipipe_restore_root+0x10 (kfree+0xfc)
     #func               -5033    6.750  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -5026    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -5020    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -5013    6.000  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func               -5007    7.000  kmem_cache_free+0x10 (__kfree_skb+0x108)
 |   +begin   0x80000001 -5000    6.500  kmem_cache_free+0x48 (__kfree_skb+0x108)
 |   #end     0x80000001 -4994    5.750  kmem_cache_free+0x5c (__kfree_skb+0x108)
     #func               -4988    5.250  __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
     #func               -4983    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -4976    5.750  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -4971    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -4964    9.750  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
 |   +begin   0x80000001 -4954    7.000  process_backlog+0x168 (net_rx_action+0xac)
 |   +end     0x80000001 -4947    7.250  process_backlog+0x17c (net_rx_action+0xac)
 |   +begin   0x80000001 -4940    6.500  process_backlog+0x60 (net_rx_action+0xac)
 |   #end     0x80000001 -4933    7.000  process_backlog+0x74 (net_rx_action+0xac)
 |   #begin   0x80000001 -4926    6.500  process_backlog+0x134 (net_rx_action+0xac)
 |   #end     0x80000001 -4920    5.500  process_backlog+0x148 (net_rx_action+0xac)
     #func               -4914    6.250  __ipipe_unstall_root+0x10 (process_backlog+0x150)
 |   #begin   0x80000000 -4908    5.500  __ipipe_unstall_root+0x30 (process_backlog+0x150)
 |   +func               -4902    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -4895    7.750  __ipipe_unstall_root+0x68 (process_backlog+0x150)
 |   +begin   0x80000001 -4888    6.500  net_rx_action+0x118 (__do_softirq+0x60)
 |   #end     0x80000001 -4881    5.500  net_rx_action+0x12c (__do_softirq+0x60)
     #func               -4876    6.500  __ipipe_unstall_root+0x10 (net_rx_action+0x208)
 |   #begin   0x80000000 -4869    6.000  __ipipe_unstall_root+0x30 (net_rx_action+0x208)
 |   +func               -4863    7.250  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -4856    7.250  __ipipe_unstall_root+0x68 (net_rx_action+0x208)
 |   +begin   0x80000001 -4849    6.500  __do_softirq+0xa8 (irq_exit+0x50)
 |   #end     0x80000001 -4842    5.750  __do_softirq+0xbc (irq_exit+0x50)
     #func               -4836    6.250  _local_bh_enable+0x10 (__do_softirq+0xfc)
     #func               -4830    8.000  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
 |   #begin   0x80000000 -4822    8.500  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000 -4814    6.250  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func               -4807    6.000  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func               -4801    5.750  irq_enter+0x10 (__exception_text_start+0x38)
     #func               -4796    6.250  ipipe_check_context+0x10 (irq_enter+0x18)
     #func               -4789    6.250  handle_simple_irq+0x10 (__exception_text_start+0x48)
     #func               -4783    5.500  handle_IRQ_event+0x10 (handle_simple_irq+0x64)
     #func               -4778    6.250  __ipipe_unstall_root+0x10 (handle_IRQ_event+0x28)
 |   #begin   0x80000000 -4771    5.750  __ipipe_unstall_root+0x30 (handle_IRQ_event+0x28)
 |   +func               -4766    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -4759    5.500  __ipipe_unstall_root+0x68 (handle_IRQ_event+0x28)
     +func               -4753    7.750  dm9000_interrupt+0x14 (handle_IRQ_event+0x40)
 |   +func               -4745    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff -4738    6.250  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func               -4732    5.750  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func               -4726   10.750  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func               -4716    7.250  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func               -4708    6.500  __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
 |   +func               -4702    5.500  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
 |   +func               -4696    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func               -4690    6.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func               -4684    7.000  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +func               -4677    7.000  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff -4670    5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +func               -4665    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff -4658    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func               -4652    6.000  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func               -4646    6.000  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func               -4640    5.750  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func               -4634    5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func               -4628    6.000  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func               -4622    5.250  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func               -4617    6.000  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func               -4611    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func               -4605    6.750  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func               -4598    8.750  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func               -4589   15.000  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func               -4574    7.500  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func               -4567    5.500  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func               -4561    6.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func               -4555    9.750  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func               -4545    6.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func               -4538    7.750  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff -4531    5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +func               -4525    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff -4518    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func               -4513    5.250  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func               -4507   12.000  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func               -4495    6.000  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func               -4489    5.750  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   +func               -4484    5.750  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func               -4478    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func               -4472    6.500  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func               -4465    8.500  <bf0071fc> (xnintr_irq_handler+0x44)
 |  # func               -4457    5.500  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  # func               -4451    8.500  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   +func               -4443    6.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func               -4436    7.250  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +func               -4429    7.000  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff -4422    7.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func               -4414    7.000  dm9000_inblk_16bit+0x10 (dm9000_interrupt+0xbc)
     +func               -4407    5.500  __alloc_skb+0x10 (dm9000_interrupt+0x120)
     +func               -4402    6.750  kmem_cache_alloc+0x10 (__alloc_skb+0x34)
 |   +begin   0x80000001 -4395    6.500  kmem_cache_alloc+0x58 (__alloc_skb+0x34)
 |   #end     0x80000001 -4388    6.000  kmem_cache_alloc+0x6c (__alloc_skb+0x34)
     #func               -4382    5.500  __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
     #func               -4377    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -4370    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -4365    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -4358    6.250  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func               -4352    8.250  __kmalloc+0x10 (__alloc_skb+0x54)
 |   +begin   0x80000001 -4343    6.500  __kmalloc+0x94 (__alloc_skb+0x54)
 |   #end     0x80000001 -4337    6.250  __kmalloc+0xa8 (__alloc_skb+0x54)
     #func               -4331    5.750  __ipipe_restore_root+0x10 (__kmalloc+0xf8)
     #func               -4325    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -4318    5.250  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -4313    7.250  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -4306    8.250  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func               -4298   17.500  dm9000_inblk_16bit+0x10 (dm9000_interrupt+0x19c)
     +func               -4280    7.000  eth_type_trans+0x10 (dm9000_interrupt+0x1b4)
     +func               -4273    7.500  netif_rx+0x14 (dm9000_interrupt+0x1c0)
 |   +begin   0x80000001 -4266    6.500  netif_rx+0x88 (dm9000_interrupt+0x1c0)
 |   #end     0x80000001 -4259    7.000  netif_rx+0x9c (dm9000_interrupt+0x1c0)
 |   #begin   0x80000001 -4252    6.500  netif_rx+0x1ac (dm9000_interrupt+0x1c0)
 |   #end     0x80000001 -4246    5.500  netif_rx+0x1c0 (dm9000_interrupt+0x1c0)
     #func               -4240    7.000  __napi_schedule+0x10 (netif_rx+0x1d4)
 |   #begin   0x80000001 -4233    6.500  __napi_schedule+0x44 (netif_rx+0x1d4)
 |   #end     0x80000001 -4227    5.250  __napi_schedule+0x58 (netif_rx+0x1d4)
     #func               -4221    7.000  __ipipe_restore_root+0x10 (__napi_schedule+0xa4)
 |   #begin   0x80000001 -4214    6.750  __ipipe_restore_root+0x48 (__napi_schedule+0xa4)
 |   #end     0x80000001 -4208    6.750  __ipipe_restore_root+0x5c (__napi_schedule+0xa4)
 |   #begin   0x80000001 -4201    6.500  netif_rx+0x108 (dm9000_interrupt+0x1c0)
 |   #end     0x80000001 -4194    5.750  netif_rx+0x11c (dm9000_interrupt+0x1c0)
     #func               -4189    5.500  __ipipe_restore_root+0x10 (netif_rx+0x16c)
     #func               -4183    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -4177    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -4171    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -4164    9.000  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
 |   +begin   0x80000001 -4155    7.250  dm9000_interrupt+0x2b0 (handle_IRQ_event+0x40)
 |   +end     0x80000001 -4148    8.250  dm9000_interrupt+0x2c4 (handle_IRQ_event+0x40)
 |   +begin   0x80000001 -4140    6.750  handle_IRQ_event+0x9c (handle_simple_irq+0x64)
 |   #end     0x80000001 -4133    6.000  handle_IRQ_event+0xb0 (handle_simple_irq+0x64)
     #func               -4127    6.750  note_interrupt+0x14 (handle_simple_irq+0x84)
     #func               -4120    5.500  irq_exit+0x10 (__exception_text_start+0x4c)
     #func               -4115    6.750  ipipe_check_context+0x10 (irq_exit+0x18)
     #func               -4108    5.500  __do_softirq+0x10 (irq_exit+0x50)
     #func               -4102    5.750  ipipe_check_context+0x10 (__do_softirq+0x20)
     #func               -4097    6.250  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
 |   #begin   0x80000000 -4090    5.500  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
 |   +func               -4085    7.250  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -4078    6.500  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
     +func               -4071    7.000  net_rx_action+0x10 (__do_softirq+0x60)
 |   +begin   0x80000001 -4064    7.000  net_rx_action+0x50 (__do_softirq+0x60)
 |   #end     0x80000001 -4057    5.750  net_rx_action+0x64 (__do_softirq+0x60)
     #func               -4051    6.500  __ipipe_unstall_root+0x10 (net_rx_action+0x88)
 |   #begin   0x80000000 -4045    6.000  __ipipe_unstall_root+0x30 (net_rx_action+0x88)
 |   +func               -4039    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -4032    5.750  __ipipe_unstall_root+0x68 (net_rx_action+0x88)
     +func               -4026    6.500  process_backlog+0x10 (net_rx_action+0xac)
 |   +begin   0x80000001 -4020    6.250  process_backlog+0x60 (net_rx_action+0xac)
 |   #end     0x80000001 -4013    5.750  process_backlog+0x74 (net_rx_action+0xac)
     #func               -4008    6.500  __ipipe_unstall_root+0x10 (process_backlog+0xb4)
 |   #begin   0x80000000 -4001    5.750  __ipipe_unstall_root+0x30 (process_backlog+0xb4)
 |   +func               -3995    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -3989    5.500  __ipipe_unstall_root+0x68 (process_backlog+0xb4)
     +func               -3983    9.000  netif_receive_skb+0x14 (process_backlog+0xc0)
     +func               -3974    8.500  ip_rcv+0x14 (netif_receive_skb+0x290)
     +func               -3966    5.500  ip_route_input+0x14 (ip_rcv+0x238)
     +func               -3960   10.250  rt_hash_code+0x10 (ip_route_input+0x38)
 |   +begin   0x80000001 -3950    6.500  ip_route_input+0xcc (ip_rcv+0x238)
 |   +end     0x80000001 -3943    7.000  ip_route_input+0xe0 (ip_rcv+0x238)
     +func               -3936    7.500  ip_local_deliver+0x10 (ip_rcv+0x538)
     +func               -3929    6.250  icmp_rcv+0x10 (ip_local_deliver+0xd8)
     +func               -3923    5.750  __skb_checksum_complete+0x10 (icmp_rcv+0x64)
     +func               -3917    5.250  __skb_checksum_complete_head+0x10 (__skb_checksum_complete+0x18)
     +func               -3912    9.500  skb_checksum+0x14 (__skb_checksum_complete_head+0x24)
     +func               -3902    7.250  icmp_echo+0x14 (icmp_rcv+0x138)
     +func               -3895    7.750  icmp_reply+0x14 (icmp_echo+0x60)
 |   +func               -3887    7.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff -3880    6.250  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func               -3874    6.250  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func               -3867    6.000  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func               -3861    6.000  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func               -3855    5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func               -3850    6.750  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func               -3843    5.750  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func               -3837    5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func               -3831    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func               -3825    6.750  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func               -3818    9.000  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func               -3809   15.000  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func               -3794    7.250  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func               -3787    5.750  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func               -3781    6.500  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func               -3775    8.750  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func               -3766    6.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func               -3759    7.500  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff -3752    5.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +func               -3746    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff -3740    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func               -3734    5.750  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func               -3728   12.500  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func               -3716    5.750  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func               -3710    5.250  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   +func               -3705    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func               -3699    6.000  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func               -3693    6.250  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func               -3687    8.250  <bf0071fc> (xnintr_irq_handler+0x44)
 |  # func               -3678    5.500  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  # func               -3673    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   +func               -3665    6.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func               -3658    6.750  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +func               -3652    7.500  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff -3644    7.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func               -3637    6.500  ip_options_echo+0x14 (icmp_reply+0x3c)
     +func               -3630    5.250  local_bh_disable+0x10 (icmp_reply+0x48)
     +func               -3625    8.000  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func               -3617    5.500  ip_route_output_key+0x10 (icmp_reply+0xc8)
     +func               -3611    5.250  ip_route_output_flow+0x10 (ip_route_output_key+0x1c)
     +func               -3606    5.250  __ip_route_output_key+0x14 (ip_route_output_flow+0x1c)
     +func               -3601    6.250  rt_hash_code+0x10 (__ip_route_output_key+0x30)
     +func               -3595    5.500  local_bh_disable+0x10 (__ip_route_output_key+0x38)
     +func               -3589    9.000  ipipe_check_context+0x10 (local_bh_disable+0x18)
 |   +begin   0x80000001 -3580    6.250  __ip_route_output_key+0xdc (ip_route_output_flow+0x1c)
 |   +end     0x80000001 -3574    5.500  __ip_route_output_key+0xf0 (ip_route_output_flow+0x1c)
     +func               -3568    5.750  local_bh_enable+0x10 (__ip_route_output_key+0x11c)
     +func               -3563    5.750  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func               -3557    7.500  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func               -3549    6.000  icmp_push_reply+0x14 (icmp_reply+0x140)
     +func               -3543    7.000  ip_append_data+0x14 (icmp_push_reply+0x50)
 |   +begin   0x80000001 -3536    6.500  ip_append_data+0xd0 (icmp_push_reply+0x50)
 |   +end     0x80000001 -3530    9.500  ip_append_data+0xe8 (icmp_push_reply+0x50)
     +func               -3520    6.750  sock_alloc_send_skb+0x14 (ip_append_data+0x550)
     +func               -3514    5.750  __alloc_skb+0x10 (sock_alloc_send_skb+0x94)
     +func               -3508    6.750  kmem_cache_alloc+0x10 (__alloc_skb+0x34)
 |   +begin   0x80000001 -3501    6.500  kmem_cache_alloc+0x58 (__alloc_skb+0x34)
 |   #end     0x80000001 -3495    6.000  kmem_cache_alloc+0x6c (__alloc_skb+0x34)
     #func               -3489    6.000  __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
     #func               -3483    6.250  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -3476    5.750  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -3471    7.250  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -3463    6.000  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func               -3457    8.750  __kmalloc+0x10 (__alloc_skb+0x54)
 |   +begin   0x80000001 -3449    6.250  __kmalloc+0x94 (__alloc_skb+0x54)
 |   #end     0x80000001 -3442    6.000  __kmalloc+0xa8 (__alloc_skb+0x54)
     #func               -3436    5.500  __ipipe_restore_root+0x10 (__kmalloc+0xf8)
     #func               -3431    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -3424    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -3419    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -3412    9.250  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
 |   +begin   0x80000001 -3403    6.250  sock_alloc_send_skb+0x2a4 (ip_append_data+0x550)
 |   +end     0x80000001 -3396    6.750  sock_alloc_send_skb+0x2b8 (ip_append_data+0x550)
 |   +begin   0x80000001 -3390    6.500  sock_alloc_send_skb+0x2f8 (ip_append_data+0x550)
 |   +end     0x80000001 -3383    7.000  sock_alloc_send_skb+0x30c (ip_append_data+0x550)
     +func               -3376    5.500  icmp_glue_bits+0x14 (ip_append_data+0x6c0)
     +func               -3371   11.000  skb_copy_and_csum_bits+0x14 (icmp_glue_bits+0x38)
     +func               -3360    7.500  ip_push_pending_frames+0x14 (icmp_push_reply+0xfc)
     +func               -3352    6.250  __ip_select_ident+0x10 (ip_push_pending_frames+0x300)
     +func               -3346    5.500  local_bh_disable+0x10 (__ip_select_ident+0x54)
     +func               -3340    6.250  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func               -3334    5.750  local_bh_enable+0x10 (__ip_select_ident+0x68)
     +func               -3328    5.750  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func               -3323    8.000  ipipe_check_context+0x10 (local_bh_enable+0x98)
 |   +begin   0x80000001 -3315    6.500  ip_push_pending_frames+0x3b0 (icmp_push_reply+0xfc)
 |   +end     0x80000001 -3308    5.500  ip_push_pending_frames+0x3c4 (icmp_push_reply+0xfc)
     +func               -3303    7.000  icmp_out_count+0x10 (ip_push_pending_frames+0x3e4)
     +func               -3296    6.000  ip_output+0x10 (ip_push_pending_frames+0x3f4)
     +func               -3290    8.250  ip_finish_output+0x10 (ip_output+0x54)
     +func               -3281    6.500  neigh_resolve_output+0x14 (ip_finish_output+0x26c)
     +func               -3275    6.000  local_bh_disable+0x10 (neigh_resolve_output+0x20c)
     +func               -3269    6.000  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func               -3263    8.750  eth_header+0x10 (neigh_resolve_output+0x258)
     +func               -3254    5.500  local_bh_enable+0x10 (neigh_resolve_output+0x268)
     +func               -3249    6.000  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func               -3243    6.500  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func               -3236    6.250  dev_queue_xmit+0x10 (neigh_resolve_output+0x280)
     +func               -3230    5.500  local_bh_disable+0x10 (dev_queue_xmit+0x110)
     +func               -3224    6.750  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func               -3218    6.250  dev_hard_start_xmit+0x14 (dev_queue_xmit+0x1e4)
     +func               -3211    9.500  bond_xmit_roundrobin+0x10 (dev_hard_start_xmit+0x1ec)
     +func               -3202    6.250  bond_dev_queue_xmit+0x10 (bond_xmit_roundrobin+0xe0)
     +func               -3196    6.250  dev_queue_xmit+0x10 (bond_dev_queue_xmit+0x1bc)
     +func               -3189    6.000  local_bh_disable+0x10 (dev_queue_xmit+0x110)
     +func               -3183    6.250  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func               -3177    8.250  pfifo_fast_enqueue+0x10 (dev_queue_xmit+0x138)
 |   +begin   0x80000001 -3169    6.500  dev_queue_xmit+0x174 (bond_dev_queue_xmit+0x1bc)
 |   +end     0x80000001 -3162    5.250  dev_queue_xmit+0x188 (bond_dev_queue_xmit+0x1bc)
     +func               -3157    5.500  __qdisc_run+0x10 (dev_queue_xmit+0x19c)
     +func               -3152    6.500  pfifo_fast_dequeue+0x10 (__qdisc_run+0x38)
     +func               -3145    6.500  dev_hard_start_xmit+0x14 (__qdisc_run+0x5c)
     +func               -3139    7.000  dm9000_start_xmit+0x10 (dev_hard_start_xmit+0x1ec)
 |   +begin   0x80000001 -3132    6.250  dm9000_start_xmit+0x5c (dev_hard_start_xmit+0x1ec)
 |   #end     0x80000001 -3125    5.750  dm9000_start_xmit+0x70 (dev_hard_start_xmit+0x1ec)
     #func               -3120    8.000  dm9000_outblk_16bit+0x10 (dm9000_start_xmit+0x9c)
 |   #func               -3112    7.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff -3104    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func               -3099    6.000  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   #func               -3093    6.250  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   #func               -3087    5.750  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   #func               -3081    5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   #func               -3075    6.250  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   #func               -3069    5.750  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   #func               -3063    5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   #func               -3057    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func               -3051    7.000  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func               -3044    9.500  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  #*func               -3034   15.000  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  #*func               -3019    7.250  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  #*func               -3012    5.500  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  #*func               -3007    7.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  #*func               -2999    9.500  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   #func               -2990    7.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #end     0xffffffff -2982    5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   #func               -2977    6.750  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff -2970    5.250  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func               -2965    5.750  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func               -2959   12.000  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func               -2947    6.000  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func               -2941    5.750  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   #func               -2935    5.500  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func               -2930    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func               -2923    7.000  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func               -2916    8.500  <bf0071fc> (xnintr_irq_handler+0x44)
 |  #*func               -2908    6.000  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func               -2902    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func               -2893    8.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func               -2885    6.750  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff -2879   18.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func               -2860    5.750  __ipipe_restore_root+0x10 (dm9000_start_xmit+0x174)
     #func               -2854    6.000  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #func               -2848    6.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff -2842    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func               -2837    6.250  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func               -2830   11.000  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func               -2819    6.750  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func               -2813    6.250  __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
 |   #func               -2806    5.750  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
 |   #func               -2801    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func               -2795    7.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func               -2787    7.500  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff -2780    8.000  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   #begin   0x80000000 -2772    6.250  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -2766    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -2759    5.500  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func               -2753    5.500  kfree_skb+0x10 (dm9000_start_xmit+0x17c)
     +func               -2748    5.750  __kfree_skb+0x10 (kfree_skb+0x80)
     +func               -2742    6.750  skb_release_all+0x10 (__kfree_skb+0x18)
 |   +begin   0x80000001 -2735    6.500  skb_release_all+0x64 (__kfree_skb+0x18)
 |   +end     0x80000001 -2729    5.750  skb_release_all+0x78 (__kfree_skb+0x18)
     +func               -2723    6.500  sock_wfree+0x10 (skb_release_all+0xd0)
 |   +begin   0x80000001 -2717    7.000  sock_wfree+0x44 (skb_release_all+0xd0)
 |   +end     0x80000001 -2710    5.750  sock_wfree+0x58 (skb_release_all+0xd0)
     +func               -2704    8.000  sock_def_write_space+0x10 (sock_wfree+0x74)
 |   +begin   0x80000001 -2696    7.500  sock_wfree+0x94 (skb_release_all+0xd0)
 |   +end     0x80000001 -2688    5.500  sock_wfree+0xa8 (skb_release_all+0xd0)
     +func               -2683    5.750  skb_release_data+0x10 (skb_release_all+0xd8)
     +func               -2677    6.750  kfree+0x10 (skb_release_data+0xdc)
 |   +begin   0x80000001 -2670    6.250  kfree+0x4c (skb_release_data+0xdc)
 |   #end     0x80000001 -2664    6.500  kfree+0x60 (skb_release_data+0xdc)
     #func               -2658    5.250  __ipipe_restore_root+0x10 (kfree+0xfc)
     #func               -2652    6.750  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -2646    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -2640    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -2633    6.500  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func               -2627    6.750  kmem_cache_free+0x10 (__kfree_skb+0x108)
 |   +begin   0x80000001 -2620    6.750  kmem_cache_free+0x48 (__kfree_skb+0x108)
 |   #end     0x80000001 -2613    5.500  kmem_cache_free+0x5c (__kfree_skb+0x108)
     #func               -2608    5.250  __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
     #func               -2602    6.750  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -2596    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -2590    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -2583    8.750  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
 |   +begin   0x80000001 -2575    6.500  __qdisc_run+0x174 (dev_queue_xmit+0x19c)
 |   +end     0x80000001 -2568    5.750  __qdisc_run+0x188 (dev_queue_xmit+0x19c)
     +func               -2562    5.500  local_bh_enable+0x10 (dev_queue_xmit+0x26c)
     +func               -2557    6.000  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func               -2551    7.750  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func               -2543    6.000  local_bh_enable+0x10 (dev_queue_xmit+0x26c)
     +func               -2537    6.000  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func               -2531    7.250  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func               -2524    5.750  ip_cork_release+0x10 (ip_push_pending_frames+0x454)
     +func               -2518    7.000  kfree+0x10 (ip_cork_release+0x28)
 |   +begin   0x80000001 -2511    6.500  ip_cork_release+0x80 (ip_push_pending_frames+0x454)
 |   +end     0x80000001 -2505    7.750  ip_cork_release+0x94 (ip_push_pending_frames+0x454)
 |   +begin   0x80000001 -2497    6.500  icmp_reply+0x190 (icmp_echo+0x60)
 |   +end     0x80000001 -2490    5.500  icmp_reply+0x1a4 (icmp_echo+0x60)
     +func               -2485    5.250  icmp_xmit_unlock+0x10 (icmp_reply+0x1bc)
     +func               -2480    5.250  local_bh_enable+0x10 (icmp_xmit_unlock+0x14)
     +func               -2474    6.000  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func               -2468    7.000  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func               -2461    5.500  kfree_skb+0x10 (icmp_rcv+0x158)
     +func               -2456    5.250  __kfree_skb+0x10 (kfree_skb+0x80)
     +func               -2451    7.250  skb_release_all+0x10 (__kfree_skb+0x18)
 |   +begin   0x80000001 -2443    6.500  skb_release_all+0x64 (__kfree_skb+0x18)
 |   +end     0x80000001 -2437    6.000  skb_release_all+0x78 (__kfree_skb+0x18)
     +func               -2431    6.000  skb_release_data+0x10 (skb_release_all+0xd8)
     +func               -2425    6.750  kfree+0x10 (skb_release_data+0xdc)
 |   +begin   0x80000001 -2418    6.750  kfree+0x4c (skb_release_data+0xdc)
 |   #end     0x80000001 -2411    6.000  kfree+0x60 (skb_release_data+0xdc)
     #func               -2405    5.250  __ipipe_restore_root+0x10 (kfree+0xfc)
     #func               -2400    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -2394    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -2388    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -2381    6.000  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func               -2375    6.500  kmem_cache_free+0x10 (__kfree_skb+0x108)
 |   +begin   0x80000001 -2369    6.750  kmem_cache_free+0x48 (__kfree_skb+0x108)
 |   #end     0x80000001 -2362    6.000  kmem_cache_free+0x5c (__kfree_skb+0x108)
     #func               -2356    5.250  __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
     #func               -2351    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -2344    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -2339    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -2332    6.750  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
 |   +func               -2325    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff -2318    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func               -2312    5.750  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func               -2307    5.250  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func               -2301    6.000  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func               -2295    5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func               -2290    6.250  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func               -2283    5.250  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func               -2278    6.000  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func               -2272    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func               -2266    6.500  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func               -2259    8.750  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func               -2250   14.500  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func               -2236    7.500  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func               -2228    5.500  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func               -2223    6.000  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func               -2217    9.250  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func               -2208    6.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func               -2201    7.250  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff -2194    5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +func               -2188    6.750  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff -2181    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func               -2176    5.750  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func               -2170   12.000  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func               -2158    6.000  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func               -2152    5.750  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   +func               -2146    5.500  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func               -2141    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func               -2135    6.750  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func               -2128    8.250  <bf0071fc> (xnintr_irq_handler+0x44)
 |  # func               -2120    5.500  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  # func               -2114    8.000  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   +func               -2106    6.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func               -2099    7.500  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +func               -2092    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff -2085   10.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +begin   0x80000001 -2074    7.000  process_backlog+0x168 (net_rx_action+0xac)
 |   +end     0x80000001 -2067    7.250  process_backlog+0x17c (net_rx_action+0xac)
 |   +begin   0x80000001 -2060    6.500  process_backlog+0x60 (net_rx_action+0xac)
 |   #end     0x80000001 -2053    7.250  process_backlog+0x74 (net_rx_action+0xac)
 |   #begin   0x80000001 -2046    6.750  process_backlog+0x134 (net_rx_action+0xac)
 |   #end     0x80000001 -2039    5.500  process_backlog+0x148 (net_rx_action+0xac)
     #func               -2034    6.500  __ipipe_unstall_root+0x10 (process_backlog+0x150)
 |   #begin   0x80000000 -2027    5.500  __ipipe_unstall_root+0x30 (process_backlog+0x150)
 |   +func               -2022    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -2015    7.750  __ipipe_unstall_root+0x68 (process_backlog+0x150)
 |   +begin   0x80000001 -2007    6.250  net_rx_action+0x118 (__do_softirq+0x60)
 |   #end     0x80000001 -2001    5.750  net_rx_action+0x12c (__do_softirq+0x60)
     #func               -1995    6.500  __ipipe_unstall_root+0x10 (net_rx_action+0x208)
 |   #begin   0x80000000 -1989    6.250  __ipipe_unstall_root+0x30 (net_rx_action+0x208)
 |   +func               -1982    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -1976    7.000  __ipipe_unstall_root+0x68 (net_rx_action+0x208)
 |   +begin   0x80000001 -1969    6.500  __do_softirq+0xa8 (irq_exit+0x50)
 |   #end     0x80000001 -1962    6.000  __do_softirq+0xbc (irq_exit+0x50)
     #func               -1956    6.000  _local_bh_enable+0x10 (__do_softirq+0xfc)
     #func               -1950    8.000  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
 |   #begin   0x80000000 -1942    8.250  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000 -1934    5.750  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func               -1928    6.250  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func               -1922    5.500  irq_enter+0x10 (__exception_text_start+0x38)
     #func               -1916    6.000  ipipe_check_context+0x10 (irq_enter+0x18)
     #func               -1910    6.250  handle_simple_irq+0x10 (__exception_text_start+0x48)
     #func               -1904    5.500  handle_IRQ_event+0x10 (handle_simple_irq+0x64)
     #func               -1899    6.500  __ipipe_unstall_root+0x10 (handle_IRQ_event+0x28)
 |   #begin   0x80000000 -1892    5.500  __ipipe_unstall_root+0x30 (handle_IRQ_event+0x28)
 |   +func               -1887    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -1880    5.750  __ipipe_unstall_root+0x68 (handle_IRQ_event+0x28)
     +func               -1874    8.000  dm9000_interrupt+0x14 (handle_IRQ_event+0x40)
 |   +func               -1866    7.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff -1859    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func               -1853    5.500  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func               -1847   11.250  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func               -1836    7.250  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func               -1829    7.000  __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
 |   +func               -1822    5.500  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
 |   +func               -1816    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func               -1810    6.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func               -1804    7.000  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   +func               -1797    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff -1790    7.250  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func               -1783    7.250  dm9000_inblk_16bit+0x10 (dm9000_interrupt+0xbc)
     +func               -1775    6.000  __alloc_skb+0x10 (dm9000_interrupt+0x120)
     +func               -1769    6.750  kmem_cache_alloc+0x10 (__alloc_skb+0x34)
 |   +begin   0x80000001 -1763    6.500  kmem_cache_alloc+0x58 (__alloc_skb+0x34)
 |   #end     0x80000001 -1756    6.000  kmem_cache_alloc+0x6c (__alloc_skb+0x34)
     #func               -1750    5.500  __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
     #func               -1745    6.500  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -1738    5.250  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -1733    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -1726    6.250  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func               -1720    8.250  __kmalloc+0x10 (__alloc_skb+0x54)
 |   +begin   0x80000001 -1711    6.750  __kmalloc+0x94 (__alloc_skb+0x54)
 |   #end     0x80000001 -1705    5.750  __kmalloc+0xa8 (__alloc_skb+0x54)
     #func               -1699    5.500  __ipipe_restore_root+0x10 (__kmalloc+0xf8)
     #func               -1693    6.750  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -1687    5.250  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -1681    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -1674    8.500  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
     +func               -1666   17.250  dm9000_inblk_16bit+0x10 (dm9000_interrupt+0x19c)
     +func               -1649    6.750  eth_type_trans+0x10 (dm9000_interrupt+0x1b4)
     +func               -1642    7.500  netif_rx+0x14 (dm9000_interrupt+0x1c0)
 |   +begin   0x80000001 -1634    6.500  netif_rx+0x88 (dm9000_interrupt+0x1c0)
 |   #end     0x80000001 -1628    6.750  netif_rx+0x9c (dm9000_interrupt+0x1c0)
 |   #begin   0x80000001 -1621    6.500  netif_rx+0x1ac (dm9000_interrupt+0x1c0)
 |   #end     0x80000001 -1615    5.500  netif_rx+0x1c0 (dm9000_interrupt+0x1c0)
     #func               -1609    7.000  __napi_schedule+0x10 (netif_rx+0x1d4)
 |   #begin   0x80000001 -1602    6.250  __napi_schedule+0x44 (netif_rx+0x1d4)
 |   #end     0x80000001 -1596    5.500  __napi_schedule+0x58 (netif_rx+0x1d4)
     #func               -1590    6.750  __ipipe_restore_root+0x10 (__napi_schedule+0xa4)
 |   #begin   0x80000001 -1584    7.250  __ipipe_restore_root+0x48 (__napi_schedule+0xa4)
 |   #end     0x80000001 -1576    6.500  __ipipe_restore_root+0x5c (__napi_schedule+0xa4)
 |   #begin   0x80000001 -1570    6.500  netif_rx+0x108 (dm9000_interrupt+0x1c0)
 |   #end     0x80000001 -1563    6.500  netif_rx+0x11c (dm9000_interrupt+0x1c0)
 |   #func               -1557    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff -1550    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func               -1544    5.750  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   #func               -1539    5.750  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   #func               -1533    5.750  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   #func               -1527    5.500  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   #func               -1522    6.250  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   #func               -1515    5.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   #func               -1510    6.000  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   #func               -1504    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func               -1497    6.750  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func               -1491    9.750  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  #*func               -1481   14.500  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  #*func               -1466    7.000  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  #*func               -1459    5.250  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  #*func               -1454    6.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  #*func               -1448    9.500  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   #func               -1438    8.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #end     0xffffffff -1430    5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   #func               -1425    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff -1418    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func               -1413    5.750  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func               -1407   11.750  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func               -1395    6.000  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func               -1389    5.500  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   #func               -1384    5.500  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func               -1378    6.000  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func               -1372    6.250  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func               -1366    8.250  <bf0071fc> (xnintr_irq_handler+0x44)
 |  #*func               -1358    5.500  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func               -1352    8.000  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func               -1344    8.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func               -1336    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff -1329    6.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func               -1322    5.250  __ipipe_restore_root+0x10 (netif_rx+0x16c)
     #func               -1317    6.750  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   #begin   0x80000000 -1310    5.500  __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
 |   +func               -1305    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -1298    8.750  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
 |   +begin   0x80000001 -1289    6.750  dm9000_interrupt+0x2b0 (handle_IRQ_event+0x40)
 |   +end     0x80000001 -1282    8.750  dm9000_interrupt+0x2c4 (handle_IRQ_event+0x40)
 |   +begin   0x80000001 -1273    7.000  handle_IRQ_event+0x9c (handle_simple_irq+0x64)
 |   #end     0x80000001 -1266    5.750  handle_IRQ_event+0xb0 (handle_simple_irq+0x64)
     #func               -1261    7.000  note_interrupt+0x14 (handle_simple_irq+0x84)
     #func               -1254    6.000  irq_exit+0x10 (__exception_text_start+0x4c)
     #func               -1248    6.250  ipipe_check_context+0x10 (irq_exit+0x18)
     #func               -1241    5.250  __do_softirq+0x10 (irq_exit+0x50)
     #func               -1236    5.750  ipipe_check_context+0x10 (__do_softirq+0x20)
     #func               -1230    6.750  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
 |   #begin   0x80000000 -1224    5.500  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
 |   +func               -1218    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -1211    6.750  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
     +func               -1205    7.000  net_rx_action+0x10 (__do_softirq+0x60)
 |   +begin   0x80000001 -1198    6.250  net_rx_action+0x50 (__do_softirq+0x60)
 |   #end     0x80000001 -1191    5.500  net_rx_action+0x64 (__do_softirq+0x60)
     #func               -1186    6.500  __ipipe_unstall_root+0x10 (net_rx_action+0x88)
 |   #begin   0x80000000 -1179    6.250  __ipipe_unstall_root+0x30 (net_rx_action+0x88)
 |   +func               -1173    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -1166    5.750  __ipipe_unstall_root+0x68 (net_rx_action+0x88)
     +func               -1160    6.500  process_backlog+0x10 (net_rx_action+0xac)
 |   +begin   0x80000001 -1154    6.500  process_backlog+0x60 (net_rx_action+0xac)
 |   #end     0x80000001 -1147    5.750  process_backlog+0x74 (net_rx_action+0xac)
     #func               -1142    6.250  __ipipe_unstall_root+0x10 (process_backlog+0xb4)
 |   #begin   0x80000000 -1135    5.750  __ipipe_unstall_root+0x30 (process_backlog+0xb4)
 |   +func               -1130    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000 -1123    5.500  __ipipe_unstall_root+0x68 (process_backlog+0xb4)
     +func               -1117    9.000  netif_receive_skb+0x14 (process_backlog+0xc0)
     +func               -1108    9.250  ip_rcv+0x14 (netif_receive_skb+0x290)
     +func               -1099    5.750  ip_route_input+0x14 (ip_rcv+0x238)
     +func               -1093    9.750  rt_hash_code+0x10 (ip_route_input+0x38)
 |   +begin   0x80000001 -1083    6.250  ip_route_input+0xcc (ip_rcv+0x238)
 |   +end     0x80000001 -1077    7.750  ip_route_input+0xe0 (ip_rcv+0x238)
     +func               -1069    7.250  ip_local_deliver+0x10 (ip_rcv+0x538)
     +func               -1062    6.000  icmp_rcv+0x10 (ip_local_deliver+0xd8)
     +func               -1056    5.250  __skb_checksum_complete+0x10 (icmp_rcv+0x64)
     +func               -1051    5.500  __skb_checksum_complete_head+0x10 (__skb_checksum_complete+0x18)
     +func               -1045   10.250  skb_checksum+0x14 (__skb_checksum_complete_head+0x24)
     +func               -1035    5.750  icmp_echo+0x14 (icmp_rcv+0x138)
     +func               -1029    6.500  icmp_reply+0x14 (icmp_echo+0x60)
     +func               -1023    7.000  ip_options_echo+0x14 (icmp_reply+0x3c)
     +func               -1016    5.500  local_bh_disable+0x10 (icmp_reply+0x48)
     +func               -1010    7.250  ipipe_check_context+0x10 (local_bh_disable+0x18)
     +func               -1003    5.250  ip_route_output_key+0x10 (icmp_reply+0xc8)
     +func                -998    5.750  ip_route_output_flow+0x10 (ip_route_output_key+0x1c)
     +func                -992    5.500  __ip_route_output_key+0x14 (ip_route_output_flow+0x1c)
     +func                -987    6.250  rt_hash_code+0x10 (__ip_route_output_key+0x30)
     +func                -980    5.250  local_bh_disable+0x10 (__ip_route_output_key+0x38)
     +func                -975    9.000  ipipe_check_context+0x10 (local_bh_disable+0x18)
 |   +begin   0x80000001  -966    6.750  __ip_route_output_key+0xdc (ip_route_output_flow+0x1c)
 |   +end     0x80000001  -959    5.500  __ip_route_output_key+0xf0 (ip_route_output_flow+0x1c)
     +func                -954    5.500  local_bh_enable+0x10 (__ip_route_output_key+0x11c)
     +func                -948    5.750  ipipe_check_context+0x10 (local_bh_enable+0x58)
     +func                -943    8.000  ipipe_check_context+0x10 (local_bh_enable+0x98)
     +func                -935    5.750  icmp_push_reply+0x14 (icmp_reply+0x140)
     +func                -929    6.750  ip_append_data+0x14 (icmp_push_reply+0x50)
 |   +begin   0x80000001  -922    6.500  ip_append_data+0xd0 (icmp_push_reply+0x50)
 |   +end     0x80000001  -916    9.250  ip_append_data+0xe8 (icmp_push_reply+0x50)
     +func                -906    7.000  sock_alloc_send_skb+0x14 (ip_append_data+0x550)
     +func                -899    5.750  __alloc_skb+0x10 (sock_alloc_send_skb+0x94)
     +func                -894    6.750  kmem_cache_alloc+0x10 (__alloc_skb+0x34)
 |   +begin   0x80000001  -887    6.750  kmem_cache_alloc+0x58 (__alloc_skb+0x34)
 |   #end     0x80000001  -880    5.750  kmem_cache_alloc+0x6c (__alloc_skb+0x34)
     #func                -874    5.250  __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
     #func                -869  853.250  __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
 |   +func                 -16    8.500  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000    -7    7.750  __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
>|   +func                   0! 878.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
:|   +func                 878+   6.750  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
:|   +func                 885+   5.750  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
:|   +func                 891+   5.750  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
:|   +func                 896+   6.000  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
:|   +func                 902+   6.250  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
:|   +func                 909+   5.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
:|   +func                 914+   5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
:|   +func                 920+   6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
:|  # func                 926+   6.750  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
:|  # func                 933+   9.750  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
:|  # func                 943!  14.500  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
:|  # func                 957+   7.500  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
:|  # func                 965+   5.250  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
:|  # func                 970+   6.000  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
:|  # func                 976+   9.250  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
:|   +func                 985+   6.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
:|   +func                 992+   7.500  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
<|   +end     0xffffffff   999    5.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +func                1005    6.750  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  1012    0.000  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)

^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-26 16:29     ` Bosko Radivojevic
@ 2008-05-26 16:47       ` Gilles Chanteperdrix
  2008-05-26 16:59         ` Gilles Chanteperdrix
  2008-05-26 16:59         ` Bosko Radivojevic
  0 siblings, 2 replies; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-26 16:47 UTC (permalink / raw)
  To: Bosko Radivojevic; +Cc: xenomai-help

On Mon, May 26, 2008 at 6:29 PM, Bosko Radivojevic
<bosko.radivojevic@domain.hid> wrote:
> Hi Gilles,
>
> I've enabled tracer, as documented on Xenomai site. Well, to be
> honest, I dont see much from the output :) I've put
> xntrace_user_freeze (1, 1) in the handler to happen at the 1000th
> iteration. At the beginning of the interrupt handler one IO PIN is set
> to 1 and set back to 0 at the end. In the meantime, there is only for
> ().
>
> Attached file osc1.jpg is screen shot of USB Osciloscope when there is
> no Ethernet activity. osc2.jpg is good example of what happens when
> there is Ethernet activity (this time ping -f from PC box in the same
> LAN as Device).
>
> Do you see anything in those .txt files?

Well, if we read the sequence:
:|   #func                -199+   7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
:|   #begin   0xffffffff  -192+   6.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
:|   #func                -185+   5.500  __ipipe_handle_irq+0x10
(__ipipe_grab_irq+0x90)
:|   #func                -180+   5.250  __ipipe_ack_timerirq+0x10

We see a timer irq

(__ipipe_handle_irq+0x70)
:|   #func                -175+   6.000  __ipipe_ack_level_irq+0x10
(__ipipe_ack_timerirq+0x30)
:|   #func                -169+   5.750  at91_aic_mask_irq+0x10
(__ipipe_ack_level_irq+0x2c)
:|   #func                -163+   6.000  __ipipe_mach_acktimer+0x10
(__ipipe_ack_timerirq+0x40)
:|   #func                -157+   5.250  __ipipe_end_level_irq+0x10
(__ipipe_ack_timerirq+0x50)
:|   #func                -152+   6.000  at91_aic_unmask_irq+0x10
(__ipipe_end_level_irq+0x24)
:|   #func                -146+   6.500  __ipipe_dispatch_wired+0x10
(__ipipe_handle_irq+0x7c)
:|  #*func                -139+   7.250  xnintr_clock_handler+0x10
(__ipipe_dispatch_wired+0x100)
:|  #*func                -132+   8.500  xntimer_tick_aperiodic+0x10
(xnintr_clock_handler+0x34)
:|  #*func                -123!  14.250  xntimer_next_local_shot+0x10
(xntimer_tick_aperiodic+0x250)
:|  #*func                -109+   7.750  __ipipe_mach_set_dec+0x10
(xntimer_next_local_shot+0xd0)
:|  #*func                -101+   5.250  rthal_irq_host_pend+0x10
(xnintr_clock_handler+0xd0)
:|  #*func                 -96+   5.750  __ipipe_schedule_irq+0x10
(rthal_irq_host_pend+0x20)
:|  #*func                 -90+   9.500  __ipipe_set_irq_pending+0x10
(__ipipe_schedule_irq+0x80)
:|   #func                 -81+   7.750  __ipipe_walk_pipeline+0x10
(__ipipe_handle_irq+0x118)
:|   #end     0xffffffff   -73+   5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)

Immediately followed by a gpio irq.

:|   #func                 -68+   6.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
:|   #begin   0xffffffff   -61+   6.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
:|   #func                 -55+   5.500  __ipipe_mach_demux_irq+0x14
(__ipipe_grab_irq+0x60)
:|   #func                 -49!  12.250  at91_aic_mask_irq+0x10
(__ipipe_mach_demux_irq+0x3c)
:|   #func                 -37+   5.250  __ipipe_handle_irq+0x10
(__ipipe_mach_demux_irq+0xa0)
:|   #func                 -32+   5.750  __ipipe_ack_irq+0x10
(__ipipe_handle_irq+0x70)
:|   #func                 -26+   5.750  __ipipe_ack_simple_irq+0x10
(__ipipe_ack_irq+0x28)
:|   #func                 -20+   6.250  __ipipe_dispatch_wired+0x10
(__ipipe_handle_irq+0x7c)
:|  #*func                 -14+   6.250  xnintr_irq_handler+0x10
(__ipipe_dispatch_wired+0x100)
:|  #*func                  -8+   8.250  <bf0071fc> (xnintr_irq_handler+0x44)
<|  #*freeze  0x00000001     0    6.750  <bf007230> (xnintr_irq_handler+0x44)
 |  #*func                   6    5.750  rthal_irq_end+0x10
(xnintr_irq_handler+0xfc)
 |  #*func                  12    8.000  __ipipe_end_simple_irq+0x10
(rthal_irq_end+0x34)
 |   #func                  20    7.250  __ipipe_walk_pipeline+0x10
(__ipipe_handle_irq+0x118)
 |   #func                  27    7.250  at91_aic_unmask_irq+0x10
(__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff    35    7.250  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)

Then, later:

 |   +func                 202    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff   209    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                 215    5.750  __ipipe_mach_demux_irq+0x14
(__ipipe_grab_irq+0x60)
 |   +func                 221   10.750  at91_aic_mask_irq+0x10
(__ipipe_mach_demux_irq+0x3c)
 |   +func                 232    7.250  __ipipe_handle_irq+0x10
(__ipipe_mach_demux_irq+0xa0)
 |   +func                 239    6.250  __ipipe_set_irq_pending+0x10
(__ipipe_handle_irq+0xb4)
 |   +func                 245    5.500  __ipipe_ack_irq+0x10
(__ipipe_handle_irq+0xd4)
 |   +func                 251    5.750  __ipipe_ack_simple_irq+0x10
(__ipipe_ack_irq+0x28)
 |   +func                 256    7.000  __ipipe_walk_pipeline+0x10
(__ipipe_handle_irq+0x118)
 |   +func                 263    7.000  __ipipe_sync_stage+0x14
(__ipipe_walk_pipeline+0x9c)
 |   +func                 270    7.000  at91_aic_unmask_irq+0x10
(__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff   277    7.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)

Which is a second gpio interrupt. I am afraid from this sequence, it
appears that the two interrupt are generated at hardware level. Did
you try setting up the irq with at91_set_gpio_input ?

-- 
 Gilles


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-26 16:47       ` Gilles Chanteperdrix
@ 2008-05-26 16:59         ` Gilles Chanteperdrix
  2008-05-26 17:04           ` Bosko Radivojevic
  2008-05-26 16:59         ` Bosko Radivojevic
  1 sibling, 1 reply; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-26 16:59 UTC (permalink / raw)
  To: Bosko Radivojevic; +Cc: xenomai-help

On Mon, May 26, 2008 at 6:47 PM, Gilles Chanteperdrix
<gilles.chanteperdrix@xenomai.org> wrote:
>Did
> you try setting up the irq with at91_set_gpio_input ?

What about at91_set_deglitch ?

-- 
 Gilles


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-26 16:47       ` Gilles Chanteperdrix
  2008-05-26 16:59         ` Gilles Chanteperdrix
@ 2008-05-26 16:59         ` Bosko Radivojevic
  1 sibling, 0 replies; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-26 16:59 UTC (permalink / raw)
  To: Gilles Chanteperdrix; +Cc: xenomai-help

On Mon, May 26, 2008 at 6:47 PM, Gilles Chanteperdrix
<gilles.chanteperdrix@xenomai.org> wrote:

> Which is a second gpio interrupt. I am afraid from this sequence, it
> appears that the two interrupt are generated at hardware level. Did
> you try setting up the irq with at91_set_gpio_input ?

Yes, I'm sure two interrupts are generated at the hardware level. It
looks on SAM9260 default is Level triggered interrupts, which brings
two interrupts for the pin 1-to-0 change. Actually, I've tried to
change SRCTYPE to Rising edge for PB:
at91_sys_write(AT91_AIC_SMR(3), AT91_AIC_SRCTYPE_RISING);

But then I see no interrupts at all. :)


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-26 16:59         ` Gilles Chanteperdrix
@ 2008-05-26 17:04           ` Bosko Radivojevic
  2008-05-26 17:14             ` Gilles Chanteperdrix
  0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-26 17:04 UTC (permalink / raw)
  To: Gilles Chanteperdrix; +Cc: xenomai-help

On Mon, May 26, 2008 at 6:59 PM, Gilles Chanteperdrix
<gilles.chanteperdrix@xenomai.org> wrote:

> What about at91_set_deglitch ?

Nothing change when add at91_set_deglitch(). Two interrupts always.

Anyway, do you see any explanation why eth activity influence so much
RT interrupt handling?


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-26 17:04           ` Bosko Radivojevic
@ 2008-05-26 17:14             ` Gilles Chanteperdrix
  2008-05-26 17:16               ` Bosko Radivojevic
  0 siblings, 1 reply; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-26 17:14 UTC (permalink / raw)
  To: Bosko Radivojevic; +Cc: xenomai-help

On Mon, May 26, 2008 at 7:04 PM, Bosko Radivojevic
<bosko.radivojevic@domain.hid> wrote:
> On Mon, May 26, 2008 at 6:59 PM, Gilles Chanteperdrix
> <gilles.chanteperdrix@xenomai.org> wrote:
>
>> What about at91_set_deglitch ?
>
> Nothing change when add at91_set_deglitch(). Two interrupts always.
>
> Anyway, do you see any explanation why eth activity influence so much
> RT interrupt handling?

To know this we need to compare a trace taken at maximum time, with
and without ethernet.


-- 
 Gilles


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-26 17:14             ` Gilles Chanteperdrix
@ 2008-05-26 17:16               ` Bosko Radivojevic
  2008-05-26 17:21                 ` Gilles Chanteperdrix
  0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-26 17:16 UTC (permalink / raw)
  To: Gilles Chanteperdrix; +Cc: xenomai-help

On Mon, May 26, 2008 at 7:14 PM, Gilles Chanteperdrix
<gilles.chanteperdrix@xenomai.org> wrote:

> To know this we need to compare a trace taken at maximum time, with
> and without ethernet.

OK. I'll remove freeze call, and capture max with and without eth.


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-26 17:16               ` Bosko Radivojevic
@ 2008-05-26 17:21                 ` Gilles Chanteperdrix
  2008-05-26 17:47                   ` Bosko Radivojevic
  0 siblings, 1 reply; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-26 17:21 UTC (permalink / raw)
  To: Bosko Radivojevic; +Cc: xenomai-help

On Mon, May 26, 2008 at 7:16 PM, Bosko Radivojevic
<bosko.radivojevic@domain.hid> wrote:
> On Mon, May 26, 2008 at 7:14 PM, Gilles Chanteperdrix
> <gilles.chanteperdrix@xenomai.org> wrote:
>
>> To know this we need to compare a trace taken at maximum time, with
>> and without ethernet.
>
> OK. I'll remove freeze call, and capture max with and without eth.

No, you need to call freeze when maximum is reached, which means you
need to add some measurement instrumentations, based on rt_timer_tsc,
detect the maximum and call freeze in this case.

-- 
 Gilles


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-26 17:21                 ` Gilles Chanteperdrix
@ 2008-05-26 17:47                   ` Bosko Radivojevic
  2008-05-27 11:31                     ` Bosko Radivojevic
  0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-26 17:47 UTC (permalink / raw)
  To: Gilles Chanteperdrix; +Cc: xenomai-help

[-- Attachment #1: Type: text/plain, Size: 621 bytes --]

On Mon, May 26, 2008 at 7:21 PM, Gilles Chanteperdrix
<gilles.chanteperdrix@xenomai.org> wrote:
> No, you need to call freeze when maximum is reached, which means you
> need to add some measurement instrumentations, based on rt_timer_tsc,
> detect the maximum and call freeze in this case.

OK, here are the frozen files in both situations: with and without
ethernet activity (= ping -f)

I added the following code to the handler:

now = rt_timer_tsc()

if (first_time) {
 last = now;
 first_time = 0;
}

if (rt_timer_tsc2ns(now-last) > max) {
 max = rt_timer_tsc2ns(now-last);
 xntrace_user_freeze(1,0);
}

last = now;

[-- Attachment #2: frozen-noeth --]
[-- Type: application/octet-stream, Size: 98634 bytes --]

I-pipe frozen back-tracing service on 2.6.24.3/ipipe-1.9-00
------------------------------------------------------------
CPU: 0, Freeze: 4054738316 cycles, Trace Points: 100 (+1000)
Calibrated minimum trace-point overhead: 1.500 us

 +----- Hard IRQs ('|': locked)
 |+---- <unused>
 ||+--- <unused>
 |||+-- Xenomai
 ||||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||||                        +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||||                        |        +- NMI noise ('N')
 |||||                        |        |
      Type    User Val.   Time    Delay  Function (Parent)
:|   #begin   0x80000001 -1542+   6.250  clocksource_get_next+0x40 (update_wall_time+0x64c)
:|   #end     0x80000001 -1536+   5.750  clocksource_get_next+0x54 (update_wall_time+0x64c)
:    #func               -1530+   6.750  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
:|   #begin   0x80000001 -1524+   6.500  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
:|   #end     0x80000001 -1517+   6.500  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
:    #func               -1511+   5.500  update_process_times+0x10 (tick_periodic+0x98)
:    #func               -1505+   5.750  account_process_tick+0x10 (update_process_times+0x2c)
:    #func               -1499+   7.000  account_system_time+0x10 (account_process_tick+0x40)
:    #func               -1492+   5.500  account_system_time_scaled+0x10 (account_process_tick+0x4c)
:    #func               -1487+   5.500  run_local_timers+0x10 (update_process_times+0x30)
:    #func               -1481+   6.750  raise_softirq+0x10 (run_local_timers+0x18)
:|   #begin   0x80000001 -1475+   6.500  raise_softirq+0x44 (run_local_timers+0x18)
:|   #end     0x80000001 -1468+   5.750  raise_softirq+0x58 (run_local_timers+0x18)
:    #func               -1462+   6.750  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
:|   #begin   0x80000001 -1456+   6.500  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
:|   #end     0x80000001 -1449+   5.500  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
:    #func               -1444+   5.500  rcu_pending+0x10 (update_process_times+0x38)
:    #func               -1438+   6.750  __rcu_pending+0x10 (rcu_pending+0x1c)
:    #func               -1431+   6.000  __rcu_pending+0x10 (rcu_pending+0x34)
:    #func               -1425+   5.750  scheduler_tick+0x10 (update_process_times+0x50)
:    #func               -1420+   5.750  __update_rq_clock+0x14 (scheduler_tick+0x38)
:    #func               -1414+   8.750  sched_clock+0x10 (__update_rq_clock+0x28)
:    #func               -1405+   7.000  run_posix_cpu_timers+0x14 (update_process_times+0x58)
:    #func               -1398+   9.250  profile_tick+0x10 (tick_periodic+0xa0)
:|   #begin   0x80000001 -1389+   6.500  handle_IRQ_event+0x9c (handle_level_irq+0x64)
:|   #end     0x80000001 -1382+   5.750  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
:    #func               -1377+   6.750  note_interrupt+0x14 (handle_level_irq+0x84)
:    #func               -1370+   5.500  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
:    #func               -1364+   5.750  irq_exit+0x10 (__exception_text_start+0x4c)
:    #func               -1359+   6.000  ipipe_check_context+0x10 (irq_exit+0x18)
:    #func               -1353+   5.500  __do_softirq+0x10 (irq_exit+0x50)
:    #func               -1347+   5.750  ipipe_check_context+0x10 (__do_softirq+0x20)
:    #func               -1341+   6.250  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
:|   #begin   0x80000000 -1335+   7.000  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
:|   +end     0x80000000 -1328+   6.000  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
:    +func               -1322+   5.750  run_timer_softirq+0x14 (__do_softirq+0x60)
:    +func               -1316+   5.750  hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
:    +func               -1311+   9.500  current_kernel_time+0x14 (hrtimer_run_queues+0x24)
:|   +begin   0x80000001 -1301+   6.500  hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
:|   #end     0x80000001 -1295+   5.750  hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
:    #func               -1289+   6.250  __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
:|   #begin   0x80000000 -1283+   6.750  __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
:|   +end     0x80000000 -1276+   7.250  __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
:|   +begin   0x80000001 -1269+   6.500  run_timer_softirq+0x68 (__do_softirq+0x60)
:|   #end     0x80000001 -1262+   6.250  run_timer_softirq+0x7c (__do_softirq+0x60)
:    #func               -1256+   6.500  __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
:|   #begin   0x80000000 -1249+   6.750  __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
:|   +end     0x80000000 -1243+   7.000  __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
:|   +begin   0x80000001 -1236+   6.250  __do_softirq+0xa8 (irq_exit+0x50)
:|   #end     0x80000001 -1229+   5.500  __do_softirq+0xbc (irq_exit+0x50)
:    #func               -1224+   5.750  _local_bh_enable+0x10 (__do_softirq+0xfc)
:    #func               -1218+   7.750  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
:|   #begin   0x80000000 -1210+   8.250  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
:|   +end     0xffffffff -1202+   5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
:    +func               -1197+   1.750  __ipipe_unstall_root+0x10 (default_idle+0x94)
:|   +begin   0x80000000 -1195+   2.000  __ipipe_unstall_root+0x30 (default_idle+0x94)
:|   +end     0x80000000 -1193+   2.000  __ipipe_unstall_root+0x68 (default_idle+0x94)
:    +func               -1191+   2.000  default_idle+0x10 (cpu_idle+0x3c)
:|   +begin   0x80000001 -1189+   2.000  default_idle+0x54 (cpu_idle+0x3c)
:|   #end     0x80000001 -1187+   1.750  default_idle+0x68 (cpu_idle+0x3c)
:    #func               -1185+   1.750  __ipipe_unstall_root+0x10 (default_idle+0x84)
:|   #begin   0x80000000 -1183+   1.750  __ipipe_unstall_root+0x30 (default_idle+0x84)
:|   +end     0x80000000 -1182+   1.750  __ipipe_unstall_root+0x68 (default_idle+0x84)
:    +end     0x8000000e -1180!  84.500  default_idle+0x8c (cpu_idle+0x3c)
:|   +func               -1095+   7.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
:|   +begin   0xffffffff -1088+   5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
:|   +func               -1082+   6.000  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
:|   +func               -1076+   5.250  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
:|   +func               -1071+   5.500  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
:|   +func               -1066+   5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
:|   +func               -1060+   6.500  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
:|   +func               -1053+   5.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
:|   +func               -1048+   5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
:|   +func               -1042! 855.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
:|  # func                -187!  10.500  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
:|  # func                -176!  15.000  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
:|  # func                -161+   7.500  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
:|  # func                -154+   5.250  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
:|  # func                -148+   6.000  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
:|  # func                -142!  10.250  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
:|   +func                -132+   7.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
:|   +func                -125+   8.000  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
:|   #end     0x80000000  -117+   7.000  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
:|   #func                -110+   7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
:|   #begin   0xffffffff  -103+   5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
:|   #func                 -97+   6.000  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
:|   #func                 -91!  12.250  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
:|   #func                 -79+   6.250  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
:|   #func                 -73+   5.750  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
:|   #func                 -67+   5.750  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
:|   #func                 -61+   6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
:|  #*func                 -55+   7.000  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
:|  #*func                 -48+   7.500  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
:|  #*func                 -41+   6.500  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
:|  #*func                 -34+   5.500  xnarch_tsc_to_ns+0x10 (do_upg+0x8c [rt_bus_driver])
:|  #*func                 -29+   5.750  ipipe_trace_frozen_reset+0x10 (do_upg+0x94 [rt_bus_driver])
:|  #*func                 -23+   5.750  __ipipe_global_path_lock+0x10 (ipipe_trace_frozen_reset+0x14)
:|  #*func                 -17!  10.500  __ipipe_spin_lock_irqsave+0x10 (__ipipe_global_path_lock+0x18)
:|  #*func                  -7+   7.000  __ipipe_spin_unlock_irqcomplete+0x10 (__ipipe_global_path_unlock+0x64)
<|  #*freeze  0x00000001     0    7.250  do_upg+0x9c [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  #*func                   7    5.750  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func                  13    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func                  21    8.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                  29    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff    36    6.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func                  43    5.500  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                  48    5.250  irq_enter+0x10 (__exception_text_start+0x38)
     #func                  54    6.500  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                  60    6.250  handle_level_irq+0x10 (__exception_text_start+0x48)
     #func                  66    5.500  handle_IRQ_event+0x10 (handle_level_irq+0x64)
     #func                  72    6.250  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
     #func                  78    5.500  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                  84    7.000  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                  91    6.250  do_timer+0x10 (tick_periodic+0x70)
     #func                  97    9.000  update_wall_time+0x14 (do_timer+0x30)
     #func                 106    7.500  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                 113    9.250  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                 123    6.500  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001   129    6.500  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001   136    5.750  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                 141    6.750  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001   148    6.000  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001   154    7.000  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                 161    5.500  update_process_times+0x10 (tick_periodic+0x98)
     #func                 167    5.500  account_process_tick+0x10 (update_process_times+0x2c)
     #func                 172    7.250  account_system_time+0x10 (account_process_tick+0x40)
     #func                 179    5.500  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                 185    5.250  run_local_timers+0x10 (update_process_times+0x30)
     #func                 190    6.750  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001   197    6.250  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001   203    6.000  raise_softirq+0x58 (run_local_timers+0x18)
     #func                 209    6.500  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001   216    6.500  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001   222    5.500  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                 228    5.500  rcu_pending+0x10 (update_process_times+0x38)
     #func                 233    6.750  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                 240    6.500  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                 246    5.750  scheduler_tick+0x10 (update_process_times+0x50)
     #func                 252    6.000  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                 258    9.000  sched_clock+0x10 (__update_rq_clock+0x28)
     #func                 267    6.500  run_posix_cpu_timers+0x14 (update_process_times+0x58)
     #func                 274    7.500  profile_tick+0x10 (tick_periodic+0xa0)
     #func                 281    5.250  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                 286    6.500  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                 293    7.000  do_timer+0x10 (tick_periodic+0x70)
     #func                 300   11.250  update_wall_time+0x14 (do_timer+0x30)
     #func                 311    6.500  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001   318    6.750  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001   324    5.750  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                 330    6.500  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001   337    6.250  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001   343    6.250  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                 349    5.500  update_process_times+0x10 (tick_periodic+0x98)
     #func                 355    5.500  account_process_tick+0x10 (update_process_times+0x2c)
     #func                 360    6.500  account_system_time+0x10 (account_process_tick+0x40)
     #func                 367    5.500  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                 372    5.750  run_local_timers+0x10 (update_process_times+0x30)
     #func                 378    6.500  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001   384    6.250  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001   391    5.750  raise_softirq+0x58 (run_local_timers+0x18)
     #func                 396    6.500  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001   403    6.250  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001   409    5.500  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                 415    5.500  rcu_pending+0x10 (update_process_times+0x38)
     #func                 420    6.500  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                 427    6.000  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                 433    5.500  scheduler_tick+0x10 (update_process_times+0x50)
     #func                 438    5.500  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                 444    8.500  sched_clock+0x10 (__update_rq_clock+0x28)
     #func                 452    6.750  run_posix_cpu_timers+0x14 (update_process_times+0x58)
 |   #func                 459    7.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff   466    6.000  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                 472    6.250  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   #func                 478    5.750  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                 484    6.000  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   #func                 490    5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   #func                 496    6.250  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   #func                 502    5.250  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   #func                 507    5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   #func                 513    6.750  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                 520    7.000  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                 527    9.500  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  #*func                 536   14.500  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  #*func                 551    7.250  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  #*func                 558    5.500  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  #*func                 564    6.000  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  #*func                 570    8.750  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   #func                 578    7.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #end     0xffffffff   586    5.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   #func                 592    6.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff   598    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                 604    5.500  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func                 609   12.000  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func                 621    5.500  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func                 627    5.250  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                 632    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func                 638    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                 644    6.500  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                 651    7.000  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  #*func                 658    7.750  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  #*func                 665    5.500  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func                 671    8.000  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func                 679    7.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                 686    7.000  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff   693    7.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func                 701    7.750  profile_tick+0x10 (tick_periodic+0xa0)
     #func                 709    5.500  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                 714    7.250  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                 722    6.000  do_timer+0x10 (tick_periodic+0x70)
     #func                 728    9.000  update_wall_time+0x14 (do_timer+0x30)
     #func                 737    9.250  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                 746    7.000  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001   753    6.750  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001   760    5.250  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                 765    6.750  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001   772    6.500  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001   778    6.500  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                 785    5.500  update_process_times+0x10 (tick_periodic+0x98)
     #func                 790    5.250  account_process_tick+0x10 (update_process_times+0x2c)
     #func                 795    7.000  account_system_time+0x10 (account_process_tick+0x40)
     #func                 802    5.750  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                 808    5.000  run_local_timers+0x10 (update_process_times+0x30)
     #func                 813    6.500  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001   820    6.500  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001   826    6.000  raise_softirq+0x58 (run_local_timers+0x18)
     #func                 832    6.250  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001   838    6.250  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001   845    5.750  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                 850    5.750  rcu_pending+0x10 (update_process_times+0x38)
     #func                 856    6.500  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                 863    6.000  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                 869    6.000  scheduler_tick+0x10 (update_process_times+0x50)
     #func                 875    5.750  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                 880    8.750  sched_clock+0x10 (__update_rq_clock+0x28)
     #func                 889    6.500  run_posix_cpu_timers+0x14 (update_process_times+0x58)
     #func                 896    9.500  profile_tick+0x10 (tick_periodic+0xa0)
 |   #begin   0x80000001   905    6.750  handle_IRQ_event+0x9c (handle_level_irq+0x64)
 |   #end     0x80000001   912    5.500  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
     #func                 917    6.750  note_interrupt+0x14 (handle_level_irq+0x84)
     #func                 924    6.000  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
     #func                 930    5.750  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                 936    6.000  ipipe_check_context+0x10 (irq_exit+0x18)
     #func                 942    5.250  __do_softirq+0x10 (irq_exit+0x50)
     #func                 947    5.750  ipipe_check_context+0x10 (__do_softirq+0x20)
     #func                 953    6.500  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
 |   #begin   0x80000000   959    5.500  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
 |   +func                 965    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000   972    6.500  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
     +func                 978    6.250  run_timer_softirq+0x14 (__do_softirq+0x60)
     +func                 985    6.000  hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
     +func                 991    9.750  current_kernel_time+0x14 (hrtimer_run_queues+0x24)
 |   +begin   0x80000001  1000    6.500  hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
 |   #end     0x80000001  1007    6.250  hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
     #func                1013    6.250  __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
 |   #begin   0x80000000  1019    5.250  __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
 |   +func                1025    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  1032    7.500  __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
 |   +begin   0x80000001  1039    6.250  run_timer_softirq+0x68 (__do_softirq+0x60)
 |   #end     0x80000001  1045    7.750  run_timer_softirq+0x7c (__do_softirq+0x60)
     #func                1053    6.250  __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
 |   #begin   0x80000000  1059    5.750  __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
 |   +func                1065    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  1072    6.750  __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
 |   +begin   0x80000001  1079    6.500  __do_softirq+0xa8 (irq_exit+0x50)
 |   #end     0x80000001  1085    5.750  __do_softirq+0xbc (irq_exit+0x50)
     #func                1091    5.750  _local_bh_enable+0x10 (__do_softirq+0xfc)
     #func                1097    7.750  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
 |   #begin   0x80000000  1104    8.000  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  1112    5.750  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func                1118    5.250  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                1123    5.500  irq_enter+0x10 (__exception_text_start+0x38)
     #func                1129    6.000  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                1135    6.500  handle_level_irq+0x10 (__exception_text_start+0x48)
     #func                1141    5.500  handle_IRQ_event+0x10 (handle_level_irq+0x64)
     #func                1147    6.250  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
     #func                1153    5.250  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                1158    7.000  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                1165    6.000  do_timer+0x10 (tick_periodic+0x70)
     #func                1171   10.500  update_wall_time+0x14 (do_timer+0x30)
     #func                1182    6.750  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001  1189    6.500  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001  1195    5.500  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                1201    6.500  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001  1207    6.500  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001  1214    6.750  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                1220    5.000  update_process_times+0x10 (tick_periodic+0x98)
     #func                1225    7.000  account_process_tick+0x10 (update_process_times+0x2c)
 |   #func                1232    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  1239    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                1245    5.750  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   #func                1251    5.500  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                1256    5.750  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   #func                1262    6.000  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   #func                1268    6.000  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   #func                1274    5.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   #func                1280    6.000  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   #func                1286    6.750  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                1292    6.500  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                1299    8.750  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  #*func                1308   15.000  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  #*func                1323    7.500  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  #*func                1330    5.250  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  #*func                1335    5.750  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  #*func                1341    9.000  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   #func                1350    7.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #end     0xffffffff  1358    5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   #func                1363    6.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  1370    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                1375    6.000  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func                1381   11.750  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func                1393    5.500  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func                1398    5.750  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                1404    5.750  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func                1410    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                1416    6.250  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                1422    6.750  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  #*func                1429    8.250  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  #*func                1437    5.500  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func                1443    8.000  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func                1451    7.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                1458    7.500  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff  1466    5.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func                1472    7.500  account_system_time+0x10 (account_process_tick+0x40)
     #func                1479    5.500  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                1485    5.750  run_local_timers+0x10 (update_process_times+0x30)
     #func                1490    6.500  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001  1497    6.500  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001  1503    5.750  raise_softirq+0x58 (run_local_timers+0x18)
     #func                1509    6.750  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001  1516    6.250  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001  1522    5.500  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                1528    5.750  rcu_pending+0x10 (update_process_times+0x38)
     #func                1533    6.500  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                1540    5.750  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                1546    5.250  scheduler_tick+0x10 (update_process_times+0x50)
     #func                1551    6.000  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                1557    9.000  sched_clock+0x10 (__update_rq_clock+0x28)
     #func                1566    6.500  run_posix_cpu_timers+0x14 (update_process_times+0x58)
     #func                1572   10.000  profile_tick+0x10 (tick_periodic+0xa0)
 |   #begin   0x80000001  1582    7.000  handle_IRQ_event+0x9c (handle_level_irq+0x64)
 |   #end     0x80000001  1589    5.750  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
     #func                1595    6.750  note_interrupt+0x14 (handle_level_irq+0x84)
     #func                1602    5.500  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
     #func                1607    6.000  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                1613    6.250  ipipe_check_context+0x10 (irq_exit+0x18)
     #func                1620    5.250  __do_softirq+0x10 (irq_exit+0x50)
     #func                1625    5.750  ipipe_check_context+0x10 (__do_softirq+0x20)
     #func                1631    6.500  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
 |   #begin   0x80000000  1637    5.500  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
 |   +func                1643    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  1649    5.750  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
     +func                1655    6.500  run_timer_softirq+0x14 (__do_softirq+0x60)
     +func                1662    5.750  hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
     +func                1667    9.000  current_kernel_time+0x14 (hrtimer_run_queues+0x24)
 |   +begin   0x80000001  1676    6.500  hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
 |   #end     0x80000001  1683    6.000  hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
     #func                1689    6.500  __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
 |   #begin   0x80000000  1695    5.250  __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
 |   +func                1701    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  1707    7.000  __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
 |   +begin   0x80000001  1714    6.500  run_timer_softirq+0x68 (__do_softirq+0x60)
 |   #end     0x80000001  1721    6.000  run_timer_softirq+0x7c (__do_softirq+0x60)
     #func                1727    6.250  __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
 |   #begin   0x80000000  1733    5.750  __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
 |   +func                1739    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  1746    7.000  __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
 |   +begin   0x80000001  1753    6.250  __do_softirq+0xa8 (irq_exit+0x50)
 |   #end     0x80000001  1759    5.500  __do_softirq+0xbc (irq_exit+0x50)
     #func                1764    6.000  _local_bh_enable+0x10 (__do_softirq+0xfc)
     #func                1770    7.750  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
 |   #begin   0x80000000  1778    8.250  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  1786    5.750  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func                1792    5.750  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                1798    5.500  irq_enter+0x10 (__exception_text_start+0x38)
     #func                1803    5.750  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                1809    5.750  handle_level_irq+0x10 (__exception_text_start+0x48)
     #func                1815    6.000  handle_IRQ_event+0x10 (handle_level_irq+0x64)
     #func                1821    6.000  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
     #func                1827    5.250  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                1832    7.000  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                1839    6.750  do_timer+0x10 (tick_periodic+0x70)
     #func                1846    9.000  update_wall_time+0x14 (do_timer+0x30)
     #func                1855    9.500  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                1864    7.000  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001  1871    6.750  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001  1878    5.750  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                1884    6.750  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001  1891    6.500  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001  1897    7.250  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                1904    5.250  update_process_times+0x10 (tick_periodic+0x98)
     #func                1910    5.250  account_process_tick+0x10 (update_process_times+0x2c)
     #func                1915    7.500  account_system_time+0x10 (account_process_tick+0x40)
     #func                1922    5.750  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                1928    5.250  run_local_timers+0x10 (update_process_times+0x30)
     #func                1933    6.500  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001  1940    6.500  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001  1946    6.000  raise_softirq+0x58 (run_local_timers+0x18)
     #func                1952    6.250  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001  1959    6.250  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001  1965    5.750  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                1971    5.750  rcu_pending+0x10 (update_process_times+0x38)
     #func                1976    6.500  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                1983    6.000  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                1989    6.000  scheduler_tick+0x10 (update_process_times+0x50)
     #func                1995    5.750  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                2001    9.000  sched_clock+0x10 (__update_rq_clock+0x28)
 |   #func                2010    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  2017    6.000  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                2023    6.500  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   #func                2029    5.500  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                2035    5.500  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   #func                2040    6.000  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   #func                2046    6.750  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   #func                2053    5.000  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   #func                2058    5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   #func                2064    6.750  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                2070    6.750  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                2077    9.000  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  #*func                2086   14.500  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  #*func                2101    7.750  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  #*func                2108    5.500  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  #*func                2114    6.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  #*func                2120    9.250  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   #func                2129    7.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #end     0xffffffff  2137    5.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   #func                2143    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  2149    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                2155    6.000  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func                2161   12.000  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func                2173    5.750  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func                2178    5.750  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                2184    5.750  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func                2190    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                2196    6.250  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                2202    6.500  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  #*func                2209    8.250  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  #*func                2217    6.000  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func                2223    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func                2231    7.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                2238    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff  2246    8.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func                2254    6.500  run_posix_cpu_timers+0x14 (update_process_times+0x58)
     #func                2261   10.500  profile_tick+0x10 (tick_periodic+0xa0)
 |   #begin   0x80000001  2271    6.750  handle_IRQ_event+0x9c (handle_level_irq+0x64)
 |   #end     0x80000001  2278    5.750  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
     #func                2284    6.250  note_interrupt+0x14 (handle_level_irq+0x84)
     #func                2290    5.750  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
     #func                2296    5.750  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                2302    6.250  ipipe_check_context+0x10 (irq_exit+0x18)
     #func                2308    5.500  __do_softirq+0x10 (irq_exit+0x50)
     #func                2313    5.500  ipipe_check_context+0x10 (__do_softirq+0x20)
     #func                2319    6.750  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
 |   #begin   0x80000000  2326    5.750  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
 |   +func                2331    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  2338    5.750  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
     +func                2344    6.250  run_timer_softirq+0x14 (__do_softirq+0x60)
     +func                2350    5.750  hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
     +func                2356    9.750  current_kernel_time+0x14 (hrtimer_run_queues+0x24)
 |   +begin   0x80000001  2366    6.250  hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
 |   #end     0x80000001  2372    5.750  hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
     #func                2378    6.500  __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
 |   #begin   0x80000000  2384    5.750  __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
 |   +func                2390    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  2397    7.750  __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
 |   +begin   0x80000001  2404    6.750  run_timer_softirq+0x68 (__do_softirq+0x60)
 |   #end     0x80000001  2411    6.250  run_timer_softirq+0x7c (__do_softirq+0x60)
     #func                2417    6.250  __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
 |   #begin   0x80000000  2424    5.500  __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
 |   +func                2429    7.250  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  2436    6.750  __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
 |   +begin   0x80000001  2443    6.250  __do_softirq+0xa8 (irq_exit+0x50)
 |   #end     0x80000001  2449    5.500  __do_softirq+0xbc (irq_exit+0x50)
     #func                2455    6.000  _local_bh_enable+0x10 (__do_softirq+0xfc)
     #func                2461    7.500  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
 |   #begin   0x80000000  2468    8.250  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  2477    5.750  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func                2482    5.500  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                2488    5.500  irq_enter+0x10 (__exception_text_start+0x38)
     #func                2493    6.000  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                2499    5.750  handle_level_irq+0x10 (__exception_text_start+0x48)
     #func                2505    6.000  handle_IRQ_event+0x10 (handle_level_irq+0x64)
     #func                2511    7.750  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
 |   #begin   0x80000001  2519    6.500  handle_IRQ_event+0x9c (handle_level_irq+0x64)
 |   #end     0x80000001  2525    5.500  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
     #func                2531    6.750  note_interrupt+0x14 (handle_level_irq+0x84)
     #func                2538    5.500  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
     #func                2543    5.750  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                2549    7.250  ipipe_check_context+0x10 (irq_exit+0x18)
 |   #begin   0x80000000  2556    8.750  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff  2565    5.000  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func                2570    1.500  __ipipe_unstall_root+0x10 (default_idle+0x94)
 |   +begin   0x80000000  2571    2.000  __ipipe_unstall_root+0x30 (default_idle+0x94)
 |   +end     0x80000000  2573    1.750  __ipipe_unstall_root+0x68 (default_idle+0x94)
     +func                2575    2.000  default_idle+0x10 (cpu_idle+0x3c)
 |   +begin   0x80000001  2577    1.750  default_idle+0x54 (cpu_idle+0x3c)
 |   #end     0x80000001  2579    1.750  default_idle+0x68 (cpu_idle+0x3c)
     #func                2581    1.750  __ipipe_unstall_root+0x10 (default_idle+0x84)
 |   #begin   0x80000000  2582    1.750  __ipipe_unstall_root+0x30 (default_idle+0x84)
 |   +end     0x80000000  2584    1.750  __ipipe_unstall_root+0x68 (default_idle+0x84)
     +end     0x8000000e  2586  198.750  default_idle+0x8c (cpu_idle+0x3c)
 |   +func                2785    7.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  2792    5.250  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                2797    5.750  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func                2803    6.000  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                2809    5.750  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func                2815    5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func                2820    6.500  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func                2827    6.000  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func                2833    6.000  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func                2839    6.000  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                2845    6.500  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                2851    8.500  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func                2860   15.250  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func                2875    7.000  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func                2882    5.250  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func                2887    6.500  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func                2894    9.250  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func                2903    6.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                2909    8.250  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  2918    6.250  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
 |   #func                2924    6.750  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  2931    6.000  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                2937    5.750  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func                2942   12.500  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func                2955    6.250  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func                2961    5.250  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                2966    5.500  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func                2972    6.750  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                2979    6.750  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                2985    7.250  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  #*func                2993    7.750  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  #*func                3000    5.750  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func                3006    8.000  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func                3014    7.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                3021    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff  3028    6.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func                3035    5.500  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                3040    5.500  irq_enter+0x10 (__exception_text_start+0x38)
     #func                3046    5.750  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                3052    7.000  handle_level_irq+0x10 (__exception_text_start+0x48)
     #func                3059    6.500  handle_IRQ_event+0x10 (handle_level_irq+0x64)
     #func                3065    6.000  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
     #func                3071    5.250  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                3076    6.250  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                3083    6.000  do_timer+0x10 (tick_periodic+0x70)
     #func                3089    9.000  update_wall_time+0x14 (do_timer+0x30)
     #func                3098    7.500  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                3105    9.500  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                3115    7.000  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001  3122    6.750  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001  3128    5.750  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                3134    7.000  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001  3141    6.750  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001  3148    6.500  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                3154    5.250  update_process_times+0x10 (tick_periodic+0x98)
     #func                3160    5.500  account_process_tick+0x10 (update_process_times+0x2c)
     #func                3165    7.500  account_system_time+0x10 (account_process_tick+0x40)
     #func                3173    6.000  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                3179    5.250  run_local_timers+0x10 (update_process_times+0x30)
     #func                3184    6.500  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001  3190    6.750  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001  3197    5.750  raise_softirq+0x58 (run_local_timers+0x18)
     #func                3203    6.500  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001  3209    6.500  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001  3216    5.750  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                3222    5.250  rcu_pending+0x10 (update_process_times+0x38)
     #func                3227    6.500  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                3233    6.500  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                3240    6.000  scheduler_tick+0x10 (update_process_times+0x50)
     #func                3246    5.750  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                3252    8.500  sched_clock+0x10 (__update_rq_clock+0x28)
     #func                3260    6.750  run_posix_cpu_timers+0x14 (update_process_times+0x58)
     #func                3267    9.500  profile_tick+0x10 (tick_periodic+0xa0)
 |   #begin   0x80000001  3276    6.500  handle_IRQ_event+0x9c (handle_level_irq+0x64)
 |   #end     0x80000001  3283    5.750  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
     #func                3289    6.750  note_interrupt+0x14 (handle_level_irq+0x84)
     #func                3295    6.000  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
     #func                3301    5.500  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                3307    5.500  ipipe_check_context+0x10 (irq_exit+0x18)
     #func                3312    6.000  __do_softirq+0x10 (irq_exit+0x50)
     #func                3318    6.000  ipipe_check_context+0x10 (__do_softirq+0x20)
     #func                3324    6.500  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
 |   #begin   0x80000000  3331    6.500  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
 |   +end     0x80000000  3337    5.750  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
     +func                3343    5.750  run_timer_softirq+0x14 (__do_softirq+0x60)
     +func                3349    5.250  hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
     +func                3354    9.500  current_kernel_time+0x14 (hrtimer_run_queues+0x24)
 |   +begin   0x80000001  3364    6.500  hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
 |   #end     0x80000001  3370    6.250  hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
     #func                3376    6.250  __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
 |   #begin   0x80000000  3383    6.500  __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
 |   +end     0x80000000  3389    7.750  __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
 |   +begin   0x80000001  3397    6.250  run_timer_softirq+0x68 (__do_softirq+0x60)
 |   #end     0x80000001  3403    6.250  run_timer_softirq+0x7c (__do_softirq+0x60)
     #func                3409    6.500  __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
 |   #begin   0x80000000  3416    6.750  __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
 |   +end     0x80000000  3423    7.000  __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
 |   +begin   0x80000001  3430    6.250  __do_softirq+0xa8 (irq_exit+0x50)
 |   #end     0x80000001  3436    5.500  __do_softirq+0xbc (irq_exit+0x50)
     #func                3441    5.500  _local_bh_enable+0x10 (__do_softirq+0xfc)
     #func                3447    8.000  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
 |   #begin   0x80000000  3455    8.500  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff  3463    4.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func                3468    1.750  __ipipe_unstall_root+0x10 (default_idle+0x94)
 |   +begin   0x80000000  3470    1.750  __ipipe_unstall_root+0x30 (default_idle+0x94)
 |   +end     0x80000000  3472    1.750  __ipipe_unstall_root+0x68 (default_idle+0x94)
     +func                3473    1.750  default_idle+0x10 (cpu_idle+0x3c)
 |   +begin   0x80000001  3475    1.750  default_idle+0x54 (cpu_idle+0x3c)
 |   #end     0x80000001  3477    1.750  default_idle+0x68 (cpu_idle+0x3c)
     #func                3479    1.750  __ipipe_unstall_root+0x10 (default_idle+0x84)
 |   #begin   0x80000000  3480    1.750  __ipipe_unstall_root+0x30 (default_idle+0x84)
 |   +end     0x80000000  3482    1.750  __ipipe_unstall_root+0x68 (default_idle+0x84)
     +end     0x8000000e  3484   76.500  default_idle+0x8c (cpu_idle+0x3c)
 |   +func                3560    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  3567    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                3573    5.750  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func                3578    6.000  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                3584    5.500  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func                3590    5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func                3596    6.250  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func                3602    5.750  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func                3608    5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func                3613    6.000  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                3619    6.500  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                3626    9.500  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func                3635   14.750  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func                3650    7.250  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func                3657    5.750  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func                3663    6.000  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func                3669    9.000  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func                3678    6.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                3684    8.750  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  3693    6.750  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
 |   #func                3700    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  3706    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                3712    6.000  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func                3718   12.000  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func                3730    6.000  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func                3736    5.500  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                3741    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func                3747    6.750  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                3754    6.500  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                3761    6.750  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  #*func                3767    8.250  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  #*func                3776    5.750  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func                3781    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func                3790    7.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                3797    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff  3804    6.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func                3811    5.750  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                3816    5.000  irq_enter+0x10 (__exception_text_start+0x38)
     #func                3821    6.500  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                3828    6.000  handle_level_irq+0x10 (__exception_text_start+0x48)
     #func                3834    5.500  handle_IRQ_event+0x10 (handle_level_irq+0x64)
     #func                3839    6.250  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
     #func                3846    5.250  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                3851    7.250  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                3858    6.000  do_timer+0x10 (tick_periodic+0x70)
     #func                3864    9.000  update_wall_time+0x14 (do_timer+0x30)
     #func                3873    9.500  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                3883    7.000  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001  3890    6.500  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001  3896    5.750  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                3902    6.500  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001  3908    6.750  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001  3915    7.500  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                3923    5.250  update_process_times+0x10 (tick_periodic+0x98)
     #func                3928    5.500  account_process_tick+0x10 (update_process_times+0x2c)
     #func                3933    7.750  account_system_time+0x10 (account_process_tick+0x40)
     #func                3941    5.750  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                3947    5.250  run_local_timers+0x10 (update_process_times+0x30)
     #func                3952    6.750  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001  3959    6.500  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001  3965    5.750  raise_softirq+0x58 (run_local_timers+0x18)
     #func                3971    6.250  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001  3977    6.750  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001  3984    6.000  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                3990    5.500  rcu_pending+0x10 (update_process_times+0x38)
     #func                3996    6.500  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                4002    6.500  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                4009    5.750  scheduler_tick+0x10 (update_process_times+0x50)
     #func                4014    5.750  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                4020    8.500  sched_clock+0x10 (__update_rq_clock+0x28)
     #func                4029    6.500  run_posix_cpu_timers+0x14 (update_process_times+0x58)
     #func                4035   10.250  profile_tick+0x10 (tick_periodic+0xa0)
 |   #begin   0x80000001  4045    6.250  handle_IRQ_event+0x9c (handle_level_irq+0x64)
 |   #end     0x80000001  4052    5.500  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
     #func                4057    6.750  note_interrupt+0x14 (handle_level_irq+0x84)
     #func                4064    6.250  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
     #func                4070    5.250  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                4075    5.750  ipipe_check_context+0x10 (irq_exit+0x18)
     #func                4081    5.500  __do_softirq+0x10 (irq_exit+0x50)
     #func                4087    6.250  ipipe_check_context+0x10 (__do_softirq+0x20)
     #func                4093    6.250  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
 |   #begin   0x80000000  4099    6.750  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
 |   +end     0x80000000  4106    6.250  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
     +func                4112    5.750  run_timer_softirq+0x14 (__do_softirq+0x60)
     +func                4118    5.750  hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
     +func                4124    8.250  current_kernel_time+0x14 (hrtimer_run_queues+0x24)
 |   +begin   0x80000001  4132    6.500  hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
 |   #end     0x80000001  4138    5.750  hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
     #func                4144    6.500  __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
 |   #begin   0x80000000  4151    6.500  __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
 |   +end     0x80000000  4157    7.250  __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
 |   +begin   0x80000001  4164    6.500  run_timer_softirq+0x68 (__do_softirq+0x60)
 |   #end     0x80000001  4171    6.000  run_timer_softirq+0x7c (__do_softirq+0x60)
     #func                4177    6.250  __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
 |   #begin   0x80000000  4183    7.000  __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
 |   +end     0x80000000  4190    7.000  __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
 |   +begin   0x80000001  4197    6.250  __do_softirq+0xa8 (irq_exit+0x50)
 |   #end     0x80000001  4203    5.500  __do_softirq+0xbc (irq_exit+0x50)
     #func                4209    6.000  _local_bh_enable+0x10 (__do_softirq+0xfc)
     #func                4215    7.750  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
 |   #begin   0x80000000  4223    8.250  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff  4231    5.000  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func                4236    1.750  __ipipe_unstall_root+0x10 (default_idle+0x94)
 |   +begin   0x80000000  4238    2.000  __ipipe_unstall_root+0x30 (default_idle+0x94)
 |   +end     0x80000000  4240    1.500  __ipipe_unstall_root+0x68 (default_idle+0x94)
     +func                4241    1.750  default_idle+0x10 (cpu_idle+0x3c)
 |   +begin   0x80000001  4243    1.750  default_idle+0x54 (cpu_idle+0x3c)
 |   #end     0x80000001  4245    1.750  default_idle+0x68 (cpu_idle+0x3c)
     #func                4246    1.750  __ipipe_unstall_root+0x10 (default_idle+0x84)
 |   #begin   0x80000000  4248    1.750  __ipipe_unstall_root+0x30 (default_idle+0x84)
 |   +end     0x80000000  4250    1.750  __ipipe_unstall_root+0x68 (default_idle+0x84)
     +end     0x8000000e  4252   84.500  default_idle+0x8c (cpu_idle+0x3c)
 |   +func                4336    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  4343    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                4348    5.750  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func                4354    5.750  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                4360    5.750  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func                4366    5.500  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func                4371    6.500  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func                4378    5.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func                4383    5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func                4389    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                4395    6.750  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                4402    9.000  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func                4411   14.500  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func                4425    7.250  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func                4433    5.750  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func                4438    6.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func                4445    9.500  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func                4454    6.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                4460    8.500  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  4469    6.500  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
 |   #func                4475    6.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  4481    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                4487    6.250  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func                4493   12.250  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func                4505    5.750  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func                4511    5.250  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                4516    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func                4522    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                4529    6.250  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                4535    7.250  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  #*func                4542    8.500  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  #*func                4551    5.750  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func                4556    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func                4565    7.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                4572    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff  4579    6.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func                4586    5.500  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                4591    5.750  irq_enter+0x10 (__exception_text_start+0x38)
     #func                4597    6.250  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                4603    6.250  handle_level_irq+0x10 (__exception_text_start+0x48)
     #func                4609    5.750  handle_IRQ_event+0x10 (handle_level_irq+0x64)
     #func                4615    5.750  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
     #func                4621    5.500  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                4626    6.250  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                4633    5.750  do_timer+0x10 (tick_periodic+0x70)
     #func                4638    8.500  update_wall_time+0x14 (do_timer+0x30)
     #func                4647   10.000  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                4657    7.000  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001  4664    6.500  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001  4670    5.500  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                4676    6.500  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001  4682    6.500  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001  4689    6.500  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                4695    5.250  update_process_times+0x10 (tick_periodic+0x98)
     #func                4701    5.750  account_process_tick+0x10 (update_process_times+0x2c)
     #func                4706    7.250  account_system_time+0x10 (account_process_tick+0x40)
     #func                4714    5.500  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                4719    5.250  run_local_timers+0x10 (update_process_times+0x30)
     #func                4724    6.750  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001  4731    6.750  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001  4738    5.750  raise_softirq+0x58 (run_local_timers+0x18)
     #func                4744    6.250  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001  4750    6.500  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001  4756    6.000  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                4762    5.500  rcu_pending+0x10 (update_process_times+0x38)
     #func                4768    6.500  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                4774    6.500  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                4781    6.000  scheduler_tick+0x10 (update_process_times+0x50)
     #func                4787    5.500  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                4792    8.500  sched_clock+0x10 (__update_rq_clock+0x28)
     #func                4801    7.250  run_posix_cpu_timers+0x14 (update_process_times+0x58)
     #func                4808    9.500  profile_tick+0x10 (tick_periodic+0xa0)
 |   #begin   0x80000001  4818    6.500  handle_IRQ_event+0x9c (handle_level_irq+0x64)
 |   #end     0x80000001  4824    5.500  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
     #func                4830    6.750  note_interrupt+0x14 (handle_level_irq+0x84)
     #func                4836    6.250  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
     #func                4843    5.500  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                4848    5.750  ipipe_check_context+0x10 (irq_exit+0x18)
     #func                4854    5.750  __do_softirq+0x10 (irq_exit+0x50)
     #func                4860    5.750  ipipe_check_context+0x10 (__do_softirq+0x20)
     #func                4865    6.250  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
 |   #begin   0x80000000  4872    6.750  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
 |   +end     0x80000000  4878    6.000  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
     +func                4884    6.250  run_timer_softirq+0x14 (__do_softirq+0x60)
     +func                4891    5.500  hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
     +func                4896    9.250  current_kernel_time+0x14 (hrtimer_run_queues+0x24)
 |   +begin   0x80000001  4905    6.500  hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
 |   #end     0x80000001  4912    6.250  hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
     #func                4918    6.250  __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
 |   #begin   0x80000000  4924    6.750  __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
 |   +end     0x80000000  4931    7.000  __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
 |   +begin   0x80000001  4938    6.500  run_timer_softirq+0x68 (__do_softirq+0x60)
 |   #end     0x80000001  4945    6.000  run_timer_softirq+0x7c (__do_softirq+0x60)
     #func                4951    6.500  __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
 |   #begin   0x80000000  4957    6.750  __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
 |   +end     0x80000000  4964    6.750  __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
 |   +begin   0x80000001  4971    6.250  __do_softirq+0xa8 (irq_exit+0x50)
 |   #end     0x80000001  4977    5.250  __do_softirq+0xbc (irq_exit+0x50)
     #func                4982    6.000  _local_bh_enable+0x10 (__do_softirq+0xfc)
     #func                4988    7.500  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
 |   #begin   0x80000000  4996    8.000  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff  5004    5.000  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func                5009    2.250  __ipipe_unstall_root+0x10 (default_idle+0x94)
 |   +begin   0x80000000  5011    1.750  __ipipe_unstall_root+0x30 (default_idle+0x94)
 |   +end     0x80000000  5013    1.750  __ipipe_unstall_root+0x68 (default_idle+0x94)
     +func                5014    1.750  default_idle+0x10 (cpu_idle+0x3c)
 |   +begin   0x80000001  5016    1.750  default_idle+0x54 (cpu_idle+0x3c)
 |   #end     0x80000001  5018    1.750  default_idle+0x68 (cpu_idle+0x3c)
     #func                5020    1.750  __ipipe_unstall_root+0x10 (default_idle+0x84)
 |   #begin   0x80000000  5021    1.750  __ipipe_unstall_root+0x30 (default_idle+0x84)
 |   +end     0x80000000  5023    1.750  __ipipe_unstall_root+0x68 (default_idle+0x84)
     +end     0x8000000e  5025   87.000  default_idle+0x8c (cpu_idle+0x3c)
 |   +func                5112    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  5119    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                5124    6.250  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func                5131    6.000  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                5137    5.750  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func                5142    5.500  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func                5148    6.500  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func                5154    5.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func                5160    5.500  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func                5165    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                5172    6.500  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                5178    9.250  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func                5187   14.500  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func                5202    6.750  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func                5209    5.500  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func                5214    6.500  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func                5221    8.750  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func                5229    6.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                5236    8.500  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  5244    6.250  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
 |   #func                5251    6.750  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  5257    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                5263    6.000  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func                5269   12.250  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func                5281    5.500  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func                5287    5.500  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                5292    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func                5298    6.750  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                5305    6.750  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                5312    7.500  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  #*func                5319    7.750  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  #*func                5327    5.750  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func                5333    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func                5341    7.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                5348    7.500  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff  5356    6.250  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func                5362    5.500  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                5368    5.500  irq_enter+0x10 (__exception_text_start+0x38)
     #func                5373    6.000  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                5379    6.250  handle_level_irq+0x10 (__exception_text_start+0x48)
     #func                5385    5.750  handle_IRQ_event+0x10 (handle_level_irq+0x64)
     #func                5391    6.000  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
     #func                5397    5.250  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                5402    6.500  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                5409    5.500  do_timer+0x10 (tick_periodic+0x70)
     #func                5414    9.000  update_wall_time+0x14 (do_timer+0x30)
     #func                5423    9.500  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                5433    6.500  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001  5439    6.500  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001  5446    5.750  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                5452    6.750  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001  5458    6.750  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001  5465    6.750  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                5472    5.250  update_process_times+0x10 (tick_periodic+0x98)
     #func                5477    5.500  account_process_tick+0x10 (update_process_times+0x2c)
     #func                5483    7.750  account_system_time+0x10 (account_process_tick+0x40)
     #func                5490    5.250  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                5496    5.250  run_local_timers+0x10 (update_process_times+0x30)
     #func                5501    6.750  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001  5508    6.750  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001  5514    5.750  raise_softirq+0x58 (run_local_timers+0x18)
     #func                5520    6.250  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001  5526    6.750  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001  5533    5.750  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                5539    5.500  rcu_pending+0x10 (update_process_times+0x38)
     #func                5544    6.500  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                5551    6.250  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                5557    5.750  scheduler_tick+0x10 (update_process_times+0x50)
     #func                5563    5.500  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                5568    8.500  sched_clock+0x10 (__update_rq_clock+0x28)
     #func                5577    6.500  run_posix_cpu_timers+0x14 (update_process_times+0x58)
     #func                5583    9.500  profile_tick+0x10 (tick_periodic+0xa0)
 |   #begin   0x80000001  5593    6.250  handle_IRQ_event+0x9c (handle_level_irq+0x64)
 |   #end     0x80000001  5599    5.750  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
     #func                5605    6.750  note_interrupt+0x14 (handle_level_irq+0x84)
     #func                5612    6.000  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
     #func                5618    5.500  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                5623    6.250  ipipe_check_context+0x10 (irq_exit+0x18)
     #func                5629    5.750  __do_softirq+0x10 (irq_exit+0x50)
     #func                5635    5.750  ipipe_check_context+0x10 (__do_softirq+0x20)
     #func                5641    6.750  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
 |   #begin   0x80000000  5648    6.750  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
 |   +end     0x80000000  5654    6.250  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
     +func                5661    6.250  run_timer_softirq+0x14 (__do_softirq+0x60)
     +func                5667    5.750  hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
     +func                5673    8.500  current_kernel_time+0x14 (hrtimer_run_queues+0x24)
 |   +begin   0x80000001  5681    6.750  hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
 |   #end     0x80000001  5688    6.000  hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
     #func                5694    6.250  __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
 |   #begin   0x80000000  5700    6.750  __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
 |   +end     0x80000000  5707    7.000  __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
 |   +begin   0x80000001  5714    6.500  run_timer_softirq+0x68 (__do_softirq+0x60)
 |   #end     0x80000001  5720    6.000  run_timer_softirq+0x7c (__do_softirq+0x60)
     #func                5726    6.250  __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
 |   #begin   0x80000000  5733    6.750  __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
 |   +end     0x80000000  5739    7.000  __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
 |   +begin   0x80000001  5746    7.000  __do_softirq+0xa8 (irq_exit+0x50)
 |   #end     0x80000001  5753    5.500  __do_softirq+0xbc (irq_exit+0x50)
     #func                5759    6.000  _local_bh_enable+0x10 (__do_softirq+0xfc)
     #func                5765    7.750  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
 |   #begin   0x80000000  5773    8.000  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff  5781    5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func                5786    1.750  __ipipe_unstall_root+0x10 (default_idle+0x94)
 |   +begin   0x80000000  5788    1.750  __ipipe_unstall_root+0x30 (default_idle+0x94)
 |   +end     0x80000000  5790    1.750  __ipipe_unstall_root+0x68 (default_idle+0x94)
     +func                5791    1.750  default_idle+0x10 (cpu_idle+0x3c)
 |   +begin   0x80000001  5793    1.750  default_idle+0x54 (cpu_idle+0x3c)
 |   #end     0x80000001  5795    1.750  default_idle+0x68 (cpu_idle+0x3c)
     #func                5797    1.750  __ipipe_unstall_root+0x10 (default_idle+0x84)
 |   #begin   0x80000000  5798    1.750  __ipipe_unstall_root+0x30 (default_idle+0x84)
 |   +end     0x80000000  5800    1.750  __ipipe_unstall_root+0x68 (default_idle+0x84)
     +end     0x8000000e  5802   85.750  default_idle+0x8c (cpu_idle+0x3c)
 |   +func                5888    7.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  5895    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                5901    5.750  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func                5907    5.750  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                5912    5.750  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func                5918    5.500  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func                5924    6.750  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func                5930    5.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func                5936    5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func                5942    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                5948    6.750  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                5955    9.250  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func                5964   15.000  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func                5979    7.250  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func                5986    5.500  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func                5992    6.000  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func                5998    9.250  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func                6007    6.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                6013    9.000  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  6022    6.500  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
 |   #func                6029    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  6035    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                6041    6.000  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func                6047   12.500  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func                6060    5.750  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func                6065    5.250  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                6071    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func                6077    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                6083    6.750  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                6090    7.500  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  #*func                6097    8.500  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  #*func                6106    5.750  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func                6112    8.500  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func                6120    7.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                6127    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff  6134    6.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func                6141    5.500  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                6146    5.500  irq_enter+0x10 (__exception_text_start+0x38)
     #func                6152    6.250  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                6158    6.000  handle_level_irq+0x10 (__exception_text_start+0x48)
     #func                6164    5.500  handle_IRQ_event+0x10 (handle_level_irq+0x64)
     #func                6170    6.000  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
     #func                6176    5.250  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                6181    6.250  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                6187    5.750  do_timer+0x10 (tick_periodic+0x70)
     #func                6193    8.750  update_wall_time+0x14 (do_timer+0x30)
     #func                6202    9.750  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                6211    7.000  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001  6218    6.250  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001  6225    5.750  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                6230    6.750  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001  6237    6.500  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001  6244    6.500  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                6250    5.500  update_process_times+0x10 (tick_periodic+0x98)
     #func                6256    5.750  account_process_tick+0x10 (update_process_times+0x2c)
     #func                6261    7.500  account_system_time+0x10 (account_process_tick+0x40)
     #func                6269    5.500  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                6274    5.000  run_local_timers+0x10 (update_process_times+0x30)
     #func                6279    7.000  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001  6286    6.750  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001  6293    5.750  raise_softirq+0x58 (run_local_timers+0x18)
     #func                6299    6.500  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001  6305    6.500  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001  6312    5.750  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                6318    5.500  rcu_pending+0x10 (update_process_times+0x38)
     #func                6323    6.250  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                6329    6.250  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                6336    6.250  scheduler_tick+0x10 (update_process_times+0x50)
     #func                6342    6.000  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                6348    8.750  sched_clock+0x10 (__update_rq_clock+0x28)
     #func                6357    6.750  run_posix_cpu_timers+0x14 (update_process_times+0x58)
     #func                6363   10.000  profile_tick+0x10 (tick_periodic+0xa0)
 |   #begin   0x80000001  6373    6.750  handle_IRQ_event+0x9c (handle_level_irq+0x64)
 |   #end     0x80000001  6380    5.750  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
     #func                6386    7.000  note_interrupt+0x14 (handle_level_irq+0x84)
     #func                6393    6.250  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
     #func                6399    5.250  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                6404    5.500  ipipe_check_context+0x10 (irq_exit+0x18)
     #func                6410    5.750  __do_softirq+0x10 (irq_exit+0x50)
     #func                6416    5.750  ipipe_check_context+0x10 (__do_softirq+0x20)
     #func                6421    6.250  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
 |   #begin   0x80000000  6428    6.750  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
 |   +end     0x80000000  6434    6.250  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
     +func                6441    6.250  run_timer_softirq+0x14 (__do_softirq+0x60)
     +func                6447    6.500  hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
     +func                6453    9.250  current_kernel_time+0x14 (hrtimer_run_queues+0x24)
 |   +begin   0x80000001  6463    6.750  hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
 |   #end     0x80000001  6469    6.000  hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
     #func                6475    6.250  __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
 |   #begin   0x80000000  6482    6.500  __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
 |   +end     0x80000000  6488    8.000  __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
 |   +begin   0x80000001  6496    6.750  run_timer_softirq+0x68 (__do_softirq+0x60)
 |   #end     0x80000001  6503    6.250  run_timer_softirq+0x7c (__do_softirq+0x60)
     #func                6509    6.250  __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
 |   #begin   0x80000000  6515    6.750  __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
 |   +end     0x80000000  6522    7.000  __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
 |   +begin   0x80000001  6529    6.250  __do_softirq+0xa8 (irq_exit+0x50)
 |   #end     0x80000001  6535    5.250  __do_softirq+0xbc (irq_exit+0x50)
     #func                6541    6.000  _local_bh_enable+0x10 (__do_softirq+0xfc)
     #func                6547    7.750  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
 |   #begin   0x80000000  6554    8.250  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff  6563    5.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func                6568    1.750  __ipipe_unstall_root+0x10 (default_idle+0x94)
 |   +begin   0x80000000  6570    2.000  __ipipe_unstall_root+0x30 (default_idle+0x94)
 |   +end     0x80000000  6572    1.750  __ipipe_unstall_root+0x68 (default_idle+0x94)
     +func                6574    1.750  default_idle+0x10 (cpu_idle+0x3c)
 |   +begin   0x80000001  6576    1.750  default_idle+0x54 (cpu_idle+0x3c)
 |   #end     0x80000001  6577    1.750  default_idle+0x68 (cpu_idle+0x3c)
     #func                6579    1.750  __ipipe_unstall_root+0x10 (default_idle+0x84)
 |   #begin   0x80000000  6581    1.750  __ipipe_unstall_root+0x30 (default_idle+0x84)
 |   +end     0x80000000  6583    1.750  __ipipe_unstall_root+0x68 (default_idle+0x84)
     +end     0x8000000e  6584   79.500  default_idle+0x8c (cpu_idle+0x3c)
 |   +func                6664    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  6670    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                6676    5.500  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func                6682    6.000  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                6688    5.500  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func                6693    5.500  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func                6699    6.250  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func                6705    5.750  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func                6711    5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func                6716    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                6723    7.000  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                6730    8.750  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func                6739   15.000  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func                6754    7.250  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func                6761    5.500  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func                6766    6.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func                6773    9.000  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func                6782    6.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                6788    8.750  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  6797    6.250  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
 |   #func                6803    6.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  6809    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                6815    5.500  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func                6820   12.250  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func                6833    5.500  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func                6838    5.500  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                6844    5.750  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func                6849    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                6856    6.500  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                6862    7.000  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  #*func                6869    8.500  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  #*func                6878    5.750  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func                6884    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func                6892    7.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                6899    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff  6906    7.000  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func                6913    5.250  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                6918    5.500  irq_enter+0x10 (__exception_text_start+0x38)
     #func                6924    0.000  ipipe_check_context+0x10 (irq_enter+0x18)

[-- Attachment #3: frozen-eth --]
[-- Type: application/octet-stream, Size: 99058 bytes --]

I-pipe frozen back-tracing service on 2.6.24.3/ipipe-1.9-00
------------------------------------------------------------
CPU: 0, Freeze: 4980314000 cycles, Trace Points: 100 (+1000)
Calibrated minimum trace-point overhead: 1.500 us

 +----- Hard IRQs ('|': locked)
 |+---- <unused>
 ||+--- <unused>
 |||+-- Xenomai
 ||||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||||                        +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||||                        |        +- NMI noise ('N')
 |||||                        |        |
      Type    User Val.   Time    Delay  Function (Parent)
:|   #begin   0x80000001  -662+   7.500  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
:|   #end     0x80000001  -655+   6.500  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
:    #func                -648+   5.250  update_process_times+0x10 (tick_periodic+0x98)
:    #func                -643+   5.500  account_process_tick+0x10 (update_process_times+0x2c)
:    #func                -637+   6.750  account_system_time+0x10 (account_process_tick+0x40)
:    #func                -631+   5.500  account_system_time_scaled+0x10 (account_process_tick+0x4c)
:    #func                -625+   5.250  run_local_timers+0x10 (update_process_times+0x30)
:    #func                -620+   6.500  raise_softirq+0x10 (run_local_timers+0x18)
:|   #begin   0x80000001  -613+   7.500  raise_softirq+0x44 (run_local_timers+0x18)
:|   #end     0x80000001  -606+   5.750  raise_softirq+0x58 (run_local_timers+0x18)
:    #func                -600+   6.500  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
:|   #begin   0x80000001  -594+   7.500  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
:|   #end     0x80000001  -586+   5.750  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
:    #func                -580+   5.500  rcu_pending+0x10 (update_process_times+0x38)
:    #func                -575+   6.000  __rcu_pending+0x10 (rcu_pending+0x1c)
:    #func                -569+   6.250  __rcu_pending+0x10 (rcu_pending+0x34)
:    #func                -563+   5.500  scheduler_tick+0x10 (update_process_times+0x50)
:    #func                -557+   5.500  __update_rq_clock+0x14 (scheduler_tick+0x38)
:    #func                -552+   8.500  sched_clock+0x10 (__update_rq_clock+0x28)
:    #func                -543+   6.500  run_posix_cpu_timers+0x14 (update_process_times+0x58)
:    #func                -537+   9.750  profile_tick+0x10 (tick_periodic+0xa0)
:|   #begin   0x80000001  -527+   8.000  handle_IRQ_event+0x9c (handle_level_irq+0x64)
:|   #end     0x80000001  -519+   5.500  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
:    #func                -513+   7.250  note_interrupt+0x14 (handle_level_irq+0x84)
:    #func                -506+   6.000  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
:    #func                -500+   5.500  irq_exit+0x10 (__exception_text_start+0x4c)
:    #func                -495+   5.500  ipipe_check_context+0x10 (irq_exit+0x18)
:    #func                -489+   5.750  __do_softirq+0x10 (irq_exit+0x50)
:    #func                -483+   6.000  ipipe_check_context+0x10 (__do_softirq+0x20)
:    #func                -477+   6.500  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
:|   #begin   0x80000000  -471+   6.500  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
:|   +func                -464+   7.250  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
:|   +end     0x80000000  -457+   6.000  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
:    +func                -451+   6.000  run_timer_softirq+0x14 (__do_softirq+0x60)
:    +func                -445+   5.750  hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
:    +func                -439+  10.000  current_kernel_time+0x14 (hrtimer_run_queues+0x24)
:|   +begin   0x80000001  -429+   7.500  hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
:|   #end     0x80000001  -422+   6.500  hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
:    #func                -415+   6.750  __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
:|   #begin   0x80000000  -409+   6.500  __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
:|   +func                -402+   7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
:|   +end     0x80000000  -395+   7.500  __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
:|   +begin   0x80000001  -388+   7.250  run_timer_softirq+0x68 (__do_softirq+0x60)
:|   #end     0x80000001  -380+   7.750  run_timer_softirq+0x7c (__do_softirq+0x60)
:    #func                -373+   6.500  __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
:|   #begin   0x80000000  -366+   6.500  __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
:|   +func                -360+   6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
:|   +end     0x80000000  -353+   7.000  __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
:|   +func                -346+   7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
:|   +begin   0xffffffff  -339+   6.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
:|   +func                -332+   5.500  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
:|   +func                -327+   6.250  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
:|   +func                -321+   6.000  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
:|   +func                -315+   5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
:|   +func                -309+   6.000  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
:|   +func                -303+   5.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
:|   +func                -297+   6.000  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
:|   +func                -291+   6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
:|  # func                -285+   6.500  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
:|  # func                -278+   9.750  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
:|  # func                -269!  14.250  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
:|  # func                -254+   7.500  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
:|  # func                -247+   5.250  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
:|  # func                -242+   6.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
:|  # func                -235+   9.250  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
:|   +func                -226+   6.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
:|   +func                -220+   7.250  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
:|   +end     0xffffffff  -213+   8.000  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
:|   +begin   0x80000001  -205+   7.750  __do_softirq+0xa8 (irq_exit+0x50)
:|   #end     0x80000001  -197+   5.250  __do_softirq+0xbc (irq_exit+0x50)
:    #func                -192+   5.750  _local_bh_enable+0x10 (__do_softirq+0xfc)
:    #func                -186+   7.750  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
:|   #begin   0x80000000  -178+   8.750  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
:|   #end     0x80000000  -170+   5.500  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
:    #func                -164+   5.500  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
:    #func                -159+   5.500  irq_enter+0x10 (__exception_text_start+0x38)
:    #func                -153+   6.500  ipipe_check_context+0x10 (irq_enter+0x18)
:    #func                -147+   6.250  handle_level_irq+0x10 (__exception_text_start+0x48)
:    #func                -140+   6.000  handle_IRQ_event+0x10 (handle_level_irq+0x64)
:    #func                -134+   8.750  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
:|   #begin   0x80000001  -126+   7.500  handle_IRQ_event+0x9c (handle_level_irq+0x64)
:|   #end     0x80000001  -118+   5.500  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
:    #func                -113+   6.750  note_interrupt+0x14 (handle_level_irq+0x84)
:    #func                -106+   6.000  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
:    #func                -100+   5.750  irq_exit+0x10 (__exception_text_start+0x4c)
:    #func                 -94+   7.250  ipipe_check_context+0x10 (irq_exit+0x18)
:|   #begin   0x80000000   -87+   9.000  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
:|   +func                 -78+   5.750  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
:|   +func                 -72+   6.000  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
:|   +func                 -66+   5.500  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
:|   +func                 -61+   6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
:|  # func                 -54+   6.500  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
:|  # func                 -48+   7.750  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
:|  # func                 -40+   6.500  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
:|  # func                 -34+   5.500  xnarch_tsc_to_ns+0x10 (do_upg+0x8c [rt_bus_driver])
:|  # func                 -28+   5.500  ipipe_trace_frozen_reset+0x10 (do_upg+0x94 [rt_bus_driver])
:|  # func                 -23+   5.500  __ipipe_global_path_lock+0x10 (ipipe_trace_frozen_reset+0x14)
:|  # func                 -17!  10.750  __ipipe_spin_lock_irqsave+0x10 (__ipipe_global_path_lock+0x18)
:|  # func                  -6+   6.750  __ipipe_spin_unlock_irqcomplete+0x10 (__ipipe_global_path_unlock+0x64)
<|  # freeze  0x00000001     0    7.250  do_upg+0x9c [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  # func                   7    5.500  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  # func                  12    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   +func                  21   13.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                  34    7.000  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func                  41    6.500  __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
 |   +func                  48    5.750  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
 |   +func                  53    5.750  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func                  59    6.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                  66    8.250  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000    74    5.500  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func                  79    5.250  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                  85    5.250  irq_enter+0x10 (__exception_text_start+0x38)
     #func                  90    6.500  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                  96    6.250  handle_simple_irq+0x10 (__exception_text_start+0x48)
     #func                 103    5.500  handle_IRQ_event+0x10 (handle_simple_irq+0x64)
     #func                 108    6.500  __ipipe_unstall_root+0x10 (handle_IRQ_event+0x28)
 |   #begin   0x80000000   115    6.750  __ipipe_unstall_root+0x30 (handle_IRQ_event+0x28)
 |   +end     0x80000000   121    5.750  __ipipe_unstall_root+0x68 (handle_IRQ_event+0x28)
     +func                 127    9.750  dm9000_interrupt+0x14 (handle_IRQ_event+0x40)
 |   +begin   0x80000001   137    6.500  handle_IRQ_event+0x9c (handle_simple_irq+0x64)
 |   #end     0x80000001   143    6.500  handle_IRQ_event+0xb0 (handle_simple_irq+0x64)
     #func                 150    6.500  note_interrupt+0x14 (handle_simple_irq+0x84)
     #func                 156    5.500  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                 162    7.750  ipipe_check_context+0x10 (irq_exit+0x18)
 |   #begin   0x80000000   170    8.000  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   +func                 178    5.750  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func                 183    5.250  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                 189    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func                 195    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                 201    6.250  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                 207    6.750  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  # func                 214    8.000  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  # func                 222    5.750  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  # func                 228    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   +func                 236    7.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                 244    7.750  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff   251    5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func                 257    1.750  __ipipe_unstall_root+0x10 (default_idle+0x94)
 |   +begin   0x80000000   259    1.750  __ipipe_unstall_root+0x30 (default_idle+0x94)
 |   +end     0x80000000   260    2.000  __ipipe_unstall_root+0x68 (default_idle+0x94)
     +func                 262    2.250  default_idle+0x10 (cpu_idle+0x3c)
 |   +begin   0x80000001   265    1.750  default_idle+0x54 (cpu_idle+0x3c)
 |   #end     0x80000001   266    1.500  default_idle+0x68 (cpu_idle+0x3c)
     #func                 268    1.750  __ipipe_unstall_root+0x10 (default_idle+0x84)
 |   #begin   0x80000000   270    1.750  __ipipe_unstall_root+0x30 (default_idle+0x84)
 |   +end     0x80000000   271    1.750  __ipipe_unstall_root+0x68 (default_idle+0x84)
     +end     0x8000000e   273  107.750  default_idle+0x8c (cpu_idle+0x3c)
 |   +func                 381    6.750  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff   388    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                 393    6.000  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func                 399   12.250  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func                 411    5.750  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func                 417    5.500  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                 423    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func                 429    6.750  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                 435    6.500  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                 442    7.500  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  # func                 449    7.500  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  # func                 457    5.250  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  # func                 462    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   +func                 470    7.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                 478    7.500  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff   485    5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +func                 491    6.750  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff   498    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                 503    5.750  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func                 509    5.500  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                 515    5.750  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func                 520    6.000  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func                 526    6.250  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func                 533    5.250  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func                 538    6.000  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func                 544    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                 550    6.250  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                 556    8.500  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func                 565   15.000  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func                 580    6.750  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func                 587    5.250  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func                 592    6.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func                 598    9.500  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func                 608    6.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                 614    8.500  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000   623    5.250  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func                 628    5.750  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                 634    5.250  irq_enter+0x10 (__exception_text_start+0x38)
     #func                 639    6.000  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                 645    5.750  handle_level_irq+0x10 (__exception_text_start+0x48)
     #func                 651    5.750  handle_IRQ_event+0x10 (handle_level_irq+0x64)
     #func                 656    6.500  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
     #func                 663    5.500  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                 668    6.000  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                 674    6.000  do_timer+0x10 (tick_periodic+0x70)
     #func                 680    9.750  update_wall_time+0x14 (do_timer+0x30)
     #func                 690    7.250  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                 697    9.000  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                 706    7.000  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001   713    6.500  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001   720    5.750  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                 726    6.500  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001   732    6.750  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001   739    7.000  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                 746    5.250  update_process_times+0x10 (tick_periodic+0x98)
     #func                 751    5.250  account_process_tick+0x10 (update_process_times+0x2c)
     #func                 756    8.500  account_system_time+0x10 (account_process_tick+0x40)
     #func                 765    6.000  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                 771    5.500  run_local_timers+0x10 (update_process_times+0x30)
     #func                 776    6.500  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001   783    6.500  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001   789    6.250  raise_softirq+0x58 (run_local_timers+0x18)
     #func                 796    6.500  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001   802    6.250  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001   808    5.750  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                 814    5.750  rcu_pending+0x10 (update_process_times+0x38)
     #func                 820    6.250  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                 826    6.500  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                 833    5.750  scheduler_tick+0x10 (update_process_times+0x50)
     #func                 838    6.500  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                 845    9.000  sched_clock+0x10 (__update_rq_clock+0x28)
     #func                 854    6.500  run_posix_cpu_timers+0x14 (update_process_times+0x58)
     #func                 860    7.500  profile_tick+0x10 (tick_periodic+0xa0)
     #func                 868    5.750  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                 874    6.000  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                 880    5.750  do_timer+0x10 (tick_periodic+0x70)
     #func                 885   11.500  update_wall_time+0x14 (do_timer+0x30)
     #func                 897    7.000  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001   904    6.250  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001   910    5.500  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                 916    7.000  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001   923    6.500  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001   929    6.250  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                 935    5.250  update_process_times+0x10 (tick_periodic+0x98)
     #func                 941    6.000  account_process_tick+0x10 (update_process_times+0x2c)
     #func                 947    6.750  account_system_time+0x10 (account_process_tick+0x40)
     #func                 953    5.750  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                 959    5.250  run_local_timers+0x10 (update_process_times+0x30)
     #func                 964    6.500  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001   971    6.750  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001   978    6.000  raise_softirq+0x58 (run_local_timers+0x18)
     #func                 984    6.250  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001   990    6.750  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001   997    5.750  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                1002    5.500  rcu_pending+0x10 (update_process_times+0x38)
     #func                1008    6.500  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                1014    6.000  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                1020    5.750  scheduler_tick+0x10 (update_process_times+0x50)
     #func                1026    5.500  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                1032    8.250  sched_clock+0x10 (__update_rq_clock+0x28)
     #func                1040    6.500  run_posix_cpu_timers+0x14 (update_process_times+0x58)
     #func                1046    9.750  profile_tick+0x10 (tick_periodic+0xa0)
 |   #begin   0x80000001  1056    6.500  handle_IRQ_event+0x9c (handle_level_irq+0x64)
 |   #end     0x80000001  1063    5.750  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
     #func                1068    6.750  note_interrupt+0x14 (handle_level_irq+0x84)
     #func                1075    6.000  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
     #func                1081    5.750  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                1087    5.750  ipipe_check_context+0x10 (irq_exit+0x18)
     #func                1093    5.500  __do_softirq+0x10 (irq_exit+0x50)
     #func                1098    6.000  ipipe_check_context+0x10 (__do_softirq+0x20)
     #func                1104    6.250  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
 |   #begin   0x80000000  1110    6.750  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
 |   +end     0x80000000  1117    6.000  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
     +func                1123    5.750  run_timer_softirq+0x14 (__do_softirq+0x60)
     +func                1129    5.500  hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
     +func                1134    9.500  current_kernel_time+0x14 (hrtimer_run_queues+0x24)
 |   +begin   0x80000001  1144    6.250  hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
 |   #end     0x80000001  1150    6.750  hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
 |   #func                1157    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  1164    6.000  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                1170    6.250  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func                1176   12.250  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func                1188    6.250  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func                1195    5.500  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                1200    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func                1206    7.000  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                1213    6.750  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                1220    7.250  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  #*func                1227    8.000  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  #*func                1235    6.000  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func                1241    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func                1249    7.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                1256    7.000  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff  1263    5.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   #func                1269    6.750  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  1276    5.250  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                1281    6.000  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   #func                1287    6.000  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                1293    5.500  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   #func                1299    5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   #func                1304    6.500  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   #func                1311    5.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   #func                1316    5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   #func                1322    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                1328    6.500  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                1335    9.000  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  #*func                1344   14.250  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  #*func                1358    6.750  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  #*func                1365    5.500  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  #*func                1370    6.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  #*func                1377    9.000  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   #func                1386    7.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #end     0xffffffff  1393    6.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func                1400    6.750  __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
 |   #begin   0x80000000  1407    5.250  __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
 |   +func                1412    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  1419    7.000  __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
 |   +begin   0x80000001  1426    6.750  run_timer_softirq+0x68 (__do_softirq+0x60)
 |   #end     0x80000001  1433    7.000  run_timer_softirq+0x7c (__do_softirq+0x60)
     #func                1440    6.250  __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
 |   #begin   0x80000000  1446    5.750  __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
 |   +func                1452    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  1459    7.000  __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
 |   +begin   0x80000001  1466    6.250  __do_softirq+0xa8 (irq_exit+0x50)
 |   #end     0x80000001  1472    6.000  __do_softirq+0xbc (irq_exit+0x50)
     #func                1478    6.500  _local_bh_enable+0x10 (__do_softirq+0xfc)
     #func                1484    8.000  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
 |   #begin   0x80000000  1492    7.750  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  1500    5.750  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func                1506    5.500  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                1511    5.500  irq_enter+0x10 (__exception_text_start+0x38)
     #func                1517    5.750  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                1523    5.750  handle_level_irq+0x10 (__exception_text_start+0x48)
     #func                1528    6.250  handle_IRQ_event+0x10 (handle_level_irq+0x64)
     #func                1535    7.500  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
 |   #begin   0x80000001  1542    6.250  handle_IRQ_event+0x9c (handle_level_irq+0x64)
 |   #end     0x80000001  1548    6.000  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
     #func                1554    7.250  note_interrupt+0x14 (handle_level_irq+0x84)
     #func                1562    5.750  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
     #func                1567    5.500  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                1573    7.500  ipipe_check_context+0x10 (irq_exit+0x18)
 |   #begin   0x80000000  1580    8.500  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff  1589    5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func                1594    1.750  __ipipe_unstall_root+0x10 (default_idle+0x94)
 |   +begin   0x80000000  1596    2.250  __ipipe_unstall_root+0x30 (default_idle+0x94)
 |   +end     0x80000000  1598    2.000  __ipipe_unstall_root+0x68 (default_idle+0x94)
     +func                1600    2.000  default_idle+0x10 (cpu_idle+0x3c)
 |   +begin   0x80000001  1602    2.000  default_idle+0x54 (cpu_idle+0x3c)
 |   #end     0x80000001  1604    2.000  default_idle+0x68 (cpu_idle+0x3c)
     #func                1606    1.750  __ipipe_unstall_root+0x10 (default_idle+0x84)
 |   #begin   0x80000000  1608    1.750  __ipipe_unstall_root+0x30 (default_idle+0x84)
 |   +end     0x80000000  1610    1.750  __ipipe_unstall_root+0x68 (default_idle+0x84)
     +end     0x8000000e  1612  322.000  default_idle+0x8c (cpu_idle+0x3c)
 |   +func                1934    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  1941    5.250  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                1946    6.000  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func                1952   12.000  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func                1964    6.000  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func                1970    5.250  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                1975    5.750  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func                1981    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                1987    6.500  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                1994    7.500  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  # func                2001    7.750  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  # func                2009    5.750  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  # func                2015    8.500  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   +func                2023    7.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                2031    6.750  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff  2038    5.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +func                2043    6.750  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  2050    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                2056    5.750  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func                2061    5.500  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                2067    5.750  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func                2073    5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func                2078    6.500  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func                2085    5.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func                2090    6.000  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func                2096    6.000  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                2102    6.250  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                2109    8.500  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func                2117   14.750  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func                2132    7.250  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func                2139    5.500  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func                2145    6.000  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func                2151    9.000  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func                2160    6.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                2166    8.500  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  2174    5.500  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func                2180    6.500  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                2186    5.500  irq_enter+0x10 (__exception_text_start+0x38)
     #func                2192    6.250  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                2198    6.250  handle_level_irq+0x10 (__exception_text_start+0x48)
     #func                2204    5.750  handle_IRQ_event+0x10 (handle_level_irq+0x64)
     #func                2210    6.250  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
     #func                2216    5.500  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                2222    6.750  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                2229    6.250  do_timer+0x10 (tick_periodic+0x70)
     #func                2235    9.750  update_wall_time+0x14 (do_timer+0x30)
     #func                2245    7.750  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                2252    9.500  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                2262    7.000  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001  2269    6.500  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001  2275    5.750  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                2281    6.750  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001  2288    6.500  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001  2294    7.000  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                2301    5.250  update_process_times+0x10 (tick_periodic+0x98)
     #func                2307    5.750  account_process_tick+0x10 (update_process_times+0x2c)
     #func                2312    7.750  account_system_time+0x10 (account_process_tick+0x40)
     #func                2320    5.750  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                2326    5.500  run_local_timers+0x10 (update_process_times+0x30)
     #func                2331    7.000  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001  2338    7.000  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001  2345    6.250  raise_softirq+0x58 (run_local_timers+0x18)
     #func                2352    6.250  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001  2358    6.750  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001  2365    5.750  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                2370    5.500  rcu_pending+0x10 (update_process_times+0x38)
     #func                2376    6.500  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                2382    6.500  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                2389    6.250  scheduler_tick+0x10 (update_process_times+0x50)
     #func                2395    6.250  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                2401    9.000  sched_clock+0x10 (__update_rq_clock+0x28)
     #func                2410    7.000  run_posix_cpu_timers+0x14 (update_process_times+0x58)
     #func                2417    7.500  profile_tick+0x10 (tick_periodic+0xa0)
     #func                2425    5.500  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                2430    6.000  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                2436    5.500  do_timer+0x10 (tick_periodic+0x70)
     #func                2442   11.500  update_wall_time+0x14 (do_timer+0x30)
     #func                2453    6.500  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001  2460    6.500  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001  2466    6.000  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                2472    7.000  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001  2479    6.250  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001  2486    6.250  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                2492    5.750  update_process_times+0x10 (tick_periodic+0x98)
     #func                2498    5.500  account_process_tick+0x10 (update_process_times+0x2c)
     #func                2503    6.500  account_system_time+0x10 (account_process_tick+0x40)
     #func                2510    5.500  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                2515    5.250  run_local_timers+0x10 (update_process_times+0x30)
     #func                2520    6.750  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001  2527    6.250  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001  2533    6.000  raise_softirq+0x58 (run_local_timers+0x18)
     #func                2539    6.500  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001  2546    6.500  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001  2552    5.500  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                2558    5.750  rcu_pending+0x10 (update_process_times+0x38)
     #func                2564    6.250  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                2570    6.250  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                2576    5.500  scheduler_tick+0x10 (update_process_times+0x50)
     #func                2582    5.750  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                2587    9.000  sched_clock+0x10 (__update_rq_clock+0x28)
     #func                2596    6.500  run_posix_cpu_timers+0x14 (update_process_times+0x58)
     #func                2603    9.250  profile_tick+0x10 (tick_periodic+0xa0)
 |   #begin   0x80000001  2612    6.500  handle_IRQ_event+0x9c (handle_level_irq+0x64)
 |   #end     0x80000001  2619    6.000  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
     #func                2625    6.750  note_interrupt+0x14 (handle_level_irq+0x84)
     #func                2631    5.500  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
     #func                2637    5.500  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                2642    6.000  ipipe_check_context+0x10 (irq_exit+0x18)
     #func                2648    5.750  __do_softirq+0x10 (irq_exit+0x50)
     #func                2654    5.500  ipipe_check_context+0x10 (__do_softirq+0x20)
     #func                2660    6.250  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
 |   #begin   0x80000000  2666    6.750  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
 |   +end     0x80000000  2673    6.500  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
     +func                2679    5.250  run_timer_softirq+0x14 (__do_softirq+0x60)
     +func                2684    5.500  hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
     +func                2690    8.500  current_kernel_time+0x14 (hrtimer_run_queues+0x24)
 |   +begin   0x80000001  2698    6.750  hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
 |   #end     0x80000001  2705    6.000  hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
 |   #func                2711    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  2718    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                2723    6.250  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func                2730   12.000  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func                2742    5.750  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func                2747    5.750  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                2753    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func                2759    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                2766    6.750  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                2772    6.750  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  #*func                2779    8.250  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  #*func                2787    5.750  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func                2793    8.000  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func                2801    7.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                2809    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff  2816    5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   #func                2821    6.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  2828    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                2833    5.750  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   #func                2839    6.000  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                2845    5.500  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   #func                2851    5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   #func                2856    6.500  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   #func                2863    5.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   #func                2868    5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   #func                2874    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                2881    6.500  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                2887    8.500  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  #*func                2896   14.250  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  #*func                2910    7.250  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  #*func                2917    5.750  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  #*func                2923    5.750  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  #*func                2929    9.250  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   #func                2938    7.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #end     0xffffffff  2946    7.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func                2953    6.500  __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
 |   #begin   0x80000000  2960    5.250  __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
 |   +func                2965    7.250  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  2972    7.750  __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
 |   +begin   0x80000001  2980    6.250  run_timer_softirq+0x68 (__do_softirq+0x60)
 |   #end     0x80000001  2986    6.750  run_timer_softirq+0x7c (__do_softirq+0x60)
     #func                2993    6.500  __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
 |   #begin   0x80000000  2999    5.750  __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
 |   +func                3005    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  3012    6.750  __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
 |   +begin   0x80000001  3019    6.750  __do_softirq+0xa8 (irq_exit+0x50)
 |   #end     0x80000001  3025    5.750  __do_softirq+0xbc (irq_exit+0x50)
     #func                3031    6.000  _local_bh_enable+0x10 (__do_softirq+0xfc)
     #func                3037    7.750  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
 |   #begin   0x80000000  3045    8.000  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  3053    5.750  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func                3059    6.500  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                3065    5.500  irq_enter+0x10 (__exception_text_start+0x38)
     #func                3071    5.750  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                3076    7.000  handle_level_irq+0x10 (__exception_text_start+0x48)
     #func                3083    5.500  handle_IRQ_event+0x10 (handle_level_irq+0x64)
     #func                3089    5.750  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
     #func                3095    5.500  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                3100    6.250  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                3106    5.500  do_timer+0x10 (tick_periodic+0x70)
     #func                3112    9.000  update_wall_time+0x14 (do_timer+0x30)
     #func                3121    9.250  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                3130    7.000  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001  3137    6.250  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001  3143    5.500  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                3149    6.750  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001  3156    6.500  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001  3162    6.500  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                3169    5.250  update_process_times+0x10 (tick_periodic+0x98)
     #func                3174    5.750  account_process_tick+0x10 (update_process_times+0x2c)
     #func                3180    7.250  account_system_time+0x10 (account_process_tick+0x40)
     #func                3187    5.500  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                3192    5.250  run_local_timers+0x10 (update_process_times+0x30)
     #func                3198    6.500  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001  3204    6.750  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001  3211    5.750  raise_softirq+0x58 (run_local_timers+0x18)
     #func                3217    6.250  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001  3223    6.500  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001  3229    5.750  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                3235    5.500  rcu_pending+0x10 (update_process_times+0x38)
     #func                3241    6.250  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                3247    6.250  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                3253    5.500  scheduler_tick+0x10 (update_process_times+0x50)
     #func                3259    5.500  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                3264    8.500  sched_clock+0x10 (__update_rq_clock+0x28)
     #func                3273    7.000  run_posix_cpu_timers+0x14 (update_process_times+0x58)
     #func                3280    9.000  profile_tick+0x10 (tick_periodic+0xa0)
 |   #begin   0x80000001  3289    6.500  handle_IRQ_event+0x9c (handle_level_irq+0x64)
 |   #end     0x80000001  3295    6.250  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
     #func                3301    6.500  note_interrupt+0x14 (handle_level_irq+0x84)
     #func                3308    6.000  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
     #func                3314    5.750  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                3320    5.750  ipipe_check_context+0x10 (irq_exit+0x18)
     #func                3325    5.250  __do_softirq+0x10 (irq_exit+0x50)
     #func                3331    5.750  ipipe_check_context+0x10 (__do_softirq+0x20)
     #func                3336    6.500  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
 |   #begin   0x80000000  3343    6.500  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
 |   +end     0x80000000  3349    6.000  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
     +func                3355    5.750  run_timer_softirq+0x14 (__do_softirq+0x60)
     +func                3361    6.000  hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
     +func                3367    9.000  current_kernel_time+0x14 (hrtimer_run_queues+0x24)
 |   +begin   0x80000001  3376    6.750  hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
 |   #end     0x80000001  3383    5.750  hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
     #func                3389    6.250  __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
 |   #begin   0x80000000  3395    6.500  __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
 |   +end     0x80000000  3401    7.500  __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
 |   +begin   0x80000001  3409    6.500  run_timer_softirq+0x68 (__do_softirq+0x60)
 |   #end     0x80000001  3415    6.250  run_timer_softirq+0x7c (__do_softirq+0x60)
     #func                3422    6.500  __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
 |   #begin   0x80000000  3428    6.750  __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
 |   +end     0x80000000  3435    7.000  __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
 |   +begin   0x80000001  3442    6.500  __do_softirq+0xa8 (irq_exit+0x50)
 |   #end     0x80000001  3448    5.250  __do_softirq+0xbc (irq_exit+0x50)
     #func                3454    6.250  _local_bh_enable+0x10 (__do_softirq+0xfc)
     #func                3460    7.750  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
 |   #begin   0x80000000  3468    8.000  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff  3476    5.250  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func                3481    2.750  __ipipe_unstall_root+0x10 (default_idle+0x94)
 |   +func                3484    2.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  3486    2.000  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                3488    2.750  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func                3491    3.500  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func                3494    2.000  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func                3496    2.000  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                3498    2.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func                3500    3.000  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                3503    2.750  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                3506    3.750  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  # func                3510    4.500  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  # func                3514    2.250  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  # func                3516    3.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   +func                3520    3.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                3523    2.500  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff  3525    2.000  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +func                3527    2.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  3529    1.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                3531    2.250  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func                3533    2.000  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                3535    2.000  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func                3537    1.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func                3539    2.500  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func                3541    1.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func                3543    2.000  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func                3545    2.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                3547    2.000  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                3549    4.500  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func                3554    5.250  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func                3559    3.750  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func                3563    1.750  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func                3564    2.750  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func                3567    4.000  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func                3571    2.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                3574    3.750  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  3577    2.500  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func                3580    2.000  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                3582    1.750  irq_enter+0x10 (__exception_text_start+0x38)
     #func                3584    2.250  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                3586    2.250  handle_level_irq+0x10 (__exception_text_start+0x48)
     #func                3588    2.000  handle_IRQ_event+0x10 (handle_level_irq+0x64)
     #func                3590    3.750  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
 |   #begin   0x80000001  3594    1.750  handle_IRQ_event+0x9c (handle_level_irq+0x64)
 |   #end     0x80000001  3596    2.000  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
     #func                3598    2.750  note_interrupt+0x14 (handle_level_irq+0x84)
     #func                3600    2.000  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
     #func                3602    1.750  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                3604    2.500  ipipe_check_context+0x10 (irq_exit+0x18)
 |   #begin   0x80000000  3607    3.500  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff  3610    2.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +begin   0x80000000  3613    2.000  __ipipe_unstall_root+0x30 (default_idle+0x94)
 |   +end     0x80000000  3615    2.000  __ipipe_unstall_root+0x68 (default_idle+0x94)
     +func                3617    2.000  default_idle+0x10 (cpu_idle+0x3c)
 |   +begin   0x80000001  3619    1.750  default_idle+0x54 (cpu_idle+0x3c)
 |   #end     0x80000001  3621    1.500  default_idle+0x68 (cpu_idle+0x3c)
     #func                3622    1.750  __ipipe_unstall_root+0x10 (default_idle+0x84)
 |   #begin   0x80000000  3624    1.750  __ipipe_unstall_root+0x30 (default_idle+0x84)
 |   +end     0x80000000  3626    1.750  __ipipe_unstall_root+0x68 (default_idle+0x84)
     +end     0x8000000e  3627  633.500  default_idle+0x8c (cpu_idle+0x3c)
 |   +func                4261    7.250  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  4268    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                4274    5.750  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func                4280   11.750  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func                4291    5.750  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func                4297    5.750  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                4303    5.750  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func                4309    5.750  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                4314    6.750  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                4321    7.500  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  # func                4329    8.000  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  # func                4337    5.500  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  # func                4342    8.750  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   +func                4351    7.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                4359    7.000  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff  4366    5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +func                4371    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  4378    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                4384    5.500  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func                4389    5.250  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                4395    6.000  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func                4401    6.000  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func                4407    6.250  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func                4413    5.250  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func                4418    5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func                4424    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                4430    6.000  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                4436    8.500  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func                4445   14.250  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func                4459    7.750  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func                4467    5.750  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func                4472    6.000  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func                4478    9.250  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func                4488    6.500  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                4494    8.500  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  4503    5.500  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func                4508    5.500  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                4514    5.750  irq_enter+0x10 (__exception_text_start+0x38)
     #func                4519    6.500  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                4526    6.250  handle_level_irq+0x10 (__exception_text_start+0x48)
     #func                4532    6.000  handle_IRQ_event+0x10 (handle_level_irq+0x64)
     #func                4538    6.250  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
     #func                4544    5.250  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                4550    6.750  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                4556    7.000  do_timer+0x10 (tick_periodic+0x70)
     #func                4563    9.500  update_wall_time+0x14 (do_timer+0x30)
     #func                4573    7.500  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                4580    8.750  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                4589    6.500  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001  4596    6.750  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001  4602    5.750  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                4608    6.750  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001  4615    6.500  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001  4621    7.250  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                4629    5.250  update_process_times+0x10 (tick_periodic+0x98)
     #func                4634    5.500  account_process_tick+0x10 (update_process_times+0x2c)
     #func                4639    7.000  account_system_time+0x10 (account_process_tick+0x40)
     #func                4646    5.750  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                4652    5.500  run_local_timers+0x10 (update_process_times+0x30)
     #func                4658    6.250  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001  4664    6.750  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001  4671    5.750  raise_softirq+0x58 (run_local_timers+0x18)
     #func                4676    6.500  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001  4683    6.250  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001  4689    5.750  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                4695    5.750  rcu_pending+0x10 (update_process_times+0x38)
     #func                4701    7.250  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                4708    6.500  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                4714    6.250  scheduler_tick+0x10 (update_process_times+0x50)
     #func                4721    5.750  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                4726    8.500  sched_clock+0x10 (__update_rq_clock+0x28)
     #func                4735    6.500  run_posix_cpu_timers+0x14 (update_process_times+0x58)
     #func                4741    7.500  profile_tick+0x10 (tick_periodic+0xa0)
     #func                4749    5.500  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                4754    6.000  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                4760    5.500  do_timer+0x10 (tick_periodic+0x70)
     #func                4766   10.250  update_wall_time+0x14 (do_timer+0x30)
     #func                4776    6.500  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001  4783    6.500  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001  4789    5.750  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                4795    6.750  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001  4802    6.500  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001  4808    6.750  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                4815    5.500  update_process_times+0x10 (tick_periodic+0x98)
     #func                4820    5.500  account_process_tick+0x10 (update_process_times+0x2c)
     #func                4826    6.750  account_system_time+0x10 (account_process_tick+0x40)
     #func                4833    5.500  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                4838    5.250  run_local_timers+0x10 (update_process_times+0x30)
     #func                4843    6.750  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001  4850    6.500  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001  4857    5.750  raise_softirq+0x58 (run_local_timers+0x18)
     #func                4862    6.250  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001  4869    6.750  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001  4875    5.750  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                4881    5.500  rcu_pending+0x10 (update_process_times+0x38)
     #func                4887    6.250  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                4893    6.250  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                4899    5.750  scheduler_tick+0x10 (update_process_times+0x50)
     #func                4905    5.500  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                4910    8.000  sched_clock+0x10 (__update_rq_clock+0x28)
     #func                4918    6.500  run_posix_cpu_timers+0x14 (update_process_times+0x58)
     #func                4925    8.750  profile_tick+0x10 (tick_periodic+0xa0)
 |   #begin   0x80000001  4934    6.500  handle_IRQ_event+0x9c (handle_level_irq+0x64)
 |   #end     0x80000001  4940    5.500  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
     #func                4946    6.750  note_interrupt+0x14 (handle_level_irq+0x84)
     #func                4952    6.000  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
     #func                4958    5.750  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                4964    6.000  ipipe_check_context+0x10 (irq_exit+0x18)
     #func                4970    5.500  __do_softirq+0x10 (irq_exit+0x50)
     #func                4976    6.000  ipipe_check_context+0x10 (__do_softirq+0x20)
     #func                4982    6.250  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
 |   #begin   0x80000000  4988    6.750  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
 |   +end     0x80000000  4995    6.500  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
     +func                5001    6.750  run_timer_softirq+0x14 (__do_softirq+0x60)
     +func                5008    5.750  hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
     +func                5014    9.000  current_kernel_time+0x14 (hrtimer_run_queues+0x24)
 |   +begin   0x80000001  5023    6.500  hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
 |   #end     0x80000001  5029    8.000  hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
 |   #func                5037    7.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  5045    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                5050    6.000  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func                5056   11.750  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func                5068    6.000  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func                5074    5.500  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                5080    5.750  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func                5085    7.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                5093    7.500  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                5100    7.500  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  #*func                5108    8.500  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  #*func                5116    5.750  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func                5122    8.500  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func                5131    7.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                5138    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff  5145    5.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   #func                5151    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  5158    5.250  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                5163    6.000  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   #func                5169    6.000  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                5175    5.500  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   #func                5180    5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   #func                5186    6.250  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   #func                5192    5.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   #func                5198    5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   #func                5204    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                5210    6.750  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                5217    8.500  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  #*func                5225   13.000  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  #*func                5238    7.000  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  #*func                5245    5.750  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  #*func                5251    6.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  #*func                5257    9.000  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   #func                5266    8.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #end     0xffffffff  5274    5.250  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func                5280    6.500  __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
 |   #begin   0x80000000  5286    5.500  __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
 |   +func                5292    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  5299    8.500  __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
 |   +begin   0x80000001  5307    6.500  run_timer_softirq+0x68 (__do_softirq+0x60)
 |   #end     0x80000001  5314    7.250  run_timer_softirq+0x7c (__do_softirq+0x60)
     #func                5321    6.250  __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
 |   #begin   0x80000000  5327    5.750  __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
 |   +func                5333    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  5340    6.750  __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
 |   +begin   0x80000001  5347    6.500  __do_softirq+0xa8 (irq_exit+0x50)
 |   #end     0x80000001  5353    5.750  __do_softirq+0xbc (irq_exit+0x50)
     #func                5359    6.250  _local_bh_enable+0x10 (__do_softirq+0xfc)
     #func                5365    7.750  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
 |   #begin   0x80000000  5373    7.500  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  5380    5.750  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func                5386    5.750  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                5392    5.500  irq_enter+0x10 (__exception_text_start+0x38)
     #func                5397    6.000  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                5403    6.000  handle_level_irq+0x10 (__exception_text_start+0x48)
     #func                5409    5.750  handle_IRQ_event+0x10 (handle_level_irq+0x64)
     #func                5415    7.250  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
 |   #begin   0x80000001  5422    6.500  handle_IRQ_event+0x9c (handle_level_irq+0x64)
 |   #end     0x80000001  5429    5.750  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
     #func                5435    6.500  note_interrupt+0x14 (handle_level_irq+0x84)
     #func                5441    5.750  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
     #func                5447    5.500  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                5452    7.250  ipipe_check_context+0x10 (irq_exit+0x18)
 |   #begin   0x80000000  5460    8.750  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff  5468    5.250  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func                5474    1.500  __ipipe_unstall_root+0x10 (default_idle+0x94)
 |   +begin   0x80000000  5475    2.000  __ipipe_unstall_root+0x30 (default_idle+0x94)
 |   +end     0x80000000  5477    1.750  __ipipe_unstall_root+0x68 (default_idle+0x94)
     +func                5479    2.000  default_idle+0x10 (cpu_idle+0x3c)
 |   +begin   0x80000001  5481    1.750  default_idle+0x54 (cpu_idle+0x3c)
 |   #end     0x80000001  5483    1.500  default_idle+0x68 (cpu_idle+0x3c)
     #func                5484    1.750  __ipipe_unstall_root+0x10 (default_idle+0x84)
 |   #begin   0x80000000  5486    2.000  __ipipe_unstall_root+0x30 (default_idle+0x84)
 |   +end     0x80000000  5488    1.750  __ipipe_unstall_root+0x68 (default_idle+0x84)
     +end     0x8000000e  5490  323.500  default_idle+0x8c (cpu_idle+0x3c)
 |   +func                5813    6.750  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  5820    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                5825    5.250  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func                5831   12.000  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func                5843    6.000  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func                5849    5.250  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                5854    5.750  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func                5860    6.750  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                5866    6.750  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                5873    7.250  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  # func                5880    7.750  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  # func                5888    5.750  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  # func                5894    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   +func                5902    7.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                5910    7.250  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff  5917    5.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +func                5923    6.750  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  5930    5.750  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                5935    5.750  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func                5941    5.500  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                5947    5.500  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func                5952    5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func                5958    6.250  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func                5964    5.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func                5970    5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func                5975    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                5982    6.250  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                5988    8.750  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func                5997   14.250  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func                6011    7.250  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func                6018    5.250  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func                6023    6.250  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func                6030   10.000  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func                6040    6.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                6046    8.000  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  6054    5.750  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func                6060    5.750  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                6065    5.250  irq_enter+0x10 (__exception_text_start+0x38)
     #func                6071    6.000  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                6077    5.750  handle_level_irq+0x10 (__exception_text_start+0x48)
     #func                6082    5.500  handle_IRQ_event+0x10 (handle_level_irq+0x64)
     #func                6088    6.250  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
     #func                6094    5.750  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                6100    6.750  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                6107    6.250  do_timer+0x10 (tick_periodic+0x70)
     #func                6113    9.500  update_wall_time+0x14 (do_timer+0x30)
     #func                6122    7.500  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                6130    9.250  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                6139    7.000  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001  6146    6.250  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001  6152    5.500  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                6158    7.000  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001  6165    6.750  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001  6172    6.750  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                6178    5.250  update_process_times+0x10 (tick_periodic+0x98)
     #func                6184    5.500  account_process_tick+0x10 (update_process_times+0x2c)
     #func                6189    7.750  account_system_time+0x10 (account_process_tick+0x40)
     #func                6197    5.500  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                6202    5.250  run_local_timers+0x10 (update_process_times+0x30)
     #func                6208    7.000  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001  6215    6.500  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001  6221    6.250  raise_softirq+0x58 (run_local_timers+0x18)
     #func                6227    6.500  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001  6234    6.500  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001  6240    5.750  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                6246    5.500  rcu_pending+0x10 (update_process_times+0x38)
     #func                6252    6.500  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                6258    6.750  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                6265    5.750  scheduler_tick+0x10 (update_process_times+0x50)
     #func                6271    6.500  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                6277    8.750  sched_clock+0x10 (__update_rq_clock+0x28)
     #func                6286    6.750  run_posix_cpu_timers+0x14 (update_process_times+0x58)
     #func                6293    7.250  profile_tick+0x10 (tick_periodic+0xa0)
     #func                6300    5.500  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                6305    6.000  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                6311    5.750  do_timer+0x10 (tick_periodic+0x70)
     #func                6317    9.750  update_wall_time+0x14 (do_timer+0x30)
     #func                6327    6.750  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001  6334    6.750  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001  6340    5.750  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                6346    7.000  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001  6353    6.500  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001  6360    6.250  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                6366    6.250  update_process_times+0x10 (tick_periodic+0x98)
     #func                6372    5.750  account_process_tick+0x10 (update_process_times+0x2c)
     #func                6378    7.000  account_system_time+0x10 (account_process_tick+0x40)
     #func                6385    5.750  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                6391    5.750  run_local_timers+0x10 (update_process_times+0x30)
     #func                6396    6.500  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001  6403    6.500  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001  6409    5.500  raise_softirq+0x58 (run_local_timers+0x18)
     #func                6415    7.000  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001  6422    6.500  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001  6428    5.750  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                6434    5.250  rcu_pending+0x10 (update_process_times+0x38)
     #func                6439    6.500  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                6446    6.000  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                6452    5.500  scheduler_tick+0x10 (update_process_times+0x50)
     #func                6457    5.250  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                6463    8.500  sched_clock+0x10 (__update_rq_clock+0x28)
     #func                6471    6.500  run_posix_cpu_timers+0x14 (update_process_times+0x58)
     #func                6478    9.750  profile_tick+0x10 (tick_periodic+0xa0)
 |   #begin   0x80000001  6487    6.500  handle_IRQ_event+0x9c (handle_level_irq+0x64)
 |   #end     0x80000001  6494    6.000  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
     #func                6500    6.750  note_interrupt+0x14 (handle_level_irq+0x84)
     #func                6507    6.000  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
     #func                6513    5.250  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                6518    6.250  ipipe_check_context+0x10 (irq_exit+0x18)
     #func                6524    5.750  __do_softirq+0x10 (irq_exit+0x50)
     #func                6530    5.750  ipipe_check_context+0x10 (__do_softirq+0x20)
     #func                6536    6.250  __ipipe_unstall_root+0x10 (__do_softirq+0x48)
 |   #begin   0x80000000  6542    6.750  __ipipe_unstall_root+0x30 (__do_softirq+0x48)
 |   +end     0x80000000  6549    6.000  __ipipe_unstall_root+0x68 (__do_softirq+0x48)
     +func                6555    6.500  run_timer_softirq+0x14 (__do_softirq+0x60)
     +func                6561    5.750  hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
     +func                6567   10.000  current_kernel_time+0x14 (hrtimer_run_queues+0x24)
 |   +begin   0x80000001  6577    6.500  hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
 |   #end     0x80000001  6583    6.500  hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
 |   #func                6590    6.750  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  6597    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                6602    6.250  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   #func                6608   12.250  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   #func                6621    6.000  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   #func                6627    6.000  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                6633    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   #func                6639    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                6645    7.000  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                6652    7.500  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  #*func                6659    8.000  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  #*func                6667    5.500  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  #*func                6673    8.250  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   #func                6681    7.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #func                6688    7.000  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   #end     0xffffffff  6695    5.500  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   #func                6701    6.500  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   #begin   0xffffffff  6707    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   #func                6713    5.750  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   #func                6719    5.750  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   #func                6724    5.500  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   #func                6730    6.000  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   #func                6736    6.500  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   #func                6742    5.250  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   #func                6748    5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   #func                6753    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  #*func                6760    6.500  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  #*func                6766    8.250  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  #*func                6774   14.250  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  #*func                6789    7.500  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  #*func                6796    5.500  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  #*func                6802    6.000  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  #*func                6808    9.250  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   #func                6817    8.000  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   #end     0xffffffff  6825    7.000  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     #func                6832    6.500  __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
 |   #begin   0x80000000  6838    5.250  __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
 |   +func                6844    7.000  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  6851    7.750  __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
 |   +begin   0x80000001  6858    6.500  run_timer_softirq+0x68 (__do_softirq+0x60)
 |   #end     0x80000001  6865    7.250  run_timer_softirq+0x7c (__do_softirq+0x60)
     #func                6872    6.750  __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
 |   #begin   0x80000000  6879    5.500  __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
 |   +func                6884    6.750  __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
 |   +end     0x80000000  6891    7.250  __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
 |   +begin   0x80000001  6898    6.500  __do_softirq+0xa8 (irq_exit+0x50)
 |   #end     0x80000001  6905    5.500  __do_softirq+0xbc (irq_exit+0x50)
     #func                6910    5.750  _local_bh_enable+0x10 (__do_softirq+0xfc)
     #func                6916    7.750  ipipe_check_context+0x10 (_local_bh_enable+0x9c)
 |   #begin   0x80000000  6924    8.000  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  6932    5.750  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func                6938    5.500  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                6943    5.000  irq_enter+0x10 (__exception_text_start+0x38)
     #func                6948    6.000  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                6954    5.750  handle_level_irq+0x10 (__exception_text_start+0x48)
     #func                6960    5.750  handle_IRQ_event+0x10 (handle_level_irq+0x64)
     #func                6966    8.000  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
 |   #begin   0x80000001  6974    6.750  handle_IRQ_event+0x9c (handle_level_irq+0x64)
 |   #end     0x80000001  6980    6.750  handle_IRQ_event+0xb0 (handle_level_irq+0x64)
     #func                6987    6.250  note_interrupt+0x14 (handle_level_irq+0x84)
     #func                6993    5.750  at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
     #func                6999    5.750  irq_exit+0x10 (__exception_text_start+0x4c)
     #func                7005    7.250  ipipe_check_context+0x10 (irq_exit+0x18)
 |   #begin   0x80000000  7012    7.750  __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
 |   +end     0xffffffff  7020    5.000  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
     +func                7025    1.750  __ipipe_unstall_root+0x10 (default_idle+0x94)
 |   +begin   0x80000000  7027    1.750  __ipipe_unstall_root+0x30 (default_idle+0x94)
 |   +end     0x80000000  7028    1.500  __ipipe_unstall_root+0x68 (default_idle+0x94)
     +func                7030    2.250  default_idle+0x10 (cpu_idle+0x3c)
 |   +begin   0x80000001  7032    1.750  default_idle+0x54 (cpu_idle+0x3c)
 |   #end     0x80000001  7034    2.250  default_idle+0x68 (cpu_idle+0x3c)
     #func                7036    2.000  __ipipe_unstall_root+0x10 (default_idle+0x84)
 |   #begin   0x80000000  7038    1.750  __ipipe_unstall_root+0x30 (default_idle+0x84)
 |   +end     0x80000000  7040    1.750  __ipipe_unstall_root+0x68 (default_idle+0x84)
     +end     0x8000000e  7042  323.750  default_idle+0x8c (cpu_idle+0x3c)
 |   +func                7365    7.000  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  7372    5.250  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                7378    6.000  __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
 |   +func                7384   12.000  at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
 |   +func                7396    6.000  __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
 |   +func                7402    5.500  __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                7407    6.000  __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
 |   +func                7413    6.500  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                7420    6.750  xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                7426    7.250  do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
 |  # func                7434    7.250  xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
 |  # func                7441    6.000  rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
 |  # func                7447    8.000  __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
 |   +func                7455    7.750  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                7463    7.500  at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
 |   +end     0xffffffff  7470    5.750  __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
 |   +func                7476    6.750  __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
 |   +begin   0xffffffff  7483    5.500  __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
 |   +func                7488    5.750  __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
 |   +func                7494    5.750  __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
 |   +func                7500    5.500  __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
 |   +func                7505    5.750  at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
 |   +func                7511    6.750  __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
 |   +func                7518    5.500  __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
 |   +func                7523    5.750  at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
 |   +func                7529    6.250  __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
 |  # func                7535    6.500  xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
 |  # func                7542    8.500  xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
 |  # func                7550   14.500  xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
 |  # func                7565    6.750  __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
 |  # func                7571    5.500  rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
 |  # func                7577    6.000  __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
 |  # func                7583    9.250  __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
 |   +func                7592    6.250  __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
 |   +func                7598    8.250  __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
 |   #end     0x80000000  7607    5.750  __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
     #func                7612    5.500  __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
     #func                7618    5.500  irq_enter+0x10 (__exception_text_start+0x38)
     #func                7623    6.500  ipipe_check_context+0x10 (irq_enter+0x18)
     #func                7630    6.000  handle_level_irq+0x10 (__exception_text_start+0x48)
     #func                7636    5.750  handle_IRQ_event+0x10 (handle_level_irq+0x64)
     #func                7642    6.000  at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
     #func                7648    5.750  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                7653    6.750  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                7660    6.750  do_timer+0x10 (tick_periodic+0x70)
     #func                7667    8.750  update_wall_time+0x14 (do_timer+0x30)
     #func                7676    7.750  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                7683    9.250  current_tick_length+0x10 (update_wall_time+0x15c)
     #func                7693    6.750  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001  7699    6.250  clocksource_get_next+0x40 (update_wall_time+0x64c)
 |   #end     0x80000001  7706    5.750  clocksource_get_next+0x54 (update_wall_time+0x64c)
     #func                7711    6.750  __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
 |   #begin   0x80000001  7718    6.750  __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
 |   #end     0x80000001  7725    7.000  __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
     #func                7732    5.500  update_process_times+0x10 (tick_periodic+0x98)
     #func                7737    5.750  account_process_tick+0x10 (update_process_times+0x2c)
     #func                7743    8.000  account_system_time+0x10 (account_process_tick+0x40)
     #func                7751    5.500  account_system_time_scaled+0x10 (account_process_tick+0x4c)
     #func                7757    5.500  run_local_timers+0x10 (update_process_times+0x30)
     #func                7762    6.750  raise_softirq+0x10 (run_local_timers+0x18)
 |   #begin   0x80000001  7769    6.750  raise_softirq+0x44 (run_local_timers+0x18)
 |   #end     0x80000001  7776    6.250  raise_softirq+0x58 (run_local_timers+0x18)
     #func                7782    6.750  __ipipe_restore_root+0x10 (raise_softirq+0xbc)
 |   #begin   0x80000001  7789    6.500  __ipipe_restore_root+0x48 (raise_softirq+0xbc)
 |   #end     0x80000001  7795    5.750  __ipipe_restore_root+0x5c (raise_softirq+0xbc)
     #func                7801    5.250  rcu_pending+0x10 (update_process_times+0x38)
     #func                7806    7.000  __rcu_pending+0x10 (rcu_pending+0x1c)
     #func                7813    6.250  __rcu_pending+0x10 (rcu_pending+0x34)
     #func                7819    5.750  scheduler_tick+0x10 (update_process_times+0x50)
     #func                7825    5.750  __update_rq_clock+0x14 (scheduler_tick+0x38)
     #func                7831    9.000  sched_clock+0x10 (__update_rq_clock+0x28)
     #func                7840    6.750  run_posix_cpu_timers+0x14 (update_process_times+0x58)
     #func                7847    7.250  profile_tick+0x10 (tick_periodic+0xa0)
     #func                7854    5.250  tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
     #func                7859    6.000  tick_periodic+0x10 (tick_handle_periodic+0x20)
     #func                7865    5.500  do_timer+0x10 (tick_periodic+0x70)
     #func                7871   10.750  update_wall_time+0x14 (do_timer+0x30)
     #func                7881    6.750  clocksource_get_next+0x10 (update_wall_time+0x64c)
 |   #begin   0x80000001  7888    0.000  clocksource_get_next+0x40 (update_wall_time+0x64c)

^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-26 17:47                   ` Bosko Radivojevic
@ 2008-05-27 11:31                     ` Bosko Radivojevic
  2008-05-27 12:11                       ` Gilles Chanteperdrix
  0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-27 11:31 UTC (permalink / raw)
  To: Gilles Chanteperdrix; +Cc: xenomai-help

Hi Gilles,

problem with Ethernet activity seems to be caused by hardware.
According to datasheet each PIO peripheral (A, B & C) has its own, but
only one, Interrupt line. In my case, both Ethernet and sync signal
were connected on PIO B peripheral. I did some quick tests using IRQ1
line, but I still need to double check.

Problem with two interrupts is still unresolved, but I have a
"feeling" :) it is also caused by hardware. It looks sync signal has
too 'sharp' edges.

Anyway, I'll send report later. If you see anything unusual on frozen*
files I've sent, please let me know. Thanks.

Regards,
Bosko


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-27 11:31                     ` Bosko Radivojevic
@ 2008-05-27 12:11                       ` Gilles Chanteperdrix
  2008-05-27 13:08                         ` Bosko Radivojevic
  0 siblings, 1 reply; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-27 12:11 UTC (permalink / raw)
  To: Bosko Radivojevic; +Cc: xenomai-help

On Tue, May 27, 2008 at 1:31 PM, Bosko Radivojevic
<bosko.radivojevic@domain.hid> wrote:
> Hi Gilles,

Hi,

>
> problem with Ethernet activity seems to be caused by hardware.
> According to datasheet each PIO peripheral (A, B & C) has its own, but
> only one, Interrupt line. In my case, both Ethernet and sync signal
> were connected on PIO B peripheral. I did some quick tests using IRQ1
> line, but I still need to double check.

Yes, if you are trying to share an irqs line between real-time and non
real-time interrupts handler, you are going to have problems,
actually, that is an FAQ, and the better thing to do is to get two
different irqs for the two drivers.

>
> Problem with two interrupts is still unresolved, but I have a
> "feeling" :) it is also caused by hardware. It looks sync signal has
> too 'sharp' edges.
>
> Anyway, I'll send report later. If you see anything unusual on frozen*
> files I've sent, please let me know. Thanks.

I had no time to have a look at them yet. Will do it.

Regards.

-- 
 Gilles


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-27 12:11                       ` Gilles Chanteperdrix
@ 2008-05-27 13:08                         ` Bosko Radivojevic
  2008-05-28  9:16                           ` Bosko Radivojevic
  0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-27 13:08 UTC (permalink / raw)
  To: Gilles Chanteperdrix; +Cc: xenomai-help

On Tue, May 27, 2008 at 2:11 PM, Gilles Chanteperdrix
<gilles.chanteperdrix@xenomai.org> wrote:

>> Anyway, I'll send report later. If you see anything unusual on frozen*
>> files I've sent, please let me know. Thanks.
>
> I had no time to have a look at them yet. Will do it.

BTW, when I enable tracer (echo 1 > /proc/ipipe/tracer/enable) I see
just one interrupt ;)


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-27 13:08                         ` Bosko Radivojevic
@ 2008-05-28  9:16                           ` Bosko Radivojevic
  2008-05-28 10:14                             ` Bosko Radivojevic
  0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-28  9:16 UTC (permalink / raw)
  To: Gilles Chanteperdrix; +Cc: xenomai-help

Gilles,

I've found the explanation why I see two interrupts. The problem is
that I, somehow, cannot use my external source connected to PC15 pin
as IRQ1 line. On AT91SAM9260 PIO Interrupts are considered as
'internal source interrupts' and it is not possible to change second
bit of source type, so it can be level or edge triggered, but not
rising or falling edge. Now it is quite clear why I get two
interrupts.

I've traced down to __ipipe_grab_irq() what is happening and
discovered that my interrupt is always coming as irq source = 4 (PIO C
peripheral) and not as irq source = 30 as expected.

Does anybody here knows anything about this? :)

Thanx


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-28  9:16                           ` Bosko Radivojevic
@ 2008-05-28 10:14                             ` Bosko Radivojevic
  2008-05-28 12:27                               ` Gilles Chanteperdrix
  0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-28 10:14 UTC (permalink / raw)
  To: Gilles Chanteperdrix; +Cc: xenomai-help

Hi,

I hope this is the last mail in this thread :) In order to use IRQ1
line, IRQ no. 30 should be requested. What get me in wrong way is
that, when I tried first time to request IRQ 30 instead of 111 (PC15),
everything hung. Actually, before requesting irq it is mandatory to
set interrupt source type to anything except LOW LEVEL.

Actually, I can still see a small jitter with heavy Ethernet activity,
but it seems acceptable.

Thanx a lot!

On Wed, May 28, 2008 at 11:16 AM, Bosko Radivojevic
<bosko.radivojevic@domain.hid> wrote:
> Gilles,
>
> I've found the explanation why I see two interrupts. The problem is
> that I, somehow, cannot use my external source connected to PC15 pin
> as IRQ1 line. On AT91SAM9260 PIO Interrupts are considered as
> 'internal source interrupts' and it is not possible to change second
> bit of source type, so it can be level or edge triggered, but not
> rising or falling edge. Now it is quite clear why I get two
> interrupts.
>
> I've traced down to __ipipe_grab_irq() what is happening and
> discovered that my interrupt is always coming as irq source = 4 (PIO C
> peripheral) and not as irq source = 30 as expected.
>
> Does anybody here knows anything about this? :)
>
> Thanx
>


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [Xenomai-help] Interrupt priorities and handling problems
  2008-05-28 10:14                             ` Bosko Radivojevic
@ 2008-05-28 12:27                               ` Gilles Chanteperdrix
  0 siblings, 0 replies; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-28 12:27 UTC (permalink / raw)
  To: Bosko Radivojevic; +Cc: xenomai-help

On Wed, May 28, 2008 at 12:14 PM, Bosko Radivojevic
<bosko.radivojevic@domain.hid> wrote:
> Hi,
>
> I hope this is the last mail in this thread :) In order to use IRQ1
> line, IRQ no. 30 should be requested. What get me in wrong way is
> that, when I tried first time to request IRQ 30 instead of 111 (PC15),
> everything hung. Actually, before requesting irq it is mandatory to
> set interrupt source type to anything except LOW LEVEL.
>
> Actually, I can still see a small jitter with heavy Ethernet activity,
> but it seems acceptable.

That's good news.

-- 
 Gilles


^ permalink raw reply	[flat|nested] 24+ messages in thread

end of thread, other threads:[~2008-05-28 12:27 UTC | newest]

Thread overview: 24+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2008-05-23 17:56 [Xenomai-help] Interrupt priorities and handling problems Bosko Radivojevic
2008-05-23 19:08 ` Gilles Chanteperdrix
2008-05-23 19:34   ` Bosko Radivojevic
2008-05-23 19:42     ` Gilles Chanteperdrix
2008-05-23 19:48       ` Bosko Radivojevic
2008-05-23 19:49         ` Gilles Chanteperdrix
2008-05-23 19:51           ` Bosko Radivojevic
2008-05-25 14:31 ` Gilles Chanteperdrix
2008-05-26 13:26   ` Bosko Radivojevic
2008-05-26 16:29     ` Bosko Radivojevic
2008-05-26 16:47       ` Gilles Chanteperdrix
2008-05-26 16:59         ` Gilles Chanteperdrix
2008-05-26 17:04           ` Bosko Radivojevic
2008-05-26 17:14             ` Gilles Chanteperdrix
2008-05-26 17:16               ` Bosko Radivojevic
2008-05-26 17:21                 ` Gilles Chanteperdrix
2008-05-26 17:47                   ` Bosko Radivojevic
2008-05-27 11:31                     ` Bosko Radivojevic
2008-05-27 12:11                       ` Gilles Chanteperdrix
2008-05-27 13:08                         ` Bosko Radivojevic
2008-05-28  9:16                           ` Bosko Radivojevic
2008-05-28 10:14                             ` Bosko Radivojevic
2008-05-28 12:27                               ` Gilles Chanteperdrix
2008-05-26 16:59         ` Bosko Radivojevic

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.