* [Xenomai-help] Interrupt priorities and handling problems
@ 2008-05-23 17:56 Bosko Radivojevic
2008-05-23 19:08 ` Gilles Chanteperdrix
2008-05-25 14:31 ` Gilles Chanteperdrix
0 siblings, 2 replies; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-23 17:56 UTC (permalink / raw)
To: xenomai-help
Hi all!
Before I ask my questions, I'll remind about my environment:
AT91SAM9260 based board (ARM), Xenomai 2.4.3, Kernel 2.6.24, I-Pipe
1.9-01. We have external interrupt source connected to PIO line (IRQ1
line) which should 'wake up' our code every 1ms. For the sake of
performances, we create interrupt handler in kernel space.
1. Two interrupts instead of one
Somehow, ISR get called twice for every single interrupt, at the
falling edge. I've tried to set interrupt source type (setting some
registers directly on the microcontroller) but whatever I set, ISR
call happens at the falling edge. The second comes right after the
first one, but not together.
When I tried to handle interrupt from the userspace, rt_intr_wait() returns
1, so it looks like "second" interrupt comes a little bit later. If I
generate more (n) interrupts during handling one, the next
rt_intr_wait() returns n*2+1. This +1 is the second interrupt that
came right after the handled one.
The quite weird thing is that sometimes (not so often, like every 1
hour) ISR is called just once. Where should I start digging?
2. Ethernet activity makes system unpredictable
Delay at interrupt reaction and, more important, duration of handling
function is pretty the same during long period of time if there is no
Ethernet activity (DM9000, GPIO IRQ 82). I can understand why we get
longer delays on interrupt reaction with Ethernet activity, but I
can't understand why exactly the same code takes more time to
complete.
We calculate ISR duration by setting one of the pins to 1 at the
beginning and setting back to 0 at the end, using at91_sys_write
macros (macros for raw_writel). We use logic port analyzer for
displaying pins status.
Without Ethernet activity irq handler lasts around 170us. With
Ethernet activity it lasts up to 280us!
That sync signal is kind of "sign of God" for us and our need is to
threat it with the highest priority possible. In one of the mails on
the list, Gilles explained that from I-Pipe 1.8 interrupt priorities
on ARM are defined at the software level. Is there a way to raise
priority of "my IRQ" over all others? Ethernet activity, timer & co
are less important than having good and predictable reactions on our
interrupt.
Thanks.
^ permalink raw reply [flat|nested] 24+ messages in thread
* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-23 17:56 [Xenomai-help] Interrupt priorities and handling problems Bosko Radivojevic
@ 2008-05-23 19:08 ` Gilles Chanteperdrix
2008-05-23 19:34 ` Bosko Radivojevic
2008-05-25 14:31 ` Gilles Chanteperdrix
1 sibling, 1 reply; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-23 19:08 UTC (permalink / raw)
To: Bosko Radivojevic; +Cc: xenomai-help
Bosko Radivojevic wrote:
> Hi all!
>
> Before I ask my questions, I'll remind about my environment:
> AT91SAM9260 based board (ARM), Xenomai 2.4.3, Kernel 2.6.24, I-Pipe
> 1.9-01. We have external interrupt source connected to PIO line (IRQ1
> line) which should 'wake up' our code every 1ms. For the sake of
> performances, we create interrupt handler in kernel space.
>
> 2. Ethernet activity makes system unpredictable
>
> Delay at interrupt reaction and, more important, duration of handling
> function is pretty the same during long period of time if there is no
> Ethernet activity (DM9000, GPIO IRQ 82). I can understand why we get
> longer delays on interrupt reaction with Ethernet activity, but I
> can't understand why exactly the same code takes more time to
> complete.
>
> We calculate ISR duration by setting one of the pins to 1 at the
> beginning and setting back to 0 at the end, using at91_sys_write
> macros (macros for raw_writel). We use logic port analyzer for
> displaying pins status.
>
> Without Ethernet activity irq handler lasts around 170us. With
> Ethernet activity it lasts up to 280us!
Due to the way you measure the interrupt duration, and since preemption
of interrupt handler by another interrupt handler is completely
excluded (unless you mistakenly re-enable interrupts in your interrupt
handler), what you observe is probably an indirect effect
such as cache thrashing. The best way to know is either to measure some
short sections with rt_timer_tsc, or to do some measurements with the
I-pipe tracer.
>
> That sync signal is kind of "sign of God" for us and our need is to
> threat it with the highest priority possible. In one of the mails on
> the list, Gilles explained that from I-Pipe 1.8 interrupt priorities
> on ARM are defined at the software level. Is there a way to raise
> priority of "my IRQ" over all others? Ethernet activity, timer & co
> are less important than having good and predictable reactions on our
> interrupt.
Interrupt priority only matters when two interrupts are pending at the
same time. If ethernet interrupt is treated at Linux level, then it is
fully preemptible by Xenomai, if it is a real-time interrupt, then it
may well trigger before you receive your periodic interrupt, so the
worst case interrupt latency of the periodic interrupt is at least the
duration of the ethernet interrupt (and vice-versa). Changing the
interrupt priority, will not change interrupt latency. What you can do
to improve situation is:
- re-enable interrupts in the ethernet interrupt handler
- rewrite the ethernet driver to only poll periodically hardware to
handle any pending packet instead of being interrupt driven, and
arrange for this not to happen at the same time as when the
periodic interrupt is triggered.
But as far as I understood, your problem is not the interrupt latency,
but rather the ISR duration, and changing the interrupt priority will
not change this at all.
--
Gilles.
^ permalink raw reply [flat|nested] 24+ messages in thread
* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-23 19:08 ` Gilles Chanteperdrix
@ 2008-05-23 19:34 ` Bosko Radivojevic
2008-05-23 19:42 ` Gilles Chanteperdrix
0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-23 19:34 UTC (permalink / raw)
To: Gilles Chanteperdrix; +Cc: xenomai-help
> Interrupt priority only matters when two interrupts are pending at the
> same time. If ethernet interrupt is treated at Linux level, then it is
> fully preemptible by Xenomai,
Ethernet is handled by Linux (dm9000 driver).
> - re-enable interrupts in the ethernet interrupt handler
What will happen with interrupted ethernet interrupt handler? :)
> But as far as I understood, your problem is not the interrupt latency,
> but rather the ISR duration, and changing the interrupt priority will
> not change this at all.
Both latency and duration are my problems. But, I had some explanation
for latency problem (irqs disabled during Eth handler).
Thanks.
^ permalink raw reply [flat|nested] 24+ messages in thread
* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-23 19:34 ` Bosko Radivojevic
@ 2008-05-23 19:42 ` Gilles Chanteperdrix
2008-05-23 19:48 ` Bosko Radivojevic
0 siblings, 1 reply; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-23 19:42 UTC (permalink / raw)
To: Bosko Radivojevic; +Cc: xenomai-help
Bosko Radivojevic wrote:
> > Interrupt priority only matters when two interrupts are pending at the
> > same time. If ethernet interrupt is treated at Linux level, then it is
> > fully preemptible by Xenomai,
>
> Ethernet is handled by Linux (dm9000 driver).
Then what I have said is irrelevant, your interrupt handler is fully
preemptible by Xenomai.
>
> > - re-enable interrupts in the ethernet interrupt handler
>
> What will happen with interrupted ethernet interrupt handler? :)
>
> > But as far as I understood, your problem is not the interrupt latency,
> > but rather the ISR duration, and changing the interrupt priority will
> > not change this at all.
>
> Both latency and duration are my problems. But, I had some explanation
> for latency problem (irqs disabled during Eth handler).
How are they disabled ? If they are disabled using Linux functions, then
they are really enabled for Adeos, that is one of the intended effects
of the Adeos patch.
--
Gilles.
^ permalink raw reply [flat|nested] 24+ messages in thread
* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-23 19:42 ` Gilles Chanteperdrix
@ 2008-05-23 19:48 ` Bosko Radivojevic
2008-05-23 19:49 ` Gilles Chanteperdrix
0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-23 19:48 UTC (permalink / raw)
To: Gilles Chanteperdrix; +Cc: xenomai-help
On Fri, May 23, 2008 at 9:42 PM, Gilles Chanteperdrix
<gilles.chanteperdrix@xenomai.org> wrote:
> Then what I have said is irrelevant, your interrupt handler is fully
> preemptible by Xenomai.
Great :)
> How are they disabled ? If they are disabled using Linux functions, then
> they are really enabled for Adeos, that is one of the intended effects
> of the Adeos patch.
OK, I missed that fact. So, why do I see latency than, at all?
^ permalink raw reply [flat|nested] 24+ messages in thread
* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-23 19:48 ` Bosko Radivojevic
@ 2008-05-23 19:49 ` Gilles Chanteperdrix
2008-05-23 19:51 ` Bosko Radivojevic
0 siblings, 1 reply; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-23 19:49 UTC (permalink / raw)
To: Bosko Radivojevic; +Cc: xenomai-help
Bosko Radivojevic wrote:
> On Fri, May 23, 2008 at 9:42 PM, Gilles Chanteperdrix
> <gilles.chanteperdrix@xenomai.org> wrote:
>
> > Then what I have said is irrelevant, your interrupt handler is fully
> > preemptible by Xenomai.
>
> Great :)
>
> > How are they disabled ? If they are disabled using Linux functions, then
> > they are really enabled for Adeos, that is one of the intended effects
> > of the Adeos patch.
>
> OK, I missed that fact. So, why do I see latency than, at all?
Only the tracer can tell.
--
Gilles.
^ permalink raw reply [flat|nested] 24+ messages in thread
* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-23 17:56 [Xenomai-help] Interrupt priorities and handling problems Bosko Radivojevic
2008-05-23 19:08 ` Gilles Chanteperdrix
@ 2008-05-25 14:31 ` Gilles Chanteperdrix
2008-05-26 13:26 ` Bosko Radivojevic
1 sibling, 1 reply; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-25 14:31 UTC (permalink / raw)
To: Bosko Radivojevic; +Cc: xenomai-help
[-- Attachment #1: message body and .signature --]
[-- Type: text/plain, Size: 1254 bytes --]
Bosko Radivojevic wrote:
> Hi all!
>
> Before I ask my questions, I'll remind about my environment:
> AT91SAM9260 based board (ARM), Xenomai 2.4.3, Kernel 2.6.24, I-Pipe
> 1.9-01. We have external interrupt source connected to PIO line (IRQ1
> line) which should 'wake up' our code every 1ms. For the sake of
> performances, we create interrupt handler in kernel space.
>
> 1. Two interrupts instead of one
>
> Somehow, ISR get called twice for every single interrupt, at the
> falling edge. I've tried to set interrupt source type (setting some
> registers directly on the microcontroller) but whatever I set, ISR
> call happens at the falling edge. The second comes right after the
> first one, but not together.
>
> When I tried to handle interrupt from the userspace, rt_intr_wait() returns
> 1, so it looks like "second" interrupt comes a little bit later. If I
> generate more (n) interrupts during handling one, the next
> rt_intr_wait() returns n*2+1. This +1 is the second interrupt that
> came right after the handled one.
>
> The quite weird thing is that sometimes (not so often, like every 1
> hour) ISR is called just once. Where should I start digging?
Does the following patch help ?
--
Gilles.
[-- Attachment #2: xeno-arm-use-mask-unmask-instead-of-enable-disable.diff --]
[-- Type: text/plain, Size: 949 bytes --]
Index: include/asm-arm/wrappers.h
===================================================================
--- include/asm-arm/wrappers.h (revision 3873)
+++ include/asm-arm/wrappers.h (working copy)
@@ -64,8 +64,8 @@ typedef irqreturn_t (*rthal_irq_host_han
extern void (*fp_init)(union fp_state *);
#else /* >= 2.6.19 */
#define rthal_irq_desc_lock(irq) (&rthal_irq_descp(irq)->lock)
-#define rthal_irq_chip_enable(irq) ({ rthal_irq_descp(irq)->chip->enable(irq); 0; })
-#define rthal_irq_chip_disable(irq) ({ rthal_irq_descp(irq)->chip->disable(irq); 0; })
+#define rthal_irq_chip_enable(irq) ({ rthal_irq_descp(irq)->chip->unmask(irq); 0; })
+#define rthal_irq_chip_disable(irq) ({ rthal_irq_descp(irq)->chip->mask(irq); 0; })
#define rthal_irq_chip_end(irq) ({ rthal_irq_descp(irq)->ipipe_end(irq, rthal_irq_descp(irq)); 0; })
typedef irq_handler_t rthal_irq_host_handler_t;
#define rthal_mark_irq_disabled(irq) do { \
^ permalink raw reply [flat|nested] 24+ messages in thread* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-25 14:31 ` Gilles Chanteperdrix
@ 2008-05-26 13:26 ` Bosko Radivojevic
2008-05-26 16:29 ` Bosko Radivojevic
0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-26 13:26 UTC (permalink / raw)
To: Gilles Chanteperdrix; +Cc: xenomai-help
Unfortunately, no. Tried with:
- xenomai-trunk and xenomai-2.4.2 on 2.6.24.3 kernel
- xenomai-2.4.2 on 2.6.20.21 kernel
I'll try tracer in the next hours.
On Sun, May 25, 2008 at 4:31 PM, Gilles Chanteperdrix
<gilles.chanteperdrix@xenomai.org> wrote:
> Bosko Radivojevic wrote:
> > Hi all!
> >
> > Before I ask my questions, I'll remind about my environment:
> > AT91SAM9260 based board (ARM), Xenomai 2.4.3, Kernel 2.6.24, I-Pipe
> > 1.9-01. We have external interrupt source connected to PIO line (IRQ1
> > line) which should 'wake up' our code every 1ms. For the sake of
> > performances, we create interrupt handler in kernel space.
> >
> > 1. Two interrupts instead of one
> >
> > Somehow, ISR get called twice for every single interrupt, at the
> > falling edge. I've tried to set interrupt source type (setting some
> > registers directly on the microcontroller) but whatever I set, ISR
> > call happens at the falling edge. The second comes right after the
> > first one, but not together.
> >
> > When I tried to handle interrupt from the userspace, rt_intr_wait() returns
> > 1, so it looks like "second" interrupt comes a little bit later. If I
> > generate more (n) interrupts during handling one, the next
> > rt_intr_wait() returns n*2+1. This +1 is the second interrupt that
> > came right after the handled one.
> >
> > The quite weird thing is that sometimes (not so often, like every 1
> > hour) ISR is called just once. Where should I start digging?
>
> Does the following patch help ?
>
> --
>
>
> Gilles.
>
> Index: include/asm-arm/wrappers.h
> ===================================================================
> --- include/asm-arm/wrappers.h (revision 3873)
> +++ include/asm-arm/wrappers.h (working copy)
> @@ -64,8 +64,8 @@ typedef irqreturn_t (*rthal_irq_host_han
> extern void (*fp_init)(union fp_state *);
> #else /* >= 2.6.19 */
> #define rthal_irq_desc_lock(irq) (&rthal_irq_descp(irq)->lock)
> -#define rthal_irq_chip_enable(irq) ({ rthal_irq_descp(irq)->chip->enable(irq); 0; })
> -#define rthal_irq_chip_disable(irq) ({ rthal_irq_descp(irq)->chip->disable(irq); 0; })
> +#define rthal_irq_chip_enable(irq) ({ rthal_irq_descp(irq)->chip->unmask(irq); 0; })
> +#define rthal_irq_chip_disable(irq) ({ rthal_irq_descp(irq)->chip->mask(irq); 0; })
> #define rthal_irq_chip_end(irq) ({ rthal_irq_descp(irq)->ipipe_end(irq, rthal_irq_descp(irq)); 0; })
> typedef irq_handler_t rthal_irq_host_handler_t;
> #define rthal_mark_irq_disabled(irq) do { \
>
>
^ permalink raw reply [flat|nested] 24+ messages in thread* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-26 13:26 ` Bosko Radivojevic
@ 2008-05-26 16:29 ` Bosko Radivojevic
2008-05-26 16:47 ` Gilles Chanteperdrix
0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-26 16:29 UTC (permalink / raw)
To: Gilles Chanteperdrix; +Cc: xenomai-help
[-- Attachment #1: Type: text/plain, Size: 615 bytes --]
Hi Gilles,
I've enabled tracer, as documented on Xenomai site. Well, to be
honest, I dont see much from the output :) I've put
xntrace_user_freeze (1, 1) in the handler to happen at the 1000th
iteration. At the beginning of the interrupt handler one IO PIN is set
to 1 and set back to 0 at the end. In the meantime, there is only for
().
Attached file osc1.jpg is screen shot of USB Osciloscope when there is
no Ethernet activity. osc2.jpg is good example of what happens when
there is Ethernet activity (this time ping -f from PC box in the same
LAN as Device).
Do you see anything in those .txt files?
Thanx.
[-- Attachment #2: osc1.jpg --]
[-- Type: image/jpeg, Size: 59032 bytes --]
[-- Attachment #3: osc2.jpg --]
[-- Type: image/jpeg, Size: 60149 bytes --]
[-- Attachment #4: frozen3.txt --]
[-- Type: text/plain, Size: 97663 bytes --]
I-pipe frozen back-tracing service on 2.6.24.3/ipipe-1.9-00
------------------------------------------------------------
CPU: 0, Freeze: 6446305569 cycles, Trace Points: 100 (+1000)
Calibrated minimum trace-point overhead: 1.500 us
+----- Hard IRQs ('|': locked)
|+---- <unused>
||+--- <unused>
|||+-- Xenomai
||||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
||||| +---------- Delay flag ('+': > 1 us, '!': > 10 us)
||||| | +- NMI noise ('N')
||||| | |
Type User Val. Time Delay Function (Parent)
: +func -665+ 6.250 sock_wfree+0x10 (skb_release_all+0xd0)
:| +begin 0x80000001 -658+ 7.500 sock_wfree+0x44 (skb_release_all+0xd0)
:| +end 0x80000001 -651+ 5.500 sock_wfree+0x58 (skb_release_all+0xd0)
: +func -645+ 8.250 sock_def_write_space+0x10 (sock_wfree+0x74)
:| +begin 0x80000001 -637+ 8.000 sock_wfree+0x94 (skb_release_all+0xd0)
:| +end 0x80000001 -629+ 5.500 sock_wfree+0xa8 (skb_release_all+0xd0)
: +func -624+ 5.750 skb_release_data+0x10 (skb_release_all+0xd8)
: +func -618+ 6.750 kfree+0x10 (skb_release_data+0xdc)
:| +begin 0x80000001 -611+ 7.500 kfree+0x4c (skb_release_data+0xdc)
:| #end 0x80000001 -604+ 6.750 kfree+0x60 (skb_release_data+0xdc)
: #func -597+ 5.750 __ipipe_restore_root+0x10 (kfree+0xfc)
: #func -591+ 6.750 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
:| #begin 0x80000000 -584+ 6.750 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
:| +func -578+ 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
:| +end 0x80000000 -571+ 6.750 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
: +func -564+ 7.000 kmem_cache_free+0x10 (__kfree_skb+0x108)
:| +begin 0x80000001 -557+ 7.250 kmem_cache_free+0x48 (__kfree_skb+0x108)
:| #end 0x80000001 -550+ 5.750 kmem_cache_free+0x5c (__kfree_skb+0x108)
: #func -544+ 5.500 __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
: #func -538+ 6.750 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
:| #begin 0x80000000 -532+ 6.250 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
:| +func -525+ 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
:| +end 0x80000000 -519+ 9.000 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
:| +begin 0x80000001 -510+ 7.750 __qdisc_run+0x174 (dev_queue_xmit+0x19c)
:| +end 0x80000001 -502+ 5.750 __qdisc_run+0x188 (dev_queue_xmit+0x19c)
: +func -496+ 5.250 local_bh_enable+0x10 (dev_queue_xmit+0x26c)
: +func -491+ 6.500 ipipe_check_context+0x10 (local_bh_enable+0x58)
: +func -484+ 7.750 ipipe_check_context+0x10 (local_bh_enable+0x98)
: +func -477+ 5.500 local_bh_enable+0x10 (dev_queue_xmit+0x26c)
: +func -471+ 5.750 ipipe_check_context+0x10 (local_bh_enable+0x58)
: +func -465+ 7.000 ipipe_check_context+0x10 (local_bh_enable+0x98)
: +func -458+ 5.500 ip_cork_release+0x10 (ip_push_pending_frames+0x454)
: +func -453+ 7.250 kfree+0x10 (ip_cork_release+0x28)
:| +begin 0x80000001 -446+ 7.250 ip_cork_release+0x80 (ip_push_pending_frames+0x454)
:| +end 0x80000001 -438+ 7.750 ip_cork_release+0x94 (ip_push_pending_frames+0x454)
:| +begin 0x80000001 -431+ 7.750 icmp_reply+0x190 (icmp_echo+0x60)
:| +end 0x80000001 -423+ 5.250 icmp_reply+0x1a4 (icmp_echo+0x60)
: +func -418+ 5.250 icmp_xmit_unlock+0x10 (icmp_reply+0x1bc)
: +func -412+ 5.750 local_bh_enable+0x10 (icmp_xmit_unlock+0x14)
: +func -407+ 6.000 ipipe_check_context+0x10 (local_bh_enable+0x58)
: +func -401+ 7.500 ipipe_check_context+0x10 (local_bh_enable+0x98)
: +func -393+ 5.750 kfree_skb+0x10 (icmp_rcv+0x158)
: +func -387+ 5.500 __kfree_skb+0x10 (kfree_skb+0x80)
: +func -382+ 7.250 skb_release_all+0x10 (__kfree_skb+0x18)
:| +begin 0x80000001 -375+ 7.250 skb_release_all+0x64 (__kfree_skb+0x18)
:| +end 0x80000001 -367+ 6.000 skb_release_all+0x78 (__kfree_skb+0x18)
: +func -361+ 6.000 skb_release_data+0x10 (skb_release_all+0xd8)
: +func -355+ 6.750 kfree+0x10 (skb_release_data+0xdc)
:| +begin 0x80000001 -349+ 7.500 kfree+0x4c (skb_release_data+0xdc)
:| #end 0x80000001 -341+ 5.750 kfree+0x60 (skb_release_data+0xdc)
: #func -335+ 5.500 __ipipe_restore_root+0x10 (kfree+0xfc)
: #func -330+ 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
:| #begin 0x80000000 -323+ 6.750 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
:| +func -317+ 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
:| +end 0x80000000 -310+ 6.500 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
: +func -303+ 6.500 kmem_cache_free+0x10 (__kfree_skb+0x108)
:| +begin 0x80000001 -297+ 7.250 kmem_cache_free+0x48 (__kfree_skb+0x108)
:| #end 0x80000001 -290+ 6.250 kmem_cache_free+0x5c (__kfree_skb+0x108)
: #func -283+ 5.750 __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
: #func -278+ 6.750 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
:| #begin 0x80000000 -271+ 6.250 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
:| +func -265+ 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
:| +end 0x80000000 -258+ 10.000 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
:| +begin 0x80000001 -248+ 8.250 process_backlog+0x168 (net_rx_action+0xac)
:| +end 0x80000001 -240+ 7.000 process_backlog+0x17c (net_rx_action+0xac)
:| +begin 0x80000001 -233+ 7.250 process_backlog+0x60 (net_rx_action+0xac)
:| #end 0x80000001 -225+ 7.500 process_backlog+0x74 (net_rx_action+0xac)
:| #begin 0x80000001 -218+ 7.500 process_backlog+0x134 (net_rx_action+0xac)
:| #end 0x80000001 -210+ 5.250 process_backlog+0x148 (net_rx_action+0xac)
: #func -205+ 6.000 __ipipe_unstall_root+0x10 (process_backlog+0x150)
:| #func -199+ 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
:| #begin 0xffffffff -192+ 6.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
:| #func -185+ 5.500 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
:| #func -180+ 5.250 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
:| #func -175+ 6.000 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
:| #func -169+ 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
:| #func -163+ 6.000 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
:| #func -157+ 5.250 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
:| #func -152+ 6.000 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
:| #func -146+ 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
:| #*func -139+ 7.250 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
:| #*func -132+ 8.500 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
:| #*func -123! 14.250 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
:| #*func -109+ 7.750 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
:| #*func -101+ 5.250 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
:| #*func -96+ 5.750 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
:| #*func -90+ 9.500 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
:| #func -81+ 7.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
:| #end 0xffffffff -73+ 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
:| #func -68+ 6.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
:| #begin 0xffffffff -61+ 6.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
:| #func -55+ 5.500 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
:| #func -49! 12.250 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
:| #func -37+ 5.250 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
:| #func -32+ 5.750 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
:| #func -26+ 5.750 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
:| #func -20+ 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
:| #*func -14+ 6.250 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
:| #*func -8+ 8.250 <bf0071fc> (xnintr_irq_handler+0x44)
<| #*freeze 0x00000001 0 6.750 <bf007230> (xnintr_irq_handler+0x44)
| #*func 6 5.750 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func 12 8.000 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func 20 7.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 27 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 35 7.250 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| #begin 0x80000000 42 5.500 __ipipe_unstall_root+0x30 (process_backlog+0x150)
| +func 47 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 54 7.500 __ipipe_unstall_root+0x68 (process_backlog+0x150)
| +begin 0x80000001 62 6.500 net_rx_action+0x118 (__do_softirq+0x60)
| #end 0x80000001 68 5.500 net_rx_action+0x12c (__do_softirq+0x60)
#func 74 6.750 __ipipe_unstall_root+0x10 (net_rx_action+0x208)
| #begin 0x80000000 81 5.750 __ipipe_unstall_root+0x30 (net_rx_action+0x208)
| +func 86 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 93 6.750 __ipipe_unstall_root+0x68 (net_rx_action+0x208)
| +begin 0x80000001 100 6.500 __do_softirq+0xa8 (irq_exit+0x50)
| #end 0x80000001 107 6.000 __do_softirq+0xbc (irq_exit+0x50)
#func 113 5.750 _local_bh_enable+0x10 (__do_softirq+0xfc)
#func 118 8.000 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
| #begin 0x80000000 126 8.750 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 135 6.250 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func 141 5.750 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 147 5.500 irq_enter+0x10 (__exception_text_start+0x38)
#func 153 6.000 ipipe_check_context+0x10 (irq_enter+0x18)
#func 159 6.000 handle_simple_irq+0x10 (__exception_text_start+0x48)
#func 165 5.750 handle_IRQ_event+0x10 (handle_simple_irq+0x64)
#func 170 6.250 __ipipe_unstall_root+0x10 (handle_IRQ_event+0x28)
| #begin 0x80000000 177 5.500 __ipipe_unstall_root+0x30 (handle_IRQ_event+0x28)
| +func 182 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 189 5.750 __ipipe_unstall_root+0x68 (handle_IRQ_event+0x28)
+func 195 7.500 dm9000_interrupt+0x14 (handle_IRQ_event+0x40)
| +func 202 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 209 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 215 5.750 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func 221 10.750 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func 232 7.250 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func 239 6.250 __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
| +func 245 5.500 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
| +func 251 5.750 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func 256 7.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 263 7.000 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +func 270 7.000 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff 277 7.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func 285 6.750 dm9000_inblk_16bit+0x10 (dm9000_interrupt+0xbc)
+func 292 6.000 __alloc_skb+0x10 (dm9000_interrupt+0x120)
+func 298 7.000 kmem_cache_alloc+0x10 (__alloc_skb+0x34)
| +begin 0x80000001 305 6.250 kmem_cache_alloc+0x58 (__alloc_skb+0x34)
| #end 0x80000001 311 6.000 kmem_cache_alloc+0x6c (__alloc_skb+0x34)
#func 317 5.500 __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
#func 322 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 329 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 334 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 341 6.250 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func 348 8.500 __kmalloc+0x10 (__alloc_skb+0x54)
| +begin 0x80000001 356 6.500 __kmalloc+0x94 (__alloc_skb+0x54)
| #end 0x80000001 363 6.000 __kmalloc+0xa8 (__alloc_skb+0x54)
#func 369 5.750 __ipipe_restore_root+0x10 (__kmalloc+0xf8)
#func 374 6.250 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 381 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 386 7.250 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 393 8.250 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func 402 17.500 dm9000_inblk_16bit+0x10 (dm9000_interrupt+0x19c)
+func 419 7.000 eth_type_trans+0x10 (dm9000_interrupt+0x1b4)
+func 426 7.250 netif_rx+0x14 (dm9000_interrupt+0x1c0)
| +begin 0x80000001 433 6.750 netif_rx+0x88 (dm9000_interrupt+0x1c0)
| #end 0x80000001 440 7.000 netif_rx+0x9c (dm9000_interrupt+0x1c0)
| #begin 0x80000001 447 6.250 netif_rx+0x1ac (dm9000_interrupt+0x1c0)
| #end 0x80000001 453 6.000 netif_rx+0x1c0 (dm9000_interrupt+0x1c0)
#func 459 7.000 __napi_schedule+0x10 (netif_rx+0x1d4)
| #begin 0x80000001 466 6.500 __napi_schedule+0x44 (netif_rx+0x1d4)
| #end 0x80000001 473 5.250 __napi_schedule+0x58 (netif_rx+0x1d4)
#func 478 6.750 __ipipe_restore_root+0x10 (__napi_schedule+0xa4)
| #begin 0x80000001 485 6.750 __ipipe_restore_root+0x48 (__napi_schedule+0xa4)
| #end 0x80000001 492 6.750 __ipipe_restore_root+0x5c (__napi_schedule+0xa4)
| #begin 0x80000001 498 6.500 netif_rx+0x108 (dm9000_interrupt+0x1c0)
| #end 0x80000001 505 6.000 netif_rx+0x11c (dm9000_interrupt+0x1c0)
#func 511 5.250 __ipipe_restore_root+0x10 (netif_rx+0x16c)
#func 516 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 523 5.250 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 528 7.250 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 535 9.000 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
| +begin 0x80000001 544 6.500 dm9000_interrupt+0x2b0 (handle_IRQ_event+0x40)
| +end 0x80000001 551 8.500 dm9000_interrupt+0x2c4 (handle_IRQ_event+0x40)
| +begin 0x80000001 559 6.750 handle_IRQ_event+0x9c (handle_simple_irq+0x64)
| #end 0x80000001 566 6.250 handle_IRQ_event+0xb0 (handle_simple_irq+0x64)
#func 572 6.000 note_interrupt+0x14 (handle_simple_irq+0x84)
| #func 578 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 585 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 590 6.250 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| #func 597 5.750 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| #func 602 5.750 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| #func 608 6.000 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| #func 614 6.250 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| #func 620 5.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| #func 626 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| #func 632 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 638 6.250 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 644 9.000 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| #*func 653 14.000 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| #*func 667 7.500 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| #*func 675 5.500 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| #*func 680 6.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| #*func 687 9.250 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| #func 696 7.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #end 0xffffffff 704 5.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| #func 709 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 716 5.250 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 721 5.750 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func 727 12.250 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func 739 6.000 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func 745 5.500 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| #func 751 5.750 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func 756 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 763 6.500 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 769 8.000 <bf0071fc> (xnintr_irq_handler+0x44)
| #*func 777 5.750 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func 783 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func 791 7.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 799 6.750 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 805 8.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func 814 6.000 irq_exit+0x10 (__exception_text_start+0x4c)
#func 820 6.000 ipipe_check_context+0x10 (irq_exit+0x18)
#func 826 5.500 __do_softirq+0x10 (irq_exit+0x50)
#func 831 6.250 ipipe_check_context+0x10 (__do_softirq+0x20)
#func 838 6.750 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
| #begin 0x80000000 844 5.250 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
| +func 850 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 856 6.750 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
+func 863 7.250 net_rx_action+0x10 (__do_softirq+0x60)
| +begin 0x80000001 870 6.250 net_rx_action+0x50 (__do_softirq+0x60)
| #end 0x80000001 877 5.750 net_rx_action+0x64 (__do_softirq+0x60)
#func 882 6.750 __ipipe_unstall_root+0x10 (net_rx_action+0x88)
| #begin 0x80000000 889 5.500 __ipipe_unstall_root+0x30 (net_rx_action+0x88)
| +func 895 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 901 5.500 __ipipe_unstall_root+0x68 (net_rx_action+0x88)
+func 907 7.000 process_backlog+0x10 (net_rx_action+0xac)
| +begin 0x80000001 914 6.750 process_backlog+0x60 (net_rx_action+0xac)
| #end 0x80000001 921 5.750 process_backlog+0x74 (net_rx_action+0xac)
#func 926 6.250 __ipipe_unstall_root+0x10 (process_backlog+0xb4)
| #begin 0x80000000 933 5.750 __ipipe_unstall_root+0x30 (process_backlog+0xb4)
| +func 938 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 945 5.500 __ipipe_unstall_root+0x68 (process_backlog+0xb4)
+func 951 8.500 netif_receive_skb+0x14 (process_backlog+0xc0)
+func 959 9.250 ip_rcv+0x14 (netif_receive_skb+0x290)
+func 969 5.750 ip_route_input+0x14 (ip_rcv+0x238)
+func 974 10.250 rt_hash_code+0x10 (ip_route_input+0x38)
| +begin 0x80000001 985 6.250 ip_route_input+0xcc (ip_rcv+0x238)
| +end 0x80000001 991 6.750 ip_route_input+0xe0 (ip_rcv+0x238)
+func 998 7.250 ip_local_deliver+0x10 (ip_rcv+0x538)
+func 1005 6.000 icmp_rcv+0x10 (ip_local_deliver+0xd8)
+func 1011 5.250 __skb_checksum_complete+0x10 (icmp_rcv+0x64)
+func 1016 5.500 __skb_checksum_complete_head+0x10 (__skb_checksum_complete+0x18)
+func 1022 9.500 skb_checksum+0x14 (__skb_checksum_complete_head+0x24)
+func 1031 7.000 icmp_echo+0x14 (icmp_rcv+0x138)
+func 1038 6.000 icmp_reply+0x14 (icmp_echo+0x60)
+func 1044 7.250 ip_options_echo+0x14 (icmp_reply+0x3c)
+func 1051 5.500 local_bh_disable+0x10 (icmp_reply+0x48)
+func 1057 7.500 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func 1064 5.250 ip_route_output_key+0x10 (icmp_reply+0xc8)
+func 1070 6.000 ip_route_output_flow+0x10 (ip_route_output_key+0x1c)
+func 1076 5.750 __ip_route_output_key+0x14 (ip_route_output_flow+0x1c)
+func 1081 6.250 rt_hash_code+0x10 (__ip_route_output_key+0x30)
+func 1088 5.500 local_bh_disable+0x10 (__ip_route_output_key+0x38)
+func 1093 8.750 ipipe_check_context+0x10 (local_bh_disable+0x18)
| +begin 0x80000001 1102 6.750 __ip_route_output_key+0xdc (ip_route_output_flow+0x1c)
| +end 0x80000001 1109 5.500 __ip_route_output_key+0xf0 (ip_route_output_flow+0x1c)
+func 1114 5.500 local_bh_enable+0x10 (__ip_route_output_key+0x11c)
+func 1120 6.000 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func 1126 7.750 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func 1133 5.750 icmp_push_reply+0x14 (icmp_reply+0x140)
+func 1139 6.750 ip_append_data+0x14 (icmp_push_reply+0x50)
| +begin 0x80000001 1146 6.750 ip_append_data+0xd0 (icmp_push_reply+0x50)
| +end 0x80000001 1153 9.250 ip_append_data+0xe8 (icmp_push_reply+0x50)
+func 1162 6.750 sock_alloc_send_skb+0x14 (ip_append_data+0x550)
+func 1169 6.000 __alloc_skb+0x10 (sock_alloc_send_skb+0x94)
+func 1175 7.000 kmem_cache_alloc+0x10 (__alloc_skb+0x34)
| +begin 0x80000001 1182 6.500 kmem_cache_alloc+0x58 (__alloc_skb+0x34)
| #end 0x80000001 1188 6.250 kmem_cache_alloc+0x6c (__alloc_skb+0x34)
#func 1194 5.500 __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
#func 1200 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 1206 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 1212 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 1219 6.000 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func 1225 8.250 __kmalloc+0x10 (__alloc_skb+0x54)
| +begin 0x80000001 1233 6.750 __kmalloc+0x94 (__alloc_skb+0x54)
| #end 0x80000001 1240 5.750 __kmalloc+0xa8 (__alloc_skb+0x54)
#func 1245 5.500 __ipipe_restore_root+0x10 (__kmalloc+0xf8)
#func 1251 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 1257 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 1263 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 1270 8.750 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
| +begin 0x80000001 1279 6.750 sock_alloc_send_skb+0x2a4 (ip_append_data+0x550)
| +end 0x80000001 1285 7.250 sock_alloc_send_skb+0x2b8 (ip_append_data+0x550)
| +begin 0x80000001 1293 6.500 sock_alloc_send_skb+0x2f8 (ip_append_data+0x550)
| +end 0x80000001 1299 6.500 sock_alloc_send_skb+0x30c (ip_append_data+0x550)
+func 1306 5.750 icmp_glue_bits+0x14 (ip_append_data+0x6c0)
+func 1311 11.500 skb_copy_and_csum_bits+0x14 (icmp_glue_bits+0x38)
+func 1323 8.000 ip_push_pending_frames+0x14 (icmp_push_reply+0xfc)
+func 1331 6.500 __ip_select_ident+0x10 (ip_push_pending_frames+0x300)
+func 1337 5.500 local_bh_disable+0x10 (__ip_select_ident+0x54)
+func 1343 7.500 ipipe_check_context+0x10 (local_bh_disable+0x18)
| +func 1350 7.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 1358 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 1363 6.000 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func 1369 5.750 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func 1375 5.500 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func 1380 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func 1386 6.500 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func 1393 5.750 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func 1398 6.250 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func 1405 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 1411 7.000 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 1418 10.000 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func 1428 14.250 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func 1442 7.250 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func 1450 5.750 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func 1455 6.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func 1462 9.250 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func 1471 6.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 1477 7.500 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff 1485 5.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +func 1490 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 1497 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 1502 6.250 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func 1509 12.000 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func 1521 5.500 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func 1526 5.750 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| +func 1532 5.750 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func 1538 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 1544 6.250 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 1550 7.750 <bf0071fc> (xnintr_irq_handler+0x44)
| # func 1558 5.750 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| # func 1564 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| +func 1572 6.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 1578 6.750 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +func 1585 7.000 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff 1592 6.250 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func 1598 5.500 local_bh_enable+0x10 (__ip_select_ident+0x68)
+func 1604 5.750 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func 1610 8.250 ipipe_check_context+0x10 (local_bh_enable+0x98)
| +begin 0x80000001 1618 6.500 ip_push_pending_frames+0x3b0 (icmp_push_reply+0xfc)
| +end 0x80000001 1624 5.500 ip_push_pending_frames+0x3c4 (icmp_push_reply+0xfc)
+func 1630 7.000 icmp_out_count+0x10 (ip_push_pending_frames+0x3e4)
+func 1637 6.250 ip_output+0x10 (ip_push_pending_frames+0x3f4)
+func 1643 8.500 ip_finish_output+0x10 (ip_output+0x54)
+func 1652 7.000 neigh_resolve_output+0x14 (ip_finish_output+0x26c)
+func 1659 5.250 local_bh_disable+0x10 (neigh_resolve_output+0x20c)
+func 1664 6.500 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func 1670 9.000 eth_header+0x10 (neigh_resolve_output+0x258)
+func 1679 5.500 local_bh_enable+0x10 (neigh_resolve_output+0x268)
+func 1685 5.750 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func 1691 6.500 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func 1697 6.500 dev_queue_xmit+0x10 (neigh_resolve_output+0x280)
+func 1704 5.750 local_bh_disable+0x10 (dev_queue_xmit+0x110)
+func 1709 6.750 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func 1716 6.500 dev_hard_start_xmit+0x14 (dev_queue_xmit+0x1e4)
+func 1723 8.000 bond_xmit_roundrobin+0x10 (dev_hard_start_xmit+0x1ec)
+func 1731 5.750 bond_dev_queue_xmit+0x10 (bond_xmit_roundrobin+0xe0)
+func 1736 6.000 dev_queue_xmit+0x10 (bond_dev_queue_xmit+0x1bc)
+func 1742 5.750 local_bh_disable+0x10 (dev_queue_xmit+0x110)
+func 1748 6.500 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func 1755 8.500 pfifo_fast_enqueue+0x10 (dev_queue_xmit+0x138)
| +begin 0x80000001 1763 6.500 dev_queue_xmit+0x174 (bond_dev_queue_xmit+0x1bc)
| +end 0x80000001 1770 6.000 dev_queue_xmit+0x188 (bond_dev_queue_xmit+0x1bc)
+func 1776 5.500 __qdisc_run+0x10 (dev_queue_xmit+0x19c)
+func 1781 6.250 pfifo_fast_dequeue+0x10 (__qdisc_run+0x38)
+func 1787 6.000 dev_hard_start_xmit+0x14 (__qdisc_run+0x5c)
+func 1793 7.250 dm9000_start_xmit+0x10 (dev_hard_start_xmit+0x1ec)
| +begin 0x80000001 1801 6.500 dm9000_start_xmit+0x5c (dev_hard_start_xmit+0x1ec)
| #end 0x80000001 1807 5.750 dm9000_start_xmit+0x70 (dev_hard_start_xmit+0x1ec)
#func 1813 16.750 dm9000_outblk_16bit+0x10 (dm9000_start_xmit+0x9c)
#func 1830 5.750 __ipipe_restore_root+0x10 (dm9000_start_xmit+0x174)
#func 1835 8.000 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #func 1843 7.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 1851 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 1856 6.500 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func 1863 11.250 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func 1874 7.750 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func 1882 6.250 __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
| #func 1888 6.000 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
| #func 1894 6.250 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func 1900 7.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 1908 7.000 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 1915 7.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| #begin 0x80000000 1922 5.750 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 1928 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 1935 5.500 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func 1940 5.750 kfree_skb+0x10 (dm9000_start_xmit+0x17c)
+func 1946 5.500 __kfree_skb+0x10 (kfree_skb+0x80)
+func 1952 6.500 skb_release_all+0x10 (__kfree_skb+0x18)
| +begin 0x80000001 1958 6.250 skb_release_all+0x64 (__kfree_skb+0x18)
| +end 0x80000001 1964 6.000 skb_release_all+0x78 (__kfree_skb+0x18)
+func 1970 6.500 sock_wfree+0x10 (skb_release_all+0xd0)
| +begin 0x80000001 1977 6.750 sock_wfree+0x44 (skb_release_all+0xd0)
| +end 0x80000001 1984 5.250 sock_wfree+0x58 (skb_release_all+0xd0)
+func 1989 7.750 sock_def_write_space+0x10 (sock_wfree+0x74)
| +begin 0x80000001 1997 6.750 sock_wfree+0x94 (skb_release_all+0xd0)
| +end 0x80000001 2003 5.500 sock_wfree+0xa8 (skb_release_all+0xd0)
+func 2009 5.750 skb_release_data+0x10 (skb_release_all+0xd8)
+func 2015 6.750 kfree+0x10 (skb_release_data+0xdc)
| +begin 0x80000001 2021 6.500 kfree+0x4c (skb_release_data+0xdc)
| #end 0x80000001 2028 6.500 kfree+0x60 (skb_release_data+0xdc)
#func 2034 5.250 __ipipe_restore_root+0x10 (kfree+0xfc)
#func 2040 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 2046 5.750 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 2052 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 2059 6.500 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func 2065 6.750 kmem_cache_free+0x10 (__kfree_skb+0x108)
| +begin 0x80000001 2072 6.500 kmem_cache_free+0x48 (__kfree_skb+0x108)
| #end 0x80000001 2078 5.750 kmem_cache_free+0x5c (__kfree_skb+0x108)
#func 2084 5.250 __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
#func 2089 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 2096 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 2101 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 2108 8.250 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
| +begin 0x80000001 2116 6.500 __qdisc_run+0x174 (dev_queue_xmit+0x19c)
| +end 0x80000001 2123 6.250 __qdisc_run+0x188 (dev_queue_xmit+0x19c)
| +func 2129 6.750 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 2136 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 2142 5.750 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func 2147 6.000 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func 2153 5.500 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func 2159 5.500 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func 2164 6.500 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func 2171 5.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func 2176 6.000 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func 2182 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 2189 7.250 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 2196 8.750 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func 2205 14.750 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func 2220 7.250 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func 2227 5.750 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func 2233 6.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func 2239 9.500 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func 2248 6.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 2254 7.750 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff 2262 5.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +func 2268 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 2274 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 2280 5.500 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func 2285 12.250 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func 2298 5.750 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func 2303 5.500 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| +func 2309 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func 2315 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 2321 6.500 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 2328 7.750 <bf0071fc> (xnintr_irq_handler+0x44)
| # func 2336 5.750 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| # func 2341 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| +func 2350 6.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 2356 7.000 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +func 2363 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff 2370 6.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func 2377 5.250 local_bh_enable+0x10 (dev_queue_xmit+0x26c)
+func 2382 6.000 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func 2388 7.250 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func 2395 5.750 local_bh_enable+0x10 (dev_queue_xmit+0x26c)
+func 2401 5.750 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func 2407 7.250 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func 2414 5.500 ip_cork_release+0x10 (ip_push_pending_frames+0x454)
+func 2420 7.250 kfree+0x10 (ip_cork_release+0x28)
| +begin 0x80000001 2427 6.500 ip_cork_release+0x80 (ip_push_pending_frames+0x454)
| +end 0x80000001 2433 8.250 ip_cork_release+0x94 (ip_push_pending_frames+0x454)
| +begin 0x80000001 2442 6.500 icmp_reply+0x190 (icmp_echo+0x60)
| +end 0x80000001 2448 5.750 icmp_reply+0x1a4 (icmp_echo+0x60)
+func 2454 5.250 icmp_xmit_unlock+0x10 (icmp_reply+0x1bc)
+func 2459 5.250 local_bh_enable+0x10 (icmp_xmit_unlock+0x14)
+func 2464 6.000 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func 2470 7.000 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func 2477 5.750 kfree_skb+0x10 (icmp_rcv+0x158)
+func 2483 5.500 __kfree_skb+0x10 (kfree_skb+0x80)
+func 2489 7.000 skb_release_all+0x10 (__kfree_skb+0x18)
| +begin 0x80000001 2496 6.500 skb_release_all+0x64 (__kfree_skb+0x18)
| +end 0x80000001 2502 5.750 skb_release_all+0x78 (__kfree_skb+0x18)
+func 2508 6.000 skb_release_data+0x10 (skb_release_all+0xd8)
+func 2514 6.750 kfree+0x10 (skb_release_data+0xdc)
| +begin 0x80000001 2521 6.500 kfree+0x4c (skb_release_data+0xdc)
| #end 0x80000001 2527 6.000 kfree+0x60 (skb_release_data+0xdc)
#func 2533 5.250 __ipipe_restore_root+0x10 (kfree+0xfc)
#func 2538 6.750 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 2545 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 2551 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 2558 6.000 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func 2564 7.000 kmem_cache_free+0x10 (__kfree_skb+0x108)
| +begin 0x80000001 2571 6.500 kmem_cache_free+0x48 (__kfree_skb+0x108)
| #end 0x80000001 2577 5.750 kmem_cache_free+0x5c (__kfree_skb+0x108)
#func 2583 5.250 __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
#func 2588 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 2595 5.750 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 2600 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 2607 9.750 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
| +begin 0x80000001 2617 7.000 process_backlog+0x168 (net_rx_action+0xac)
| +end 0x80000001 2624 7.250 process_backlog+0x17c (net_rx_action+0xac)
| +begin 0x80000001 2631 6.500 process_backlog+0x60 (net_rx_action+0xac)
| #end 0x80000001 2638 7.000 process_backlog+0x74 (net_rx_action+0xac)
| #begin 0x80000001 2645 6.500 process_backlog+0x134 (net_rx_action+0xac)
| #end 0x80000001 2651 5.500 process_backlog+0x148 (net_rx_action+0xac)
#func 2657 6.250 __ipipe_unstall_root+0x10 (process_backlog+0x150)
| #begin 0x80000000 2663 5.500 __ipipe_unstall_root+0x30 (process_backlog+0x150)
| +func 2669 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 2676 7.750 __ipipe_unstall_root+0x68 (process_backlog+0x150)
| +begin 0x80000001 2683 6.500 net_rx_action+0x118 (__do_softirq+0x60)
| #end 0x80000001 2690 5.500 net_rx_action+0x12c (__do_softirq+0x60)
#func 2695 6.500 __ipipe_unstall_root+0x10 (net_rx_action+0x208)
| #begin 0x80000000 2702 6.000 __ipipe_unstall_root+0x30 (net_rx_action+0x208)
| +func 2708 7.250 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 2715 7.250 __ipipe_unstall_root+0x68 (net_rx_action+0x208)
| +begin 0x80000001 2722 6.500 __do_softirq+0xa8 (irq_exit+0x50)
| #end 0x80000001 2729 5.750 __do_softirq+0xbc (irq_exit+0x50)
#func 2735 6.250 _local_bh_enable+0x10 (__do_softirq+0xfc)
#func 2741 8.000 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
| #begin 0x80000000 2749 8.500 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 2757 6.250 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func 2764 6.000 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 2770 5.750 irq_enter+0x10 (__exception_text_start+0x38)
#func 2775 6.250 ipipe_check_context+0x10 (irq_enter+0x18)
#func 2782 6.250 handle_simple_irq+0x10 (__exception_text_start+0x48)
#func 2788 5.500 handle_IRQ_event+0x10 (handle_simple_irq+0x64)
#func 2793 6.250 __ipipe_unstall_root+0x10 (handle_IRQ_event+0x28)
| #begin 0x80000000 2800 5.750 __ipipe_unstall_root+0x30 (handle_IRQ_event+0x28)
| +func 2805 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 2812 5.500 __ipipe_unstall_root+0x68 (handle_IRQ_event+0x28)
+func 2818 7.750 dm9000_interrupt+0x14 (handle_IRQ_event+0x40)
| +func 2826 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 2833 6.250 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 2839 5.750 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func 2845 10.750 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func 2855 7.250 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func 2863 6.500 __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
| +func 2869 5.500 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
| +func 2875 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func 2881 6.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 2887 7.000 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +func 2894 7.000 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff 2901 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +func 2906 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 2913 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 2919 6.000 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func 2925 6.000 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func 2931 5.750 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func 2937 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func 2943 6.000 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func 2949 5.250 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func 2954 6.000 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func 2960 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 2966 6.750 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 2973 8.750 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func 2982 15.000 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func 2997 7.500 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func 3004 5.500 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func 3010 6.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func 3016 9.750 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func 3026 6.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 3033 7.750 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff 3040 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +func 3046 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 3053 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 3058 5.250 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func 3064 12.000 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func 3076 6.000 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func 3082 5.750 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| +func 3087 5.750 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func 3093 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 3099 6.500 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 3106 8.500 <bf0071fc> (xnintr_irq_handler+0x44)
| # func 3114 5.500 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| # func 3120 8.500 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| +func 3128 6.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 3135 7.250 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +func 3142 7.000 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff 3149 7.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func 3157 7.000 dm9000_inblk_16bit+0x10 (dm9000_interrupt+0xbc)
+func 3164 5.500 __alloc_skb+0x10 (dm9000_interrupt+0x120)
+func 3169 6.750 kmem_cache_alloc+0x10 (__alloc_skb+0x34)
| +begin 0x80000001 3176 6.500 kmem_cache_alloc+0x58 (__alloc_skb+0x34)
| #end 0x80000001 3183 6.000 kmem_cache_alloc+0x6c (__alloc_skb+0x34)
#func 3189 5.500 __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
#func 3194 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 3201 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 3206 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 3213 6.250 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func 3219 8.250 __kmalloc+0x10 (__alloc_skb+0x54)
| +begin 0x80000001 3228 6.500 __kmalloc+0x94 (__alloc_skb+0x54)
| #end 0x80000001 3234 6.250 __kmalloc+0xa8 (__alloc_skb+0x54)
#func 3240 5.750 __ipipe_restore_root+0x10 (__kmalloc+0xf8)
#func 3246 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 3253 5.250 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 3258 7.250 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 3265 8.250 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func 3273 17.500 dm9000_inblk_16bit+0x10 (dm9000_interrupt+0x19c)
+func 3291 7.000 eth_type_trans+0x10 (dm9000_interrupt+0x1b4)
+func 3298 7.500 netif_rx+0x14 (dm9000_interrupt+0x1c0)
| +begin 0x80000001 3305 6.500 netif_rx+0x88 (dm9000_interrupt+0x1c0)
| #end 0x80000001 3312 7.000 netif_rx+0x9c (dm9000_interrupt+0x1c0)
| #begin 0x80000001 3319 6.500 netif_rx+0x1ac (dm9000_interrupt+0x1c0)
| #end 0x80000001 3325 5.500 netif_rx+0x1c0 (dm9000_interrupt+0x1c0)
#func 3331 7.000 __napi_schedule+0x10 (netif_rx+0x1d4)
| #begin 0x80000001 3338 6.500 __napi_schedule+0x44 (netif_rx+0x1d4)
| #end 0x80000001 3344 5.250 __napi_schedule+0x58 (netif_rx+0x1d4)
#func 3350 7.000 __ipipe_restore_root+0x10 (__napi_schedule+0xa4)
| #begin 0x80000001 3357 6.750 __ipipe_restore_root+0x48 (__napi_schedule+0xa4)
| #end 0x80000001 3363 6.750 __ipipe_restore_root+0x5c (__napi_schedule+0xa4)
| #begin 0x80000001 3370 6.500 netif_rx+0x108 (dm9000_interrupt+0x1c0)
| #end 0x80000001 3377 5.750 netif_rx+0x11c (dm9000_interrupt+0x1c0)
#func 3382 5.500 __ipipe_restore_root+0x10 (netif_rx+0x16c)
#func 3388 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 3394 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 3400 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 3407 9.000 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
| +begin 0x80000001 3416 7.250 dm9000_interrupt+0x2b0 (handle_IRQ_event+0x40)
| +end 0x80000001 3423 8.250 dm9000_interrupt+0x2c4 (handle_IRQ_event+0x40)
| +begin 0x80000001 3431 6.750 handle_IRQ_event+0x9c (handle_simple_irq+0x64)
| #end 0x80000001 3438 6.000 handle_IRQ_event+0xb0 (handle_simple_irq+0x64)
#func 3444 6.750 note_interrupt+0x14 (handle_simple_irq+0x84)
#func 3451 5.500 irq_exit+0x10 (__exception_text_start+0x4c)
#func 3456 6.750 ipipe_check_context+0x10 (irq_exit+0x18)
#func 3463 5.500 __do_softirq+0x10 (irq_exit+0x50)
#func 3469 5.750 ipipe_check_context+0x10 (__do_softirq+0x20)
#func 3474 6.250 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
| #begin 0x80000000 3481 5.500 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
| +func 3486 7.250 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 3493 6.500 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
+func 3500 7.000 net_rx_action+0x10 (__do_softirq+0x60)
| +begin 0x80000001 3507 7.000 net_rx_action+0x50 (__do_softirq+0x60)
| #end 0x80000001 3514 5.750 net_rx_action+0x64 (__do_softirq+0x60)
#func 3520 6.500 __ipipe_unstall_root+0x10 (net_rx_action+0x88)
| #begin 0x80000000 3526 6.000 __ipipe_unstall_root+0x30 (net_rx_action+0x88)
| +func 3532 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 3539 5.750 __ipipe_unstall_root+0x68 (net_rx_action+0x88)
+func 3545 6.500 process_backlog+0x10 (net_rx_action+0xac)
| +begin 0x80000001 3551 6.250 process_backlog+0x60 (net_rx_action+0xac)
| #end 0x80000001 3558 5.750 process_backlog+0x74 (net_rx_action+0xac)
#func 3563 6.500 __ipipe_unstall_root+0x10 (process_backlog+0xb4)
| #begin 0x80000000 3570 5.750 __ipipe_unstall_root+0x30 (process_backlog+0xb4)
| +func 3576 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 3582 5.500 __ipipe_unstall_root+0x68 (process_backlog+0xb4)
+func 3588 9.000 netif_receive_skb+0x14 (process_backlog+0xc0)
+func 3597 8.500 ip_rcv+0x14 (netif_receive_skb+0x290)
+func 3605 5.500 ip_route_input+0x14 (ip_rcv+0x238)
+func 3611 10.250 rt_hash_code+0x10 (ip_route_input+0x38)
| +begin 0x80000001 3621 6.500 ip_route_input+0xcc (ip_rcv+0x238)
| +end 0x80000001 3628 7.000 ip_route_input+0xe0 (ip_rcv+0x238)
+func 3635 7.500 ip_local_deliver+0x10 (ip_rcv+0x538)
+func 3642 6.250 icmp_rcv+0x10 (ip_local_deliver+0xd8)
+func 3648 5.750 __skb_checksum_complete+0x10 (icmp_rcv+0x64)
+func 3654 5.250 __skb_checksum_complete_head+0x10 (__skb_checksum_complete+0x18)
+func 3659 9.500 skb_checksum+0x14 (__skb_checksum_complete_head+0x24)
+func 3669 7.250 icmp_echo+0x14 (icmp_rcv+0x138)
+func 3676 7.750 icmp_reply+0x14 (icmp_echo+0x60)
| +func 3684 7.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 3691 6.250 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 3697 6.250 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func 3704 6.000 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func 3710 6.000 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func 3716 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func 3721 6.750 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func 3728 5.750 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func 3734 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func 3740 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 3746 6.750 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 3753 9.000 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func 3762 15.000 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func 3777 7.250 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func 3784 5.750 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func 3790 6.500 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func 3796 8.750 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func 3805 6.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 3812 7.500 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff 3819 5.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +func 3825 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 3831 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 3837 5.750 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func 3843 12.500 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func 3855 5.750 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func 3861 5.250 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| +func 3866 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func 3872 6.000 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 3878 6.250 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 3884 8.250 <bf0071fc> (xnintr_irq_handler+0x44)
| # func 3893 5.500 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| # func 3898 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| +func 3906 6.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 3913 6.750 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +func 3919 7.500 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff 3927 7.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func 3934 6.500 ip_options_echo+0x14 (icmp_reply+0x3c)
+func 3941 5.250 local_bh_disable+0x10 (icmp_reply+0x48)
+func 3946 8.000 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func 3954 5.500 ip_route_output_key+0x10 (icmp_reply+0xc8)
+func 3960 5.250 ip_route_output_flow+0x10 (ip_route_output_key+0x1c)
+func 3965 5.250 __ip_route_output_key+0x14 (ip_route_output_flow+0x1c)
+func 3970 6.250 rt_hash_code+0x10 (__ip_route_output_key+0x30)
+func 3976 5.500 local_bh_disable+0x10 (__ip_route_output_key+0x38)
+func 3982 9.000 ipipe_check_context+0x10 (local_bh_disable+0x18)
| +begin 0x80000001 3991 6.250 __ip_route_output_key+0xdc (ip_route_output_flow+0x1c)
| +end 0x80000001 3997 5.500 __ip_route_output_key+0xf0 (ip_route_output_flow+0x1c)
+func 4003 5.750 local_bh_enable+0x10 (__ip_route_output_key+0x11c)
+func 4008 5.750 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func 4014 7.500 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func 4022 6.000 icmp_push_reply+0x14 (icmp_reply+0x140)
+func 4028 7.000 ip_append_data+0x14 (icmp_push_reply+0x50)
| +begin 0x80000001 4035 6.500 ip_append_data+0xd0 (icmp_push_reply+0x50)
| +end 0x80000001 4041 9.500 ip_append_data+0xe8 (icmp_push_reply+0x50)
+func 4051 6.750 sock_alloc_send_skb+0x14 (ip_append_data+0x550)
+func 4057 5.750 __alloc_skb+0x10 (sock_alloc_send_skb+0x94)
+func 4063 6.750 kmem_cache_alloc+0x10 (__alloc_skb+0x34)
| +begin 0x80000001 4070 6.500 kmem_cache_alloc+0x58 (__alloc_skb+0x34)
| #end 0x80000001 4076 6.000 kmem_cache_alloc+0x6c (__alloc_skb+0x34)
#func 4082 6.000 __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
#func 4088 6.250 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 4095 5.750 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 4100 7.250 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 4108 6.000 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func 4114 8.750 __kmalloc+0x10 (__alloc_skb+0x54)
| +begin 0x80000001 4122 6.250 __kmalloc+0x94 (__alloc_skb+0x54)
| #end 0x80000001 4129 6.000 __kmalloc+0xa8 (__alloc_skb+0x54)
#func 4135 5.500 __ipipe_restore_root+0x10 (__kmalloc+0xf8)
#func 4140 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 4147 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 4152 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 4159 9.250 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
| +begin 0x80000001 4168 6.250 sock_alloc_send_skb+0x2a4 (ip_append_data+0x550)
| +end 0x80000001 4175 6.750 sock_alloc_send_skb+0x2b8 (ip_append_data+0x550)
| +begin 0x80000001 4181 6.500 sock_alloc_send_skb+0x2f8 (ip_append_data+0x550)
| +end 0x80000001 4188 7.000 sock_alloc_send_skb+0x30c (ip_append_data+0x550)
+func 4195 5.500 icmp_glue_bits+0x14 (ip_append_data+0x6c0)
+func 4200 11.000 skb_copy_and_csum_bits+0x14 (icmp_glue_bits+0x38)
+func 4211 7.500 ip_push_pending_frames+0x14 (icmp_push_reply+0xfc)
+func 4219 6.250 __ip_select_ident+0x10 (ip_push_pending_frames+0x300)
+func 4225 5.500 local_bh_disable+0x10 (__ip_select_ident+0x54)
+func 4231 6.250 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func 4237 5.750 local_bh_enable+0x10 (__ip_select_ident+0x68)
+func 4243 5.750 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func 4248 8.000 ipipe_check_context+0x10 (local_bh_enable+0x98)
| +begin 0x80000001 4256 6.500 ip_push_pending_frames+0x3b0 (icmp_push_reply+0xfc)
| +end 0x80000001 4263 5.500 ip_push_pending_frames+0x3c4 (icmp_push_reply+0xfc)
+func 4268 7.000 icmp_out_count+0x10 (ip_push_pending_frames+0x3e4)
+func 4275 6.000 ip_output+0x10 (ip_push_pending_frames+0x3f4)
+func 4281 8.250 ip_finish_output+0x10 (ip_output+0x54)
+func 4290 6.500 neigh_resolve_output+0x14 (ip_finish_output+0x26c)
+func 4296 6.000 local_bh_disable+0x10 (neigh_resolve_output+0x20c)
+func 4302 6.000 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func 4308 8.750 eth_header+0x10 (neigh_resolve_output+0x258)
+func 4317 5.500 local_bh_enable+0x10 (neigh_resolve_output+0x268)
+func 4322 6.000 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func 4328 6.500 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func 4335 6.250 dev_queue_xmit+0x10 (neigh_resolve_output+0x280)
+func 4341 5.500 local_bh_disable+0x10 (dev_queue_xmit+0x110)
+func 4347 6.750 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func 4353 6.250 dev_hard_start_xmit+0x14 (dev_queue_xmit+0x1e4)
+func 4360 9.500 bond_xmit_roundrobin+0x10 (dev_hard_start_xmit+0x1ec)
+func 4369 6.250 bond_dev_queue_xmit+0x10 (bond_xmit_roundrobin+0xe0)
+func 4375 6.250 dev_queue_xmit+0x10 (bond_dev_queue_xmit+0x1bc)
+func 4382 6.000 local_bh_disable+0x10 (dev_queue_xmit+0x110)
+func 4388 6.250 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func 4394 8.250 pfifo_fast_enqueue+0x10 (dev_queue_xmit+0x138)
| +begin 0x80000001 4402 6.500 dev_queue_xmit+0x174 (bond_dev_queue_xmit+0x1bc)
| +end 0x80000001 4409 5.250 dev_queue_xmit+0x188 (bond_dev_queue_xmit+0x1bc)
+func 4414 5.500 __qdisc_run+0x10 (dev_queue_xmit+0x19c)
+func 4419 6.500 pfifo_fast_dequeue+0x10 (__qdisc_run+0x38)
+func 4426 6.500 dev_hard_start_xmit+0x14 (__qdisc_run+0x5c)
+func 4432 7.000 dm9000_start_xmit+0x10 (dev_hard_start_xmit+0x1ec)
| +begin 0x80000001 4439 6.250 dm9000_start_xmit+0x5c (dev_hard_start_xmit+0x1ec)
| #end 0x80000001 4446 5.750 dm9000_start_xmit+0x70 (dev_hard_start_xmit+0x1ec)
#func 4451 8.000 dm9000_outblk_16bit+0x10 (dm9000_start_xmit+0x9c)
| #func 4459 7.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 4467 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 4472 6.000 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| #func 4478 6.250 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| #func 4484 5.750 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| #func 4490 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| #func 4496 6.250 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| #func 4502 5.750 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| #func 4508 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| #func 4514 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 4520 7.000 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 4527 9.500 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| #*func 4537 15.000 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| #*func 4552 7.250 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| #*func 4559 5.500 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| #*func 4564 7.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| #*func 4572 9.500 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| #func 4581 7.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #end 0xffffffff 4589 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| #func 4594 6.750 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 4601 5.250 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 4606 5.750 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func 4612 12.000 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func 4624 6.000 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func 4630 5.750 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| #func 4636 5.500 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func 4641 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 4648 7.000 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 4655 8.500 <bf0071fc> (xnintr_irq_handler+0x44)
| #*func 4663 6.000 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func 4669 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func 4678 8.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 4686 6.750 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 4692 18.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func 4711 5.750 __ipipe_restore_root+0x10 (dm9000_start_xmit+0x174)
#func 4717 6.000 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #func 4723 6.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 4729 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 4734 6.250 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func 4741 11.000 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func 4752 6.750 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func 4758 6.250 __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
| #func 4765 5.750 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
| #func 4770 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func 4776 7.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 4784 7.500 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 4791 8.000 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| #begin 0x80000000 4799 6.250 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 4805 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 4812 5.500 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func 4818 5.500 kfree_skb+0x10 (dm9000_start_xmit+0x17c)
+func 4823 5.750 __kfree_skb+0x10 (kfree_skb+0x80)
+func 4829 6.750 skb_release_all+0x10 (__kfree_skb+0x18)
| +begin 0x80000001 4836 6.500 skb_release_all+0x64 (__kfree_skb+0x18)
| +end 0x80000001 4842 5.750 skb_release_all+0x78 (__kfree_skb+0x18)
+func 4848 6.500 sock_wfree+0x10 (skb_release_all+0xd0)
| +begin 0x80000001 4854 7.000 sock_wfree+0x44 (skb_release_all+0xd0)
| +end 0x80000001 4861 5.750 sock_wfree+0x58 (skb_release_all+0xd0)
+func 4867 8.000 sock_def_write_space+0x10 (sock_wfree+0x74)
| +begin 0x80000001 4875 7.500 sock_wfree+0x94 (skb_release_all+0xd0)
| +end 0x80000001 4883 5.500 sock_wfree+0xa8 (skb_release_all+0xd0)
+func 4888 5.750 skb_release_data+0x10 (skb_release_all+0xd8)
+func 4894 6.750 kfree+0x10 (skb_release_data+0xdc)
| +begin 0x80000001 4901 6.250 kfree+0x4c (skb_release_data+0xdc)
| #end 0x80000001 4907 6.500 kfree+0x60 (skb_release_data+0xdc)
#func 4913 5.250 __ipipe_restore_root+0x10 (kfree+0xfc)
#func 4919 6.750 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 4925 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 4931 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 4938 6.500 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func 4944 6.750 kmem_cache_free+0x10 (__kfree_skb+0x108)
| +begin 0x80000001 4951 6.750 kmem_cache_free+0x48 (__kfree_skb+0x108)
| #end 0x80000001 4958 5.500 kmem_cache_free+0x5c (__kfree_skb+0x108)
#func 4963 5.250 __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
#func 4969 6.750 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 4975 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 4981 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 4988 8.750 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
| +begin 0x80000001 4996 6.500 __qdisc_run+0x174 (dev_queue_xmit+0x19c)
| +end 0x80000001 5003 5.750 __qdisc_run+0x188 (dev_queue_xmit+0x19c)
+func 5009 5.500 local_bh_enable+0x10 (dev_queue_xmit+0x26c)
+func 5014 6.000 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func 5020 7.750 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func 5028 6.000 local_bh_enable+0x10 (dev_queue_xmit+0x26c)
+func 5034 6.000 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func 5040 7.250 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func 5047 5.750 ip_cork_release+0x10 (ip_push_pending_frames+0x454)
+func 5053 7.000 kfree+0x10 (ip_cork_release+0x28)
| +begin 0x80000001 5060 6.500 ip_cork_release+0x80 (ip_push_pending_frames+0x454)
| +end 0x80000001 5066 7.750 ip_cork_release+0x94 (ip_push_pending_frames+0x454)
| +begin 0x80000001 5074 6.500 icmp_reply+0x190 (icmp_echo+0x60)
| +end 0x80000001 5081 5.500 icmp_reply+0x1a4 (icmp_echo+0x60)
+func 5086 5.250 icmp_xmit_unlock+0x10 (icmp_reply+0x1bc)
+func 5091 5.250 local_bh_enable+0x10 (icmp_xmit_unlock+0x14)
+func 5097 6.000 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func 5103 7.000 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func 5110 5.500 kfree_skb+0x10 (icmp_rcv+0x158)
+func 5115 5.250 __kfree_skb+0x10 (kfree_skb+0x80)
+func 5120 7.250 skb_release_all+0x10 (__kfree_skb+0x18)
| +begin 0x80000001 5128 6.500 skb_release_all+0x64 (__kfree_skb+0x18)
| +end 0x80000001 5134 6.000 skb_release_all+0x78 (__kfree_skb+0x18)
+func 5140 6.000 skb_release_data+0x10 (skb_release_all+0xd8)
+func 5146 6.750 kfree+0x10 (skb_release_data+0xdc)
| +begin 0x80000001 5153 6.750 kfree+0x4c (skb_release_data+0xdc)
| #end 0x80000001 5160 6.000 kfree+0x60 (skb_release_data+0xdc)
#func 5166 5.250 __ipipe_restore_root+0x10 (kfree+0xfc)
#func 5171 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 5177 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 5183 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 5190 6.000 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func 5196 6.500 kmem_cache_free+0x10 (__kfree_skb+0x108)
| +begin 0x80000001 5202 6.750 kmem_cache_free+0x48 (__kfree_skb+0x108)
| #end 0x80000001 5209 6.000 kmem_cache_free+0x5c (__kfree_skb+0x108)
#func 5215 5.250 __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
#func 5220 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 5227 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 5232 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 5239 6.750 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
| +func 5246 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 5253 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 5259 5.750 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func 5264 5.250 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func 5270 6.000 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func 5276 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func 5281 6.250 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func 5288 5.250 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func 5293 6.000 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func 5299 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 5305 6.500 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 5312 8.750 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func 5321 14.500 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func 5335 7.500 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func 5343 5.500 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func 5348 6.000 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func 5354 9.250 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func 5363 6.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 5370 7.250 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff 5377 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +func 5383 6.750 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 5390 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 5395 5.750 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func 5401 12.000 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func 5413 6.000 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func 5419 5.750 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| +func 5425 5.500 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func 5430 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 5436 6.750 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 5443 8.250 <bf0071fc> (xnintr_irq_handler+0x44)
| # func 5451 5.500 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| # func 5457 8.000 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| +func 5465 6.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 5472 7.500 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +func 5479 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff 5486 10.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +begin 0x80000001 5497 7.000 process_backlog+0x168 (net_rx_action+0xac)
| +end 0x80000001 5504 7.250 process_backlog+0x17c (net_rx_action+0xac)
| +begin 0x80000001 5511 6.500 process_backlog+0x60 (net_rx_action+0xac)
| #end 0x80000001 5518 7.250 process_backlog+0x74 (net_rx_action+0xac)
| #begin 0x80000001 5525 6.750 process_backlog+0x134 (net_rx_action+0xac)
| #end 0x80000001 5532 5.500 process_backlog+0x148 (net_rx_action+0xac)
#func 5537 6.500 __ipipe_unstall_root+0x10 (process_backlog+0x150)
| #begin 0x80000000 5544 5.500 __ipipe_unstall_root+0x30 (process_backlog+0x150)
| +func 5549 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 5556 7.750 __ipipe_unstall_root+0x68 (process_backlog+0x150)
| +begin 0x80000001 5564 6.250 net_rx_action+0x118 (__do_softirq+0x60)
| #end 0x80000001 5570 5.750 net_rx_action+0x12c (__do_softirq+0x60)
#func 5576 6.500 __ipipe_unstall_root+0x10 (net_rx_action+0x208)
| #begin 0x80000000 5582 6.250 __ipipe_unstall_root+0x30 (net_rx_action+0x208)
| +func 5589 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 5595 7.000 __ipipe_unstall_root+0x68 (net_rx_action+0x208)
| +begin 0x80000001 5602 6.500 __do_softirq+0xa8 (irq_exit+0x50)
| #end 0x80000001 5609 6.000 __do_softirq+0xbc (irq_exit+0x50)
#func 5615 6.000 _local_bh_enable+0x10 (__do_softirq+0xfc)
#func 5621 8.000 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
| #begin 0x80000000 5629 8.250 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 5637 5.750 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func 5643 6.250 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 5649 5.500 irq_enter+0x10 (__exception_text_start+0x38)
#func 5655 6.000 ipipe_check_context+0x10 (irq_enter+0x18)
#func 5661 6.250 handle_simple_irq+0x10 (__exception_text_start+0x48)
#func 5667 5.500 handle_IRQ_event+0x10 (handle_simple_irq+0x64)
#func 5672 6.500 __ipipe_unstall_root+0x10 (handle_IRQ_event+0x28)
| #begin 0x80000000 5679 5.500 __ipipe_unstall_root+0x30 (handle_IRQ_event+0x28)
| +func 5684 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 5691 5.750 __ipipe_unstall_root+0x68 (handle_IRQ_event+0x28)
+func 5697 8.000 dm9000_interrupt+0x14 (handle_IRQ_event+0x40)
| +func 5705 7.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 5712 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 5718 5.500 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func 5724 11.250 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func 5735 7.250 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func 5742 7.000 __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
| +func 5749 5.500 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
| +func 5755 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func 5761 6.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 5767 7.000 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +func 5774 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff 5781 7.250 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func 5788 7.250 dm9000_inblk_16bit+0x10 (dm9000_interrupt+0xbc)
+func 5796 6.000 __alloc_skb+0x10 (dm9000_interrupt+0x120)
+func 5802 6.750 kmem_cache_alloc+0x10 (__alloc_skb+0x34)
| +begin 0x80000001 5808 6.500 kmem_cache_alloc+0x58 (__alloc_skb+0x34)
| #end 0x80000001 5815 6.000 kmem_cache_alloc+0x6c (__alloc_skb+0x34)
#func 5821 5.500 __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
#func 5826 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 5833 5.250 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 5838 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 5845 6.250 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func 5851 8.250 __kmalloc+0x10 (__alloc_skb+0x54)
| +begin 0x80000001 5860 6.750 __kmalloc+0x94 (__alloc_skb+0x54)
| #end 0x80000001 5866 5.750 __kmalloc+0xa8 (__alloc_skb+0x54)
#func 5872 5.500 __ipipe_restore_root+0x10 (__kmalloc+0xf8)
#func 5878 6.750 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 5884 5.250 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 5890 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 5897 8.500 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func 5905 17.250 dm9000_inblk_16bit+0x10 (dm9000_interrupt+0x19c)
+func 5922 6.750 eth_type_trans+0x10 (dm9000_interrupt+0x1b4)
+func 5929 7.500 netif_rx+0x14 (dm9000_interrupt+0x1c0)
| +begin 0x80000001 5937 6.500 netif_rx+0x88 (dm9000_interrupt+0x1c0)
| #end 0x80000001 5943 6.750 netif_rx+0x9c (dm9000_interrupt+0x1c0)
| #begin 0x80000001 5950 6.500 netif_rx+0x1ac (dm9000_interrupt+0x1c0)
| #end 0x80000001 5956 5.500 netif_rx+0x1c0 (dm9000_interrupt+0x1c0)
#func 5962 7.000 __napi_schedule+0x10 (netif_rx+0x1d4)
| #begin 0x80000001 5969 6.250 __napi_schedule+0x44 (netif_rx+0x1d4)
| #end 0x80000001 5975 5.500 __napi_schedule+0x58 (netif_rx+0x1d4)
#func 5981 6.750 __ipipe_restore_root+0x10 (__napi_schedule+0xa4)
| #begin 0x80000001 5987 7.250 __ipipe_restore_root+0x48 (__napi_schedule+0xa4)
| #end 0x80000001 5995 6.500 __ipipe_restore_root+0x5c (__napi_schedule+0xa4)
| #begin 0x80000001 6001 6.500 netif_rx+0x108 (dm9000_interrupt+0x1c0)
| #end 0x80000001 6008 6.500 netif_rx+0x11c (dm9000_interrupt+0x1c0)
| #func 6014 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 6021 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 6027 5.750 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| #func 6032 5.750 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| #func 6038 5.750 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| #func 6044 5.500 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| #func 6049 6.250 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| #func 6056 5.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| #func 6061 6.000 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| #func 6067 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 6074 6.750 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 6080 9.750 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| #*func 6090 14.500 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| #*func 6105 7.000 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| #*func 6112 5.250 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| #*func 6117 6.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| #*func 6123 9.500 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| #func 6133 8.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #end 0xffffffff 6141 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| #func 6146 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 6153 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 6158 5.750 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func 6164 11.750 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func 6176 6.000 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func 6182 5.500 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| #func 6187 5.500 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func 6193 6.000 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 6199 6.250 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 6205 8.250 <bf0071fc> (xnintr_irq_handler+0x44)
| #*func 6213 5.500 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func 6219 8.000 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func 6227 8.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 6235 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 6242 6.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func 6249 5.250 __ipipe_restore_root+0x10 (netif_rx+0x16c)
#func 6254 6.750 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 6261 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func 6266 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 6273 8.750 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
| +begin 0x80000001 6282 6.750 dm9000_interrupt+0x2b0 (handle_IRQ_event+0x40)
| +end 0x80000001 6289 8.750 dm9000_interrupt+0x2c4 (handle_IRQ_event+0x40)
| +begin 0x80000001 6298 7.000 handle_IRQ_event+0x9c (handle_simple_irq+0x64)
| #end 0x80000001 6305 5.750 handle_IRQ_event+0xb0 (handle_simple_irq+0x64)
#func 6310 7.000 note_interrupt+0x14 (handle_simple_irq+0x84)
#func 6317 6.000 irq_exit+0x10 (__exception_text_start+0x4c)
#func 6323 6.250 ipipe_check_context+0x10 (irq_exit+0x18)
#func 6330 5.250 __do_softirq+0x10 (irq_exit+0x50)
#func 6335 5.750 ipipe_check_context+0x10 (__do_softirq+0x20)
#func 6341 6.750 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
| #begin 0x80000000 6347 5.500 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
| +func 6353 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 6360 6.750 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
+func 6366 7.000 net_rx_action+0x10 (__do_softirq+0x60)
| +begin 0x80000001 6373 6.250 net_rx_action+0x50 (__do_softirq+0x60)
| #end 0x80000001 6380 5.500 net_rx_action+0x64 (__do_softirq+0x60)
#func 6385 6.500 __ipipe_unstall_root+0x10 (net_rx_action+0x88)
| #begin 0x80000000 6392 6.250 __ipipe_unstall_root+0x30 (net_rx_action+0x88)
| +func 6398 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 6405 5.750 __ipipe_unstall_root+0x68 (net_rx_action+0x88)
+func 6411 6.500 process_backlog+0x10 (net_rx_action+0xac)
| +begin 0x80000001 6417 6.500 process_backlog+0x60 (net_rx_action+0xac)
| #end 0x80000001 6424 5.750 process_backlog+0x74 (net_rx_action+0xac)
#func 6429 6.250 __ipipe_unstall_root+0x10 (process_backlog+0xb4)
| #begin 0x80000000 6436 5.750 __ipipe_unstall_root+0x30 (process_backlog+0xb4)
| +func 6441 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 6448 5.500 __ipipe_unstall_root+0x68 (process_backlog+0xb4)
+func 6454 9.000 netif_receive_skb+0x14 (process_backlog+0xc0)
+func 6463 9.250 ip_rcv+0x14 (netif_receive_skb+0x290)
+func 6472 5.750 ip_route_input+0x14 (ip_rcv+0x238)
+func 6478 9.750 rt_hash_code+0x10 (ip_route_input+0x38)
| +begin 0x80000001 6488 6.250 ip_route_input+0xcc (ip_rcv+0x238)
| +end 0x80000001 6494 7.750 ip_route_input+0xe0 (ip_rcv+0x238)
+func 6502 7.250 ip_local_deliver+0x10 (ip_rcv+0x538)
+func 6509 6.000 icmp_rcv+0x10 (ip_local_deliver+0xd8)
+func 6515 5.250 __skb_checksum_complete+0x10 (icmp_rcv+0x64)
+func 6520 5.500 __skb_checksum_complete_head+0x10 (__skb_checksum_complete+0x18)
+func 6526 10.250 skb_checksum+0x14 (__skb_checksum_complete_head+0x24)
+func 6536 5.750 icmp_echo+0x14 (icmp_rcv+0x138)
+func 6542 6.500 icmp_reply+0x14 (icmp_echo+0x60)
+func 6548 7.000 ip_options_echo+0x14 (icmp_reply+0x3c)
+func 6555 5.500 local_bh_disable+0x10 (icmp_reply+0x48)
+func 6561 7.250 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func 6568 5.250 ip_route_output_key+0x10 (icmp_reply+0xc8)
+func 6573 5.750 ip_route_output_flow+0x10 (ip_route_output_key+0x1c)
+func 6579 5.500 __ip_route_output_key+0x14 (ip_route_output_flow+0x1c)
+func 6584 6.250 rt_hash_code+0x10 (__ip_route_output_key+0x30)
+func 6591 5.250 local_bh_disable+0x10 (__ip_route_output_key+0x38)
+func 6596 9.000 ipipe_check_context+0x10 (local_bh_disable+0x18)
| +begin 0x80000001 6605 6.750 __ip_route_output_key+0xdc (ip_route_output_flow+0x1c)
| +end 0x80000001 6612 5.500 __ip_route_output_key+0xf0 (ip_route_output_flow+0x1c)
+func 6617 5.500 local_bh_enable+0x10 (__ip_route_output_key+0x11c)
+func 6623 5.750 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func 6628 8.000 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func 6636 5.750 icmp_push_reply+0x14 (icmp_reply+0x140)
+func 6642 6.750 ip_append_data+0x14 (icmp_push_reply+0x50)
| +begin 0x80000001 6649 6.500 ip_append_data+0xd0 (icmp_push_reply+0x50)
| +end 0x80000001 6655 9.250 ip_append_data+0xe8 (icmp_push_reply+0x50)
+func 6665 7.000 sock_alloc_send_skb+0x14 (ip_append_data+0x550)
+func 6672 5.750 __alloc_skb+0x10 (sock_alloc_send_skb+0x94)
+func 6677 6.750 kmem_cache_alloc+0x10 (__alloc_skb+0x34)
| +begin 0x80000001 6684 6.750 kmem_cache_alloc+0x58 (__alloc_skb+0x34)
| #end 0x80000001 6691 5.750 kmem_cache_alloc+0x6c (__alloc_skb+0x34)
#func 6697 5.250 __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
#func 6702 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 6708 0.000 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
[-- Attachment #5: max3.txt --]
[-- Type: text/plain, Size: 90910 bytes --]
I-pipe worst-case tracing service on 2.6.24.3/ipipe-1.9-00
------------------------------------------------------------
CPU: 0, Begin: 6446335856 cycles, Trace Points: 19 (-1000/+2), Length: 999 us
Calibrated minimum trace-point overhead: 1.500 us
+----- Hard IRQs ('|': locked)
|+---- <unused>
||+--- <unused>
|||+-- Xenomai
||||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
||||| +---------- Delay flag ('+': > 1 us, '!': > 10 us)
||||| | +- NMI noise ('N')
||||| | |
Type User Val. Time Delay Function (Parent)
| #*func -7559 8.000 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func -7551 7.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func -7544 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff -7536 7.250 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| #begin 0x80000000 -7529 5.500 __ipipe_unstall_root+0x30 (process_backlog+0x150)
| +func -7524 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -7517 7.500 __ipipe_unstall_root+0x68 (process_backlog+0x150)
| +begin 0x80000001 -7509 6.500 net_rx_action+0x118 (__do_softirq+0x60)
| #end 0x80000001 -7503 5.500 net_rx_action+0x12c (__do_softirq+0x60)
#func -7497 6.750 __ipipe_unstall_root+0x10 (net_rx_action+0x208)
| #begin 0x80000000 -7490 5.750 __ipipe_unstall_root+0x30 (net_rx_action+0x208)
| +func -7485 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -7478 6.750 __ipipe_unstall_root+0x68 (net_rx_action+0x208)
| +begin 0x80000001 -7471 6.500 __do_softirq+0xa8 (irq_exit+0x50)
| #end 0x80000001 -7464 6.000 __do_softirq+0xbc (irq_exit+0x50)
#func -7458 5.750 _local_bh_enable+0x10 (__do_softirq+0xfc)
#func -7453 8.000 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
| #begin 0x80000000 -7445 8.750 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 -7436 6.250 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func -7430 5.750 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func -7424 5.500 irq_enter+0x10 (__exception_text_start+0x38)
#func -7418 6.000 ipipe_check_context+0x10 (irq_enter+0x18)
#func -7412 6.000 handle_simple_irq+0x10 (__exception_text_start+0x48)
#func -7406 5.750 handle_IRQ_event+0x10 (handle_simple_irq+0x64)
#func -7401 6.250 __ipipe_unstall_root+0x10 (handle_IRQ_event+0x28)
| #begin 0x80000000 -7394 5.500 __ipipe_unstall_root+0x30 (handle_IRQ_event+0x28)
| +func -7389 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -7382 5.750 __ipipe_unstall_root+0x68 (handle_IRQ_event+0x28)
+func -7376 7.500 dm9000_interrupt+0x14 (handle_IRQ_event+0x40)
| +func -7369 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff -7362 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func -7356 5.750 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func -7350 10.750 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func -7339 7.250 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func -7332 6.250 __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
| +func -7326 5.500 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
| +func -7320 5.750 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func -7315 7.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func -7308 7.000 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +func -7301 7.000 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff -7294 7.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func -7286 6.750 dm9000_inblk_16bit+0x10 (dm9000_interrupt+0xbc)
+func -7279 6.000 __alloc_skb+0x10 (dm9000_interrupt+0x120)
+func -7273 7.000 kmem_cache_alloc+0x10 (__alloc_skb+0x34)
| +begin 0x80000001 -7266 6.250 kmem_cache_alloc+0x58 (__alloc_skb+0x34)
| #end 0x80000001 -7260 6.000 kmem_cache_alloc+0x6c (__alloc_skb+0x34)
#func -7254 5.500 __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
#func -7249 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -7242 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -7237 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -7230 6.250 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func -7223 8.500 __kmalloc+0x10 (__alloc_skb+0x54)
| +begin 0x80000001 -7215 6.500 __kmalloc+0x94 (__alloc_skb+0x54)
| #end 0x80000001 -7208 6.000 __kmalloc+0xa8 (__alloc_skb+0x54)
#func -7202 5.750 __ipipe_restore_root+0x10 (__kmalloc+0xf8)
#func -7197 6.250 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -7190 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -7185 7.250 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -7178 8.250 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func -7169 17.500 dm9000_inblk_16bit+0x10 (dm9000_interrupt+0x19c)
+func -7152 7.000 eth_type_trans+0x10 (dm9000_interrupt+0x1b4)
+func -7145 7.250 netif_rx+0x14 (dm9000_interrupt+0x1c0)
| +begin 0x80000001 -7138 6.750 netif_rx+0x88 (dm9000_interrupt+0x1c0)
| #end 0x80000001 -7131 7.000 netif_rx+0x9c (dm9000_interrupt+0x1c0)
| #begin 0x80000001 -7124 6.250 netif_rx+0x1ac (dm9000_interrupt+0x1c0)
| #end 0x80000001 -7118 6.000 netif_rx+0x1c0 (dm9000_interrupt+0x1c0)
#func -7112 7.000 __napi_schedule+0x10 (netif_rx+0x1d4)
| #begin 0x80000001 -7105 6.500 __napi_schedule+0x44 (netif_rx+0x1d4)
| #end 0x80000001 -7098 5.250 __napi_schedule+0x58 (netif_rx+0x1d4)
#func -7093 6.750 __ipipe_restore_root+0x10 (__napi_schedule+0xa4)
| #begin 0x80000001 -7086 6.750 __ipipe_restore_root+0x48 (__napi_schedule+0xa4)
| #end 0x80000001 -7079 6.750 __ipipe_restore_root+0x5c (__napi_schedule+0xa4)
| #begin 0x80000001 -7073 6.500 netif_rx+0x108 (dm9000_interrupt+0x1c0)
| #end 0x80000001 -7066 6.000 netif_rx+0x11c (dm9000_interrupt+0x1c0)
#func -7060 5.250 __ipipe_restore_root+0x10 (netif_rx+0x16c)
#func -7055 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -7048 5.250 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -7043 7.250 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -7036 9.000 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
| +begin 0x80000001 -7027 6.500 dm9000_interrupt+0x2b0 (handle_IRQ_event+0x40)
| +end 0x80000001 -7020 8.500 dm9000_interrupt+0x2c4 (handle_IRQ_event+0x40)
| +begin 0x80000001 -7012 6.750 handle_IRQ_event+0x9c (handle_simple_irq+0x64)
| #end 0x80000001 -7005 6.250 handle_IRQ_event+0xb0 (handle_simple_irq+0x64)
#func -6999 6.000 note_interrupt+0x14 (handle_simple_irq+0x84)
| #func -6993 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff -6986 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func -6981 6.250 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| #func -6974 5.750 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| #func -6969 5.750 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| #func -6963 6.000 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| #func -6957 6.250 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| #func -6951 5.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| #func -6945 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| #func -6939 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func -6933 6.250 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func -6927 9.000 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| #*func -6918 14.000 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| #*func -6904 7.500 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| #*func -6896 5.500 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| #*func -6891 6.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| #*func -6884 9.250 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| #func -6875 7.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #end 0xffffffff -6867 5.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| #func -6862 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff -6855 5.250 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func -6850 5.750 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func -6844 12.250 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func -6832 6.000 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func -6826 5.500 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| #func -6820 5.750 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func -6815 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func -6808 6.500 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func -6802 8.000 <bf0071fc> (xnintr_irq_handler+0x44)
| #*func -6794 5.750 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func -6788 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func -6780 7.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func -6772 6.750 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff -6766 8.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func -6757 6.000 irq_exit+0x10 (__exception_text_start+0x4c)
#func -6751 6.000 ipipe_check_context+0x10 (irq_exit+0x18)
#func -6745 5.500 __do_softirq+0x10 (irq_exit+0x50)
#func -6740 6.250 ipipe_check_context+0x10 (__do_softirq+0x20)
#func -6733 6.750 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
| #begin 0x80000000 -6727 5.250 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
| +func -6721 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -6715 6.750 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
+func -6708 7.250 net_rx_action+0x10 (__do_softirq+0x60)
| +begin 0x80000001 -6701 6.250 net_rx_action+0x50 (__do_softirq+0x60)
| #end 0x80000001 -6694 5.750 net_rx_action+0x64 (__do_softirq+0x60)
#func -6689 6.750 __ipipe_unstall_root+0x10 (net_rx_action+0x88)
| #begin 0x80000000 -6682 5.500 __ipipe_unstall_root+0x30 (net_rx_action+0x88)
| +func -6676 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -6670 5.500 __ipipe_unstall_root+0x68 (net_rx_action+0x88)
+func -6664 7.000 process_backlog+0x10 (net_rx_action+0xac)
| +begin 0x80000001 -6657 6.750 process_backlog+0x60 (net_rx_action+0xac)
| #end 0x80000001 -6650 5.750 process_backlog+0x74 (net_rx_action+0xac)
#func -6645 6.250 __ipipe_unstall_root+0x10 (process_backlog+0xb4)
| #begin 0x80000000 -6638 5.750 __ipipe_unstall_root+0x30 (process_backlog+0xb4)
| +func -6633 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -6626 5.500 __ipipe_unstall_root+0x68 (process_backlog+0xb4)
+func -6620 8.500 netif_receive_skb+0x14 (process_backlog+0xc0)
+func -6612 9.250 ip_rcv+0x14 (netif_receive_skb+0x290)
+func -6602 5.750 ip_route_input+0x14 (ip_rcv+0x238)
+func -6597 10.250 rt_hash_code+0x10 (ip_route_input+0x38)
| +begin 0x80000001 -6586 6.250 ip_route_input+0xcc (ip_rcv+0x238)
| +end 0x80000001 -6580 6.750 ip_route_input+0xe0 (ip_rcv+0x238)
+func -6573 7.250 ip_local_deliver+0x10 (ip_rcv+0x538)
+func -6566 6.000 icmp_rcv+0x10 (ip_local_deliver+0xd8)
+func -6560 5.250 __skb_checksum_complete+0x10 (icmp_rcv+0x64)
+func -6555 5.500 __skb_checksum_complete_head+0x10 (__skb_checksum_complete+0x18)
+func -6549 9.500 skb_checksum+0x14 (__skb_checksum_complete_head+0x24)
+func -6540 7.000 icmp_echo+0x14 (icmp_rcv+0x138)
+func -6533 6.000 icmp_reply+0x14 (icmp_echo+0x60)
+func -6527 7.250 ip_options_echo+0x14 (icmp_reply+0x3c)
+func -6520 5.500 local_bh_disable+0x10 (icmp_reply+0x48)
+func -6514 7.500 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func -6507 5.250 ip_route_output_key+0x10 (icmp_reply+0xc8)
+func -6501 6.000 ip_route_output_flow+0x10 (ip_route_output_key+0x1c)
+func -6495 5.750 __ip_route_output_key+0x14 (ip_route_output_flow+0x1c)
+func -6490 6.250 rt_hash_code+0x10 (__ip_route_output_key+0x30)
+func -6483 5.500 local_bh_disable+0x10 (__ip_route_output_key+0x38)
+func -6478 8.750 ipipe_check_context+0x10 (local_bh_disable+0x18)
| +begin 0x80000001 -6469 6.750 __ip_route_output_key+0xdc (ip_route_output_flow+0x1c)
| +end 0x80000001 -6462 5.500 __ip_route_output_key+0xf0 (ip_route_output_flow+0x1c)
+func -6457 5.500 local_bh_enable+0x10 (__ip_route_output_key+0x11c)
+func -6451 6.000 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func -6445 7.750 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func -6438 5.750 icmp_push_reply+0x14 (icmp_reply+0x140)
+func -6432 6.750 ip_append_data+0x14 (icmp_push_reply+0x50)
| +begin 0x80000001 -6425 6.750 ip_append_data+0xd0 (icmp_push_reply+0x50)
| +end 0x80000001 -6418 9.250 ip_append_data+0xe8 (icmp_push_reply+0x50)
+func -6409 6.750 sock_alloc_send_skb+0x14 (ip_append_data+0x550)
+func -6402 6.000 __alloc_skb+0x10 (sock_alloc_send_skb+0x94)
+func -6396 7.000 kmem_cache_alloc+0x10 (__alloc_skb+0x34)
| +begin 0x80000001 -6389 6.500 kmem_cache_alloc+0x58 (__alloc_skb+0x34)
| #end 0x80000001 -6383 6.250 kmem_cache_alloc+0x6c (__alloc_skb+0x34)
#func -6377 5.500 __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
#func -6371 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -6365 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -6359 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -6352 6.000 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func -6346 8.250 __kmalloc+0x10 (__alloc_skb+0x54)
| +begin 0x80000001 -6338 6.750 __kmalloc+0x94 (__alloc_skb+0x54)
| #end 0x80000001 -6331 5.750 __kmalloc+0xa8 (__alloc_skb+0x54)
#func -6326 5.500 __ipipe_restore_root+0x10 (__kmalloc+0xf8)
#func -6320 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -6314 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -6308 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -6301 8.750 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
| +begin 0x80000001 -6292 6.750 sock_alloc_send_skb+0x2a4 (ip_append_data+0x550)
| +end 0x80000001 -6286 7.250 sock_alloc_send_skb+0x2b8 (ip_append_data+0x550)
| +begin 0x80000001 -6278 6.500 sock_alloc_send_skb+0x2f8 (ip_append_data+0x550)
| +end 0x80000001 -6272 6.500 sock_alloc_send_skb+0x30c (ip_append_data+0x550)
+func -6265 5.750 icmp_glue_bits+0x14 (ip_append_data+0x6c0)
+func -6260 11.500 skb_copy_and_csum_bits+0x14 (icmp_glue_bits+0x38)
+func -6248 8.000 ip_push_pending_frames+0x14 (icmp_push_reply+0xfc)
+func -6240 6.500 __ip_select_ident+0x10 (ip_push_pending_frames+0x300)
+func -6234 5.500 local_bh_disable+0x10 (__ip_select_ident+0x54)
+func -6228 7.500 ipipe_check_context+0x10 (local_bh_disable+0x18)
| +func -6221 7.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff -6213 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func -6208 6.000 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func -6202 5.750 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func -6196 5.500 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func -6191 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func -6185 6.500 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func -6178 5.750 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func -6173 6.250 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func -6166 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func -6160 7.000 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func -6153 10.000 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func -6143 14.250 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func -6129 7.250 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func -6121 5.750 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func -6116 6.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func -6109 9.250 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func -6100 6.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func -6094 7.500 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff -6086 5.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +func -6081 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff -6074 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func -6069 6.250 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func -6062 12.000 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func -6050 5.500 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func -6045 5.750 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| +func -6039 5.750 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func -6033 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func -6027 6.250 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func -6021 7.750 <bf0071fc> (xnintr_irq_handler+0x44)
| # func -6013 5.750 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| # func -6007 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| +func -5999 6.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func -5993 6.750 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +func -5986 7.000 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff -5979 6.250 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func -5973 5.500 local_bh_enable+0x10 (__ip_select_ident+0x68)
+func -5967 5.750 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func -5961 8.250 ipipe_check_context+0x10 (local_bh_enable+0x98)
| +begin 0x80000001 -5953 6.500 ip_push_pending_frames+0x3b0 (icmp_push_reply+0xfc)
| +end 0x80000001 -5947 5.500 ip_push_pending_frames+0x3c4 (icmp_push_reply+0xfc)
+func -5941 7.000 icmp_out_count+0x10 (ip_push_pending_frames+0x3e4)
+func -5934 6.250 ip_output+0x10 (ip_push_pending_frames+0x3f4)
+func -5928 8.500 ip_finish_output+0x10 (ip_output+0x54)
+func -5919 7.000 neigh_resolve_output+0x14 (ip_finish_output+0x26c)
+func -5912 5.250 local_bh_disable+0x10 (neigh_resolve_output+0x20c)
+func -5907 6.500 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func -5901 9.000 eth_header+0x10 (neigh_resolve_output+0x258)
+func -5892 5.500 local_bh_enable+0x10 (neigh_resolve_output+0x268)
+func -5886 5.750 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func -5880 6.500 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func -5874 6.500 dev_queue_xmit+0x10 (neigh_resolve_output+0x280)
+func -5867 5.750 local_bh_disable+0x10 (dev_queue_xmit+0x110)
+func -5862 6.750 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func -5855 6.500 dev_hard_start_xmit+0x14 (dev_queue_xmit+0x1e4)
+func -5848 8.000 bond_xmit_roundrobin+0x10 (dev_hard_start_xmit+0x1ec)
+func -5840 5.750 bond_dev_queue_xmit+0x10 (bond_xmit_roundrobin+0xe0)
+func -5835 6.000 dev_queue_xmit+0x10 (bond_dev_queue_xmit+0x1bc)
+func -5829 5.750 local_bh_disable+0x10 (dev_queue_xmit+0x110)
+func -5823 6.500 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func -5816 8.500 pfifo_fast_enqueue+0x10 (dev_queue_xmit+0x138)
| +begin 0x80000001 -5808 6.500 dev_queue_xmit+0x174 (bond_dev_queue_xmit+0x1bc)
| +end 0x80000001 -5801 6.000 dev_queue_xmit+0x188 (bond_dev_queue_xmit+0x1bc)
+func -5795 5.500 __qdisc_run+0x10 (dev_queue_xmit+0x19c)
+func -5790 6.250 pfifo_fast_dequeue+0x10 (__qdisc_run+0x38)
+func -5784 6.000 dev_hard_start_xmit+0x14 (__qdisc_run+0x5c)
+func -5778 7.250 dm9000_start_xmit+0x10 (dev_hard_start_xmit+0x1ec)
| +begin 0x80000001 -5770 6.500 dm9000_start_xmit+0x5c (dev_hard_start_xmit+0x1ec)
| #end 0x80000001 -5764 5.750 dm9000_start_xmit+0x70 (dev_hard_start_xmit+0x1ec)
#func -5758 16.750 dm9000_outblk_16bit+0x10 (dm9000_start_xmit+0x9c)
#func -5741 5.750 __ipipe_restore_root+0x10 (dm9000_start_xmit+0x174)
#func -5736 8.000 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #func -5728 7.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff -5720 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func -5715 6.500 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func -5708 11.250 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func -5697 7.750 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func -5689 6.250 __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
| #func -5683 6.000 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
| #func -5677 6.250 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func -5671 7.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func -5663 7.000 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff -5656 7.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| #begin 0x80000000 -5649 5.750 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -5643 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -5636 5.500 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func -5631 5.750 kfree_skb+0x10 (dm9000_start_xmit+0x17c)
+func -5625 5.500 __kfree_skb+0x10 (kfree_skb+0x80)
+func -5619 6.500 skb_release_all+0x10 (__kfree_skb+0x18)
| +begin 0x80000001 -5613 6.250 skb_release_all+0x64 (__kfree_skb+0x18)
| +end 0x80000001 -5607 6.000 skb_release_all+0x78 (__kfree_skb+0x18)
+func -5601 6.500 sock_wfree+0x10 (skb_release_all+0xd0)
| +begin 0x80000001 -5594 6.750 sock_wfree+0x44 (skb_release_all+0xd0)
| +end 0x80000001 -5587 5.250 sock_wfree+0x58 (skb_release_all+0xd0)
+func -5582 7.750 sock_def_write_space+0x10 (sock_wfree+0x74)
| +begin 0x80000001 -5574 6.750 sock_wfree+0x94 (skb_release_all+0xd0)
| +end 0x80000001 -5568 5.500 sock_wfree+0xa8 (skb_release_all+0xd0)
+func -5562 5.750 skb_release_data+0x10 (skb_release_all+0xd8)
+func -5556 6.750 kfree+0x10 (skb_release_data+0xdc)
| +begin 0x80000001 -5550 6.500 kfree+0x4c (skb_release_data+0xdc)
| #end 0x80000001 -5543 6.500 kfree+0x60 (skb_release_data+0xdc)
#func -5537 5.250 __ipipe_restore_root+0x10 (kfree+0xfc)
#func -5531 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -5525 5.750 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -5519 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -5512 6.500 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func -5506 6.750 kmem_cache_free+0x10 (__kfree_skb+0x108)
| +begin 0x80000001 -5499 6.500 kmem_cache_free+0x48 (__kfree_skb+0x108)
| #end 0x80000001 -5493 5.750 kmem_cache_free+0x5c (__kfree_skb+0x108)
#func -5487 5.250 __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
#func -5482 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -5475 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -5470 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -5463 8.250 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
| +begin 0x80000001 -5455 6.500 __qdisc_run+0x174 (dev_queue_xmit+0x19c)
| +end 0x80000001 -5448 6.250 __qdisc_run+0x188 (dev_queue_xmit+0x19c)
| +func -5442 6.750 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff -5435 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func -5429 5.750 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func -5424 6.000 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func -5418 5.500 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func -5412 5.500 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func -5407 6.500 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func -5400 5.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func -5395 6.000 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func -5389 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func -5382 7.250 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func -5375 8.750 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func -5366 14.750 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func -5351 7.250 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func -5344 5.750 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func -5338 6.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func -5332 9.500 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func -5323 6.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func -5317 7.750 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff -5309 5.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +func -5303 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff -5297 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func -5291 5.500 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func -5286 12.250 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func -5273 5.750 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func -5268 5.500 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| +func -5262 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func -5256 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func -5250 6.500 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func -5243 7.750 <bf0071fc> (xnintr_irq_handler+0x44)
| # func -5235 5.750 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| # func -5230 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| +func -5221 6.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func -5215 7.000 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +func -5208 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff -5201 6.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func -5194 5.250 local_bh_enable+0x10 (dev_queue_xmit+0x26c)
+func -5189 6.000 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func -5183 7.250 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func -5176 5.750 local_bh_enable+0x10 (dev_queue_xmit+0x26c)
+func -5170 5.750 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func -5164 7.250 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func -5157 5.500 ip_cork_release+0x10 (ip_push_pending_frames+0x454)
+func -5151 7.250 kfree+0x10 (ip_cork_release+0x28)
| +begin 0x80000001 -5144 6.500 ip_cork_release+0x80 (ip_push_pending_frames+0x454)
| +end 0x80000001 -5138 8.250 ip_cork_release+0x94 (ip_push_pending_frames+0x454)
| +begin 0x80000001 -5129 6.500 icmp_reply+0x190 (icmp_echo+0x60)
| +end 0x80000001 -5123 5.750 icmp_reply+0x1a4 (icmp_echo+0x60)
+func -5117 5.250 icmp_xmit_unlock+0x10 (icmp_reply+0x1bc)
+func -5112 5.250 local_bh_enable+0x10 (icmp_xmit_unlock+0x14)
+func -5107 6.000 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func -5101 7.000 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func -5094 5.750 kfree_skb+0x10 (icmp_rcv+0x158)
+func -5088 5.500 __kfree_skb+0x10 (kfree_skb+0x80)
+func -5082 7.000 skb_release_all+0x10 (__kfree_skb+0x18)
| +begin 0x80000001 -5075 6.500 skb_release_all+0x64 (__kfree_skb+0x18)
| +end 0x80000001 -5069 5.750 skb_release_all+0x78 (__kfree_skb+0x18)
+func -5063 6.000 skb_release_data+0x10 (skb_release_all+0xd8)
+func -5057 6.750 kfree+0x10 (skb_release_data+0xdc)
| +begin 0x80000001 -5050 6.500 kfree+0x4c (skb_release_data+0xdc)
| #end 0x80000001 -5044 6.000 kfree+0x60 (skb_release_data+0xdc)
#func -5038 5.250 __ipipe_restore_root+0x10 (kfree+0xfc)
#func -5033 6.750 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -5026 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -5020 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -5013 6.000 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func -5007 7.000 kmem_cache_free+0x10 (__kfree_skb+0x108)
| +begin 0x80000001 -5000 6.500 kmem_cache_free+0x48 (__kfree_skb+0x108)
| #end 0x80000001 -4994 5.750 kmem_cache_free+0x5c (__kfree_skb+0x108)
#func -4988 5.250 __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
#func -4983 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -4976 5.750 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -4971 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -4964 9.750 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
| +begin 0x80000001 -4954 7.000 process_backlog+0x168 (net_rx_action+0xac)
| +end 0x80000001 -4947 7.250 process_backlog+0x17c (net_rx_action+0xac)
| +begin 0x80000001 -4940 6.500 process_backlog+0x60 (net_rx_action+0xac)
| #end 0x80000001 -4933 7.000 process_backlog+0x74 (net_rx_action+0xac)
| #begin 0x80000001 -4926 6.500 process_backlog+0x134 (net_rx_action+0xac)
| #end 0x80000001 -4920 5.500 process_backlog+0x148 (net_rx_action+0xac)
#func -4914 6.250 __ipipe_unstall_root+0x10 (process_backlog+0x150)
| #begin 0x80000000 -4908 5.500 __ipipe_unstall_root+0x30 (process_backlog+0x150)
| +func -4902 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -4895 7.750 __ipipe_unstall_root+0x68 (process_backlog+0x150)
| +begin 0x80000001 -4888 6.500 net_rx_action+0x118 (__do_softirq+0x60)
| #end 0x80000001 -4881 5.500 net_rx_action+0x12c (__do_softirq+0x60)
#func -4876 6.500 __ipipe_unstall_root+0x10 (net_rx_action+0x208)
| #begin 0x80000000 -4869 6.000 __ipipe_unstall_root+0x30 (net_rx_action+0x208)
| +func -4863 7.250 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -4856 7.250 __ipipe_unstall_root+0x68 (net_rx_action+0x208)
| +begin 0x80000001 -4849 6.500 __do_softirq+0xa8 (irq_exit+0x50)
| #end 0x80000001 -4842 5.750 __do_softirq+0xbc (irq_exit+0x50)
#func -4836 6.250 _local_bh_enable+0x10 (__do_softirq+0xfc)
#func -4830 8.000 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
| #begin 0x80000000 -4822 8.500 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 -4814 6.250 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func -4807 6.000 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func -4801 5.750 irq_enter+0x10 (__exception_text_start+0x38)
#func -4796 6.250 ipipe_check_context+0x10 (irq_enter+0x18)
#func -4789 6.250 handle_simple_irq+0x10 (__exception_text_start+0x48)
#func -4783 5.500 handle_IRQ_event+0x10 (handle_simple_irq+0x64)
#func -4778 6.250 __ipipe_unstall_root+0x10 (handle_IRQ_event+0x28)
| #begin 0x80000000 -4771 5.750 __ipipe_unstall_root+0x30 (handle_IRQ_event+0x28)
| +func -4766 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -4759 5.500 __ipipe_unstall_root+0x68 (handle_IRQ_event+0x28)
+func -4753 7.750 dm9000_interrupt+0x14 (handle_IRQ_event+0x40)
| +func -4745 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff -4738 6.250 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func -4732 5.750 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func -4726 10.750 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func -4716 7.250 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func -4708 6.500 __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
| +func -4702 5.500 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
| +func -4696 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func -4690 6.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func -4684 7.000 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +func -4677 7.000 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff -4670 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +func -4665 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff -4658 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func -4652 6.000 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func -4646 6.000 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func -4640 5.750 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func -4634 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func -4628 6.000 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func -4622 5.250 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func -4617 6.000 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func -4611 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func -4605 6.750 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func -4598 8.750 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func -4589 15.000 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func -4574 7.500 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func -4567 5.500 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func -4561 6.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func -4555 9.750 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func -4545 6.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func -4538 7.750 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff -4531 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +func -4525 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff -4518 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func -4513 5.250 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func -4507 12.000 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func -4495 6.000 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func -4489 5.750 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| +func -4484 5.750 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func -4478 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func -4472 6.500 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func -4465 8.500 <bf0071fc> (xnintr_irq_handler+0x44)
| # func -4457 5.500 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| # func -4451 8.500 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| +func -4443 6.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func -4436 7.250 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +func -4429 7.000 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff -4422 7.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func -4414 7.000 dm9000_inblk_16bit+0x10 (dm9000_interrupt+0xbc)
+func -4407 5.500 __alloc_skb+0x10 (dm9000_interrupt+0x120)
+func -4402 6.750 kmem_cache_alloc+0x10 (__alloc_skb+0x34)
| +begin 0x80000001 -4395 6.500 kmem_cache_alloc+0x58 (__alloc_skb+0x34)
| #end 0x80000001 -4388 6.000 kmem_cache_alloc+0x6c (__alloc_skb+0x34)
#func -4382 5.500 __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
#func -4377 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -4370 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -4365 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -4358 6.250 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func -4352 8.250 __kmalloc+0x10 (__alloc_skb+0x54)
| +begin 0x80000001 -4343 6.500 __kmalloc+0x94 (__alloc_skb+0x54)
| #end 0x80000001 -4337 6.250 __kmalloc+0xa8 (__alloc_skb+0x54)
#func -4331 5.750 __ipipe_restore_root+0x10 (__kmalloc+0xf8)
#func -4325 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -4318 5.250 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -4313 7.250 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -4306 8.250 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func -4298 17.500 dm9000_inblk_16bit+0x10 (dm9000_interrupt+0x19c)
+func -4280 7.000 eth_type_trans+0x10 (dm9000_interrupt+0x1b4)
+func -4273 7.500 netif_rx+0x14 (dm9000_interrupt+0x1c0)
| +begin 0x80000001 -4266 6.500 netif_rx+0x88 (dm9000_interrupt+0x1c0)
| #end 0x80000001 -4259 7.000 netif_rx+0x9c (dm9000_interrupt+0x1c0)
| #begin 0x80000001 -4252 6.500 netif_rx+0x1ac (dm9000_interrupt+0x1c0)
| #end 0x80000001 -4246 5.500 netif_rx+0x1c0 (dm9000_interrupt+0x1c0)
#func -4240 7.000 __napi_schedule+0x10 (netif_rx+0x1d4)
| #begin 0x80000001 -4233 6.500 __napi_schedule+0x44 (netif_rx+0x1d4)
| #end 0x80000001 -4227 5.250 __napi_schedule+0x58 (netif_rx+0x1d4)
#func -4221 7.000 __ipipe_restore_root+0x10 (__napi_schedule+0xa4)
| #begin 0x80000001 -4214 6.750 __ipipe_restore_root+0x48 (__napi_schedule+0xa4)
| #end 0x80000001 -4208 6.750 __ipipe_restore_root+0x5c (__napi_schedule+0xa4)
| #begin 0x80000001 -4201 6.500 netif_rx+0x108 (dm9000_interrupt+0x1c0)
| #end 0x80000001 -4194 5.750 netif_rx+0x11c (dm9000_interrupt+0x1c0)
#func -4189 5.500 __ipipe_restore_root+0x10 (netif_rx+0x16c)
#func -4183 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -4177 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -4171 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -4164 9.000 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
| +begin 0x80000001 -4155 7.250 dm9000_interrupt+0x2b0 (handle_IRQ_event+0x40)
| +end 0x80000001 -4148 8.250 dm9000_interrupt+0x2c4 (handle_IRQ_event+0x40)
| +begin 0x80000001 -4140 6.750 handle_IRQ_event+0x9c (handle_simple_irq+0x64)
| #end 0x80000001 -4133 6.000 handle_IRQ_event+0xb0 (handle_simple_irq+0x64)
#func -4127 6.750 note_interrupt+0x14 (handle_simple_irq+0x84)
#func -4120 5.500 irq_exit+0x10 (__exception_text_start+0x4c)
#func -4115 6.750 ipipe_check_context+0x10 (irq_exit+0x18)
#func -4108 5.500 __do_softirq+0x10 (irq_exit+0x50)
#func -4102 5.750 ipipe_check_context+0x10 (__do_softirq+0x20)
#func -4097 6.250 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
| #begin 0x80000000 -4090 5.500 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
| +func -4085 7.250 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -4078 6.500 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
+func -4071 7.000 net_rx_action+0x10 (__do_softirq+0x60)
| +begin 0x80000001 -4064 7.000 net_rx_action+0x50 (__do_softirq+0x60)
| #end 0x80000001 -4057 5.750 net_rx_action+0x64 (__do_softirq+0x60)
#func -4051 6.500 __ipipe_unstall_root+0x10 (net_rx_action+0x88)
| #begin 0x80000000 -4045 6.000 __ipipe_unstall_root+0x30 (net_rx_action+0x88)
| +func -4039 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -4032 5.750 __ipipe_unstall_root+0x68 (net_rx_action+0x88)
+func -4026 6.500 process_backlog+0x10 (net_rx_action+0xac)
| +begin 0x80000001 -4020 6.250 process_backlog+0x60 (net_rx_action+0xac)
| #end 0x80000001 -4013 5.750 process_backlog+0x74 (net_rx_action+0xac)
#func -4008 6.500 __ipipe_unstall_root+0x10 (process_backlog+0xb4)
| #begin 0x80000000 -4001 5.750 __ipipe_unstall_root+0x30 (process_backlog+0xb4)
| +func -3995 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -3989 5.500 __ipipe_unstall_root+0x68 (process_backlog+0xb4)
+func -3983 9.000 netif_receive_skb+0x14 (process_backlog+0xc0)
+func -3974 8.500 ip_rcv+0x14 (netif_receive_skb+0x290)
+func -3966 5.500 ip_route_input+0x14 (ip_rcv+0x238)
+func -3960 10.250 rt_hash_code+0x10 (ip_route_input+0x38)
| +begin 0x80000001 -3950 6.500 ip_route_input+0xcc (ip_rcv+0x238)
| +end 0x80000001 -3943 7.000 ip_route_input+0xe0 (ip_rcv+0x238)
+func -3936 7.500 ip_local_deliver+0x10 (ip_rcv+0x538)
+func -3929 6.250 icmp_rcv+0x10 (ip_local_deliver+0xd8)
+func -3923 5.750 __skb_checksum_complete+0x10 (icmp_rcv+0x64)
+func -3917 5.250 __skb_checksum_complete_head+0x10 (__skb_checksum_complete+0x18)
+func -3912 9.500 skb_checksum+0x14 (__skb_checksum_complete_head+0x24)
+func -3902 7.250 icmp_echo+0x14 (icmp_rcv+0x138)
+func -3895 7.750 icmp_reply+0x14 (icmp_echo+0x60)
| +func -3887 7.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff -3880 6.250 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func -3874 6.250 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func -3867 6.000 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func -3861 6.000 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func -3855 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func -3850 6.750 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func -3843 5.750 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func -3837 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func -3831 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func -3825 6.750 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func -3818 9.000 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func -3809 15.000 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func -3794 7.250 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func -3787 5.750 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func -3781 6.500 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func -3775 8.750 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func -3766 6.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func -3759 7.500 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff -3752 5.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +func -3746 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff -3740 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func -3734 5.750 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func -3728 12.500 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func -3716 5.750 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func -3710 5.250 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| +func -3705 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func -3699 6.000 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func -3693 6.250 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func -3687 8.250 <bf0071fc> (xnintr_irq_handler+0x44)
| # func -3678 5.500 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| # func -3673 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| +func -3665 6.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func -3658 6.750 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +func -3652 7.500 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff -3644 7.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func -3637 6.500 ip_options_echo+0x14 (icmp_reply+0x3c)
+func -3630 5.250 local_bh_disable+0x10 (icmp_reply+0x48)
+func -3625 8.000 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func -3617 5.500 ip_route_output_key+0x10 (icmp_reply+0xc8)
+func -3611 5.250 ip_route_output_flow+0x10 (ip_route_output_key+0x1c)
+func -3606 5.250 __ip_route_output_key+0x14 (ip_route_output_flow+0x1c)
+func -3601 6.250 rt_hash_code+0x10 (__ip_route_output_key+0x30)
+func -3595 5.500 local_bh_disable+0x10 (__ip_route_output_key+0x38)
+func -3589 9.000 ipipe_check_context+0x10 (local_bh_disable+0x18)
| +begin 0x80000001 -3580 6.250 __ip_route_output_key+0xdc (ip_route_output_flow+0x1c)
| +end 0x80000001 -3574 5.500 __ip_route_output_key+0xf0 (ip_route_output_flow+0x1c)
+func -3568 5.750 local_bh_enable+0x10 (__ip_route_output_key+0x11c)
+func -3563 5.750 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func -3557 7.500 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func -3549 6.000 icmp_push_reply+0x14 (icmp_reply+0x140)
+func -3543 7.000 ip_append_data+0x14 (icmp_push_reply+0x50)
| +begin 0x80000001 -3536 6.500 ip_append_data+0xd0 (icmp_push_reply+0x50)
| +end 0x80000001 -3530 9.500 ip_append_data+0xe8 (icmp_push_reply+0x50)
+func -3520 6.750 sock_alloc_send_skb+0x14 (ip_append_data+0x550)
+func -3514 5.750 __alloc_skb+0x10 (sock_alloc_send_skb+0x94)
+func -3508 6.750 kmem_cache_alloc+0x10 (__alloc_skb+0x34)
| +begin 0x80000001 -3501 6.500 kmem_cache_alloc+0x58 (__alloc_skb+0x34)
| #end 0x80000001 -3495 6.000 kmem_cache_alloc+0x6c (__alloc_skb+0x34)
#func -3489 6.000 __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
#func -3483 6.250 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -3476 5.750 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -3471 7.250 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -3463 6.000 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func -3457 8.750 __kmalloc+0x10 (__alloc_skb+0x54)
| +begin 0x80000001 -3449 6.250 __kmalloc+0x94 (__alloc_skb+0x54)
| #end 0x80000001 -3442 6.000 __kmalloc+0xa8 (__alloc_skb+0x54)
#func -3436 5.500 __ipipe_restore_root+0x10 (__kmalloc+0xf8)
#func -3431 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -3424 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -3419 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -3412 9.250 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
| +begin 0x80000001 -3403 6.250 sock_alloc_send_skb+0x2a4 (ip_append_data+0x550)
| +end 0x80000001 -3396 6.750 sock_alloc_send_skb+0x2b8 (ip_append_data+0x550)
| +begin 0x80000001 -3390 6.500 sock_alloc_send_skb+0x2f8 (ip_append_data+0x550)
| +end 0x80000001 -3383 7.000 sock_alloc_send_skb+0x30c (ip_append_data+0x550)
+func -3376 5.500 icmp_glue_bits+0x14 (ip_append_data+0x6c0)
+func -3371 11.000 skb_copy_and_csum_bits+0x14 (icmp_glue_bits+0x38)
+func -3360 7.500 ip_push_pending_frames+0x14 (icmp_push_reply+0xfc)
+func -3352 6.250 __ip_select_ident+0x10 (ip_push_pending_frames+0x300)
+func -3346 5.500 local_bh_disable+0x10 (__ip_select_ident+0x54)
+func -3340 6.250 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func -3334 5.750 local_bh_enable+0x10 (__ip_select_ident+0x68)
+func -3328 5.750 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func -3323 8.000 ipipe_check_context+0x10 (local_bh_enable+0x98)
| +begin 0x80000001 -3315 6.500 ip_push_pending_frames+0x3b0 (icmp_push_reply+0xfc)
| +end 0x80000001 -3308 5.500 ip_push_pending_frames+0x3c4 (icmp_push_reply+0xfc)
+func -3303 7.000 icmp_out_count+0x10 (ip_push_pending_frames+0x3e4)
+func -3296 6.000 ip_output+0x10 (ip_push_pending_frames+0x3f4)
+func -3290 8.250 ip_finish_output+0x10 (ip_output+0x54)
+func -3281 6.500 neigh_resolve_output+0x14 (ip_finish_output+0x26c)
+func -3275 6.000 local_bh_disable+0x10 (neigh_resolve_output+0x20c)
+func -3269 6.000 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func -3263 8.750 eth_header+0x10 (neigh_resolve_output+0x258)
+func -3254 5.500 local_bh_enable+0x10 (neigh_resolve_output+0x268)
+func -3249 6.000 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func -3243 6.500 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func -3236 6.250 dev_queue_xmit+0x10 (neigh_resolve_output+0x280)
+func -3230 5.500 local_bh_disable+0x10 (dev_queue_xmit+0x110)
+func -3224 6.750 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func -3218 6.250 dev_hard_start_xmit+0x14 (dev_queue_xmit+0x1e4)
+func -3211 9.500 bond_xmit_roundrobin+0x10 (dev_hard_start_xmit+0x1ec)
+func -3202 6.250 bond_dev_queue_xmit+0x10 (bond_xmit_roundrobin+0xe0)
+func -3196 6.250 dev_queue_xmit+0x10 (bond_dev_queue_xmit+0x1bc)
+func -3189 6.000 local_bh_disable+0x10 (dev_queue_xmit+0x110)
+func -3183 6.250 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func -3177 8.250 pfifo_fast_enqueue+0x10 (dev_queue_xmit+0x138)
| +begin 0x80000001 -3169 6.500 dev_queue_xmit+0x174 (bond_dev_queue_xmit+0x1bc)
| +end 0x80000001 -3162 5.250 dev_queue_xmit+0x188 (bond_dev_queue_xmit+0x1bc)
+func -3157 5.500 __qdisc_run+0x10 (dev_queue_xmit+0x19c)
+func -3152 6.500 pfifo_fast_dequeue+0x10 (__qdisc_run+0x38)
+func -3145 6.500 dev_hard_start_xmit+0x14 (__qdisc_run+0x5c)
+func -3139 7.000 dm9000_start_xmit+0x10 (dev_hard_start_xmit+0x1ec)
| +begin 0x80000001 -3132 6.250 dm9000_start_xmit+0x5c (dev_hard_start_xmit+0x1ec)
| #end 0x80000001 -3125 5.750 dm9000_start_xmit+0x70 (dev_hard_start_xmit+0x1ec)
#func -3120 8.000 dm9000_outblk_16bit+0x10 (dm9000_start_xmit+0x9c)
| #func -3112 7.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff -3104 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func -3099 6.000 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| #func -3093 6.250 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| #func -3087 5.750 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| #func -3081 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| #func -3075 6.250 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| #func -3069 5.750 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| #func -3063 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| #func -3057 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func -3051 7.000 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func -3044 9.500 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| #*func -3034 15.000 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| #*func -3019 7.250 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| #*func -3012 5.500 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| #*func -3007 7.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| #*func -2999 9.500 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| #func -2990 7.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #end 0xffffffff -2982 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| #func -2977 6.750 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff -2970 5.250 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func -2965 5.750 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func -2959 12.000 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func -2947 6.000 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func -2941 5.750 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| #func -2935 5.500 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func -2930 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func -2923 7.000 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func -2916 8.500 <bf0071fc> (xnintr_irq_handler+0x44)
| #*func -2908 6.000 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func -2902 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func -2893 8.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func -2885 6.750 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff -2879 18.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func -2860 5.750 __ipipe_restore_root+0x10 (dm9000_start_xmit+0x174)
#func -2854 6.000 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #func -2848 6.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff -2842 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func -2837 6.250 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func -2830 11.000 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func -2819 6.750 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func -2813 6.250 __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
| #func -2806 5.750 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
| #func -2801 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func -2795 7.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func -2787 7.500 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff -2780 8.000 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| #begin 0x80000000 -2772 6.250 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -2766 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -2759 5.500 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func -2753 5.500 kfree_skb+0x10 (dm9000_start_xmit+0x17c)
+func -2748 5.750 __kfree_skb+0x10 (kfree_skb+0x80)
+func -2742 6.750 skb_release_all+0x10 (__kfree_skb+0x18)
| +begin 0x80000001 -2735 6.500 skb_release_all+0x64 (__kfree_skb+0x18)
| +end 0x80000001 -2729 5.750 skb_release_all+0x78 (__kfree_skb+0x18)
+func -2723 6.500 sock_wfree+0x10 (skb_release_all+0xd0)
| +begin 0x80000001 -2717 7.000 sock_wfree+0x44 (skb_release_all+0xd0)
| +end 0x80000001 -2710 5.750 sock_wfree+0x58 (skb_release_all+0xd0)
+func -2704 8.000 sock_def_write_space+0x10 (sock_wfree+0x74)
| +begin 0x80000001 -2696 7.500 sock_wfree+0x94 (skb_release_all+0xd0)
| +end 0x80000001 -2688 5.500 sock_wfree+0xa8 (skb_release_all+0xd0)
+func -2683 5.750 skb_release_data+0x10 (skb_release_all+0xd8)
+func -2677 6.750 kfree+0x10 (skb_release_data+0xdc)
| +begin 0x80000001 -2670 6.250 kfree+0x4c (skb_release_data+0xdc)
| #end 0x80000001 -2664 6.500 kfree+0x60 (skb_release_data+0xdc)
#func -2658 5.250 __ipipe_restore_root+0x10 (kfree+0xfc)
#func -2652 6.750 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -2646 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -2640 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -2633 6.500 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func -2627 6.750 kmem_cache_free+0x10 (__kfree_skb+0x108)
| +begin 0x80000001 -2620 6.750 kmem_cache_free+0x48 (__kfree_skb+0x108)
| #end 0x80000001 -2613 5.500 kmem_cache_free+0x5c (__kfree_skb+0x108)
#func -2608 5.250 __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
#func -2602 6.750 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -2596 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -2590 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -2583 8.750 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
| +begin 0x80000001 -2575 6.500 __qdisc_run+0x174 (dev_queue_xmit+0x19c)
| +end 0x80000001 -2568 5.750 __qdisc_run+0x188 (dev_queue_xmit+0x19c)
+func -2562 5.500 local_bh_enable+0x10 (dev_queue_xmit+0x26c)
+func -2557 6.000 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func -2551 7.750 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func -2543 6.000 local_bh_enable+0x10 (dev_queue_xmit+0x26c)
+func -2537 6.000 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func -2531 7.250 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func -2524 5.750 ip_cork_release+0x10 (ip_push_pending_frames+0x454)
+func -2518 7.000 kfree+0x10 (ip_cork_release+0x28)
| +begin 0x80000001 -2511 6.500 ip_cork_release+0x80 (ip_push_pending_frames+0x454)
| +end 0x80000001 -2505 7.750 ip_cork_release+0x94 (ip_push_pending_frames+0x454)
| +begin 0x80000001 -2497 6.500 icmp_reply+0x190 (icmp_echo+0x60)
| +end 0x80000001 -2490 5.500 icmp_reply+0x1a4 (icmp_echo+0x60)
+func -2485 5.250 icmp_xmit_unlock+0x10 (icmp_reply+0x1bc)
+func -2480 5.250 local_bh_enable+0x10 (icmp_xmit_unlock+0x14)
+func -2474 6.000 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func -2468 7.000 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func -2461 5.500 kfree_skb+0x10 (icmp_rcv+0x158)
+func -2456 5.250 __kfree_skb+0x10 (kfree_skb+0x80)
+func -2451 7.250 skb_release_all+0x10 (__kfree_skb+0x18)
| +begin 0x80000001 -2443 6.500 skb_release_all+0x64 (__kfree_skb+0x18)
| +end 0x80000001 -2437 6.000 skb_release_all+0x78 (__kfree_skb+0x18)
+func -2431 6.000 skb_release_data+0x10 (skb_release_all+0xd8)
+func -2425 6.750 kfree+0x10 (skb_release_data+0xdc)
| +begin 0x80000001 -2418 6.750 kfree+0x4c (skb_release_data+0xdc)
| #end 0x80000001 -2411 6.000 kfree+0x60 (skb_release_data+0xdc)
#func -2405 5.250 __ipipe_restore_root+0x10 (kfree+0xfc)
#func -2400 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -2394 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -2388 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -2381 6.000 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func -2375 6.500 kmem_cache_free+0x10 (__kfree_skb+0x108)
| +begin 0x80000001 -2369 6.750 kmem_cache_free+0x48 (__kfree_skb+0x108)
| #end 0x80000001 -2362 6.000 kmem_cache_free+0x5c (__kfree_skb+0x108)
#func -2356 5.250 __ipipe_restore_root+0x10 (kmem_cache_free+0xb4)
#func -2351 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -2344 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -2339 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -2332 6.750 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
| +func -2325 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff -2318 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func -2312 5.750 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func -2307 5.250 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func -2301 6.000 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func -2295 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func -2290 6.250 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func -2283 5.250 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func -2278 6.000 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func -2272 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func -2266 6.500 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func -2259 8.750 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func -2250 14.500 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func -2236 7.500 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func -2228 5.500 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func -2223 6.000 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func -2217 9.250 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func -2208 6.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func -2201 7.250 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff -2194 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +func -2188 6.750 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff -2181 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func -2176 5.750 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func -2170 12.000 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func -2158 6.000 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func -2152 5.750 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| +func -2146 5.500 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func -2141 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func -2135 6.750 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func -2128 8.250 <bf0071fc> (xnintr_irq_handler+0x44)
| # func -2120 5.500 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| # func -2114 8.000 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| +func -2106 6.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func -2099 7.500 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +func -2092 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff -2085 10.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +begin 0x80000001 -2074 7.000 process_backlog+0x168 (net_rx_action+0xac)
| +end 0x80000001 -2067 7.250 process_backlog+0x17c (net_rx_action+0xac)
| +begin 0x80000001 -2060 6.500 process_backlog+0x60 (net_rx_action+0xac)
| #end 0x80000001 -2053 7.250 process_backlog+0x74 (net_rx_action+0xac)
| #begin 0x80000001 -2046 6.750 process_backlog+0x134 (net_rx_action+0xac)
| #end 0x80000001 -2039 5.500 process_backlog+0x148 (net_rx_action+0xac)
#func -2034 6.500 __ipipe_unstall_root+0x10 (process_backlog+0x150)
| #begin 0x80000000 -2027 5.500 __ipipe_unstall_root+0x30 (process_backlog+0x150)
| +func -2022 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -2015 7.750 __ipipe_unstall_root+0x68 (process_backlog+0x150)
| +begin 0x80000001 -2007 6.250 net_rx_action+0x118 (__do_softirq+0x60)
| #end 0x80000001 -2001 5.750 net_rx_action+0x12c (__do_softirq+0x60)
#func -1995 6.500 __ipipe_unstall_root+0x10 (net_rx_action+0x208)
| #begin 0x80000000 -1989 6.250 __ipipe_unstall_root+0x30 (net_rx_action+0x208)
| +func -1982 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -1976 7.000 __ipipe_unstall_root+0x68 (net_rx_action+0x208)
| +begin 0x80000001 -1969 6.500 __do_softirq+0xa8 (irq_exit+0x50)
| #end 0x80000001 -1962 6.000 __do_softirq+0xbc (irq_exit+0x50)
#func -1956 6.000 _local_bh_enable+0x10 (__do_softirq+0xfc)
#func -1950 8.000 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
| #begin 0x80000000 -1942 8.250 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 -1934 5.750 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func -1928 6.250 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func -1922 5.500 irq_enter+0x10 (__exception_text_start+0x38)
#func -1916 6.000 ipipe_check_context+0x10 (irq_enter+0x18)
#func -1910 6.250 handle_simple_irq+0x10 (__exception_text_start+0x48)
#func -1904 5.500 handle_IRQ_event+0x10 (handle_simple_irq+0x64)
#func -1899 6.500 __ipipe_unstall_root+0x10 (handle_IRQ_event+0x28)
| #begin 0x80000000 -1892 5.500 __ipipe_unstall_root+0x30 (handle_IRQ_event+0x28)
| +func -1887 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -1880 5.750 __ipipe_unstall_root+0x68 (handle_IRQ_event+0x28)
+func -1874 8.000 dm9000_interrupt+0x14 (handle_IRQ_event+0x40)
| +func -1866 7.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff -1859 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func -1853 5.500 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func -1847 11.250 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func -1836 7.250 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func -1829 7.000 __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
| +func -1822 5.500 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
| +func -1816 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func -1810 6.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func -1804 7.000 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| +func -1797 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff -1790 7.250 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func -1783 7.250 dm9000_inblk_16bit+0x10 (dm9000_interrupt+0xbc)
+func -1775 6.000 __alloc_skb+0x10 (dm9000_interrupt+0x120)
+func -1769 6.750 kmem_cache_alloc+0x10 (__alloc_skb+0x34)
| +begin 0x80000001 -1763 6.500 kmem_cache_alloc+0x58 (__alloc_skb+0x34)
| #end 0x80000001 -1756 6.000 kmem_cache_alloc+0x6c (__alloc_skb+0x34)
#func -1750 5.500 __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
#func -1745 6.500 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -1738 5.250 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -1733 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -1726 6.250 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func -1720 8.250 __kmalloc+0x10 (__alloc_skb+0x54)
| +begin 0x80000001 -1711 6.750 __kmalloc+0x94 (__alloc_skb+0x54)
| #end 0x80000001 -1705 5.750 __kmalloc+0xa8 (__alloc_skb+0x54)
#func -1699 5.500 __ipipe_restore_root+0x10 (__kmalloc+0xf8)
#func -1693 6.750 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -1687 5.250 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -1681 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -1674 8.500 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
+func -1666 17.250 dm9000_inblk_16bit+0x10 (dm9000_interrupt+0x19c)
+func -1649 6.750 eth_type_trans+0x10 (dm9000_interrupt+0x1b4)
+func -1642 7.500 netif_rx+0x14 (dm9000_interrupt+0x1c0)
| +begin 0x80000001 -1634 6.500 netif_rx+0x88 (dm9000_interrupt+0x1c0)
| #end 0x80000001 -1628 6.750 netif_rx+0x9c (dm9000_interrupt+0x1c0)
| #begin 0x80000001 -1621 6.500 netif_rx+0x1ac (dm9000_interrupt+0x1c0)
| #end 0x80000001 -1615 5.500 netif_rx+0x1c0 (dm9000_interrupt+0x1c0)
#func -1609 7.000 __napi_schedule+0x10 (netif_rx+0x1d4)
| #begin 0x80000001 -1602 6.250 __napi_schedule+0x44 (netif_rx+0x1d4)
| #end 0x80000001 -1596 5.500 __napi_schedule+0x58 (netif_rx+0x1d4)
#func -1590 6.750 __ipipe_restore_root+0x10 (__napi_schedule+0xa4)
| #begin 0x80000001 -1584 7.250 __ipipe_restore_root+0x48 (__napi_schedule+0xa4)
| #end 0x80000001 -1576 6.500 __ipipe_restore_root+0x5c (__napi_schedule+0xa4)
| #begin 0x80000001 -1570 6.500 netif_rx+0x108 (dm9000_interrupt+0x1c0)
| #end 0x80000001 -1563 6.500 netif_rx+0x11c (dm9000_interrupt+0x1c0)
| #func -1557 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff -1550 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func -1544 5.750 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| #func -1539 5.750 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| #func -1533 5.750 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| #func -1527 5.500 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| #func -1522 6.250 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| #func -1515 5.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| #func -1510 6.000 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| #func -1504 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func -1497 6.750 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func -1491 9.750 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| #*func -1481 14.500 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| #*func -1466 7.000 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| #*func -1459 5.250 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| #*func -1454 6.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| #*func -1448 9.500 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| #func -1438 8.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #end 0xffffffff -1430 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| #func -1425 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff -1418 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func -1413 5.750 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func -1407 11.750 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func -1395 6.000 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func -1389 5.500 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| #func -1384 5.500 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func -1378 6.000 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func -1372 6.250 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func -1366 8.250 <bf0071fc> (xnintr_irq_handler+0x44)
| #*func -1358 5.500 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func -1352 8.000 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func -1344 8.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func -1336 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff -1329 6.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func -1322 5.250 __ipipe_restore_root+0x10 (netif_rx+0x16c)
#func -1317 6.750 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| #begin 0x80000000 -1310 5.500 __ipipe_unstall_root+0x30 (__ipipe_restore_root+0x68)
| +func -1305 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -1298 8.750 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
| +begin 0x80000001 -1289 6.750 dm9000_interrupt+0x2b0 (handle_IRQ_event+0x40)
| +end 0x80000001 -1282 8.750 dm9000_interrupt+0x2c4 (handle_IRQ_event+0x40)
| +begin 0x80000001 -1273 7.000 handle_IRQ_event+0x9c (handle_simple_irq+0x64)
| #end 0x80000001 -1266 5.750 handle_IRQ_event+0xb0 (handle_simple_irq+0x64)
#func -1261 7.000 note_interrupt+0x14 (handle_simple_irq+0x84)
#func -1254 6.000 irq_exit+0x10 (__exception_text_start+0x4c)
#func -1248 6.250 ipipe_check_context+0x10 (irq_exit+0x18)
#func -1241 5.250 __do_softirq+0x10 (irq_exit+0x50)
#func -1236 5.750 ipipe_check_context+0x10 (__do_softirq+0x20)
#func -1230 6.750 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
| #begin 0x80000000 -1224 5.500 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
| +func -1218 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -1211 6.750 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
+func -1205 7.000 net_rx_action+0x10 (__do_softirq+0x60)
| +begin 0x80000001 -1198 6.250 net_rx_action+0x50 (__do_softirq+0x60)
| #end 0x80000001 -1191 5.500 net_rx_action+0x64 (__do_softirq+0x60)
#func -1186 6.500 __ipipe_unstall_root+0x10 (net_rx_action+0x88)
| #begin 0x80000000 -1179 6.250 __ipipe_unstall_root+0x30 (net_rx_action+0x88)
| +func -1173 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -1166 5.750 __ipipe_unstall_root+0x68 (net_rx_action+0x88)
+func -1160 6.500 process_backlog+0x10 (net_rx_action+0xac)
| +begin 0x80000001 -1154 6.500 process_backlog+0x60 (net_rx_action+0xac)
| #end 0x80000001 -1147 5.750 process_backlog+0x74 (net_rx_action+0xac)
#func -1142 6.250 __ipipe_unstall_root+0x10 (process_backlog+0xb4)
| #begin 0x80000000 -1135 5.750 __ipipe_unstall_root+0x30 (process_backlog+0xb4)
| +func -1130 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -1123 5.500 __ipipe_unstall_root+0x68 (process_backlog+0xb4)
+func -1117 9.000 netif_receive_skb+0x14 (process_backlog+0xc0)
+func -1108 9.250 ip_rcv+0x14 (netif_receive_skb+0x290)
+func -1099 5.750 ip_route_input+0x14 (ip_rcv+0x238)
+func -1093 9.750 rt_hash_code+0x10 (ip_route_input+0x38)
| +begin 0x80000001 -1083 6.250 ip_route_input+0xcc (ip_rcv+0x238)
| +end 0x80000001 -1077 7.750 ip_route_input+0xe0 (ip_rcv+0x238)
+func -1069 7.250 ip_local_deliver+0x10 (ip_rcv+0x538)
+func -1062 6.000 icmp_rcv+0x10 (ip_local_deliver+0xd8)
+func -1056 5.250 __skb_checksum_complete+0x10 (icmp_rcv+0x64)
+func -1051 5.500 __skb_checksum_complete_head+0x10 (__skb_checksum_complete+0x18)
+func -1045 10.250 skb_checksum+0x14 (__skb_checksum_complete_head+0x24)
+func -1035 5.750 icmp_echo+0x14 (icmp_rcv+0x138)
+func -1029 6.500 icmp_reply+0x14 (icmp_echo+0x60)
+func -1023 7.000 ip_options_echo+0x14 (icmp_reply+0x3c)
+func -1016 5.500 local_bh_disable+0x10 (icmp_reply+0x48)
+func -1010 7.250 ipipe_check_context+0x10 (local_bh_disable+0x18)
+func -1003 5.250 ip_route_output_key+0x10 (icmp_reply+0xc8)
+func -998 5.750 ip_route_output_flow+0x10 (ip_route_output_key+0x1c)
+func -992 5.500 __ip_route_output_key+0x14 (ip_route_output_flow+0x1c)
+func -987 6.250 rt_hash_code+0x10 (__ip_route_output_key+0x30)
+func -980 5.250 local_bh_disable+0x10 (__ip_route_output_key+0x38)
+func -975 9.000 ipipe_check_context+0x10 (local_bh_disable+0x18)
| +begin 0x80000001 -966 6.750 __ip_route_output_key+0xdc (ip_route_output_flow+0x1c)
| +end 0x80000001 -959 5.500 __ip_route_output_key+0xf0 (ip_route_output_flow+0x1c)
+func -954 5.500 local_bh_enable+0x10 (__ip_route_output_key+0x11c)
+func -948 5.750 ipipe_check_context+0x10 (local_bh_enable+0x58)
+func -943 8.000 ipipe_check_context+0x10 (local_bh_enable+0x98)
+func -935 5.750 icmp_push_reply+0x14 (icmp_reply+0x140)
+func -929 6.750 ip_append_data+0x14 (icmp_push_reply+0x50)
| +begin 0x80000001 -922 6.500 ip_append_data+0xd0 (icmp_push_reply+0x50)
| +end 0x80000001 -916 9.250 ip_append_data+0xe8 (icmp_push_reply+0x50)
+func -906 7.000 sock_alloc_send_skb+0x14 (ip_append_data+0x550)
+func -899 5.750 __alloc_skb+0x10 (sock_alloc_send_skb+0x94)
+func -894 6.750 kmem_cache_alloc+0x10 (__alloc_skb+0x34)
| +begin 0x80000001 -887 6.750 kmem_cache_alloc+0x58 (__alloc_skb+0x34)
| #end 0x80000001 -880 5.750 kmem_cache_alloc+0x6c (__alloc_skb+0x34)
#func -874 5.250 __ipipe_restore_root+0x10 (kmem_cache_alloc+0xbc)
#func -869 853.250 __ipipe_unstall_root+0x10 (__ipipe_restore_root+0x68)
| +func -16 8.500 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 -7 7.750 __ipipe_unstall_root+0x68 (__ipipe_restore_root+0x68)
>| +func 0! 878.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
:| +func 878+ 6.750 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
:| +func 885+ 5.750 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
:| +func 891+ 5.750 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
:| +func 896+ 6.000 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
:| +func 902+ 6.250 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
:| +func 909+ 5.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
:| +func 914+ 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
:| +func 920+ 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
:| # func 926+ 6.750 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
:| # func 933+ 9.750 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
:| # func 943! 14.500 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
:| # func 957+ 7.500 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
:| # func 965+ 5.250 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
:| # func 970+ 6.000 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
:| # func 976+ 9.250 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
:| +func 985+ 6.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
:| +func 992+ 7.500 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
<| +end 0xffffffff 999 5.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +func 1005 6.750 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 1012 0.000 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
^ permalink raw reply [flat|nested] 24+ messages in thread* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-26 16:29 ` Bosko Radivojevic
@ 2008-05-26 16:47 ` Gilles Chanteperdrix
2008-05-26 16:59 ` Gilles Chanteperdrix
2008-05-26 16:59 ` Bosko Radivojevic
0 siblings, 2 replies; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-26 16:47 UTC (permalink / raw)
To: Bosko Radivojevic; +Cc: xenomai-help
On Mon, May 26, 2008 at 6:29 PM, Bosko Radivojevic
<bosko.radivojevic@domain.hid> wrote:
> Hi Gilles,
>
> I've enabled tracer, as documented on Xenomai site. Well, to be
> honest, I dont see much from the output :) I've put
> xntrace_user_freeze (1, 1) in the handler to happen at the 1000th
> iteration. At the beginning of the interrupt handler one IO PIN is set
> to 1 and set back to 0 at the end. In the meantime, there is only for
> ().
>
> Attached file osc1.jpg is screen shot of USB Osciloscope when there is
> no Ethernet activity. osc2.jpg is good example of what happens when
> there is Ethernet activity (this time ping -f from PC box in the same
> LAN as Device).
>
> Do you see anything in those .txt files?
Well, if we read the sequence:
:| #func -199+ 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
:| #begin 0xffffffff -192+ 6.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
:| #func -185+ 5.500 __ipipe_handle_irq+0x10
(__ipipe_grab_irq+0x90)
:| #func -180+ 5.250 __ipipe_ack_timerirq+0x10
We see a timer irq
(__ipipe_handle_irq+0x70)
:| #func -175+ 6.000 __ipipe_ack_level_irq+0x10
(__ipipe_ack_timerirq+0x30)
:| #func -169+ 5.750 at91_aic_mask_irq+0x10
(__ipipe_ack_level_irq+0x2c)
:| #func -163+ 6.000 __ipipe_mach_acktimer+0x10
(__ipipe_ack_timerirq+0x40)
:| #func -157+ 5.250 __ipipe_end_level_irq+0x10
(__ipipe_ack_timerirq+0x50)
:| #func -152+ 6.000 at91_aic_unmask_irq+0x10
(__ipipe_end_level_irq+0x24)
:| #func -146+ 6.500 __ipipe_dispatch_wired+0x10
(__ipipe_handle_irq+0x7c)
:| #*func -139+ 7.250 xnintr_clock_handler+0x10
(__ipipe_dispatch_wired+0x100)
:| #*func -132+ 8.500 xntimer_tick_aperiodic+0x10
(xnintr_clock_handler+0x34)
:| #*func -123! 14.250 xntimer_next_local_shot+0x10
(xntimer_tick_aperiodic+0x250)
:| #*func -109+ 7.750 __ipipe_mach_set_dec+0x10
(xntimer_next_local_shot+0xd0)
:| #*func -101+ 5.250 rthal_irq_host_pend+0x10
(xnintr_clock_handler+0xd0)
:| #*func -96+ 5.750 __ipipe_schedule_irq+0x10
(rthal_irq_host_pend+0x20)
:| #*func -90+ 9.500 __ipipe_set_irq_pending+0x10
(__ipipe_schedule_irq+0x80)
:| #func -81+ 7.750 __ipipe_walk_pipeline+0x10
(__ipipe_handle_irq+0x118)
:| #end 0xffffffff -73+ 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
Immediately followed by a gpio irq.
:| #func -68+ 6.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
:| #begin 0xffffffff -61+ 6.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
:| #func -55+ 5.500 __ipipe_mach_demux_irq+0x14
(__ipipe_grab_irq+0x60)
:| #func -49! 12.250 at91_aic_mask_irq+0x10
(__ipipe_mach_demux_irq+0x3c)
:| #func -37+ 5.250 __ipipe_handle_irq+0x10
(__ipipe_mach_demux_irq+0xa0)
:| #func -32+ 5.750 __ipipe_ack_irq+0x10
(__ipipe_handle_irq+0x70)
:| #func -26+ 5.750 __ipipe_ack_simple_irq+0x10
(__ipipe_ack_irq+0x28)
:| #func -20+ 6.250 __ipipe_dispatch_wired+0x10
(__ipipe_handle_irq+0x7c)
:| #*func -14+ 6.250 xnintr_irq_handler+0x10
(__ipipe_dispatch_wired+0x100)
:| #*func -8+ 8.250 <bf0071fc> (xnintr_irq_handler+0x44)
<| #*freeze 0x00000001 0 6.750 <bf007230> (xnintr_irq_handler+0x44)
| #*func 6 5.750 rthal_irq_end+0x10
(xnintr_irq_handler+0xfc)
| #*func 12 8.000 __ipipe_end_simple_irq+0x10
(rthal_irq_end+0x34)
| #func 20 7.250 __ipipe_walk_pipeline+0x10
(__ipipe_handle_irq+0x118)
| #func 27 7.250 at91_aic_unmask_irq+0x10
(__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 35 7.250 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
Then, later:
| +func 202 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 209 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 215 5.750 __ipipe_mach_demux_irq+0x14
(__ipipe_grab_irq+0x60)
| +func 221 10.750 at91_aic_mask_irq+0x10
(__ipipe_mach_demux_irq+0x3c)
| +func 232 7.250 __ipipe_handle_irq+0x10
(__ipipe_mach_demux_irq+0xa0)
| +func 239 6.250 __ipipe_set_irq_pending+0x10
(__ipipe_handle_irq+0xb4)
| +func 245 5.500 __ipipe_ack_irq+0x10
(__ipipe_handle_irq+0xd4)
| +func 251 5.750 __ipipe_ack_simple_irq+0x10
(__ipipe_ack_irq+0x28)
| +func 256 7.000 __ipipe_walk_pipeline+0x10
(__ipipe_handle_irq+0x118)
| +func 263 7.000 __ipipe_sync_stage+0x14
(__ipipe_walk_pipeline+0x9c)
| +func 270 7.000 at91_aic_unmask_irq+0x10
(__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff 277 7.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
Which is a second gpio interrupt. I am afraid from this sequence, it
appears that the two interrupt are generated at hardware level. Did
you try setting up the irq with at91_set_gpio_input ?
--
Gilles
^ permalink raw reply [flat|nested] 24+ messages in thread
* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-26 16:47 ` Gilles Chanteperdrix
@ 2008-05-26 16:59 ` Gilles Chanteperdrix
2008-05-26 17:04 ` Bosko Radivojevic
2008-05-26 16:59 ` Bosko Radivojevic
1 sibling, 1 reply; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-26 16:59 UTC (permalink / raw)
To: Bosko Radivojevic; +Cc: xenomai-help
On Mon, May 26, 2008 at 6:47 PM, Gilles Chanteperdrix
<gilles.chanteperdrix@xenomai.org> wrote:
>Did
> you try setting up the irq with at91_set_gpio_input ?
What about at91_set_deglitch ?
--
Gilles
^ permalink raw reply [flat|nested] 24+ messages in thread
* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-26 16:59 ` Gilles Chanteperdrix
@ 2008-05-26 17:04 ` Bosko Radivojevic
2008-05-26 17:14 ` Gilles Chanteperdrix
0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-26 17:04 UTC (permalink / raw)
To: Gilles Chanteperdrix; +Cc: xenomai-help
On Mon, May 26, 2008 at 6:59 PM, Gilles Chanteperdrix
<gilles.chanteperdrix@xenomai.org> wrote:
> What about at91_set_deglitch ?
Nothing change when add at91_set_deglitch(). Two interrupts always.
Anyway, do you see any explanation why eth activity influence so much
RT interrupt handling?
^ permalink raw reply [flat|nested] 24+ messages in thread
* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-26 17:04 ` Bosko Radivojevic
@ 2008-05-26 17:14 ` Gilles Chanteperdrix
2008-05-26 17:16 ` Bosko Radivojevic
0 siblings, 1 reply; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-26 17:14 UTC (permalink / raw)
To: Bosko Radivojevic; +Cc: xenomai-help
On Mon, May 26, 2008 at 7:04 PM, Bosko Radivojevic
<bosko.radivojevic@domain.hid> wrote:
> On Mon, May 26, 2008 at 6:59 PM, Gilles Chanteperdrix
> <gilles.chanteperdrix@xenomai.org> wrote:
>
>> What about at91_set_deglitch ?
>
> Nothing change when add at91_set_deglitch(). Two interrupts always.
>
> Anyway, do you see any explanation why eth activity influence so much
> RT interrupt handling?
To know this we need to compare a trace taken at maximum time, with
and without ethernet.
--
Gilles
^ permalink raw reply [flat|nested] 24+ messages in thread
* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-26 17:14 ` Gilles Chanteperdrix
@ 2008-05-26 17:16 ` Bosko Radivojevic
2008-05-26 17:21 ` Gilles Chanteperdrix
0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-26 17:16 UTC (permalink / raw)
To: Gilles Chanteperdrix; +Cc: xenomai-help
On Mon, May 26, 2008 at 7:14 PM, Gilles Chanteperdrix
<gilles.chanteperdrix@xenomai.org> wrote:
> To know this we need to compare a trace taken at maximum time, with
> and without ethernet.
OK. I'll remove freeze call, and capture max with and without eth.
^ permalink raw reply [flat|nested] 24+ messages in thread
* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-26 17:16 ` Bosko Radivojevic
@ 2008-05-26 17:21 ` Gilles Chanteperdrix
2008-05-26 17:47 ` Bosko Radivojevic
0 siblings, 1 reply; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-26 17:21 UTC (permalink / raw)
To: Bosko Radivojevic; +Cc: xenomai-help
On Mon, May 26, 2008 at 7:16 PM, Bosko Radivojevic
<bosko.radivojevic@domain.hid> wrote:
> On Mon, May 26, 2008 at 7:14 PM, Gilles Chanteperdrix
> <gilles.chanteperdrix@xenomai.org> wrote:
>
>> To know this we need to compare a trace taken at maximum time, with
>> and without ethernet.
>
> OK. I'll remove freeze call, and capture max with and without eth.
No, you need to call freeze when maximum is reached, which means you
need to add some measurement instrumentations, based on rt_timer_tsc,
detect the maximum and call freeze in this case.
--
Gilles
^ permalink raw reply [flat|nested] 24+ messages in thread
* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-26 17:21 ` Gilles Chanteperdrix
@ 2008-05-26 17:47 ` Bosko Radivojevic
2008-05-27 11:31 ` Bosko Radivojevic
0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-26 17:47 UTC (permalink / raw)
To: Gilles Chanteperdrix; +Cc: xenomai-help
[-- Attachment #1: Type: text/plain, Size: 621 bytes --]
On Mon, May 26, 2008 at 7:21 PM, Gilles Chanteperdrix
<gilles.chanteperdrix@xenomai.org> wrote:
> No, you need to call freeze when maximum is reached, which means you
> need to add some measurement instrumentations, based on rt_timer_tsc,
> detect the maximum and call freeze in this case.
OK, here are the frozen files in both situations: with and without
ethernet activity (= ping -f)
I added the following code to the handler:
now = rt_timer_tsc()
if (first_time) {
last = now;
first_time = 0;
}
if (rt_timer_tsc2ns(now-last) > max) {
max = rt_timer_tsc2ns(now-last);
xntrace_user_freeze(1,0);
}
last = now;
[-- Attachment #2: frozen-noeth --]
[-- Type: application/octet-stream, Size: 98634 bytes --]
I-pipe frozen back-tracing service on 2.6.24.3/ipipe-1.9-00
------------------------------------------------------------
CPU: 0, Freeze: 4054738316 cycles, Trace Points: 100 (+1000)
Calibrated minimum trace-point overhead: 1.500 us
+----- Hard IRQs ('|': locked)
|+---- <unused>
||+--- <unused>
|||+-- Xenomai
||||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
||||| +---------- Delay flag ('+': > 1 us, '!': > 10 us)
||||| | +- NMI noise ('N')
||||| | |
Type User Val. Time Delay Function (Parent)
:| #begin 0x80000001 -1542+ 6.250 clocksource_get_next+0x40 (update_wall_time+0x64c)
:| #end 0x80000001 -1536+ 5.750 clocksource_get_next+0x54 (update_wall_time+0x64c)
: #func -1530+ 6.750 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
:| #begin 0x80000001 -1524+ 6.500 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
:| #end 0x80000001 -1517+ 6.500 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
: #func -1511+ 5.500 update_process_times+0x10 (tick_periodic+0x98)
: #func -1505+ 5.750 account_process_tick+0x10 (update_process_times+0x2c)
: #func -1499+ 7.000 account_system_time+0x10 (account_process_tick+0x40)
: #func -1492+ 5.500 account_system_time_scaled+0x10 (account_process_tick+0x4c)
: #func -1487+ 5.500 run_local_timers+0x10 (update_process_times+0x30)
: #func -1481+ 6.750 raise_softirq+0x10 (run_local_timers+0x18)
:| #begin 0x80000001 -1475+ 6.500 raise_softirq+0x44 (run_local_timers+0x18)
:| #end 0x80000001 -1468+ 5.750 raise_softirq+0x58 (run_local_timers+0x18)
: #func -1462+ 6.750 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
:| #begin 0x80000001 -1456+ 6.500 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
:| #end 0x80000001 -1449+ 5.500 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
: #func -1444+ 5.500 rcu_pending+0x10 (update_process_times+0x38)
: #func -1438+ 6.750 __rcu_pending+0x10 (rcu_pending+0x1c)
: #func -1431+ 6.000 __rcu_pending+0x10 (rcu_pending+0x34)
: #func -1425+ 5.750 scheduler_tick+0x10 (update_process_times+0x50)
: #func -1420+ 5.750 __update_rq_clock+0x14 (scheduler_tick+0x38)
: #func -1414+ 8.750 sched_clock+0x10 (__update_rq_clock+0x28)
: #func -1405+ 7.000 run_posix_cpu_timers+0x14 (update_process_times+0x58)
: #func -1398+ 9.250 profile_tick+0x10 (tick_periodic+0xa0)
:| #begin 0x80000001 -1389+ 6.500 handle_IRQ_event+0x9c (handle_level_irq+0x64)
:| #end 0x80000001 -1382+ 5.750 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
: #func -1377+ 6.750 note_interrupt+0x14 (handle_level_irq+0x84)
: #func -1370+ 5.500 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
: #func -1364+ 5.750 irq_exit+0x10 (__exception_text_start+0x4c)
: #func -1359+ 6.000 ipipe_check_context+0x10 (irq_exit+0x18)
: #func -1353+ 5.500 __do_softirq+0x10 (irq_exit+0x50)
: #func -1347+ 5.750 ipipe_check_context+0x10 (__do_softirq+0x20)
: #func -1341+ 6.250 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
:| #begin 0x80000000 -1335+ 7.000 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
:| +end 0x80000000 -1328+ 6.000 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
: +func -1322+ 5.750 run_timer_softirq+0x14 (__do_softirq+0x60)
: +func -1316+ 5.750 hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
: +func -1311+ 9.500 current_kernel_time+0x14 (hrtimer_run_queues+0x24)
:| +begin 0x80000001 -1301+ 6.500 hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
:| #end 0x80000001 -1295+ 5.750 hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
: #func -1289+ 6.250 __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
:| #begin 0x80000000 -1283+ 6.750 __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
:| +end 0x80000000 -1276+ 7.250 __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
:| +begin 0x80000001 -1269+ 6.500 run_timer_softirq+0x68 (__do_softirq+0x60)
:| #end 0x80000001 -1262+ 6.250 run_timer_softirq+0x7c (__do_softirq+0x60)
: #func -1256+ 6.500 __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
:| #begin 0x80000000 -1249+ 6.750 __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
:| +end 0x80000000 -1243+ 7.000 __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
:| +begin 0x80000001 -1236+ 6.250 __do_softirq+0xa8 (irq_exit+0x50)
:| #end 0x80000001 -1229+ 5.500 __do_softirq+0xbc (irq_exit+0x50)
: #func -1224+ 5.750 _local_bh_enable+0x10 (__do_softirq+0xfc)
: #func -1218+ 7.750 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
:| #begin 0x80000000 -1210+ 8.250 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
:| +end 0xffffffff -1202+ 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
: +func -1197+ 1.750 __ipipe_unstall_root+0x10 (default_idle+0x94)
:| +begin 0x80000000 -1195+ 2.000 __ipipe_unstall_root+0x30 (default_idle+0x94)
:| +end 0x80000000 -1193+ 2.000 __ipipe_unstall_root+0x68 (default_idle+0x94)
: +func -1191+ 2.000 default_idle+0x10 (cpu_idle+0x3c)
:| +begin 0x80000001 -1189+ 2.000 default_idle+0x54 (cpu_idle+0x3c)
:| #end 0x80000001 -1187+ 1.750 default_idle+0x68 (cpu_idle+0x3c)
: #func -1185+ 1.750 __ipipe_unstall_root+0x10 (default_idle+0x84)
:| #begin 0x80000000 -1183+ 1.750 __ipipe_unstall_root+0x30 (default_idle+0x84)
:| +end 0x80000000 -1182+ 1.750 __ipipe_unstall_root+0x68 (default_idle+0x84)
: +end 0x8000000e -1180! 84.500 default_idle+0x8c (cpu_idle+0x3c)
:| +func -1095+ 7.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
:| +begin 0xffffffff -1088+ 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
:| +func -1082+ 6.000 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
:| +func -1076+ 5.250 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
:| +func -1071+ 5.500 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
:| +func -1066+ 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
:| +func -1060+ 6.500 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
:| +func -1053+ 5.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
:| +func -1048+ 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
:| +func -1042! 855.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
:| # func -187! 10.500 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
:| # func -176! 15.000 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
:| # func -161+ 7.500 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
:| # func -154+ 5.250 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
:| # func -148+ 6.000 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
:| # func -142! 10.250 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
:| +func -132+ 7.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
:| +func -125+ 8.000 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
:| #end 0x80000000 -117+ 7.000 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
:| #func -110+ 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
:| #begin 0xffffffff -103+ 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
:| #func -97+ 6.000 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
:| #func -91! 12.250 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
:| #func -79+ 6.250 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
:| #func -73+ 5.750 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
:| #func -67+ 5.750 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
:| #func -61+ 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
:| #*func -55+ 7.000 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
:| #*func -48+ 7.500 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
:| #*func -41+ 6.500 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
:| #*func -34+ 5.500 xnarch_tsc_to_ns+0x10 (do_upg+0x8c [rt_bus_driver])
:| #*func -29+ 5.750 ipipe_trace_frozen_reset+0x10 (do_upg+0x94 [rt_bus_driver])
:| #*func -23+ 5.750 __ipipe_global_path_lock+0x10 (ipipe_trace_frozen_reset+0x14)
:| #*func -17! 10.500 __ipipe_spin_lock_irqsave+0x10 (__ipipe_global_path_lock+0x18)
:| #*func -7+ 7.000 __ipipe_spin_unlock_irqcomplete+0x10 (__ipipe_global_path_unlock+0x64)
<| #*freeze 0x00000001 0 7.250 do_upg+0x9c [rt_bus_driver] (xnintr_irq_handler+0x44)
| #*func 7 5.750 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func 13 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func 21 8.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 29 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 36 6.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func 43 5.500 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 48 5.250 irq_enter+0x10 (__exception_text_start+0x38)
#func 54 6.500 ipipe_check_context+0x10 (irq_enter+0x18)
#func 60 6.250 handle_level_irq+0x10 (__exception_text_start+0x48)
#func 66 5.500 handle_IRQ_event+0x10 (handle_level_irq+0x64)
#func 72 6.250 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
#func 78 5.500 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 84 7.000 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 91 6.250 do_timer+0x10 (tick_periodic+0x70)
#func 97 9.000 update_wall_time+0x14 (do_timer+0x30)
#func 106 7.500 current_tick_length+0x10 (update_wall_time+0x15c)
#func 113 9.250 current_tick_length+0x10 (update_wall_time+0x15c)
#func 123 6.500 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 129 6.500 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 136 5.750 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 141 6.750 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 148 6.000 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 154 7.000 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 161 5.500 update_process_times+0x10 (tick_periodic+0x98)
#func 167 5.500 account_process_tick+0x10 (update_process_times+0x2c)
#func 172 7.250 account_system_time+0x10 (account_process_tick+0x40)
#func 179 5.500 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 185 5.250 run_local_timers+0x10 (update_process_times+0x30)
#func 190 6.750 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 197 6.250 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 203 6.000 raise_softirq+0x58 (run_local_timers+0x18)
#func 209 6.500 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 216 6.500 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 222 5.500 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 228 5.500 rcu_pending+0x10 (update_process_times+0x38)
#func 233 6.750 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 240 6.500 __rcu_pending+0x10 (rcu_pending+0x34)
#func 246 5.750 scheduler_tick+0x10 (update_process_times+0x50)
#func 252 6.000 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 258 9.000 sched_clock+0x10 (__update_rq_clock+0x28)
#func 267 6.500 run_posix_cpu_timers+0x14 (update_process_times+0x58)
#func 274 7.500 profile_tick+0x10 (tick_periodic+0xa0)
#func 281 5.250 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 286 6.500 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 293 7.000 do_timer+0x10 (tick_periodic+0x70)
#func 300 11.250 update_wall_time+0x14 (do_timer+0x30)
#func 311 6.500 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 318 6.750 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 324 5.750 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 330 6.500 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 337 6.250 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 343 6.250 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 349 5.500 update_process_times+0x10 (tick_periodic+0x98)
#func 355 5.500 account_process_tick+0x10 (update_process_times+0x2c)
#func 360 6.500 account_system_time+0x10 (account_process_tick+0x40)
#func 367 5.500 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 372 5.750 run_local_timers+0x10 (update_process_times+0x30)
#func 378 6.500 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 384 6.250 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 391 5.750 raise_softirq+0x58 (run_local_timers+0x18)
#func 396 6.500 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 403 6.250 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 409 5.500 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 415 5.500 rcu_pending+0x10 (update_process_times+0x38)
#func 420 6.500 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 427 6.000 __rcu_pending+0x10 (rcu_pending+0x34)
#func 433 5.500 scheduler_tick+0x10 (update_process_times+0x50)
#func 438 5.500 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 444 8.500 sched_clock+0x10 (__update_rq_clock+0x28)
#func 452 6.750 run_posix_cpu_timers+0x14 (update_process_times+0x58)
| #func 459 7.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 466 6.000 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 472 6.250 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| #func 478 5.750 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| #func 484 6.000 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| #func 490 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| #func 496 6.250 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| #func 502 5.250 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| #func 507 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| #func 513 6.750 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 520 7.000 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 527 9.500 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| #*func 536 14.500 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| #*func 551 7.250 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| #*func 558 5.500 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| #*func 564 6.000 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| #*func 570 8.750 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| #func 578 7.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #end 0xffffffff 586 5.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| #func 592 6.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 598 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 604 5.500 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func 609 12.000 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func 621 5.500 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func 627 5.250 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| #func 632 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func 638 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 644 6.500 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 651 7.000 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| #*func 658 7.750 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| #*func 665 5.500 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func 671 8.000 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func 679 7.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 686 7.000 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 693 7.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func 701 7.750 profile_tick+0x10 (tick_periodic+0xa0)
#func 709 5.500 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 714 7.250 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 722 6.000 do_timer+0x10 (tick_periodic+0x70)
#func 728 9.000 update_wall_time+0x14 (do_timer+0x30)
#func 737 9.250 current_tick_length+0x10 (update_wall_time+0x15c)
#func 746 7.000 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 753 6.750 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 760 5.250 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 765 6.750 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 772 6.500 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 778 6.500 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 785 5.500 update_process_times+0x10 (tick_periodic+0x98)
#func 790 5.250 account_process_tick+0x10 (update_process_times+0x2c)
#func 795 7.000 account_system_time+0x10 (account_process_tick+0x40)
#func 802 5.750 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 808 5.000 run_local_timers+0x10 (update_process_times+0x30)
#func 813 6.500 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 820 6.500 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 826 6.000 raise_softirq+0x58 (run_local_timers+0x18)
#func 832 6.250 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 838 6.250 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 845 5.750 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 850 5.750 rcu_pending+0x10 (update_process_times+0x38)
#func 856 6.500 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 863 6.000 __rcu_pending+0x10 (rcu_pending+0x34)
#func 869 6.000 scheduler_tick+0x10 (update_process_times+0x50)
#func 875 5.750 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 880 8.750 sched_clock+0x10 (__update_rq_clock+0x28)
#func 889 6.500 run_posix_cpu_timers+0x14 (update_process_times+0x58)
#func 896 9.500 profile_tick+0x10 (tick_periodic+0xa0)
| #begin 0x80000001 905 6.750 handle_IRQ_event+0x9c (handle_level_irq+0x64)
| #end 0x80000001 912 5.500 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
#func 917 6.750 note_interrupt+0x14 (handle_level_irq+0x84)
#func 924 6.000 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
#func 930 5.750 irq_exit+0x10 (__exception_text_start+0x4c)
#func 936 6.000 ipipe_check_context+0x10 (irq_exit+0x18)
#func 942 5.250 __do_softirq+0x10 (irq_exit+0x50)
#func 947 5.750 ipipe_check_context+0x10 (__do_softirq+0x20)
#func 953 6.500 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
| #begin 0x80000000 959 5.500 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
| +func 965 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 972 6.500 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
+func 978 6.250 run_timer_softirq+0x14 (__do_softirq+0x60)
+func 985 6.000 hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
+func 991 9.750 current_kernel_time+0x14 (hrtimer_run_queues+0x24)
| +begin 0x80000001 1000 6.500 hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
| #end 0x80000001 1007 6.250 hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
#func 1013 6.250 __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
| #begin 0x80000000 1019 5.250 __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
| +func 1025 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 1032 7.500 __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
| +begin 0x80000001 1039 6.250 run_timer_softirq+0x68 (__do_softirq+0x60)
| #end 0x80000001 1045 7.750 run_timer_softirq+0x7c (__do_softirq+0x60)
#func 1053 6.250 __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
| #begin 0x80000000 1059 5.750 __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
| +func 1065 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 1072 6.750 __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
| +begin 0x80000001 1079 6.500 __do_softirq+0xa8 (irq_exit+0x50)
| #end 0x80000001 1085 5.750 __do_softirq+0xbc (irq_exit+0x50)
#func 1091 5.750 _local_bh_enable+0x10 (__do_softirq+0xfc)
#func 1097 7.750 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
| #begin 0x80000000 1104 8.000 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 1112 5.750 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func 1118 5.250 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 1123 5.500 irq_enter+0x10 (__exception_text_start+0x38)
#func 1129 6.000 ipipe_check_context+0x10 (irq_enter+0x18)
#func 1135 6.500 handle_level_irq+0x10 (__exception_text_start+0x48)
#func 1141 5.500 handle_IRQ_event+0x10 (handle_level_irq+0x64)
#func 1147 6.250 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
#func 1153 5.250 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 1158 7.000 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 1165 6.000 do_timer+0x10 (tick_periodic+0x70)
#func 1171 10.500 update_wall_time+0x14 (do_timer+0x30)
#func 1182 6.750 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 1189 6.500 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 1195 5.500 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 1201 6.500 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 1207 6.500 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 1214 6.750 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 1220 5.000 update_process_times+0x10 (tick_periodic+0x98)
#func 1225 7.000 account_process_tick+0x10 (update_process_times+0x2c)
| #func 1232 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 1239 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 1245 5.750 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| #func 1251 5.500 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| #func 1256 5.750 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| #func 1262 6.000 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| #func 1268 6.000 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| #func 1274 5.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| #func 1280 6.000 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| #func 1286 6.750 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 1292 6.500 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 1299 8.750 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| #*func 1308 15.000 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| #*func 1323 7.500 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| #*func 1330 5.250 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| #*func 1335 5.750 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| #*func 1341 9.000 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| #func 1350 7.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #end 0xffffffff 1358 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| #func 1363 6.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 1370 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 1375 6.000 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func 1381 11.750 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func 1393 5.500 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func 1398 5.750 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| #func 1404 5.750 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func 1410 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 1416 6.250 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 1422 6.750 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| #*func 1429 8.250 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| #*func 1437 5.500 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func 1443 8.000 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func 1451 7.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 1458 7.500 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 1466 5.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func 1472 7.500 account_system_time+0x10 (account_process_tick+0x40)
#func 1479 5.500 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 1485 5.750 run_local_timers+0x10 (update_process_times+0x30)
#func 1490 6.500 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 1497 6.500 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 1503 5.750 raise_softirq+0x58 (run_local_timers+0x18)
#func 1509 6.750 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 1516 6.250 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 1522 5.500 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 1528 5.750 rcu_pending+0x10 (update_process_times+0x38)
#func 1533 6.500 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 1540 5.750 __rcu_pending+0x10 (rcu_pending+0x34)
#func 1546 5.250 scheduler_tick+0x10 (update_process_times+0x50)
#func 1551 6.000 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 1557 9.000 sched_clock+0x10 (__update_rq_clock+0x28)
#func 1566 6.500 run_posix_cpu_timers+0x14 (update_process_times+0x58)
#func 1572 10.000 profile_tick+0x10 (tick_periodic+0xa0)
| #begin 0x80000001 1582 7.000 handle_IRQ_event+0x9c (handle_level_irq+0x64)
| #end 0x80000001 1589 5.750 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
#func 1595 6.750 note_interrupt+0x14 (handle_level_irq+0x84)
#func 1602 5.500 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
#func 1607 6.000 irq_exit+0x10 (__exception_text_start+0x4c)
#func 1613 6.250 ipipe_check_context+0x10 (irq_exit+0x18)
#func 1620 5.250 __do_softirq+0x10 (irq_exit+0x50)
#func 1625 5.750 ipipe_check_context+0x10 (__do_softirq+0x20)
#func 1631 6.500 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
| #begin 0x80000000 1637 5.500 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
| +func 1643 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 1649 5.750 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
+func 1655 6.500 run_timer_softirq+0x14 (__do_softirq+0x60)
+func 1662 5.750 hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
+func 1667 9.000 current_kernel_time+0x14 (hrtimer_run_queues+0x24)
| +begin 0x80000001 1676 6.500 hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
| #end 0x80000001 1683 6.000 hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
#func 1689 6.500 __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
| #begin 0x80000000 1695 5.250 __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
| +func 1701 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 1707 7.000 __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
| +begin 0x80000001 1714 6.500 run_timer_softirq+0x68 (__do_softirq+0x60)
| #end 0x80000001 1721 6.000 run_timer_softirq+0x7c (__do_softirq+0x60)
#func 1727 6.250 __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
| #begin 0x80000000 1733 5.750 __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
| +func 1739 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 1746 7.000 __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
| +begin 0x80000001 1753 6.250 __do_softirq+0xa8 (irq_exit+0x50)
| #end 0x80000001 1759 5.500 __do_softirq+0xbc (irq_exit+0x50)
#func 1764 6.000 _local_bh_enable+0x10 (__do_softirq+0xfc)
#func 1770 7.750 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
| #begin 0x80000000 1778 8.250 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 1786 5.750 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func 1792 5.750 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 1798 5.500 irq_enter+0x10 (__exception_text_start+0x38)
#func 1803 5.750 ipipe_check_context+0x10 (irq_enter+0x18)
#func 1809 5.750 handle_level_irq+0x10 (__exception_text_start+0x48)
#func 1815 6.000 handle_IRQ_event+0x10 (handle_level_irq+0x64)
#func 1821 6.000 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
#func 1827 5.250 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 1832 7.000 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 1839 6.750 do_timer+0x10 (tick_periodic+0x70)
#func 1846 9.000 update_wall_time+0x14 (do_timer+0x30)
#func 1855 9.500 current_tick_length+0x10 (update_wall_time+0x15c)
#func 1864 7.000 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 1871 6.750 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 1878 5.750 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 1884 6.750 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 1891 6.500 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 1897 7.250 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 1904 5.250 update_process_times+0x10 (tick_periodic+0x98)
#func 1910 5.250 account_process_tick+0x10 (update_process_times+0x2c)
#func 1915 7.500 account_system_time+0x10 (account_process_tick+0x40)
#func 1922 5.750 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 1928 5.250 run_local_timers+0x10 (update_process_times+0x30)
#func 1933 6.500 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 1940 6.500 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 1946 6.000 raise_softirq+0x58 (run_local_timers+0x18)
#func 1952 6.250 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 1959 6.250 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 1965 5.750 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 1971 5.750 rcu_pending+0x10 (update_process_times+0x38)
#func 1976 6.500 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 1983 6.000 __rcu_pending+0x10 (rcu_pending+0x34)
#func 1989 6.000 scheduler_tick+0x10 (update_process_times+0x50)
#func 1995 5.750 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 2001 9.000 sched_clock+0x10 (__update_rq_clock+0x28)
| #func 2010 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 2017 6.000 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 2023 6.500 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| #func 2029 5.500 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| #func 2035 5.500 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| #func 2040 6.000 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| #func 2046 6.750 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| #func 2053 5.000 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| #func 2058 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| #func 2064 6.750 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 2070 6.750 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 2077 9.000 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| #*func 2086 14.500 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| #*func 2101 7.750 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| #*func 2108 5.500 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| #*func 2114 6.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| #*func 2120 9.250 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| #func 2129 7.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #end 0xffffffff 2137 5.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| #func 2143 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 2149 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 2155 6.000 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func 2161 12.000 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func 2173 5.750 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func 2178 5.750 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| #func 2184 5.750 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func 2190 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 2196 6.250 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 2202 6.500 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| #*func 2209 8.250 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| #*func 2217 6.000 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func 2223 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func 2231 7.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 2238 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 2246 8.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func 2254 6.500 run_posix_cpu_timers+0x14 (update_process_times+0x58)
#func 2261 10.500 profile_tick+0x10 (tick_periodic+0xa0)
| #begin 0x80000001 2271 6.750 handle_IRQ_event+0x9c (handle_level_irq+0x64)
| #end 0x80000001 2278 5.750 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
#func 2284 6.250 note_interrupt+0x14 (handle_level_irq+0x84)
#func 2290 5.750 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
#func 2296 5.750 irq_exit+0x10 (__exception_text_start+0x4c)
#func 2302 6.250 ipipe_check_context+0x10 (irq_exit+0x18)
#func 2308 5.500 __do_softirq+0x10 (irq_exit+0x50)
#func 2313 5.500 ipipe_check_context+0x10 (__do_softirq+0x20)
#func 2319 6.750 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
| #begin 0x80000000 2326 5.750 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
| +func 2331 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 2338 5.750 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
+func 2344 6.250 run_timer_softirq+0x14 (__do_softirq+0x60)
+func 2350 5.750 hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
+func 2356 9.750 current_kernel_time+0x14 (hrtimer_run_queues+0x24)
| +begin 0x80000001 2366 6.250 hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
| #end 0x80000001 2372 5.750 hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
#func 2378 6.500 __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
| #begin 0x80000000 2384 5.750 __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
| +func 2390 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 2397 7.750 __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
| +begin 0x80000001 2404 6.750 run_timer_softirq+0x68 (__do_softirq+0x60)
| #end 0x80000001 2411 6.250 run_timer_softirq+0x7c (__do_softirq+0x60)
#func 2417 6.250 __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
| #begin 0x80000000 2424 5.500 __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
| +func 2429 7.250 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 2436 6.750 __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
| +begin 0x80000001 2443 6.250 __do_softirq+0xa8 (irq_exit+0x50)
| #end 0x80000001 2449 5.500 __do_softirq+0xbc (irq_exit+0x50)
#func 2455 6.000 _local_bh_enable+0x10 (__do_softirq+0xfc)
#func 2461 7.500 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
| #begin 0x80000000 2468 8.250 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 2477 5.750 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func 2482 5.500 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 2488 5.500 irq_enter+0x10 (__exception_text_start+0x38)
#func 2493 6.000 ipipe_check_context+0x10 (irq_enter+0x18)
#func 2499 5.750 handle_level_irq+0x10 (__exception_text_start+0x48)
#func 2505 6.000 handle_IRQ_event+0x10 (handle_level_irq+0x64)
#func 2511 7.750 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
| #begin 0x80000001 2519 6.500 handle_IRQ_event+0x9c (handle_level_irq+0x64)
| #end 0x80000001 2525 5.500 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
#func 2531 6.750 note_interrupt+0x14 (handle_level_irq+0x84)
#func 2538 5.500 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
#func 2543 5.750 irq_exit+0x10 (__exception_text_start+0x4c)
#func 2549 7.250 ipipe_check_context+0x10 (irq_exit+0x18)
| #begin 0x80000000 2556 8.750 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff 2565 5.000 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func 2570 1.500 __ipipe_unstall_root+0x10 (default_idle+0x94)
| +begin 0x80000000 2571 2.000 __ipipe_unstall_root+0x30 (default_idle+0x94)
| +end 0x80000000 2573 1.750 __ipipe_unstall_root+0x68 (default_idle+0x94)
+func 2575 2.000 default_idle+0x10 (cpu_idle+0x3c)
| +begin 0x80000001 2577 1.750 default_idle+0x54 (cpu_idle+0x3c)
| #end 0x80000001 2579 1.750 default_idle+0x68 (cpu_idle+0x3c)
#func 2581 1.750 __ipipe_unstall_root+0x10 (default_idle+0x84)
| #begin 0x80000000 2582 1.750 __ipipe_unstall_root+0x30 (default_idle+0x84)
| +end 0x80000000 2584 1.750 __ipipe_unstall_root+0x68 (default_idle+0x84)
+end 0x8000000e 2586 198.750 default_idle+0x8c (cpu_idle+0x3c)
| +func 2785 7.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 2792 5.250 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 2797 5.750 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func 2803 6.000 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func 2809 5.750 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func 2815 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func 2820 6.500 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func 2827 6.000 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func 2833 6.000 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func 2839 6.000 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 2845 6.500 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 2851 8.500 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func 2860 15.250 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func 2875 7.000 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func 2882 5.250 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func 2887 6.500 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func 2894 9.250 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func 2903 6.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 2909 8.250 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 2918 6.250 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
| #func 2924 6.750 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 2931 6.000 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 2937 5.750 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func 2942 12.500 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func 2955 6.250 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func 2961 5.250 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| #func 2966 5.500 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func 2972 6.750 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 2979 6.750 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 2985 7.250 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| #*func 2993 7.750 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| #*func 3000 5.750 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func 3006 8.000 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func 3014 7.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 3021 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 3028 6.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func 3035 5.500 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 3040 5.500 irq_enter+0x10 (__exception_text_start+0x38)
#func 3046 5.750 ipipe_check_context+0x10 (irq_enter+0x18)
#func 3052 7.000 handle_level_irq+0x10 (__exception_text_start+0x48)
#func 3059 6.500 handle_IRQ_event+0x10 (handle_level_irq+0x64)
#func 3065 6.000 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
#func 3071 5.250 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 3076 6.250 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 3083 6.000 do_timer+0x10 (tick_periodic+0x70)
#func 3089 9.000 update_wall_time+0x14 (do_timer+0x30)
#func 3098 7.500 current_tick_length+0x10 (update_wall_time+0x15c)
#func 3105 9.500 current_tick_length+0x10 (update_wall_time+0x15c)
#func 3115 7.000 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 3122 6.750 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 3128 5.750 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 3134 7.000 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 3141 6.750 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 3148 6.500 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 3154 5.250 update_process_times+0x10 (tick_periodic+0x98)
#func 3160 5.500 account_process_tick+0x10 (update_process_times+0x2c)
#func 3165 7.500 account_system_time+0x10 (account_process_tick+0x40)
#func 3173 6.000 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 3179 5.250 run_local_timers+0x10 (update_process_times+0x30)
#func 3184 6.500 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 3190 6.750 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 3197 5.750 raise_softirq+0x58 (run_local_timers+0x18)
#func 3203 6.500 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 3209 6.500 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 3216 5.750 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 3222 5.250 rcu_pending+0x10 (update_process_times+0x38)
#func 3227 6.500 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 3233 6.500 __rcu_pending+0x10 (rcu_pending+0x34)
#func 3240 6.000 scheduler_tick+0x10 (update_process_times+0x50)
#func 3246 5.750 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 3252 8.500 sched_clock+0x10 (__update_rq_clock+0x28)
#func 3260 6.750 run_posix_cpu_timers+0x14 (update_process_times+0x58)
#func 3267 9.500 profile_tick+0x10 (tick_periodic+0xa0)
| #begin 0x80000001 3276 6.500 handle_IRQ_event+0x9c (handle_level_irq+0x64)
| #end 0x80000001 3283 5.750 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
#func 3289 6.750 note_interrupt+0x14 (handle_level_irq+0x84)
#func 3295 6.000 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
#func 3301 5.500 irq_exit+0x10 (__exception_text_start+0x4c)
#func 3307 5.500 ipipe_check_context+0x10 (irq_exit+0x18)
#func 3312 6.000 __do_softirq+0x10 (irq_exit+0x50)
#func 3318 6.000 ipipe_check_context+0x10 (__do_softirq+0x20)
#func 3324 6.500 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
| #begin 0x80000000 3331 6.500 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
| +end 0x80000000 3337 5.750 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
+func 3343 5.750 run_timer_softirq+0x14 (__do_softirq+0x60)
+func 3349 5.250 hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
+func 3354 9.500 current_kernel_time+0x14 (hrtimer_run_queues+0x24)
| +begin 0x80000001 3364 6.500 hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
| #end 0x80000001 3370 6.250 hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
#func 3376 6.250 __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
| #begin 0x80000000 3383 6.500 __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
| +end 0x80000000 3389 7.750 __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
| +begin 0x80000001 3397 6.250 run_timer_softirq+0x68 (__do_softirq+0x60)
| #end 0x80000001 3403 6.250 run_timer_softirq+0x7c (__do_softirq+0x60)
#func 3409 6.500 __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
| #begin 0x80000000 3416 6.750 __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
| +end 0x80000000 3423 7.000 __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
| +begin 0x80000001 3430 6.250 __do_softirq+0xa8 (irq_exit+0x50)
| #end 0x80000001 3436 5.500 __do_softirq+0xbc (irq_exit+0x50)
#func 3441 5.500 _local_bh_enable+0x10 (__do_softirq+0xfc)
#func 3447 8.000 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
| #begin 0x80000000 3455 8.500 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff 3463 4.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func 3468 1.750 __ipipe_unstall_root+0x10 (default_idle+0x94)
| +begin 0x80000000 3470 1.750 __ipipe_unstall_root+0x30 (default_idle+0x94)
| +end 0x80000000 3472 1.750 __ipipe_unstall_root+0x68 (default_idle+0x94)
+func 3473 1.750 default_idle+0x10 (cpu_idle+0x3c)
| +begin 0x80000001 3475 1.750 default_idle+0x54 (cpu_idle+0x3c)
| #end 0x80000001 3477 1.750 default_idle+0x68 (cpu_idle+0x3c)
#func 3479 1.750 __ipipe_unstall_root+0x10 (default_idle+0x84)
| #begin 0x80000000 3480 1.750 __ipipe_unstall_root+0x30 (default_idle+0x84)
| +end 0x80000000 3482 1.750 __ipipe_unstall_root+0x68 (default_idle+0x84)
+end 0x8000000e 3484 76.500 default_idle+0x8c (cpu_idle+0x3c)
| +func 3560 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 3567 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 3573 5.750 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func 3578 6.000 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func 3584 5.500 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func 3590 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func 3596 6.250 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func 3602 5.750 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func 3608 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func 3613 6.000 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 3619 6.500 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 3626 9.500 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func 3635 14.750 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func 3650 7.250 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func 3657 5.750 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func 3663 6.000 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func 3669 9.000 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func 3678 6.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 3684 8.750 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 3693 6.750 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
| #func 3700 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 3706 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 3712 6.000 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func 3718 12.000 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func 3730 6.000 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func 3736 5.500 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| #func 3741 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func 3747 6.750 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 3754 6.500 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 3761 6.750 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| #*func 3767 8.250 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| #*func 3776 5.750 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func 3781 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func 3790 7.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 3797 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 3804 6.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func 3811 5.750 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 3816 5.000 irq_enter+0x10 (__exception_text_start+0x38)
#func 3821 6.500 ipipe_check_context+0x10 (irq_enter+0x18)
#func 3828 6.000 handle_level_irq+0x10 (__exception_text_start+0x48)
#func 3834 5.500 handle_IRQ_event+0x10 (handle_level_irq+0x64)
#func 3839 6.250 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
#func 3846 5.250 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 3851 7.250 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 3858 6.000 do_timer+0x10 (tick_periodic+0x70)
#func 3864 9.000 update_wall_time+0x14 (do_timer+0x30)
#func 3873 9.500 current_tick_length+0x10 (update_wall_time+0x15c)
#func 3883 7.000 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 3890 6.500 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 3896 5.750 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 3902 6.500 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 3908 6.750 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 3915 7.500 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 3923 5.250 update_process_times+0x10 (tick_periodic+0x98)
#func 3928 5.500 account_process_tick+0x10 (update_process_times+0x2c)
#func 3933 7.750 account_system_time+0x10 (account_process_tick+0x40)
#func 3941 5.750 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 3947 5.250 run_local_timers+0x10 (update_process_times+0x30)
#func 3952 6.750 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 3959 6.500 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 3965 5.750 raise_softirq+0x58 (run_local_timers+0x18)
#func 3971 6.250 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 3977 6.750 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 3984 6.000 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 3990 5.500 rcu_pending+0x10 (update_process_times+0x38)
#func 3996 6.500 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 4002 6.500 __rcu_pending+0x10 (rcu_pending+0x34)
#func 4009 5.750 scheduler_tick+0x10 (update_process_times+0x50)
#func 4014 5.750 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 4020 8.500 sched_clock+0x10 (__update_rq_clock+0x28)
#func 4029 6.500 run_posix_cpu_timers+0x14 (update_process_times+0x58)
#func 4035 10.250 profile_tick+0x10 (tick_periodic+0xa0)
| #begin 0x80000001 4045 6.250 handle_IRQ_event+0x9c (handle_level_irq+0x64)
| #end 0x80000001 4052 5.500 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
#func 4057 6.750 note_interrupt+0x14 (handle_level_irq+0x84)
#func 4064 6.250 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
#func 4070 5.250 irq_exit+0x10 (__exception_text_start+0x4c)
#func 4075 5.750 ipipe_check_context+0x10 (irq_exit+0x18)
#func 4081 5.500 __do_softirq+0x10 (irq_exit+0x50)
#func 4087 6.250 ipipe_check_context+0x10 (__do_softirq+0x20)
#func 4093 6.250 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
| #begin 0x80000000 4099 6.750 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
| +end 0x80000000 4106 6.250 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
+func 4112 5.750 run_timer_softirq+0x14 (__do_softirq+0x60)
+func 4118 5.750 hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
+func 4124 8.250 current_kernel_time+0x14 (hrtimer_run_queues+0x24)
| +begin 0x80000001 4132 6.500 hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
| #end 0x80000001 4138 5.750 hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
#func 4144 6.500 __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
| #begin 0x80000000 4151 6.500 __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
| +end 0x80000000 4157 7.250 __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
| +begin 0x80000001 4164 6.500 run_timer_softirq+0x68 (__do_softirq+0x60)
| #end 0x80000001 4171 6.000 run_timer_softirq+0x7c (__do_softirq+0x60)
#func 4177 6.250 __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
| #begin 0x80000000 4183 7.000 __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
| +end 0x80000000 4190 7.000 __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
| +begin 0x80000001 4197 6.250 __do_softirq+0xa8 (irq_exit+0x50)
| #end 0x80000001 4203 5.500 __do_softirq+0xbc (irq_exit+0x50)
#func 4209 6.000 _local_bh_enable+0x10 (__do_softirq+0xfc)
#func 4215 7.750 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
| #begin 0x80000000 4223 8.250 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff 4231 5.000 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func 4236 1.750 __ipipe_unstall_root+0x10 (default_idle+0x94)
| +begin 0x80000000 4238 2.000 __ipipe_unstall_root+0x30 (default_idle+0x94)
| +end 0x80000000 4240 1.500 __ipipe_unstall_root+0x68 (default_idle+0x94)
+func 4241 1.750 default_idle+0x10 (cpu_idle+0x3c)
| +begin 0x80000001 4243 1.750 default_idle+0x54 (cpu_idle+0x3c)
| #end 0x80000001 4245 1.750 default_idle+0x68 (cpu_idle+0x3c)
#func 4246 1.750 __ipipe_unstall_root+0x10 (default_idle+0x84)
| #begin 0x80000000 4248 1.750 __ipipe_unstall_root+0x30 (default_idle+0x84)
| +end 0x80000000 4250 1.750 __ipipe_unstall_root+0x68 (default_idle+0x84)
+end 0x8000000e 4252 84.500 default_idle+0x8c (cpu_idle+0x3c)
| +func 4336 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 4343 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 4348 5.750 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func 4354 5.750 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func 4360 5.750 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func 4366 5.500 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func 4371 6.500 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func 4378 5.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func 4383 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func 4389 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 4395 6.750 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 4402 9.000 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func 4411 14.500 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func 4425 7.250 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func 4433 5.750 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func 4438 6.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func 4445 9.500 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func 4454 6.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 4460 8.500 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 4469 6.500 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
| #func 4475 6.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 4481 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 4487 6.250 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func 4493 12.250 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func 4505 5.750 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func 4511 5.250 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| #func 4516 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func 4522 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 4529 6.250 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 4535 7.250 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| #*func 4542 8.500 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| #*func 4551 5.750 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func 4556 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func 4565 7.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 4572 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 4579 6.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func 4586 5.500 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 4591 5.750 irq_enter+0x10 (__exception_text_start+0x38)
#func 4597 6.250 ipipe_check_context+0x10 (irq_enter+0x18)
#func 4603 6.250 handle_level_irq+0x10 (__exception_text_start+0x48)
#func 4609 5.750 handle_IRQ_event+0x10 (handle_level_irq+0x64)
#func 4615 5.750 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
#func 4621 5.500 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 4626 6.250 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 4633 5.750 do_timer+0x10 (tick_periodic+0x70)
#func 4638 8.500 update_wall_time+0x14 (do_timer+0x30)
#func 4647 10.000 current_tick_length+0x10 (update_wall_time+0x15c)
#func 4657 7.000 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 4664 6.500 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 4670 5.500 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 4676 6.500 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 4682 6.500 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 4689 6.500 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 4695 5.250 update_process_times+0x10 (tick_periodic+0x98)
#func 4701 5.750 account_process_tick+0x10 (update_process_times+0x2c)
#func 4706 7.250 account_system_time+0x10 (account_process_tick+0x40)
#func 4714 5.500 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 4719 5.250 run_local_timers+0x10 (update_process_times+0x30)
#func 4724 6.750 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 4731 6.750 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 4738 5.750 raise_softirq+0x58 (run_local_timers+0x18)
#func 4744 6.250 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 4750 6.500 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 4756 6.000 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 4762 5.500 rcu_pending+0x10 (update_process_times+0x38)
#func 4768 6.500 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 4774 6.500 __rcu_pending+0x10 (rcu_pending+0x34)
#func 4781 6.000 scheduler_tick+0x10 (update_process_times+0x50)
#func 4787 5.500 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 4792 8.500 sched_clock+0x10 (__update_rq_clock+0x28)
#func 4801 7.250 run_posix_cpu_timers+0x14 (update_process_times+0x58)
#func 4808 9.500 profile_tick+0x10 (tick_periodic+0xa0)
| #begin 0x80000001 4818 6.500 handle_IRQ_event+0x9c (handle_level_irq+0x64)
| #end 0x80000001 4824 5.500 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
#func 4830 6.750 note_interrupt+0x14 (handle_level_irq+0x84)
#func 4836 6.250 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
#func 4843 5.500 irq_exit+0x10 (__exception_text_start+0x4c)
#func 4848 5.750 ipipe_check_context+0x10 (irq_exit+0x18)
#func 4854 5.750 __do_softirq+0x10 (irq_exit+0x50)
#func 4860 5.750 ipipe_check_context+0x10 (__do_softirq+0x20)
#func 4865 6.250 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
| #begin 0x80000000 4872 6.750 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
| +end 0x80000000 4878 6.000 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
+func 4884 6.250 run_timer_softirq+0x14 (__do_softirq+0x60)
+func 4891 5.500 hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
+func 4896 9.250 current_kernel_time+0x14 (hrtimer_run_queues+0x24)
| +begin 0x80000001 4905 6.500 hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
| #end 0x80000001 4912 6.250 hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
#func 4918 6.250 __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
| #begin 0x80000000 4924 6.750 __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
| +end 0x80000000 4931 7.000 __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
| +begin 0x80000001 4938 6.500 run_timer_softirq+0x68 (__do_softirq+0x60)
| #end 0x80000001 4945 6.000 run_timer_softirq+0x7c (__do_softirq+0x60)
#func 4951 6.500 __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
| #begin 0x80000000 4957 6.750 __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
| +end 0x80000000 4964 6.750 __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
| +begin 0x80000001 4971 6.250 __do_softirq+0xa8 (irq_exit+0x50)
| #end 0x80000001 4977 5.250 __do_softirq+0xbc (irq_exit+0x50)
#func 4982 6.000 _local_bh_enable+0x10 (__do_softirq+0xfc)
#func 4988 7.500 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
| #begin 0x80000000 4996 8.000 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff 5004 5.000 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func 5009 2.250 __ipipe_unstall_root+0x10 (default_idle+0x94)
| +begin 0x80000000 5011 1.750 __ipipe_unstall_root+0x30 (default_idle+0x94)
| +end 0x80000000 5013 1.750 __ipipe_unstall_root+0x68 (default_idle+0x94)
+func 5014 1.750 default_idle+0x10 (cpu_idle+0x3c)
| +begin 0x80000001 5016 1.750 default_idle+0x54 (cpu_idle+0x3c)
| #end 0x80000001 5018 1.750 default_idle+0x68 (cpu_idle+0x3c)
#func 5020 1.750 __ipipe_unstall_root+0x10 (default_idle+0x84)
| #begin 0x80000000 5021 1.750 __ipipe_unstall_root+0x30 (default_idle+0x84)
| +end 0x80000000 5023 1.750 __ipipe_unstall_root+0x68 (default_idle+0x84)
+end 0x8000000e 5025 87.000 default_idle+0x8c (cpu_idle+0x3c)
| +func 5112 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 5119 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 5124 6.250 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func 5131 6.000 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func 5137 5.750 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func 5142 5.500 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func 5148 6.500 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func 5154 5.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func 5160 5.500 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func 5165 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 5172 6.500 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 5178 9.250 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func 5187 14.500 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func 5202 6.750 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func 5209 5.500 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func 5214 6.500 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func 5221 8.750 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func 5229 6.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 5236 8.500 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 5244 6.250 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
| #func 5251 6.750 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 5257 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 5263 6.000 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func 5269 12.250 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func 5281 5.500 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func 5287 5.500 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| #func 5292 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func 5298 6.750 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 5305 6.750 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 5312 7.500 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| #*func 5319 7.750 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| #*func 5327 5.750 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func 5333 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func 5341 7.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 5348 7.500 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 5356 6.250 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func 5362 5.500 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 5368 5.500 irq_enter+0x10 (__exception_text_start+0x38)
#func 5373 6.000 ipipe_check_context+0x10 (irq_enter+0x18)
#func 5379 6.250 handle_level_irq+0x10 (__exception_text_start+0x48)
#func 5385 5.750 handle_IRQ_event+0x10 (handle_level_irq+0x64)
#func 5391 6.000 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
#func 5397 5.250 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 5402 6.500 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 5409 5.500 do_timer+0x10 (tick_periodic+0x70)
#func 5414 9.000 update_wall_time+0x14 (do_timer+0x30)
#func 5423 9.500 current_tick_length+0x10 (update_wall_time+0x15c)
#func 5433 6.500 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 5439 6.500 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 5446 5.750 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 5452 6.750 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 5458 6.750 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 5465 6.750 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 5472 5.250 update_process_times+0x10 (tick_periodic+0x98)
#func 5477 5.500 account_process_tick+0x10 (update_process_times+0x2c)
#func 5483 7.750 account_system_time+0x10 (account_process_tick+0x40)
#func 5490 5.250 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 5496 5.250 run_local_timers+0x10 (update_process_times+0x30)
#func 5501 6.750 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 5508 6.750 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 5514 5.750 raise_softirq+0x58 (run_local_timers+0x18)
#func 5520 6.250 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 5526 6.750 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 5533 5.750 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 5539 5.500 rcu_pending+0x10 (update_process_times+0x38)
#func 5544 6.500 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 5551 6.250 __rcu_pending+0x10 (rcu_pending+0x34)
#func 5557 5.750 scheduler_tick+0x10 (update_process_times+0x50)
#func 5563 5.500 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 5568 8.500 sched_clock+0x10 (__update_rq_clock+0x28)
#func 5577 6.500 run_posix_cpu_timers+0x14 (update_process_times+0x58)
#func 5583 9.500 profile_tick+0x10 (tick_periodic+0xa0)
| #begin 0x80000001 5593 6.250 handle_IRQ_event+0x9c (handle_level_irq+0x64)
| #end 0x80000001 5599 5.750 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
#func 5605 6.750 note_interrupt+0x14 (handle_level_irq+0x84)
#func 5612 6.000 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
#func 5618 5.500 irq_exit+0x10 (__exception_text_start+0x4c)
#func 5623 6.250 ipipe_check_context+0x10 (irq_exit+0x18)
#func 5629 5.750 __do_softirq+0x10 (irq_exit+0x50)
#func 5635 5.750 ipipe_check_context+0x10 (__do_softirq+0x20)
#func 5641 6.750 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
| #begin 0x80000000 5648 6.750 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
| +end 0x80000000 5654 6.250 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
+func 5661 6.250 run_timer_softirq+0x14 (__do_softirq+0x60)
+func 5667 5.750 hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
+func 5673 8.500 current_kernel_time+0x14 (hrtimer_run_queues+0x24)
| +begin 0x80000001 5681 6.750 hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
| #end 0x80000001 5688 6.000 hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
#func 5694 6.250 __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
| #begin 0x80000000 5700 6.750 __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
| +end 0x80000000 5707 7.000 __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
| +begin 0x80000001 5714 6.500 run_timer_softirq+0x68 (__do_softirq+0x60)
| #end 0x80000001 5720 6.000 run_timer_softirq+0x7c (__do_softirq+0x60)
#func 5726 6.250 __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
| #begin 0x80000000 5733 6.750 __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
| +end 0x80000000 5739 7.000 __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
| +begin 0x80000001 5746 7.000 __do_softirq+0xa8 (irq_exit+0x50)
| #end 0x80000001 5753 5.500 __do_softirq+0xbc (irq_exit+0x50)
#func 5759 6.000 _local_bh_enable+0x10 (__do_softirq+0xfc)
#func 5765 7.750 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
| #begin 0x80000000 5773 8.000 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff 5781 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func 5786 1.750 __ipipe_unstall_root+0x10 (default_idle+0x94)
| +begin 0x80000000 5788 1.750 __ipipe_unstall_root+0x30 (default_idle+0x94)
| +end 0x80000000 5790 1.750 __ipipe_unstall_root+0x68 (default_idle+0x94)
+func 5791 1.750 default_idle+0x10 (cpu_idle+0x3c)
| +begin 0x80000001 5793 1.750 default_idle+0x54 (cpu_idle+0x3c)
| #end 0x80000001 5795 1.750 default_idle+0x68 (cpu_idle+0x3c)
#func 5797 1.750 __ipipe_unstall_root+0x10 (default_idle+0x84)
| #begin 0x80000000 5798 1.750 __ipipe_unstall_root+0x30 (default_idle+0x84)
| +end 0x80000000 5800 1.750 __ipipe_unstall_root+0x68 (default_idle+0x84)
+end 0x8000000e 5802 85.750 default_idle+0x8c (cpu_idle+0x3c)
| +func 5888 7.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 5895 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 5901 5.750 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func 5907 5.750 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func 5912 5.750 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func 5918 5.500 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func 5924 6.750 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func 5930 5.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func 5936 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func 5942 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 5948 6.750 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 5955 9.250 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func 5964 15.000 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func 5979 7.250 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func 5986 5.500 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func 5992 6.000 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func 5998 9.250 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func 6007 6.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 6013 9.000 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 6022 6.500 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
| #func 6029 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 6035 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 6041 6.000 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func 6047 12.500 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func 6060 5.750 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func 6065 5.250 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| #func 6071 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func 6077 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 6083 6.750 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 6090 7.500 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| #*func 6097 8.500 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| #*func 6106 5.750 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func 6112 8.500 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func 6120 7.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 6127 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 6134 6.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func 6141 5.500 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 6146 5.500 irq_enter+0x10 (__exception_text_start+0x38)
#func 6152 6.250 ipipe_check_context+0x10 (irq_enter+0x18)
#func 6158 6.000 handle_level_irq+0x10 (__exception_text_start+0x48)
#func 6164 5.500 handle_IRQ_event+0x10 (handle_level_irq+0x64)
#func 6170 6.000 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
#func 6176 5.250 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 6181 6.250 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 6187 5.750 do_timer+0x10 (tick_periodic+0x70)
#func 6193 8.750 update_wall_time+0x14 (do_timer+0x30)
#func 6202 9.750 current_tick_length+0x10 (update_wall_time+0x15c)
#func 6211 7.000 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 6218 6.250 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 6225 5.750 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 6230 6.750 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 6237 6.500 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 6244 6.500 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 6250 5.500 update_process_times+0x10 (tick_periodic+0x98)
#func 6256 5.750 account_process_tick+0x10 (update_process_times+0x2c)
#func 6261 7.500 account_system_time+0x10 (account_process_tick+0x40)
#func 6269 5.500 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 6274 5.000 run_local_timers+0x10 (update_process_times+0x30)
#func 6279 7.000 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 6286 6.750 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 6293 5.750 raise_softirq+0x58 (run_local_timers+0x18)
#func 6299 6.500 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 6305 6.500 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 6312 5.750 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 6318 5.500 rcu_pending+0x10 (update_process_times+0x38)
#func 6323 6.250 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 6329 6.250 __rcu_pending+0x10 (rcu_pending+0x34)
#func 6336 6.250 scheduler_tick+0x10 (update_process_times+0x50)
#func 6342 6.000 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 6348 8.750 sched_clock+0x10 (__update_rq_clock+0x28)
#func 6357 6.750 run_posix_cpu_timers+0x14 (update_process_times+0x58)
#func 6363 10.000 profile_tick+0x10 (tick_periodic+0xa0)
| #begin 0x80000001 6373 6.750 handle_IRQ_event+0x9c (handle_level_irq+0x64)
| #end 0x80000001 6380 5.750 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
#func 6386 7.000 note_interrupt+0x14 (handle_level_irq+0x84)
#func 6393 6.250 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
#func 6399 5.250 irq_exit+0x10 (__exception_text_start+0x4c)
#func 6404 5.500 ipipe_check_context+0x10 (irq_exit+0x18)
#func 6410 5.750 __do_softirq+0x10 (irq_exit+0x50)
#func 6416 5.750 ipipe_check_context+0x10 (__do_softirq+0x20)
#func 6421 6.250 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
| #begin 0x80000000 6428 6.750 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
| +end 0x80000000 6434 6.250 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
+func 6441 6.250 run_timer_softirq+0x14 (__do_softirq+0x60)
+func 6447 6.500 hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
+func 6453 9.250 current_kernel_time+0x14 (hrtimer_run_queues+0x24)
| +begin 0x80000001 6463 6.750 hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
| #end 0x80000001 6469 6.000 hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
#func 6475 6.250 __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
| #begin 0x80000000 6482 6.500 __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
| +end 0x80000000 6488 8.000 __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
| +begin 0x80000001 6496 6.750 run_timer_softirq+0x68 (__do_softirq+0x60)
| #end 0x80000001 6503 6.250 run_timer_softirq+0x7c (__do_softirq+0x60)
#func 6509 6.250 __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
| #begin 0x80000000 6515 6.750 __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
| +end 0x80000000 6522 7.000 __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
| +begin 0x80000001 6529 6.250 __do_softirq+0xa8 (irq_exit+0x50)
| #end 0x80000001 6535 5.250 __do_softirq+0xbc (irq_exit+0x50)
#func 6541 6.000 _local_bh_enable+0x10 (__do_softirq+0xfc)
#func 6547 7.750 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
| #begin 0x80000000 6554 8.250 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff 6563 5.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func 6568 1.750 __ipipe_unstall_root+0x10 (default_idle+0x94)
| +begin 0x80000000 6570 2.000 __ipipe_unstall_root+0x30 (default_idle+0x94)
| +end 0x80000000 6572 1.750 __ipipe_unstall_root+0x68 (default_idle+0x94)
+func 6574 1.750 default_idle+0x10 (cpu_idle+0x3c)
| +begin 0x80000001 6576 1.750 default_idle+0x54 (cpu_idle+0x3c)
| #end 0x80000001 6577 1.750 default_idle+0x68 (cpu_idle+0x3c)
#func 6579 1.750 __ipipe_unstall_root+0x10 (default_idle+0x84)
| #begin 0x80000000 6581 1.750 __ipipe_unstall_root+0x30 (default_idle+0x84)
| +end 0x80000000 6583 1.750 __ipipe_unstall_root+0x68 (default_idle+0x84)
+end 0x8000000e 6584 79.500 default_idle+0x8c (cpu_idle+0x3c)
| +func 6664 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 6670 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 6676 5.500 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func 6682 6.000 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func 6688 5.500 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func 6693 5.500 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func 6699 6.250 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func 6705 5.750 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func 6711 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func 6716 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 6723 7.000 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 6730 8.750 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func 6739 15.000 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func 6754 7.250 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func 6761 5.500 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func 6766 6.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func 6773 9.000 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func 6782 6.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 6788 8.750 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 6797 6.250 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
| #func 6803 6.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 6809 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 6815 5.500 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func 6820 12.250 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func 6833 5.500 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func 6838 5.500 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| #func 6844 5.750 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func 6849 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 6856 6.500 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 6862 7.000 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| #*func 6869 8.500 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| #*func 6878 5.750 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func 6884 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func 6892 7.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 6899 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 6906 7.000 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func 6913 5.250 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 6918 5.500 irq_enter+0x10 (__exception_text_start+0x38)
#func 6924 0.000 ipipe_check_context+0x10 (irq_enter+0x18)
[-- Attachment #3: frozen-eth --]
[-- Type: application/octet-stream, Size: 99058 bytes --]
I-pipe frozen back-tracing service on 2.6.24.3/ipipe-1.9-00
------------------------------------------------------------
CPU: 0, Freeze: 4980314000 cycles, Trace Points: 100 (+1000)
Calibrated minimum trace-point overhead: 1.500 us
+----- Hard IRQs ('|': locked)
|+---- <unused>
||+--- <unused>
|||+-- Xenomai
||||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
||||| +---------- Delay flag ('+': > 1 us, '!': > 10 us)
||||| | +- NMI noise ('N')
||||| | |
Type User Val. Time Delay Function (Parent)
:| #begin 0x80000001 -662+ 7.500 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
:| #end 0x80000001 -655+ 6.500 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
: #func -648+ 5.250 update_process_times+0x10 (tick_periodic+0x98)
: #func -643+ 5.500 account_process_tick+0x10 (update_process_times+0x2c)
: #func -637+ 6.750 account_system_time+0x10 (account_process_tick+0x40)
: #func -631+ 5.500 account_system_time_scaled+0x10 (account_process_tick+0x4c)
: #func -625+ 5.250 run_local_timers+0x10 (update_process_times+0x30)
: #func -620+ 6.500 raise_softirq+0x10 (run_local_timers+0x18)
:| #begin 0x80000001 -613+ 7.500 raise_softirq+0x44 (run_local_timers+0x18)
:| #end 0x80000001 -606+ 5.750 raise_softirq+0x58 (run_local_timers+0x18)
: #func -600+ 6.500 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
:| #begin 0x80000001 -594+ 7.500 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
:| #end 0x80000001 -586+ 5.750 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
: #func -580+ 5.500 rcu_pending+0x10 (update_process_times+0x38)
: #func -575+ 6.000 __rcu_pending+0x10 (rcu_pending+0x1c)
: #func -569+ 6.250 __rcu_pending+0x10 (rcu_pending+0x34)
: #func -563+ 5.500 scheduler_tick+0x10 (update_process_times+0x50)
: #func -557+ 5.500 __update_rq_clock+0x14 (scheduler_tick+0x38)
: #func -552+ 8.500 sched_clock+0x10 (__update_rq_clock+0x28)
: #func -543+ 6.500 run_posix_cpu_timers+0x14 (update_process_times+0x58)
: #func -537+ 9.750 profile_tick+0x10 (tick_periodic+0xa0)
:| #begin 0x80000001 -527+ 8.000 handle_IRQ_event+0x9c (handle_level_irq+0x64)
:| #end 0x80000001 -519+ 5.500 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
: #func -513+ 7.250 note_interrupt+0x14 (handle_level_irq+0x84)
: #func -506+ 6.000 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
: #func -500+ 5.500 irq_exit+0x10 (__exception_text_start+0x4c)
: #func -495+ 5.500 ipipe_check_context+0x10 (irq_exit+0x18)
: #func -489+ 5.750 __do_softirq+0x10 (irq_exit+0x50)
: #func -483+ 6.000 ipipe_check_context+0x10 (__do_softirq+0x20)
: #func -477+ 6.500 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
:| #begin 0x80000000 -471+ 6.500 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
:| +func -464+ 7.250 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
:| +end 0x80000000 -457+ 6.000 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
: +func -451+ 6.000 run_timer_softirq+0x14 (__do_softirq+0x60)
: +func -445+ 5.750 hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
: +func -439+ 10.000 current_kernel_time+0x14 (hrtimer_run_queues+0x24)
:| +begin 0x80000001 -429+ 7.500 hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
:| #end 0x80000001 -422+ 6.500 hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
: #func -415+ 6.750 __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
:| #begin 0x80000000 -409+ 6.500 __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
:| +func -402+ 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
:| +end 0x80000000 -395+ 7.500 __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
:| +begin 0x80000001 -388+ 7.250 run_timer_softirq+0x68 (__do_softirq+0x60)
:| #end 0x80000001 -380+ 7.750 run_timer_softirq+0x7c (__do_softirq+0x60)
: #func -373+ 6.500 __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
:| #begin 0x80000000 -366+ 6.500 __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
:| +func -360+ 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
:| +end 0x80000000 -353+ 7.000 __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
:| +func -346+ 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
:| +begin 0xffffffff -339+ 6.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
:| +func -332+ 5.500 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
:| +func -327+ 6.250 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
:| +func -321+ 6.000 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
:| +func -315+ 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
:| +func -309+ 6.000 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
:| +func -303+ 5.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
:| +func -297+ 6.000 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
:| +func -291+ 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
:| # func -285+ 6.500 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
:| # func -278+ 9.750 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
:| # func -269! 14.250 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
:| # func -254+ 7.500 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
:| # func -247+ 5.250 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
:| # func -242+ 6.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
:| # func -235+ 9.250 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
:| +func -226+ 6.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
:| +func -220+ 7.250 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
:| +end 0xffffffff -213+ 8.000 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
:| +begin 0x80000001 -205+ 7.750 __do_softirq+0xa8 (irq_exit+0x50)
:| #end 0x80000001 -197+ 5.250 __do_softirq+0xbc (irq_exit+0x50)
: #func -192+ 5.750 _local_bh_enable+0x10 (__do_softirq+0xfc)
: #func -186+ 7.750 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
:| #begin 0x80000000 -178+ 8.750 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
:| #end 0x80000000 -170+ 5.500 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
: #func -164+ 5.500 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
: #func -159+ 5.500 irq_enter+0x10 (__exception_text_start+0x38)
: #func -153+ 6.500 ipipe_check_context+0x10 (irq_enter+0x18)
: #func -147+ 6.250 handle_level_irq+0x10 (__exception_text_start+0x48)
: #func -140+ 6.000 handle_IRQ_event+0x10 (handle_level_irq+0x64)
: #func -134+ 8.750 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
:| #begin 0x80000001 -126+ 7.500 handle_IRQ_event+0x9c (handle_level_irq+0x64)
:| #end 0x80000001 -118+ 5.500 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
: #func -113+ 6.750 note_interrupt+0x14 (handle_level_irq+0x84)
: #func -106+ 6.000 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
: #func -100+ 5.750 irq_exit+0x10 (__exception_text_start+0x4c)
: #func -94+ 7.250 ipipe_check_context+0x10 (irq_exit+0x18)
:| #begin 0x80000000 -87+ 9.000 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
:| +func -78+ 5.750 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
:| +func -72+ 6.000 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
:| +func -66+ 5.500 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
:| +func -61+ 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
:| # func -54+ 6.500 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
:| # func -48+ 7.750 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
:| # func -40+ 6.500 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
:| # func -34+ 5.500 xnarch_tsc_to_ns+0x10 (do_upg+0x8c [rt_bus_driver])
:| # func -28+ 5.500 ipipe_trace_frozen_reset+0x10 (do_upg+0x94 [rt_bus_driver])
:| # func -23+ 5.500 __ipipe_global_path_lock+0x10 (ipipe_trace_frozen_reset+0x14)
:| # func -17! 10.750 __ipipe_spin_lock_irqsave+0x10 (__ipipe_global_path_lock+0x18)
:| # func -6+ 6.750 __ipipe_spin_unlock_irqcomplete+0x10 (__ipipe_global_path_unlock+0x64)
<| # freeze 0x00000001 0 7.250 do_upg+0x9c [rt_bus_driver] (xnintr_irq_handler+0x44)
| # func 7 5.500 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| # func 12 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| +func 21 13.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 34 7.000 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func 41 6.500 __ipipe_set_irq_pending+0x10 (__ipipe_handle_irq+0xb4)
| +func 48 5.750 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0xd4)
| +func 53 5.750 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func 59 6.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 66 8.250 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 74 5.500 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func 79 5.250 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 85 5.250 irq_enter+0x10 (__exception_text_start+0x38)
#func 90 6.500 ipipe_check_context+0x10 (irq_enter+0x18)
#func 96 6.250 handle_simple_irq+0x10 (__exception_text_start+0x48)
#func 103 5.500 handle_IRQ_event+0x10 (handle_simple_irq+0x64)
#func 108 6.500 __ipipe_unstall_root+0x10 (handle_IRQ_event+0x28)
| #begin 0x80000000 115 6.750 __ipipe_unstall_root+0x30 (handle_IRQ_event+0x28)
| +end 0x80000000 121 5.750 __ipipe_unstall_root+0x68 (handle_IRQ_event+0x28)
+func 127 9.750 dm9000_interrupt+0x14 (handle_IRQ_event+0x40)
| +begin 0x80000001 137 6.500 handle_IRQ_event+0x9c (handle_simple_irq+0x64)
| #end 0x80000001 143 6.500 handle_IRQ_event+0xb0 (handle_simple_irq+0x64)
#func 150 6.500 note_interrupt+0x14 (handle_simple_irq+0x84)
#func 156 5.500 irq_exit+0x10 (__exception_text_start+0x4c)
#func 162 7.750 ipipe_check_context+0x10 (irq_exit+0x18)
| #begin 0x80000000 170 8.000 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| +func 178 5.750 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func 183 5.250 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| +func 189 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func 195 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 201 6.250 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 207 6.750 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| # func 214 8.000 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| # func 222 5.750 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| # func 228 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| +func 236 7.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 244 7.750 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff 251 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func 257 1.750 __ipipe_unstall_root+0x10 (default_idle+0x94)
| +begin 0x80000000 259 1.750 __ipipe_unstall_root+0x30 (default_idle+0x94)
| +end 0x80000000 260 2.000 __ipipe_unstall_root+0x68 (default_idle+0x94)
+func 262 2.250 default_idle+0x10 (cpu_idle+0x3c)
| +begin 0x80000001 265 1.750 default_idle+0x54 (cpu_idle+0x3c)
| #end 0x80000001 266 1.500 default_idle+0x68 (cpu_idle+0x3c)
#func 268 1.750 __ipipe_unstall_root+0x10 (default_idle+0x84)
| #begin 0x80000000 270 1.750 __ipipe_unstall_root+0x30 (default_idle+0x84)
| +end 0x80000000 271 1.750 __ipipe_unstall_root+0x68 (default_idle+0x84)
+end 0x8000000e 273 107.750 default_idle+0x8c (cpu_idle+0x3c)
| +func 381 6.750 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 388 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 393 6.000 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func 399 12.250 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func 411 5.750 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func 417 5.500 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| +func 423 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func 429 6.750 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 435 6.500 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 442 7.500 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| # func 449 7.500 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| # func 457 5.250 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| # func 462 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| +func 470 7.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 478 7.500 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff 485 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +func 491 6.750 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 498 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 503 5.750 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func 509 5.500 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func 515 5.750 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func 520 6.000 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func 526 6.250 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func 533 5.250 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func 538 6.000 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func 544 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 550 6.250 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 556 8.500 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func 565 15.000 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func 580 6.750 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func 587 5.250 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func 592 6.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func 598 9.500 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func 608 6.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 614 8.500 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 623 5.250 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func 628 5.750 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 634 5.250 irq_enter+0x10 (__exception_text_start+0x38)
#func 639 6.000 ipipe_check_context+0x10 (irq_enter+0x18)
#func 645 5.750 handle_level_irq+0x10 (__exception_text_start+0x48)
#func 651 5.750 handle_IRQ_event+0x10 (handle_level_irq+0x64)
#func 656 6.500 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
#func 663 5.500 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 668 6.000 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 674 6.000 do_timer+0x10 (tick_periodic+0x70)
#func 680 9.750 update_wall_time+0x14 (do_timer+0x30)
#func 690 7.250 current_tick_length+0x10 (update_wall_time+0x15c)
#func 697 9.000 current_tick_length+0x10 (update_wall_time+0x15c)
#func 706 7.000 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 713 6.500 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 720 5.750 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 726 6.500 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 732 6.750 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 739 7.000 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 746 5.250 update_process_times+0x10 (tick_periodic+0x98)
#func 751 5.250 account_process_tick+0x10 (update_process_times+0x2c)
#func 756 8.500 account_system_time+0x10 (account_process_tick+0x40)
#func 765 6.000 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 771 5.500 run_local_timers+0x10 (update_process_times+0x30)
#func 776 6.500 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 783 6.500 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 789 6.250 raise_softirq+0x58 (run_local_timers+0x18)
#func 796 6.500 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 802 6.250 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 808 5.750 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 814 5.750 rcu_pending+0x10 (update_process_times+0x38)
#func 820 6.250 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 826 6.500 __rcu_pending+0x10 (rcu_pending+0x34)
#func 833 5.750 scheduler_tick+0x10 (update_process_times+0x50)
#func 838 6.500 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 845 9.000 sched_clock+0x10 (__update_rq_clock+0x28)
#func 854 6.500 run_posix_cpu_timers+0x14 (update_process_times+0x58)
#func 860 7.500 profile_tick+0x10 (tick_periodic+0xa0)
#func 868 5.750 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 874 6.000 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 880 5.750 do_timer+0x10 (tick_periodic+0x70)
#func 885 11.500 update_wall_time+0x14 (do_timer+0x30)
#func 897 7.000 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 904 6.250 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 910 5.500 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 916 7.000 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 923 6.500 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 929 6.250 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 935 5.250 update_process_times+0x10 (tick_periodic+0x98)
#func 941 6.000 account_process_tick+0x10 (update_process_times+0x2c)
#func 947 6.750 account_system_time+0x10 (account_process_tick+0x40)
#func 953 5.750 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 959 5.250 run_local_timers+0x10 (update_process_times+0x30)
#func 964 6.500 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 971 6.750 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 978 6.000 raise_softirq+0x58 (run_local_timers+0x18)
#func 984 6.250 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 990 6.750 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 997 5.750 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 1002 5.500 rcu_pending+0x10 (update_process_times+0x38)
#func 1008 6.500 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 1014 6.000 __rcu_pending+0x10 (rcu_pending+0x34)
#func 1020 5.750 scheduler_tick+0x10 (update_process_times+0x50)
#func 1026 5.500 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 1032 8.250 sched_clock+0x10 (__update_rq_clock+0x28)
#func 1040 6.500 run_posix_cpu_timers+0x14 (update_process_times+0x58)
#func 1046 9.750 profile_tick+0x10 (tick_periodic+0xa0)
| #begin 0x80000001 1056 6.500 handle_IRQ_event+0x9c (handle_level_irq+0x64)
| #end 0x80000001 1063 5.750 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
#func 1068 6.750 note_interrupt+0x14 (handle_level_irq+0x84)
#func 1075 6.000 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
#func 1081 5.750 irq_exit+0x10 (__exception_text_start+0x4c)
#func 1087 5.750 ipipe_check_context+0x10 (irq_exit+0x18)
#func 1093 5.500 __do_softirq+0x10 (irq_exit+0x50)
#func 1098 6.000 ipipe_check_context+0x10 (__do_softirq+0x20)
#func 1104 6.250 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
| #begin 0x80000000 1110 6.750 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
| +end 0x80000000 1117 6.000 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
+func 1123 5.750 run_timer_softirq+0x14 (__do_softirq+0x60)
+func 1129 5.500 hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
+func 1134 9.500 current_kernel_time+0x14 (hrtimer_run_queues+0x24)
| +begin 0x80000001 1144 6.250 hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
| #end 0x80000001 1150 6.750 hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
| #func 1157 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 1164 6.000 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 1170 6.250 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func 1176 12.250 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func 1188 6.250 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func 1195 5.500 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| #func 1200 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func 1206 7.000 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 1213 6.750 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 1220 7.250 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| #*func 1227 8.000 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| #*func 1235 6.000 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func 1241 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func 1249 7.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 1256 7.000 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 1263 5.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| #func 1269 6.750 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 1276 5.250 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 1281 6.000 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| #func 1287 6.000 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| #func 1293 5.500 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| #func 1299 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| #func 1304 6.500 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| #func 1311 5.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| #func 1316 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| #func 1322 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 1328 6.500 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 1335 9.000 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| #*func 1344 14.250 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| #*func 1358 6.750 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| #*func 1365 5.500 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| #*func 1370 6.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| #*func 1377 9.000 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| #func 1386 7.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #end 0xffffffff 1393 6.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func 1400 6.750 __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
| #begin 0x80000000 1407 5.250 __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
| +func 1412 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 1419 7.000 __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
| +begin 0x80000001 1426 6.750 run_timer_softirq+0x68 (__do_softirq+0x60)
| #end 0x80000001 1433 7.000 run_timer_softirq+0x7c (__do_softirq+0x60)
#func 1440 6.250 __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
| #begin 0x80000000 1446 5.750 __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
| +func 1452 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 1459 7.000 __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
| +begin 0x80000001 1466 6.250 __do_softirq+0xa8 (irq_exit+0x50)
| #end 0x80000001 1472 6.000 __do_softirq+0xbc (irq_exit+0x50)
#func 1478 6.500 _local_bh_enable+0x10 (__do_softirq+0xfc)
#func 1484 8.000 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
| #begin 0x80000000 1492 7.750 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 1500 5.750 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func 1506 5.500 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 1511 5.500 irq_enter+0x10 (__exception_text_start+0x38)
#func 1517 5.750 ipipe_check_context+0x10 (irq_enter+0x18)
#func 1523 5.750 handle_level_irq+0x10 (__exception_text_start+0x48)
#func 1528 6.250 handle_IRQ_event+0x10 (handle_level_irq+0x64)
#func 1535 7.500 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
| #begin 0x80000001 1542 6.250 handle_IRQ_event+0x9c (handle_level_irq+0x64)
| #end 0x80000001 1548 6.000 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
#func 1554 7.250 note_interrupt+0x14 (handle_level_irq+0x84)
#func 1562 5.750 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
#func 1567 5.500 irq_exit+0x10 (__exception_text_start+0x4c)
#func 1573 7.500 ipipe_check_context+0x10 (irq_exit+0x18)
| #begin 0x80000000 1580 8.500 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff 1589 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func 1594 1.750 __ipipe_unstall_root+0x10 (default_idle+0x94)
| +begin 0x80000000 1596 2.250 __ipipe_unstall_root+0x30 (default_idle+0x94)
| +end 0x80000000 1598 2.000 __ipipe_unstall_root+0x68 (default_idle+0x94)
+func 1600 2.000 default_idle+0x10 (cpu_idle+0x3c)
| +begin 0x80000001 1602 2.000 default_idle+0x54 (cpu_idle+0x3c)
| #end 0x80000001 1604 2.000 default_idle+0x68 (cpu_idle+0x3c)
#func 1606 1.750 __ipipe_unstall_root+0x10 (default_idle+0x84)
| #begin 0x80000000 1608 1.750 __ipipe_unstall_root+0x30 (default_idle+0x84)
| +end 0x80000000 1610 1.750 __ipipe_unstall_root+0x68 (default_idle+0x84)
+end 0x8000000e 1612 322.000 default_idle+0x8c (cpu_idle+0x3c)
| +func 1934 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 1941 5.250 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 1946 6.000 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func 1952 12.000 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func 1964 6.000 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func 1970 5.250 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| +func 1975 5.750 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func 1981 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 1987 6.500 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 1994 7.500 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| # func 2001 7.750 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| # func 2009 5.750 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| # func 2015 8.500 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| +func 2023 7.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 2031 6.750 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff 2038 5.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +func 2043 6.750 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 2050 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 2056 5.750 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func 2061 5.500 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func 2067 5.750 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func 2073 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func 2078 6.500 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func 2085 5.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func 2090 6.000 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func 2096 6.000 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 2102 6.250 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 2109 8.500 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func 2117 14.750 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func 2132 7.250 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func 2139 5.500 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func 2145 6.000 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func 2151 9.000 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func 2160 6.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 2166 8.500 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 2174 5.500 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func 2180 6.500 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 2186 5.500 irq_enter+0x10 (__exception_text_start+0x38)
#func 2192 6.250 ipipe_check_context+0x10 (irq_enter+0x18)
#func 2198 6.250 handle_level_irq+0x10 (__exception_text_start+0x48)
#func 2204 5.750 handle_IRQ_event+0x10 (handle_level_irq+0x64)
#func 2210 6.250 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
#func 2216 5.500 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 2222 6.750 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 2229 6.250 do_timer+0x10 (tick_periodic+0x70)
#func 2235 9.750 update_wall_time+0x14 (do_timer+0x30)
#func 2245 7.750 current_tick_length+0x10 (update_wall_time+0x15c)
#func 2252 9.500 current_tick_length+0x10 (update_wall_time+0x15c)
#func 2262 7.000 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 2269 6.500 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 2275 5.750 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 2281 6.750 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 2288 6.500 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 2294 7.000 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 2301 5.250 update_process_times+0x10 (tick_periodic+0x98)
#func 2307 5.750 account_process_tick+0x10 (update_process_times+0x2c)
#func 2312 7.750 account_system_time+0x10 (account_process_tick+0x40)
#func 2320 5.750 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 2326 5.500 run_local_timers+0x10 (update_process_times+0x30)
#func 2331 7.000 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 2338 7.000 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 2345 6.250 raise_softirq+0x58 (run_local_timers+0x18)
#func 2352 6.250 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 2358 6.750 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 2365 5.750 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 2370 5.500 rcu_pending+0x10 (update_process_times+0x38)
#func 2376 6.500 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 2382 6.500 __rcu_pending+0x10 (rcu_pending+0x34)
#func 2389 6.250 scheduler_tick+0x10 (update_process_times+0x50)
#func 2395 6.250 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 2401 9.000 sched_clock+0x10 (__update_rq_clock+0x28)
#func 2410 7.000 run_posix_cpu_timers+0x14 (update_process_times+0x58)
#func 2417 7.500 profile_tick+0x10 (tick_periodic+0xa0)
#func 2425 5.500 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 2430 6.000 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 2436 5.500 do_timer+0x10 (tick_periodic+0x70)
#func 2442 11.500 update_wall_time+0x14 (do_timer+0x30)
#func 2453 6.500 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 2460 6.500 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 2466 6.000 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 2472 7.000 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 2479 6.250 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 2486 6.250 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 2492 5.750 update_process_times+0x10 (tick_periodic+0x98)
#func 2498 5.500 account_process_tick+0x10 (update_process_times+0x2c)
#func 2503 6.500 account_system_time+0x10 (account_process_tick+0x40)
#func 2510 5.500 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 2515 5.250 run_local_timers+0x10 (update_process_times+0x30)
#func 2520 6.750 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 2527 6.250 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 2533 6.000 raise_softirq+0x58 (run_local_timers+0x18)
#func 2539 6.500 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 2546 6.500 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 2552 5.500 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 2558 5.750 rcu_pending+0x10 (update_process_times+0x38)
#func 2564 6.250 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 2570 6.250 __rcu_pending+0x10 (rcu_pending+0x34)
#func 2576 5.500 scheduler_tick+0x10 (update_process_times+0x50)
#func 2582 5.750 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 2587 9.000 sched_clock+0x10 (__update_rq_clock+0x28)
#func 2596 6.500 run_posix_cpu_timers+0x14 (update_process_times+0x58)
#func 2603 9.250 profile_tick+0x10 (tick_periodic+0xa0)
| #begin 0x80000001 2612 6.500 handle_IRQ_event+0x9c (handle_level_irq+0x64)
| #end 0x80000001 2619 6.000 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
#func 2625 6.750 note_interrupt+0x14 (handle_level_irq+0x84)
#func 2631 5.500 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
#func 2637 5.500 irq_exit+0x10 (__exception_text_start+0x4c)
#func 2642 6.000 ipipe_check_context+0x10 (irq_exit+0x18)
#func 2648 5.750 __do_softirq+0x10 (irq_exit+0x50)
#func 2654 5.500 ipipe_check_context+0x10 (__do_softirq+0x20)
#func 2660 6.250 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
| #begin 0x80000000 2666 6.750 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
| +end 0x80000000 2673 6.500 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
+func 2679 5.250 run_timer_softirq+0x14 (__do_softirq+0x60)
+func 2684 5.500 hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
+func 2690 8.500 current_kernel_time+0x14 (hrtimer_run_queues+0x24)
| +begin 0x80000001 2698 6.750 hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
| #end 0x80000001 2705 6.000 hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
| #func 2711 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 2718 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 2723 6.250 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func 2730 12.000 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func 2742 5.750 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func 2747 5.750 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| #func 2753 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func 2759 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 2766 6.750 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 2772 6.750 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| #*func 2779 8.250 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| #*func 2787 5.750 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func 2793 8.000 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func 2801 7.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 2809 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 2816 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| #func 2821 6.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 2828 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 2833 5.750 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| #func 2839 6.000 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| #func 2845 5.500 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| #func 2851 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| #func 2856 6.500 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| #func 2863 5.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| #func 2868 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| #func 2874 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 2881 6.500 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 2887 8.500 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| #*func 2896 14.250 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| #*func 2910 7.250 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| #*func 2917 5.750 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| #*func 2923 5.750 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| #*func 2929 9.250 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| #func 2938 7.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #end 0xffffffff 2946 7.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func 2953 6.500 __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
| #begin 0x80000000 2960 5.250 __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
| +func 2965 7.250 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 2972 7.750 __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
| +begin 0x80000001 2980 6.250 run_timer_softirq+0x68 (__do_softirq+0x60)
| #end 0x80000001 2986 6.750 run_timer_softirq+0x7c (__do_softirq+0x60)
#func 2993 6.500 __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
| #begin 0x80000000 2999 5.750 __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
| +func 3005 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 3012 6.750 __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
| +begin 0x80000001 3019 6.750 __do_softirq+0xa8 (irq_exit+0x50)
| #end 0x80000001 3025 5.750 __do_softirq+0xbc (irq_exit+0x50)
#func 3031 6.000 _local_bh_enable+0x10 (__do_softirq+0xfc)
#func 3037 7.750 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
| #begin 0x80000000 3045 8.000 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 3053 5.750 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func 3059 6.500 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 3065 5.500 irq_enter+0x10 (__exception_text_start+0x38)
#func 3071 5.750 ipipe_check_context+0x10 (irq_enter+0x18)
#func 3076 7.000 handle_level_irq+0x10 (__exception_text_start+0x48)
#func 3083 5.500 handle_IRQ_event+0x10 (handle_level_irq+0x64)
#func 3089 5.750 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
#func 3095 5.500 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 3100 6.250 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 3106 5.500 do_timer+0x10 (tick_periodic+0x70)
#func 3112 9.000 update_wall_time+0x14 (do_timer+0x30)
#func 3121 9.250 current_tick_length+0x10 (update_wall_time+0x15c)
#func 3130 7.000 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 3137 6.250 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 3143 5.500 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 3149 6.750 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 3156 6.500 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 3162 6.500 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 3169 5.250 update_process_times+0x10 (tick_periodic+0x98)
#func 3174 5.750 account_process_tick+0x10 (update_process_times+0x2c)
#func 3180 7.250 account_system_time+0x10 (account_process_tick+0x40)
#func 3187 5.500 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 3192 5.250 run_local_timers+0x10 (update_process_times+0x30)
#func 3198 6.500 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 3204 6.750 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 3211 5.750 raise_softirq+0x58 (run_local_timers+0x18)
#func 3217 6.250 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 3223 6.500 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 3229 5.750 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 3235 5.500 rcu_pending+0x10 (update_process_times+0x38)
#func 3241 6.250 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 3247 6.250 __rcu_pending+0x10 (rcu_pending+0x34)
#func 3253 5.500 scheduler_tick+0x10 (update_process_times+0x50)
#func 3259 5.500 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 3264 8.500 sched_clock+0x10 (__update_rq_clock+0x28)
#func 3273 7.000 run_posix_cpu_timers+0x14 (update_process_times+0x58)
#func 3280 9.000 profile_tick+0x10 (tick_periodic+0xa0)
| #begin 0x80000001 3289 6.500 handle_IRQ_event+0x9c (handle_level_irq+0x64)
| #end 0x80000001 3295 6.250 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
#func 3301 6.500 note_interrupt+0x14 (handle_level_irq+0x84)
#func 3308 6.000 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
#func 3314 5.750 irq_exit+0x10 (__exception_text_start+0x4c)
#func 3320 5.750 ipipe_check_context+0x10 (irq_exit+0x18)
#func 3325 5.250 __do_softirq+0x10 (irq_exit+0x50)
#func 3331 5.750 ipipe_check_context+0x10 (__do_softirq+0x20)
#func 3336 6.500 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
| #begin 0x80000000 3343 6.500 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
| +end 0x80000000 3349 6.000 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
+func 3355 5.750 run_timer_softirq+0x14 (__do_softirq+0x60)
+func 3361 6.000 hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
+func 3367 9.000 current_kernel_time+0x14 (hrtimer_run_queues+0x24)
| +begin 0x80000001 3376 6.750 hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
| #end 0x80000001 3383 5.750 hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
#func 3389 6.250 __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
| #begin 0x80000000 3395 6.500 __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
| +end 0x80000000 3401 7.500 __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
| +begin 0x80000001 3409 6.500 run_timer_softirq+0x68 (__do_softirq+0x60)
| #end 0x80000001 3415 6.250 run_timer_softirq+0x7c (__do_softirq+0x60)
#func 3422 6.500 __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
| #begin 0x80000000 3428 6.750 __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
| +end 0x80000000 3435 7.000 __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
| +begin 0x80000001 3442 6.500 __do_softirq+0xa8 (irq_exit+0x50)
| #end 0x80000001 3448 5.250 __do_softirq+0xbc (irq_exit+0x50)
#func 3454 6.250 _local_bh_enable+0x10 (__do_softirq+0xfc)
#func 3460 7.750 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
| #begin 0x80000000 3468 8.000 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff 3476 5.250 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func 3481 2.750 __ipipe_unstall_root+0x10 (default_idle+0x94)
| +func 3484 2.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 3486 2.000 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 3488 2.750 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func 3491 3.500 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func 3494 2.000 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func 3496 2.000 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| +func 3498 2.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func 3500 3.000 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 3503 2.750 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 3506 3.750 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| # func 3510 4.500 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| # func 3514 2.250 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| # func 3516 3.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| +func 3520 3.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 3523 2.500 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff 3525 2.000 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +func 3527 2.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 3529 1.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 3531 2.250 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func 3533 2.000 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func 3535 2.000 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func 3537 1.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func 3539 2.500 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func 3541 1.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func 3543 2.000 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func 3545 2.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 3547 2.000 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 3549 4.500 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func 3554 5.250 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func 3559 3.750 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func 3563 1.750 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func 3564 2.750 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func 3567 4.000 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func 3571 2.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 3574 3.750 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 3577 2.500 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func 3580 2.000 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 3582 1.750 irq_enter+0x10 (__exception_text_start+0x38)
#func 3584 2.250 ipipe_check_context+0x10 (irq_enter+0x18)
#func 3586 2.250 handle_level_irq+0x10 (__exception_text_start+0x48)
#func 3588 2.000 handle_IRQ_event+0x10 (handle_level_irq+0x64)
#func 3590 3.750 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
| #begin 0x80000001 3594 1.750 handle_IRQ_event+0x9c (handle_level_irq+0x64)
| #end 0x80000001 3596 2.000 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
#func 3598 2.750 note_interrupt+0x14 (handle_level_irq+0x84)
#func 3600 2.000 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
#func 3602 1.750 irq_exit+0x10 (__exception_text_start+0x4c)
#func 3604 2.500 ipipe_check_context+0x10 (irq_exit+0x18)
| #begin 0x80000000 3607 3.500 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff 3610 2.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +begin 0x80000000 3613 2.000 __ipipe_unstall_root+0x30 (default_idle+0x94)
| +end 0x80000000 3615 2.000 __ipipe_unstall_root+0x68 (default_idle+0x94)
+func 3617 2.000 default_idle+0x10 (cpu_idle+0x3c)
| +begin 0x80000001 3619 1.750 default_idle+0x54 (cpu_idle+0x3c)
| #end 0x80000001 3621 1.500 default_idle+0x68 (cpu_idle+0x3c)
#func 3622 1.750 __ipipe_unstall_root+0x10 (default_idle+0x84)
| #begin 0x80000000 3624 1.750 __ipipe_unstall_root+0x30 (default_idle+0x84)
| +end 0x80000000 3626 1.750 __ipipe_unstall_root+0x68 (default_idle+0x84)
+end 0x8000000e 3627 633.500 default_idle+0x8c (cpu_idle+0x3c)
| +func 4261 7.250 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 4268 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 4274 5.750 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func 4280 11.750 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func 4291 5.750 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func 4297 5.750 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| +func 4303 5.750 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func 4309 5.750 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 4314 6.750 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 4321 7.500 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| # func 4329 8.000 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| # func 4337 5.500 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| # func 4342 8.750 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| +func 4351 7.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 4359 7.000 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff 4366 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +func 4371 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 4378 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 4384 5.500 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func 4389 5.250 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func 4395 6.000 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func 4401 6.000 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func 4407 6.250 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func 4413 5.250 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func 4418 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func 4424 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 4430 6.000 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 4436 8.500 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func 4445 14.250 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func 4459 7.750 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func 4467 5.750 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func 4472 6.000 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func 4478 9.250 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func 4488 6.500 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 4494 8.500 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 4503 5.500 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func 4508 5.500 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 4514 5.750 irq_enter+0x10 (__exception_text_start+0x38)
#func 4519 6.500 ipipe_check_context+0x10 (irq_enter+0x18)
#func 4526 6.250 handle_level_irq+0x10 (__exception_text_start+0x48)
#func 4532 6.000 handle_IRQ_event+0x10 (handle_level_irq+0x64)
#func 4538 6.250 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
#func 4544 5.250 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 4550 6.750 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 4556 7.000 do_timer+0x10 (tick_periodic+0x70)
#func 4563 9.500 update_wall_time+0x14 (do_timer+0x30)
#func 4573 7.500 current_tick_length+0x10 (update_wall_time+0x15c)
#func 4580 8.750 current_tick_length+0x10 (update_wall_time+0x15c)
#func 4589 6.500 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 4596 6.750 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 4602 5.750 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 4608 6.750 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 4615 6.500 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 4621 7.250 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 4629 5.250 update_process_times+0x10 (tick_periodic+0x98)
#func 4634 5.500 account_process_tick+0x10 (update_process_times+0x2c)
#func 4639 7.000 account_system_time+0x10 (account_process_tick+0x40)
#func 4646 5.750 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 4652 5.500 run_local_timers+0x10 (update_process_times+0x30)
#func 4658 6.250 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 4664 6.750 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 4671 5.750 raise_softirq+0x58 (run_local_timers+0x18)
#func 4676 6.500 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 4683 6.250 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 4689 5.750 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 4695 5.750 rcu_pending+0x10 (update_process_times+0x38)
#func 4701 7.250 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 4708 6.500 __rcu_pending+0x10 (rcu_pending+0x34)
#func 4714 6.250 scheduler_tick+0x10 (update_process_times+0x50)
#func 4721 5.750 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 4726 8.500 sched_clock+0x10 (__update_rq_clock+0x28)
#func 4735 6.500 run_posix_cpu_timers+0x14 (update_process_times+0x58)
#func 4741 7.500 profile_tick+0x10 (tick_periodic+0xa0)
#func 4749 5.500 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 4754 6.000 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 4760 5.500 do_timer+0x10 (tick_periodic+0x70)
#func 4766 10.250 update_wall_time+0x14 (do_timer+0x30)
#func 4776 6.500 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 4783 6.500 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 4789 5.750 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 4795 6.750 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 4802 6.500 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 4808 6.750 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 4815 5.500 update_process_times+0x10 (tick_periodic+0x98)
#func 4820 5.500 account_process_tick+0x10 (update_process_times+0x2c)
#func 4826 6.750 account_system_time+0x10 (account_process_tick+0x40)
#func 4833 5.500 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 4838 5.250 run_local_timers+0x10 (update_process_times+0x30)
#func 4843 6.750 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 4850 6.500 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 4857 5.750 raise_softirq+0x58 (run_local_timers+0x18)
#func 4862 6.250 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 4869 6.750 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 4875 5.750 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 4881 5.500 rcu_pending+0x10 (update_process_times+0x38)
#func 4887 6.250 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 4893 6.250 __rcu_pending+0x10 (rcu_pending+0x34)
#func 4899 5.750 scheduler_tick+0x10 (update_process_times+0x50)
#func 4905 5.500 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 4910 8.000 sched_clock+0x10 (__update_rq_clock+0x28)
#func 4918 6.500 run_posix_cpu_timers+0x14 (update_process_times+0x58)
#func 4925 8.750 profile_tick+0x10 (tick_periodic+0xa0)
| #begin 0x80000001 4934 6.500 handle_IRQ_event+0x9c (handle_level_irq+0x64)
| #end 0x80000001 4940 5.500 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
#func 4946 6.750 note_interrupt+0x14 (handle_level_irq+0x84)
#func 4952 6.000 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
#func 4958 5.750 irq_exit+0x10 (__exception_text_start+0x4c)
#func 4964 6.000 ipipe_check_context+0x10 (irq_exit+0x18)
#func 4970 5.500 __do_softirq+0x10 (irq_exit+0x50)
#func 4976 6.000 ipipe_check_context+0x10 (__do_softirq+0x20)
#func 4982 6.250 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
| #begin 0x80000000 4988 6.750 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
| +end 0x80000000 4995 6.500 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
+func 5001 6.750 run_timer_softirq+0x14 (__do_softirq+0x60)
+func 5008 5.750 hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
+func 5014 9.000 current_kernel_time+0x14 (hrtimer_run_queues+0x24)
| +begin 0x80000001 5023 6.500 hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
| #end 0x80000001 5029 8.000 hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
| #func 5037 7.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 5045 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 5050 6.000 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func 5056 11.750 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func 5068 6.000 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func 5074 5.500 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| #func 5080 5.750 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func 5085 7.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 5093 7.500 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 5100 7.500 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| #*func 5108 8.500 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| #*func 5116 5.750 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func 5122 8.500 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func 5131 7.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 5138 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 5145 5.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| #func 5151 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 5158 5.250 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 5163 6.000 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| #func 5169 6.000 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| #func 5175 5.500 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| #func 5180 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| #func 5186 6.250 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| #func 5192 5.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| #func 5198 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| #func 5204 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 5210 6.750 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 5217 8.500 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| #*func 5225 13.000 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| #*func 5238 7.000 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| #*func 5245 5.750 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| #*func 5251 6.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| #*func 5257 9.000 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| #func 5266 8.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #end 0xffffffff 5274 5.250 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func 5280 6.500 __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
| #begin 0x80000000 5286 5.500 __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
| +func 5292 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 5299 8.500 __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
| +begin 0x80000001 5307 6.500 run_timer_softirq+0x68 (__do_softirq+0x60)
| #end 0x80000001 5314 7.250 run_timer_softirq+0x7c (__do_softirq+0x60)
#func 5321 6.250 __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
| #begin 0x80000000 5327 5.750 __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
| +func 5333 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 5340 6.750 __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
| +begin 0x80000001 5347 6.500 __do_softirq+0xa8 (irq_exit+0x50)
| #end 0x80000001 5353 5.750 __do_softirq+0xbc (irq_exit+0x50)
#func 5359 6.250 _local_bh_enable+0x10 (__do_softirq+0xfc)
#func 5365 7.750 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
| #begin 0x80000000 5373 7.500 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 5380 5.750 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func 5386 5.750 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 5392 5.500 irq_enter+0x10 (__exception_text_start+0x38)
#func 5397 6.000 ipipe_check_context+0x10 (irq_enter+0x18)
#func 5403 6.000 handle_level_irq+0x10 (__exception_text_start+0x48)
#func 5409 5.750 handle_IRQ_event+0x10 (handle_level_irq+0x64)
#func 5415 7.250 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
| #begin 0x80000001 5422 6.500 handle_IRQ_event+0x9c (handle_level_irq+0x64)
| #end 0x80000001 5429 5.750 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
#func 5435 6.500 note_interrupt+0x14 (handle_level_irq+0x84)
#func 5441 5.750 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
#func 5447 5.500 irq_exit+0x10 (__exception_text_start+0x4c)
#func 5452 7.250 ipipe_check_context+0x10 (irq_exit+0x18)
| #begin 0x80000000 5460 8.750 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff 5468 5.250 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func 5474 1.500 __ipipe_unstall_root+0x10 (default_idle+0x94)
| +begin 0x80000000 5475 2.000 __ipipe_unstall_root+0x30 (default_idle+0x94)
| +end 0x80000000 5477 1.750 __ipipe_unstall_root+0x68 (default_idle+0x94)
+func 5479 2.000 default_idle+0x10 (cpu_idle+0x3c)
| +begin 0x80000001 5481 1.750 default_idle+0x54 (cpu_idle+0x3c)
| #end 0x80000001 5483 1.500 default_idle+0x68 (cpu_idle+0x3c)
#func 5484 1.750 __ipipe_unstall_root+0x10 (default_idle+0x84)
| #begin 0x80000000 5486 2.000 __ipipe_unstall_root+0x30 (default_idle+0x84)
| +end 0x80000000 5488 1.750 __ipipe_unstall_root+0x68 (default_idle+0x84)
+end 0x8000000e 5490 323.500 default_idle+0x8c (cpu_idle+0x3c)
| +func 5813 6.750 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 5820 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 5825 5.250 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func 5831 12.000 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func 5843 6.000 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func 5849 5.250 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| +func 5854 5.750 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func 5860 6.750 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 5866 6.750 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 5873 7.250 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| # func 5880 7.750 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| # func 5888 5.750 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| # func 5894 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| +func 5902 7.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 5910 7.250 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff 5917 5.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +func 5923 6.750 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 5930 5.750 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 5935 5.750 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func 5941 5.500 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func 5947 5.500 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func 5952 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func 5958 6.250 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func 5964 5.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func 5970 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func 5975 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 5982 6.250 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 5988 8.750 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func 5997 14.250 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func 6011 7.250 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func 6018 5.250 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func 6023 6.250 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func 6030 10.000 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func 6040 6.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 6046 8.000 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 6054 5.750 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func 6060 5.750 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 6065 5.250 irq_enter+0x10 (__exception_text_start+0x38)
#func 6071 6.000 ipipe_check_context+0x10 (irq_enter+0x18)
#func 6077 5.750 handle_level_irq+0x10 (__exception_text_start+0x48)
#func 6082 5.500 handle_IRQ_event+0x10 (handle_level_irq+0x64)
#func 6088 6.250 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
#func 6094 5.750 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 6100 6.750 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 6107 6.250 do_timer+0x10 (tick_periodic+0x70)
#func 6113 9.500 update_wall_time+0x14 (do_timer+0x30)
#func 6122 7.500 current_tick_length+0x10 (update_wall_time+0x15c)
#func 6130 9.250 current_tick_length+0x10 (update_wall_time+0x15c)
#func 6139 7.000 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 6146 6.250 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 6152 5.500 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 6158 7.000 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 6165 6.750 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 6172 6.750 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 6178 5.250 update_process_times+0x10 (tick_periodic+0x98)
#func 6184 5.500 account_process_tick+0x10 (update_process_times+0x2c)
#func 6189 7.750 account_system_time+0x10 (account_process_tick+0x40)
#func 6197 5.500 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 6202 5.250 run_local_timers+0x10 (update_process_times+0x30)
#func 6208 7.000 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 6215 6.500 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 6221 6.250 raise_softirq+0x58 (run_local_timers+0x18)
#func 6227 6.500 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 6234 6.500 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 6240 5.750 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 6246 5.500 rcu_pending+0x10 (update_process_times+0x38)
#func 6252 6.500 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 6258 6.750 __rcu_pending+0x10 (rcu_pending+0x34)
#func 6265 5.750 scheduler_tick+0x10 (update_process_times+0x50)
#func 6271 6.500 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 6277 8.750 sched_clock+0x10 (__update_rq_clock+0x28)
#func 6286 6.750 run_posix_cpu_timers+0x14 (update_process_times+0x58)
#func 6293 7.250 profile_tick+0x10 (tick_periodic+0xa0)
#func 6300 5.500 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 6305 6.000 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 6311 5.750 do_timer+0x10 (tick_periodic+0x70)
#func 6317 9.750 update_wall_time+0x14 (do_timer+0x30)
#func 6327 6.750 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 6334 6.750 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 6340 5.750 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 6346 7.000 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 6353 6.500 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 6360 6.250 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 6366 6.250 update_process_times+0x10 (tick_periodic+0x98)
#func 6372 5.750 account_process_tick+0x10 (update_process_times+0x2c)
#func 6378 7.000 account_system_time+0x10 (account_process_tick+0x40)
#func 6385 5.750 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 6391 5.750 run_local_timers+0x10 (update_process_times+0x30)
#func 6396 6.500 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 6403 6.500 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 6409 5.500 raise_softirq+0x58 (run_local_timers+0x18)
#func 6415 7.000 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 6422 6.500 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 6428 5.750 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 6434 5.250 rcu_pending+0x10 (update_process_times+0x38)
#func 6439 6.500 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 6446 6.000 __rcu_pending+0x10 (rcu_pending+0x34)
#func 6452 5.500 scheduler_tick+0x10 (update_process_times+0x50)
#func 6457 5.250 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 6463 8.500 sched_clock+0x10 (__update_rq_clock+0x28)
#func 6471 6.500 run_posix_cpu_timers+0x14 (update_process_times+0x58)
#func 6478 9.750 profile_tick+0x10 (tick_periodic+0xa0)
| #begin 0x80000001 6487 6.500 handle_IRQ_event+0x9c (handle_level_irq+0x64)
| #end 0x80000001 6494 6.000 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
#func 6500 6.750 note_interrupt+0x14 (handle_level_irq+0x84)
#func 6507 6.000 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
#func 6513 5.250 irq_exit+0x10 (__exception_text_start+0x4c)
#func 6518 6.250 ipipe_check_context+0x10 (irq_exit+0x18)
#func 6524 5.750 __do_softirq+0x10 (irq_exit+0x50)
#func 6530 5.750 ipipe_check_context+0x10 (__do_softirq+0x20)
#func 6536 6.250 __ipipe_unstall_root+0x10 (__do_softirq+0x48)
| #begin 0x80000000 6542 6.750 __ipipe_unstall_root+0x30 (__do_softirq+0x48)
| +end 0x80000000 6549 6.000 __ipipe_unstall_root+0x68 (__do_softirq+0x48)
+func 6555 6.500 run_timer_softirq+0x14 (__do_softirq+0x60)
+func 6561 5.750 hrtimer_run_queues+0x14 (run_timer_softirq+0x20)
+func 6567 10.000 current_kernel_time+0x14 (hrtimer_run_queues+0x24)
| +begin 0x80000001 6577 6.500 hrtimer_run_queues+0xf8 (run_timer_softirq+0x20)
| #end 0x80000001 6583 6.500 hrtimer_run_queues+0x10c (run_timer_softirq+0x20)
| #func 6590 6.750 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 6597 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 6602 6.250 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| #func 6608 12.250 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| #func 6621 6.000 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| #func 6627 6.000 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| #func 6633 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| #func 6639 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 6645 7.000 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 6652 7.500 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| #*func 6659 8.000 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| #*func 6667 5.500 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| #*func 6673 8.250 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| #func 6681 7.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #func 6688 7.000 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| #end 0xffffffff 6695 5.500 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| #func 6701 6.500 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| #begin 0xffffffff 6707 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| #func 6713 5.750 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| #func 6719 5.750 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| #func 6724 5.500 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| #func 6730 6.000 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| #func 6736 6.500 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| #func 6742 5.250 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| #func 6748 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| #func 6753 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| #*func 6760 6.500 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| #*func 6766 8.250 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| #*func 6774 14.250 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| #*func 6789 7.500 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| #*func 6796 5.500 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| #*func 6802 6.000 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| #*func 6808 9.250 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| #func 6817 8.000 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| #end 0xffffffff 6825 7.000 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
#func 6832 6.500 __ipipe_unstall_root+0x10 (hrtimer_run_queues+0x1ec)
| #begin 0x80000000 6838 5.250 __ipipe_unstall_root+0x30 (hrtimer_run_queues+0x1ec)
| +func 6844 7.000 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 6851 7.750 __ipipe_unstall_root+0x68 (hrtimer_run_queues+0x1ec)
| +begin 0x80000001 6858 6.500 run_timer_softirq+0x68 (__do_softirq+0x60)
| #end 0x80000001 6865 7.250 run_timer_softirq+0x7c (__do_softirq+0x60)
#func 6872 6.750 __ipipe_unstall_root+0x10 (run_timer_softirq+0x230)
| #begin 0x80000000 6879 5.500 __ipipe_unstall_root+0x30 (run_timer_softirq+0x230)
| +func 6884 6.750 __ipipe_sync_stage+0x14 (__ipipe_unstall_root+0x54)
| +end 0x80000000 6891 7.250 __ipipe_unstall_root+0x68 (run_timer_softirq+0x230)
| +begin 0x80000001 6898 6.500 __do_softirq+0xa8 (irq_exit+0x50)
| #end 0x80000001 6905 5.500 __do_softirq+0xbc (irq_exit+0x50)
#func 6910 5.750 _local_bh_enable+0x10 (__do_softirq+0xfc)
#func 6916 7.750 ipipe_check_context+0x10 (_local_bh_enable+0x9c)
| #begin 0x80000000 6924 8.000 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 6932 5.750 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func 6938 5.500 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 6943 5.000 irq_enter+0x10 (__exception_text_start+0x38)
#func 6948 6.000 ipipe_check_context+0x10 (irq_enter+0x18)
#func 6954 5.750 handle_level_irq+0x10 (__exception_text_start+0x48)
#func 6960 5.750 handle_IRQ_event+0x10 (handle_level_irq+0x64)
#func 6966 8.000 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
| #begin 0x80000001 6974 6.750 handle_IRQ_event+0x9c (handle_level_irq+0x64)
| #end 0x80000001 6980 6.750 handle_IRQ_event+0xb0 (handle_level_irq+0x64)
#func 6987 6.250 note_interrupt+0x14 (handle_level_irq+0x84)
#func 6993 5.750 at91_aic_unmask_irq+0x10 (handle_level_irq+0xb0)
#func 6999 5.750 irq_exit+0x10 (__exception_text_start+0x4c)
#func 7005 7.250 ipipe_check_context+0x10 (irq_exit+0x18)
| #begin 0x80000000 7012 7.750 __ipipe_sync_stage+0x278 (__ipipe_walk_pipeline+0x9c)
| +end 0xffffffff 7020 5.000 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
+func 7025 1.750 __ipipe_unstall_root+0x10 (default_idle+0x94)
| +begin 0x80000000 7027 1.750 __ipipe_unstall_root+0x30 (default_idle+0x94)
| +end 0x80000000 7028 1.500 __ipipe_unstall_root+0x68 (default_idle+0x94)
+func 7030 2.250 default_idle+0x10 (cpu_idle+0x3c)
| +begin 0x80000001 7032 1.750 default_idle+0x54 (cpu_idle+0x3c)
| #end 0x80000001 7034 2.250 default_idle+0x68 (cpu_idle+0x3c)
#func 7036 2.000 __ipipe_unstall_root+0x10 (default_idle+0x84)
| #begin 0x80000000 7038 1.750 __ipipe_unstall_root+0x30 (default_idle+0x84)
| +end 0x80000000 7040 1.750 __ipipe_unstall_root+0x68 (default_idle+0x84)
+end 0x8000000e 7042 323.750 default_idle+0x8c (cpu_idle+0x3c)
| +func 7365 7.000 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 7372 5.250 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 7378 6.000 __ipipe_mach_demux_irq+0x14 (__ipipe_grab_irq+0x60)
| +func 7384 12.000 at91_aic_mask_irq+0x10 (__ipipe_mach_demux_irq+0x3c)
| +func 7396 6.000 __ipipe_handle_irq+0x10 (__ipipe_mach_demux_irq+0xa0)
| +func 7402 5.500 __ipipe_ack_irq+0x10 (__ipipe_handle_irq+0x70)
| +func 7407 6.000 __ipipe_ack_simple_irq+0x10 (__ipipe_ack_irq+0x28)
| +func 7413 6.500 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 7420 6.750 xnintr_irq_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 7426 7.250 do_upg+0x10 [rt_bus_driver] (xnintr_irq_handler+0x44)
| # func 7434 7.250 xnarch_tsc_to_ns+0x10 (do_upg+0x50 [rt_bus_driver])
| # func 7441 6.000 rthal_irq_end+0x10 (xnintr_irq_handler+0xfc)
| # func 7447 8.000 __ipipe_end_simple_irq+0x10 (rthal_irq_end+0x34)
| +func 7455 7.750 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 7463 7.500 at91_aic_unmask_irq+0x10 (__ipipe_mach_demux_irq+0xc4)
| +end 0xffffffff 7470 5.750 __ipipe_grab_irq+0x9c (__irq_svc+0x2c)
| +func 7476 6.750 __ipipe_grab_irq+0x10 (__irq_svc+0x2c)
| +begin 0xffffffff 7483 5.500 __ipipe_grab_irq+0x40 (__irq_svc+0x2c)
| +func 7488 5.750 __ipipe_handle_irq+0x10 (__ipipe_grab_irq+0x90)
| +func 7494 5.750 __ipipe_ack_timerirq+0x10 (__ipipe_handle_irq+0x70)
| +func 7500 5.500 __ipipe_ack_level_irq+0x10 (__ipipe_ack_timerirq+0x30)
| +func 7505 5.750 at91_aic_mask_irq+0x10 (__ipipe_ack_level_irq+0x2c)
| +func 7511 6.750 __ipipe_mach_acktimer+0x10 (__ipipe_ack_timerirq+0x40)
| +func 7518 5.500 __ipipe_end_level_irq+0x10 (__ipipe_ack_timerirq+0x50)
| +func 7523 5.750 at91_aic_unmask_irq+0x10 (__ipipe_end_level_irq+0x24)
| +func 7529 6.250 __ipipe_dispatch_wired+0x10 (__ipipe_handle_irq+0x7c)
| # func 7535 6.500 xnintr_clock_handler+0x10 (__ipipe_dispatch_wired+0x100)
| # func 7542 8.500 xntimer_tick_aperiodic+0x10 (xnintr_clock_handler+0x34)
| # func 7550 14.500 xntimer_next_local_shot+0x10 (xntimer_tick_aperiodic+0x250)
| # func 7565 6.750 __ipipe_mach_set_dec+0x10 (xntimer_next_local_shot+0xd0)
| # func 7571 5.500 rthal_irq_host_pend+0x10 (xnintr_clock_handler+0xd0)
| # func 7577 6.000 __ipipe_schedule_irq+0x10 (rthal_irq_host_pend+0x20)
| # func 7583 9.250 __ipipe_set_irq_pending+0x10 (__ipipe_schedule_irq+0x80)
| +func 7592 6.250 __ipipe_walk_pipeline+0x10 (__ipipe_handle_irq+0x118)
| +func 7598 8.250 __ipipe_sync_stage+0x14 (__ipipe_walk_pipeline+0x9c)
| #end 0x80000000 7607 5.750 __ipipe_sync_stage+0x1b0 (__ipipe_walk_pipeline+0x9c)
#func 7612 5.500 __exception_text_start+0x10 (__ipipe_sync_stage+0x1ec)
#func 7618 5.500 irq_enter+0x10 (__exception_text_start+0x38)
#func 7623 6.500 ipipe_check_context+0x10 (irq_enter+0x18)
#func 7630 6.000 handle_level_irq+0x10 (__exception_text_start+0x48)
#func 7636 5.750 handle_IRQ_event+0x10 (handle_level_irq+0x64)
#func 7642 6.000 at91_timer_interrupt+0x10 (handle_IRQ_event+0x40)
#func 7648 5.750 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 7653 6.750 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 7660 6.750 do_timer+0x10 (tick_periodic+0x70)
#func 7667 8.750 update_wall_time+0x14 (do_timer+0x30)
#func 7676 7.750 current_tick_length+0x10 (update_wall_time+0x15c)
#func 7683 9.250 current_tick_length+0x10 (update_wall_time+0x15c)
#func 7693 6.750 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 7699 6.250 clocksource_get_next+0x40 (update_wall_time+0x64c)
| #end 0x80000001 7706 5.750 clocksource_get_next+0x54 (update_wall_time+0x64c)
#func 7711 6.750 __ipipe_restore_root+0x10 (clocksource_get_next+0xa0)
| #begin 0x80000001 7718 6.750 __ipipe_restore_root+0x48 (clocksource_get_next+0xa0)
| #end 0x80000001 7725 7.000 __ipipe_restore_root+0x5c (clocksource_get_next+0xa0)
#func 7732 5.500 update_process_times+0x10 (tick_periodic+0x98)
#func 7737 5.750 account_process_tick+0x10 (update_process_times+0x2c)
#func 7743 8.000 account_system_time+0x10 (account_process_tick+0x40)
#func 7751 5.500 account_system_time_scaled+0x10 (account_process_tick+0x4c)
#func 7757 5.500 run_local_timers+0x10 (update_process_times+0x30)
#func 7762 6.750 raise_softirq+0x10 (run_local_timers+0x18)
| #begin 0x80000001 7769 6.750 raise_softirq+0x44 (run_local_timers+0x18)
| #end 0x80000001 7776 6.250 raise_softirq+0x58 (run_local_timers+0x18)
#func 7782 6.750 __ipipe_restore_root+0x10 (raise_softirq+0xbc)
| #begin 0x80000001 7789 6.500 __ipipe_restore_root+0x48 (raise_softirq+0xbc)
| #end 0x80000001 7795 5.750 __ipipe_restore_root+0x5c (raise_softirq+0xbc)
#func 7801 5.250 rcu_pending+0x10 (update_process_times+0x38)
#func 7806 7.000 __rcu_pending+0x10 (rcu_pending+0x1c)
#func 7813 6.250 __rcu_pending+0x10 (rcu_pending+0x34)
#func 7819 5.750 scheduler_tick+0x10 (update_process_times+0x50)
#func 7825 5.750 __update_rq_clock+0x14 (scheduler_tick+0x38)
#func 7831 9.000 sched_clock+0x10 (__update_rq_clock+0x28)
#func 7840 6.750 run_posix_cpu_timers+0x14 (update_process_times+0x58)
#func 7847 7.250 profile_tick+0x10 (tick_periodic+0xa0)
#func 7854 5.250 tick_handle_periodic+0x14 (at91_timer_interrupt+0x2c)
#func 7859 6.000 tick_periodic+0x10 (tick_handle_periodic+0x20)
#func 7865 5.500 do_timer+0x10 (tick_periodic+0x70)
#func 7871 10.750 update_wall_time+0x14 (do_timer+0x30)
#func 7881 6.750 clocksource_get_next+0x10 (update_wall_time+0x64c)
| #begin 0x80000001 7888 0.000 clocksource_get_next+0x40 (update_wall_time+0x64c)
^ permalink raw reply [flat|nested] 24+ messages in thread* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-26 17:47 ` Bosko Radivojevic
@ 2008-05-27 11:31 ` Bosko Radivojevic
2008-05-27 12:11 ` Gilles Chanteperdrix
0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-27 11:31 UTC (permalink / raw)
To: Gilles Chanteperdrix; +Cc: xenomai-help
Hi Gilles,
problem with Ethernet activity seems to be caused by hardware.
According to datasheet each PIO peripheral (A, B & C) has its own, but
only one, Interrupt line. In my case, both Ethernet and sync signal
were connected on PIO B peripheral. I did some quick tests using IRQ1
line, but I still need to double check.
Problem with two interrupts is still unresolved, but I have a
"feeling" :) it is also caused by hardware. It looks sync signal has
too 'sharp' edges.
Anyway, I'll send report later. If you see anything unusual on frozen*
files I've sent, please let me know. Thanks.
Regards,
Bosko
^ permalink raw reply [flat|nested] 24+ messages in thread
* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-27 11:31 ` Bosko Radivojevic
@ 2008-05-27 12:11 ` Gilles Chanteperdrix
2008-05-27 13:08 ` Bosko Radivojevic
0 siblings, 1 reply; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-27 12:11 UTC (permalink / raw)
To: Bosko Radivojevic; +Cc: xenomai-help
On Tue, May 27, 2008 at 1:31 PM, Bosko Radivojevic
<bosko.radivojevic@domain.hid> wrote:
> Hi Gilles,
Hi,
>
> problem with Ethernet activity seems to be caused by hardware.
> According to datasheet each PIO peripheral (A, B & C) has its own, but
> only one, Interrupt line. In my case, both Ethernet and sync signal
> were connected on PIO B peripheral. I did some quick tests using IRQ1
> line, but I still need to double check.
Yes, if you are trying to share an irqs line between real-time and non
real-time interrupts handler, you are going to have problems,
actually, that is an FAQ, and the better thing to do is to get two
different irqs for the two drivers.
>
> Problem with two interrupts is still unresolved, but I have a
> "feeling" :) it is also caused by hardware. It looks sync signal has
> too 'sharp' edges.
>
> Anyway, I'll send report later. If you see anything unusual on frozen*
> files I've sent, please let me know. Thanks.
I had no time to have a look at them yet. Will do it.
Regards.
--
Gilles
^ permalink raw reply [flat|nested] 24+ messages in thread
* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-27 12:11 ` Gilles Chanteperdrix
@ 2008-05-27 13:08 ` Bosko Radivojevic
2008-05-28 9:16 ` Bosko Radivojevic
0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-27 13:08 UTC (permalink / raw)
To: Gilles Chanteperdrix; +Cc: xenomai-help
On Tue, May 27, 2008 at 2:11 PM, Gilles Chanteperdrix
<gilles.chanteperdrix@xenomai.org> wrote:
>> Anyway, I'll send report later. If you see anything unusual on frozen*
>> files I've sent, please let me know. Thanks.
>
> I had no time to have a look at them yet. Will do it.
BTW, when I enable tracer (echo 1 > /proc/ipipe/tracer/enable) I see
just one interrupt ;)
^ permalink raw reply [flat|nested] 24+ messages in thread
* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-27 13:08 ` Bosko Radivojevic
@ 2008-05-28 9:16 ` Bosko Radivojevic
2008-05-28 10:14 ` Bosko Radivojevic
0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-28 9:16 UTC (permalink / raw)
To: Gilles Chanteperdrix; +Cc: xenomai-help
Gilles,
I've found the explanation why I see two interrupts. The problem is
that I, somehow, cannot use my external source connected to PC15 pin
as IRQ1 line. On AT91SAM9260 PIO Interrupts are considered as
'internal source interrupts' and it is not possible to change second
bit of source type, so it can be level or edge triggered, but not
rising or falling edge. Now it is quite clear why I get two
interrupts.
I've traced down to __ipipe_grab_irq() what is happening and
discovered that my interrupt is always coming as irq source = 4 (PIO C
peripheral) and not as irq source = 30 as expected.
Does anybody here knows anything about this? :)
Thanx
^ permalink raw reply [flat|nested] 24+ messages in thread
* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-28 9:16 ` Bosko Radivojevic
@ 2008-05-28 10:14 ` Bosko Radivojevic
2008-05-28 12:27 ` Gilles Chanteperdrix
0 siblings, 1 reply; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-28 10:14 UTC (permalink / raw)
To: Gilles Chanteperdrix; +Cc: xenomai-help
Hi,
I hope this is the last mail in this thread :) In order to use IRQ1
line, IRQ no. 30 should be requested. What get me in wrong way is
that, when I tried first time to request IRQ 30 instead of 111 (PC15),
everything hung. Actually, before requesting irq it is mandatory to
set interrupt source type to anything except LOW LEVEL.
Actually, I can still see a small jitter with heavy Ethernet activity,
but it seems acceptable.
Thanx a lot!
On Wed, May 28, 2008 at 11:16 AM, Bosko Radivojevic
<bosko.radivojevic@domain.hid> wrote:
> Gilles,
>
> I've found the explanation why I see two interrupts. The problem is
> that I, somehow, cannot use my external source connected to PC15 pin
> as IRQ1 line. On AT91SAM9260 PIO Interrupts are considered as
> 'internal source interrupts' and it is not possible to change second
> bit of source type, so it can be level or edge triggered, but not
> rising or falling edge. Now it is quite clear why I get two
> interrupts.
>
> I've traced down to __ipipe_grab_irq() what is happening and
> discovered that my interrupt is always coming as irq source = 4 (PIO C
> peripheral) and not as irq source = 30 as expected.
>
> Does anybody here knows anything about this? :)
>
> Thanx
>
^ permalink raw reply [flat|nested] 24+ messages in thread
* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-28 10:14 ` Bosko Radivojevic
@ 2008-05-28 12:27 ` Gilles Chanteperdrix
0 siblings, 0 replies; 24+ messages in thread
From: Gilles Chanteperdrix @ 2008-05-28 12:27 UTC (permalink / raw)
To: Bosko Radivojevic; +Cc: xenomai-help
On Wed, May 28, 2008 at 12:14 PM, Bosko Radivojevic
<bosko.radivojevic@domain.hid> wrote:
> Hi,
>
> I hope this is the last mail in this thread :) In order to use IRQ1
> line, IRQ no. 30 should be requested. What get me in wrong way is
> that, when I tried first time to request IRQ 30 instead of 111 (PC15),
> everything hung. Actually, before requesting irq it is mandatory to
> set interrupt source type to anything except LOW LEVEL.
>
> Actually, I can still see a small jitter with heavy Ethernet activity,
> but it seems acceptable.
That's good news.
--
Gilles
^ permalink raw reply [flat|nested] 24+ messages in thread
* Re: [Xenomai-help] Interrupt priorities and handling problems
2008-05-26 16:47 ` Gilles Chanteperdrix
2008-05-26 16:59 ` Gilles Chanteperdrix
@ 2008-05-26 16:59 ` Bosko Radivojevic
1 sibling, 0 replies; 24+ messages in thread
From: Bosko Radivojevic @ 2008-05-26 16:59 UTC (permalink / raw)
To: Gilles Chanteperdrix; +Cc: xenomai-help
On Mon, May 26, 2008 at 6:47 PM, Gilles Chanteperdrix
<gilles.chanteperdrix@xenomai.org> wrote:
> Which is a second gpio interrupt. I am afraid from this sequence, it
> appears that the two interrupt are generated at hardware level. Did
> you try setting up the irq with at91_set_gpio_input ?
Yes, I'm sure two interrupts are generated at the hardware level. It
looks on SAM9260 default is Level triggered interrupts, which brings
two interrupts for the pin 1-to-0 change. Actually, I've tried to
change SRCTYPE to Rising edge for PB:
at91_sys_write(AT91_AIC_SMR(3), AT91_AIC_SRCTYPE_RISING);
But then I see no interrupts at all. :)
^ permalink raw reply [flat|nested] 24+ messages in thread
end of thread, other threads:[~2008-05-28 12:27 UTC | newest]
Thread overview: 24+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2008-05-23 17:56 [Xenomai-help] Interrupt priorities and handling problems Bosko Radivojevic
2008-05-23 19:08 ` Gilles Chanteperdrix
2008-05-23 19:34 ` Bosko Radivojevic
2008-05-23 19:42 ` Gilles Chanteperdrix
2008-05-23 19:48 ` Bosko Radivojevic
2008-05-23 19:49 ` Gilles Chanteperdrix
2008-05-23 19:51 ` Bosko Radivojevic
2008-05-25 14:31 ` Gilles Chanteperdrix
2008-05-26 13:26 ` Bosko Radivojevic
2008-05-26 16:29 ` Bosko Radivojevic
2008-05-26 16:47 ` Gilles Chanteperdrix
2008-05-26 16:59 ` Gilles Chanteperdrix
2008-05-26 17:04 ` Bosko Radivojevic
2008-05-26 17:14 ` Gilles Chanteperdrix
2008-05-26 17:16 ` Bosko Radivojevic
2008-05-26 17:21 ` Gilles Chanteperdrix
2008-05-26 17:47 ` Bosko Radivojevic
2008-05-27 11:31 ` Bosko Radivojevic
2008-05-27 12:11 ` Gilles Chanteperdrix
2008-05-27 13:08 ` Bosko Radivojevic
2008-05-28 9:16 ` Bosko Radivojevic
2008-05-28 10:14 ` Bosko Radivojevic
2008-05-28 12:27 ` Gilles Chanteperdrix
2008-05-26 16:59 ` Bosko Radivojevic
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.
![[-- Attachment #2: osc1.jpg --] [-- Type: image/jpeg, Size: 59032 bytes --]](../../d6c8ef150805260929yeb4e263o618c446cdd96856b@domain.hid/2-osc1.jpg){kind=link}
![[-- Attachment #3: osc2.jpg --] [-- Type: image/jpeg, Size: 60149 bytes --]](../../d6c8ef150805260929yeb4e263o618c446cdd96856b@domain.hid/3-osc2.jpg){kind=link}