All of lore.kernel.org
 help / color / mirror / Atom feed
From: Roman Pisl <rpisl@domain.hid>
To: Jan Kiszka <jan.kiszka@domain.hid>
Cc: xenomai@xenomai.org
Subject: Re: [Xenomai-help] Freeze on SMP x86-64
Date: Tue, 06 Oct 2009 17:45:42 +0200	[thread overview]
Message-ID: <4ACB6626.6020707@domain.hid> (raw)
In-Reply-To: <4ACB4C70.80406@domain.hid>

[-- Attachment #1: Type: text/plain, Size: 859 bytes --]

On 6.10.2009 15:56, Jan Kiszka wrote:
> Roman Pisl wrote:
>> ...
>>>
>>> Is there a chance to grab the panic log via serial line? The first of
>>> your two screenshots indicate that there might have happened something
>>> interesting before the NMI triggered, but it's scrolled out of sight.
>>>
>>> Jan
>>>
>>
>> Hello,
>> here I send kernel panic (triggered by rt_task_sleep and latency test)
>> grabbed via serial line.
>
> Hmm, still only NMI alarms...
>
>>
>> I'm ready to help with resolving this issue.
>
> Could you try enabling the I-pipe tracer with function tracing? It
> should dump a trace of the functions that were executed before the
> watchdog triggered. You may need to extend the number of tracepoints a
> bit, try "echo 1000>  /proc/ipipe/trace/back_trace_points".
>
> Jan
>

Then I had I/O activity on the background and got this.

Roman

[-- Attachment #2: panic.rt_task_sleep.ipipe2 --]
[-- Type: text/plain, Size: 131468 bytes --]

[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 2.6.31.1-xenomai-i2.4-06 (root@crane-k) (gcc version 4.4.1 (Gentoo 4.4.1 p1.0) ) #7 SMP Tue Oct 6 17:10:50 CEST 2009
[    0.000000] Command line: root=/dev/sda3 nmi_watchdog=2 console=ttyS0,115200 
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Centaur CentaurHauls
[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  BIOS-e820: 0000000000000000 - 000000000009a000 (usable)
[    0.000000]  BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
[    0.000000]  BIOS-e820: 0000000000100000 - 00000000cd9ffc00 (usable)
[    0.000000]  BIOS-e820: 00000000cd9ffc00 - 00000000cda53c00 (ACPI NVS)
[    0.000000]  BIOS-e820: 00000000cda53c00 - 00000000cda55c00 (ACPI data)
[    0.000000]  BIOS-e820: 00000000cda55c00 - 00000000d0000000 (reserved)
[    0.000000]  BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved)
[    0.000000]  BIOS-e820: 00000000fec00000 - 00000000fed00400 (reserved)
[    0.000000]  BIOS-e820: 00000000fed20000 - 00000000feda0000 (reserved)
[    0.000000]  BIOS-e820: 00000000fee00000 - 00000000fef00000 (reserved)
[    0.000000]  BIOS-e820: 00000000ffb00000 - 0000000100000000 (reserved)
[    0.000000]  BIOS-e820: 0000000100000000 - 0000000128000000 (usable)
[    0.000000] DMI 2.5 present.
[    0.000000] last_pfn = 0x128000 max_arch_pfn = 0x400000000
[    0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
[    0.000000] last_pfn = 0xcd9ff max_arch_pfn = 0x400000000
[    0.000000] init_memory_mapping: 0000000000000000-00000000cd9ff000
[    0.000000] init_memory_mapping: 0000000100000000-0000000128000000
[    0.000000] ACPI: RSDP 00000000000fec00 00024 (v02 DELL  )
[    0.000000] ACPI: XSDT 00000000000fc7cb 00074 (v01 DELL    B10K    00000015 ASL  00000061)
[    0.000000] ACPI: FACP 00000000000fc8fb 000F4 (v03 DELL    B10K    00000015 ASL  00000061)
[    0.000000] ACPI: DSDT 00000000ffe9cff8 054AD (v01   DELL    dt_ex 00001000 INTL 20050624)
[    0.000000] ACPI: FACS 00000000cd9ffc00 00040
[    0.000000] ACPI: SSDT 00000000ffea25c4 000AA (v01   DELL    st_ex 00001000 INTL 20050624)
[    0.000000] ACPI: APIC 00000000000fc9ef 00092 (v01 DELL    B10K    00000015 ASL  00000061)
[    0.000000] ACPI: BOOT 00000000000fca81 00028 (v01 DELL    B10K    00000015 ASL  00000061)
[    0.000000] ACPI: ASF! 00000000000fcaa9 00096 (v32 DELL    B10K    00000015 ASL  00000061)
[    0.000000] ACPI: MCFG 00000000000fcb3f 0003E (v01 DELL    B10K    00000015 ASL  00000061)
[    0.000000] ACPI: HPET 00000000000fcb7d 00038 (v01 DELL    B10K    00000015 ASL  00000061)
[    0.000000] ACPI: TCPA 00000000000fcdd9 00032 (v01 DELL    B10K    00000015 ASL  00000061)
[    0.000000] ACPI: DMAR 00000000000fce0b 00120 (v01 DELL    B10K    00000015 ASL  00000061)
[    0.000000] ACPI: SLIC 00000000000fcbb5 00176 (v01 DELL    B10K    00000015 ASL  00000061)
[    0.000000] (7 early reservations) ==> bootmem [0000000000 - 0128000000]
[    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
[    0.000000]   #1 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
[    0.000000]   #2 [0001000000 - 0001cfc2d4]    TEXT DATA BSS ==> [0001000000 - 0001cfc2d4]
[    0.000000]   #3 [000009a000 - 0000100000]    BIOS reserved ==> [000009a000 - 0000100000]
[    0.000000]   #4 [0001cfd000 - 0001cfd1f0]              BRK ==> [0001cfd000 - 0001cfd1f0]
[    0.000000]   #5 [0000008000 - 000000c000]          PGTABLE ==> [0000008000 - 000000c000]
[    0.000000]   #6 [000000c000 - 000000d000]          PGTABLE ==> [000000c000 - 000000d000]
[    0.000000] found SMP MP-table at [ffff8800000fe710] fe710
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA      0x00000000 -> 0x00001000
[    0.000000]   DMA32    0x00001000 -> 0x00100000
[    0.000000]   Normal   0x00100000 -> 0x00128000
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[3] active PFN ranges
[    0.000000]     0: 0x00000000 -> 0x0000009a
[    0.000000]     0: 0x00000100 -> 0x000cd9ff
[    0.000000]     0: 0x00100000 -> 0x00128000
[    0.000000] ACPI: PM-Timer IO Port: 0x808
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x01] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x02] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x03] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high level lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] 8 Processors exceeds NR_CPUS limit of 4
[    0.000000] SMP: Allowing 4 CPUs, 0 hotplug CPUs
[    0.000000] Allocating PCI resources starting at d0000000 (gap: d0000000:10000000)
[    0.000000] NR_CPUS:4 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1
[    0.000000] PERCPU: Embedded 1312 pages at ffff88002be00000, static data 5341408 bytes
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 989291
[    0.000000] Kernel command line: root=/dev/sda3 nmi_watchdog=2 console=ttyS0,115200 
[    0.000000] PID hash table entries: 4096 (order: 12, 32768 bytes)
[    0.000000] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
[    0.000000] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
[    0.000000] Initializing CPU#0
[    0.000000] xsave/xrstor: enabled xstate_bv 0x3, cntxt size 0x240
[    0.000000] Checking aperture...
[    0.000000] No AGP bridge found
[    0.000000] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    0.000000] Placing 64MB software IO TLB between ffff880020000000 - ffff880024000000
[    0.000000] software IO TLB at phys 0x20000000 - 0x24000000
[    0.000000] Memory: 3859008k/4849664k available (4374k kernel code, 825756k absent, 163992k reserved, 2164k data, 5556k init)
[    0.000000] SLUB: Genslabs=13, HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000] NR_IRQS:384
[    0.000000] Fast TSC calibration using PIT
[    0.000000] Detected 2659.948 MHz processor.
[    0.000059] I-pipe 2.4-06: pipeline enabled.
[    0.003121] Console: colour VGA+ 80x25
[    0.003141] console [ttyS0] enabled
[    0.004000] HPET: 8 timers in total, 4 timers will be used for per-cpu timer
[    0.004009] Calibrating delay loop (skipped), value calculated using timer frequency.. 5319.89 BogoMIPS (lpj=10639792)
[    0.012036] Mount-cache hash table entries: 256
[    0.016177] Initializing cgroup subsys ns
[    0.020006] Initializing cgroup subsys cpuacct
[    0.024009] Initializing cgroup subsys freezer
[    0.028014] CPU: L1 I cache: 32K, L1 D cache: 32K
[    0.036004] CPU: L2 cache: 3072K
[    0.039209] CPU: Physical Processor ID: 0
[    0.040004] CPU: Processor Core ID: 0
[    0.044005] mce: CPU supports 6 MCE banks
[    0.048008] CPU0: Thermal monitoring enabled (TM2)
[    0.052005] Performance Counters: Core2 events, Intel PMU driver.
[    0.061654] ... version:                 2
[    0.064004] ... bit width:               40
[    0.068004] ... generic counters:        2
[    0.072004] ... value mask:              000000ffffffffff
[    0.076004] ... max period:              000000007fffffff
[    0.080004] ... fixed-purpose counters:  3
[    0.084004] ... counter mask:            0000000700000003
[    0.088015] Freeing SMP alternatives: 36k freed
[    0.092024] ACPI: Core revision 20090521
[    0.339852] ftrace: converting mcount calls to 0f 1f 44 00 00
[    0.340007] ftrace: allocating 21378 entries in 84 pages
[    0.359202] Setting APIC routing to flat
[    0.360325] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.364001] ..MP-BIOS bug: 8254 timer not connected to IO-APIC
[    0.364001] ...trying to set up timer (IRQ0) through the 8259A ...
[    0.364001] ..... (found apic 0 pin 2) ...
[    0.404854] ....... works.
[    0.407543] CPU0: Intel(R) Core(TM)2 Quad CPU    Q9400  @ 2.66GHz stepping 0a
[    0.416001] Booting processor 1 APIC 0x1 ip 0x6000
[    0.004000] Initializing CPU#1
[    0.004000] Calibrating delay using timer specific routine.. 5319.98 BogoMIPS (lpj=10639963)
[    0.004000] CPU: L1 I cache: 32K, L1 D cache: 32K
[    0.004000] CPU: L2 cache: 3072K
[    0.004000] CPU: Physical Processor ID: 0
[    0.004000] CPU: Processor Core ID: 1
[    0.004000] mce: CPU supports 6 MCE banks
[    0.004000] CPU1: Thermal monitoring enabled (TM2)
[    0.004000] x86 PAT enabled: cpu 1, old 0x7040600070406, new 0x7010600070106
[    0.505434] CPU1: Intel(R) Core(TM)2 Quad CPU    Q9400  @ 2.66GHz stepping 0a
[    0.513228] checking TSC synchronization [CPU#0 -> CPU#1]: passed.
[    0.516089] Booting processor 2 APIC 0x2 ip 0x6000
[    0.004000] Initializing CPU#2
[    0.004000] Calibrating delay using timer specific routine.. 5320.00 BogoMIPS (lpj=10640006)
[    0.004000] CPU: L1 I cache: 32K, L1 D cache: 32K
[    0.004000] CPU: L2 cache: 3072K
[    0.004000] CPU: Physical Processor ID: 0
[    0.004000] CPU: Processor Core ID: 2
[    0.004000] mce: CPU supports 6 MCE banks
[    0.004000] CPU2: Thermal monitoring enabled (TM2)
[    0.004000] x86 PAT enabled: cpu 2, old 0x7040600070406, new 0x7010600070106
[    0.613592] CPU2: Intel(R) Core(TM)2 Quad CPU    Q9400  @ 2.66GHz stepping 0a
[    0.621228] checking TSC synchronization [CPU#0 -> CPU#2]: passed.
[    0.624072] Booting processor 3 APIC 0x3 ip 0x6000
[    0.004000] Initializing CPU#3
[    0.004000] Calibrating delay using timer specific routine.. 5319.99 BogoMIPS (lpj=10639996)
[    0.004000] CPU: L1 I cache: 32K, L1 D cache: 32K
[    0.004000] CPU: L2 cache: 3072K
[    0.004000] CPU: Physical Processor ID: 0
[    0.004000] CPU: Processor Core ID: 3
[    0.004000] mce: CPU supports 6 MCE banks
[    0.004000] CPU3: Thermal monitoring enabled (TM2)
[    0.004000] x86 PAT enabled: cpu 3, old 0x7040600070406, new 0x7010600070106
[    0.721431] CPU3: Intel(R) Core(TM)2 Quad CPU    Q9400  @ 2.66GHz stepping 0a
[    0.729227] checking TSC synchronization [CPU#0 -> CPU#3]: passed.
[    0.732019] Brought up 4 CPUs
[    0.736006] Total of 4 processors activated (21279.87 BogoMIPS).
[    0.740041] Testing NMI watchdog ... OK.
[    0.828522] NET: Registered protocol family 16
[    0.836323] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    0.840031] ACPI: bus type pci registered
[    0.844026] PCI: Using configuration type 1 for base access
[    0.888219] bio: create slab <bio-0> at 0
[    1.040957] ACPI: BIOS _OSI(Linux) query ignored
[    1.090667] ACPI: Interpreter enabled
[    1.092020] ACPI: (supports S0 S5)
[    1.096663] ACPI: Using IOAPIC for interrupt routing
[    1.304561] ACPI Warning: Incorrect checksum in table [TCPA] - 00, should be 7F 20090521 tbutils-246
[    1.321153] ACPI: ACPI Dock Station Driver: 1 docks/bays found
[    1.339918] ACPI: PCI Root Bridge [PCI0] (0000:00)
[    1.341248] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[    1.344032] pci 0000:00:03.0: PME# disabled
[    1.349468] pci 0000:00:19.0: PME# supported from D0 D3hot D3cold
[    1.352028] pci 0000:00:19.0: PME# disabled
[    1.357310] pci 0000:00:1a.7: PME# supported from D0 D3hot D3cold
[    1.360032] pci 0000:00:1a.7: PME# disabled
[    1.364366] pci 0000:00:1b.0: PME# supported from D0 D3hot D3cold
[    1.368028] pci 0000:00:1b.0: PME# disabled
[    1.372258] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    1.376032] pci 0000:00:1c.0: PME# disabled
[    1.380270] pci 0000:00:1c.1: PME# supported from D0 D3hot D3cold
[    1.384031] pci 0000:00:1c.1: PME# disabled
[    1.393252] pci 0000:00:1d.7: PME# supported from D0 D3hot D3cold
[    1.396029] pci 0000:00:1d.7: PME# disabled
[    1.404598] pci 0000:00:1f.2: PME# supported from D3hot
[    1.408028] pci 0000:00:1f.2: PME# disabled
[    1.413296] pci 0000:03:00.0: PME# supported from D0 D1 D2 D3hot
[    1.416033] pci 0000:03:00.0: PME# disabled
[    1.420370] pci 0000:03:02.0: PME# supported from D1 D2 D3hot D3cold
[    1.424032] pci 0000:03:02.0: PME# disabled
[    1.428268] pci 0000:00:1e.0: transparent bridge
[    3.817264] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 10 *11 12 15)
[    3.828295] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 *5 6 7 9 10 11 12 15)
[    3.837172] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 *9 10 11 12 15)
[    3.845926] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 *10 11 12 15)
[    3.854752] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 11 12 15) *0, disabled.
[    3.864912] ACPI: PCI Interrupt Link [LNKF] (IRQs *3 4 5 6 7 9 10 11 12 15)
[    3.873626] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 *5 6 7 9 10 11 12 15)
[    3.882497] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 *10 11 12 15)
[    3.892196] SCSI subsystem initialized
[    3.896181] usbcore: registered new interface driver usbfs
[    3.900147] usbcore: registered new interface driver hub
[    3.904110] usbcore: registered new device driver usb
[    3.912133] PCI: Using ACPI for IRQ routing
[    3.968087] pnp: PnP ACPI init
[    3.971184] ACPI: bus type pnp registered
[    4.068296] pnp: PnP ACPI: found 9 devices
[    4.072423] ACPI: ACPI bus type pnp unregistered
[    4.077109] system 00:01: ioport range 0x800-0x85f has been reserved
[    4.083488] system 00:01: ioport range 0xc00-0xc7f has been reserved
[    4.089875] system 00:01: ioport range 0x860-0x8ff has been reserved
[    4.104513] pci 0000:00:1c.0: PCI bridge, secondary bus 0000:01
[    4.110456] pci 0000:00:1c.0:   IO window: disabled
[    4.115369] pci 0000:00:1c.0:   MEM window: 0xfe500000-0xfe5fffff
[    4.121491] pci 0000:00:1c.0:   PREFETCH window: disabled
[    4.126925] pci 0000:00:1c.1: PCI bridge, secondary bus 0000:02
[    4.132867] pci 0000:00:1c.1:   IO window: disabled
[    4.137778] pci 0000:00:1c.1:   MEM window: 0xfe400000-0xfe4fffff
[    4.143900] pci 0000:00:1c.1:   PREFETCH window: disabled
[    4.149329] pci 0000:00:1e.0: PCI bridge, secondary bus 0000:03
[    4.155272] pci 0000:00:1e.0:   IO window: 0xd000-0xdfff
[    4.160617] pci 0000:00:1e.0:   MEM window: 0xfe300000-0xfe3fffff
[    4.166739] pci 0000:00:1e.0:   PREFETCH window: disabled
[    4.172203] pci 0000:00:1c.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
[    4.178983] pci 0000:00:1c.1: PCI INT B -> GSI 17 (level, low) -> IRQ 17
[    4.185976] NET: Registered protocol family 2
[    4.190476] IP route cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    4.198336] TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
[    4.207359] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    4.214506] TCP: Hash tables configured (established 262144 bind 65536)
[    4.221143] TCP reno registered
[    4.224621] NET: Registered protocol family 1
[    4.229852] Simple Boot Flag at 0x7a set to 0x1
[    4.243213] audit: initializing netlink socket (disabled)
[    4.248680] type=2000 audit(1254850510.245:1): initialized
[    4.259565] I-pipe: Domain Xenomai registered.
[    4.264364] Xenomai: hal/x86_64 started.
[    4.268390] Xenomai: scheduling class idle registered.
[    4.273577] Xenomai: scheduling class rt registered.
[    4.294823] Xenomai: real-time nucleus v2.5-rc3 (Flying In A Blue Dream) loaded.
[    4.303000] Xenomai: NMI watchdog started (threshold=100 us).
[    4.308897] Xenomai: starting native API services.
[    4.313731] Xenomai: starting POSIX services.
[    4.319880] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    4.360626] Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
[    4.374108] fuse init (API version 7.12)
[    4.379961] msgmni has been set to 7538
[    4.387344] alg: No test for stdrng (krng)
[    4.392371] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
[    4.399815] io scheduler noop registered
[    4.403781] io scheduler anticipatory registered
[    4.408443] io scheduler deadline registered
[    4.412799] io scheduler cfq registered (default)
[    4.422666] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    4.459879] Non-volatile memory driver v1.3
[    4.464154] Linux agpgart interface v0.103
[    4.468304] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
ÿ[    4.729708] serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    4.738831] 00:07: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    4.745286] serial 0000:00:03.3: PCI INT B -> GSI 17 (level, low) -> IRQ 17
[    4.752791] 0000:00:03.3: ttyS1 at I/O 0xec98 (irq = 17) is a 16550A
[    4.777566] brd: module loaded
[    4.790003] loop: module loaded
[    4.795363] ahci 0000:00:1f.2: PCI INT C -> GSI 18 (level, low) -> IRQ 18
[    4.802659] ahci 0000:00:1f.2: AHCI 0001.0200 32 slots 6 ports 3 Gbps 0x2f impl RAID mode
[    4.810876] ahci 0000:00:1f.2: flags: 64bit ncq sntf led clo pio ems 
[    4.848435] scsi0 : ahci
[    4.852265] scsi1 : ahci
[    4.855898] scsi2 : ahci
[    4.859527] scsi3 : ahci
[    4.863188] scsi4 : ahci
[    4.866812] scsi5 : ahci
[    4.876697] ata1: SATA max UDMA/133 abar m2048@0xff970000 port 0xff970100 irq 30
[    4.884134] ata2: SATA max UDMA/133 abar m2048@0xff970000 port 0xff970180 irq 30
[    4.891571] ata3: SATA max UDMA/133 abar m2048@0xff970000 port 0xff970200 irq 30
[    4.899007] ata4: SATA max UDMA/133 abar m2048@0xff970000 port 0xff970280 irq 30
[    4.906443] ata5: DUMMY
[    4.908936] ata6: SATA max UDMA/133 abar m2048@0xff970000 port 0xff970380 irq 30
[    4.918594] Intel(R) PRO/1000 Network Driver - version 7.3.21-k3-NAPI
[    4.925081] Copyright (c) 1999-2006 Intel Corporation.
[    4.930675] e1000e: Intel(R) PRO/1000 Network Driver - 1.0.2-k2
[    4.936637] e1000e: Copyright (c) 1999-2008 Intel Corporation.
[    4.942652] e1000e 0000:00:19.0: PCI INT A -> GSI 21 (level, low) -> IRQ 21
[    4.949685] e1000e 0000:00:19.0: pci_enable_pcie_error_reporting failed 0xfffffffb
[    5.065507] 0000:00:19.0: eth0: (PCI Express:2.5GB/s:Width x1) 00:24:e8:39:3c:95
[    5.072943] 0000:00:19.0: eth0: Intel(R) PRO/1000 Network Connection
[    5.079410] 0000:00:19.0: eth0: MAC: 8, PHY: 8, PBA No: 2021ff-0ff
[    5.086053] Intel(R) Gigabit Ethernet Network Driver - version 1.3.16-k2
[    5.092795] Copyright (c) 2007-2009 Intel Corporation.
[    5.098354] Intel(R) Virtual Function Network Driver - version 1.0.0-k0
[    5.105012] Copyright (c) 2009 Intel Corporation.
[    5.110219] <6>8139cp: 10/100 PCI Ethernet driver v1.3 (Mar 22, 2004)
[    5.116705] 8139cp 0000:03:02.0: This (id 10ec:8139 rev 10) is not an 8139C+ compatible chip, use 8139too
[    5.126654] tun: Universal TUN/TAP device driver, 1.6
[    5.131750] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
[    5.139130] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    5.145888] ehci_hcd 0000:00:1a.7: PCI INT C -> GSI 22 (level, low) -> IRQ 22
[    5.153132] ehci_hcd 0000:00:1a.7: EHCI Host Controller
[    5.159035] ehci_hcd 0000:00:1a.7: new USB bus registered, assigned bus number 1
[    5.170564] ehci_hcd 0000:00:1a.7: debug port 1
[    5.175307] ehci_hcd 0000:00:1a.7: irq 22, io mem 0xfe6da000
[    5.192110] ehci_hcd 0000:00:1a.7: USB 2.0 started, EHCI 1.00
[    5.198263] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    5.205091] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    5.212353] usb usb1: Product: EHCI Host Controller
[    5.217273] usb usb1: Manufacturer: Linux 2.6.31.1-xenomai-i2.4-06 ehci_hcd
[    5.224275] usb usb1: SerialNumber: 0000:00:1a.7
[    5.229619] usb usb1: configuration #1 chosen from 1 choice
[    5.235801] hub 1-0:1.0: USB hub found
[    5.237628] ata3: SATA link down (SStatus 4 SControl 300)
[    5.237720] ata2: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[    5.237798] ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[    5.237869] ata4: SATA link down (SStatus 4 SControl 300)
[    5.237955] ata6: SATA link down (SStatus 0 SControl 300)
[    5.240027] ata2.00: ATAPI: PLDS DVD+/-RW DH-16AAS, JD12, max UDMA/100, ATAPI AN
[    5.264790] ata1.00: ATA-8: ST3500418AS, CC44, max UDMA/133
[    5.264808] ata1.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[    5.277428] ata2.00: configured for UDMA/100
[    5.291983] hub 1-0:1.0: 6 ports detected
[    5.296798] ehci_hcd 0000:00:1d.7: PCI INT A -> GSI 23 (level, low) -> IRQ 23
[    5.304083] ehci_hcd 0000:00:1d.7: EHCI Host Controller
[    5.305588] ata1.00: configured for UDMA/133
[    5.306345] scsi 0:0:0:0: Direct-Access     ATA      ST3500418AS      CC44 PQ: 0 ANSI: 5
[    5.308679] sd 0:0:0:0: Attached scsi generic sg0 type 0
[    5.309582] sd 0:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[    5.310186] sd 0:0:0:0: [sda] Write Protect is off
[    5.310510] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    5.348829] ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 2
[    5.356303] scsi 1:0:0:0: CD-ROM            PLDS     DVD+-RW DH-16AAS JD12 PQ: 0 ANSI: 5
[    5.360396] ehci_hcd 0000:00:1d.7: debug port 1
[    5.360546] ehci_hcd 0000:00:1d.7: irq 23, io mem 0xff980000
[    5.365401]  sda:
[    5.372096] ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00
[    5.372453] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    5.372473] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    5.372493] usb usb2: Product: EHCI Host Controller
[    5.372510] usb usb2: Manufacturer: Linux 2.6.31.1-xenomai-i2.4-06 ehci_hcd
[    5.372529] usb usb2: SerialNumber: 0000:00:1d.7
[    5.373211] usb usb2: configuration #1 chosen from 1 choice
[    5.373785] hub 2-0:1.0: USB hub found
[    5.373844] hub 2-0:1.0: 6 ports detected
[    5.374890] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    5.375315] uhci_hcd: USB Universal Host Controller Interface driver
[    5.376104] uhci_hcd 0000:00:1a.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
[    5.376172] uhci_hcd 0000:00:1a.0: UHCI Host Controller
[    5.376843] uhci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 3
[    5.376887] uhci_hcd 0000:00:1a.0: detected 2 ports
[    5.377066] uhci_hcd 0000:00:1a.0: irq 16, io base 0x0000ff20
[    5.377446] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001
[    5.377466] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    5.377486] usb usb3: Product: UHCI Host Controller
[    5.377503] usb usb3: Manufacturer: Linux 2.6.31.1-xenomai-i2.4-06 uhci_hcd
[    5.377522] usb usb3: SerialNumber: 0000:00:1a.0
[    5.378182] usb usb3: configuration #1 chosen from 1 choice
[    5.378769] hub 3-0:1.0: USB hub found
[    5.378828] hub 3-0:1.0: 2 ports detected
[    5.379407] uhci_hcd 0000:00:1a.1: PCI INT B -> GSI 17 (level, low) -> IRQ 17
[    5.379469] uhci_hcd 0000:00:1a.1: UHCI Host Controller
[    5.380070] uhci_hcd 0000:00:1a.1: new USB bus registered, assigned bus number 4
[    5.380102] uhci_hcd 0000:00:1a.1: detected 2 ports
[    5.380285] uhci_hcd 0000:00:1a.1: irq 17, io base 0x0000ff00
[    5.380672] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001
[    5.380691] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    5.380712] usb usb4: Product: UHCI Host Controller
[    5.380728] usb usb4: Manufacturer: Linux 2.6.31.1-xenomai-i2.4-06 uhci_hcd
[    5.380748] usb usb4: SerialNumber: 0000:00:1a.1
[    5.381428] usb usb4: configuration #1 chosen from 1 choice
[    5.381997] hub 4-0:1.0: USB hub found
[    5.382056] hub 4-0:1.0: 2 ports detected
[    5.382648] uhci_hcd 0000:00:1a.2: PCI INT C -> GSI 22 (level, low) -> IRQ 22
[    5.382710] uhci_hcd 0000:00:1a.2: UHCI Host Controller
[    5.383271] uhci_hcd 0000:00:1a.2: new USB bus registered, assigned bus number 5
[    5.383303] uhci_hcd 0000:00:1a.2: detected 2 ports
[    5.383422] uhci_hcd 0000:00:1a.2: irq 22, io base 0x0000fc00
[    5.383797] usb usb5: New USB device found, idVendor=1d6b, idProduct=0001
[    5.383817] usb usb5: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    5.383837] usb usb5: Product: UHCI Host Controller
[    5.383853] usb usb5: Manufacturer: Linux 2.6.31.1-xenomai-i2.4-06 uhci_hcd
[    5.383873] usb usb5: SerialNumber: 0000:00:1a.2
[    5.384602] usb usb5: configuration #1 chosen from 1 choice
[    5.385186] hub 5-0:1.0: USB hub found
[    5.385244] hub 5-0:1.0: 2 ports detected
[    5.385843] uhci_hcd 0000:00:1d.0: PCI INT A -> GSI 23 (level, low) -> IRQ 23
[    5.385907] uhci_hcd 0000:00:1d.0: UHCI Host Controller
[    5.386478] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 6
[    5.386509] uhci_hcd 0000:00:1d.0: detected 2 ports
[    5.386627] uhci_hcd 0000:00:1d.0: irq 23, io base 0x0000ff80
[    5.387014] usb usb6: New USB device found, idVendor=1d6b, idProduct=0001
[    5.387034] usb usb6: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    5.387054] usb usb6: Product: UHCI Host Controller
[    5.387070] usb usb6: Manufacturer: Linux 2.6.31.1-xenomai-i2.4-06 uhci_hcd
[    5.387090] usb usb6: SerialNumber: 0000:00:1d.0
[    5.387791] usb usb6: configuration #1 chosen from 1 choice
[    5.388412] hub 6-0:1.0: USB hub found
[    5.388471] hub 6-0:1.0: 2 ports detected
[    5.389069] uhci_hcd 0000:00:1d.1: PCI INT B -> GSI 17 (level, low) -> IRQ 17
[    5.389132] uhci_hcd 0000:00:1d.1: UHCI Host Controller
[    5.389694] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 7
[    5.389725] uhci_hcd 0000:00:1d.1: detected 2 ports
[    5.389843] uhci_hcd 0000:00:1d.1: irq 17, io base 0x0000ff60
[    5.390250] usb usb7: New USB device found, idVendor=1d6b, idProduct=0001
[    5.390270] usb usb7: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    5.390290] usb usb7: Product: UHCI Host Controller
[    5.390306] usb usb7: Manufacturer: Linux 2.6.31.1-xenomai-i2.4-06 uhci_hcd
[    5.390326] usb usb7: SerialNumber: 0000:00:1d.1
[    5.391022] usb usb7: configuration #1 chosen from 1 choice
[    5.391590] hub 7-0:1.0: USB hub found
[    5.391649] hub 7-0:1.0: 2 ports detected
[    5.392279] uhci_hcd 0000:00:1d.2: PCI INT C -> GSI 18 (level, low) -> IRQ 18
[    5.392344] uhci_hcd 0000:00:1d.2: UHCI Host Controller
[    5.392919] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 8
[    5.392951] uhci_hcd 0000:00:1d.2: detected 2 ports
[    5.393140] uhci_hcd 0000:00:1d.2: irq 18, io base 0x0000ff40
[    5.393526] usb usb8: New USB device found, idVendor=1d6b, idProduct=0001
[    5.393546] usb usb8: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    5.393566] usb usb8: Product: UHCI Host Controller
[    5.393582] usb usb8: Manufacturer: Linux 2.6.31.1-xenomai-i2.4-06 uhci_hcd
[    5.393602] usb usb8: SerialNumber: 0000:00:1d.2
[    5.394263] usb usb8: configuration #1 chosen from 1 choice
[    5.394859] hub 8-0:1.0: USB hub found
[    5.394929] hub 8-0:1.0: 2 ports detected
[    5.396657] usbcore: registered new interface driver usblp
[    5.396681] Initializing USB Mass Storage driver...
[    5.397771] usbcore: registered new interface driver usb-storage
[    5.397796] USB Mass Storage support registered.
[    5.398887] usbcore: registered new interface driver libusual
[    5.400383] PNP: No PS/2 controller found. Probing ports directly.
[    5.403615] serio: i8042 KBD port at 0x60,0x64 irq 1
[    5.403653] serio: i8042 AUX port at 0x60,0x64 irq 12
[    5.404419] mice: PS/2 mouse device common for all mice
[    5.456701] rtc_cmos 00:05: RTC can wake from S4
[    5.457301] rtc_cmos 00:05: rtc core: registered rtc_cmos as rtc0
[    5.457385] rtc0: alarms up to one day, 242 bytes nvram, hpet irqs
[    5.457830] i801_smbus 0000:00:1f.3: PCI INT C -> GSI 18 (level, low) -> IRQ 18
[    5.458715] cpuidle: using governor ladder
[    5.458732] cpuidle: using governor menu
[    5.469263] usbcore: registered new interface driver hiddev
[    5.469666] usbcore: registered new interface driver usbhid
[    5.469691] usbhid: v2.6:USB HID core driver
[    5.469787] Netfilter messages via NETLINK v0.30.
[    5.469867] nf_conntrack version 0.5.0 (16384 buckets, 65536 max)
[    5.471178] ctnetlink v0.93: registering with nfnetlink.
[    5.471576] ip_tables: (C) 2000-2006 Netfilter Core Team
[    5.471767] TCP cubic registered
[    5.471780] Initializing XFRM netlink socket
[    5.474093] NET: Registered protocol family 10
[    5.475349] ip6_tables: (C) 2000-2006 Netfilter Core Team
[    5.475489] IPv6 over IPv4 tunneling driver
[    5.476787] NET: Registered protocol family 17
[    5.478035] RPC: Registered udp transport module.
[    5.478051] RPC: Registered tcp transport module.
[    5.904119] usb 5-1: new full speed USB device using uhci_hcd and address 2
[    6.041016]  sda1 sda2 sda3 sda4 <sr0: scsi3-mmc drive: 48x/48x writer dvd-ram cd/rw xa/form2 cdda tray
[    6.056044] Uniform CD-ROM driver Revision: 3.20
[    6.060486]  sda5
[    6.069209] sr 1:0:0:0: Attached scsi generic sg1 type 5
[    6.079079]  sda6 >
[    6.086051] sd 0:0:0:0: [sda] Attached SCSI disk
[    6.143419] kjournald starting.  Commit interval 5 seconds
[    6.143473] EXT3-fs: mounted filesystem with writeback data mode.
[    6.143533] VFS: Mounted root (ext3 filesystem) readonly on device 8:3.
[    6.145009] Freeing unused kernel memory: 5556k freed
[    6.238701] usb 5-1: New USB device found, idVendor=413c, idProduct=2101
[    6.245531] usb 5-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    6.252713] usb 5-1: Product: Dell Smart Card Reader Keyboard
[    6.258502] usb 5-1: Manufacturer: Dell
[    6.263114] usb 5-1: configuration #1 chosen from 1 choice
[    6.278839] input: Dell Dell Smart Card Reader Keyboard as /devices/pci0000:00/0000:00:1a.2/usb5/5-1/5-1:1.0/input/input0
[    6.290751] generic-usb 0003:413C:2101.0001: input,hidraw0: USB HID v1.11 Keyboard [Dell Dell Smart Card Reader Keyboard] on usb-0000:00:1a.2-1/input0
\rINIT: version 2.86 booting
[    6.544154] usb 5-2: new low speed USB device using uhci_hcd and address 3
[    6.720726] usb 5-2: New USB device found, idVendor=0461, idProduct=4d51
[    6.727475] usb 5-2: New USB device strings: Mfr=0, Product=2, SerialNumber=0
[    6.734736] usb 5-2: Product: DELL Laser Mouse
[    6.739916] usb 5-2: configuration #1 chosen from 1 choice
[    6.763631] input: DELL Laser Mouse as /devices/pci0000:00/0000:00:1a.2/usb5/5-2/5-2:1.0/input/input1
[    6.774291] generic-usb 0003:0461:4D51.0002: input,hidraw1: USB HID v1.11 Mouse [DELL Laser Mouse] on usb-0000:00:1a.2-2/input0
[  128.718661] ------------[ cut here ]------------
[  128.722564] kernel BUG at kernel/ipipe/core.c:331!
[  128.724511] invalid opcode: 0000 [#1] SMP 
[  128.728508] last sysfs file: /sys/devices/pci0000:00/0000:00:1e.0/0000:03:02.0/resource
[  128.737512] CPU 0 
[  128.740511] Modules linked in: 8139too
[  128.744509] Pid: 6309, comm: trivial Not tainted 2.6.31.1-xenomai-i2.4-06 #7 OptiPlex 960                 
[  128.752508] RIP: 0010:[<ffffffff810800fc>]  [<ffffffff810800fc>] __ipipe_restore_root+0x87/0xb8
[  128.752508] RSP: 0018:ffff88002be07d48  EFLAGS: 00010006
[  128.768508] RAX: ffff88002be00000 RBX: 0000000000000092 RCX: 00000000000072d8
[  128.768508] RDX: ffff88002be00000 RSI: 0000001ba42ceda3 RDI: 0000000000000001
[  128.768508] RBP: ffff88002be07d68 R08: ffffffffffdc2a91 R09: 0000000000000073
[  128.768508] R10: ffff88002be07ec8 R11: 0000000000000003 R12: ffffffff81c9ddc0
[  128.768508] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000200
[  128.800508] FS:  00007f430b533950(0000) GS:ffff88002be00000(0000) knlGS:0000000000000000
[  128.800508] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[  128.800508] CR2: 00007f430b11c2e0 CR3: 0000000123907000 CR4: 00000000000406f0
[  128.800508] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  128.800508] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[  128.800508] Process trivial (pid: 6309, threadinfo ffff8801241f0000, task ffff880126ae0650)
[  128.800508] Stack:
[  128.800508]  0000000000000000 0000001ba42d607b 0000000000000000 ffff88002be07db8
[  128.800508] <0> ffff88002be07d88 ffffffff81056f39 ffffffff81c677b3 000000000000007b
[  128.864509] <0> ffff88002be07e28 ffffffff8103d52a ffff88002be07e38 0000000000000006
[  128.864509] Call Trace:
[  128.864509]  <NMI> 
[  128.864509]  [<ffffffff81056f39>] cpu_clock+0x5a/0x62
[  128.864509]  [<ffffffff8103d52a>] vprintk+0x233/0x354
[  128.864509]  [<ffffffff81082643>] ? ipipe_trace_panic_freeze+0x9/0x73
[  128.864509]  [<ffffffff8143d5ac>] printk+0x1e7/0x28a
[  128.864509]  [<ffffffff810824ae>] ? ipipe_trace_function+0x1c/0x1e
[  128.864509]  [<ffffffff8107e10d>] ipipe_check_context+0x1dc/0x203
[  128.864509]  [<ffffffff8144037a>] do_nmi+0x44/0x2ac
[  128.864509]  [<ffffffff8143ff2a>] nmi+0x1a/0x20
[  128.864509]  [<ffffffff8135c2f4>] ? rthal_nmi_arm+0xe1/0x176
[  128.924507]  <<EOE>> 
[  128.924507]  [<ffffffff810a45bc>] xntimer_next_local_shot+0x11b/0x120
[  128.924507]  [<ffffffff810a48d1>] xntimer_start_aperiodic+0x12a/0x13e
[  128.924507]  [<ffffffff8109e784>] xntimer_start+0xe/0x10
[  128.924507]  [<ffffffff8109f8fd>] xnpod_suspend_thread+0xe4/0x1af
[  128.924507]  [<ffffffff810acd98>] rt_task_sleep+0x63/0x7e
[  128.924507]  [<ffffffff810afe07>] __rt_task_sleep+0x33/0x35
[  128.924507]  [<ffffffff810a9297>] losyscall_event+0xc9/0x1a8
[  128.924507]  [<ffffffff810a91ce>] ? losyscall_event+0x0/0x1a8
[  128.924507]  [<ffffffff810a91ce>] ? losyscall_event+0x0/0x1a8
[  128.985008]  [<ffffffff8107efd9>] __ipipe_dispatch_event+0x1b6/0x4cb
[  128.988512]  [<ffffffff81021768>] __ipipe_syscall_root+0x4f/0x180
[  128.996512]  [<ffffffff8143f52d>] __ipipe_syscall_root_thunk+0x35/0x6a
[  128.996512]  [<ffffffff8100b1c4>] ? system_call_after_swapgs+0x54/0x79
[  128.996512] Code: 01 00 00 00 65 48 8b 04 25 a0 cb 00 00 4d 85 f6 4e 8b 24 20 74 0a bf 01 00 00 80 e8 21 25 00 00 53 9d 49 81 fc c0 1f c7 81 74 04 <0f> 0b eb fe 4d 85 ed 74 1a 9c fa 65 48 8b 04 25 a0 cb 00 00 48 
[  129.012510] RIP  [<ffffffff810800fc>] __ipipe_restore_root+0x87/0xb8
[  129.012510]  RSP <ffff88002be07d48>
[  129.012510] I-pipe tracer log (1000 points):
[  129.012510]  |  # func                    0 ipipe_trace_panic_freeze+0x9 (ipipe_check_context+0x165)
[  129.044509]  |  # func                    0 cpumask_next+0x4 (ipipe_check_context+0x158)
[  129.044509]  |  # func                    0 cpumask_next+0x4 (ipipe_check_context+0x158)
[  129.044509]  |  # func                    0 cpumask_next+0x4 (ipipe_check_context+0x158)
[  129.044509]  |  # func                    0 cpumask_next+0x4 (ipipe_check_context+0x158)
[  129.044509]  |  # func                    0 cpumask_next+0x4 (ipipe_check_context+0x158)
[  129.044509]  |  # func                   -1 ipipe_check_context+0x11 (do_nmi+0x44)
[  129.044509]  |  # func                   -1 ipipe_test_foreign_stack+0xd (do_nmi+0x19)
[  129.108510]  |  # func                   -2 rthal_nmi_arm+0x11 (xntimer_next_local_shot+0x11b)
[  129.108510]  |  # func                   -3 __ipipe_set_irq_pending+0x11 (xntimer_next_local_shot+0xf9)
[  129.108510]  |  # event   tick@312025    -3 xntimer_next_local_shot+0xab (xntimer_start_aperiodic+0x12a)
[  129.108510]  |  # func                   -3 xntimer_next_local_shot+0x7 (xntimer_start_aperiodic+0x12a)
[  129.108510]  |  # func                   -3 xntimer_enqueue_aperiodic+0x4 (xntimer_start_aperiodic+0xc6)
[  129.108510]  |  # func                   -4 xnarch_ns_to_tsc+0x4 (xntimer_start_aperiodic+0x6f)
[  129.108510]  |  # func                   -4 xntimer_start_aperiodic+0xb (xntimer_start+0xe)
[  129.108510]  |  # func                   -5 xntimer_start+0x4 (xnpod_suspend_thread+0xe4)
[  129.108510]  |  # func                   -5 T.537+0x7 (xntimer_migrate+0x82)
[  129.108510]  |  # func                   -5 T.538+0x9 (xntimer_migrate+0x21)
[  129.108510]  |  # func                   -5 xntimer_migrate+0x11 (xnpod_suspend_thread+0xd3)
[  129.108510]  |  + begin   0x80000000     -5 ipipe_test_and_stall_pipeline_head+0x20 (T.625+0xe)
[  129.108510]     + func                   -6 ipipe_test_and_stall_pipeline_head+0x9 (T.625+0xe)
[  129.108510]     + func                   -6 T.625+0x4 (xnpod_suspend_thread+0x2b)
[  129.108510]     + func                   -6 xnpod_suspend_thread+0x11 (rt_task_sleep+0x63)
[  129.236508]     + func                   -6 rt_task_sleep+0x9 (__rt_task_sleep+0x33)
[  129.236508]     + func                   -6 __xn_safe_copy_from_user+0x9 (__rt_task_sleep+0x1f)
[  129.236508]     + func                   -7 __rt_task_sleep+0x8 (losyscall_event+0xc9)
[  129.236508]  |  + end     0x80000000     -7 __ipipe_restore_pipeline_head+0xfa (ipipe_restore_pipeline_head+0x66)
[  129.236508]  |  # func                   -7 __ipipe_restore_pipeline_head+0x7 (ipipe_restore_pipeline_head+0x66)
[  129.236508]  |  # func                   -7 ipipe_restore_pipeline_head+0x7 (xnlock_put_irqrestore+0x23)
[  129.236508]  |  # func                   -7 xnlock_put_irqrestore+0x4 (xnshadow_harden+0x1a4)
[  129.236508]  |  # func                   -8 xnarch_save_fpu+0x4 (__xnpod_switch_fpu+0x44)
[  129.236508]  |  # func                   -8 __xnpod_switch_fpu+0x7 (xnpod_switch_fpu+0xe)
[  129.236508]  |  # func                   -8 xnpod_switch_fpu+0x4 (xnshadow_harden+0x187)
[  129.324507]  |  # func                   -8 __unlazy_fpu+0x4 (__switch_to+0x17e)
[  129.324507]  |  # func                   -8 __switch_to+0xb (thread_return+0x0)
[  129.324507]  |  # func                   -9 xnsched_pick_next+0x4 (__xnpod_schedule+0x129)
[  129.324507]  |  # func                   -9 T.623+0x4 (__xnpod_schedule+0xf0)
[  129.324507]  |  # [  350] gatekee -1     -9 __xnpod_schedule+0xd2 (xnpod_schedule+0x32)
[  129.324507]  |  # func                   -9 ipipe_test_and_stall_pipeline_head+0x9 (T.625+0xe)
[  129.324507]  |  # func                   -9 T.625+0x4 (__xnpod_schedule+0xaa)
[  129.324507]  |  # func                  -10 __xnpod_schedule+0x11 (xnpod_schedule+0x32)
[  129.324507]  |  # func                  -10 xnpod_schedule+0x4 (xnpod_schedule_handler+0x59)
[  129.324507]  |  # func                  -10 xnpod_schedule_handler+0x7 (__ipipe_dispatch_wired_nocheck+0x127)
[  129.324507]  |   +func                  -10 __ipipe_dispatch_wired_nocheck+0x11 (__ipipe_dispatch_wired+0xc3)
[  129.324507]  |   +func                  -10 __ipipe_dispatch_wired+0xd (__ipipe_handle_irq+0x128)
[  129.324507]  |   +func                  -11 __ipipe_handle_irq+0x11 (ipipe_trigger_irq+0x71)
[  129.324507]  |   +begin   0x80000001    -11 ipipe_trigger_irq+0x52 (__xnpod_schedule+0xa0)
[  129.324507]      +func                  -11 ipipe_trigger_irq+0x10 (__xnpod_schedule+0xa0)
[  129.324507]  |   +end     0x80000001    -11 __xnpod_schedule+0x8a (xnpod_schedule+0x32)
[  129.324507]  |   +begin   0x80000001    -11 __xnpod_schedule+0x3a (xnpod_schedule+0x32)
[  129.324507]      +func                  -12 __xnpod_schedule+0x11 (xnpod_schedule+0x32)
[  129.324507]      +func                  -12 xnpod_schedule+0x4 (gatekeeper_thread+0x179)
[  129.324507]  |   +end     0x80000000    -12 __ipipe_restore_pipeline_head+0xfa (ipipe_restore_pipeline_head+0x66)
[  129.492509]  |  *+func                  -12 __ipipe_restore_pipeline_head+0x7 (ipipe_restore_pipeline_head+0x66)
[  129.492509]  |  *+func                  -12 ipipe_restore_pipeline_head+0x7 (xnlock_put_irqrestore+0x23)
[  129.492509]  |  *+func                  -12 xnlock_put_irqrestore+0x4 (gatekeeper_thread+0x174)
[  129.492509]  |  *+func                  -13 ipipe_restore_pipeline_head+0x7 (T.622+0x24)
[  129.492509]  |  *+func                  -13 T.622+0x4 (xnpod_resume_thread+0x253)
[  129.492509]  |  *+[ 6309] trivial 99    -13 xnpod_resume_thread+0x44 (gatekeeper_thread+0x165)
[  129.492509]  |  *+func                  -13 ipipe_test_and_stall_pipeline_head+0x9 (T.625+0xe)
[  129.492509]  |  *+func                  -13 T.625+0x4 (xnpod_resume_thread+0x21)
[  129.492509]  |  *+func                  -14 xnpod_resume_thread+0x11 (gatekeeper_thread+0x165)
[  129.492509]  |  *+func                  -14 __xnlock_get+0x4 (__xnlock_get_irqsave+0x23)
[  129.492509]  |   +begin   0x80000000    -14 ipipe_test_and_stall_pipeline_head+0x20 (__xnlock_get_irqsave+0x17)
[  129.492509]      +func                  -14 ipipe_test_and_stall_pipeline_head+0x9 (__xnlock_get_irqsave+0x17)
[  129.492509]      +func                  -14 __xnlock_get_irqsave+0x9 (gatekeeper_thread+0x141)
[  129.492509]  |   +end     0x80000000    -14 __ipipe_restore_pipeline_head+0xfa (T.513+0x7b)
[  129.492509]  |  *+func                  -15 __ipipe_restore_pipeline_head+0x7 (T.513+0x7b)
[  129.492509]  |  *+func                  -15 T.513+0x7 (xnsched_renice_root+0x5c)
[  129.492509]  |  *+[  350] gatekee -1    -15 xnsched_renice_root+0x54 (rpi_pop+0xe9)
[  129.492509]  |  *+func                  -15 xnsched_track_policy+0x4 (xnsched_renice_root+0x3b)
[  129.492509]  |   +begin   0x80000000    -15 T.515+0x20 (xnsched_renice_root+0x25)
[  129.492509]      +func                  -16 T.515+0x9 (xnsched_renice_root+0x25)
[  129.492509]      +func                  -16 xnsched_renice_root+0xd (rpi_pop+0xe9)
[  129.492509]  |   +end     0x80000000    -16 __ipipe_restore_pipeline_head+0xfa (ipipe_restore_pipeline_head+0x66)
[  129.492509]  |  *+func                  -16 __ipipe_restore_pipeline_head+0x7 (ipipe_restore_pipeline_head+0x66)
[  129.492509]  |  *+func                  -16 ipipe_restore_pipeline_head+0x7 (xnlock_put_irqrestore+0x23)
[  129.492509]  |  *+func                  -16 xnlock_put_irqrestore+0x4 (rpi_pop+0xc7)
[  129.492509]  |  *+func                  -17 xnsched_peek_rpi+0x4 (rpi_pop+0xa0)
[  129.492509]  |  *+func                  -17 __xnlock_get+0x4 (__xnlock_get_irqsave+0x23)
[  129.724508]  |   +begin   0x80000000    -17 ipipe_test_and_stall_pipeline_head+0x20 (__xnlock_get_irqsave+0x17)
[  129.724508]      +func                  -17 ipipe_test_and_stall_pipeline_head+0x9 (__xnlock_get_irqsave+0x17)
[  129.724508]      +func                  -17 __xnlock_get_irqsave+0x9 (rpi_pop+0x43)
[  129.724508]      +func                  -18 rpi_pop+0x11 (gatekeeper_thread+0x135)
[  129.724508]      +func                  -18 kthread_should_stop+0x4 (gatekeeper_thread+0x112)
[  129.724508]  |   +end     0x80000000    -18 __ipipe_unstall_root+0xd1 (raw_local_irq_enable+0xe)
[  129.724508]  |   #begin   0x80000000    -18 __ipipe_unstall_root+0x20 (raw_local_irq_enable+0xe)
[  129.724508]      #func                  -18 __ipipe_unstall_root+0x9 (raw_local_irq_enable+0xe)
[  129.724508]      #func                  -18 raw_local_irq_enable+0x4 (finish_task_switch+0x6a)
[  129.724508]      #func                  -19 perf_counter_task_sched_in+0x7 (finish_task_switch+0x63)
[  129.724508]      #func                  -19 needs_post_schedule_rt+0x4 (finish_task_switch+0x3d)
[  129.724508]      #func                  -19 finish_task_switch+0x11 (thread_return+0x18b)
[  129.724508]  |   #end     0x80000000    -19 thread_return+0xe4 (gatekeeper_thread+0x10d)
[  129.724508]  |   #func                  -19 __unlazy_fpu+0x4 (__switch_to+0x17e)
[  129.724508]  |   #func                  -20 __switch_to+0xb (thread_return+0x0)
[  129.724508]  |   #begin   0x80000000    -20 schedule+0x5d3 (xnshadow_harden+0xd7)
[  129.724508]  |   #end     0x80000001    -20 __ipipe_dispatch_event+0x4b0 (schedule+0x5c1)
[  129.724508]  |   #begin   0x80000001    -20 __ipipe_dispatch_event+0x1da (schedule+0x5c1)
[  129.724508]  |   #end     0x80000000    -20 __ipipe_restore_pipeline_head+0xfa (ipipe_restore_pipeline_head+0x66)
[  129.724508]  |  *#func                  -21 __ipipe_restore_pipeline_head+0x7 (ipipe_restore_pipeline_head+0x66)
[  129.892508]  |  *#func                  -21 ipipe_restore_pipeline_head+0x7 (xnlock_put_irqrestore+0x23)
[  129.892508]  |  *#func                  -21 xnlock_put_irqrestore+0x4 (schedule_event+0x2d3)
[  129.892508]  |  *#func                  -21 xnsched_peek_rpi+0x4 (schedule_event+0x1d8)
[  129.892508]  |  *#func                  -21 __xnlock_get+0x4 (__xnlock_get_irqsave+0x23)
[  129.892508]  |   #begin   0x80000000    -22 ipipe_test_and_stall_pipeline_head+0x20 (__xnlock_get_irqsave+0x17)
[  129.892508]      #func                  -22 ipipe_test_and_stall_pipeline_head+0x9 (__xnlock_get_irqsave+0x17)
[  129.892508]      #func                  -22 __xnlock_get_irqsave+0x9 (schedule_event+0x1cc)
[  129.892508]      #func                  -22 schedule_event+0x11 (__ipipe_dispatch_event+0x1b6)
[  129.892508]  |   #end     0x80000001    -22 __ipipe_dispatch_event+0x1a4 (schedule+0x5c1)
[  129.892508]  |   #begin   0x80000001    -22 __ipipe_dispatch_event+0x34 (schedule+0x5c1)
[  129.892508]      #func                  -23 __ipipe_dispatch_event+0x11 (schedule+0x5c1)
[  129.892508]      #func                  -23 __ipipe_event_monitored_p+0xb (schedule+0x5af)
[  129.892508]      #func                  -23 perf_counter_task_sched_out+0x11 (schedule+0x57c)
[  129.892508]      #func                  -23 dequeue_pushable_task+0x4 (pick_next_task_rt+0x7a)
[  129.892508]      #func                  -23 pick_next_task_rt+0x9 (schedule+0x54f)
[  129.892508]      #func                  -24 balance_runtime+0x11 (update_curr_rt+0x114)
[  129.892508]      #func                  -24 _spin_lock+0x4 (update_curr_rt+0xe8)
[  129.892508]      #func                  -24 account_group_exec_runtime+0x7 (update_curr_rt+0x51)
[  129.892508]      #func                  -24 update_curr_rt+0xb (put_prev_task_rt+0x1a)
[  129.892508]      #func                  -24 put_prev_task_rt+0x9 (schedule+0x51e)
[  129.892508]      #func                  -24 pre_schedule_rt+0x4 (schedule+0x15a)
[  129.892508]      #func                  -25 dequeue_pushable_task+0x4 (dequeue_task_rt+0x59)
[  129.892508]      #func                  -25 update_rt_migration+0x4 (__dequeue_rt_entity+0x16b)
[  129.892508]      #func                  -25 pick_next_highest_task_rt+0xd (next_prio+0x14)
[  129.892508]      #func                  -25 next_prio+0x4 (__dequeue_rt_entity+0x119)
[  129.892508]      #func                  -25 __dequeue_rt_entity+0xb (dequeue_task_rt+0x45)
[  129.892508]      #func                  -25 balance_runtime+0x11 (update_curr_rt+0x114)
[  130.124508]      #func                  -26 _spin_lock+0x4 (update_curr_rt+0xe8)
[  130.124508]      #func                  -26 account_group_exec_runtime+0x7 (update_curr_rt+0x51)
[  130.124508]      #func                  -26 update_curr_rt+0xb (dequeue_task_rt+0x25)
[  130.124508]      #func                  -26 dequeue_task_rt+0xb (dequeue_task+0x78)
[  130.124508]      #func                  -26 dequeue_task+0x9 (deactivate_task+0x2d)
[  130.124508]      #func                  -26 deactivate_task+0x9 (schedule+0x136)
[  130.124508]      #func                  -27 signal_pending_state+0x4 (schedule+0x114)
[  130.124508]      #func                  -27 update_rq_clock+0x9 (schedule+0xe2)
[  130.124508]  |   +end     0x80000001    -27 ipipe_check_context+0xdb (raw_local_irq_disable+0x15)
[  130.124508]  |   +begin   0x80000001    -27 ipipe_check_context+0x32 (raw_local_irq_disable+0x15)
[  130.124508]      +func                  -27 ipipe_check_context+0x11 (raw_local_irq_disable+0x15)
[  130.124508]      +func                  -28 raw_local_irq_disable+0x4 (_spin_lock_irq+0x16)
[  130.124508]      +func                  -28 _spin_lock_irq+0x9 (schedule+0xda)
[  130.124508]  |   +end     0x80000001    -28 ipipe_check_context+0xdb (schedule+0xa8)
[  130.124508]  |   +begin   0x80000001    -28 ipipe_check_context+0x32 (schedule+0xa8)
[  130.124508]      +func                  -28 ipipe_check_context+0x11 (schedule+0xa8)
[  130.124508]      +func                  -29 rcu_qsctr_inc+0x4 (schedule+0x63)
[  130.124508]      +func                  -29 schedule+0x14 (xnshadow_harden+0xd7)
[  130.124508]  |   +end     0x80000000    -29 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  130.124508]  |   #begin   0x80000000    -29 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  130.124508]      #func                  -29 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  130.292509]  |   #end     0x80000001    -29 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  130.292509]  |   #begin   0x80000001    -30 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  130.292509]      #func                  -30 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  130.292509]      #func                  -30 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  130.292509]      #func                  -30 _spin_unlock_irqrestore+0x4 (__wake_up_sync_key+0x4e)
[  130.292509]  |   #end     0x80000001    -30 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  130.292509]  |   #begin   0x80000001    -31 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  130.292509]      #func                  -31 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  130.292509]      #func                  -31 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  130.292509]      #func                  -31 _spin_unlock_irqrestore+0x4 (task_rq_unlock+0x11)
[  130.292509]      #func                  -31 task_rq_unlock+0x4 (try_to_wake_up+0x1f6)
[  130.292509]      #func                  -31 task_wake_up_rt+0x9 (try_to_wake_up+0x1e5)
[  130.292509]      #func                  -32 check_preempt_curr_rt+0x7 (check_preempt_curr+0x17)
[  130.292509]      #func                  -32 check_preempt_curr+0x4 (try_to_wake_up+0x1c9)
[  130.292509]      #func                  -32 update_rt_migration+0x4 (enqueue_task_rt+0x15c)
[  130.292509]      #func                  -32 enqueue_task_rt+0x11 (enqueue_task+0x2d)
[  130.292509]      #func                  -32 enqueue_task+0x9 (activate_task+0x2d)
[  130.292509]      #func                  -33 activate_task+0x9 (try_to_wake_up+0x120)
[  130.292509]      #func                  -33 select_task_rq_rt+0x9 (try_to_wake_up+0xcc)
[  130.292509]      #func                  -33 update_rq_clock+0x9 (try_to_wake_up+0x8c)
[  130.292509]      #func                  -33 _spin_lock+0x4 (task_rq_lock+0x6c)
[  130.292509]  |   #end     0x80000001    -33 ipipe_check_context+0xdb (task_rq_lock+0x29)
[  130.292509]  |   #begin   0x80000001    -34 ipipe_check_context+0x32 (task_rq_lock+0x29)
[  130.292509]      #func                  -34 ipipe_check_context+0x11 (task_rq_lock+0x29)
[  130.292509]      #func                  -34 task_rq_lock+0xb (try_to_wake_up+0x81)
[  130.292509]      #func                  -34 try_to_wake_up+0x11 (default_wake_function+0x12)
[  130.292509]      #func                  -34 default_wake_function+0x4 (__wake_up_common+0x4e)
[  130.524509]      #func                  -34 __wake_up_common+0x11 (__wake_up_sync_key+0x43)
[  130.524509]  |   +end     0x80000001    -35 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  130.524509]  |   +begin   0x80000001    -35 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  130.524509]      +func                  -35 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  130.524509]      +func                  -35 _spin_lock_irqsave+0x9 (__wake_up_sync_key+0x27)
[  130.524509]      +func                  -35 __wake_up_sync_key+0xb (__wake_up_sync+0x10)
[  130.524509]      +func                  -35 __wake_up_sync+0x4 (xnshadow_harden+0xd2)
[  130.524509]  |   +end     0x80000000    -36 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  130.524509]  |   #begin   0x80000000    -36 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  130.524509]      #func                  -36 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  130.524509]  |   #end     0x80000001    -36 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  130.524509]  |   #begin   0x80000001    -36 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  130.524509]      #func                  -37 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  130.524509]      #func                  -37 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  130.524509]      #func                  -37 _spin_unlock_irqrestore+0x4 (down_interruptible+0x41)
[  130.524509]  |   +end     0x80000001    -37 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  130.524509]  |   +begin   0x80000001    -37 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  130.524509]      +func                  -37 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  130.524509]      +func                  -38 _spin_lock_irqsave+0x9 (down_interruptible+0x18)
[  130.692509]      +func                  -38 down_interruptible+0xb (xnshadow_harden+0x70)
[  130.692509]      +func                  -38 xnshadow_harden+0x11 (losyscall_event+0xa2)
[  130.692509]      +func                  -38 losyscall_event+0x11 (__ipipe_dispatch_event+0x1b6)
[  130.692509]  |   +end     0x80000001    -38 __ipipe_dispatch_event+0x1a4 (__ipipe_syscall_root+0x4f)
[  130.692509]  |  + begin   0x80000001    -39 __ipipe_dispatch_event+0x1da (__ipipe_syscall_root+0x4f)
[  130.692509]     + func                  -39 hisyscall_event+0x11 (__ipipe_dispatch_event+0x1b6)
[  130.692509]  |  + end     0x80000001    -39 __ipipe_dispatch_event+0x1a4 (__ipipe_syscall_root+0x4f)
[  130.692509]  |   +begin   0x80000001    -39 __ipipe_dispatch_event+0x34 (__ipipe_syscall_root+0x4f)
[  130.692509]      +func                  -40 __ipipe_dispatch_event+0x11 (__ipipe_syscall_root+0x4f)
[  130.692509]      +func                  -40 __ipipe_event_monitored_p+0xb (__ipipe_syscall_root+0x3a)
[  130.692509]      +func                  -40 __ipipe_syscall_root+0xb (__ipipe_syscall_root_thunk+0x35)
[  130.692509]      +func                  -41 fput+0x4 (fput_light+0x12)
[  130.692509]      +func                  -41 fput_light+0x4 (sys_write+0x61)
[  130.692509]      +func                  -41 fsnotify+0x11 (fsnotify_modify+0x6c)
[  130.692509]      +func                  -41 inotify_dentry_parent_queue_event+0xb (fsnotify_parent+0x28)
[  130.692509]      +func                  -42 __fsnotify_parent+0xf (fsnotify_parent+0x17)
[  130.692509]      +func                  -42 fsnotify_parent+0x7 (fsnotify_modify+0x54)
[  130.692509]      +func                  -42 inotify_inode_queue_event+0x11 (fsnotify_modify+0x4a)
[  130.692509]      +func                  -42 fsnotify_modify+0xd (vfs_write+0xcf)
[  130.692509]  |   +end     0x80000000    -42 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  130.692509]  |   #begin   0x80000000    -43 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  130.692509]      #func                  -43 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  130.692509]  |   #end     0x80000001    -43 __ipipe_restore_root+0x7c (put_ldisc+0xca)
[  130.692509]  |   #begin   0x80000001    -43 __ipipe_restore_root+0x2c (put_ldisc+0xca)
[  130.692509]      #func                  -43 __ipipe_restore_root+0xb (put_ldisc+0xca)
[  130.692509]  |   +end     0x80000001    -44 ipipe_check_context+0xdb (put_ldisc+0x4d)
[  130.692509]  |   +begin   0x80000001    -44 ipipe_check_context+0x32 (put_ldisc+0x4d)
[  130.692509]      +func                  -44 ipipe_check_context+0x11 (put_ldisc+0x4d)
[  130.924506]      +func                  -44 put_ldisc+0x7 (tty_ldisc_deref+0xe)
[  130.924506]      +func                  -44 tty_ldisc_deref+0x4 (tty_write+0x20d)
[  130.924506]  |   +end     0x80000000    -44 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  130.924506]  |   #begin   0x80000000    -45 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  130.924506]      #func                  -45 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  130.924506]  |   #end     0x80000001    -45 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  130.924506]  |   #begin   0x80000001    -45 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  130.924506]      #func                  -45 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  130.924506]      #func                  -45 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  130.924506]      #func                  -46 _spin_unlock_irqrestore+0x4 (__wake_up+0x44)
[  130.924506]      #func                  -46 __wake_up_common+0x11 (__wake_up+0x39)
[  130.924506]  |   +end     0x80000001    -46 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  130.924506]  |   +begin   0x80000001    -46 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  130.924506]      +func                  -46 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  130.924506]      +func                  -47 _spin_lock_irqsave+0x9 (__wake_up+0x22)
[  130.924506]      +func                  -47 __wake_up+0xb (tty_write_unlock+0x38)
[  130.924506]      +func                  -47 mutex_unlock+0x4 (tty_write_unlock+0x1d)
[  130.924506]      +func                  -47 tty_write_unlock+0x9 (tty_write+0x1fd)
[  130.924506]      +func                  -47 timespec_trunc+0x8 (current_fs_time+0x27)
[  130.924506]      +func                  -47 current_kernel_time+0x8 (current_fs_time+0x16)
[  131.092509]      +func                  -48 current_fs_time+0x9 (tty_write+0x1de)
[  131.092509]  |   +end     0x80000000    -48 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  131.092509]  |   #begin   0x80000000    -48 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  131.092509]      #func                  -48 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  131.092509]  |   #end     0x80000001    -48 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  131.092509]  |   #begin   0x80000001    -48 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  131.092509]      #func                  -49 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  131.092509]      #func                  -49 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  131.092509]      #func                  -49 _spin_unlock_irqrestore+0x4 (remove_wait_queue+0x45)
[  131.092509]  |   +end     0x80000001    -49 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  131.092509]  |   +begin   0x80000001    -49 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  131.092509]      +func                  -50 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  131.092509]      +func                  -50 _spin_lock_irqsave+0x9 (remove_wait_queue+0x17)
[  131.092509]      +func                  -50 remove_wait_queue+0x7 (n_tty_write+0x303)
[  131.092509]  |   +end     0x80000000    -50 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  131.092509]  |   #begin   0x80000000    -50 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  131.092509]      #func                  -50 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  131.092509]  |   #end     0x80000001    -51 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  131.092509]  |   #begin   0x80000001    -51 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  131.092509]      #func                  -51 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  131.092509]      #func                  -51 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  131.092509]      #func                  -51 _spin_unlock_irqrestore+0x4 (release_console_sem+0x18f)
[  131.092509]  |   #end     0x80000001    -51 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  131.092509]  |   #begin   0x80000001    -52 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  131.092509]      #func                  -52 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  131.092509]      #func                  -52 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  131.324507]      #func                  -52 _spin_unlock_irqrestore+0x4 (up+0x39)
[  131.324507]  |   #end     0x80000001    -52 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  131.324507]  |   #begin   0x80000001    -53 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  131.324507]      #func                  -53 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  131.324507]      #func                  -53 _spin_lock_irqsave+0x9 (up+0x14)
[  131.324507]      #func                  -53 up+0x7 (release_console_sem+0x180)
[  131.324507]  |   +end     0x80000001    -53 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  131.324507]  |   +begin   0x80000001    -53 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  131.324507]      +func                  -54 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  131.324507]      +func                  -54 _spin_lock_irqsave+0x9 (release_console_sem+0x42)
[  131.324507]      +func                  -54 release_console_sem+0xb (con_flush_chars+0x43)
[  131.324507]      +func                  -54 vgacon_set_cursor_size+0x11 (vgacon_cursor+0x13c)
[  131.324507]  |   +end     0x80000000    -54 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  131.324507]  |   #begin   0x80000000    -55 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  131.324507]      #func                  -55 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  131.324507]  |   #end     0x80000001    -55 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  131.324507]  |   #begin   0x80000001    -55 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  131.324507]      #func                  -55 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  131.324507]      #func                  -55 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  131.324507]      #func                  -56 _spin_unlock_irqrestore+0x4 (write_vga+0x52)
[  131.492510]  |   +end     0x80000001    -56 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  131.492510]  |   +begin   0x80000001    -56 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  131.492510]      +func                  -57 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  131.492510]      +func                  -57 _spin_lock_irqsave+0x9 (write_vga+0x1d)
[  131.492510]      +func                  -57 write_vga+0x7 (vgacon_cursor+0x6e)
[  131.492510]      +func                  -57 vgacon_restore_screen+0x4 (vgacon_cursor+0x21)
[  131.492510]      +func                  -57 vgacon_cursor+0x7 (set_cursor+0x63)
[  131.492510]      +func                  -58 add_softcursor+0x4 (set_cursor+0x4a)
[  131.492510]      +func                  -58 set_cursor+0x9 (con_flush_chars+0x3e)
[  131.492510]  |   +end     0x80000000    -58 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  131.492510]  |   #begin   0x80000000    -58 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  131.492510]      #func                  -58 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  131.492510]  |   #end     0x80000001    -58 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  131.492510]  |   #begin   0x80000001    -59 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  131.492510]      #func                  -59 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  131.492510]      #func                  -59 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  131.492510]      #func                  -59 _spin_unlock_irqrestore+0x4 (down+0x38)
[  131.492510]  |   +end     0x80000001    -59 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  131.492510]  |   +begin   0x80000001    -60 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  131.492510]      +func                  -60 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  131.492510]      +func                  -60 _spin_lock_irqsave+0x9 (down+0x14)
[  131.492510]      +func                  -60 down+0x7 (acquire_console_sem+0x30)
[  131.492510]      +func                  -60 acquire_console_sem+0x4 (con_flush_chars+0x2d)
[  131.492510]      +func                  -60 con_flush_chars+0x9 (n_tty_write+0x285)
[  131.492510]      +func                  -61 mutex_unlock+0x4 (process_output+0x48)
[  131.492510]  |   +end     0x80000000    -61 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  131.492510]  |   #begin   0x80000000    -61 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  131.492510]      #func                  -61 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  131.724507]  |   #end     0x80000001    -61 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  131.724507]  |   #begin   0x80000001    -62 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  131.724507]      #func                  -62 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  131.724507]      #func                  -62 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  131.724507]      #func                  -62 _spin_unlock_irqrestore+0x4 (release_console_sem+0x18f)
[  131.724507]  |   #end     0x80000001    -62 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  131.724507]  |   #begin   0x80000001    -62 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  131.724507]      #func                  -63 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  131.724507]      #func                  -63 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  131.724507]      #func                  -63 _spin_unlock_irqrestore+0x4 (up+0x39)
[  131.724507]  |   #end     0x80000001    -63 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  131.724507]  |   #begin   0x80000001    -63 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  131.724507]      #func                  -63 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  131.724507]      #func                  -64 _spin_lock_irqsave+0x9 (up+0x14)
[  131.724507]      #func                  -64 up+0x7 (release_console_sem+0x180)
[  131.724507]  |   +end     0x80000001    -64 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  131.724507]  |   +begin   0x80000001    -64 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  131.724507]      +func                  -64 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  131.724507]      +func                  -64 _spin_lock_irqsave+0x9 (release_console_sem+0x42)
[  131.892509]      +func                  -65 release_console_sem+0xb (con_flush_chars+0x43)
[  131.892509]  |   +end     0x80000000    -65 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  131.892509]  |   #begin   0x80000000    -65 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  131.892509]      #func                  -65 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  131.892509]  |   #end     0x80000001    -65 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  131.892509]  |   #begin   0x80000001    -66 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  131.892509]      #func                  -66 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  131.892509]      #func                  -66 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  131.892509]      #func                  -66 _spin_unlock_irqrestore+0x4 (vgacon_set_cursor_size+0x103)
[  131.892509]      #func                  -68 native_io_delay+0x4 (outb_p+0x14)
[  131.892509]      #func                  -68 outb_p+0x4 (vgacon_set_cursor_size+0xf4)
[  131.892509]      #func                  -70 native_io_delay+0x4 (outb_p+0x14)
[  131.892509]      #func                  -70 outb_p+0x4 (vgacon_set_cursor_size+0xe4)
[  131.892509]      #func                  -72 native_io_delay+0x4 (outb_p+0x14)
[  131.892509]      #func                  -72 outb_p+0x4 (vgacon_set_cursor_size+0xd3)
[  131.892509]      #func                  -74 native_io_delay+0x4 (outb_p+0x14)
[  131.892509]      #func                  -74 outb_p+0x4 (vgacon_set_cursor_size+0xb6)
[  131.892509]      #func                  -76 native_io_delay+0x4 (inb_p+0x18)
[  131.892509]      #func                  -76 inb_p+0x8 (vgacon_set_cursor_size+0x9a)
[  131.892509]      #func                  -78 native_io_delay+0x4 (outb_p+0x14)
[  131.892509]      #func                  -78 outb_p+0x4 (vgacon_set_cursor_size+0x8e)
[  131.892509]      #func                  -80 native_io_delay+0x4 (inb_p+0x18)
[  131.892509]      #func                  -80 inb_p+0x8 (vgacon_set_cursor_size+0x79)
[  131.892509]      #func                  -82 native_io_delay+0x4 (outb_p+0x14)
[  131.892509]      #func                  -82 outb_p+0x4 (vgacon_set_cursor_size+0x6d)
[  131.892509]  |   +end     0x80000001    -83 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  131.892509]  |   +begin   0x80000001    -83 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  131.892509]      +func                  -83 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  132.124507]      +func                  -83 _spin_lock_irqsave+0x9 (vgacon_set_cursor_size+0x48)
[  132.124507]      +func                  -83 vgacon_set_cursor_size+0x11 (vgacon_cursor+0x13c)
[  132.124507]  |   +end     0x80000000    -84 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  132.124507]  |   #begin   0x80000000    -84 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  132.124507]      #func                  -84 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  132.124507]  |   #end     0x80000001    -84 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  132.124507]  |   #begin   0x80000001    -84 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  132.124507]      #func                  -84 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  132.124507]      #func                  -85 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  132.124507]      #func                  -85 _spin_unlock_irqrestore+0x4 (write_vga+0x52)
[  132.124507]  |   +end     0x80000001    -85 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  132.124507]  |   +begin   0x80000001    -86 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  132.124507]      +func                  -86 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  132.124507]      +func                  -86 _spin_lock_irqsave+0x9 (write_vga+0x1d)
[  132.124507]      +func                  -86 write_vga+0x7 (vgacon_cursor+0x6e)
[  132.124507]      +func                  -86 vgacon_restore_screen+0x4 (vgacon_cursor+0x21)
[  132.124507]      +func                  -86 vgacon_cursor+0x7 (set_cursor+0x63)
[  132.124507]      +func                  -87 add_softcursor+0x4 (set_cursor+0x4a)
[  132.124507]      +func                  -87 set_cursor+0x9 (con_flush_chars+0x3e)
[  132.124507]  |   +end     0x80000000    -87 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  132.292510]  |   #begin   0x80000000    -87 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  132.292510]      #func                  -88 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  132.292510]  |   #end     0x80000001    -88 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  132.292510]  |   #begin   0x80000001    -88 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  132.292510]      #func                  -88 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  132.292510]      #func                  -88 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  132.292510]      #func                  -88 _spin_unlock_irqrestore+0x4 (down+0x38)
[  132.292510]  |   +end     0x80000001    -89 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  132.292510]  |   +begin   0x80000001    -89 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  132.292510]      +func                  -89 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  132.292510]      +func                  -89 _spin_lock_irqsave+0x9 (down+0x14)
[  132.292510]      +func                  -89 down+0x7 (acquire_console_sem+0x30)
[  132.292510]      +func                  -89 acquire_console_sem+0x4 (con_flush_chars+0x2d)
[  132.292510]      +func                  -90 con_flush_chars+0x9 (con_write+0x21)
[  132.292510]      +func                  -90 notify_update+0x8 (do_con_write+0x1b40)
[  132.292510]  |   +end     0x80000000    -90 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  132.292510]  |   #begin   0x80000000    -90 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  132.292510]      #func                  -90 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  132.292510]  |   #end     0x80000001    -91 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  132.292510]  |   #begin   0x80000001    -91 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  132.292510]      #func                  -91 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  132.292510]      #func                  -91 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  132.292510]      #func                  -91 _spin_unlock_irqrestore+0x4 (release_console_sem+0x18f)
[  132.292510]  |   #end     0x80000001    -91 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  132.292510]  |   #begin   0x80000001    -92 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  132.292510]      #func                  -92 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  132.292510]      #func                  -92 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  132.524508]      #func                  -92 _spin_unlock_irqrestore+0x4 (up+0x39)
[  132.524508]  |   #end     0x80000001    -92 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  132.524508]  |   #begin   0x80000001    -92 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  132.524508]      #func                  -93 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  132.524508]      #func                  -93 _spin_lock_irqsave+0x9 (up+0x14)
[  132.524508]      #func                  -93 up+0x7 (release_console_sem+0x180)
[  132.524508]  |   +end     0x80000001    -93 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  132.524508]  |   +begin   0x80000001    -93 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  132.524508]      +func                  -94 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  132.524508]      +func                  -94 _spin_lock_irqsave+0x9 (release_console_sem+0x42)
[  132.524508]      +func                  -94 release_console_sem+0xb (do_con_write+0x1b38)
[  132.524508]      +func                  -94 _cond_resched+0x4 (console_conditional_schedule+0x17)
[  132.524508]      +func                  -94 console_conditional_schedule+0x4 (do_con_write+0x1b33)
[  132.524508]      +func                  -94 notify_write+0x8 (lf+0x52)
[  132.524508]      +func                  -95 lf+0x9 (do_con_write+0x8a0)
[  132.524508]      +func                  -95 notify_write+0x8 (cr+0x2c)
[  132.524508]      +func                  -95 cr+0x4 (do_con_write+0x8bc)
[  132.524508]  |   +end     0x80000000    -95 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  132.524508]  |   #begin   0x80000000    -95 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  132.524508]      #func                  -96 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  132.524508]  |   #end     0x80000001    -96 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  132.692509]  |   #begin   0x80000001    -96 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  132.692509]      #func                  -96 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  132.692509]      #func                  -96 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  132.692509]      #func                  -96 _spin_unlock_irqrestore+0x4 (vgacon_set_cursor_size+0x103)
[  132.692509]      #func                  -98 native_io_delay+0x4 (outb_p+0x14)
[  132.692509]      #func                  -98 outb_p+0x4 (vgacon_set_cursor_size+0xf4)
[  132.692509]      #func                 -100 native_io_delay+0x4 (outb_p+0x14)
[  132.692509]      #func                 -101 outb_p+0x4 (vgacon_set_cursor_size+0xe4)
[  132.692509]      #func                 -102 native_io_delay+0x4 (outb_p+0x14)
[  132.692509]      #func                 -103 outb_p+0x4 (vgacon_set_cursor_size+0xd3)
[  132.692509]      #func                 -104 native_io_delay+0x4 (outb_p+0x14)
[  132.692509]      #func                 -105 outb_p+0x4 (vgacon_set_cursor_size+0xb6)
[  132.692509]      #func                 -106 native_io_delay+0x4 (inb_p+0x18)
[  132.692509]      #func                 -107 inb_p+0x8 (vgacon_set_cursor_size+0x9a)
[  132.692509]      #func                 -108 native_io_delay+0x4 (outb_p+0x14)
[  132.692509]      #func                 -109 outb_p+0x4 (vgacon_set_cursor_size+0x8e)
[  132.692509]      #func                 -110 native_io_delay+0x4 (inb_p+0x18)
[  132.692509]      #func                 -111 inb_p+0x8 (vgacon_set_cursor_size+0x79)
[  132.692509]      #func                 -113 native_io_delay+0x4 (outb_p+0x14)
[  132.692509]      #func                 -113 outb_p+0x4 (vgacon_set_cursor_size+0x6d)
[  132.692509]  |   +end     0x80000001   -113 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  132.692509]  |   +begin   0x80000001   -113 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  132.692509]      +func                 -113 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  132.692509]      +func                 -114 _spin_lock_irqsave+0x9 (vgacon_set_cursor_size+0x48)
[  132.692509]      +func                 -114 vgacon_set_cursor_size+0x11 (vgacon_cursor+0x13c)
[  132.692509]  |   +end     0x80000000   -114 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  132.692509]  |   #begin   0x80000000   -114 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  132.692509]      #func                 -114 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  132.924507]  |   #end     0x80000001   -115 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  132.924507]  |   #begin   0x80000001   -115 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  132.924507]      #func                 -115 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  132.924507]      #func                 -115 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  132.924507]      #func                 -115 _spin_unlock_irqrestore+0x4 (write_vga+0x52)
[  132.924507]  |   +end     0x80000001   -116 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  132.924507]  |   +begin   0x80000001   -116 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  132.924507]      +func                 -116 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  132.924507]      +func                 -116 _spin_lock_irqsave+0x9 (write_vga+0x1d)
[  132.924507]      +func                 -117 write_vga+0x7 (vgacon_cursor+0x51)
[  132.924507]      +func                 -117 vgacon_restore_screen+0x4 (vgacon_cursor+0x21)
[  132.924507]      +func                 -117 vgacon_cursor+0x7 (hide_cursor+0x2e)
[  132.924507]      +func                 -117 hide_cursor+0x9 (do_con_write+0xfc)
[  132.924507]  |   +end     0x80000000   -117 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  132.924507]  |   #begin   0x80000000   -117 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  132.924507]      #func                 -118 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  132.924507]  |   #end     0x80000001   -118 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  132.924507]  |   #begin   0x80000001   -118 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  132.924507]      #func                 -118 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  132.924507]      #func                 -118 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  133.092509]      #func                 -118 _spin_unlock_irqrestore+0x4 (down+0x38)
[  133.092509]  |   +end     0x80000001   -119 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  133.092509]  |   +begin   0x80000001   -119 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  133.092509]      +func                 -119 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  133.092509]      +func                 -119 _spin_lock_irqsave+0x9 (down+0x14)
[  133.092509]      +func                 -119 down+0x7 (acquire_console_sem+0x30)
[  133.092509]      +func                 -120 acquire_console_sem+0x4 (do_con_write+0x5e)
[  133.092509]      +func                 -120 _cond_resched+0x4 (do_con_write+0x59)
[  133.092509]  |   +end     0x80000001   -120 ipipe_check_context+0xdb (do_con_write+0x54)
[  133.092509]  |   +begin   0x80000001   -120 ipipe_check_context+0x32 (do_con_write+0x54)
[  133.092509]      +func                 -120 ipipe_check_context+0x11 (do_con_write+0x54)
[  133.092509]      +func                 -120 do_con_write+0x14 (con_write+0x16)
[  133.092509]      +func                 -121 con_write+0x9 (do_output_char+0x8b)
[  133.092509]      +func                 -121 do_output_char+0x9 (process_output+0x3d)
[  133.092509]      +func                 -121 con_write_room+0x4 (tty_write_room+0x1d)
[  133.092509]      +func                 -121 tty_write_room+0x4 (process_output+0x2f)
[  133.092509]      +func                 -121 _cond_resched+0x4 (mutex_lock+0x22)
[  133.092509]  |   +end     0x80000001   -121 ipipe_check_context+0xdb (mutex_lock+0x1d)
[  133.092509]  |   +begin   0x80000001   -122 ipipe_check_context+0x32 (mutex_lock+0x1d)
[  133.092509]      +func                 -122 ipipe_check_context+0x11 (mutex_lock+0x1d)
[  133.092509]      +func                 -122 mutex_lock+0x9 (process_output+0x27)
[  133.092509]      +func                 -122 process_output+0xd (n_tty_write+0x260)
[  133.092509]      +func                 -122 mutex_unlock+0x4 (n_tty_write+0x234)
[  133.092509]  |   +end     0x80000000   -122 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  133.092509]  |   #begin   0x80000000   -123 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  133.092509]      #func                 -123 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  133.092509]  |   #end     0x80000001   -123 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  133.092509]  |   #begin   0x80000001   -123 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  133.324507]      #func                 -123 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  133.324507]      #func                 -124 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  133.324507]      #func                 -124 _spin_unlock_irqrestore+0x4 (release_console_sem+0x18f)
[  133.324507]  |   #end     0x80000001   -124 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  133.324507]  |   #begin   0x80000001   -124 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  133.324507]      #func                 -124 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  133.324507]      #func                 -124 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  133.324507]      #func                 -125 _spin_unlock_irqrestore+0x4 (up+0x39)
[  133.324507]  |   #end     0x80000001   -125 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  133.324507]  |   #begin   0x80000001   -125 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  133.324507]      #func                 -125 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  133.324507]      #func                 -125 _spin_lock_irqsave+0x9 (up+0x14)
[  133.324507]      #func                 -125 up+0x7 (release_console_sem+0x180)
[  133.324507]  |   +end     0x80000001   -126 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  133.324507]  |   +begin   0x80000001   -126 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  133.324507]      +func                 -126 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  133.324507]      +func                 -126 _spin_lock_irqsave+0x9 (release_console_sem+0x42)
[  133.324507]      +func                 -126 release_console_sem+0xb (con_flush_chars+0x43)
[  133.324507]  |   +end     0x80000000   -127 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  133.324507]  |   #begin   0x80000000   -127 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  133.492509]      #func                 -127 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  133.492509]  |   #end     0x80000001   -127 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  133.492509]  |   #begin   0x80000001   -127 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  133.492509]      #func                 -127 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  133.492509]      #func                 -128 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  133.492509]      #func                 -128 _spin_unlock_irqrestore+0x4 (vgacon_set_cursor_size+0x103)
[  133.492509]      #func                 -130 native_io_delay+0x4 (outb_p+0x14)
[  133.492509]      #func                 -130 outb_p+0x4 (vgacon_set_cursor_size+0xf4)
[  133.492509]      #func                 -132 native_io_delay+0x4 (outb_p+0x14)
[  133.492509]      #func                 -132 outb_p+0x4 (vgacon_set_cursor_size+0xe4)
[  133.492509]      #func                 -134 native_io_delay+0x4 (outb_p+0x14)
[  133.492509]      #func                 -134 outb_p+0x4 (vgacon_set_cursor_size+0xd3)
[  133.492509]      #func                 -136 native_io_delay+0x4 (outb_p+0x14)
[  133.492509]      #func                 -136 outb_p+0x4 (vgacon_set_cursor_size+0xb6)
[  133.492509]      #func                 -138 native_io_delay+0x4 (inb_p+0x18)
[  133.492509]      #func                 -138 inb_p+0x8 (vgacon_set_cursor_size+0x9a)
[  133.492509]      #func                 -140 native_io_delay+0x4 (outb_p+0x14)
[  133.492509]      #func                 -140 outb_p+0x4 (vgacon_set_cursor_size+0x8e)
[  133.492509]      #func                 -142 native_io_delay+0x4 (inb_p+0x18)
[  133.492509]      #func                 -142 inb_p+0x8 (vgacon_set_cursor_size+0x79)
[  133.492509]      #func                 -144 native_io_delay+0x4 (outb_p+0x14)
[  133.492509]      #func                 -144 outb_p+0x4 (vgacon_set_cursor_size+0x6d)
[  133.492509]  |   +end     0x80000001   -144 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  133.492509]  |   +begin   0x80000001   -145 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  133.492509]      +func                 -145 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  133.492509]      +func                 -145 _spin_lock_irqsave+0x9 (vgacon_set_cursor_size+0x48)
[  133.492509]      +func                 -145 vgacon_set_cursor_size+0x11 (vgacon_cursor+0x13c)
[  133.492509]  |   +end     0x80000000   -145 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  133.724507]  |   #begin   0x80000000   -146 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  133.724507]      #func                 -146 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  133.724507]  |   #end     0x80000001   -146 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  133.724507]  |   #begin   0x80000001   -146 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  133.724507]      #func                 -146 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  133.724507]      #func                 -146 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  133.724507]      #func                 -147 _spin_unlock_irqrestore+0x4 (write_vga+0x52)
[  133.724507]  |   +end     0x80000001   -147 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  133.792071]  |   +begin   0x80000001   -147 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  133.792071]      +func                 -148 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  133.792071]      +func                 -148 _spin_lock_irqsave+0x9 (write_vga+0x1d)
[  133.792071]      +func                 -148 write_vga+0x7 (vgacon_cursor+0x6e)
[  133.792071]      +func                 -148 vgacon_restore_screen+0x4 (vgacon_cursor+0x21)
[  133.792071]      +func                 -148 vgacon_cursor+0x7 (set_cursor+0x63)
[  133.792071]      +func                 -149 add_softcursor+0x4 (set_cursor+0x4a)
[  133.792071]      +func                 -149 set_cursor+0x9 (con_flush_chars+0x3e)
[  133.792071]  |   +end     0x80000000   -149 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  133.792071]  |   #begin   0x80000000   -149 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  133.792071]      #func                 -149 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  133.792071]  |   #end     0x80000001   -149 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  133.892509]  |   #begin   0x80000001   -150 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  133.892509]      #func                 -150 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  133.892509]      #func                 -150 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  133.892509]      #func                 -150 _spin_unlock_irqrestore+0x4 (down+0x38)
[  133.892509]  |   +end     0x80000001   -150 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  133.892509]  |   +begin   0x80000001   -151 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  133.892509]      +func                 -151 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  133.892509]      +func                 -151 _spin_lock_irqsave+0x9 (down+0x14)
[  133.892509]      +func                 -151 down+0x7 (acquire_console_sem+0x30)
[  133.892509]      +func                 -151 acquire_console_sem+0x4 (con_flush_chars+0x2d)
[  133.892509]      +func       \r       [ 4>33 184089] 09a2 0015qc timeout (cmd 0xa0)
 on_flush_chars+0x9co\r_write+0x21[ 4>33 1936292509a2)\r0: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 frozen
[ 
133.892509]   [ 41[ .938.81]50ta  00: irq_stat 0x40000001
 +
[ 4>34.0333892 a9]2.un: c   a0/00:00:00:00:00/00:00:00:00:00/a0 tag 0
[   34  04  6]          cdb 00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00
  -134 004368]          res 51/20:03:00:00:00/00:00:00:00:00/a0 Emask 0x5 (timeout)
 otify_update+0x8d
con_write+0x1b40< >[34103.409]09ta)\r00: status: { DRDY ERR }
[  133.892509]  |<  [341332897]09ta : hard resetting link
  +end     0x80000000   -152 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  133.892509]  |   #begin   0x80000000   -152 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  133.892509]      #func                 -152 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  133.892509]  |   #end     0x80000001   -152 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  133.892509]  |   #begin   0x80000001   -152 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  133.892509]      #func                 -153 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  133.892509]      #func                 -153 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  133.892509]      #func                 -153 _spin_unlock_irqrestore+0x4 (release_console_sem+0x18f)
[  133.892509]  |   #end     0x80000001   -153 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  133.892509]  |   #begin   0x80000001   -153 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  134.124509]      #func                 -153 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  134.124509]      #func                 -154 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  134.124509]      #func                 -154 _spin_unlock_irqrestore+0x4 (up+0x39)
[  134.124509]  |   #end     0x80000001   -154 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  134.124509]  |   #begin   0x80000001   -154 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  134.124509]      #func                 -154 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  134.124509]      #func                 -155 _spin_lock_irqsave+0x9 (up+0x14)
[  134.124509]      #func                 -155 up+0x7 (release_console_sem+0x180)
[  134.124509]  |   +end     0x80000001   -155 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  134.124509]  |   +begin   0x80000001   -155 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  134.124509]      +func                 -155 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  134.124509]      +func                 -155 _spin_lock_irqsave+0x9 (release_console_sem+0x42)
[  134.124509]      +func                 -156 release_console_sem+0xb (do_con_write+0x1b38)
[  134.124509]      +func                 -156 _cond_resched+0x4 (console_conditional_schedule+0x17)
[  134.124509]      +func                 -156 console_conditional_schedule+0x4 (do_con_write+0x1b33)
[  134.124509]      +func                 -156 vgacon_dummy+0x4 (do_con_write+0x1b2e)
[  134.124509]      +func                 -156 notify_write+0x8 (do_con_write+0x6f1)
[  134.124509]      +func                 -157 conv_uni_to_pc+0x4 (do_con_write+0x464)
[  134.124509]      +func                 -157 notify_write+0x8 (do_con_write+0x6f1)
[  134.124509]      +func                 -157 conv_uni_to_pc+0x4 (do_con_write+0x464)
[  134.124509]      +func                 -157 notify_write+0x8 (do_con_write+0x6f1)
[  134.293015]      +func                 -158 conv_uni_to_pc+0x4 (do_con_write+0x464)
[  134.293015]      +func                 -158 notify_write+0x8 (do_con_write+0x6f1)
[  134.293015]      +func                 -158 conv_uni_to_pc+0x4 (do_con_write+0x464)
[  134.293015]      +func                 -158 notify_write+0x8 (do_con_write+0x6f1)
[  134.293015]      +func                 -159 conv_uni_to_pc+0x4 (do_con_write+0x464)
[  134.293015]      +func                 -159 notify_write+0x8 (do_con_write+0x6f1)
[  134.293015]      +func                 -159 conv_uni_to_pc+0x4 (do_con_write+0x464)
[  134.293015]      +func               [ 4>34.334040]01ta   S1TA link up 1.5 Gbps (SStatus 113 SControl 300)
 otify_write+0x8)o
con_write+0x6f1[  134.293015]      +func                 -160 conv_uni_to_pc+0x4 (do_con_write+0x464)
[  134.293015]      +func                 -160 notify_write+0x8 (do_con_write+0x6f1)
[  134.293015]      +func                 -160 conv_uni_to_pc+0x4 (do_con_write+0x464)
[  134.293015]  |   +end     0x80000000   -161 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  134.293015]  |   #begin   0x80000000   -161 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  134.293015]      #func                 -161 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  134.293015]  |   #end     0x80000001   -161 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  134.293015]  |   #begin   0x80000001   -161 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  134.293015]      #func                 -162 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  134.293015]      #func                 -162 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  134.293015]      #func                 -162 _spin_unlock_irqrestore+0x4 (vgacon_set_cursor_size+0x103)
[  134.293015]      #func                 -164 native_io_delay+0x4 (outb_p+0x14)
[  134.293015]      #func                 -164 outb_p+0x4 (vgacon_set_cursor_size+0xf4)
[  134.293015]      #func                 -166 native_io_delay+0x4 (outb_p+0x14)
[  134.293015]      #func                 -166 outb_p+0x4 (vgacon_set_cursor_size+0xe4)
[  134.293015]      #func                 -168 native_io_delay+0x4 (outb_p+0x14)
[  134.293015]      #func                 -168 outb_p+0x4 (vgacon_set_cursor_size+0xd3)
[  134.293015]      #func                 -170 native_io_delay+0x4 (outb_p+0x14)
[  134.293015]      #func                 -170 outb_p+0x4 (vgacon_set_cursor_size+0xb6)
[  134.293015]      #func                 -172 native_io_delay+0x4 (inb_p+0x18)
[  134.524508]      #func                 -172 inb_p+0x8 (vgacon_set_cursor_size+0x9a)
[  134.524508]      #func                 -174 native_io_delay+0x4 (outb_p+0x14)
[  134.524508]      #func                 -174 outb_p+0x4 (vgacon_set_cursor_size+0x8e)
[  134.524508]      #func                 -176 native_io_delay+0x4 (inb_p+0x18)
[  134.524508]      #func                 -176 inb_p+0x8 (vgacon_set_cursor_size+0x79)
[  134.524508]      #func                 -178 native_io_delay+0x4 (outb_p+0x14)
[  134.524508]      #func                 -178 outb_p+0x4 (vgacon_set_cursor_size+0x6d)
[  134.524508]  |   +end     0x80000001   -178 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  134.524508]  |   +begin   0x80000001   -179 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  134.524508]      +func                 -179 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  134.524508]      +func                 -179 _spin_lock_irqsave+0x9 (vgacon_set_cursor_size+0x48)
[  134.524508]      +func                 -179 vgacon_set_cursor_size+0x11 (vgacon_cursor+0x13c)
[  134.524508]  |   +end     0x80000000   -179 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  134.524508]  |   #begin   0x80000000   -180 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  134.524508]      #func                 -180 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  134.524508]  |   #end     0x80000001   -180 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  134.524508]  |   #begin   0x80000001   -180 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  134.524508]      #func                 -180 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  134.524508]      #func                 -180 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  134.524508]      #func                 -181 _spin_unlock_irqrestore+0x4 (write_vga+0x52)
[  134.693013]  |   +end     0x80000001   -181 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  134.693013]  |   +begin   0x80000001   -181 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  134.693013]      +func                 -182 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  134.693013]      +func                 -182 _spin_lock_irqsave+0x9 (write_vga+0x1d)
[  134.693013]      +func                 -182 write_vga+0x7 (vgacon_cursor+0x51)
[  134.693013]      +func                 -182 vgacon_restore_screen+0x4 (vgacon_cursor+0x21)
[  134.693013]      +func                 -182 vgacon_cursor+0x7 (hide_cursor+0x2e)
[  134.693013]      +func                 -182 hide_cursor+0x9 (do_con_write+0xfc)
[  134.693013]  |   +end     0x80000000   -183 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  134.693013]  |   #begin   0x80000000   -183 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  134.693013]      #func                 -183 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  134.693013]  |   #end     0x80000001   -183 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  134.693013]  |   #begin   0x80000001   -183 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  134.693013]      #func                 -184 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  134.693013]      #func                 -184 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  134.693013]      #func                 -184 _spin_unlock_irqrestore+0x4 (down+0x38)
[  134.693013]  |   +end     0x80000001   -184 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  134.693013]  |   +begin   0x80000001   -184 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  134.693013]      +func                 -184 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  134.693013]      +func                 -185 _spin_lock_irqsave+0x9 (down+0x14)
[  134.693013]      +func                 -185 down+0x7 (acquire_console_sem+0x30)
[  134.693013]      +func                 -185 acquire_console_sem+0x4 (do_con_write+0x5e)
[  134.693013]      +func                 -185 _cond_resched+0x4 (do_con_write+0x59)
[  134.693013]  |   +end     0x80000001   -185 ipipe_check_context+0xdb (do_con_write+0x54)
[  134.693013]  |   +begin   0x80000001   -186 ipipe_check_context+0x32 (do_con_write+0x54)
[  134.693013]      +func                 -186 ipipe_check_context+0x11 (do_con_write+0x54)
[  134.693013]      +func                 -186 do_con_write+0x14 (con_write+0x16)
[  134.693013]      +func                 -186 con_write+0x9 (n_tty_write+0x228)
[  134.924508]      +func                 -186 con_write_room+0x4 (tty_write_room+0x1d)
[  134.924508]      +func                 -186 tty_write_room+0x4 (n_tty_write+0x120)
[  134.924508]      +func                 -187 _cond_resched+0x4 (mutex_lock+0x22)
[  134.924508]  |   +end     0x80000001   -187 ipipe_check_context+0xdb (mutex_lock+0x1d)
[  134.924508]  |   +begin   0x80000001   -187 ipipe_check_context+0x32 (mutex_lock+0x1d)
[  134.924508]      +func                 -187 ipipe_check_context+0x11 (mutex_lock+0x1d)
[  134.924508]      +func                 -187 mutex_lock+0x9 (n_tty_write+0x118)
[  134.924508]      +func                 -188 tty_hung_up_p+0x4 (n_tty_write+0xce)
[  134.924508]  |   +end     0x80000000   -188 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  134.924508]  |   #begin   0x80000000   -188 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  134.924508]      #func                 -188 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  134.924508]  |   #end     0x80000001   -188 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  134.924508]  |   #begin   0x80000001   -188 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  134.924508]      #func                 -189 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  134.924508]      #func                 -189 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  134.924508]      #func                 -189 _spin_unlock_irqrestore+0x4 (add_wait_queue+0x44)
[  134.924508]  |   +end     0x80000001   -189 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  134.924508]  |   +begin   0x80000001   -189 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  134.924508]      +func                 -190 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  134.924508]      +func                 -190 _spin_lock_irqsave+0x9 (add_wait_queue+0x1a)
[  135.093014]      +func                 -190 add_wait_queue+0x7 (n_tty_write+0x91)
[  135.093014]      +func                 -190 process_echoes+0x11 (n_tty_write+0x7a)
[  135.093014]      +func                 -190 n_tty_write+0x11 (tty_write+0x18f)
[  135.093014]      +func                 -190 mutex_trylock+0x4 (tty_write_lock+0x1e)
[  135.093014]      +func                 -191 tty_write_lock+0x7 (tty_write+0xc5)
[  135.093014]  |   +end     0x80000000   -191 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  135.093014]  |   #begin   0x80000000   -191 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  135.093014]      #func                 -191 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  135.093014]  |   #end     0x80000001   -191 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  135.093014]  |   #begin   0x80000001   -192 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  135.093014]      #func                 -192 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  135.093014]      #func                 -192 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  135.093014]      #func           
   < >[351399198]13ta  0092configured for UDMA/100
 spin_unlock_irqrestore+0x4tty_ldisc_try+0x45)
[  135.197013]  |   +end     0x80000001   -192 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  135.197013]  |   +begin   0x80000001   -193 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  135.197013]      +func                 -193 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  135.197013]      +func                 -193 _spin_lock_irqsave+0x9 (tty_ldisc_try+0x1d)
[  135.197013]      +func                 -193 tty_ldisc_try+0x7 (tty_ldisc_ref_wait+0x18)
[  135.197013]      +func                 -193 tty_ldisc_ref_wait+0xb (tty_write+0x93)
[  135.197013]      +func                 -193 tty_paranoia_check+0x4 (tty_write+0x3e)
[  135.197013]      +func                 -194 tty_write+0x11 (vfs_write+0xaa)
[  135.197013]      +func                 -194 rw_verify_area+0x9 (vfs_write+0x87)
[  135.197013]      +func                 -194 vfs_write+0xd (sys_write+0x4a)
[  135.197013]      +func                 -194 fget_light+0x4 (sys_write+0x20)
[  135.197013]      +func                 -194 sys_write+0xb (system_call_fastpath+0x16)
[  135.197013]  |   +end     0x80000001   -194 __ipipe_syscall_root+0x16c (__ipipe_syscall_root_thunk+0x35)
[  135.197013]  |   +begin   0x80000001   -195 __ipipe_syscall_root+0x104 (__ipipe_syscall_root_thunk+0x35)
[  135.197013]  |   +end     0x80000001   -195 __ipipe_syscall_root+0xbb (__ipipe_syscall_root_thunk+0x35)
[  135.324508]  |   +begin   0x80000001   -195 __ipipe_syscall_root+0x6b (__ipipe_syscall_root_thunk+0x35)
[  135.324508]  |   +end     0x80000001   -195 __ipipe_dispatch_event+0x4b0 (__ipipe_syscall_root+0x4f)
[  135.324508]  |   +begin   0x80000001   -195 __ipipe_dispatch_event+0x1da (__ipipe_syscall_root+0x4f)
[  135.324508]      +func                 -196 losyscall_event+0x11 (__ipipe_dispatch_event+0x1b6)
[  135.324508]  |   +end     0x80000001   -196 __ipipe_dispatch_event+0x1a4 (__ipipe_syscall_root+0x4f)
[  135.324508]  |   +begin   0x80000001   -196 __ipipe_dispatch_event+0x1da (__ipipe_syscall_root+0x4f)
[  135.324508]  |   +end     0x80000000   -196 __ipipe_unstall_root+0xd1 (raw_local_irq_enable+0xe)
[  135.324508]  |   #begin   0x80000000   -197 __ipipe_unstall_root+0x20 (raw_local_irq_enable+0xe)
[  135.324508]      #func                 -197 __ipipe_unstall_root+0x9 (raw_local_irq_enable+0xe)
[  135.324508]      #func                 -197 raw_local_irq_enable+0x4 (finish_task_switch+0x6a)
[  135.324508]      #func                 -197 perf_counter_task_sched_in+0x7 (finish_task_switch+0x63)
[  135.324508]      #func                 -197 needs_post_schedule_rt+0x4 (finish_task_switch+0x3d)
[  135.324508]      #func                 -197 finish_task_switch+0x11 (ipipe_reenter_root+0x30)
[  135.324508]      #func                 -198 ipipe_reenter_root+0x7 (xnshadow_relax+0xc8)
[  135.324508]  |   #end     0x80000000   -198 __ipipe_restore_pipeline_head+0xfa (ipipe_restore_pipeline_head+0x66)
[  135.324508]  |  *#func                 -198 __ipipe_restore_pipeline_head+0x7 (ipipe_restore_pipeline_head+0x66)
[  135.324508]  |  *#func                 -198 ipipe_restore_pipeline_head+0x7 (xnshadow_relax+0x90)
[  135.324508]  |  *#func                 -198 ipipe_restore_pipeline_head+0x7 (T.622+0x24)
[  135.493016]  |  *#func                 -199 T.622+0x4 (xnpod_suspend_thread+0x1a0)
[  135.493016]  |  *#func                 -199 ipipe_restore_pipeline_head+0x7 (T.622+0x24)
[  135.493016]  |  *#func                 -199 T.622+0x4 (__xnpod_schedule+0x69f)
[  135.493016]  |   #func                 -199 ipipe_test_and_stall_pipeline_head+0x9 (T.625+0xe)
[  135.493016]  |   #func                 -199 T.625+0x4 (__xnpod_schedule+0x696)
[  135.493016]  |   #func                 -200 __unlazy_fpu+0x4 (__switch_to+0x17e)
[  135.493016]  |   #func                 -200 __switch_to+0xb (__xnpod_schedule+0x483)
[  135.493016]  |   #begin   0x80000000   -200 schedule+0x5d3 (gatekeeper_thread+0x10d)
[  135.493016]  |   #end     0x80000001   -200 __ipipe_dispatch_event+0x4b0 (schedule+0x5c1)
[  135.493016]  |   #begin   0x80000001   -201 __ipipe_dispatch_event+0x1da (schedule+0x5c1)
[  135.493016]  |   #end     0x80000001   -201 ipipe_trigger_irq+0x80 (__xnpod_schedule+0xa0)
[  135.493016]  |   #func                 -201 __ipipe_walk_pipeline+0x11 (__ipipe_dispatch_wired_nocheck+0x1d8)
[  135.493016]  |  #*func                 -201 ipipe_restore_pipeline_head+0x7 (T.622+0x24)
[  135.493016]  |  #*func                 -201 T.622+0x4 (__xnpod_schedule+0x69f)
[  135.493016]  |  #*func                 -202 xnsched_pick_next+0x4 (__xnpod_schedule+0x129)
[  135.493016]  |  #*func                 -202 T.623+0x4 (__xnpod_schedule+0xf0)
[  135.493016]  |  #*[  350] gatekee 99   -202 __xnpod_schedule+0xd2 (xnpod_schedule+0x32)
[  135.493016]  |  #*func                 -202 ipipe_test_and_stall_pipeline_head+0x9 (T.625+0xe)
[  135.493016]  |  #*func                 -202 T.625+0x4 (__xnpod_schedule+0xaa)
[  135.493016]  |  #*func                 -203 __xnpod_schedule+0x11 (xnpod_schedule+0x32)
[  135.493016]  |  #*func                 -203 xnpod_schedule+0x4 (xnpod_schedule_handler+0x59)
[  135.493016]  |  #*func                 -203 xnpod_schedule_handler+0x7 (__ipipe_dispatch_wired_nocheck+0x127)
[  135.493016]  |   #func                 -203 __ipipe_dispatch_wired_nocheck+0x11 (__ipipe_dispatch_wired+0xc3)
[  135.493016]  |   #func                 -203 __ipipe_dispatch_wired+0xd (__ipipe_handle_irq+0x128)
[  135.493016]  |   #func                 -204 __ipipe_handle_irq+0x11 (ipipe_trigger_irq+0x71)
[  135.493016]  |   #begin   0x80000001   -204 ipipe_trigger_irq+0x52 (__xnpod_schedule+0xa0)
[  135.493016]      #func                 -204 ipipe_trigger_irq+0x10 (__xnpod_schedule+0xa0)
[  135.493016]  |   #end     0x80000001   -204 __xnpod_schedule+0x8a (xnpod_schedule+0x32)
[  135.724509]  |   #begin   0x80000001   -204 __xnpod_schedule+0x3a (xnpod_schedule+0x32)
[  135.724509]      #func                 -204 __xnpod_schedule+0x11 (xnpod_schedule+0x32)
[  135.724509]      #func                 -205 xnpod_schedule+0x4 (schedule_event+0x2ef)
[  135.724509]  |   #end     0x80000000   -205 __ipipe_restore_pipeline_head+0xfa (T.513+0x7b)
[  135.724509]  |  *#func                 -205 __ipipe_restore_pipeline_head+0x7 (T.513+0x7b)
[  135.724509]  |  *#func                 -205 T.513+0x7 (xnsched_renice_root+0x5c)
[  135.724509]  |  *#[  350] gatekee 99   -205 xnsched_renice_root+0x54 (schedule_event+0x2ea)
[  135.724509]  |  *#func                 -205 xnsched_track_policy+0x4 (xnsched_renice_root+0x3b)
[  135.724509]  |   #begin   0x80000000   -206 T.515+0x20 (xnsched_renice_root+0x25)
[  135.724509]      #func                 -206 T.515+0x9 (xnsched_renice_root+0x25)
[  135.724509]      #func                 -206 xnsched_renice_root+0xd (schedule_event+0x2ea)
[  135.724509]      #func                 -206 schedule_event+0x11 (__ipipe_dispatch_event+0x1b6)
[  135.724509]  |   #end     0x80000001   -206 __ipipe_dispatch_event+0x1a4 (schedule+0x5c1)
[  135.724509]  |   #begin   0x80000001   -207 __ipipe_dispatch_event+0x34 (schedule+0x5c1)
[  135.724509]      #func                 -207 __ipipe_dispatch_event+0x11 (schedule+0x5c1)
[  135.724509]      #func                 -207 __ipipe_event_monitored_p+0xb (schedule+0x5af)
[  135.724509]      #func                 -207 perf_counter_task_sched_out+0x11 (schedule+0x57c)
[  135.724509]      #func                 -207 dequeue_pushable_task+0x4 (pick_next_task_rt+0x7a)
[  135.724509]      #func                 -208 pick_next_task_rt+0x9 (schedule+0x54f)
[  135.724509]      #func                 -208 balance_runtime+0x11 (update_curr_rt+0x114)
[  135.724509]      #func                 -208 _spin_lock+0x4 (update_curr_rt+0xe8)
[  135.893013]      #func                 -208 account_group_exec_runtime+0x7 (update_curr_rt+0x51)
[  135.893013]      #func                 -208 update_curr_rt+0xb (put_prev_task_rt+0x1a)
[  135.893013]      #func                 -208 put_prev_task_rt+0x9 (schedule+0x51e)
[  135.893013]      #func                 -209 pre_schedule_rt+0x4 (schedule+0x15a)
[  135.893013]      #func                 -209 dequeue_pushable_task+0x4 (dequeue_task_rt+0x59)
[  135.893013]      #func                 -209 update_rt_migration+0x4 (__dequeue_rt_entity+0x16b)
[  135.893013]      #func                 -209 pick_next_highest_task_rt+0xd (next_prio+0x14)
[  135.893013]      #func                 -209 next_prio+0x4 (__dequeue_rt_entity+0x119)
[  135.893013]      #func                 -209 __dequeue_rt_entity+0xb (dequeue_task_rt+0x45)
[  135.893013]      #func                 -210 balance_runtime+0x11 (update_curr_rt+0x114)
[  135.893013]      #func                 -210 _spin_lock+0x4 (update_curr_rt+0xe8)
[  135.893013]      #func                 -210 account_group_exec_runtime+0x7 (update_curr_rt+0x51)
[  135.893013]      #func                 -210 update_curr_rt+0xb (dequeue_task_rt+0x25)
[  135.893013]      #func                 -210 dequeue_task_rt+0xb (dequeue_task+0x78)
[  135.893013]      #func                 -211 dequeue_task+0x9 (deactivate_task+0x2d)
[  135.893013]      #func                 -211 deactivate_task+0x9 (schedule+0x136)
[  135.893013]      #func                 -211 signal_pending_state+0x4 (schedule+0x114)
[  135.893013]      #func                 -211 update_rq_clock+0x9 (schedule+0xe2)
[  135.893013]  |   +end     0x80000001   -211 ipipe_check_context+0xdb (raw_local_irq_disable+0x15)
[  135.893013]  |   +begin   0x80000001   -212 ipipe_check_context+0x32 (raw_local_irq_disable+0x15)
[  135.893013]      +func                 -212 ipipe_check_context+0x11 (raw_local_irq_disable+0x15)
[  135.893013]      +func                 -212 raw_local_irq_disable+0x4 (_spin_lock_irq+0x16)
[  135.893013]      +func                 -212 _spin_lock_irq+0x9 (schedule+0xda)
[  135.893013]  |   +end     0x80000001   -212 ipipe_check_context+0xdb (schedule+0xa8)
[  135.893013]  |   +begin   0x80000001   -212 ipipe_check_context+0x32 (schedule+0xa8)
[  135.893013]      +func                 -213 ipipe_check_context+0x11 (schedule+0xa8)
[  135.893013]      +func                 -213 rcu_qsctr_inc+0x4 (schedule+0x63)
[  135.893013]      +func                 -213 schedule+0x14 (gatekeeper_thread+0x10d)
[  135.893013]  |   +end     0x80000000   -213 __ipipe_unstall_root+0xd1 (__ipipe_restore_root+0xaf)
[  136.124507]  |   #begin   0x80000000   -213 __ipipe_unstall_root+0x20 (__ipipe_restore_root+0xaf)
[  136.124507]      #func                 -214 __ipipe_unstall_root+0x9 (__ipipe_restore_root+0xaf)
[  136.124507]  |   #end     0x80000001   -214 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  136.124507]  |   #begin   0x80000001   -214 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  136.124507]      #func                 -214 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  136.124507]      #func                 -214 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  136.124507]      #func                 -214 _spin_unlock_irqrestore+0x4 (up+0x39)
[  136.124507]  |   +end     0x80000001   -215 ipipe_check_context+0xdb (_spin_lock_irqsave+0x1d)
[  136.124507]  |   +begin   0x80000001   -215 ipipe_check_context+0x32 (_spin_lock_irqsave+0x1d)
[  136.124507]      +func                 -215 ipipe_check_context+0x11 (_spin_lock_irqsave+0x1d)
[  136.124507]      +func                 -215 _spin_lock_irqsave+0x9 (up+0x14)
[  136.124507]      +func                 -215 up+0x7 (gatekeeper_thread+0x108)
[  136.124507]  |   +end     0x80000001   -216 ipipe_trigger_irq+0x80 (__xnpod_schedule+0xa0)
[  136.124507]      #func                 -216 idle_cpu+0x4 (irq_exit+0x62)
[  136.124507]      #func                 -216 rcu_irq_exit+0x4 (irq_exit+0x55)
[  136.124507]  |   #end     0x80000001   -216 ipipe_check_context+0xdb (irq_exit+0x15)
[  136.124507]  |   #begin   0x80000001   -217 ipipe_check_context+0x32 (irq_exit+0x15)
[  136.124507]      #func                 -217 ipipe_check_context+0x11 (irq_exit+0x15)
[  136.124507]      #func                 -217 irq_exit+0x4 (__xirq_end+0x82)
[  136.124507]  |   #end     0x80000001   -217 __ipipe_restore_root+0x7c (raw_local_irq_restore+0x19)
[  136.293014]  |   #begin   0x80000001   -217 __ipipe_restore_root+0x2c (raw_local_irq_restore+0x19)
[  136.293014]      #func                 -217 __ipipe_restore_root+0xb (raw_local_irq_restore+0x19)
[  136.293014]      #func                 -218 raw_local_irq_restore+0x4 (_spin_unlock_irqrestore+0x16)
[  136.293014]      #func                 -218 _spin_unlock_irqrestore+0x4 (task_rq_unlock+0x11)
[  136.293014]      #func                 -218 task_rq_unlock+0x4 (try_to_wake_up+0x1f6)
[  136.293014]      #func                 -218 task_wake_up_rt+0x9 (try_to_wake_up+0x1e5)
[  136.293014]      #func                 -218 check_preempt_curr_rt+0x7 (check_preempt_curr+0x17)
[  136.293014]      #func                 -219 check_preempt_curr+0x4 (try_to_wake_up+0x1c9)
[  136.293014]      #func                 -219 update_rt_migration+0x4 (enqueue_task_rt+0x15c)
[  136.293014]      #func                 -219 enqueue_task_rt+0x11 (enqueue_task+0x2d)
[  136.293014]      #func                 -219 enqueue_task+0x9 (activate_task+0x2d)
[  136.293014]      #func                 -219 activate_task+0x9 (try_to_wake_up+0x120)
[  136.293014]      #func                 -219 select_task_rq_rt+0x9 (try_to_wake_up+0xcc)
[  136.293014]      #func                 -220 update_rq_clock+0x9 (try_to_wake_up+0x8c)
[  136.293014]      #func                 -220 _spin_lock+0x4 (task_rq_lock+0x6c)
[  136.293014]  |   #end     0x80000001   -220 ipipe_check_context+0xdb (task_rq_lock+0x29)
[  136.293014]  |   #begin   0x80000001   -220 ipipe_check_context+0x32 (task_rq_lock+0x29)
[  136.293014]      #func                 -220 ipipe_check_context+0x11 (task_rq_lock+0x29)
[  136.293014]      #func                 -221 task_rq_lock+0xb (try_to_wake_up+0x81)
[  136.293014]      #func                 -221 try_to_wake_up+0x11 (wake_up_process+0x15)
[  136.293014]      #func                 -221 wake_up_process+0x4 (lostage_handler+0xdd)
[  136.293014]  |   #end     0x80000001   -221 ipipe_trigger_irq+0x80 (__xnpod_schedule+0xa0)
[  136.293014]  |   #func                 -221 __ipipe_walk_pipeline+0x11 (__ipipe_dispatch_wired_nocheck+0x1d8)
[  136.293014]  |  #*func                 -222 ipipe_restore_pipeline_head+0x7 (T.622+0x24)
[  136.293014]  |  #*func                 -222 T.622+0x4 (__xnpod_schedule+0x69f)
[  136.293014]  |  #*func                 -222 xnsched_pick_next+0x4 (__xnpod_schedule+0x129)
[  136.293014]  |  #*func                 -222 T.623+0x4 (__xnpod_schedule+0xf0)
[  136.293014]  |  #*[  350] gatekee -1   -222 __xnpod_schedule+0xd2 (xnpod_schedule+0x32)
[  136.524508]  |  #*func                 -223 ipipe_test_and_stall_pipeline_head+0x9 (T.625+0xe)
[  136.524508]  |  #*func                 -223 T.625+0x4 (__xnpod_schedule+0xaa)
[  136.524508]  |  #*func                 -223 __xnpod_schedule+0x11 (xnpod_schedule+0x32)
[  136.524508]  |  #*func                 -223 xnpod_schedule+0x4 (xnpod_schedule_handler+0x59)
[  136.524508]  |  #*func                 -223 xnpod_schedule_handler+0x7 (__ipipe_dispatch_wired_nocheck+0x127)
[  136.524508]  |   #func                 -224 __ipipe_dispatch_wired_nocheck+0x11 (__ipipe_dispatch_wired+0xc3)
[  136.524508]  |   #func                 -224 __ipipe_dispatch_wired+0xd (__ipipe_handle_irq+0x128)
[  136.524508]  |   #func                 -224 __ipipe_handle_irq+0x11 (ipipe_trigger_irq+0x71)
[  136.524508]  |   #begin   0x80000001   -224 ipipe_trigger_irq+0x52 (__xnpod_schedule+0xa0)
[  136.524508]      #func                 -224 ipipe_trigger_irq+0x10 (__xnpod_schedule+0xa0)
[  136.524508]  |   #end     0x80000001   -224 __xnpod_schedule+0x8a (xnpod_schedule+0x32)
[  136.524508]  |   #begin   0x80000001   -225 __xnpod_schedule+0x3a (xnpod_schedule+0x32)
[  136.524508]      #func                 -225 __xnpod_schedule+0x11 (xnpod_schedule+0x32)
[  136.524508]      #func                 -225 xnpod_schedule+0x4 (lostage_handler+0xd5)
[  136.524508]  |   #end     0x80000000   -225 __ipipe_restore_pipeline_head+0xfa (T.513+0x7b)
[  136.524508]  |  *#func                 -225 __ipipe_restore_pipeline_head+0x7 (T.513+0x7b)
[  136.524508]  |  *#func                 -226 T.513+0x7 (xnsched_renice_root+0x5c)
[  136.524508]  |  *#[  350] gatekee -1   -226 xnsched_renice_root+0x54 (lostage_handler+0xd0)
[  136.524508]  |  *#func                 -226 xnsched_track_policy+0x4 (xnsched_renice_root+0x3b)
[  136.524508]  |   #begin   0x80000000   -226 T.515+0x20 (xnsched_renice_root+0x25)
[  136.693014]      #func                 -226 T.515+0x9 (xnsched_renice_root+0x25)
[  136.693014]      #func                 -227 xnsched_renice_root+0xd (lostage_handler+0xd0)
[  136.693014]      #func                 -227 lostage_handler+0x14 (rthal_apc_handler+0x8e)
[  136.693014]      #func                 -227 rthal_apc_handler+0xb (__xirq_end+0x7d)
[  136.693014]  |   #end     0x80000001   -227 ipipe_check_context+0xdb (irq_enter+0x71)
[  136.693014]  |   #begin   0x80000001   -227 ipipe_check_context+0x32 (irq_enter+0x71)
[  136.693014]      #func                 -228 ipipe_check_context+0x11 (irq_enter+0x71)
[  136.693014]      #func                 -228 idle_cpu+0x4 (irq_enter+0x22)
[  136.693014]      #func                 -228 rcu_irq_enter+0x4 (irq_enter+0x1b)
[  136.693014]      #func                 -228 irq_enter+0x9 (__xirq_end+0x2e)
[  136.693014]  |   #end     0x80000000   -228 __ipipe_sync_stage+0x16a (__ipipe_walk_pipeline+0x215)
[  136.693014]  |   +func                 -229 __ipipe_sync_stage+0x11 (__ipipe_walk_pipeline+0x215)
[  136.693014]  |   +func                 -229 __ipipe_walk_pipeline+0x11 (__ipipe_dispatch_wired_nocheck+0x1d8)
[  136.693014]  |  # func                 -229 ipipe_restore_pipeline_head+0x7 (T.622+0x24)
[  136.693014]  |  # func                 -229 T.622+0x4 (__xnpod_schedule+0x69f)
[  136.693014]  |  # func                 -230 xnarch_save_fpu+0x4 (__xnpod_switch_fpu+0x44)
[  136.693014]  |  # func                 -230 __xnpod_switch_fpu+0x7 (__xnpod_schedule+0x635)
[  136.693014]  |  # [  350] gatekee 99   -230 __xnpod_schedule+0x554 (xnpod_schedule+0x32)
[  136.693014]  |  # func                 -230 __unlazy_fpu+0x4 (__switch_to+0x17e)
[  136.693014]  |  # func                 -231 __switch_to+0xb (__xnpod_schedule+0x483)
[  136.693014]  |  # func                 -231 xnsched_pick_next+0x4 (__xnpod_schedule+0x129)
[  136.693014]  |  # func                 -231 T.623+0x4 (__xnpod_schedule+0xf0)
[  136.693014]  |  # [ 6309] trivial 99   -231 __xnpod_schedule+0xd2 (xnpod_schedule+0x32)
[  136.693014]  |  # func                 -232 ipipe_test_and_stall_pipeline_head+0x9 (T.625+0xe)
[  136.693014]  |  # func                 -232 T.625+0x4 (__xnpod_schedule+0xaa)
[  136.693014]  |  # func                 -232 __xnpod_schedule+0x11 (xnpod_schedule+0x32)
[  136.693014]  |  # func                 -232 xnpod_schedule+0x4 (xnpod_suspend_thread+0x173)
[  136.693014]  |  # func                 -232 ipipe_test_and_stall_pipeline_head+0x9 (T.625+0xe)
[  136.693014]  |  # func                 -232 T.625+0x4 (xnpod_suspend_thread+0x2b)
[  136.924508]  |  # func                 -233 xnpod_suspend_thread+0x11 (xnshadow_relax+0x7f)
[  136.924508]  |  # func                 -233 ipipe_restore_pipeline_head+0x7 (rthal_apc_schedule+0x5c)
[  136.924508]  |  # func                 -233 __ipipe_set_irq_pending+0x11 (rthal_apc_schedule+0x51)
[  136.924508]  |  # func                 -233 ipipe_test_and_stall_pipeline_head+0x9 (rthal_apc_schedule+0x1e)
[  136.924508]  |  # func                 -233 rthal_apc_schedule+0x7 (schedule_linux_call+0x76)
[  136.924508]  |  # func                 -234 ipipe_restore_pipeline_head+0x7 (schedule_linux_call+0x6b)
[  136.924508]  |  # func                 -234 ipipe_test_and_stall_pipeline_head+0x9 (schedule_linux_call+0x26)
[  136.924508]  |  # func                 -234 schedule_linux_call+0xb (xnshadow_relax+0x59)
[  136.924508]  |  + begin   0x80000000   -234 ipipe_test_and_stall_pipeline_head+0x20 (xnshadow_relax+0x41)
[  136.924508]     + func                 -234 ipipe_test_and_stall_pipeline_head+0x9 (xnshadow_relax+0x41)
[  136.924508]  |  + end     0x80000000   -235 __ipipe_restore_pipeline_head+0xfa (T.513+0x7b)
[  136.924508]  |  # func                 -235 __ipipe_restore_pipeline_head+0x7 (T.513+0x7b)
[  136.924508]  |  # func                 -235 T.513+0x7 (xnsched_renice_root+0x5c)
[  136.924508]  |  # [  350] gatekee 99   -235 xnsched_renice_root+0x54 (rpi_push+0xf6)
[  136.924508]  |  # func                 -235 xnsched_track_policy+0x4 (xnsched_renice_root+0x3b)
[  136.924508]  |  + begin   0x80000000   -236 T.515+0x20 (xnsched_renice_root+0x25)
[  136.924508]     + func                 -236 T.515+0x9 (xnsched_renice_root+0x25)
[  136.924508]     + func                 -236 xnsched_renice_root+0xd (rpi_push+0xf6)
[  136.924508]  |  + end     0x80000000   -236 __ipipe_restore_pipeline_head+0xfa (ipipe_restore_pipeline_head+0x66)
[  137.093014]  |  # func                 -236 __ipipe_restore_pipeline_head+0x7 (ipipe_restore_pipeline_head+0x66)
[  137.093014]  |  # func                 -236 ipipe_restore_pipeline_head+0x7 (xnlock_put_irqrestore+0x23)
[  137.093014]  |  # func                 -237 xnlock_put_irqrestore+0x4 (rpi_push+0xc9)
[  137.093014]  |  # func                 -237 __xnlock_get+0x4 (__xnlock_get_irqsave+0x23)
[  137.093014]  |  + begin   0x80000000   -237 ipipe_test_and_stall_pipeline_head+0x20 (__xnlock_get_irqsave+0x17)
[  137.093014]     + func                 -237 ipipe_test_and_stall_pipeline_head+0x9 (__xnlock_get_irqsave+0x17)
[  137.093014]     + func                 -237 __xnlock_get_irqsave+0x9 (rpi_push+0x49)
[  137.093014]     + func                 -238 rpi_push+0x11 (xnshadow_relax+0x3c)
[  137.093014]     + func                 -238 xnshadow_relax+0xd (hisyscall_event+0x230)
[  137.093014]     + func                 -238 hisyscall_event+0x11 (__ipipe_dispatch_event+0x1b6)
[  137.093014]  |  + end     0x80000001   -238 __ipipe_dispatch_event+0x1a4 (__ipipe_syscall_root+0x4f)
[  137.093014]  |  + begin   0x80000001   -238 __ipipe_dispatch_event+0x34 (__ipipe_syscall_root+0x4f)
[  137.093014]     + func                 -238 __ipipe_dispatch_event+0x11 (__ipipe_syscall_root+0x4f)
[  137.093014]     + func                 -239 __ipipe_event_monitored_p+0xb (__ipipe_syscall_root+0x3a)
[  137.093014]     + func                 -239 __ipipe_syscall_root+0xb (__ipipe_syscall_root_thunk+0x35)
[  137.093014]  |  + begin   0x80000000   -239 __ipipe_syscall_root+0xe1 (__ipipe_syscall_root_thunk+0x35)
[  137.093014]  |  + end     0x80000001   -240 __ipipe_syscall_root+0xbb (__ipipe_syscall_root_thunk+0x35)
[  137.093014]  |  + begin   0x80000001   -240 __ipipe_syscall_root+0x6b (__ipipe_syscall_root_thunk+0x35)
[  137.093014]  |  + end     0x80000001   -240 __ipipe_dispatch_event+0x4b0 (__ipipe_syscall_root+0x4f)
[  137.093014]  |  + begin   0x80000001   -240 __ipipe_dispatch_event+0x1da (__ipipe_syscall_root+0x4f)
[  137.093014]  |  + end     0x80000000   -241 __ipipe_restore_pipeline_head+0xfa (ipipe_restore_pipeline_head+0x66)
[  137.093014]  |  # func                 -241 __ipipe_restore_pipeline_head+0x7 (ipipe_restore_pipeline_head+0x66)
[  137.093014]  |  # func                 -241 ipipe_restore_pipeline_head+0x7 (xnlock_put_irqrestore+0x23)
[  137.093014]  |  # func                 -241 xnlock_put_irqrestore+0x4 (xnshadow_harden+0x1a4)
[  137.093014]  |  # func                 -241 xnarch_save_fpu+0x4 (__xnpod_switch_fpu+0x44)
[  137.093014]  |  # func                 -241 __xnpod_switch_fpu+0x7 (xnpod_switch_fpu+0xe)
[  137.324508]  |  # func                 -242 xnpod_switch_fpu+0x4 (xnshadow_harden+0x187)
[  137.324508]  |  # func                 -242 __unlazy_fpu+0x4 (__switch_to+0x17e)
[  137.324508]  |  # func                 -242 __switch_to+0xb (thread_return+0x0)
[  137.324508]  |  # func                 -243 xnsched_pick_next+0x4 (__xnpod_schedule+0x129)
[  137.324508]  |  # func                 -243 T.623+0x4 (__xnpod_schedule+0xf0)
[  137.324508]  |  # [  350] gatekee -1   -243 __xnpod_schedule+0xd2 (xnpod_schedule+0x32)
[  137.324508]  |  # func                 -243 ipipe_test_and_stall_pipeline_head+0x9 (T.625+0xe)
[  137.324508]  |  # func                 -243 T.625+0x4 (__xnpod_schedule+0xaa)
[  137.324508]  |  # func                 -244 __xnpod_schedule+0x11 (xnpod_schedule+0x32)
[  137.324508]  |  # func                 -244 xnpod_schedule+0x4 (xnpod_schedule_handler+0x59)
[  137.324508]  |  # func                 -244 xnpod_schedule_handler+0x7 (__ipipe_dispatch_wired_nocheck+0x127)
[  137.324508]  |   +func                 -244 __ipipe_dispatch_wired_nocheck+0x11 (__ipipe_dispatch_wired+0xc3)
[  137.324508]  |   +func                 -245 __ipipe_dispatch_wired+0xd (__ipipe_handle_irq+0x128)
[  137.324508]  |   +func                 -245 __ipipe_handle_irq+0x11 (ipipe_trigger_irq+0x71)
[  137.324508]  |   +begin   0x80000001   -245 ipipe_trigger_irq+0x52 (__xnpod_schedule+0xa0)
[  137.324508]      +func                 -245 ipipe_trigger_irq+0x10 (__xnpod_schedule+0xa0)
[  137.324508]  |   +end     0x80000001   -245 __xnpod_schedule+0x8a (xnpod_schedule+0x32)
[  137.324508]  |   +begin   0x80000001   -246 __xnpod_schedule+0x3a (xnpod_schedule+0x32)
[  137.324508]      +func                 -246 __xnpod_schedule+0x11 (xnpod_schedule+0x32)
[  137.324508]      +func                 -246 xnpod_schedule+0x4 (gatekeeper_thread+0x179)
[  137.496549] ---[ end trace 9d22ced1f219c8f9 ]---
[  137.501180] ata2: EH complete

  parent reply	other threads:[~2009-10-06 15:45 UTC|newest]

Thread overview: 19+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2009-10-02 11:48 [Xenomai-help] Freeze on SMP x86-64 Roman Pisl
2009-10-02 12:39 ` Gilles Chanteperdrix
2009-10-02 13:22   ` Roman Pisl
2009-10-02 13:25     ` Gilles Chanteperdrix
2009-10-02 13:34     ` Philippe Gerum
2009-10-02 13:36       ` Philippe Gerum
2009-10-03 16:01     ` Jan Kiszka
     [not found]       ` <4AC9E655.5090006@domain.hid>
     [not found]         ` <4AC9ED6B.4050004@domain.hid>
     [not found]           ` <4AC9F4FA.5070409@domain.hid>
     [not found]             ` <4ACA013F.8040602@domain.hid>
2009-10-06 13:18               ` Roman Pisl
2009-10-06 13:56                 ` Jan Kiszka
2009-10-06 14:50                   ` Roman Pisl
2009-10-06 15:33                   ` Roman Pisl
2009-10-06 15:45                   ` Roman Pisl [this message]
2009-10-06 15:59                     ` Jan Kiszka
2009-10-02 12:45 ` Peter Soetens
2009-10-02 12:58   ` Roman Pisl
2009-10-02 13:40 ` Philippe Gerum
2009-10-02 14:14   ` Roman Pisl
2009-10-02 16:40     ` Gilles Chanteperdrix
2009-10-02 14:21 ` Jan Kiszka

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4ACB6626.6020707@domain.hid \
    --to=rpisl@domain.hid \
    --cc=jan.kiszka@domain.hid \
    --cc=xenomai@xenomai.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.