[Xenomai] Decrease Latency (below 10 us) on x32 or x32

All of lore.kernel.org
 help / color / mirror / Atom feed

* [Xenomai] Decrease Latency (below 10 us) on x32 or x32_64?
@ 2013-03-19 20:14 Manuel Huber
  2013-03-19 20:46 ` Gilles Chanteperdrix
  0 siblings, 1 reply; 12+ messages in thread
From: Manuel Huber @ 2013-03-19 20:14 UTC (permalink / raw)
  To: xenomai

Hello!

We use a AMD FX-61000 CPU together with Xenomai 2.6.2.1 and Kernel
3.5.7 (thanks to Jan Kiszka) and I was wondering if it's possible to
further decrease the latency of the system. I currently can get more
than 30 us when interacting with the system.

My first guess was the graphics card + graphics card driver because I
read about such problems and tested another graphics card which caused
a huge amount of extra-latency... I tried to get the real system
latency by booting the system in recovery mode (single) with vga=792
option + setting the nouveau driver on the blacklist... This seems to
work, but I still get roughly the same latencies (>20us) even after
1hour by using the latency program in interrupt mode (-t 2). Only a
few times the latency grows beyond 10us but still it does... I have
unplugged the usb mouse and keyboard before running the test and
started ten instances of burnK7 with nice -n -20.  I also tried
booting with isolcpus=2,3 and assigned the latency program to cpu 3
(-c 3). This didn't really improve the worst case latency (still the
same setup as above, no gui, single). Is it possible to further
decrease latency (especially worst case latency) by using one cpu just
for real-time tasks? Is there some other way to keep Linux from using
a core?

The next thing I want to test is using 64bits; It seems rational that
using 32 bits with 16GB ram causes some extra latencies but is it
possible that it causes about 10 us extra? Is there some other option
I can tune? I know that the I-Pipe system isn't trivial but to me,
using interrupts seems pretty low-level and I would expect this to
have minimal latency (and jitter). I don't want to complain, it's just
that my supervisor asked me about the source of the latency and I
can't really explain... After having read just about all papers
about I-Pipe, I still don't have a deep understanding of the system.
Is there a good reference I missed?

Best regards, Manuel Huber

-------------- next part --------------
#
# Automatically generated file; DO NOT EDIT.
# Linux/i386 3.5.7-x2621-p6-fhts Kernel Configuration
#
# CONFIG_64BIT is not set
CONFIG_X86_32=y
# CONFIG_X86_64 is not set
CONFIG_X86=y
CONFIG_INSTRUCTION_DECODER=y
CONFIG_OUTPUT_FORMAT="elf32-i386"
CONFIG_ARCH_DEFCONFIG="arch/x86/configs/i386_defconfig"
CONFIG_LOCKDEP_SUPPORT=y
CONFIG_STACKTRACE_SUPPORT=y
CONFIG_HAVE_LATENCYTOP_SUPPORT=y
CONFIG_MMU=y
# CONFIG_NEED_DMA_MAP_STATE is not set
CONFIG_NEED_SG_DMA_LENGTH=y
CONFIG_GENERIC_ISA_DMA=y
CONFIG_GENERIC_BUG=y
CONFIG_GENERIC_HWEIGHT=y
CONFIG_GENERIC_GPIO=y
CONFIG_ARCH_MAY_HAVE_PC_FDC=y
# CONFIG_RWSEM_GENERIC_SPINLOCK is not set
CONFIG_RWSEM_XCHGADD_ALGORITHM=y
CONFIG_GENERIC_CALIBRATE_DELAY=y
CONFIG_ARCH_HAS_CPU_RELAX=y
CONFIG_ARCH_HAS_DEFAULT_IDLE=y
CONFIG_ARCH_HAS_CACHE_LINE_SIZE=y
CONFIG_ARCH_HAS_CPU_AUTOPROBE=y
CONFIG_HAVE_SETUP_PER_CPU_AREA=y
CONFIG_NEED_PER_CPU_EMBED_FIRST_CHUNK=y
CONFIG_NEED_PER_CPU_PAGE_FIRST_CHUNK=y
CONFIG_ARCH_HIBERNATION_POSSIBLE=y
CONFIG_ARCH_SUSPEND_POSSIBLE=y
# CONFIG_ZONE_DMA32 is not set
# CONFIG_AUDIT_ARCH is not set
CONFIG_ARCH_SUPPORTS_OPTIMIZED_INLINING=y
CONFIG_ARCH_SUPPORTS_DEBUG_PAGEALLOC=y
CONFIG_X86_32_SMP=y
CONFIG_X86_HT=y
CONFIG_X86_32_LAZY_GS=y
CONFIG_ARCH_HWEIGHT_CFLAGS="-fcall-saved-ecx -fcall-saved-edx"
CONFIG_ARCH_CPU_PROBE_RELEASE=y
CONFIG_ARCH_SUPPORTS_UPROBES=y
CONFIG_DEFCONFIG_LIST="/lib/modules/$UNAME_RELEASE/.config"
CONFIG_HAVE_IRQ_WORK=y
CONFIG_IRQ_WORK=y
CONFIG_BUILDTIME_EXTABLE_SORT=y

#
# General setup
#
CONFIG_EXPERIMENTAL=y
CONFIG_INIT_ENV_ARG_LIMIT=32
CONFIG_CROSS_COMPILE=""
CONFIG_LOCALVERSION=""
# CONFIG_LOCALVERSION_AUTO is not set
CONFIG_HAVE_KERNEL_GZIP=y
CONFIG_HAVE_KERNEL_BZIP2=y
CONFIG_HAVE_KERNEL_LZMA=y
CONFIG_HAVE_KERNEL_XZ=y
CONFIG_HAVE_KERNEL_LZO=y
CONFIG_KERNEL_GZIP=y
# CONFIG_KERNEL_BZIP2 is not set
# CONFIG_KERNEL_LZMA is not set
# CONFIG_KERNEL_XZ is not set
# CONFIG_KERNEL_LZO is not set
CONFIG_DEFAULT_HOSTNAME="(none)"
CONFIG_SWAP=y
CONFIG_SYSVIPC=y
CONFIG_SYSVIPC_SYSCTL=y
CONFIG_POSIX_MQUEUE=y
CONFIG_POSIX_MQUEUE_SYSCTL=y
CONFIG_BSD_PROCESS_ACCT=y
CONFIG_BSD_PROCESS_ACCT_V3=y
# CONFIG_FHANDLE is not set
CONFIG_TASKSTATS=y
CONFIG_TASK_DELAY_ACCT=y
CONFIG_TASK_XACCT=y
CONFIG_TASK_IO_ACCOUNTING=y
# CONFIG_AUDIT is not set
CONFIG_HAVE_GENERIC_HARDIRQS=y

#
# IRQ subsystem
#
CONFIG_GENERIC_HARDIRQS=y
CONFIG_GENERIC_IRQ_PROBE=y
CONFIG_GENERIC_IRQ_SHOW=y
CONFIG_GENERIC_PENDING_IRQ=y
CONFIG_IRQ_FORCED_THREADING=y
CONFIG_SPARSE_IRQ=y
CONFIG_CLOCKSOURCE_WATCHDOG=y
CONFIG_GENERIC_TIME_VSYSCALL=y
CONFIG_KTIME_SCALAR=y
CONFIG_GENERIC_CLOCKEVENTS=y
CONFIG_GENERIC_CLOCKEVENTS_BUILD=y
CONFIG_GENERIC_CLOCKEVENTS_BROADCAST=y
CONFIG_GENERIC_CLOCKEVENTS_MIN_ADJUST=y
CONFIG_GENERIC_CMOS_UPDATE=y

#
# Timers subsystem
#
CONFIG_TICK_ONESHOT=y
CONFIG_NO_HZ=y
CONFIG_HIGH_RES_TIMERS=y

#
# RCU Subsystem
#
CONFIG_TREE_PREEMPT_RCU=y
CONFIG_PREEMPT_RCU=y
CONFIG_RCU_FANOUT=32
CONFIG_RCU_FANOUT_LEAF=16
# CONFIG_RCU_FANOUT_EXACT is not set
# CONFIG_RCU_FAST_NO_HZ is not set
# CONFIG_TREE_RCU_TRACE is not set
# CONFIG_RCU_BOOST is not set
# CONFIG_IKCONFIG is not set
CONFIG_LOG_BUF_SHIFT=17
CONFIG_HAVE_UNSTABLE_SCHED_CLOCK=y
CONFIG_CGROUPS=y
# CONFIG_CGROUP_DEBUG is not set
CONFIG_CGROUP_FREEZER=y
CONFIG_CGROUP_DEVICE=y
CONFIG_CPUSETS=y
CONFIG_PROC_PID_CPUSET=y
CONFIG_CGROUP_CPUACCT=y
# CONFIG_RESOURCE_COUNTERS is not set
# CONFIG_CGROUP_PERF is not set
CONFIG_CGROUP_SCHED=y
CONFIG_FAIR_GROUP_SCHED=y
# CONFIG_CFS_BANDWIDTH is not set
# CONFIG_RT_GROUP_SCHED is not set
# CONFIG_BLK_CGROUP is not set
# CONFIG_CHECKPOINT_RESTORE is not set
CONFIG_NAMESPACES=y
CONFIG_UTS_NS=y
CONFIG_IPC_NS=y
CONFIG_PID_NS=y
CONFIG_NET_NS=y
# CONFIG_SCHED_AUTOGROUP is not set
# CONFIG_SYSFS_DEPRECATED is not set
CONFIG_RELAY=y
CONFIG_BLK_DEV_INITRD=y
CONFIG_INITRAMFS_SOURCE=""
CONFIG_RD_GZIP=y
CONFIG_RD_BZIP2=y
CONFIG_RD_LZMA=y
CONFIG_RD_XZ=y
CONFIG_RD_LZO=y
CONFIG_CC_OPTIMIZE_FOR_SIZE=y
CONFIG_SYSCTL=y
CONFIG_ANON_INODES=y
# CONFIG_EXPERT is not set
CONFIG_UID16=y
# CONFIG_SYSCTL_SYSCALL is not set
CONFIG_KALLSYMS=y
# CONFIG_KALLSYMS_ALL is not set
CONFIG_HOTPLUG=y
CONFIG_PRINTK=y
CONFIG_BUG=y
CONFIG_ELF_CORE=y
CONFIG_PCSPKR_PLATFORM=y
CONFIG_HAVE_PCSPKR_PLATFORM=y
CONFIG_BASE_FULL=y
CONFIG_FUTEX=y
CONFIG_EPOLL=y
CONFIG_SIGNALFD=y
CONFIG_TIMERFD=y
CONFIG_EVENTFD=y
CONFIG_SHMEM=y
CONFIG_AIO=y
# CONFIG_EMBEDDED is not set
CONFIG_HAVE_PERF_EVENTS=y

#
# Kernel Performance Events And Counters
#
CONFIG_PERF_EVENTS=y
# CONFIG_DEBUG_PERF_USE_VMALLOC is not set
CONFIG_VM_EVENT_COUNTERS=y
CONFIG_PCI_QUIRKS=y
CONFIG_SLUB_DEBUG=y
# CONFIG_COMPAT_BRK is not set
# CONFIG_SLAB is not set
CONFIG_SLUB=y
# CONFIG_PROFILING is not set
CONFIG_HAVE_OPROFILE=y
CONFIG_OPROFILE_NMI_TIMER=y
# CONFIG_KPROBES is not set
# CONFIG_JUMP_LABEL is not set
CONFIG_HAVE_EFFICIENT_UNALIGNED_ACCESS=y
CONFIG_USER_RETURN_NOTIFIER=y
CONFIG_HAVE_IOREMAP_PROT=y
CONFIG_HAVE_KPROBES=y
CONFIG_HAVE_KRETPROBES=y
CONFIG_HAVE_OPTPROBES=y
CONFIG_HAVE_ARCH_TRACEHOOK=y
CONFIG_HAVE_DMA_ATTRS=y
CONFIG_HAVE_DMA_CONTIGUOUS=y
CONFIG_USE_GENERIC_SMP_HELPERS=y
CONFIG_GENERIC_SMP_IDLE_THREAD=y
CONFIG_HAVE_REGS_AND_STACK_ACCESS_API=y
CONFIG_HAVE_DMA_API_DEBUG=y
CONFIG_HAVE_HW_BREAKPOINT=y
CONFIG_HAVE_MIXED_BREAKPOINTS_REGS=y
CONFIG_HAVE_USER_RETURN_NOTIFIER=y
CONFIG_HAVE_PERF_EVENTS_NMI=y
CONFIG_HAVE_ARCH_JUMP_LABEL=y
CONFIG_ARCH_HAVE_NMI_SAFE_CMPXCHG=y
CONFIG_HAVE_ALIGNED_STRUCT_PAGE=y
CONFIG_HAVE_CMPXCHG_LOCAL=y
CONFIG_HAVE_CMPXCHG_DOUBLE=y
CONFIG_HAVE_ARCH_SECCOMP_FILTER=y
CONFIG_SECCOMP_FILTER=y

#
# GCOV-based kernel profiling
#
# CONFIG_GCOV_KERNEL is not set
CONFIG_HAVE_GENERIC_DMA_COHERENT=y
CONFIG_SLABINFO=y
CONFIG_RT_MUTEXES=y
CONFIG_BASE_SMALL=0
CONFIG_MODULES=y
CONFIG_MODULE_FORCE_LOAD=y
CONFIG_MODULE_UNLOAD=y
CONFIG_MODULE_FORCE_UNLOAD=y
CONFIG_MODVERSIONS=y
# CONFIG_MODULE_SRCVERSION_ALL is not set
CONFIG_STOP_MACHINE=y
CONFIG_BLOCK=y
CONFIG_LBDAF=y
CONFIG_BLK_DEV_BSG=y
CONFIG_BLK_DEV_BSGLIB=y
CONFIG_BLK_DEV_INTEGRITY=y

#
# Partition Types
#
CONFIG_PARTITION_ADVANCED=y
CONFIG_ACORN_PARTITION=y
# CONFIG_ACORN_PARTITION_CUMANA is not set
# CONFIG_ACORN_PARTITION_EESOX is not set
CONFIG_ACORN_PARTITION_ICS=y
# CONFIG_ACORN_PARTITION_ADFS is not set
# CONFIG_ACORN_PARTITION_POWERTEC is not set
CONFIG_ACORN_PARTITION_RISCIX=y
CONFIG_OSF_PARTITION=y
CONFIG_AMIGA_PARTITION=y
CONFIG_ATARI_PARTITION=y
CONFIG_MAC_PARTITION=y
CONFIG_MSDOS_PARTITION=y
CONFIG_BSD_DISKLABEL=y
CONFIG_MINIX_SUBPARTITION=y
CONFIG_SOLARIS_X86_PARTITION=y
CONFIG_UNIXWARE_DISKLABEL=y
CONFIG_LDM_PARTITION=y
# CONFIG_LDM_DEBUG is not set
CONFIG_SGI_PARTITION=y
CONFIG_ULTRIX_PARTITION=y
CONFIG_SUN_PARTITION=y
CONFIG_KARMA_PARTITION=y
CONFIG_EFI_PARTITION=y
# CONFIG_SYSV68_PARTITION is not set

#
# IO Schedulers
#
CONFIG_IOSCHED_NOOP=y
CONFIG_IOSCHED_DEADLINE=y
CONFIG_IOSCHED_CFQ=y
# CONFIG_DEFAULT_DEADLINE is not set
CONFIG_DEFAULT_CFQ=y
# CONFIG_DEFAULT_NOOP is not set
CONFIG_DEFAULT_IOSCHED="cfq"
CONFIG_PREEMPT_NOTIFIERS=y
# CONFIG_INLINE_SPIN_TRYLOCK is not set
# CONFIG_INLINE_SPIN_TRYLOCK_BH is not set
# CONFIG_INLINE_SPIN_LOCK is not set
# CONFIG_INLINE_SPIN_LOCK_BH is not set
# CONFIG_INLINE_SPIN_LOCK_IRQ is not set
# CONFIG_INLINE_SPIN_LOCK_IRQSAVE is not set
CONFIG_UNINLINE_SPIN_UNLOCK=y
# CONFIG_INLINE_SPIN_UNLOCK_BH is not set
# CONFIG_INLINE_SPIN_UNLOCK_IRQ is not set
# CONFIG_INLINE_SPIN_UNLOCK_IRQRESTORE is not set
# CONFIG_INLINE_READ_TRYLOCK is not set
# CONFIG_INLINE_READ_LOCK is not set
# CONFIG_INLINE_READ_LOCK_BH is not set
# CONFIG_INLINE_READ_LOCK_IRQ is not set
# CONFIG_INLINE_READ_LOCK_IRQSAVE is not set
# CONFIG_INLINE_READ_UNLOCK is not set
# CONFIG_INLINE_READ_UNLOCK_BH is not set
# CONFIG_INLINE_READ_UNLOCK_IRQ is not set
# CONFIG_INLINE_READ_UNLOCK_IRQRESTORE is not set
# CONFIG_INLINE_WRITE_TRYLOCK is not set
# CONFIG_INLINE_WRITE_LOCK is not set
# CONFIG_INLINE_WRITE_LOCK_BH is not set
# CONFIG_INLINE_WRITE_LOCK_IRQ is not set
# CONFIG_INLINE_WRITE_LOCK_IRQSAVE is not set
# CONFIG_INLINE_WRITE_UNLOCK is not set
# CONFIG_INLINE_WRITE_UNLOCK_BH is not set
# CONFIG_INLINE_WRITE_UNLOCK_IRQ is not set
# CONFIG_INLINE_WRITE_UNLOCK_IRQRESTORE is not set
CONFIG_MUTEX_SPIN_ON_OWNER=y

#
# Real-time sub-system
#
CONFIG_XENOMAI=y
CONFIG_XENO_GENERIC_STACKPOOL=y
CONFIG_XENO_FASTSYNCH=y
CONFIG_XENO_OPT_NUCLEUS=y
CONFIG_XENO_OPT_PERVASIVE=y
# CONFIG_XENO_OPT_PRIOCPL is not set
CONFIG_XENO_OPT_PIPELINE_HEAD=y
# CONFIG_XENO_OPT_SCHED_CLASSES is not set
CONFIG_XENO_OPT_PIPE=y
CONFIG_XENO_OPT_VFILE=y
CONFIG_XENO_OPT_PIPE_NRDEV=32
CONFIG_XENO_OPT_REGISTRY_NRSLOTS=512
CONFIG_XENO_OPT_SYS_HEAPSZ=256
CONFIG_XENO_OPT_SYS_STACKPOOLSZ=128
CONFIG_XENO_OPT_SEM_HEAPSZ=12
CONFIG_XENO_OPT_GLOBAL_SEM_HEAPSZ=12
CONFIG_XENO_OPT_STATS=y
CONFIG_XENO_OPT_DEBUG=y
# CONFIG_XENO_OPT_DEBUG_NUCLEUS is not set
CONFIG_XENO_OPT_DEBUG_XNLOCK=y
# CONFIG_XENO_OPT_DEBUG_QUEUES is not set
# CONFIG_XENO_OPT_DEBUG_REGISTRY is not set
# CONFIG_XENO_OPT_DEBUG_TIMERS is not set
# CONFIG_XENO_OPT_DEBUG_SYNCH_RELAX is not set
CONFIG_XENO_OPT_WATCHDOG=y
CONFIG_XENO_OPT_WATCHDOG_TIMEOUT=4
# CONFIG_XENO_OPT_SHIRQ is not set
CONFIG_XENO_OPT_SELECT=y
CONFIG_XENO_OPT_HOSTRT=y

#
# Timing
#
# CONFIG_XENO_OPT_TIMING_PERIODIC is not set
CONFIG_XENO_OPT_TIMING_VIRTICK=1000
CONFIG_XENO_OPT_TIMING_SCHEDLAT=0

#
# Scalability
#
# CONFIG_XENO_OPT_SCALABLE_SCHED is not set
CONFIG_XENO_OPT_TIMER_LIST=y
# CONFIG_XENO_OPT_TIMER_HEAP is not set
# CONFIG_XENO_OPT_TIMER_WHEEL is not set

#
# Machine
#
CONFIG_XENO_HW_FPU=y

#
# SMI workaround
#
# CONFIG_XENO_HW_SMI_DETECT_DISABLE is not set
CONFIG_XENO_HW_SMI_DETECT=y
# CONFIG_XENO_HW_SMI_WORKAROUND is not set

#
# Interfaces
#
CONFIG_XENO_SKIN_NATIVE=y
CONFIG_XENO_OPT_NATIVE_PERIOD=0
CONFIG_XENO_OPT_NATIVE_PIPE=y
CONFIG_XENO_OPT_NATIVE_PIPE_BUFSZ=1024
CONFIG_XENO_OPT_NATIVE_SEM=y
CONFIG_XENO_OPT_NATIVE_EVENT=y
CONFIG_XENO_OPT_NATIVE_MUTEX=y
CONFIG_XENO_OPT_NATIVE_COND=y
CONFIG_XENO_OPT_NATIVE_QUEUE=y
CONFIG_XENO_OPT_NATIVE_BUFFER=y
CONFIG_XENO_OPT_NATIVE_HEAP=y
CONFIG_XENO_OPT_NATIVE_ALARM=y
CONFIG_XENO_OPT_NATIVE_MPS=y
CONFIG_XENO_OPT_NATIVE_INTR=y
CONFIG_XENO_OPT_DEBUG_NATIVE=y
CONFIG_XENO_SKIN_POSIX=y
CONFIG_XENO_OPT_POSIX_PERIOD=0
# CONFIG_XENO_OPT_POSIX_SHM is not set
CONFIG_XENO_OPT_POSIX_INTR=y
CONFIG_XENO_OPT_POSIX_SELECT=y
# CONFIG_XENO_OPT_DEBUG_POSIX is not set
# CONFIG_XENO_SKIN_PSOS is not set
# CONFIG_XENO_SKIN_UITRON is not set
# CONFIG_XENO_SKIN_VRTX is not set
# CONFIG_XENO_SKIN_VXWORKS is not set
# CONFIG_XENO_OPT_NOWARN_DEPRECATED is not set
CONFIG_XENO_SKIN_RTDM=y
CONFIG_XENO_OPT_RTDM_PERIOD=0
CONFIG_XENO_OPT_RTDM_FILDES=128
CONFIG_XENO_OPT_RTDM_SELECT=y
# CONFIG_XENO_OPT_DEBUG_RTDM is not set
# CONFIG_XENO_OPT_DEBUG_RTDM_APPL is not set

#
# Drivers
#

#
# Serial drivers
#
# CONFIG_XENO_DRIVERS_16550A is not set

#
# Testing drivers
#
CONFIG_XENO_DRIVERS_TIMERBENCH=y
# CONFIG_XENO_DRIVERS_KLATENCY is not set
# CONFIG_XENO_DRIVERS_IRQBENCH is not set
CONFIG_XENO_DRIVERS_SWITCHTEST=y
# CONFIG_XENO_DRIVERS_RTDMTEST is not set

#
# CAN drivers
#
# CONFIG_XENO_DRIVERS_CAN is not set

#
# ANALOGY drivers
#
# CONFIG_XENO_DRIVERS_ANALOGY is not set

#
# Real-time IPC drivers
#
# CONFIG_XENO_DRIVERS_RTIPC is not set
CONFIG_FREEZER=y

#
# Processor type and features
#
CONFIG_ZONE_DMA=y
CONFIG_SMP=y
CONFIG_X86_MPPARSE=y
CONFIG_X86_BIGSMP=y
# CONFIG_X86_EXTENDED_PLATFORM is not set
CONFIG_X86_SUPPORTS_MEMORY_FAILURE=y
# CONFIG_X86_32_IRIS is not set
CONFIG_SCHED_OMIT_FRAME_POINTER=y
CONFIG_NO_BOOTMEM=y
# CONFIG_MEMTEST is not set
# CONFIG_M386 is not set
# CONFIG_M486 is not set
# CONFIG_M586 is not set
# CONFIG_M586TSC is not set
# CONFIG_M586MMX is not set
# CONFIG_M686 is not set
# CONFIG_MPENTIUMII is not set
# CONFIG_MPENTIUMIII is not set
# CONFIG_MPENTIUMM is not set
# CONFIG_MPENTIUM4 is not set
# CONFIG_MK6 is not set
CONFIG_MK7=y
# CONFIG_MK8 is not set
# CONFIG_MCRUSOE is not set
# CONFIG_MEFFICEON is not set
# CONFIG_MWINCHIPC6 is not set
# CONFIG_MWINCHIP3D is not set
# CONFIG_MELAN is not set
# CONFIG_MGEODEGX1 is not set
# CONFIG_MGEODE_LX is not set
# CONFIG_MCYRIXIII is not set
# CONFIG_MVIAC3_2 is not set
# CONFIG_MVIAC7 is not set
# CONFIG_MCORE2 is not set
# CONFIG_MATOM is not set
# CONFIG_X86_GENERIC is not set
CONFIG_X86_INTERNODE_CACHE_SHIFT=6
CONFIG_X86_CMPXCHG=y
CONFIG_X86_L1_CACHE_SHIFT=6
CONFIG_X86_XADD=y
CONFIG_X86_WP_WORKS_OK=y
CONFIG_X86_INVLPG=y
CONFIG_X86_BSWAP=y
CONFIG_X86_POPAD_OK=y
CONFIG_X86_INTEL_USERCOPY=y
CONFIG_X86_USE_PPRO_CHECKSUM=y
CONFIG_X86_USE_3DNOW=y
CONFIG_X86_TSC=y
CONFIG_X86_CMPXCHG64=y
CONFIG_X86_CMOV=y
CONFIG_X86_MINIMUM_CPU_FAMILY=5
CONFIG_X86_DEBUGCTLMSR=y
CONFIG_CPU_SUP_INTEL=y
CONFIG_CPU_SUP_AMD=y
CONFIG_CPU_SUP_CENTAUR=y
CONFIG_CPU_SUP_TRANSMETA_32=y
CONFIG_HPET_TIMER=y
CONFIG_HPET_EMULATE_RTC=y
CONFIG_DMI=y
# CONFIG_IOMMU_HELPER is not set
CONFIG_NR_CPUS=32
CONFIG_SCHED_SMT=y
CONFIG_SCHED_MC=y
# CONFIG_IRQ_TIME_ACCOUNTING is not set
# CONFIG_PREEMPT_NONE is not set
# CONFIG_PREEMPT_VOLUNTARY is not set
CONFIG_PREEMPT=y
CONFIG_PREEMPT_COUNT=y
CONFIG_IPIPE=y
CONFIG_IPIPE_CORE=y
CONFIG_IPIPE_WANT_CLOCKSOURCE=y
CONFIG_IPIPE_CORE_APIREV=2
CONFIG_IPIPE_WANT_APIREV_2=y
CONFIG_IPIPE_TARGET_APIREV=2
CONFIG_IPIPE_LEGACY=y
CONFIG_IPIPE_HAVE_HOSTRT=y
CONFIG_IPIPE_DELAYED_ATOMICSW=y
CONFIG_X86_LOCAL_APIC=y
CONFIG_X86_IO_APIC=y
CONFIG_X86_REROUTE_FOR_BROKEN_BOOT_IRQS=y
CONFIG_X86_MCE=y
CONFIG_X86_MCE_INTEL=y
CONFIG_X86_MCE_AMD=y
# CONFIG_X86_ANCIENT_MCE is not set
CONFIG_X86_MCE_THRESHOLD=y
# CONFIG_X86_MCE_INJECT is not set
CONFIG_X86_THERMAL_VECTOR=y
CONFIG_VM86=y
# CONFIG_TOSHIBA is not set
# CONFIG_I8K is not set
CONFIG_X86_REBOOTFIXUPS=y
CONFIG_MICROCODE=m
CONFIG_MICROCODE_INTEL=y
CONFIG_MICROCODE_AMD=y
CONFIG_MICROCODE_OLD_INTERFACE=y
CONFIG_X86_MSR=m
CONFIG_X86_CPUID=m
# CONFIG_NOHIGHMEM is not set
# CONFIG_HIGHMEM4G is not set
CONFIG_HIGHMEM64G=y
CONFIG_PAGE_OFFSET=0xC0000000
CONFIG_HIGHMEM=y
CONFIG_X86_PAE=y
CONFIG_ARCH_PHYS_ADDR_T_64BIT=y
CONFIG_ARCH_DMA_ADDR_T_64BIT=y
CONFIG_NUMA=y
# CONFIG_NUMA_EMU is not set
CONFIG_NODES_SHIFT=3
CONFIG_HAVE_ARCH_ALLOC_REMAP=y
CONFIG_ARCH_HAVE_MEMORY_PRESENT=y
CONFIG_NEED_NODE_MEMMAP_SIZE=y
CONFIG_ARCH_DISCONTIGMEM_ENABLE=y
CONFIG_ARCH_DISCONTIGMEM_DEFAULT=y
CONFIG_ARCH_SPARSEMEM_ENABLE=y
CONFIG_ARCH_SELECT_MEMORY_MODEL=y
CONFIG_ILLEGAL_POINTER_VALUE=0
CONFIG_SELECT_MEMORY_MODEL=y
CONFIG_DISCONTIGMEM_MANUAL=y
# CONFIG_SPARSEMEM_MANUAL is not set
CONFIG_DISCONTIGMEM=y
CONFIG_FLAT_NODE_MEM_MAP=y
CONFIG_NEED_MULTIPLE_NODES=y
CONFIG_HAVE_MEMORY_PRESENT=y
CONFIG_SPARSEMEM_STATIC=y
CONFIG_HAVE_MEMBLOCK=y
CONFIG_HAVE_MEMBLOCK_NODE_MAP=y
CONFIG_ARCH_DISCARD_MEMBLOCK=y
CONFIG_PAGEFLAGS_EXTENDED=y
CONFIG_SPLIT_PTLOCK_CPUS=4
# CONFIG_COMPACTION is not set
CONFIG_MIGRATION=y
CONFIG_PHYS_ADDR_T_64BIT=y
CONFIG_ZONE_DMA_FLAG=1
CONFIG_BOUNCE=y
CONFIG_VIRT_TO_BUS=y
CONFIG_MMU_NOTIFIER=y
CONFIG_KSM=y
CONFIG_DEFAULT_MMAP_MIN_ADDR=65536
CONFIG_ARCH_SUPPORTS_MEMORY_FAILURE=y
CONFIG_MEMORY_FAILURE=y
CONFIG_HWPOISON_INJECT=m
CONFIG_CROSS_MEMORY_ATTACH=y
# CONFIG_CLEANCACHE is not set
# CONFIG_FRONTSWAP is not set
CONFIG_HIGHPTE=y
# CONFIG_X86_CHECK_BIOS_CORRUPTION is not set
CONFIG_X86_RESERVE_LOW=64
# CONFIG_MATH_EMULATION is not set
CONFIG_MTRR=y
CONFIG_MTRR_SANITIZER=y
CONFIG_MTRR_SANITIZER_ENABLE_DEFAULT=0
CONFIG_MTRR_SANITIZER_SPARE_REG_NR_DEFAULT=1
CONFIG_X86_PAT=y
CONFIG_ARCH_USES_PG_UNCACHED=y
CONFIG_ARCH_RANDOM=y
CONFIG_EFI=y
# CONFIG_EFI_STUB is not set
CONFIG_SECCOMP=y
# CONFIG_CC_STACKPROTECTOR is not set
# CONFIG_HZ_100 is not set
CONFIG_HZ_250=y
# CONFIG_HZ_300 is not set
# CONFIG_HZ_1000 is not set
CONFIG_HZ=250
CONFIG_SCHED_HRTICK=y
CONFIG_KEXEC=y
# CONFIG_CRASH_DUMP is not set
# CONFIG_KEXEC_JUMP is not set
CONFIG_PHYSICAL_START=0x1000000
CONFIG_RELOCATABLE=y
CONFIG_X86_NEED_RELOCS=y
CONFIG_PHYSICAL_ALIGN=0x1000000
CONFIG_HOTPLUG_CPU=y
# CONFIG_COMPAT_VDSO is not set
# CONFIG_CMDLINE_BOOL is not set
CONFIG_ARCH_ENABLE_MEMORY_HOTPLUG=y
CONFIG_USE_PERCPU_NUMA_NODE_ID=y

#
# Power management and ACPI options
#
CONFIG_SUSPEND=y
CONFIG_SUSPEND_FREEZER=y
CONFIG_HIBERNATE_CALLBACKS=y
CONFIG_HIBERNATION=y
CONFIG_PM_STD_PARTITION=""
CONFIG_PM_SLEEP=y
CONFIG_PM_SLEEP_SMP=y
# CONFIG_PM_AUTOSLEEP is not set
# CONFIG_PM_WAKELOCKS is not set
CONFIG_PM_RUNTIME=y
CONFIG_PM=y
CONFIG_PM_DEBUG=y
# CONFIG_PM_ADVANCED_DEBUG is not set
# CONFIG_PM_TEST_SUSPEND is not set
CONFIG_CAN_PM_TRACE=y
# CONFIG_PM_TRACE_RTC is not set
CONFIG_ACPI=y
CONFIG_ACPI_SLEEP=y
CONFIG_ACPI_PROCFS=y
# CONFIG_ACPI_PROCFS_POWER is not set
# CONFIG_ACPI_EC_DEBUGFS is not set
# CONFIG_ACPI_PROC_EVENT is not set
CONFIG_ACPI_AC=m
CONFIG_ACPI_BATTERY=m
CONFIG_ACPI_BUTTON=m
CONFIG_ACPI_VIDEO=m
CONFIG_ACPI_FAN=m
CONFIG_ACPI_DOCK=y
# CONFIG_ACPI_PROCESSOR is not set
# CONFIG_ACPI_IPMI is not set
# CONFIG_ACPI_NUMA is not set
# CONFIG_ACPI_CUSTOM_DSDT is not set
CONFIG_ACPI_BLACKLIST_YEAR=0
# CONFIG_ACPI_DEBUG is not set
CONFIG_ACPI_PCI_SLOT=m
CONFIG_X86_PM_TIMER=y
CONFIG_ACPI_CONTAINER=m
CONFIG_ACPI_SBS=m
# CONFIG_ACPI_HED is not set
# CONFIG_ACPI_CUSTOM_METHOD is not set
# CONFIG_ACPI_BGRT is not set
# CONFIG_ACPI_APEI is not set
CONFIG_SFI=y
# CONFIG_APM is not set

#
# CPU Frequency scaling
#
# CONFIG_CPU_FREQ is not set
# CONFIG_CPU_IDLE is not set

#
# Bus options (PCI etc.)
#
CONFIG_PCI=y
# CONFIG_PCI_GOBIOS is not set
# CONFIG_PCI_GOMMCONFIG is not set
# CONFIG_PCI_GODIRECT is not set
CONFIG_PCI_GOANY=y
CONFIG_PCI_BIOS=y
CONFIG_PCI_DIRECT=y
CONFIG_PCI_MMCONFIG=y
CONFIG_PCI_DOMAINS=y
# CONFIG_PCI_CNB20LE_QUIRK is not set
CONFIG_PCIEPORTBUS=y
CONFIG_HOTPLUG_PCI_PCIE=m
CONFIG_PCIEAER=y
# CONFIG_PCIE_ECRC is not set
CONFIG_PCIEAER_INJECT=m
CONFIG_PCIEASPM=y
# CONFIG_PCIEASPM_DEBUG is not set
CONFIG_PCIEASPM_DEFAULT=y
# CONFIG_PCIEASPM_POWERSAVE is not set
# CONFIG_PCIEASPM_PERFORMANCE is not set
CONFIG_PCIE_PME=y
CONFIG_ARCH_SUPPORTS_MSI=y
# CONFIG_PCI_MSI is not set
# CONFIG_PCI_DEBUG is not set
# CONFIG_PCI_REALLOC_ENABLE_AUTO is not set
CONFIG_PCI_STUB=m
CONFIG_HT_IRQ=y
CONFIG_PCI_ATS=y
CONFIG_PCI_IOV=y
# CONFIG_PCI_PRI is not set
# CONFIG_PCI_PASID is not set
# CONFIG_PCI_IOAPIC is not set
CONFIG_PCI_LABEL=y
CONFIG_ISA_DMA_API=y
CONFIG_ISA=y
# CONFIG_EISA is not set
CONFIG_SCx200=m
CONFIG_SCx200HR_TIMER=m
# CONFIG_ALIX is not set
# CONFIG_NET5501 is not set
# CONFIG_GEOS is not set
CONFIG_AMD_NB=y
CONFIG_PCCARD=m
CONFIG_PCMCIA=m
CONFIG_PCMCIA_LOAD_CIS=y
CONFIG_CARDBUS=y

#
# PC-card bridges
#
CONFIG_YENTA=m
CONFIG_YENTA_O2=y
CONFIG_YENTA_RICOH=y
CONFIG_YENTA_TI=y
CONFIG_YENTA_ENE_TUNE=y
CONFIG_YENTA_TOSHIBA=y
CONFIG_PD6729=m
CONFIG_I82092=m
CONFIG_I82365=m
CONFIG_TCIC=m
CONFIG_PCMCIA_PROBE=y
CONFIG_PCCARD_NONSTATIC=y
CONFIG_HOTPLUG_PCI=m
CONFIG_HOTPLUG_PCI_FAKE=m
CONFIG_HOTPLUG_PCI_COMPAQ=m
# CONFIG_HOTPLUG_PCI_COMPAQ_NVRAM is not set
CONFIG_HOTPLUG_PCI_IBM=m
CONFIG_HOTPLUG_PCI_ACPI=m
CONFIG_HOTPLUG_PCI_ACPI_IBM=m
CONFIG_HOTPLUG_PCI_CPCI=y
CONFIG_HOTPLUG_PCI_CPCI_ZT5550=m
CONFIG_HOTPLUG_PCI_CPCI_GENERIC=m
CONFIG_HOTPLUG_PCI_SHPC=m
# CONFIG_RAPIDIO is not set

#
# Executable file formats / Emulations
#
CONFIG_BINFMT_ELF=y
CONFIG_ARCH_BINFMT_ELF_RANDOMIZE_PIE=y
CONFIG_CORE_DUMP_DEFAULT_ELF_HEADERS=y
CONFIG_HAVE_AOUT=y
CONFIG_BINFMT_AOUT=m
CONFIG_BINFMT_MISC=m
CONFIG_HAVE_ATOMIC_IOMAP=y
CONFIG_HAVE_TEXT_POKE_SMP=y
CONFIG_NET=y

#
# Networking options
#
CONFIG_PACKET=y
CONFIG_UNIX=y
# CONFIG_UNIX_DIAG is not set
CONFIG_XFRM=y
CONFIG_XFRM_ALGO=m
CONFIG_XFRM_USER=m
CONFIG_XFRM_SUB_POLICY=y
CONFIG_XFRM_MIGRATE=y
# CONFIG_XFRM_STATISTICS is not set
CONFIG_XFRM_IPCOMP=m
CONFIG_NET_KEY=m
CONFIG_NET_KEY_MIGRATE=y
CONFIG_INET=y
CONFIG_IP_MULTICAST=y
CONFIG_IP_ADVANCED_ROUTER=y
# CONFIG_IP_FIB_TRIE_STATS is not set
CONFIG_IP_MULTIPLE_TABLES=y
CONFIG_IP_ROUTE_MULTIPATH=y
CONFIG_IP_ROUTE_VERBOSE=y
CONFIG_IP_ROUTE_CLASSID=y
# CONFIG_IP_PNP is not set
CONFIG_NET_IPIP=m
# CONFIG_NET_IPGRE_DEMUX is not set
CONFIG_IP_MROUTE=y
# CONFIG_IP_MROUTE_MULTIPLE_TABLES is not set
CONFIG_IP_PIMSM_V1=y
CONFIG_IP_PIMSM_V2=y
# CONFIG_ARPD is not set
CONFIG_SYN_COOKIES=y
CONFIG_INET_AH=m
CONFIG_INET_ESP=m
CONFIG_INET_IPCOMP=m
CONFIG_INET_XFRM_TUNNEL=m
CONFIG_INET_TUNNEL=m
CONFIG_INET_XFRM_MODE_TRANSPORT=m
CONFIG_INET_XFRM_MODE_TUNNEL=m
CONFIG_INET_XFRM_MODE_BEET=m
CONFIG_INET_LRO=m
CONFIG_INET_DIAG=m
CONFIG_INET_TCP_DIAG=m
CONFIG_INET_UDP_DIAG=m
CONFIG_TCP_CONG_ADVANCED=y
CONFIG_TCP_CONG_BIC=m
CONFIG_TCP_CONG_CUBIC=y
CONFIG_TCP_CONG_WESTWOOD=m
CONFIG_TCP_CONG_HTCP=m
CONFIG_TCP_CONG_HSTCP=m
CONFIG_TCP_CONG_HYBLA=m
CONFIG_TCP_CONG_VEGAS=m
CONFIG_TCP_CONG_SCALABLE=m
CONFIG_TCP_CONG_LP=m
CONFIG_TCP_CONG_VENO=m
CONFIG_TCP_CONG_YEAH=m
CONFIG_TCP_CONG_ILLINOIS=m
CONFIG_DEFAULT_CUBIC=y
# CONFIG_DEFAULT_RENO is not set
CONFIG_DEFAULT_TCP_CONG="cubic"
CONFIG_TCP_MD5SIG=y
CONFIG_IPV6=y
CONFIG_IPV6_PRIVACY=y
CONFIG_IPV6_ROUTER_PREF=y
CONFIG_IPV6_ROUTE_INFO=y
CONFIG_IPV6_OPTIMISTIC_DAD=y
CONFIG_INET6_AH=m
CONFIG_INET6_ESP=m
CONFIG_INET6_IPCOMP=m
CONFIG_IPV6_MIP6=y
CONFIG_INET6_XFRM_TUNNEL=m
CONFIG_INET6_TUNNEL=m
CONFIG_INET6_XFRM_MODE_TRANSPORT=m
CONFIG_INET6_XFRM_MODE_TUNNEL=m
CONFIG_INET6_XFRM_MODE_BEET=m
CONFIG_INET6_XFRM_MODE_ROUTEOPTIMIZATION=m
CONFIG_IPV6_SIT=m
# CONFIG_IPV6_SIT_6RD is not set
CONFIG_IPV6_NDISC_NODETYPE=y
CONFIG_IPV6_TUNNEL=m
CONFIG_IPV6_MULTIPLE_TABLES=y
CONFIG_IPV6_SUBTREES=y
CONFIG_IPV6_MROUTE=y
# CONFIG_IPV6_MROUTE_MULTIPLE_TABLES is not set
CONFIG_IPV6_PIMSM_V2=y
# CONFIG_NETLABEL is not set
CONFIG_NETWORK_SECMARK=y
CONFIG_NETWORK_PHY_TIMESTAMPING=y
CONFIG_NETFILTER=y
# CONFIG_NETFILTER_DEBUG is not set
CONFIG_NETFILTER_ADVANCED=y
CONFIG_BRIDGE_NETFILTER=y

#
# Core Netfilter Configuration
#
CONFIG_NETFILTER_NETLINK=m
# CONFIG_NETFILTER_NETLINK_ACCT is not set
CONFIG_NETFILTER_NETLINK_QUEUE=m
CONFIG_NETFILTER_NETLINK_LOG=m
CONFIG_NF_CONNTRACK=m
CONFIG_NF_CONNTRACK_MARK=y
CONFIG_NF_CONNTRACK_SECMARK=y
CONFIG_NF_CONNTRACK_PROCFS=y
CONFIG_NF_CONNTRACK_EVENTS=y
# CONFIG_NF_CONNTRACK_TIMEOUT is not set
# CONFIG_NF_CONNTRACK_TIMESTAMP is not set
CONFIG_NF_CT_PROTO_DCCP=m
CONFIG_NF_CT_PROTO_GRE=m
CONFIG_NF_CT_PROTO_SCTP=m
CONFIG_NF_CT_PROTO_UDPLITE=m
CONFIG_NF_CONNTRACK_AMANDA=m
CONFIG_NF_CONNTRACK_FTP=m
CONFIG_NF_CONNTRACK_H323=m
CONFIG_NF_CONNTRACK_IRC=m
CONFIG_NF_CONNTRACK_BROADCAST=m
CONFIG_NF_CONNTRACK_NETBIOS_NS=m
# CONFIG_NF_CONNTRACK_SNMP is not set
CONFIG_NF_CONNTRACK_PPTP=m
CONFIG_NF_CONNTRACK_SANE=m
CONFIG_NF_CONNTRACK_SIP=m
CONFIG_NF_CONNTRACK_TFTP=m
CONFIG_NF_CT_NETLINK=m
# CONFIG_NF_CT_NETLINK_TIMEOUT is not set
CONFIG_NETFILTER_TPROXY=m
CONFIG_NETFILTER_XTABLES=m

#
# Xtables combined modules
#
CONFIG_NETFILTER_XT_MARK=m
CONFIG_NETFILTER_XT_CONNMARK=m

#
# Xtables targets
#
# CONFIG_NETFILTER_XT_TARGET_CHECKSUM is not set
CONFIG_NETFILTER_XT_TARGET_CLASSIFY=m
CONFIG_NETFILTER_XT_TARGET_CONNMARK=m
CONFIG_NETFILTER_XT_TARGET_CONNSECMARK=m
# CONFIG_NETFILTER_XT_TARGET_CT is not set
CONFIG_NETFILTER_XT_TARGET_DSCP=m
CONFIG_NETFILTER_XT_TARGET_HL=m
# CONFIG_NETFILTER_XT_TARGET_HMARK is not set
# CONFIG_NETFILTER_XT_TARGET_IDLETIMER is not set
CONFIG_NETFILTER_XT_TARGET_LED=m
# CONFIG_NETFILTER_XT_TARGET_LOG is not set
CONFIG_NETFILTER_XT_TARGET_MARK=m
CONFIG_NETFILTER_XT_TARGET_NFLOG=m
CONFIG_NETFILTER_XT_TARGET_NFQUEUE=m
CONFIG_NETFILTER_XT_TARGET_NOTRACK=m
CONFIG_NETFILTER_XT_TARGET_RATEEST=m
# CONFIG_NETFILTER_XT_TARGET_TEE is not set
CONFIG_NETFILTER_XT_TARGET_TPROXY=m
CONFIG_NETFILTER_XT_TARGET_TRACE=m
CONFIG_NETFILTER_XT_TARGET_SECMARK=m
CONFIG_NETFILTER_XT_TARGET_TCPMSS=m
CONFIG_NETFILTER_XT_TARGET_TCPOPTSTRIP=m

#
# Xtables matches
#
# CONFIG_NETFILTER_XT_MATCH_ADDRTYPE is not set
CONFIG_NETFILTER_XT_MATCH_CLUSTER=m
CONFIG_NETFILTER_XT_MATCH_COMMENT=m
CONFIG_NETFILTER_XT_MATCH_CONNBYTES=m
CONFIG_NETFILTER_XT_MATCH_CONNLIMIT=m
CONFIG_NETFILTER_XT_MATCH_CONNMARK=m
CONFIG_NETFILTER_XT_MATCH_CONNTRACK=m
# CONFIG_NETFILTER_XT_MATCH_CPU is not set
CONFIG_NETFILTER_XT_MATCH_DCCP=m
# CONFIG_NETFILTER_XT_MATCH_DEVGROUP is not set
CONFIG_NETFILTER_XT_MATCH_DSCP=m
CONFIG_NETFILTER_XT_MATCH_ECN=m
CONFIG_NETFILTER_XT_MATCH_ESP=m
CONFIG_NETFILTER_XT_MATCH_HASHLIMIT=m
CONFIG_NETFILTER_XT_MATCH_HELPER=m
CONFIG_NETFILTER_XT_MATCH_HL=m
CONFIG_NETFILTER_XT_MATCH_IPRANGE=m
# CONFIG_NETFILTER_XT_MATCH_IPVS is not set
CONFIG_NETFILTER_XT_MATCH_LENGTH=m
CONFIG_NETFILTER_XT_MATCH_LIMIT=m
CONFIG_NETFILTER_XT_MATCH_MAC=m
CONFIG_NETFILTER_XT_MATCH_MARK=m
CONFIG_NETFILTER_XT_MATCH_MULTIPORT=m
# CONFIG_NETFILTER_XT_MATCH_NFACCT is not set
CONFIG_NETFILTER_XT_MATCH_OSF=m
CONFIG_NETFILTER_XT_MATCH_OWNER=m
CONFIG_NETFILTER_XT_MATCH_POLICY=m
CONFIG_NETFILTER_XT_MATCH_PHYSDEV=m
CONFIG_NETFILTER_XT_MATCH_PKTTYPE=m
CONFIG_NETFILTER_XT_MATCH_QUOTA=m
CONFIG_NETFILTER_XT_MATCH_RATEEST=m
CONFIG_NETFILTER_XT_MATCH_REALM=m
CONFIG_NETFILTER_XT_MATCH_RECENT=m
CONFIG_NETFILTER_XT_MATCH_SCTP=m
CONFIG_NETFILTER_XT_MATCH_SOCKET=m
CONFIG_NETFILTER_XT_MATCH_STATE=m
CONFIG_NETFILTER_XT_MATCH_STATISTIC=m
CONFIG_NETFILTER_XT_MATCH_STRING=m
CONFIG_NETFILTER_XT_MATCH_TCPMSS=m
CONFIG_NETFILTER_XT_MATCH_TIME=m
CONFIG_NETFILTER_XT_MATCH_U32=m
# CONFIG_IP_SET is not set
CONFIG_IP_VS=m
CONFIG_IP_VS_IPV6=y
# CONFIG_IP_VS_DEBUG is not set
CONFIG_IP_VS_TAB_BITS=12

#
# IPVS transport protocol load balancing support
#
CONFIG_IP_VS_PROTO_TCP=y
CONFIG_IP_VS_PROTO_UDP=y
CONFIG_IP_VS_PROTO_AH_ESP=y
CONFIG_IP_VS_PROTO_ESP=y
CONFIG_IP_VS_PROTO_AH=y
# CONFIG_IP_VS_PROTO_SCTP is not set

#
# IPVS scheduler
#
CONFIG_IP_VS_RR=m
CONFIG_IP_VS_WRR=m
CONFIG_IP_VS_LC=m
CONFIG_IP_VS_WLC=m
CONFIG_IP_VS_LBLC=m
CONFIG_IP_VS_LBLCR=m
CONFIG_IP_VS_DH=m
CONFIG_IP_VS_SH=m
CONFIG_IP_VS_SED=m
CONFIG_IP_VS_NQ=m

#
# IPVS SH scheduler
#
CONFIG_IP_VS_SH_TAB_BITS=8

#
# IPVS application helper
#
CONFIG_IP_VS_FTP=m
CONFIG_IP_VS_NFCT=y
# CONFIG_IP_VS_PE_SIP is not set

#
# IP: Netfilter Configuration
#
CONFIG_NF_DEFRAG_IPV4=m
CONFIG_NF_CONNTRACK_IPV4=m
CONFIG_NF_CONNTRACK_PROC_COMPAT=y
CONFIG_IP_NF_QUEUE=m
CONFIG_IP_NF_IPTABLES=m
CONFIG_IP_NF_MATCH_AH=m
CONFIG_IP_NF_MATCH_ECN=m
# CONFIG_IP_NF_MATCH_RPFILTER is not set
CONFIG_IP_NF_MATCH_TTL=m
CONFIG_IP_NF_FILTER=m
CONFIG_IP_NF_TARGET_REJECT=m
CONFIG_IP_NF_TARGET_ULOG=m
CONFIG_NF_NAT=m
CONFIG_NF_NAT_NEEDED=y
CONFIG_IP_NF_TARGET_MASQUERADE=m
CONFIG_IP_NF_TARGET_NETMAP=m
CONFIG_IP_NF_TARGET_REDIRECT=m
CONFIG_NF_NAT_PROTO_DCCP=m
CONFIG_NF_NAT_PROTO_GRE=m
CONFIG_NF_NAT_PROTO_UDPLITE=m
CONFIG_NF_NAT_PROTO_SCTP=m
CONFIG_NF_NAT_FTP=m
CONFIG_NF_NAT_IRC=m
CONFIG_NF_NAT_TFTP=m
CONFIG_NF_NAT_AMANDA=m
CONFIG_NF_NAT_PPTP=m
CONFIG_NF_NAT_H323=m
CONFIG_NF_NAT_SIP=m
CONFIG_IP_NF_MANGLE=m
CONFIG_IP_NF_TARGET_CLUSTERIP=m
CONFIG_IP_NF_TARGET_ECN=m
CONFIG_IP_NF_TARGET_TTL=m
CONFIG_IP_NF_RAW=m
CONFIG_IP_NF_SECURITY=m
CONFIG_IP_NF_ARPTABLES=m
CONFIG_IP_NF_ARPFILTER=m
CONFIG_IP_NF_ARP_MANGLE=m

#
# IPv6: Netfilter Configuration
#
CONFIG_NF_DEFRAG_IPV6=m
CONFIG_NF_CONNTRACK_IPV6=m
CONFIG_IP6_NF_IPTABLES=m
CONFIG_IP6_NF_MATCH_AH=m
CONFIG_IP6_NF_MATCH_EUI64=m
CONFIG_IP6_NF_MATCH_FRAG=m
CONFIG_IP6_NF_MATCH_OPTS=m
CONFIG_IP6_NF_MATCH_HL=m
CONFIG_IP6_NF_MATCH_IPV6HEADER=m
CONFIG_IP6_NF_MATCH_MH=m
# CONFIG_IP6_NF_MATCH_RPFILTER is not set
CONFIG_IP6_NF_MATCH_RT=m
CONFIG_IP6_NF_TARGET_HL=m
CONFIG_IP6_NF_FILTER=m
CONFIG_IP6_NF_TARGET_REJECT=m
CONFIG_IP6_NF_MANGLE=m
CONFIG_IP6_NF_RAW=m
CONFIG_IP6_NF_SECURITY=m

#
# DECnet: Netfilter Configuration
#
CONFIG_DECNET_NF_GRABULATOR=m
CONFIG_BRIDGE_NF_EBTABLES=m
CONFIG_BRIDGE_EBT_BROUTE=m
CONFIG_BRIDGE_EBT_T_FILTER=m
CONFIG_BRIDGE_EBT_T_NAT=m
CONFIG_BRIDGE_EBT_802_3=m
CONFIG_BRIDGE_EBT_AMONG=m
CONFIG_BRIDGE_EBT_ARP=m
CONFIG_BRIDGE_EBT_IP=m
CONFIG_BRIDGE_EBT_IP6=m
CONFIG_BRIDGE_EBT_LIMIT=m
CONFIG_BRIDGE_EBT_MARK=m
CONFIG_BRIDGE_EBT_PKTTYPE=m
CONFIG_BRIDGE_EBT_STP=m
CONFIG_BRIDGE_EBT_VLAN=m
CONFIG_BRIDGE_EBT_ARPREPLY=m
CONFIG_BRIDGE_EBT_DNAT=m
CONFIG_BRIDGE_EBT_MARK_T=m
CONFIG_BRIDGE_EBT_REDIRECT=m
CONFIG_BRIDGE_EBT_SNAT=m
CONFIG_BRIDGE_EBT_LOG=m
CONFIG_BRIDGE_EBT_ULOG=m
CONFIG_BRIDGE_EBT_NFLOG=m
CONFIG_IP_DCCP=m
CONFIG_INET_DCCP_DIAG=m

#
# DCCP CCIDs Configuration (EXPERIMENTAL)
#
# CONFIG_IP_DCCP_CCID2_DEBUG is not set
CONFIG_IP_DCCP_CCID3=y
# CONFIG_IP_DCCP_CCID3_DEBUG is not set
CONFIG_IP_DCCP_TFRC_LIB=y

#
# DCCP Kernel Hacking
#
# CONFIG_IP_DCCP_DEBUG is not set
CONFIG_IP_SCTP=m
# CONFIG_SCTP_DBG_MSG is not set
# CONFIG_SCTP_DBG_OBJCNT is not set
# CONFIG_SCTP_HMAC_NONE is not set
# CONFIG_SCTP_HMAC_SHA1 is not set
CONFIG_SCTP_HMAC_MD5=y
CONFIG_RDS=m
CONFIG_RDS_RDMA=m
CONFIG_RDS_TCP=m
# CONFIG_RDS_DEBUG is not set
CONFIG_TIPC=m
CONFIG_TIPC_ADVANCED=y
CONFIG_TIPC_PORTS=8191
CONFIG_TIPC_LOG=0
# CONFIG_TIPC_DEBUG is not set
CONFIG_ATM=m
CONFIG_ATM_CLIP=m
# CONFIG_ATM_CLIP_NO_ICMP is not set
CONFIG_ATM_LANE=m
CONFIG_ATM_MPOA=m
CONFIG_ATM_BR2684=m
# CONFIG_ATM_BR2684_IPFILTER is not set
# CONFIG_L2TP is not set
CONFIG_STP=m
CONFIG_GARP=m
CONFIG_BRIDGE=m
CONFIG_BRIDGE_IGMP_SNOOPING=y
# CONFIG_NET_DSA is not set
CONFIG_VLAN_8021Q=m
CONFIG_VLAN_8021Q_GVRP=y
CONFIG_DECNET=m
# CONFIG_DECNET_ROUTER is not set
CONFIG_LLC=m
CONFIG_LLC2=m
CONFIG_IPX=m
# CONFIG_IPX_INTERN is not set
CONFIG_ATALK=m
CONFIG_DEV_APPLETALK=m
CONFIG_LTPC=m
# CONFIG_COPS is not set
CONFIG_IPDDP=m
CONFIG_IPDDP_ENCAP=y
CONFIG_IPDDP_DECAP=y
CONFIG_X25=m
CONFIG_LAPB=m
CONFIG_WAN_ROUTER=m
CONFIG_PHONET=m
CONFIG_IEEE802154=m
# CONFIG_IEEE802154_6LOWPAN is not set
# CONFIG_MAC802154 is not set
CONFIG_NET_SCHED=y

#
# Queueing/Scheduling
#
CONFIG_NET_SCH_CBQ=m
CONFIG_NET_SCH_HTB=m
CONFIG_NET_SCH_HFSC=m
CONFIG_NET_SCH_ATM=m
CONFIG_NET_SCH_PRIO=m
CONFIG_NET_SCH_MULTIQ=m
CONFIG_NET_SCH_RED=m
# CONFIG_NET_SCH_SFB is not set
CONFIG_NET_SCH_SFQ=m
CONFIG_NET_SCH_TEQL=m
CONFIG_NET_SCH_TBF=m
CONFIG_NET_SCH_GRED=m
CONFIG_NET_SCH_DSMARK=m
CONFIG_NET_SCH_NETEM=m
CONFIG_NET_SCH_DRR=m
# CONFIG_NET_SCH_MQPRIO is not set
# CONFIG_NET_SCH_CHOKE is not set
# CONFIG_NET_SCH_QFQ is not set
# CONFIG_NET_SCH_CODEL is not set
# CONFIG_NET_SCH_FQ_CODEL is not set
CONFIG_NET_SCH_INGRESS=m
# CONFIG_NET_SCH_PLUG is not set

#
# Classification
#
CONFIG_NET_CLS=y
CONFIG_NET_CLS_BASIC=m
CONFIG_NET_CLS_TCINDEX=m
CONFIG_NET_CLS_ROUTE4=m
CONFIG_NET_CLS_FW=m
CONFIG_NET_CLS_U32=m
CONFIG_CLS_U32_PERF=y
CONFIG_CLS_U32_MARK=y
CONFIG_NET_CLS_RSVP=m
CONFIG_NET_CLS_RSVP6=m
CONFIG_NET_CLS_FLOW=m
CONFIG_NET_CLS_CGROUP=y
CONFIG_NET_EMATCH=y
CONFIG_NET_EMATCH_STACK=32
CONFIG_NET_EMATCH_CMP=m
CONFIG_NET_EMATCH_NBYTE=m
CONFIG_NET_EMATCH_U32=m
CONFIG_NET_EMATCH_META=m
CONFIG_NET_EMATCH_TEXT=m
CONFIG_NET_CLS_ACT=y
CONFIG_NET_ACT_POLICE=m
CONFIG_NET_ACT_GACT=m
CONFIG_GACT_PROB=y
CONFIG_NET_ACT_MIRRED=m
CONFIG_NET_ACT_IPT=m
CONFIG_NET_ACT_NAT=m
CONFIG_NET_ACT_PEDIT=m
CONFIG_NET_ACT_SIMP=m
CONFIG_NET_ACT_SKBEDIT=m
# CONFIG_NET_ACT_CSUM is not set
CONFIG_NET_CLS_IND=y
CONFIG_NET_SCH_FIFO=y
CONFIG_DCB=y
CONFIG_DNS_RESOLVER=y
# CONFIG_BATMAN_ADV is not set
# CONFIG_OPENVSWITCH is not set
CONFIG_RPS=y
CONFIG_RFS_ACCEL=y
CONFIG_XPS=y
# CONFIG_NETPRIO_CGROUP is not set
CONFIG_BQL=y

#
# Network testing
#
CONFIG_NET_PKTGEN=m
CONFIG_HAMRADIO=y

#
# Packet Radio protocols
#
CONFIG_AX25=m
# CONFIG_AX25_DAMA_SLAVE is not set
CONFIG_NETROM=m
CONFIG_ROSE=m

#
# AX.25 network device drivers
#
CONFIG_MKISS=m
CONFIG_6PACK=m
CONFIG_BPQETHER=m
CONFIG_SCC=m
# CONFIG_SCC_DELAY is not set
# CONFIG_SCC_TRXECHO is not set
CONFIG_BAYCOM_SER_FDX=m
CONFIG_BAYCOM_SER_HDX=m
CONFIG_BAYCOM_PAR=m
CONFIG_BAYCOM_EPP=m
CONFIG_YAM=m
CONFIG_CAN=m
CONFIG_CAN_RAW=m
CONFIG_CAN_BCM=m
# CONFIG_CAN_GW is not set

#
# CAN Device Drivers
#
CONFIG_CAN_VCAN=m
# CONFIG_CAN_SLCAN is not set
CONFIG_CAN_DEV=m
CONFIG_CAN_CALC_BITTIMING=y
# CONFIG_CAN_MCP251X is not set
# CONFIG_PCH_CAN is not set
CONFIG_CAN_SJA1000=m
# CONFIG_CAN_SJA1000_ISA is not set
CONFIG_CAN_SJA1000_PLATFORM=m
# CONFIG_CAN_EMS_PCMCIA is not set
CONFIG_CAN_EMS_PCI=m
# CONFIG_CAN_PEAK_PCMCIA is not set
# CONFIG_CAN_PEAK_PCI is not set
CONFIG_CAN_KVASER_PCI=m
# CONFIG_CAN_PLX_PCI is not set
# CONFIG_CAN_TSCAN1 is not set
# CONFIG_CAN_C_CAN is not set
# CONFIG_CAN_CC770 is not set

#
# CAN USB interfaces
#
CONFIG_CAN_EMS_USB=m
# CONFIG_CAN_ESD_USB2 is not set
# CONFIG_CAN_PEAK_USB is not set
# CONFIG_CAN_SOFTING is not set
# CONFIG_CAN_DEBUG_DEVICES is not set
CONFIG_IRDA=m

#
# IrDA protocols
#
CONFIG_IRLAN=m
CONFIG_IRNET=m
CONFIG_IRCOMM=m
# CONFIG_IRDA_ULTRA is not set

#
# IrDA options
#
CONFIG_IRDA_CACHE_LAST_LSAP=y
CONFIG_IRDA_FAST_RR=y
# CONFIG_IRDA_DEBUG is not set

#
# Infrared-port device drivers
#

#
# SIR device drivers
#
CONFIG_IRTTY_SIR=m

#
# Dongle support
#
CONFIG_DONGLE=y
CONFIG_ESI_DONGLE=m
CONFIG_ACTISYS_DONGLE=m
CONFIG_TEKRAM_DONGLE=m
CONFIG_TOIM3232_DONGLE=m
CONFIG_LITELINK_DONGLE=m
CONFIG_MA600_DONGLE=m
CONFIG_GIRBIL_DONGLE=m
CONFIG_MCP2120_DONGLE=m
CONFIG_OLD_BELKIN_DONGLE=m
CONFIG_ACT200L_DONGLE=m
CONFIG_KINGSUN_DONGLE=m
CONFIG_KSDAZZLE_DONGLE=m
CONFIG_KS959_DONGLE=m

#
# FIR device drivers
#
CONFIG_USB_IRDA=m
CONFIG_SIGMATEL_FIR=m
CONFIG_NSC_FIR=m
CONFIG_WINBOND_FIR=m
CONFIG_TOSHIBA_FIR=m
CONFIG_SMC_IRCC_FIR=m
CONFIG_ALI_FIR=m
CONFIG_VLSI_FIR=m
CONFIG_VIA_FIR=m
CONFIG_MCS_FIR=m
CONFIG_BT=m
CONFIG_BT_RFCOMM=m
CONFIG_BT_RFCOMM_TTY=y
CONFIG_BT_BNEP=m
CONFIG_BT_BNEP_MC_FILTER=y
CONFIG_BT_BNEP_PROTO_FILTER=y
CONFIG_BT_CMTP=m
CONFIG_BT_HIDP=m

#
# Bluetooth device drivers
#
CONFIG_BT_HCIBTUSB=m
CONFIG_BT_HCIBTSDIO=m
CONFIG_BT_HCIUART=m
CONFIG_BT_HCIUART_H4=y
CONFIG_BT_HCIUART_BCSP=y
# CONFIG_BT_HCIUART_ATH3K is not set
CONFIG_BT_HCIUART_LL=y
CONFIG_BT_HCIBCM203X=m
CONFIG_BT_HCIBPA10X=m
CONFIG_BT_HCIBFUSB=m
CONFIG_BT_HCIDTL1=m
CONFIG_BT_HCIBT3C=m
CONFIG_BT_HCIBLUECARD=m
CONFIG_BT_HCIBTUART=m
CONFIG_BT_HCIVHCI=m
CONFIG_BT_MRVL=m
CONFIG_BT_MRVL_SDIO=m
# CONFIG_BT_ATH3K is not set
CONFIG_AF_RXRPC=m
# CONFIG_AF_RXRPC_DEBUG is not set
CONFIG_RXKAD=m
CONFIG_FIB_RULES=y
CONFIG_WIRELESS=y
CONFIG_WIRELESS_EXT=y
CONFIG_WEXT_CORE=y
CONFIG_WEXT_PROC=y
CONFIG_WEXT_SPY=y
CONFIG_WEXT_PRIV=y
CONFIG_CFG80211=m
# CONFIG_NL80211_TESTMODE is not set
# CONFIG_CFG80211_DEVELOPER_WARNINGS is not set
# CONFIG_CFG80211_REG_DEBUG is not set
CONFIG_CFG80211_DEFAULT_PS=y
# CONFIG_CFG80211_DEBUGFS is not set
# CONFIG_CFG80211_INTERNAL_REGDB is not set
CONFIG_CFG80211_WEXT=y
# CONFIG_WIRELESS_EXT_SYSFS is not set
CONFIG_LIB80211=m
CONFIG_LIB80211_CRYPT_WEP=m
CONFIG_LIB80211_CRYPT_CCMP=m
CONFIG_LIB80211_CRYPT_TKIP=m
# CONFIG_LIB80211_DEBUG is not set
CONFIG_MAC80211=m
CONFIG_MAC80211_HAS_RC=y
CONFIG_MAC80211_RC_MINSTREL=y
CONFIG_MAC80211_RC_MINSTREL_HT=y
CONFIG_MAC80211_RC_DEFAULT_MINSTREL=y
CONFIG_MAC80211_RC_DEFAULT="minstrel_ht"
CONFIG_MAC80211_MESH=y
CONFIG_MAC80211_LEDS=y
# CONFIG_MAC80211_DEBUGFS is not set
# CONFIG_MAC80211_DEBUG_MENU is not set
CONFIG_WIMAX=m
CONFIG_WIMAX_DEBUG_LEVEL=8
CONFIG_RFKILL=m
CONFIG_RFKILL_LEDS=y
CONFIG_RFKILL_INPUT=y
# CONFIG_RFKILL_REGULATOR is not set
CONFIG_NET_9P=m
CONFIG_NET_9P_VIRTIO=m
CONFIG_NET_9P_RDMA=m
# CONFIG_NET_9P_DEBUG is not set
# CONFIG_CAIF is not set
# CONFIG_CEPH_LIB is not set
# CONFIG_NFC is not set

#
# Device Drivers
#

#
# Generic Driver Options
#
CONFIG_UEVENT_HELPER_PATH=""
CONFIG_DEVTMPFS=y
# CONFIG_DEVTMPFS_MOUNT is not set
CONFIG_STANDALONE=y
CONFIG_PREVENT_FIRMWARE_BUILD=y
CONFIG_FW_LOADER=y
# CONFIG_FIRMWARE_IN_KERNEL is not set
CONFIG_EXTRA_FIRMWARE=""
# CONFIG_DEBUG_DRIVER is not set
# CONFIG_DEBUG_DEVRES is not set
# CONFIG_SYS_HYPERVISOR is not set
# CONFIG_GENERIC_CPU_DEVICES is not set
CONFIG_REGMAP=y
CONFIG_REGMAP_I2C=m
CONFIG_DMA_SHARED_BUFFER=y
# CONFIG_CMA is not set
CONFIG_CONNECTOR=m
CONFIG_MTD=m
# CONFIG_MTD_TESTS is not set
CONFIG_MTD_REDBOOT_PARTS=m
CONFIG_MTD_REDBOOT_DIRECTORY_BLOCK=-1
# CONFIG_MTD_REDBOOT_PARTS_UNALLOCATED is not set
# CONFIG_MTD_REDBOOT_PARTS_READONLY is not set
CONFIG_MTD_AR7_PARTS=m

#
# User Modules And Translation Layers
#
CONFIG_MTD_CHAR=m
CONFIG_MTD_BLKDEVS=m
CONFIG_MTD_BLOCK=m
CONFIG_MTD_BLOCK_RO=m
CONFIG_FTL=m
CONFIG_NFTL=m
CONFIG_NFTL_RW=y
CONFIG_INFTL=m
CONFIG_RFD_FTL=m
CONFIG_SSFDC=m
# CONFIG_SM_FTL is not set
CONFIG_MTD_OOPS=m
# CONFIG_MTD_SWAP is not set

#
# RAM/ROM/Flash chip drivers
#
CONFIG_MTD_CFI=m
CONFIG_MTD_JEDECPROBE=m
CONFIG_MTD_GEN_PROBE=m
# CONFIG_MTD_CFI_ADV_OPTIONS is not set
CONFIG_MTD_MAP_BANK_WIDTH_1=y
CONFIG_MTD_MAP_BANK_WIDTH_2=y
CONFIG_MTD_MAP_BANK_WIDTH_4=y
# CONFIG_MTD_MAP_BANK_WIDTH_8 is not set
# CONFIG_MTD_MAP_BANK_WIDTH_16 is not set
# CONFIG_MTD_MAP_BANK_WIDTH_32 is not set
CONFIG_MTD_CFI_I1=y
CONFIG_MTD_CFI_I2=y
# CONFIG_MTD_CFI_I4 is not set
# CONFIG_MTD_CFI_I8 is not set
CONFIG_MTD_CFI_INTELEXT=m
CONFIG_MTD_CFI_AMDSTD=m
CONFIG_MTD_CFI_STAA=m
CONFIG_MTD_CFI_UTIL=m
CONFIG_MTD_RAM=m
CONFIG_MTD_ROM=m
CONFIG_MTD_ABSENT=m

#
# Mapping drivers for chip access
#
CONFIG_MTD_COMPLEX_MAPPINGS=y
CONFIG_MTD_PHYSMAP=m
# CONFIG_MTD_PHYSMAP_COMPAT is not set
CONFIG_MTD_SC520CDP=m
CONFIG_MTD_NETSC520=m
CONFIG_MTD_TS5500=m
CONFIG_MTD_SBC_GXX=m
CONFIG_MTD_SCx200_DOCFLASH=m
# CONFIG_MTD_AMD76XROM is not set
# CONFIG_MTD_ICHXROM is not set
# CONFIG_MTD_ESB2ROM is not set
# CONFIG_MTD_CK804XROM is not set
# CONFIG_MTD_SCB2_FLASH is not set
CONFIG_MTD_NETtel=m
# CONFIG_MTD_L440GX is not set
CONFIG_MTD_PCI=m
# CONFIG_MTD_PCMCIA is not set
# CONFIG_MTD_GPIO_ADDR is not set
CONFIG_MTD_INTEL_VR_NOR=m
CONFIG_MTD_PLATRAM=m
# CONFIG_MTD_LATCH_ADDR is not set

#
# Self-contained MTD device drivers
#
CONFIG_MTD_PMC551=m
# CONFIG_MTD_PMC551_BUGFIX is not set
# CONFIG_MTD_PMC551_DEBUG is not set
CONFIG_MTD_DATAFLASH=m
# CONFIG_MTD_DATAFLASH_WRITE_VERIFY is not set
# CONFIG_MTD_DATAFLASH_OTP is not set
CONFIG_MTD_M25P80=m
CONFIG_M25PXX_USE_FAST_READ=y
CONFIG_MTD_SST25L=m
CONFIG_MTD_SLRAM=m
CONFIG_MTD_PHRAM=m
CONFIG_MTD_MTDRAM=m
CONFIG_MTDRAM_TOTAL_SIZE=4096
CONFIG_MTDRAM_ERASE_SIZE=128
CONFIG_MTD_BLOCK2MTD=m

#
# Disk-On-Chip Device Drivers
#
CONFIG_MTD_DOC2000=m
CONFIG_MTD_DOC2001=m
CONFIG_MTD_DOC2001PLUS=m
# CONFIG_MTD_DOCG3 is not set
CONFIG_MTD_DOCPROBE=m
CONFIG_MTD_DOCECC=m
# CONFIG_MTD_DOCPROBE_ADVANCED is not set
CONFIG_MTD_DOCPROBE_ADDRESS=0x0
CONFIG_MTD_NAND_ECC=m
# CONFIG_MTD_NAND_ECC_SMC is not set
CONFIG_MTD_NAND=m
# CONFIG_MTD_NAND_VERIFY_WRITE is not set
# CONFIG_MTD_NAND_ECC_BCH is not set
# CONFIG_MTD_SM_COMMON is not set
# CONFIG_MTD_NAND_MUSEUM_IDS is not set
# CONFIG_MTD_NAND_DENALI is not set
CONFIG_MTD_NAND_IDS=m
# CONFIG_MTD_NAND_RICOH is not set
CONFIG_MTD_NAND_DISKONCHIP=m
# CONFIG_MTD_NAND_DISKONCHIP_PROBE_ADVANCED is not set
CONFIG_MTD_NAND_DISKONCHIP_PROBE_ADDRESS=0
# CONFIG_MTD_NAND_DISKONCHIP_BBTWRITE is not set
# CONFIG_MTD_NAND_DOCG4 is not set
CONFIG_MTD_NAND_CAFE=m
CONFIG_MTD_NAND_CS553X=m
CONFIG_MTD_NAND_NANDSIM=m
CONFIG_MTD_NAND_PLATFORM=m
CONFIG_MTD_ALAUDA=m
CONFIG_MTD_ONENAND=m
CONFIG_MTD_ONENAND_VERIFY_WRITE=y
CONFIG_MTD_ONENAND_GENERIC=m
# CONFIG_MTD_ONENAND_OTP is not set
CONFIG_MTD_ONENAND_2X_PROGRAM=y
CONFIG_MTD_ONENAND_SIM=m

#
# LPDDR flash memory drivers
#
CONFIG_MTD_LPDDR=m
CONFIG_MTD_QINFO_PROBE=m
CONFIG_MTD_UBI=m
CONFIG_MTD_UBI_WL_THRESHOLD=4096
CONFIG_MTD_UBI_BEB_RESERVE=1
# CONFIG_MTD_UBI_GLUEBI is not set
CONFIG_PARPORT=m
CONFIG_PARPORT_PC=m
CONFIG_PARPORT_SERIAL=m
# CONFIG_PARPORT_PC_FIFO is not set
# CONFIG_PARPORT_PC_SUPERIO is not set
CONFIG_PARPORT_PC_PCMCIA=m
# CONFIG_PARPORT_GSC is not set
CONFIG_PARPORT_AX88796=m
CONFIG_PARPORT_1284=y
CONFIG_PARPORT_NOT_PC=y
CONFIG_PNP=y
# CONFIG_PNP_DEBUG_MESSAGES is not set

#
# Protocols
#
CONFIG_ISAPNP=y
CONFIG_PNPBIOS=y
CONFIG_PNPBIOS_PROC_FS=y
CONFIG_PNPACPI=y
CONFIG_BLK_DEV=y
CONFIG_BLK_DEV_FD=m
CONFIG_BLK_DEV_XD=m
CONFIG_PARIDE=m

#
# Parallel IDE high-level drivers
#
CONFIG_PARIDE_PD=m
CONFIG_PARIDE_PCD=m
CONFIG_PARIDE_PF=m
CONFIG_PARIDE_PT=m
CONFIG_PARIDE_PG=m

#
# Parallel IDE protocol modules
#
CONFIG_PARIDE_ATEN=m
CONFIG_PARIDE_BPCK=m
CONFIG_PARIDE_BPCK6=m
CONFIG_PARIDE_COMM=m
CONFIG_PARIDE_DSTR=m
CONFIG_PARIDE_FIT2=m
CONFIG_PARIDE_FIT3=m
CONFIG_PARIDE_EPAT=m
# CONFIG_PARIDE_EPATC8 is not set
CONFIG_PARIDE_EPIA=m
CONFIG_PARIDE_FRIQ=m
CONFIG_PARIDE_FRPW=m
CONFIG_PARIDE_KBIC=m
CONFIG_PARIDE_KTTI=m
CONFIG_PARIDE_ON20=m
CONFIG_PARIDE_ON26=m
# CONFIG_BLK_DEV_PCIESSD_MTIP32XX is not set
CONFIG_BLK_CPQ_DA=m
CONFIG_BLK_CPQ_CISS_DA=m
CONFIG_CISS_SCSI_TAPE=y
CONFIG_BLK_DEV_DAC960=m
CONFIG_BLK_DEV_UMEM=m
# CONFIG_BLK_DEV_COW_COMMON is not set
CONFIG_BLK_DEV_LOOP=m
CONFIG_BLK_DEV_LOOP_MIN_COUNT=8
# CONFIG_BLK_DEV_CRYPTOLOOP is not set
CONFIG_BLK_DEV_DRBD=m
# CONFIG_DRBD_FAULT_INJECTION is not set
CONFIG_BLK_DEV_NBD=m
# CONFIG_BLK_DEV_NVME is not set
CONFIG_BLK_DEV_OSD=m
CONFIG_BLK_DEV_SX8=m
# CONFIG_BLK_DEV_UB is not set
CONFIG_BLK_DEV_RAM=m
CONFIG_BLK_DEV_RAM_COUNT=16
CONFIG_BLK_DEV_RAM_SIZE=8192
# CONFIG_BLK_DEV_XIP is not set
CONFIG_CDROM_PKTCDVD=m
CONFIG_CDROM_PKTCDVD_BUFFERS=8
# CONFIG_CDROM_PKTCDVD_WCACHE is not set
CONFIG_ATA_OVER_ETH=m
CONFIG_VIRTIO_BLK=m
# CONFIG_BLK_DEV_HD is not set
# CONFIG_BLK_DEV_RBD is not set

#
# Misc devices
#
# CONFIG_SENSORS_LIS3LV02D is not set
# CONFIG_AD525X_DPOT is not set
CONFIG_IBM_ASM=m
CONFIG_PHANTOM=m
# CONFIG_INTEL_MID_PTI is not set
CONFIG_SGI_IOC4=m
CONFIG_TIFM_CORE=m
CONFIG_TIFM_7XX1=m
CONFIG_ICS932S401=m
CONFIG_ENCLOSURE_SERVICES=m
CONFIG_HP_ILO=m
# CONFIG_APDS9802ALS is not set
CONFIG_ISL29003=m
# CONFIG_ISL29020 is not set
CONFIG_SENSORS_TSL2550=m
# CONFIG_SENSORS_BH1780 is not set
# CONFIG_SENSORS_BH1770 is not set
# CONFIG_SENSORS_APDS990X is not set
# CONFIG_HMC6352 is not set
CONFIG_DS1682=m
# CONFIG_TI_DAC7512 is not set
# CONFIG_VMWARE_BALLOON is not set
# CONFIG_BMP085_I2C is not set
# CONFIG_BMP085_SPI is not set
# CONFIG_PCH_PHUB is not set
# CONFIG_USB_SWITCH_FSA9480 is not set
CONFIG_C2PORT=m
CONFIG_C2PORT_DURAMAR_2150=m

#
# EEPROM support
#
CONFIG_EEPROM_AT24=m
CONFIG_EEPROM_AT25=m
CONFIG_EEPROM_LEGACY=m
CONFIG_EEPROM_MAX6875=m
CONFIG_EEPROM_93CX6=m
# CONFIG_EEPROM_93XX46 is not set
CONFIG_CB710_CORE=m
# CONFIG_CB710_DEBUG is not set
CONFIG_CB710_DEBUG_ASSUMPTIONS=y
CONFIG_IWMC3200TOP=m
# CONFIG_IWMC3200TOP_DEBUG is not set
# CONFIG_IWMC3200TOP_DEBUGFS is not set

#
# Texas Instruments shared transport line discipline
#
# CONFIG_TI_ST is not set
# CONFIG_SENSORS_LIS3_I2C is not set

#
# Altera FPGA firmware download module
#
# CONFIG_ALTERA_STAPL is not set
# CONFIG_INTEL_MEI is not set
CONFIG_HAVE_IDE=y
CONFIG_IDE=m

#
# Please see Documentation/ide/ide.txt for help/info on IDE drives
#
CONFIG_IDE_XFER_MODE=y
CONFIG_IDE_ATAPI=y
# CONFIG_BLK_DEV_IDE_SATA is not set
CONFIG_IDE_GD=m
CONFIG_IDE_GD_ATA=y
CONFIG_IDE_GD_ATAPI=y
CONFIG_BLK_DEV_IDECS=m
CONFIG_BLK_DEV_DELKIN=m
CONFIG_BLK_DEV_IDECD=m
CONFIG_BLK_DEV_IDECD_VERBOSE_ERRORS=y
CONFIG_BLK_DEV_IDETAPE=m
# CONFIG_BLK_DEV_IDEACPI is not set
# CONFIG_IDE_TASK_IOCTL is not set
CONFIG_IDE_PROC_FS=y

#
# IDE chipset support/bugfixes
#
CONFIG_IDE_GENERIC=m
# CONFIG_BLK_DEV_PLATFORM is not set
# CONFIG_BLK_DEV_CMD640 is not set
CONFIG_BLK_DEV_IDEPNP=m
CONFIG_BLK_DEV_IDEDMA_SFF=y

#
# PCI IDE chipsets support
#
CONFIG_BLK_DEV_IDEPCI=y
# CONFIG_BLK_DEV_OFFBOARD is not set
# CONFIG_BLK_DEV_GENERIC is not set
CONFIG_BLK_DEV_OPTI621=m
# CONFIG_BLK_DEV_RZ1000 is not set
CONFIG_BLK_DEV_IDEDMA_PCI=y
# CONFIG_BLK_DEV_AEC62XX is not set
# CONFIG_BLK_DEV_ALI15X3 is not set
# CONFIG_BLK_DEV_AMD74XX is not set
# CONFIG_BLK_DEV_ATIIXP is not set
# CONFIG_BLK_DEV_CMD64X is not set
# CONFIG_BLK_DEV_TRIFLEX is not set
# CONFIG_BLK_DEV_CS5520 is not set
# CONFIG_BLK_DEV_CS5530 is not set
CONFIG_BLK_DEV_CS5535=m
# CONFIG_BLK_DEV_CS5536 is not set
CONFIG_BLK_DEV_HPT366=m
# CONFIG_BLK_DEV_JMICRON is not set
# CONFIG_BLK_DEV_SC1200 is not set
CONFIG_BLK_DEV_PIIX=m
CONFIG_BLK_DEV_IT8172=m
CONFIG_BLK_DEV_IT8213=m
# CONFIG_BLK_DEV_IT821X is not set
# CONFIG_BLK_DEV_NS87415 is not set
# CONFIG_BLK_DEV_PDC202XX_OLD is not set
# CONFIG_BLK_DEV_PDC202XX_NEW is not set
# CONFIG_BLK_DEV_SVWKS is not set
# CONFIG_BLK_DEV_SIIMAGE is not set
# CONFIG_BLK_DEV_SIS5513 is not set
# CONFIG_BLK_DEV_SLC90E66 is not set
CONFIG_BLK_DEV_TRM290=m
# CONFIG_BLK_DEV_VIA82CXXX is not set
CONFIG_BLK_DEV_TC86C001=m

#
# Other IDE chipsets support
#

#
# Note: most of these also require special kernel boot parameters
#
# CONFIG_BLK_DEV_4DRIVES is not set
# CONFIG_BLK_DEV_ALI14XX is not set
# CONFIG_BLK_DEV_DTC2278 is not set
# CONFIG_BLK_DEV_HT6560B is not set
# CONFIG_BLK_DEV_QD65XX is not set
# CONFIG_BLK_DEV_UMC8672 is not set
CONFIG_BLK_DEV_IDEDMA=y

#
# SCSI device support
#
CONFIG_SCSI_MOD=m
CONFIG_RAID_ATTRS=m
CONFIG_SCSI=m
CONFIG_SCSI_DMA=y
CONFIG_SCSI_TGT=m
CONFIG_SCSI_NETLINK=y
CONFIG_SCSI_PROC_FS=y

#
# SCSI support type (disk, tape, CD-ROM)
#
CONFIG_BLK_DEV_SD=m
CONFIG_CHR_DEV_ST=m
CONFIG_CHR_DEV_OSST=m
CONFIG_BLK_DEV_SR=m
CONFIG_BLK_DEV_SR_VENDOR=y
CONFIG_CHR_DEV_SG=m
CONFIG_CHR_DEV_SCH=m
CONFIG_SCSI_ENCLOSURE=m
CONFIG_SCSI_MULTI_LUN=y
CONFIG_SCSI_CONSTANTS=y
CONFIG_SCSI_LOGGING=y
CONFIG_SCSI_SCAN_ASYNC=y
CONFIG_SCSI_WAIT_SCAN=m

#
# SCSI Transports
#
CONFIG_SCSI_SPI_ATTRS=m
CONFIG_SCSI_FC_ATTRS=m
CONFIG_SCSI_FC_TGT_ATTRS=y
CONFIG_SCSI_ISCSI_ATTRS=m
CONFIG_SCSI_SAS_ATTRS=m
CONFIG_SCSI_SAS_LIBSAS=m
CONFIG_SCSI_SAS_ATA=y
CONFIG_SCSI_SAS_HOST_SMP=y
CONFIG_SCSI_SRP_ATTRS=m
CONFIG_SCSI_SRP_TGT_ATTRS=y
CONFIG_SCSI_LOWLEVEL=y
CONFIG_ISCSI_TCP=m
CONFIG_ISCSI_BOOT_SYSFS=m
CONFIG_SCSI_CXGB3_ISCSI=m
# CONFIG_SCSI_CXGB4_ISCSI is not set
CONFIG_SCSI_BNX2_ISCSI=m
# CONFIG_SCSI_BNX2X_FCOE is not set
CONFIG_BE2ISCSI=m
CONFIG_BLK_DEV_3W_XXXX_RAID=m
CONFIG_SCSI_HPSA=m
CONFIG_SCSI_3W_9XXX=m
CONFIG_SCSI_3W_SAS=m
CONFIG_SCSI_7000FASST=m
CONFIG_SCSI_ACARD=m
CONFIG_SCSI_AHA152X=m
CONFIG_SCSI_AHA1542=m
CONFIG_SCSI_AACRAID=m
CONFIG_SCSI_AIC7XXX=m
CONFIG_AIC7XXX_CMDS_PER_DEVICE=8
CONFIG_AIC7XXX_RESET_DELAY_MS=15000
CONFIG_AIC7XXX_DEBUG_ENABLE=y
CONFIG_AIC7XXX_DEBUG_MASK=0
CONFIG_AIC7XXX_REG_PRETTY_PRINT=y
CONFIG_SCSI_AIC7XXX_OLD=m
CONFIG_SCSI_AIC79XX=m
CONFIG_AIC79XX_CMDS_PER_DEVICE=32
CONFIG_AIC79XX_RESET_DELAY_MS=15000
CONFIG_AIC79XX_DEBUG_ENABLE=y
CONFIG_AIC79XX_DEBUG_MASK=0
CONFIG_AIC79XX_REG_PRETTY_PRINT=y
CONFIG_SCSI_AIC94XX=m
# CONFIG_AIC94XX_DEBUG is not set
CONFIG_SCSI_MVSAS=m
# CONFIG_SCSI_MVSAS_DEBUG is not set
# CONFIG_SCSI_MVSAS_TASKLET is not set
# CONFIG_SCSI_MVUMI is not set
CONFIG_SCSI_DPT_I2O=m
CONFIG_SCSI_ADVANSYS=m
CONFIG_SCSI_IN2000=m
CONFIG_SCSI_ARCMSR=m
CONFIG_MEGARAID_NEWGEN=y
CONFIG_MEGARAID_MM=m
CONFIG_MEGARAID_MAILBOX=m
CONFIG_MEGARAID_LEGACY=m
CONFIG_MEGARAID_SAS=m
CONFIG_SCSI_MPT2SAS=m
CONFIG_SCSI_MPT2SAS_MAX_SGE=128
# CONFIG_SCSI_MPT2SAS_LOGGING is not set
# CONFIG_SCSI_UFSHCD is not set
CONFIG_SCSI_HPTIOP=m
CONFIG_SCSI_BUSLOGIC=m
# CONFIG_SCSI_FLASHPOINT is not set
CONFIG_VMWARE_PVSCSI=m
CONFIG_LIBFC=m
CONFIG_LIBFCOE=m
CONFIG_FCOE=m
CONFIG_FCOE_FNIC=m
CONFIG_SCSI_DMX3191D=m
CONFIG_SCSI_DTC3280=m
CONFIG_SCSI_EATA=m
CONFIG_SCSI_EATA_TAGGED_QUEUE=y
CONFIG_SCSI_EATA_LINKED_COMMANDS=y
CONFIG_SCSI_EATA_MAX_TAGS=16
CONFIG_SCSI_FUTURE_DOMAIN=m
CONFIG_SCSI_GDTH=m
CONFIG_SCSI_ISCI=m
# CONFIG_SCSI_GENERIC_NCR5380 is not set
# CONFIG_SCSI_GENERIC_NCR5380_MMIO is not set
CONFIG_SCSI_IPS=m
CONFIG_SCSI_INITIO=m
# CONFIG_SCSI_INIA100 is not set
CONFIG_SCSI_PPA=m
CONFIG_SCSI_IMM=m
# CONFIG_SCSI_IZIP_EPP16 is not set
# CONFIG_SCSI_IZIP_SLOW_CTR is not set
CONFIG_SCSI_NCR53C406A=m
CONFIG_SCSI_STEX=m
CONFIG_SCSI_SYM53C8XX_2=m
CONFIG_SCSI_SYM53C8XX_DMA_ADDRESSING_MODE=1
CONFIG_SCSI_SYM53C8XX_DEFAULT_TAGS=16
CONFIG_SCSI_SYM53C8XX_MAX_TAGS=64
CONFIG_SCSI_SYM53C8XX_MMIO=y
CONFIG_SCSI_IPR=m
# CONFIG_SCSI_IPR_TRACE is not set
# CONFIG_SCSI_IPR_DUMP is not set
CONFIG_SCSI_PAS16=m
CONFIG_SCSI_QLOGIC_FAS=m
CONFIG_SCSI_QLOGIC_1280=m
CONFIG_SCSI_QLA_FC=m
CONFIG_SCSI_QLA_ISCSI=m
CONFIG_SCSI_LPFC=m
# CONFIG_SCSI_LPFC_DEBUG_FS is not set
CONFIG_SCSI_SYM53C416=m
CONFIG_SCSI_DC395x=m
CONFIG_SCSI_DC390T=m
CONFIG_SCSI_T128=m
CONFIG_SCSI_U14_34F=m
CONFIG_SCSI_U14_34F_TAGGED_QUEUE=y
CONFIG_SCSI_U14_34F_LINKED_COMMANDS=y
CONFIG_SCSI_U14_34F_MAX_TAGS=8
CONFIG_SCSI_ULTRASTOR=m
CONFIG_SCSI_NSP32=m
CONFIG_SCSI_DEBUG=m
CONFIG_SCSI_PMCRAID=m
CONFIG_SCSI_PM8001=m
CONFIG_SCSI_SRP=m
CONFIG_SCSI_BFA_FC=m
# CONFIG_SCSI_VIRTIO is not set
CONFIG_SCSI_LOWLEVEL_PCMCIA=y
CONFIG_PCMCIA_AHA152X=m
CONFIG_PCMCIA_FDOMAIN=m
CONFIG_PCMCIA_NINJA_SCSI=m
CONFIG_PCMCIA_QLOGIC=m
CONFIG_PCMCIA_SYM53C500=m
CONFIG_SCSI_DH=m
CONFIG_SCSI_DH_RDAC=m
CONFIG_SCSI_DH_HP_SW=m
CONFIG_SCSI_DH_EMC=m
CONFIG_SCSI_DH_ALUA=m
CONFIG_SCSI_OSD_INITIATOR=m
CONFIG_SCSI_OSD_ULD=m
CONFIG_SCSI_OSD_DPRINT_SENSE=1
# CONFIG_SCSI_OSD_DEBUG is not set
CONFIG_ATA=m
# CONFIG_ATA_NONSTANDARD is not set
CONFIG_ATA_VERBOSE_ERROR=y
CONFIG_ATA_ACPI=y
CONFIG_SATA_PMP=y

#
# Controllers with non-SFF native interface
#
CONFIG_SATA_AHCI=m
# CONFIG_SATA_AHCI_PLATFORM is not set
CONFIG_SATA_INIC162X=m
# CONFIG_SATA_ACARD_AHCI is not set
CONFIG_SATA_SIL24=m
CONFIG_ATA_SFF=y

#
# SFF controllers with custom DMA interface
#
CONFIG_PDC_ADMA=m
CONFIG_SATA_QSTOR=m
CONFIG_SATA_SX4=m
CONFIG_ATA_BMDMA=y

#
# SATA SFF controllers with BMDMA
#
CONFIG_ATA_PIIX=m
CONFIG_SATA_MV=m
CONFIG_SATA_NV=m
CONFIG_SATA_PROMISE=m
CONFIG_SATA_SIL=m
CONFIG_SATA_SIS=m
CONFIG_SATA_SVW=m
CONFIG_SATA_ULI=m
CONFIG_SATA_VIA=m
CONFIG_SATA_VITESSE=m

#
# PATA SFF controllers with BMDMA
#
CONFIG_PATA_ALI=m
CONFIG_PATA_AMD=m
# CONFIG_PATA_ARASAN_CF is not set
CONFIG_PATA_ARTOP=m
CONFIG_PATA_ATIIXP=m
CONFIG_PATA_ATP867X=m
CONFIG_PATA_CMD64X=m
CONFIG_PATA_CS5520=m
CONFIG_PATA_CS5530=m
# CONFIG_PATA_CS5535 is not set
CONFIG_PATA_CS5536=m
# CONFIG_PATA_CYPRESS is not set
CONFIG_PATA_EFAR=m
# CONFIG_PATA_HPT366 is not set
# CONFIG_PATA_HPT37X is not set
# CONFIG_PATA_HPT3X2N is not set
# CONFIG_PATA_HPT3X3 is not set
# CONFIG_PATA_IT8213 is not set
CONFIG_PATA_IT821X=m
CONFIG_PATA_JMICRON=m
CONFIG_PATA_MARVELL=m
CONFIG_PATA_NETCELL=m
# CONFIG_PATA_NINJA32 is not set
CONFIG_PATA_NS87415=m
CONFIG_PATA_OLDPIIX=m
# CONFIG_PATA_OPTIDMA is not set
CONFIG_PATA_PDC2027X=m
CONFIG_PATA_PDC_OLD=m
# CONFIG_PATA_RADISYS is not set
CONFIG_PATA_RDC=m
CONFIG_PATA_SC1200=m
CONFIG_PATA_SCH=m
CONFIG_PATA_SERVERWORKS=m
CONFIG_PATA_SIL680=m
CONFIG_PATA_SIS=m
# CONFIG_PATA_TOSHIBA is not set
CONFIG_PATA_TRIFLEX=m
CONFIG_PATA_VIA=m
# CONFIG_PATA_WINBOND is not set

#
# PIO-only SFF controllers
#
# CONFIG_PATA_CMD640_PCI is not set
# CONFIG_PATA_ISAPNP is not set
CONFIG_PATA_MPIIX=m
CONFIG_PATA_NS87410=m
# CONFIG_PATA_OPTI is not set
# CONFIG_PATA_PCMCIA is not set
# CONFIG_PATA_QDI is not set
CONFIG_PATA_RZ1000=m
# CONFIG_PATA_WINBOND_VLB is not set

#
# Generic fallback / legacy drivers
#
# CONFIG_PATA_ACPI is not set
CONFIG_ATA_GENERIC=m
# CONFIG_PATA_LEGACY is not set
CONFIG_MD=y
CONFIG_BLK_DEV_MD=m
CONFIG_MD_LINEAR=m
CONFIG_MD_RAID0=m
CONFIG_MD_RAID1=m
CONFIG_MD_RAID10=m
CONFIG_MD_RAID456=m
# CONFIG_MULTICORE_RAID456 is not set
CONFIG_MD_MULTIPATH=m
CONFIG_MD_FAULTY=m
CONFIG_BLK_DEV_DM=m
# CONFIG_DM_DEBUG is not set
CONFIG_DM_CRYPT=m
CONFIG_DM_SNAPSHOT=m
# CONFIG_DM_THIN_PROVISIONING is not set
CONFIG_DM_MIRROR=m
# CONFIG_DM_RAID is not set
CONFIG_DM_LOG_USERSPACE=m
CONFIG_DM_ZERO=m
CONFIG_DM_MULTIPATH=m
CONFIG_DM_MULTIPATH_QL=m
CONFIG_DM_MULTIPATH_ST=m
CONFIG_DM_DELAY=m
CONFIG_DM_UEVENT=y
# CONFIG_DM_FLAKEY is not set
# CONFIG_DM_VERITY is not set
# CONFIG_TARGET_CORE is not set
CONFIG_FUSION=y
CONFIG_FUSION_SPI=m
CONFIG_FUSION_FC=m
CONFIG_FUSION_SAS=m
CONFIG_FUSION_MAX_SGE=128
CONFIG_FUSION_CTL=m
CONFIG_FUSION_LAN=m
# CONFIG_FUSION_LOGGING is not set

#
# IEEE 1394 (FireWire) support
#
CONFIG_FIREWIRE=m
CONFIG_FIREWIRE_OHCI=m
CONFIG_FIREWIRE_SBP2=m
CONFIG_FIREWIRE_NET=m
# CONFIG_FIREWIRE_NOSY is not set
CONFIG_I2O=m
CONFIG_I2O_LCT_NOTIFY_ON_CHANGES=y
CONFIG_I2O_EXT_ADAPTEC=y
CONFIG_I2O_EXT_ADAPTEC_DMA64=y
CONFIG_I2O_CONFIG=m
CONFIG_I2O_CONFIG_OLD_IOCTL=y
CONFIG_I2O_BUS=m
CONFIG_I2O_BLOCK=m
CONFIG_I2O_SCSI=m
CONFIG_I2O_PROC=m
# CONFIG_MACINTOSH_DRIVERS is not set
CONFIG_NETDEVICES=y
CONFIG_NET_CORE=y
CONFIG_BONDING=m
CONFIG_DUMMY=m
CONFIG_EQUALIZER=m
CONFIG_NET_FC=y
CONFIG_MII=m
CONFIG_IEEE802154_DRIVERS=m
CONFIG_IEEE802154_FAKEHARD=m
CONFIG_IFB=m
# CONFIG_NET_TEAM is not set
CONFIG_MACVLAN=m
CONFIG_MACVTAP=m
CONFIG_NETCONSOLE=m
CONFIG_NETCONSOLE_DYNAMIC=y
CONFIG_NETPOLL=y
# CONFIG_NETPOLL_TRAP is not set
CONFIG_NET_POLL_CONTROLLER=y
CONFIG_TUN=m
CONFIG_VETH=m
CONFIG_VIRTIO_NET=m
CONFIG_SUNGEM_PHY=m
CONFIG_ARCNET=m
CONFIG_ARCNET_1201=m
CONFIG_ARCNET_1051=m
CONFIG_ARCNET_RAW=m
CONFIG_ARCNET_CAP=m
CONFIG_ARCNET_COM90xx=m
CONFIG_ARCNET_COM90xxIO=m
CONFIG_ARCNET_RIM_I=m
CONFIG_ARCNET_COM20020=m
CONFIG_ARCNET_COM20020_ISA=m
CONFIG_ARCNET_COM20020_PCI=m
CONFIG_ARCNET_COM20020_CS=m
CONFIG_ATM_DRIVERS=y
CONFIG_ATM_DUMMY=m
CONFIG_ATM_TCP=m
CONFIG_ATM_LANAI=m
CONFIG_ATM_ENI=m
# CONFIG_ATM_ENI_DEBUG is not set
# CONFIG_ATM_ENI_TUNE_BURST is not set
CONFIG_ATM_FIRESTREAM=m
CONFIG_ATM_ZATM=m
# CONFIG_ATM_ZATM_DEBUG is not set
CONFIG_ATM_NICSTAR=m
# CONFIG_ATM_NICSTAR_USE_SUNI is not set
# CONFIG_ATM_NICSTAR_USE_IDT77105 is not set
CONFIG_ATM_IDT77252=m
# CONFIG_ATM_IDT77252_DEBUG is not set
# CONFIG_ATM_IDT77252_RCV_ALL is not set
CONFIG_ATM_IDT77252_USE_SUNI=y
CONFIG_ATM_AMBASSADOR=m
# CONFIG_ATM_AMBASSADOR_DEBUG is not set
CONFIG_ATM_HORIZON=m
# CONFIG_ATM_HORIZON_DEBUG is not set
CONFIG_ATM_IA=m
# CONFIG_ATM_IA_DEBUG is not set
CONFIG_ATM_FORE200E=m
# CONFIG_ATM_FORE200E_USE_TASKLET is not set
CONFIG_ATM_FORE200E_TX_RETRY=16
CONFIG_ATM_FORE200E_DEBUG=0
CONFIG_ATM_HE=m
CONFIG_ATM_HE_USE_SUNI=y
CONFIG_ATM_SOLOS=m

#
# CAIF transport drivers
#
CONFIG_ETHERNET=y
CONFIG_MDIO=m
CONFIG_NET_VENDOR_3COM=y
CONFIG_EL1=m
CONFIG_EL3=m
CONFIG_3C515=m
CONFIG_PCMCIA_3C574=m
CONFIG_PCMCIA_3C589=m
CONFIG_VORTEX=m
CONFIG_TYPHOON=m
CONFIG_NET_VENDOR_ADAPTEC=y
CONFIG_ADAPTEC_STARFIRE=m
CONFIG_NET_VENDOR_ALTEON=y
CONFIG_ACENIC=m
# CONFIG_ACENIC_OMIT_TIGON_I is not set
CONFIG_NET_VENDOR_AMD=y
CONFIG_AMD8111_ETH=m
CONFIG_LANCE=m
CONFIG_PCNET32=m
CONFIG_DEPCA=m
CONFIG_PCMCIA_NMCLAN=m
CONFIG_NI65=m
CONFIG_NET_VENDOR_ATHEROS=y
CONFIG_ATL2=m
CONFIG_ATL1=m
CONFIG_ATL1E=m
CONFIG_ATL1C=m
CONFIG_NET_VENDOR_BROADCOM=y
CONFIG_B44=m
CONFIG_B44_PCI_AUTOSELECT=y
CONFIG_B44_PCICORE_AUTOSELECT=y
CONFIG_B44_PCI=y
CONFIG_BNX2=m
CONFIG_CNIC=m
CONFIG_TIGON3=m
CONFIG_BNX2X=m
CONFIG_NET_VENDOR_BROCADE=y
CONFIG_BNA=m
# CONFIG_NET_CALXEDA_XGMAC is not set
CONFIG_NET_VENDOR_CHELSIO=y
CONFIG_CHELSIO_T1=m
CONFIG_CHELSIO_T1_1G=y
CONFIG_CHELSIO_T3=m
# CONFIG_CHELSIO_T4 is not set
# CONFIG_CHELSIO_T4VF is not set
CONFIG_NET_VENDOR_CIRRUS=y
CONFIG_CS89x0=m
# CONFIG_CS89x0_PLATFORM is not set
CONFIG_NET_VENDOR_CISCO=y
CONFIG_ENIC=m
CONFIG_DNET=m
CONFIG_NET_VENDOR_DEC=y
CONFIG_EWRK3=m
CONFIG_NET_TULIP=y
CONFIG_DE2104X=m
CONFIG_DE2104X_DSL=0
CONFIG_TULIP=m
# CONFIG_TULIP_MWI is not set
# CONFIG_TULIP_MMIO is not set
CONFIG_TULIP_NAPI=y
CONFIG_TULIP_NAPI_HW_MITIGATION=y
CONFIG_DE4X5=m
CONFIG_WINBOND_840=m
CONFIG_DM9102=m
CONFIG_ULI526X=m
CONFIG_PCMCIA_XIRCOM=m
CONFIG_NET_VENDOR_DLINK=y
# CONFIG_DE600 is not set
# CONFIG_DE620 is not set
CONFIG_DL2K=m
CONFIG_SUNDANCE=m
# CONFIG_SUNDANCE_MMIO is not set
CONFIG_NET_VENDOR_EMULEX=y
CONFIG_BE2NET=m
CONFIG_NET_VENDOR_EXAR=y
CONFIG_S2IO=m
CONFIG_VXGE=m
# CONFIG_VXGE_DEBUG_TRACE_ALL is not set
CONFIG_NET_VENDOR_FUJITSU=y
CONFIG_AT1700=m
CONFIG_PCMCIA_FMVJ18X=m
CONFIG_ETH16I=m
CONFIG_NET_VENDOR_HP=y
CONFIG_HP100=m
CONFIG_NET_VENDOR_INTEL=y
CONFIG_E100=m
CONFIG_E1000=m
CONFIG_E1000E=m
CONFIG_IGB=m
CONFIG_IGB_DCA=y
CONFIG_IGB_PTP=y
CONFIG_IGBVF=m
CONFIG_IXGB=m
CONFIG_IXGBE=m
CONFIG_IXGBE_HWMON=y
CONFIG_IXGBE_DCA=y
CONFIG_IXGBE_DCB=y
CONFIG_IXGBE_PTP=y
CONFIG_NET_VENDOR_I825XX=y
CONFIG_ELPLUS=m
CONFIG_EL16=m
CONFIG_APRICOT=m
CONFIG_EEXPRESS=m
CONFIG_EEXPRESS_PRO=m
CONFIG_LP486E=m
CONFIG_NI52=m
CONFIG_ZNET=m
CONFIG_IP1000=m
CONFIG_JME=m
CONFIG_NET_VENDOR_MARVELL=y
CONFIG_SKGE=m
# CONFIG_SKGE_DEBUG is not set
# CONFIG_SKGE_GENESIS is not set
CONFIG_SKY2=m
# CONFIG_SKY2_DEBUG is not set
CONFIG_NET_VENDOR_MELLANOX=y
CONFIG_MLX4_EN=m
CONFIG_MLX4_EN_DCB=y
CONFIG_MLX4_CORE=m
CONFIG_MLX4_DEBUG=y
CONFIG_NET_VENDOR_MICREL=y
CONFIG_KS8842=m
CONFIG_KS8851=m
CONFIG_KS8851_MLL=m
# CONFIG_KSZ884X_PCI is not set
CONFIG_NET_VENDOR_MICROCHIP=y
CONFIG_ENC28J60=m
# CONFIG_ENC28J60_WRITEVERIFY is not set
CONFIG_NET_VENDOR_MYRI=y
CONFIG_MYRI10GE=m
CONFIG_MYRI10GE_DCA=y
CONFIG_FEALNX=m
CONFIG_NET_VENDOR_NATSEMI=y
CONFIG_NATSEMI=m
CONFIG_NS83820=m
CONFIG_NET_VENDOR_8390=y
CONFIG_EL2=m
CONFIG_AC3200=m
CONFIG_PCMCIA_AXNET=m
CONFIG_E2100=m
CONFIG_HPLAN_PLUS=m
CONFIG_HPLAN=m
CONFIG_NE2000=m
CONFIG_NE2K_PCI=m
CONFIG_PCMCIA_PCNET=m
CONFIG_ULTRA=m
CONFIG_WD80x3=m
CONFIG_NET_VENDOR_NVIDIA=y
CONFIG_FORCEDETH=m
CONFIG_NET_VENDOR_OKI=y
# CONFIG_PCH_GBE is not set
CONFIG_ETHOC=m
CONFIG_NET_PACKET_ENGINE=y
CONFIG_HAMACHI=m
CONFIG_YELLOWFIN=m
CONFIG_NET_VENDOR_QLOGIC=y
CONFIG_QLA3XXX=m
CONFIG_QLCNIC=m
CONFIG_QLGE=m
CONFIG_NETXEN_NIC=m
CONFIG_NET_VENDOR_RACAL=y
CONFIG_NET_VENDOR_REALTEK=y
# CONFIG_ATP is not set
# CONFIG_8139CP is not set
# CONFIG_8139TOO is not set
CONFIG_R8169=m
CONFIG_NET_VENDOR_RDC=y
CONFIG_R6040=m
CONFIG_NET_VENDOR_SEEQ=y
CONFIG_SEEQ8005=m
CONFIG_NET_VENDOR_SILAN=y
CONFIG_SC92031=m
CONFIG_NET_VENDOR_SIS=y
CONFIG_SIS900=m
CONFIG_SIS190=m
CONFIG_SFC=m
CONFIG_SFC_MTD=y
CONFIG_SFC_MCDI_MON=y
CONFIG_SFC_SRIOV=y
CONFIG_NET_VENDOR_SMSC=y
CONFIG_SMC9194=m
CONFIG_PCMCIA_SMC91C92=m
CONFIG_EPIC100=m
CONFIG_SMSC9420=m
CONFIG_NET_VENDOR_STMICRO=y
# CONFIG_STMMAC_ETH is not set
CONFIG_NET_VENDOR_SUN=y
CONFIG_HAPPYMEAL=m
CONFIG_SUNGEM=m
CONFIG_CASSINI=m
CONFIG_NIU=m
CONFIG_NET_VENDOR_TEHUTI=y
CONFIG_TEHUTI=m
CONFIG_NET_VENDOR_TI=y
CONFIG_TLAN=m
CONFIG_NET_VENDOR_VIA=y
CONFIG_VIA_RHINE=m
# CONFIG_VIA_RHINE_MMIO is not set
CONFIG_VIA_VELOCITY=m
CONFIG_NET_VENDOR_WIZNET=y
# CONFIG_WIZNET_W5100 is not set
# CONFIG_WIZNET_W5300 is not set
CONFIG_NET_VENDOR_XIRCOM=y
CONFIG_PCMCIA_XIRC2PS=m
CONFIG_FDDI=y
CONFIG_DEFXX=m
# CONFIG_DEFXX_MMIO is not set
CONFIG_SKFP=m
CONFIG_HIPPI=y
CONFIG_ROADRUNNER=m
# CONFIG_ROADRUNNER_LARGE_RINGS is not set
CONFIG_NET_SB1000=m
CONFIG_PHYLIB=m

#
# MII PHY device drivers
#
# CONFIG_AMD_PHY is not set
CONFIG_MARVELL_PHY=m
CONFIG_DAVICOM_PHY=m
CONFIG_QSEMI_PHY=m
CONFIG_LXT_PHY=m
CONFIG_CICADA_PHY=m
CONFIG_VITESSE_PHY=m
CONFIG_SMSC_PHY=m
CONFIG_BROADCOM_PHY=m
CONFIG_ICPLUS_PHY=m
CONFIG_REALTEK_PHY=m
CONFIG_NATIONAL_PHY=m
CONFIG_STE10XP=m
CONFIG_LSI_ET1011C_PHY=m
# CONFIG_MICREL_PHY is not set
CONFIG_MDIO_BITBANG=m
# CONFIG_MDIO_GPIO is not set
# CONFIG_MICREL_KS8995MA is not set
CONFIG_PLIP=m
CONFIG_PPP=m
CONFIG_PPP_BSDCOMP=m
CONFIG_PPP_DEFLATE=m
CONFIG_PPP_FILTER=y
CONFIG_PPP_MPPE=m
CONFIG_PPP_MULTILINK=y
CONFIG_PPPOATM=m
CONFIG_PPPOE=m
CONFIG_PPP_ASYNC=m
CONFIG_PPP_SYNC_TTY=m
CONFIG_SLIP=m
CONFIG_SLHC=m
CONFIG_SLIP_COMPRESSED=y
CONFIG_SLIP_SMART=y
CONFIG_SLIP_MODE_SLIP6=y

#
# USB Network Adapters
#
CONFIG_USB_CATC=m
CONFIG_USB_KAWETH=m
CONFIG_USB_PEGASUS=m
CONFIG_USB_RTL8150=m
CONFIG_USB_USBNET=m
CONFIG_USB_NET_AX8817X=m
CONFIG_USB_NET_CDCETHER=m
CONFIG_USB_NET_CDC_EEM=m
CONFIG_USB_NET_CDC_NCM=m
CONFIG_USB_NET_DM9601=m
# CONFIG_USB_NET_SMSC75XX is not set
CONFIG_USB_NET_SMSC95XX=m
CONFIG_USB_NET_GL620A=m
CONFIG_USB_NET_NET1080=m
CONFIG_USB_NET_PLUSB=m
CONFIG_USB_NET_MCS7830=m
CONFIG_USB_NET_RNDIS_HOST=m
CONFIG_USB_NET_CDC_SUBSET=m
CONFIG_USB_ALI_M5632=y
CONFIG_USB_AN2720=y
CONFIG_USB_BELKIN=y
CONFIG_USB_ARMLINUX=y
CONFIG_USB_EPSON2888=y
CONFIG_USB_KC2190=y
CONFIG_USB_NET_ZAURUS=m
# CONFIG_USB_NET_CX82310_ETH is not set
# CONFIG_USB_NET_KALMIA is not set
# CONFIG_USB_NET_QMI_WWAN is not set
CONFIG_USB_HSO=m
CONFIG_USB_NET_INT51X1=m
CONFIG_USB_CDC_PHONET=m
CONFIG_USB_IPHETH=m
# CONFIG_USB_SIERRA_NET is not set
# CONFIG_USB_VL600 is not set
CONFIG_WLAN=y
CONFIG_PCMCIA_RAYCS=m
CONFIG_LIBERTAS_THINFIRM=m
# CONFIG_LIBERTAS_THINFIRM_DEBUG is not set
CONFIG_LIBERTAS_THINFIRM_USB=m
CONFIG_AIRO=m
CONFIG_ATMEL=m
CONFIG_PCI_ATMEL=m
CONFIG_PCMCIA_ATMEL=m
CONFIG_AT76C50X_USB=m
CONFIG_AIRO_CS=m
CONFIG_PCMCIA_WL3501=m
# CONFIG_PRISM54 is not set
CONFIG_USB_ZD1201=m
CONFIG_USB_NET_RNDIS_WLAN=m
CONFIG_RTL8180=m
CONFIG_RTL8187=m
CONFIG_RTL8187_LEDS=y
CONFIG_ADM8211=m
CONFIG_MAC80211_HWSIM=m
CONFIG_MWL8K=m
CONFIG_ATH_COMMON=m
# CONFIG_ATH_DEBUG is not set
CONFIG_ATH5K=m
# CONFIG_ATH5K_DEBUG is not set
CONFIG_ATH5K_PCI=y
CONFIG_ATH9K_HW=m
CONFIG_ATH9K_COMMON=m
CONFIG_ATH9K_BTCOEX_SUPPORT=y
CONFIG_ATH9K=m
CONFIG_ATH9K_PCI=y
# CONFIG_ATH9K_AHB is not set
# CONFIG_ATH9K_DEBUGFS is not set
CONFIG_ATH9K_RATE_CONTROL=y
# CONFIG_ATH9K_HTC is not set
# CONFIG_CARL9170 is not set
# CONFIG_ATH6KL is not set
CONFIG_B43=m
CONFIG_B43_SSB=y
CONFIG_B43_PCI_AUTOSELECT=y
CONFIG_B43_PCICORE_AUTOSELECT=y
CONFIG_B43_PCMCIA=y
CONFIG_B43_SDIO=y
CONFIG_B43_PIO=y
# CONFIG_B43_PHY_N is not set
CONFIG_B43_PHY_LP=y
# CONFIG_B43_PHY_HT is not set
CONFIG_B43_LEDS=y
CONFIG_B43_HWRNG=y
# CONFIG_B43_DEBUG is not set
CONFIG_B43LEGACY=m
CONFIG_B43LEGACY_PCI_AUTOSELECT=y
CONFIG_B43LEGACY_PCICORE_AUTOSELECT=y
CONFIG_B43LEGACY_LEDS=y
CONFIG_B43LEGACY_HWRNG=y
CONFIG_B43LEGACY_DEBUG=y
CONFIG_B43LEGACY_DMA=y
CONFIG_B43LEGACY_PIO=y
CONFIG_B43LEGACY_DMA_AND_PIO_MODE=y
# CONFIG_B43LEGACY_DMA_MODE is not set
# CONFIG_B43LEGACY_PIO_MODE is not set
# CONFIG_BRCMFMAC is not set
CONFIG_HOSTAP=m
CONFIG_HOSTAP_FIRMWARE=y
# CONFIG_HOSTAP_FIRMWARE_NVRAM is not set
CONFIG_HOSTAP_PLX=m
CONFIG_HOSTAP_PCI=m
CONFIG_HOSTAP_CS=m
CONFIG_IPW2100=m
CONFIG_IPW2100_MONITOR=y
# CONFIG_IPW2100_DEBUG is not set
CONFIG_IPW2200=m
CONFIG_IPW2200_MONITOR=y
CONFIG_IPW2200_RADIOTAP=y
CONFIG_IPW2200_PROMISCUOUS=y
CONFIG_IPW2200_QOS=y
# CONFIG_IPW2200_DEBUG is not set
CONFIG_LIBIPW=m
# CONFIG_LIBIPW_DEBUG is not set
CONFIG_IWLWIFI=m

#
# Debugging Options
#
# CONFIG_IWLWIFI_DEBUG is not set
CONFIG_IWLWIFI_P2P=y
# CONFIG_IWLWIFI_EXPERIMENTAL_MFP is not set
CONFIG_IWLEGACY=m
CONFIG_IWL4965=m
CONFIG_IWL3945=m

#
# iwl3945 / iwl4965 Debugging Options
#
# CONFIG_IWLEGACY_DEBUG is not set
CONFIG_IWM=m
# CONFIG_IWM_DEBUG is not set
CONFIG_LIBERTAS=m
CONFIG_LIBERTAS_USB=m
CONFIG_LIBERTAS_CS=m
CONFIG_LIBERTAS_SDIO=m
CONFIG_LIBERTAS_SPI=m
# CONFIG_LIBERTAS_DEBUG is not set
# CONFIG_LIBERTAS_MESH is not set
CONFIG_HERMES=m
# CONFIG_HERMES_PRISM is not set
CONFIG_HERMES_CACHE_FW_ON_INIT=y
CONFIG_PLX_HERMES=m
CONFIG_TMD_HERMES=m
CONFIG_NORTEL_HERMES=m
CONFIG_PCMCIA_HERMES=m
CONFIG_PCMCIA_SPECTRUM=m
# CONFIG_ORINOCO_USB is not set
CONFIG_P54_COMMON=m
CONFIG_P54_USB=m
CONFIG_P54_PCI=m
CONFIG_P54_SPI=m
# CONFIG_P54_SPI_DEFAULT_EEPROM is not set
CONFIG_P54_LEDS=y
CONFIG_RT2X00=m
CONFIG_RT2400PCI=m
CONFIG_RT2500PCI=m
CONFIG_RT61PCI=m
# CONFIG_RT2800PCI is not set
CONFIG_RT2500USB=m
CONFIG_RT73USB=m
CONFIG_RT2800USB=m
CONFIG_RT2800USB_RT33XX=y
CONFIG_RT2800USB_RT35XX=y
# CONFIG_RT2800USB_RT53XX is not set
# CONFIG_RT2800USB_UNKNOWN is not set
CONFIG_RT2800_LIB=m
CONFIG_RT2X00_LIB_PCI=m
CONFIG_RT2X00_LIB_USB=m
CONFIG_RT2X00_LIB=m
CONFIG_RT2X00_LIB_FIRMWARE=y
CONFIG_RT2X00_LIB_CRYPTO=y
CONFIG_RT2X00_LIB_LEDS=y
# CONFIG_RT2X00_DEBUG is not set
# CONFIG_RTL8192CE is not set
# CONFIG_RTL8192SE is not set
# CONFIG_RTL8192DE is not set
# CONFIG_RTL8192CU is not set
# CONFIG_WL_TI is not set
CONFIG_ZD1211RW=m
# CONFIG_ZD1211RW_DEBUG is not set
# CONFIG_MWIFIEX is not set

#
# WiMAX Wireless Broadband devices
#
CONFIG_WIMAX_I2400M=m
CONFIG_WIMAX_I2400M_USB=m
CONFIG_WIMAX_I2400M_SDIO=m
# CONFIG_WIMAX_IWMC3200_SDIO is not set
CONFIG_WIMAX_I2400M_DEBUG_LEVEL=8
CONFIG_WAN=y
CONFIG_HOSTESS_SV11=m
CONFIG_COSA=m
CONFIG_LANMEDIA=m
CONFIG_SEALEVEL_4021=m
CONFIG_HDLC=m
CONFIG_HDLC_RAW=m
CONFIG_HDLC_RAW_ETH=m
CONFIG_HDLC_CISCO=m
CONFIG_HDLC_FR=m
CONFIG_HDLC_PPP=m
CONFIG_HDLC_X25=m
CONFIG_PCI200SYN=m
CONFIG_WANXL=m
# CONFIG_PC300TOO is not set
CONFIG_N2=m
CONFIG_C101=m
CONFIG_FARSYNC=m
CONFIG_DSCC4=m
CONFIG_DSCC4_PCISYNC=y
CONFIG_DSCC4_PCI_RST=y
CONFIG_DLCI=m
CONFIG_DLCI_MAX=8
CONFIG_SDLA=m
CONFIG_WAN_ROUTER_DRIVERS=m
CONFIG_CYCLADES_SYNC=m
CONFIG_CYCLOMX_X25=y
CONFIG_LAPBETHER=m
CONFIG_X25_ASY=m
CONFIG_SBNI=m
# CONFIG_SBNI_MULTILINE is not set
CONFIG_VMXNET3=m
CONFIG_ISDN=y
CONFIG_ISDN_I4L=m
CONFIG_ISDN_PPP=y
CONFIG_ISDN_PPP_VJ=y
CONFIG_ISDN_MPP=y
CONFIG_IPPP_FILTER=y
CONFIG_ISDN_PPP_BSDCOMP=m
CONFIG_ISDN_AUDIO=y
CONFIG_ISDN_TTY_FAX=y
CONFIG_ISDN_X25=y

#
# ISDN feature submodules
#
CONFIG_ISDN_DIVERSION=m

#
# ISDN4Linux hardware drivers
#

#
# Passive cards
#
CONFIG_ISDN_DRV_HISAX=m

#
# D-channel protocol features
#
CONFIG_HISAX_EURO=y
CONFIG_DE_AOC=y
# CONFIG_HISAX_NO_SENDCOMPLETE is not set
# CONFIG_HISAX_NO_LLC is not set
# CONFIG_HISAX_NO_KEYPAD is not set
CONFIG_HISAX_1TR6=y
CONFIG_HISAX_NI1=y
CONFIG_HISAX_MAX_CARDS=8

#
# HiSax supported cards
#
CONFIG_HISAX_16_0=y
CONFIG_HISAX_16_3=y
CONFIG_HISAX_TELESPCI=y
CONFIG_HISAX_S0BOX=y
CONFIG_HISAX_AVM_A1=y
CONFIG_HISAX_FRITZPCI=y
CONFIG_HISAX_AVM_A1_PCMCIA=y
CONFIG_HISAX_ELSA=y
CONFIG_HISAX_IX1MICROR2=y
CONFIG_HISAX_DIEHLDIVA=y
CONFIG_HISAX_ASUSCOM=y
CONFIG_HISAX_TELEINT=y
CONFIG_HISAX_HFCS=y
CONFIG_HISAX_SEDLBAUER=y
CONFIG_HISAX_SPORTSTER=y
CONFIG_HISAX_MIC=y
CONFIG_HISAX_NETJET=y
CONFIG_HISAX_NETJET_U=y
CONFIG_HISAX_NICCY=y
CONFIG_HISAX_ISURF=y
CONFIG_HISAX_HSTSAPHIR=y
CONFIG_HISAX_BKM_A4T=y
CONFIG_HISAX_SCT_QUADRO=y
CONFIG_HISAX_GAZEL=y
CONFIG_HISAX_HFC_PCI=y
CONFIG_HISAX_W6692=y
CONFIG_HISAX_HFC_SX=y
CONFIG_HISAX_ENTERNOW_PCI=y
# CONFIG_HISAX_DEBUG is not set

#
# HiSax PCMCIA card service modules
#
CONFIG_HISAX_SEDLBAUER_CS=m
CONFIG_HISAX_ELSA_CS=m
CONFIG_HISAX_AVM_A1_CS=m
CONFIG_HISAX_TELES_CS=m

#
# HiSax sub driver modules
#
CONFIG_HISAX_ST5481=m
CONFIG_HISAX_HFCUSB=m
CONFIG_HISAX_HFC4S8S=m
CONFIG_HISAX_FRITZ_PCIPNP=m

#
# Active cards
#
CONFIG_ISDN_DRV_ICN=m
CONFIG_ISDN_DRV_PCBIT=m
CONFIG_ISDN_DRV_SC=m
CONFIG_ISDN_DRV_ACT2000=m
CONFIG_ISDN_CAPI=m
CONFIG_ISDN_DRV_AVMB1_VERBOSE_REASON=y
CONFIG_CAPI_TRACE=y
CONFIG_ISDN_CAPI_MIDDLEWARE=y
CONFIG_ISDN_CAPI_CAPI20=m
CONFIG_ISDN_CAPI_CAPIDRV=m

#
# CAPI hardware drivers
#
CONFIG_CAPI_AVM=y
CONFIG_ISDN_DRV_AVMB1_B1ISA=m
CONFIG_ISDN_DRV_AVMB1_B1PCI=m
CONFIG_ISDN_DRV_AVMB1_B1PCIV4=y
CONFIG_ISDN_DRV_AVMB1_T1ISA=m
CONFIG_ISDN_DRV_AVMB1_B1PCMCIA=m
CONFIG_ISDN_DRV_AVMB1_AVM_CS=m
CONFIG_ISDN_DRV_AVMB1_T1PCI=m
CONFIG_ISDN_DRV_AVMB1_C4=m
CONFIG_CAPI_EICON=y
CONFIG_ISDN_DIVAS=m
CONFIG_ISDN_DIVAS_BRIPCI=y
CONFIG_ISDN_DIVAS_PRIPCI=y
CONFIG_ISDN_DIVAS_DIVACAPI=m
CONFIG_ISDN_DIVAS_USERIDI=m
CONFIG_ISDN_DIVAS_MAINT=m
CONFIG_ISDN_DRV_GIGASET=m
# CONFIG_GIGASET_CAPI is not set
CONFIG_GIGASET_I4L=y
# CONFIG_GIGASET_DUMMYLL is not set
CONFIG_GIGASET_BASE=m
CONFIG_GIGASET_M105=m
CONFIG_GIGASET_M101=m
# CONFIG_GIGASET_DEBUG is not set
CONFIG_HYSDN=m
CONFIG_HYSDN_CAPI=y
CONFIG_MISDN=m
CONFIG_MISDN_DSP=m
CONFIG_MISDN_L1OIP=m

#
# mISDN hardware drivers
#
CONFIG_MISDN_HFCPCI=m
CONFIG_MISDN_HFCMULTI=m
CONFIG_MISDN_HFCUSB=m
CONFIG_MISDN_AVMFRITZ=m
CONFIG_MISDN_SPEEDFAX=m
CONFIG_MISDN_INFINEON=m
CONFIG_MISDN_W6692=m
# CONFIG_MISDN_NETJET is not set
CONFIG_MISDN_IPAC=m
CONFIG_MISDN_ISAR=m
CONFIG_ISDN_HDLC=m

#
# Input device support
#
CONFIG_INPUT=y
CONFIG_INPUT_FF_MEMLESS=m
CONFIG_INPUT_POLLDEV=m
CONFIG_INPUT_SPARSEKMAP=m
# CONFIG_INPUT_MATRIXKMAP is not set

#
# Userland interfaces
#
CONFIG_INPUT_MOUSEDEV=y
CONFIG_INPUT_MOUSEDEV_PSAUX=y
CONFIG_INPUT_MOUSEDEV_SCREEN_X=1024
CONFIG_INPUT_MOUSEDEV_SCREEN_Y=768
CONFIG_INPUT_JOYDEV=m
CONFIG_INPUT_EVDEV=m
# CONFIG_INPUT_EVBUG is not set

#
# Input Device Drivers
#
CONFIG_INPUT_KEYBOARD=y
CONFIG_KEYBOARD_ADP5588=m
# CONFIG_KEYBOARD_ADP5589 is not set
CONFIG_KEYBOARD_ATKBD=y
# CONFIG_KEYBOARD_QT1070 is not set
# CONFIG_KEYBOARD_QT2160 is not set
CONFIG_KEYBOARD_LKKBD=m
# CONFIG_KEYBOARD_GPIO is not set
# CONFIG_KEYBOARD_GPIO_POLLED is not set
# CONFIG_KEYBOARD_TCA6416 is not set
# CONFIG_KEYBOARD_TCA8418 is not set
# CONFIG_KEYBOARD_MATRIX is not set
CONFIG_KEYBOARD_LM8323=m
# CONFIG_KEYBOARD_LM8333 is not set
CONFIG_KEYBOARD_MAX7359=m
# CONFIG_KEYBOARD_MCS is not set
# CONFIG_KEYBOARD_MPR121 is not set
CONFIG_KEYBOARD_NEWTON=m
CONFIG_KEYBOARD_OPENCORES=m
CONFIG_KEYBOARD_STOWAWAY=m
CONFIG_KEYBOARD_SUNKBD=m
# CONFIG_KEYBOARD_OMAP4 is not set
CONFIG_KEYBOARD_XTKBD=m
CONFIG_INPUT_MOUSE=y
CONFIG_MOUSE_PS2=m
CONFIG_MOUSE_PS2_ALPS=y
CONFIG_MOUSE_PS2_LOGIPS2PP=y
CONFIG_MOUSE_PS2_SYNAPTICS=y
CONFIG_MOUSE_PS2_LIFEBOOK=y
CONFIG_MOUSE_PS2_TRACKPOINT=y
CONFIG_MOUSE_PS2_ELANTECH=y
CONFIG_MOUSE_PS2_SENTELIC=y
# CONFIG_MOUSE_PS2_TOUCHKIT is not set
CONFIG_MOUSE_SERIAL=m
CONFIG_MOUSE_APPLETOUCH=m
CONFIG_MOUSE_BCM5974=m
CONFIG_MOUSE_INPORT=m
# CONFIG_MOUSE_ATIXL is not set
CONFIG_MOUSE_LOGIBM=m
CONFIG_MOUSE_PC110PAD=m
CONFIG_MOUSE_VSXXXAA=m
# CONFIG_MOUSE_GPIO is not set
CONFIG_MOUSE_SYNAPTICS_I2C=m
# CONFIG_MOUSE_SYNAPTICS_USB is not set
CONFIG_INPUT_JOYSTICK=y
CONFIG_JOYSTICK_ANALOG=m
CONFIG_JOYSTICK_A3D=m
CONFIG_JOYSTICK_ADI=m
CONFIG_JOYSTICK_COBRA=m
CONFIG_JOYSTICK_GF2K=m
CONFIG_JOYSTICK_GRIP=m
CONFIG_JOYSTICK_GRIP_MP=m
CONFIG_JOYSTICK_GUILLEMOT=m
CONFIG_JOYSTICK_INTERACT=m
CONFIG_JOYSTICK_SIDEWINDER=m
CONFIG_JOYSTICK_TMDC=m
CONFIG_JOYSTICK_IFORCE=m
CONFIG_JOYSTICK_IFORCE_USB=y
CONFIG_JOYSTICK_IFORCE_232=y
CONFIG_JOYSTICK_WARRIOR=m
CONFIG_JOYSTICK_MAGELLAN=m
CONFIG_JOYSTICK_SPACEORB=m
CONFIG_JOYSTICK_SPACEBALL=m
CONFIG_JOYSTICK_STINGER=m
CONFIG_JOYSTICK_TWIDJOY=m
CONFIG_JOYSTICK_ZHENHUA=m
CONFIG_JOYSTICK_DB9=m
CONFIG_JOYSTICK_GAMECON=m
CONFIG_JOYSTICK_TURBOGRAFX=m
# CONFIG_JOYSTICK_AS5011 is not set
CONFIG_JOYSTICK_JOYDUMP=m
CONFIG_JOYSTICK_XPAD=m
CONFIG_JOYSTICK_XPAD_FF=y
CONFIG_JOYSTICK_XPAD_LEDS=y
CONFIG_JOYSTICK_WALKERA0701=m
CONFIG_INPUT_TABLET=y
CONFIG_TABLET_USB_ACECAD=m
CONFIG_TABLET_USB_AIPTEK=m
CONFIG_TABLET_USB_GTCO=m
# CONFIG_TABLET_USB_HANWANG is not set
CONFIG_TABLET_USB_KBTAB=m
CONFIG_TABLET_USB_WACOM=m
CONFIG_INPUT_TOUCHSCREEN=y
CONFIG_TOUCHSCREEN_ADS7846=m
CONFIG_TOUCHSCREEN_AD7877=m
CONFIG_TOUCHSCREEN_AD7879=m
CONFIG_TOUCHSCREEN_AD7879_I2C=m
# CONFIG_TOUCHSCREEN_AD7879_SPI is not set
# CONFIG_TOUCHSCREEN_ATMEL_MXT is not set
# CONFIG_TOUCHSCREEN_AUO_PIXCIR is not set
# CONFIG_TOUCHSCREEN_BU21013 is not set
# CONFIG_TOUCHSCREEN_CY8CTMG110 is not set
# CONFIG_TOUCHSCREEN_CYTTSP_CORE is not set
# CONFIG_TOUCHSCREEN_DYNAPRO is not set
# CONFIG_TOUCHSCREEN_HAMPSHIRE is not set
CONFIG_TOUCHSCREEN_EETI=m
# CONFIG_TOUCHSCREEN_EGALAX is not set
CONFIG_TOUCHSCREEN_FUJITSU=m
# CONFIG_TOUCHSCREEN_ILI210X is not set
CONFIG_TOUCHSCREEN_GUNZE=m
CONFIG_TOUCHSCREEN_ELO=m
CONFIG_TOUCHSCREEN_WACOM_W8001=m
# CONFIG_TOUCHSCREEN_WACOM_I2C is not set
# CONFIG_TOUCHSCREEN_MAX11801 is not set
CONFIG_TOUCHSCREEN_MCS5000=m
CONFIG_TOUCHSCREEN_MTOUCH=m
CONFIG_TOUCHSCREEN_INEXIO=m
CONFIG_TOUCHSCREEN_MK712=m
CONFIG_TOUCHSCREEN_HTCPEN=m
CONFIG_TOUCHSCREEN_PENMOUNT=m
CONFIG_TOUCHSCREEN_TOUCHRIGHT=m
CONFIG_TOUCHSCREEN_TOUCHWIN=m
# CONFIG_TOUCHSCREEN_PIXCIR is not set
CONFIG_TOUCHSCREEN_WM97XX=m
CONFIG_TOUCHSCREEN_WM9705=y
CONFIG_TOUCHSCREEN_WM9712=y
CONFIG_TOUCHSCREEN_WM9713=y
CONFIG_TOUCHSCREEN_USB_COMPOSITE=m
CONFIG_TOUCHSCREEN_USB_EGALAX=y
CONFIG_TOUCHSCREEN_USB_PANJIT=y
CONFIG_TOUCHSCREEN_USB_3M=y
CONFIG_TOUCHSCREEN_USB_ITM=y
CONFIG_TOUCHSCREEN_USB_ETURBO=y
CONFIG_TOUCHSCREEN_USB_GUNZE=y
CONFIG_TOUCHSCREEN_USB_DMC_TSC10=y
CONFIG_TOUCHSCREEN_USB_IRTOUCH=y
CONFIG_TOUCHSCREEN_USB_IDEALTEK=y
CONFIG_TOUCHSCREEN_USB_GENERAL_TOUCH=y
CONFIG_TOUCHSCREEN_USB_GOTOP=y
CONFIG_TOUCHSCREEN_USB_JASTEC=y
CONFIG_TOUCHSCREEN_USB_ELO=y
CONFIG_TOUCHSCREEN_USB_E2I=y
CONFIG_TOUCHSCREEN_USB_ZYTRONIC=y
CONFIG_TOUCHSCREEN_USB_ETT_TC45USB=y
CONFIG_TOUCHSCREEN_USB_NEXIO=y
CONFIG_TOUCHSCREEN_USB_EASYTOUCH=y
CONFIG_TOUCHSCREEN_TOUCHIT213=m
# CONFIG_TOUCHSCREEN_TSC_SERIO is not set
# CONFIG_TOUCHSCREEN_TSC2005 is not set
CONFIG_TOUCHSCREEN_TSC2007=m
# CONFIG_TOUCHSCREEN_ST1232 is not set
# CONFIG_TOUCHSCREEN_TPS6507X is not set
CONFIG_INPUT_MISC=y
# CONFIG_INPUT_AD714X is not set
# CONFIG_INPUT_BMA150 is not set
# CONFIG_INPUT_PCSPKR is not set
# CONFIG_INPUT_MMA8450 is not set
# CONFIG_INPUT_MPU3050 is not set
CONFIG_INPUT_APANEL=m
# CONFIG_INPUT_GP2A is not set
# CONFIG_INPUT_GPIO_TILT_POLLED is not set
CONFIG_INPUT_WISTRON_BTNS=m
CONFIG_INPUT_ATLAS_BTNS=m
CONFIG_INPUT_ATI_REMOTE2=m
CONFIG_INPUT_KEYSPAN_REMOTE=m
# CONFIG_INPUT_KXTJ9 is not set
CONFIG_INPUT_POWERMATE=m
CONFIG_INPUT_YEALINK=m
CONFIG_INPUT_CM109=m
CONFIG_INPUT_UINPUT=m
CONFIG_INPUT_PCF50633_PMU=m
# CONFIG_INPUT_PCF8574 is not set
# CONFIG_INPUT_GPIO_ROTARY_ENCODER is not set
# CONFIG_INPUT_ADXL34X is not set
# CONFIG_INPUT_CMA3000 is not set

#
# Hardware I/O ports
#
CONFIG_SERIO=y
CONFIG_SERIO_I8042=y
CONFIG_SERIO_SERPORT=m
CONFIG_SERIO_CT82C710=m
CONFIG_SERIO_PARKBD=m
CONFIG_SERIO_PCIPS2=m
CONFIG_SERIO_LIBPS2=y
CONFIG_SERIO_RAW=m
# CONFIG_SERIO_ALTERA_PS2 is not set
# CONFIG_SERIO_PS2MULT is not set
CONFIG_GAMEPORT=m
CONFIG_GAMEPORT_NS558=m
CONFIG_GAMEPORT_L4=m
CONFIG_GAMEPORT_EMU10K1=m
CONFIG_GAMEPORT_FM801=m

#
# Character devices
#
CONFIG_VT=y
CONFIG_CONSOLE_TRANSLATIONS=y
CONFIG_VT_CONSOLE=y
CONFIG_VT_CONSOLE_SLEEP=y
CONFIG_HW_CONSOLE=y
CONFIG_VT_HW_CONSOLE_BINDING=y
CONFIG_UNIX98_PTYS=y
CONFIG_DEVPTS_MULTIPLE_INSTANCES=y
# CONFIG_LEGACY_PTYS is not set
CONFIG_SERIAL_NONSTANDARD=y
CONFIG_ROCKETPORT=m
CONFIG_CYCLADES=m
# CONFIG_CYZ_INTR is not set
# CONFIG_MOXA_INTELLIO is not set
CONFIG_MOXA_SMARTIO=m
CONFIG_SYNCLINK=m
CONFIG_SYNCLINKMP=m
CONFIG_SYNCLINK_GT=m
CONFIG_NOZOMI=m
# CONFIG_ISI is not set
CONFIG_N_HDLC=m
# CONFIG_N_GSM is not set
# CONFIG_TRACE_SINK is not set
# CONFIG_DEVKMEM is not set
CONFIG_STALDRV=y

#
# Serial drivers
#
CONFIG_SERIAL_8250=y
CONFIG_SERIAL_8250_CONSOLE=y
CONFIG_FIX_EARLYCON_MEM=y
CONFIG_SERIAL_8250_PCI=y
CONFIG_SERIAL_8250_PNP=y
CONFIG_SERIAL_8250_CS=m
CONFIG_SERIAL_8250_NR_UARTS=32
CONFIG_SERIAL_8250_RUNTIME_UARTS=4
CONFIG_SERIAL_8250_EXTENDED=y
CONFIG_SERIAL_8250_MANY_PORTS=y
CONFIG_SERIAL_8250_FOURPORT=m
CONFIG_SERIAL_8250_ACCENT=m
CONFIG_SERIAL_8250_BOCA=m
CONFIG_SERIAL_8250_EXAR_ST16C554=m
CONFIG_SERIAL_8250_HUB6=m
CONFIG_SERIAL_8250_SHARE_IRQ=y
# CONFIG_SERIAL_8250_DETECT_IRQ is not set
CONFIG_SERIAL_8250_RSA=y

#
# Non-8250 serial port support
#
CONFIG_SERIAL_MAX3100=m
# CONFIG_SERIAL_MAX3107 is not set
# CONFIG_SERIAL_MFD_HSU is not set
CONFIG_SERIAL_CORE=y
CONFIG_SERIAL_CORE_CONSOLE=y
CONFIG_SERIAL_JSM=m
# CONFIG_SERIAL_TIMBERDALE is not set
# CONFIG_SERIAL_ALTERA_JTAGUART is not set
# CONFIG_SERIAL_ALTERA_UART is not set
# CONFIG_SERIAL_IFX6X60 is not set
# CONFIG_SERIAL_PCH_UART is not set
# CONFIG_SERIAL_XILINX_PS_UART is not set
CONFIG_PRINTER=m
# CONFIG_LP_CONSOLE is not set
CONFIG_PPDEV=m
CONFIG_HVC_DRIVER=y
CONFIG_VIRTIO_CONSOLE=m
CONFIG_IPMI_HANDLER=m
# CONFIG_IPMI_PANIC_EVENT is not set
CONFIG_IPMI_DEVICE_INTERFACE=m
CONFIG_IPMI_SI=m
CONFIG_IPMI_WATCHDOG=m
CONFIG_IPMI_POWEROFF=m
CONFIG_HW_RANDOM=m
CONFIG_HW_RANDOM_TIMERIOMEM=m
CONFIG_HW_RANDOM_INTEL=m
CONFIG_HW_RANDOM_AMD=m
CONFIG_HW_RANDOM_GEODE=m
CONFIG_HW_RANDOM_VIA=m
CONFIG_HW_RANDOM_VIRTIO=m
CONFIG_NVRAM=m
CONFIG_DTLK=m
CONFIG_R3964=m
CONFIG_APPLICOM=m
CONFIG_SONYPI=m

#
# PCMCIA character devices
#
CONFIG_SYNCLINK_CS=m
CONFIG_CARDMAN_4000=m
CONFIG_CARDMAN_4040=m
CONFIG_IPWIRELESS=m
CONFIG_MWAVE=m
CONFIG_SCx200_GPIO=m
CONFIG_PC8736x_GPIO=m
CONFIG_NSC_GPIO=m
CONFIG_RAW_DRIVER=m
CONFIG_MAX_RAW_DEVS=256
CONFIG_HPET=y
CONFIG_HPET_MMAP=y
CONFIG_HANGCHECK_TIMER=m
CONFIG_TCG_TPM=m
CONFIG_TCG_TIS=m
CONFIG_TCG_NSC=m
CONFIG_TCG_ATMEL=m
CONFIG_TCG_INFINEON=m
CONFIG_TELCLOCK=m
CONFIG_DEVPORT=y
CONFIG_I2C=m
CONFIG_I2C_BOARDINFO=y
CONFIG_I2C_COMPAT=y
CONFIG_I2C_CHARDEV=m
# CONFIG_I2C_MUX is not set
CONFIG_I2C_HELPER_AUTO=y
CONFIG_I2C_SMBUS=m
CONFIG_I2C_ALGOBIT=m
CONFIG_I2C_ALGOPCA=m

#
# I2C Hardware Bus support
#

#
# PC SMBus host controller drivers
#
CONFIG_I2C_ALI1535=m
CONFIG_I2C_ALI1563=m
CONFIG_I2C_ALI15X3=m
CONFIG_I2C_AMD756=m
CONFIG_I2C_AMD756_S4882=m
CONFIG_I2C_AMD8111=m
CONFIG_I2C_I801=m
CONFIG_I2C_ISCH=m
CONFIG_I2C_PIIX4=m
CONFIG_I2C_NFORCE2=m
CONFIG_I2C_NFORCE2_S4985=m
CONFIG_I2C_SIS5595=m
CONFIG_I2C_SIS630=m
CONFIG_I2C_SIS96X=m
CONFIG_I2C_VIA=m
CONFIG_I2C_VIAPRO=m

#
# ACPI drivers
#
CONFIG_I2C_SCMI=m

#
# I2C system bus drivers (mostly embedded / system-on-chip)
#
# CONFIG_I2C_DESIGNWARE_PCI is not set
# CONFIG_I2C_EG20T is not set
# CONFIG_I2C_GPIO is not set
# CONFIG_I2C_INTEL_MID is not set
CONFIG_I2C_OCORES=m
CONFIG_I2C_PCA_PLATFORM=m
# CONFIG_I2C_PXA_PCI is not set
CONFIG_I2C_SIMTEC=m
# CONFIG_I2C_XILINX is not set

#
# External I2C/SMBus adapter drivers
#
# CONFIG_I2C_DIOLAN_U2C is not set
CONFIG_I2C_PARPORT=m
CONFIG_I2C_PARPORT_LIGHT=m
CONFIG_I2C_TAOS_EVM=m
CONFIG_I2C_TINY_USB=m

#
# Other I2C/SMBus bus drivers
#
CONFIG_I2C_PCA_ISA=m
CONFIG_I2C_STUB=m
CONFIG_SCx200_I2C=m
CONFIG_SCx200_I2C_SCL=12
CONFIG_SCx200_I2C_SDA=13
CONFIG_SCx200_ACB=m
# CONFIG_I2C_DEBUG_CORE is not set
# CONFIG_I2C_DEBUG_ALGO is not set
# CONFIG_I2C_DEBUG_BUS is not set
CONFIG_SPI=y
# CONFIG_SPI_DEBUG is not set
CONFIG_SPI_MASTER=y

#
# SPI Master Controller Drivers
#
# CONFIG_SPI_ALTERA is not set
CONFIG_SPI_BITBANG=m
CONFIG_SPI_BUTTERFLY=m
# CONFIG_SPI_GPIO is not set
CONFIG_SPI_LM70_LLP=m
# CONFIG_SPI_OC_TINY is not set
# CONFIG_SPI_PXA2XX is not set
# CONFIG_SPI_PXA2XX_PCI is not set
# CONFIG_SPI_TOPCLIFF_PCH is not set
# CONFIG_SPI_XILINX is not set
# CONFIG_SPI_DESIGNWARE is not set

#
# SPI Protocol Masters
#
# CONFIG_SPI_SPIDEV is not set
CONFIG_SPI_TLE62X0=m
# CONFIG_HSI is not set

#
# PPS support
#
CONFIG_PPS=m
# CONFIG_PPS_DEBUG is not set

#
# PPS clients support
#
# CONFIG_PPS_CLIENT_KTIMER is not set
# CONFIG_PPS_CLIENT_LDISC is not set
# CONFIG_PPS_CLIENT_PARPORT is not set
# CONFIG_PPS_CLIENT_GPIO is not set

#
# PPS generators support
#

#
# PTP clock support
#
CONFIG_PTP_1588_CLOCK=m
# CONFIG_DP83640_PHY is not set
CONFIG_ARCH_WANT_OPTIONAL_GPIOLIB=y
CONFIG_GPIOLIB=y
# CONFIG_DEBUG_GPIO is not set
# CONFIG_GPIO_SYSFS is not set

#
# Memory mapped GPIO drivers:
#
# CONFIG_GPIO_GENERIC_PLATFORM is not set
# CONFIG_GPIO_IT8761E is not set
# CONFIG_GPIO_SCH is not set
# CONFIG_GPIO_ICH is not set
# CONFIG_GPIO_VX855 is not set

#
# I2C GPIO expanders:
#
# CONFIG_GPIO_MAX7300 is not set
# CONFIG_GPIO_MAX732X is not set
# CONFIG_GPIO_PCA953X is not set
# CONFIG_GPIO_PCF857X is not set
# CONFIG_GPIO_ADP5588 is not set

#
# PCI GPIO expanders:
#
# CONFIG_GPIO_LANGWELL is not set
# CONFIG_GPIO_PCH is not set
# CONFIG_GPIO_ML_IOH is not set
# CONFIG_GPIO_RDC321X is not set

#
# SPI GPIO expanders:
#
# CONFIG_GPIO_MAX7301 is not set
# CONFIG_GPIO_MCP23S08 is not set
# CONFIG_GPIO_MC33880 is not set
# CONFIG_GPIO_74X164 is not set

#
# AC97 GPIO expanders:
#

#
# MODULbus GPIO expanders:
#
CONFIG_W1=m
CONFIG_W1_CON=y

#
# 1-wire Bus Masters
#
CONFIG_W1_MASTER_MATROX=m
CONFIG_W1_MASTER_DS2490=m
CONFIG_W1_MASTER_DS2482=m
# CONFIG_W1_MASTER_DS1WM is not set
# CONFIG_W1_MASTER_GPIO is not set

#
# 1-wire Slaves
#
CONFIG_W1_SLAVE_THERM=m
CONFIG_W1_SLAVE_SMEM=m
# CONFIG_W1_SLAVE_DS2408 is not set
# CONFIG_W1_SLAVE_DS2423 is not set
CONFIG_W1_SLAVE_DS2431=m
CONFIG_W1_SLAVE_DS2433=m
# CONFIG_W1_SLAVE_DS2433_CRC is not set
CONFIG_W1_SLAVE_DS2760=m
# CONFIG_W1_SLAVE_DS2780 is not set
# CONFIG_W1_SLAVE_DS2781 is not set
CONFIG_W1_SLAVE_BQ27000=m
CONFIG_POWER_SUPPLY=y
# CONFIG_POWER_SUPPLY_DEBUG is not set
CONFIG_PDA_POWER=m
# CONFIG_TEST_POWER is not set
CONFIG_BATTERY_DS2760=m
# CONFIG_BATTERY_DS2780 is not set
# CONFIG_BATTERY_DS2781 is not set
CONFIG_BATTERY_DS2782=m
# CONFIG_BATTERY_SBS is not set
CONFIG_BATTERY_BQ27x00=m
CONFIG_BATTERY_BQ27X00_I2C=y
CONFIG_BATTERY_BQ27X00_PLATFORM=y
CONFIG_BATTERY_MAX17040=m
# CONFIG_BATTERY_MAX17042 is not set
CONFIG_CHARGER_PCF50633=m
# CONFIG_CHARGER_ISP1704 is not set
# CONFIG_CHARGER_MAX8903 is not set
# CONFIG_CHARGER_LP8727 is not set
# CONFIG_CHARGER_GPIO is not set
# CONFIG_CHARGER_MANAGER is not set
# CONFIG_CHARGER_SMB347 is not set
CONFIG_HWMON=y
CONFIG_HWMON_VID=m
# CONFIG_HWMON_DEBUG_CHIP is not set

#
# Native drivers
#
CONFIG_SENSORS_ABITUGURU=m
CONFIG_SENSORS_ABITUGURU3=m
# CONFIG_SENSORS_AD7314 is not set
CONFIG_SENSORS_AD7414=m
CONFIG_SENSORS_AD7418=m
CONFIG_SENSORS_ADCXX=m
CONFIG_SENSORS_ADM1021=m
CONFIG_SENSORS_ADM1025=m
CONFIG_SENSORS_ADM1026=m
CONFIG_SENSORS_ADM1029=m
CONFIG_SENSORS_ADM1031=m
CONFIG_SENSORS_ADM9240=m
# CONFIG_SENSORS_ADT7411 is not set
CONFIG_SENSORS_ADT7462=m
CONFIG_SENSORS_ADT7470=m
CONFIG_SENSORS_ADT7475=m
# CONFIG_SENSORS_ASC7621 is not set
CONFIG_SENSORS_K8TEMP=m
CONFIG_SENSORS_K10TEMP=m
# CONFIG_SENSORS_FAM15H_POWER is not set
CONFIG_SENSORS_ASB100=m
CONFIG_SENSORS_ATXP1=m
# CONFIG_SENSORS_DS620 is not set
CONFIG_SENSORS_DS1621=m
CONFIG_SENSORS_I5K_AMB=m
CONFIG_SENSORS_F71805F=m
CONFIG_SENSORS_F71882FG=m
CONFIG_SENSORS_F75375S=m
CONFIG_SENSORS_FSCHMD=m
CONFIG_SENSORS_G760A=m
CONFIG_SENSORS_GL518SM=m
CONFIG_SENSORS_GL520SM=m
# CONFIG_SENSORS_GPIO_FAN is not set
CONFIG_SENSORS_CORETEMP=m
CONFIG_SENSORS_IBMAEM=m
CONFIG_SENSORS_IBMPEX=m
CONFIG_SENSORS_IT87=m
# CONFIG_SENSORS_JC42 is not set
# CONFIG_SENSORS_LINEAGE is not set
CONFIG_SENSORS_LM63=m
CONFIG_SENSORS_LM70=m
# CONFIG_SENSORS_LM73 is not set
CONFIG_SENSORS_LM75=m
CONFIG_SENSORS_LM77=m
CONFIG_SENSORS_LM78=m
CONFIG_SENSORS_LM80=m
CONFIG_SENSORS_LM83=m
CONFIG_SENSORS_LM85=m
CONFIG_SENSORS_LM87=m
CONFIG_SENSORS_LM90=m
CONFIG_SENSORS_LM92=m
CONFIG_SENSORS_LM93=m
# CONFIG_SENSORS_LTC4151 is not set
CONFIG_SENSORS_LTC4215=m
CONFIG_SENSORS_LTC4245=m
# CONFIG_SENSORS_LTC4261 is not set
CONFIG_SENSORS_LM95241=m
# CONFIG_SENSORS_LM95245 is not set
CONFIG_SENSORS_MAX1111=m
# CONFIG_SENSORS_MAX16065 is not set
CONFIG_SENSORS_MAX1619=m
# CONFIG_SENSORS_MAX1668 is not set
# CONFIG_SENSORS_MAX6639 is not set
# CONFIG_SENSORS_MAX6642 is not set
CONFIG_SENSORS_MAX6650=m
# CONFIG_SENSORS_MCP3021 is not set
# CONFIG_SENSORS_NTC_THERMISTOR is not set
CONFIG_SENSORS_PC87360=m
CONFIG_SENSORS_PC87427=m
CONFIG_SENSORS_PCF8591=m
# CONFIG_PMBUS is not set
# CONFIG_SENSORS_SHT15 is not set
# CONFIG_SENSORS_SHT21 is not set
CONFIG_SENSORS_SIS5595=m
# CONFIG_SENSORS_SMM665 is not set
CONFIG_SENSORS_DME1737=m
# CONFIG_SENSORS_EMC1403 is not set
# CONFIG_SENSORS_EMC2103 is not set
# CONFIG_SENSORS_EMC6W201 is not set
CONFIG_SENSORS_SMSC47M1=m
CONFIG_SENSORS_SMSC47M192=m
CONFIG_SENSORS_SMSC47B397=m
# CONFIG_SENSORS_SCH56XX_COMMON is not set
# CONFIG_SENSORS_SCH5627 is not set
# CONFIG_SENSORS_SCH5636 is not set
# CONFIG_SENSORS_ADS1015 is not set
CONFIG_SENSORS_ADS7828=m
# CONFIG_SENSORS_ADS7871 is not set
# CONFIG_SENSORS_AMC6821 is not set
# CONFIG_SENSORS_INA2XX is not set
CONFIG_SENSORS_THMC50=m
# CONFIG_SENSORS_TMP102 is not set
CONFIG_SENSORS_TMP401=m
CONFIG_SENSORS_TMP421=m
CONFIG_SENSORS_VIA_CPUTEMP=m
CONFIG_SENSORS_VIA686A=m
CONFIG_SENSORS_VT1211=m
CONFIG_SENSORS_VT8231=m
CONFIG_SENSORS_W83781D=m
CONFIG_SENSORS_W83791D=m
CONFIG_SENSORS_W83792D=m
CONFIG_SENSORS_W83793=m
# CONFIG_SENSORS_W83795 is not set
CONFIG_SENSORS_W83L785TS=m
CONFIG_SENSORS_W83L786NG=m
CONFIG_SENSORS_W83627HF=m
CONFIG_SENSORS_W83627EHF=m
CONFIG_SENSORS_APPLESMC=m

#
# ACPI drivers
#
# CONFIG_SENSORS_ACPI_POWER is not set
CONFIG_SENSORS_ATK0110=m
CONFIG_THERMAL=m
CONFIG_THERMAL_HWMON=y
CONFIG_WATCHDOG=y
CONFIG_WATCHDOG_CORE=y
# CONFIG_WATCHDOG_NOWAYOUT is not set

#
# Watchdog Device Drivers
#
CONFIG_SOFT_WATCHDOG=m
CONFIG_ACQUIRE_WDT=m
CONFIG_ADVANTECH_WDT=m
CONFIG_ALIM1535_WDT=m
CONFIG_ALIM7101_WDT=m
CONFIG_F71808E_WDT=m
# CONFIG_SP5100_TCO is not set
CONFIG_SC520_WDT=m
CONFIG_SBC_FITPC2_WATCHDOG=m
CONFIG_EUROTECH_WDT=m
CONFIG_IB700_WDT=m
CONFIG_IBMASR=m
CONFIG_WAFER_WDT=m
CONFIG_I6300ESB_WDT=m
# CONFIG_IE6XX_WDT is not set
CONFIG_ITCO_WDT=m
CONFIG_ITCO_VENDOR_SUPPORT=y
CONFIG_IT8712F_WDT=m
CONFIG_IT87_WDT=m
CONFIG_HP_WATCHDOG=m
CONFIG_HPWDT_NMI_DECODING=y
CONFIG_SC1200_WDT=m
CONFIG_SCx200_WDT=m
CONFIG_PC87413_WDT=m
# CONFIG_NV_TCO is not set
CONFIG_60XX_WDT=m
CONFIG_SBC8360_WDT=m
CONFIG_SBC7240_WDT=m
CONFIG_CPU5_WDT=m
CONFIG_SMSC_SCH311X_WDT=m
CONFIG_SMSC37B787_WDT=m
# CONFIG_VIA_WDT is not set
CONFIG_W83627HF_WDT=m
CONFIG_W83697HF_WDT=m
CONFIG_W83697UG_WDT=m
CONFIG_W83877F_WDT=m
CONFIG_W83977F_WDT=m
CONFIG_MACHZ_WDT=m
CONFIG_SBC_EPX_C3_WATCHDOG=m

#
# ISA-based Watchdog Cards
#
CONFIG_PCWATCHDOG=m
CONFIG_MIXCOMWD=m
CONFIG_WDT=m

#
# PCI-based Watchdog Cards
#
CONFIG_PCIPCWATCHDOG=m
CONFIG_WDTPCI=m

#
# USB-based Watchdog Cards
#
CONFIG_USBPCWATCHDOG=m
CONFIG_SSB_POSSIBLE=y

#
# Sonics Silicon Backplane
#
CONFIG_SSB=m
CONFIG_SSB_SPROM=y
CONFIG_SSB_BLOCKIO=y
CONFIG_SSB_PCIHOST_POSSIBLE=y
CONFIG_SSB_PCIHOST=y
CONFIG_SSB_B43_PCI_BRIDGE=y
CONFIG_SSB_PCMCIAHOST_POSSIBLE=y
CONFIG_SSB_PCMCIAHOST=y
CONFIG_SSB_SDIOHOST_POSSIBLE=y
CONFIG_SSB_SDIOHOST=y
# CONFIG_SSB_DEBUG is not set
CONFIG_SSB_DRIVER_PCICORE_POSSIBLE=y
CONFIG_SSB_DRIVER_PCICORE=y
CONFIG_BCMA_POSSIBLE=y

#
# Broadcom specific AMBA
#
# CONFIG_BCMA is not set

#
# Multifunction device drivers
#
CONFIG_MFD_CORE=m
CONFIG_MFD_SM501=m
# CONFIG_MFD_SM501_GPIO is not set
CONFIG_HTC_PASIC3=m
# CONFIG_UCB1400_CORE is not set
# CONFIG_MFD_LM3533 is not set
# CONFIG_TPS6105X is not set
# CONFIG_TPS65010 is not set
# CONFIG_TPS6507X is not set
# CONFIG_MFD_TPS65217 is not set
# CONFIG_MFD_TPS65912_SPI is not set
# CONFIG_MFD_STMPE is not set
# CONFIG_MFD_TMIO is not set
# CONFIG_MFD_DA9052_SPI is not set
# CONFIG_MFD_WM831X_SPI is not set
CONFIG_MFD_PCF50633=m
CONFIG_PCF50633_ADC=m
CONFIG_PCF50633_GPIO=m
# CONFIG_MFD_MC13XXX_SPI is not set
# CONFIG_MFD_MC13XXX_I2C is not set
# CONFIG_ABX500_CORE is not set
# CONFIG_EZX_PCAP is not set
# CONFIG_MFD_CS5535 is not set
# CONFIG_MFD_TIMBERDALE is not set
CONFIG_LPC_SCH=m
CONFIG_LPC_ICH=m
# CONFIG_MFD_RDC321X is not set
# CONFIG_MFD_JANZ_CMODIO is not set
# CONFIG_MFD_VX855 is not set
# CONFIG_MFD_WL1273_CORE is not set
CONFIG_REGULATOR=y
# CONFIG_REGULATOR_DEBUG is not set
# CONFIG_REGULATOR_DUMMY is not set
CONFIG_REGULATOR_FIXED_VOLTAGE=m
# CONFIG_REGULATOR_VIRTUAL_CONSUMER is not set
CONFIG_REGULATOR_USERSPACE_CONSUMER=m
# CONFIG_REGULATOR_GPIO is not set
# CONFIG_REGULATOR_AD5398 is not set
# CONFIG_REGULATOR_ISL6271A is not set
CONFIG_REGULATOR_MAX1586=m
# CONFIG_REGULATOR_MAX8649 is not set
# CONFIG_REGULATOR_MAX8660 is not set
# CONFIG_REGULATOR_MAX8952 is not set
CONFIG_REGULATOR_LP3971=m
# CONFIG_REGULATOR_LP3972 is not set
CONFIG_REGULATOR_PCF50633=m
# CONFIG_REGULATOR_TPS62360 is not set
CONFIG_REGULATOR_TPS65023=m
CONFIG_REGULATOR_TPS6507X=m
# CONFIG_REGULATOR_TPS6524X is not set
CONFIG_MEDIA_SUPPORT=m

#
# Multimedia core support
#
# CONFIG_MEDIA_CONTROLLER is not set
CONFIG_VIDEO_DEV=m
CONFIG_VIDEO_V4L2_COMMON=m
CONFIG_DVB_CORE=m
CONFIG_DVB_NET=y
CONFIG_VIDEO_MEDIA=m

#
# Multimedia drivers
#
CONFIG_VIDEO_SAA7146=m
CONFIG_VIDEO_SAA7146_VV=m
CONFIG_RC_CORE=m
CONFIG_LIRC=m
CONFIG_RC_MAP=m
CONFIG_IR_NEC_DECODER=m
CONFIG_IR_RC5_DECODER=m
CONFIG_IR_RC6_DECODER=m
CONFIG_IR_JVC_DECODER=m
CONFIG_IR_SONY_DECODER=m
CONFIG_IR_RC5_SZ_DECODER=m
CONFIG_IR_SANYO_DECODER=m
CONFIG_IR_MCE_KBD_DECODER=m
CONFIG_IR_LIRC_CODEC=m
# CONFIG_RC_ATI_REMOTE is not set
# CONFIG_IR_ENE is not set
# CONFIG_IR_IMON is not set
# CONFIG_IR_MCEUSB is not set
# CONFIG_IR_ITE_CIR is not set
# CONFIG_IR_FINTEK is not set
# CONFIG_IR_NUVOTON is not set
# CONFIG_IR_REDRAT3 is not set
# CONFIG_IR_STREAMZAP is not set
# CONFIG_IR_WINBOND_CIR is not set
# CONFIG_RC_LOOPBACK is not set
# CONFIG_IR_GPIO_CIR is not set
CONFIG_MEDIA_ATTACH=y
CONFIG_MEDIA_TUNER=m
# CONFIG_MEDIA_TUNER_CUSTOMISE is not set
CONFIG_MEDIA_TUNER_SIMPLE=m
CONFIG_MEDIA_TUNER_TDA8290=m
CONFIG_MEDIA_TUNER_TDA827X=m
CONFIG_MEDIA_TUNER_TDA18271=m
CONFIG_MEDIA_TUNER_TDA9887=m
CONFIG_MEDIA_TUNER_TEA5761=m
CONFIG_MEDIA_TUNER_TEA5767=m
CONFIG_MEDIA_TUNER_MT20XX=m
CONFIG_MEDIA_TUNER_MT2060=m
CONFIG_MEDIA_TUNER_MT2266=m
CONFIG_MEDIA_TUNER_MT2131=m
CONFIG_MEDIA_TUNER_QT1010=m
CONFIG_MEDIA_TUNER_XC2028=m
CONFIG_MEDIA_TUNER_XC5000=m
CONFIG_MEDIA_TUNER_XC4000=m
CONFIG_MEDIA_TUNER_MXL5005S=m
CONFIG_MEDIA_TUNER_MXL5007T=m
CONFIG_MEDIA_TUNER_MC44S803=m
CONFIG_MEDIA_TUNER_MAX2165=m
CONFIG_MEDIA_TUNER_TDA18218=m
CONFIG_MEDIA_TUNER_TDA18212=m
CONFIG_VIDEO_V4L2=m
CONFIG_VIDEOBUF_GEN=m
CONFIG_VIDEOBUF_DMA_SG=m
CONFIG_VIDEOBUF_VMALLOC=m
CONFIG_VIDEOBUF_DVB=m
CONFIG_VIDEO_BTCX=m
CONFIG_VIDEO_TVEEPROM=m
CONFIG_VIDEO_TUNER=m
CONFIG_VIDEOBUF2_CORE=m
CONFIG_VIDEOBUF2_MEMOPS=m
CONFIG_VIDEOBUF2_VMALLOC=m
CONFIG_VIDEO_CAPTURE_DRIVERS=y
# CONFIG_VIDEO_ADV_DEBUG is not set
# CONFIG_VIDEO_FIXED_MINOR_RANGES is not set
CONFIG_VIDEO_HELPER_CHIPS_AUTO=y
CONFIG_VIDEO_IR_I2C=m

#
# Audio decoders, processors and mixers
#
CONFIG_VIDEO_TVAUDIO=m
CONFIG_VIDEO_TDA7432=m
CONFIG_VIDEO_TDA9840=m
CONFIG_VIDEO_TEA6415C=m
CONFIG_VIDEO_TEA6420=m
CONFIG_VIDEO_MSP3400=m
CONFIG_VIDEO_CS5345=m
CONFIG_VIDEO_CS53L32A=m
CONFIG_VIDEO_WM8775=m
CONFIG_VIDEO_WM8739=m
CONFIG_VIDEO_VP27SMPX=m

#
# RDS decoders
#
CONFIG_VIDEO_SAA6588=m

#
# Video decoders
#
CONFIG_VIDEO_BT819=m
CONFIG_VIDEO_BT856=m
CONFIG_VIDEO_BT866=m
CONFIG_VIDEO_KS0127=m
CONFIG_VIDEO_SAA7110=m
CONFIG_VIDEO_SAA711X=m
CONFIG_VIDEO_TVP5150=m
CONFIG_VIDEO_VPX3220=m

#
# Video and audio decoders
#
CONFIG_VIDEO_SAA717X=m
CONFIG_VIDEO_CX25840=m

#
# MPEG video encoders
#
CONFIG_VIDEO_CX2341X=m

#
# Video encoders
#
CONFIG_VIDEO_SAA7127=m
CONFIG_VIDEO_SAA7185=m
CONFIG_VIDEO_ADV7170=m
CONFIG_VIDEO_ADV7175=m

#
# Camera sensor devices
#
CONFIG_VIDEO_MT9V011=m

#
# Flash devices
#

#
# Video improvement chips
#
CONFIG_VIDEO_UPD64031A=m
CONFIG_VIDEO_UPD64083=m

#
# Miscelaneous helper chips
#
CONFIG_VIDEO_M52790=m
CONFIG_VIDEO_VIVI=m
CONFIG_V4L_USB_DRIVERS=y
CONFIG_VIDEO_AU0828=m
CONFIG_USB_VIDEO_CLASS=m
CONFIG_USB_VIDEO_CLASS_INPUT_EVDEV=y
CONFIG_USB_GSPCA=m
CONFIG_USB_M5602=m
CONFIG_USB_STV06XX=m
CONFIG_USB_GL860=m
# CONFIG_USB_GSPCA_BENQ is not set
CONFIG_USB_GSPCA_CONEX=m
# CONFIG_USB_GSPCA_CPIA1 is not set
CONFIG_USB_GSPCA_ETOMS=m
CONFIG_USB_GSPCA_FINEPIX=m
CONFIG_USB_GSPCA_JEILINJ=m
# CONFIG_USB_GSPCA_JL2005BCD is not set
# CONFIG_USB_GSPCA_KINECT is not set
# CONFIG_USB_GSPCA_KONICA is not set
CONFIG_USB_GSPCA_MARS=m
CONFIG_USB_GSPCA_MR97310A=m
# CONFIG_USB_GSPCA_NW80X is not set
CONFIG_USB_GSPCA_OV519=m
CONFIG_USB_GSPCA_OV534=m
# CONFIG_USB_GSPCA_OV534_9 is not set
CONFIG_USB_GSPCA_PAC207=m
# CONFIG_USB_GSPCA_PAC7302 is not set
CONFIG_USB_GSPCA_PAC7311=m
# CONFIG_USB_GSPCA_SE401 is not set
# CONFIG_USB_GSPCA_SN9C2028 is not set
CONFIG_USB_GSPCA_SN9C20X=m
CONFIG_USB_GSPCA_SONIXB=m
CONFIG_USB_GSPCA_SONIXJ=m
CONFIG_USB_GSPCA_SPCA500=m
CONFIG_USB_GSPCA_SPCA501=m
CONFIG_USB_GSPCA_SPCA505=m
CONFIG_USB_GSPCA_SPCA506=m
CONFIG_USB_GSPCA_SPCA508=m
CONFIG_USB_GSPCA_SPCA561=m
# CONFIG_USB_GSPCA_SPCA1528 is not set
CONFIG_USB_GSPCA_SQ905=m
CONFIG_USB_GSPCA_SQ905C=m
# CONFIG_USB_GSPCA_SQ930X is not set
CONFIG_USB_GSPCA_STK014=m
# CONFIG_USB_GSPCA_STV0680 is not set
CONFIG_USB_GSPCA_SUNPLUS=m
CONFIG_USB_GSPCA_T613=m
# CONFIG_USB_GSPCA_TOPRO is not set
CONFIG_USB_GSPCA_TV8532=m
CONFIG_USB_GSPCA_VC032X=m
# CONFIG_USB_GSPCA_VICAM is not set
# CONFIG_USB_GSPCA_XIRLINK_CIT is not set
CONFIG_USB_GSPCA_ZC3XX=m
CONFIG_VIDEO_PVRUSB2=m
CONFIG_VIDEO_PVRUSB2_SYSFS=y
CONFIG_VIDEO_PVRUSB2_DVB=y
# CONFIG_VIDEO_PVRUSB2_DEBUGIFC is not set
CONFIG_VIDEO_HDPVR=m
CONFIG_VIDEO_EM28XX=m
CONFIG_VIDEO_EM28XX_ALSA=m
CONFIG_VIDEO_EM28XX_DVB=m
CONFIG_VIDEO_EM28XX_RC=m
# CONFIG_VIDEO_TLG2300 is not set
CONFIG_VIDEO_CX231XX=m
CONFIG_VIDEO_CX231XX_RC=y
CONFIG_VIDEO_CX231XX_ALSA=m
CONFIG_VIDEO_CX231XX_DVB=m
# CONFIG_VIDEO_TM6000 is not set
CONFIG_VIDEO_USBVISION=m
CONFIG_USB_SN9C102=m
CONFIG_USB_PWC=m
# CONFIG_USB_PWC_DEBUG is not set
CONFIG_USB_PWC_INPUT_EVDEV=y
CONFIG_VIDEO_CPIA2=m
CONFIG_USB_ZR364XX=m
CONFIG_USB_STKWEBCAM=m
CONFIG_USB_S2255=m
CONFIG_V4L_PCI_DRIVERS=y
CONFIG_VIDEO_BT848=m
CONFIG_VIDEO_BT848_DVB=y
CONFIG_VIDEO_CX18=m
# CONFIG_VIDEO_CX18_ALSA is not set
CONFIG_VIDEO_CX23885=m
# CONFIG_MEDIA_ALTERA_CI is not set
# CONFIG_VIDEO_CX25821 is not set
CONFIG_VIDEO_CX88=m
CONFIG_VIDEO_CX88_ALSA=m
CONFIG_VIDEO_CX88_BLACKBIRD=m
CONFIG_VIDEO_CX88_DVB=m
CONFIG_VIDEO_CX88_VP3054=m
CONFIG_VIDEO_CX88_MPEG=m
CONFIG_VIDEO_HEXIUM_GEMINI=m
CONFIG_VIDEO_HEXIUM_ORION=m
CONFIG_VIDEO_IVTV=m
CONFIG_VIDEO_FB_IVTV=m
CONFIG_VIDEO_MEYE=m
CONFIG_VIDEO_MXB=m
CONFIG_VIDEO_SAA7134=m
CONFIG_VIDEO_SAA7134_ALSA=m
CONFIG_VIDEO_SAA7134_RC=y
CONFIG_VIDEO_SAA7134_DVB=m
CONFIG_VIDEO_SAA7164=m
CONFIG_VIDEO_ZORAN=m
CONFIG_VIDEO_ZORAN_DC30=m
CONFIG_VIDEO_ZORAN_ZR36060=m
CONFIG_VIDEO_ZORAN_BUZ=m
CONFIG_VIDEO_ZORAN_DC10=m
CONFIG_VIDEO_ZORAN_LML33=m
CONFIG_VIDEO_ZORAN_LML33R10=m
CONFIG_VIDEO_ZORAN_AVS6EYES=m
# CONFIG_V4L_ISA_PARPORT_DRIVERS is not set
# CONFIG_V4L_PLATFORM_DRIVERS is not set
# CONFIG_V4L_MEM2MEM_DRIVERS is not set
CONFIG_RADIO_ADAPTERS=y
CONFIG_RADIO_SI470X=y
CONFIG_USB_SI470X=m
CONFIG_I2C_SI470X=m
CONFIG_USB_MR800=m
CONFIG_USB_DSBR=m
CONFIG_RADIO_MAXIRADIO=m
CONFIG_I2C_SI4713=m
CONFIG_RADIO_SI4713=m
# CONFIG_USB_KEENE is not set
CONFIG_RADIO_TEA5764=m
# CONFIG_RADIO_SAA7706H is not set
# CONFIG_RADIO_TEF6862 is not set
# CONFIG_RADIO_WL1273 is not set

#
# Texas Instruments WL128x FM driver (ST based)
#
# CONFIG_RADIO_WL128X is not set
# CONFIG_V4L_RADIO_ISA_DRIVERS is not set
CONFIG_DVB_MAX_ADAPTERS=8
CONFIG_DVB_DYNAMIC_MINORS=y
CONFIG_DVB_CAPTURE_DRIVERS=y

#
# Supported SAA7146 based PCI Adapters
#
CONFIG_TTPCI_EEPROM=m
CONFIG_DVB_AV7110=m
CONFIG_DVB_AV7110_OSD=y
CONFIG_DVB_BUDGET_CORE=m
CONFIG_DVB_BUDGET=m
CONFIG_DVB_BUDGET_CI=m
CONFIG_DVB_BUDGET_AV=m
CONFIG_DVB_BUDGET_PATCH=m

#
# Supported USB Adapters
#
CONFIG_DVB_USB=m
# CONFIG_DVB_USB_DEBUG is not set
CONFIG_DVB_USB_A800=m
CONFIG_DVB_USB_DIBUSB_MB=m
CONFIG_DVB_USB_DIBUSB_MB_FAULTY=y
CONFIG_DVB_USB_DIBUSB_MC=m
CONFIG_DVB_USB_DIB0700=m
CONFIG_DVB_USB_UMT_010=m
CONFIG_DVB_USB_CXUSB=m
CONFIG_DVB_USB_M920X=m
CONFIG_DVB_USB_GL861=m
CONFIG_DVB_USB_AU6610=m
CONFIG_DVB_USB_DIGITV=m
CONFIG_DVB_USB_VP7045=m
CONFIG_DVB_USB_VP702X=m
CONFIG_DVB_USB_GP8PSK=m
CONFIG_DVB_USB_NOVA_T_USB2=m
CONFIG_DVB_USB_TTUSB2=m
CONFIG_DVB_USB_DTT200U=m
CONFIG_DVB_USB_OPERA1=m
CONFIG_DVB_USB_AF9005=m
CONFIG_DVB_USB_AF9005_REMOTE=m
# CONFIG_DVB_USB_PCTV452E is not set
CONFIG_DVB_USB_DW2102=m
CONFIG_DVB_USB_CINERGY_T2=m
CONFIG_DVB_USB_ANYSEE=m
CONFIG_DVB_USB_DTV5100=m
CONFIG_DVB_USB_AF9015=m
CONFIG_DVB_USB_CE6230=m
CONFIG_DVB_USB_FRIIO=m
# CONFIG_DVB_USB_EC168 is not set
# CONFIG_DVB_USB_AZ6007 is not set
# CONFIG_DVB_USB_AZ6027 is not set
# CONFIG_DVB_USB_LME2510 is not set
# CONFIG_DVB_USB_TECHNISAT_USB2 is not set
# CONFIG_DVB_USB_IT913X is not set
# CONFIG_DVB_USB_MXL111SF is not set
# CONFIG_DVB_USB_RTL28XXU is not set
# CONFIG_DVB_USB_AF9035 is not set
CONFIG_DVB_TTUSB_BUDGET=m
CONFIG_DVB_TTUSB_DEC=m
CONFIG_SMS_SIANO_MDTV=m

#
# Siano module components
#
CONFIG_SMS_USB_DRV=m
CONFIG_SMS_SDIO_DRV=m

#
# Supported FlexCopII (B2C2) Adapters
#
CONFIG_DVB_B2C2_FLEXCOP=m
CONFIG_DVB_B2C2_FLEXCOP_PCI=m
CONFIG_DVB_B2C2_FLEXCOP_USB=m
# CONFIG_DVB_B2C2_FLEXCOP_DEBUG is not set

#
# Supported BT878 Adapters
#
CONFIG_DVB_BT8XX=m

#
# Supported Pluto2 Adapters
#
CONFIG_DVB_PLUTO2=m

#
# Supported SDMC DM1105 Adapters
#
CONFIG_DVB_DM1105=m

#
# Supported FireWire (IEEE 1394) Adapters
#
# CONFIG_DVB_FIREDTV is not set

#
# Supported Earthsoft PT1 Adapters
#
CONFIG_DVB_PT1=m

#
# Supported Mantis Adapters
#
CONFIG_MANTIS_CORE=m
CONFIG_DVB_MANTIS=m
CONFIG_DVB_HOPPER=m

#
# Supported nGene Adapters
#
# CONFIG_DVB_NGENE is not set

#
# Supported ddbridge ('Octopus') Adapters
#
# CONFIG_DVB_DDBRIDGE is not set

#
# Supported DVB Frontends
#
# CONFIG_DVB_FE_CUSTOMISE is not set

#
# Multistandard (satellite) frontends
#
CONFIG_DVB_STB0899=m
CONFIG_DVB_STB6100=m
CONFIG_DVB_STV090x=m
CONFIG_DVB_STV6110x=m

#
# Multistandard (cable + terrestrial) frontends
#
CONFIG_DVB_DRXK=m
CONFIG_DVB_TDA18271C2DD=m

#
# DVB-S (satellite) frontends
#
CONFIG_DVB_CX24110=m
CONFIG_DVB_CX24123=m
CONFIG_DVB_MT312=m
CONFIG_DVB_ZL10036=m
CONFIG_DVB_ZL10039=m
CONFIG_DVB_S5H1420=m
CONFIG_DVB_STV0288=m
CONFIG_DVB_STB6000=m
CONFIG_DVB_STV0299=m
CONFIG_DVB_STV6110=m
CONFIG_DVB_STV0900=m
CONFIG_DVB_TDA8083=m
CONFIG_DVB_TDA10086=m
CONFIG_DVB_TDA8261=m
CONFIG_DVB_VES1X93=m
CONFIG_DVB_TUNER_ITD1000=m
CONFIG_DVB_TUNER_CX24113=m
CONFIG_DVB_TDA826X=m
CONFIG_DVB_TUA6100=m
CONFIG_DVB_CX24116=m
CONFIG_DVB_SI21XX=m
CONFIG_DVB_DS3000=m
CONFIG_DVB_MB86A16=m
CONFIG_DVB_TDA10071=m

#
# DVB-T (terrestrial) frontends
#
CONFIG_DVB_SP8870=m
CONFIG_DVB_SP887X=m
CONFIG_DVB_CX22700=m
CONFIG_DVB_CX22702=m
CONFIG_DVB_DRXD=m
CONFIG_DVB_L64781=m
CONFIG_DVB_TDA1004X=m
CONFIG_DVB_NXT6000=m
CONFIG_DVB_MT352=m
CONFIG_DVB_ZL10353=m
CONFIG_DVB_DIB3000MB=m
CONFIG_DVB_DIB3000MC=m
CONFIG_DVB_DIB7000M=m
CONFIG_DVB_DIB7000P=m
CONFIG_DVB_TDA10048=m
CONFIG_DVB_AF9013=m
CONFIG_DVB_STV0367=m
CONFIG_DVB_CXD2820R=m

#
# DVB-C (cable) frontends
#
CONFIG_DVB_VES1820=m
CONFIG_DVB_TDA10021=m
CONFIG_DVB_TDA10023=m
CONFIG_DVB_STV0297=m

#
# ATSC (North American/Korean Terrestrial/Cable DTV) frontends
#
CONFIG_DVB_NXT200X=m
CONFIG_DVB_OR51211=m
CONFIG_DVB_OR51132=m
CONFIG_DVB_BCM3510=m
CONFIG_DVB_LGDT330X=m
CONFIG_DVB_LGDT3305=m
CONFIG_DVB_S5H1409=m
CONFIG_DVB_AU8522=m
CONFIG_DVB_AU8522_DTV=m
CONFIG_DVB_AU8522_V4L=m
CONFIG_DVB_S5H1411=m

#
# ISDB-T (terrestrial) frontends
#
CONFIG_DVB_S921=m
CONFIG_DVB_DIB8000=m
CONFIG_DVB_MB86A20S=m

#
# Digital terrestrial only tuners/PLL
#
CONFIG_DVB_PLL=m
CONFIG_DVB_TUNER_DIB0070=m
CONFIG_DVB_TUNER_DIB0090=m

#
# SEC control devices for DVB-S
#
CONFIG_DVB_LNBP21=m
CONFIG_DVB_ISL6405=m
CONFIG_DVB_ISL6421=m
CONFIG_DVB_ISL6423=m
CONFIG_DVB_A8293=m
CONFIG_DVB_LGS8GXX=m
CONFIG_DVB_ATBM8830=m
CONFIG_DVB_TDA665x=m

#
# Tools to develop new frontends
#
# CONFIG_DVB_DUMMY_FE is not set

#
# Graphics support
#
CONFIG_AGP=y
CONFIG_AGP_ALI=y
CONFIG_AGP_ATI=y
CONFIG_AGP_AMD=y
CONFIG_AGP_AMD64=y
CONFIG_AGP_INTEL=y
CONFIG_AGP_NVIDIA=y
CONFIG_AGP_SIS=y
CONFIG_AGP_SWORKS=y
CONFIG_AGP_VIA=y
CONFIG_AGP_EFFICEON=y
CONFIG_VGA_ARB=y
CONFIG_VGA_ARB_MAX_GPUS=16
# CONFIG_VGA_SWITCHEROO is not set
CONFIG_DRM=m
CONFIG_DRM_KMS_HELPER=m
# CONFIG_DRM_LOAD_EDID_FIRMWARE is not set
CONFIG_DRM_TTM=m
CONFIG_DRM_TDFX=m
CONFIG_DRM_R128=m
CONFIG_DRM_RADEON=m
# CONFIG_DRM_RADEON_KMS is not set
CONFIG_DRM_NOUVEAU=m
CONFIG_DRM_NOUVEAU_BACKLIGHT=y
# CONFIG_DRM_NOUVEAU_DEBUG is not set

#
# I2C encoder or helper chips
#
CONFIG_DRM_I2C_CH7006=m
CONFIG_DRM_I2C_SIL164=m
CONFIG_DRM_I915=m
# CONFIG_DRM_I915_KMS is not set
CONFIG_DRM_MGA=m
CONFIG_DRM_SIS=m
CONFIG_DRM_VIA=m
CONFIG_DRM_SAVAGE=m
# CONFIG_DRM_VMWGFX is not set
# CONFIG_DRM_GMA500 is not set
# CONFIG_DRM_UDL is not set
# CONFIG_DRM_AST is not set
# CONFIG_DRM_MGAG200 is not set
# CONFIG_DRM_CIRRUS_QEMU is not set
# CONFIG_STUB_POULSBO is not set
CONFIG_VGASTATE=m
CONFIG_VIDEO_OUTPUT_CONTROL=m
CONFIG_FB=y
CONFIG_FIRMWARE_EDID=y
CONFIG_FB_DDC=m
CONFIG_FB_BOOT_VESA_SUPPORT=y
CONFIG_FB_CFB_FILLRECT=y
CONFIG_FB_CFB_COPYAREA=y
CONFIG_FB_CFB_IMAGEBLIT=y
# CONFIG_FB_CFB_REV_PIXELS_IN_BYTE is not set
CONFIG_FB_SYS_FILLRECT=m
CONFIG_FB_SYS_COPYAREA=m
CONFIG_FB_SYS_IMAGEBLIT=m
# CONFIG_FB_FOREIGN_ENDIAN is not set
CONFIG_FB_SYS_FOPS=m
# CONFIG_FB_WMT_GE_ROPS is not set
CONFIG_FB_DEFERRED_IO=y
CONFIG_FB_HECUBA=m
CONFIG_FB_SVGALIB=m
# CONFIG_FB_MACMODES is not set
CONFIG_FB_BACKLIGHT=y
CONFIG_FB_MODE_HELPERS=y
CONFIG_FB_TILEBLITTING=y

#
# Frame buffer hardware drivers
#
CONFIG_FB_CIRRUS=m
CONFIG_FB_PM2=m
CONFIG_FB_PM2_FIFO_DISCONNECT=y
CONFIG_FB_CYBER2000=m
CONFIG_FB_CYBER2000_DDC=y
CONFIG_FB_ARC=m
# CONFIG_FB_ASILIANT is not set
# CONFIG_FB_IMSTT is not set
CONFIG_FB_VGA16=m
CONFIG_FB_UVESA=m
CONFIG_FB_VESA=y
CONFIG_FB_EFI=y
CONFIG_FB_N411=m
CONFIG_FB_HGA=m
CONFIG_FB_S1D13XXX=m
CONFIG_FB_NVIDIA=m
CONFIG_FB_NVIDIA_I2C=y
# CONFIG_FB_NVIDIA_DEBUG is not set
CONFIG_FB_NVIDIA_BACKLIGHT=y
# CONFIG_FB_RIVA is not set
# CONFIG_FB_I740 is not set
CONFIG_FB_I810=m
# CONFIG_FB_I810_GTF is not set
CONFIG_FB_LE80578=m
CONFIG_FB_CARILLO_RANCH=m
CONFIG_FB_MATROX=m
CONFIG_FB_MATROX_MILLENIUM=y
CONFIG_FB_MATROX_MYSTIQUE=y
CONFIG_FB_MATROX_G=y
CONFIG_FB_MATROX_I2C=m
CONFIG_FB_MATROX_MAVEN=m
CONFIG_FB_RADEON=m
CONFIG_FB_RADEON_I2C=y
CONFIG_FB_RADEON_BACKLIGHT=y
# CONFIG_FB_RADEON_DEBUG is not set
CONFIG_FB_ATY128=m
CONFIG_FB_ATY128_BACKLIGHT=y
CONFIG_FB_ATY=m
CONFIG_FB_ATY_CT=y
CONFIG_FB_ATY_GENERIC_LCD=y
CONFIG_FB_ATY_GX=y
CONFIG_FB_ATY_BACKLIGHT=y
CONFIG_FB_S3=m
CONFIG_FB_S3_DDC=y
CONFIG_FB_SAVAGE=m
CONFIG_FB_SAVAGE_I2C=y
# CONFIG_FB_SAVAGE_ACCEL is not set
CONFIG_FB_SIS=m
CONFIG_FB_SIS_300=y
CONFIG_FB_SIS_315=y
CONFIG_FB_VIA=m
# CONFIG_FB_VIA_DIRECT_PROCFS is not set
# CONFIG_FB_VIA_X_COMPATIBILITY is not set
CONFIG_FB_NEOMAGIC=m
CONFIG_FB_KYRO=m
CONFIG_FB_3DFX=m
# CONFIG_FB_3DFX_ACCEL is not set
CONFIG_FB_3DFX_I2C=y
CONFIG_FB_VOODOO1=m
CONFIG_FB_VT8623=m
CONFIG_FB_TRIDENT=m
CONFIG_FB_ARK=m
CONFIG_FB_PM3=m
# CONFIG_FB_CARMINE is not set
CONFIG_FB_GEODE=y
CONFIG_FB_GEODE_LX=m
CONFIG_FB_GEODE_GX=m
CONFIG_FB_GEODE_GX1=m
# CONFIG_FB_TMIO is not set
CONFIG_FB_SM501=m
# CONFIG_FB_SMSCUFX is not set
# CONFIG_FB_UDL is not set
CONFIG_FB_VIRTUAL=m
CONFIG_FB_METRONOME=m
CONFIG_FB_MB862XX=m
CONFIG_FB_MB862XX_PCI_GDC=y
CONFIG_FB_MB862XX_I2C=y
# CONFIG_FB_BROADSHEET is not set
# CONFIG_FB_AUO_K190X is not set
# CONFIG_EXYNOS_VIDEO is not set
CONFIG_BACKLIGHT_LCD_SUPPORT=y
# CONFIG_LCD_CLASS_DEVICE is not set
CONFIG_BACKLIGHT_CLASS_DEVICE=y
# CONFIG_BACKLIGHT_GENERIC is not set
CONFIG_BACKLIGHT_PROGEAR=m
# CONFIG_BACKLIGHT_APPLE is not set
# CONFIG_BACKLIGHT_SAHARA is not set
# CONFIG_BACKLIGHT_ADP8860 is not set
# CONFIG_BACKLIGHT_ADP8870 is not set
# CONFIG_BACKLIGHT_PCF50633 is not set
# CONFIG_BACKLIGHT_LP855X is not set

#
# Console display driver support
#
CONFIG_VGA_CONSOLE=y
# CONFIG_VGACON_SOFT_SCROLLBACK is not set
CONFIG_MDA_CONSOLE=m
CONFIG_DUMMY_CONSOLE=y
CONFIG_FRAMEBUFFER_CONSOLE=y
CONFIG_FRAMEBUFFER_CONSOLE_DETECT_PRIMARY=y
CONFIG_FRAMEBUFFER_CONSOLE_ROTATION=y
# CONFIG_FONTS is not set
CONFIG_FONT_8x8=y
CONFIG_FONT_8x16=y
# CONFIG_LOGO is not set
CONFIG_SOUND=m
CONFIG_SOUND_OSS_CORE=y
# CONFIG_SOUND_OSS_CORE_PRECLAIM is not set
CONFIG_SND=m
CONFIG_SND_TIMER=m
CONFIG_SND_PCM=m
CONFIG_SND_HWDEP=m
CONFIG_SND_RAWMIDI=m
CONFIG_SND_JACK=y
CONFIG_SND_SEQUENCER=m
CONFIG_SND_SEQ_DUMMY=m
CONFIG_SND_OSSEMUL=y
CONFIG_SND_MIXER_OSS=m
CONFIG_SND_PCM_OSS=m
CONFIG_SND_PCM_OSS_PLUGINS=y
# CONFIG_SND_SEQUENCER_OSS is not set
CONFIG_SND_HRTIMER=m
CONFIG_SND_SEQ_HRTIMER_DEFAULT=y
CONFIG_SND_DYNAMIC_MINORS=y
CONFIG_SND_SUPPORT_OLD_API=y
CONFIG_SND_VERBOSE_PROCFS=y
# CONFIG_SND_VERBOSE_PRINTK is not set
# CONFIG_SND_DEBUG is not set
CONFIG_SND_VMASTER=y
CONFIG_SND_KCTL_JACK=y
CONFIG_SND_DMA_SGBUF=y
CONFIG_SND_RAWMIDI_SEQ=m
CONFIG_SND_OPL3_LIB_SEQ=m
CONFIG_SND_OPL4_LIB_SEQ=m
CONFIG_SND_SBAWE_SEQ=m
CONFIG_SND_EMU10K1_SEQ=m
CONFIG_SND_MPU401_UART=m
CONFIG_SND_OPL3_LIB=m
CONFIG_SND_OPL4_LIB=m
CONFIG_SND_VX_LIB=m
CONFIG_SND_AC97_CODEC=m
CONFIG_SND_DRIVERS=y
CONFIG_SND_PCSP=m
CONFIG_SND_DUMMY=m
# CONFIG_SND_ALOOP is not set
CONFIG_SND_VIRMIDI=m
CONFIG_SND_MTPAV=m
CONFIG_SND_MTS64=m
CONFIG_SND_SERIAL_U16550=m
CONFIG_SND_MPU401=m
CONFIG_SND_PORTMAN2X4=m
CONFIG_SND_AC97_POWER_SAVE=y
CONFIG_SND_AC97_POWER_SAVE_DEFAULT=0
CONFIG_SND_WSS_LIB=m
CONFIG_SND_SB_COMMON=m
CONFIG_SND_SB8_DSP=m
CONFIG_SND_SB16_DSP=m
CONFIG_SND_ISA=y
CONFIG_SND_ADLIB=m
CONFIG_SND_AD1816A=m
CONFIG_SND_AD1848=m
CONFIG_SND_ALS100=m
# CONFIG_SND_AZT1605 is not set
# CONFIG_SND_AZT2316 is not set
CONFIG_SND_AZT2320=m
CONFIG_SND_CMI8330=m
CONFIG_SND_CS4231=m
CONFIG_SND_CS4236=m
CONFIG_SND_ES1688=m
CONFIG_SND_ES18XX=m
CONFIG_SND_SC6000=m
CONFIG_SND_GUSCLASSIC=m
CONFIG_SND_GUSEXTREME=m
CONFIG_SND_GUSMAX=m
CONFIG_SND_INTERWAVE=m
CONFIG_SND_INTERWAVE_STB=m
# CONFIG_SND_JAZZ16 is not set
CONFIG_SND_OPL3SA2=m
CONFIG_SND_OPTI92X_AD1848=m
CONFIG_SND_OPTI92X_CS4231=m
CONFIG_SND_OPTI93X=m
CONFIG_SND_MIRO=m
CONFIG_SND_SB8=m
CONFIG_SND_SB16=m
CONFIG_SND_SBAWE=m
CONFIG_SND_SB16_CSP=y
CONFIG_SND_SSCAPE=m
CONFIG_SND_WAVEFRONT=m
# CONFIG_SND_MSND_PINNACLE is not set
# CONFIG_SND_MSND_CLASSIC is not set
CONFIG_SND_TEA575X=m
CONFIG_SND_PCI=y
CONFIG_SND_AD1889=m
CONFIG_SND_ALS300=m
CONFIG_SND_ALS4000=m
CONFIG_SND_ALI5451=m
# CONFIG_SND_ASIHPI is not set
CONFIG_SND_ATIIXP=m
CONFIG_SND_ATIIXP_MODEM=m
CONFIG_SND_AU8810=m
CONFIG_SND_AU8820=m
CONFIG_SND_AU8830=m
# CONFIG_SND_AW2 is not set
CONFIG_SND_AZT3328=m
CONFIG_SND_BT87X=m
# CONFIG_SND_BT87X_OVERCLOCK is not set
CONFIG_SND_CA0106=m
CONFIG_SND_CMIPCI=m
CONFIG_SND_OXYGEN_LIB=m
CONFIG_SND_OXYGEN=m
CONFIG_SND_CS4281=m
CONFIG_SND_CS46XX=m
CONFIG_SND_CS46XX_NEW_DSP=y
CONFIG_SND_CS5530=m
CONFIG_SND_CS5535AUDIO=m
CONFIG_SND_CTXFI=m
CONFIG_SND_DARLA20=m
CONFIG_SND_GINA20=m
CONFIG_SND_LAYLA20=m
CONFIG_SND_DARLA24=m
CONFIG_SND_GINA24=m
CONFIG_SND_LAYLA24=m
CONFIG_SND_MONA=m
CONFIG_SND_MIA=m
CONFIG_SND_ECHO3G=m
CONFIG_SND_INDIGO=m
CONFIG_SND_INDIGOIO=m
CONFIG_SND_INDIGODJ=m
CONFIG_SND_INDIGOIOX=m
CONFIG_SND_INDIGODJX=m
CONFIG_SND_EMU10K1=m
CONFIG_SND_EMU10K1X=m
CONFIG_SND_ENS1370=m
CONFIG_SND_ENS1371=m
CONFIG_SND_ES1938=m
CONFIG_SND_ES1968=m
# CONFIG_SND_ES1968_INPUT is not set
# CONFIG_SND_ES1968_RADIO is not set
CONFIG_SND_FM801=m
CONFIG_SND_FM801_TEA575X_BOOL=y
CONFIG_SND_HDA_INTEL=m
CONFIG_SND_HDA_PREALLOC_SIZE=64
CONFIG_SND_HDA_HWDEP=y
CONFIG_SND_HDA_RECONFIG=y
CONFIG_SND_HDA_INPUT_BEEP=y
CONFIG_SND_HDA_INPUT_BEEP_MODE=1
CONFIG_SND_HDA_INPUT_JACK=y
CONFIG_SND_HDA_PATCH_LOADER=y
CONFIG_SND_HDA_CODEC_REALTEK=y
CONFIG_SND_HDA_CODEC_ANALOG=y
CONFIG_SND_HDA_CODEC_SIGMATEL=y
CONFIG_SND_HDA_CODEC_VIA=y
CONFIG_SND_HDA_CODEC_HDMI=y
CONFIG_SND_HDA_CODEC_CIRRUS=y
CONFIG_SND_HDA_CODEC_CONEXANT=y
CONFIG_SND_HDA_CODEC_CA0110=y
CONFIG_SND_HDA_CODEC_CA0132=y
CONFIG_SND_HDA_CODEC_CMEDIA=y
CONFIG_SND_HDA_CODEC_SI3054=y
CONFIG_SND_HDA_GENERIC=y
CONFIG_SND_HDA_POWER_SAVE=y
CONFIG_SND_HDA_POWER_SAVE_DEFAULT=0
CONFIG_SND_HDSP=m
CONFIG_SND_HDSPM=m
CONFIG_SND_ICE1712=m
CONFIG_SND_ICE1724=m
CONFIG_SND_INTEL8X0=m
CONFIG_SND_INTEL8X0M=m
CONFIG_SND_KORG1212=m
# CONFIG_SND_LOLA is not set
CONFIG_SND_LX6464ES=m
CONFIG_SND_MAESTRO3=m
# CONFIG_SND_MAESTRO3_INPUT is not set
CONFIG_SND_MIXART=m
CONFIG_SND_NM256=m
CONFIG_SND_PCXHR=m
CONFIG_SND_RIPTIDE=m
CONFIG_SND_RME32=m
CONFIG_SND_RME96=m
CONFIG_SND_RME9652=m
CONFIG_SND_SIS7019=m
CONFIG_SND_SONICVIBES=m
CONFIG_SND_TRIDENT=m
CONFIG_SND_VIA82XX=m
CONFIG_SND_VIA82XX_MODEM=m
CONFIG_SND_VIRTUOSO=m
CONFIG_SND_VX222=m
CONFIG_SND_YMFPCI=m
CONFIG_SND_SPI=y
CONFIG_SND_USB=y
CONFIG_SND_USB_AUDIO=m
# CONFIG_SND_USB_UA101 is not set
CONFIG_SND_USB_USX2Y=m
CONFIG_SND_USB_CAIAQ=m
CONFIG_SND_USB_CAIAQ_INPUT=y
CONFIG_SND_USB_US122L=m
# CONFIG_SND_USB_6FIRE is not set
CONFIG_SND_FIREWIRE=y
# CONFIG_SND_FIREWIRE_SPEAKERS is not set
# CONFIG_SND_ISIGHT is not set
CONFIG_SND_PCMCIA=y
CONFIG_SND_VXPOCKET=m
CONFIG_SND_PDAUDIOCF=m
# CONFIG_SND_SOC is not set
# CONFIG_SOUND_PRIME is not set
CONFIG_AC97_BUS=m

#
# HID support
#
CONFIG_HID=m
CONFIG_HIDRAW=y
CONFIG_HID_GENERIC=m

#
# Special HID drivers
#
CONFIG_HID_A4TECH=m
# CONFIG_HID_ACRUX is not set
CONFIG_HID_APPLE=m
# CONFIG_HID_AUREAL is not set
CONFIG_HID_BELKIN=m
CONFIG_HID_CHERRY=m
CONFIG_HID_CHICONY=m
# CONFIG_HID_PRODIKEYS is not set
CONFIG_HID_CYPRESS=m
CONFIG_HID_DRAGONRISE=m
CONFIG_DRAGONRISE_FF=y
# CONFIG_HID_EMS_FF is not set
# CONFIG_HID_ELECOM is not set
CONFIG_HID_EZKEY=m
# CONFIG_HID_HOLTEK is not set
# CONFIG_HID_KEYTOUCH is not set
CONFIG_HID_KYE=m
# CONFIG_HID_UCLOGIC is not set
# CONFIG_HID_WALTOP is not set
CONFIG_HID_GYRATION=m
CONFIG_HID_TWINHAN=m
CONFIG_HID_KENSINGTON=m
# CONFIG_HID_LCPOWER is not set
CONFIG_HID_LOGITECH=m
CONFIG_HID_LOGITECH_DJ=m
CONFIG_LOGITECH_FF=y
CONFIG_LOGIRUMBLEPAD2_FF=y
# CONFIG_LOGIG940_FF is not set
CONFIG_LOGIWHEELS_FF=y
# CONFIG_HID_MAGICMOUSE is not set
CONFIG_HID_MICROSOFT=m
CONFIG_HID_MONTEREY=m
# CONFIG_HID_MULTITOUCH is not set
CONFIG_HID_NTRIG=m
# CONFIG_HID_ORTEK is not set
CONFIG_HID_PANTHERLORD=m
CONFIG_PANTHERLORD_FF=y
CONFIG_HID_PETALYNX=m
# CONFIG_HID_PICOLCD is not set
# CONFIG_HID_PRIMAX is not set
# CONFIG_HID_ROCCAT is not set
# CONFIG_HID_SAITEK is not set
CONFIG_HID_SAMSUNG=m
CONFIG_HID_SONY=m
# CONFIG_HID_SPEEDLINK is not set
CONFIG_HID_SUNPLUS=m
CONFIG_HID_GREENASIA=m
CONFIG_GREENASIA_FF=y
CONFIG_HID_SMARTJOYPLUS=m
CONFIG_SMARTJOYPLUS_FF=y
# CONFIG_HID_TIVO is not set
CONFIG_HID_TOPSEED=m
CONFIG_HID_THRUSTMASTER=m
CONFIG_THRUSTMASTER_FF=y
CONFIG_HID_WACOM=m
# CONFIG_HID_WIIMOTE is not set
CONFIG_HID_ZEROPLUS=m
CONFIG_ZEROPLUS_FF=y
# CONFIG_HID_ZYDACRON is not set

#
# USB HID support
#
CONFIG_USB_HID=m
CONFIG_HID_PID=y
CONFIG_USB_HIDDEV=y
CONFIG_USB_ARCH_HAS_OHCI=y
CONFIG_USB_ARCH_HAS_EHCI=y
CONFIG_USB_ARCH_HAS_XHCI=y
CONFIG_USB_SUPPORT=y
CONFIG_USB_COMMON=m
CONFIG_USB_ARCH_HAS_HCD=y
CONFIG_USB=m
# CONFIG_USB_DEBUG is not set
CONFIG_USB_ANNOUNCE_NEW_DEVICES=y

#
# Miscellaneous USB options
#
CONFIG_USB_DYNAMIC_MINORS=y
CONFIG_USB_SUSPEND=y
# CONFIG_USB_OTG is not set
CONFIG_USB_MON=m
CONFIG_USB_WUSB=m
CONFIG_USB_WUSB_CBAF=m
# CONFIG_USB_WUSB_CBAF_DEBUG is not set

#
# USB Host Controller Drivers
#
CONFIG_USB_C67X00_HCD=m
CONFIG_USB_XHCI_HCD=m
# CONFIG_USB_XHCI_HCD_DEBUGGING is not set
CONFIG_USB_EHCI_HCD=m
CONFIG_USB_EHCI_ROOT_HUB_TT=y
CONFIG_USB_EHCI_TT_NEWSCHED=y
# CONFIG_USB_OXU210HP_HCD is not set
CONFIG_USB_ISP116X_HCD=m
# CONFIG_USB_ISP1760_HCD is not set
# CONFIG_USB_ISP1362_HCD is not set
CONFIG_USB_OHCI_HCD=m
# CONFIG_USB_OHCI_HCD_SSB is not set
# CONFIG_USB_OHCI_HCD_PLATFORM is not set
# CONFIG_USB_EHCI_HCD_PLATFORM is not set
# CONFIG_USB_OHCI_BIG_ENDIAN_DESC is not set
# CONFIG_USB_OHCI_BIG_ENDIAN_MMIO is not set
CONFIG_USB_OHCI_LITTLE_ENDIAN=y
CONFIG_USB_UHCI_HCD=m
CONFIG_USB_U132_HCD=m
CONFIG_USB_SL811_HCD=m
# CONFIG_USB_SL811_HCD_ISO is not set
CONFIG_USB_SL811_CS=m
CONFIG_USB_R8A66597_HCD=m
CONFIG_USB_WHCI_HCD=m
CONFIG_USB_HWA_HCD=m
# CONFIG_USB_HCD_SSB is not set
# CONFIG_USB_CHIPIDEA is not set

#
# USB Device Class drivers
#
CONFIG_USB_ACM=m
CONFIG_USB_PRINTER=m
CONFIG_USB_WDM=m
CONFIG_USB_TMC=m

#
# NOTE: USB_STORAGE depends on SCSI but BLK_DEV_SD may
#

#
# also be needed; see USB_STORAGE Help for more info
#
CONFIG_USB_STORAGE=m
# CONFIG_USB_STORAGE_DEBUG is not set
# CONFIG_USB_STORAGE_REALTEK is not set
CONFIG_USB_STORAGE_DATAFAB=m
CONFIG_USB_STORAGE_FREECOM=m
CONFIG_USB_STORAGE_ISD200=m
CONFIG_USB_STORAGE_USBAT=m
CONFIG_USB_STORAGE_SDDR09=m
CONFIG_USB_STORAGE_SDDR55=m
CONFIG_USB_STORAGE_JUMPSHOT=m
CONFIG_USB_STORAGE_ALAUDA=m
CONFIG_USB_STORAGE_ONETOUCH=m
CONFIG_USB_STORAGE_KARMA=m
CONFIG_USB_STORAGE_CYPRESS_ATACB=m
# CONFIG_USB_STORAGE_ENE_UB6250 is not set
# CONFIG_USB_UAS is not set
# CONFIG_USB_LIBUSUAL is not set

#
# USB Imaging devices
#
CONFIG_USB_MDC800=m
CONFIG_USB_MICROTEK=m

#
# USB port drivers
#
CONFIG_USB_USS720=m
CONFIG_USB_SERIAL=m
CONFIG_USB_EZUSB=y
CONFIG_USB_SERIAL_GENERIC=y
CONFIG_USB_SERIAL_AIRCABLE=m
CONFIG_USB_SERIAL_ARK3116=m
CONFIG_USB_SERIAL_BELKIN=m
CONFIG_USB_SERIAL_CH341=m
CONFIG_USB_SERIAL_WHITEHEAT=m
CONFIG_USB_SERIAL_DIGI_ACCELEPORT=m
CONFIG_USB_SERIAL_CP210X=m
CONFIG_USB_SERIAL_CYPRESS_M8=m
CONFIG_USB_SERIAL_EMPEG=m
CONFIG_USB_SERIAL_FTDI_SIO=m
CONFIG_USB_SERIAL_FUNSOFT=m
CONFIG_USB_SERIAL_VISOR=m
CONFIG_USB_SERIAL_IPAQ=m
CONFIG_USB_SERIAL_IR=m
CONFIG_USB_SERIAL_EDGEPORT=m
CONFIG_USB_SERIAL_EDGEPORT_TI=m
# CONFIG_USB_SERIAL_F81232 is not set
CONFIG_USB_SERIAL_GARMIN=m
CONFIG_USB_SERIAL_IPW=m
CONFIG_USB_SERIAL_IUU=m
CONFIG_USB_SERIAL_KEYSPAN_PDA=m
CONFIG_USB_SERIAL_KEYSPAN=m
CONFIG_USB_SERIAL_KLSI=m
CONFIG_USB_SERIAL_KOBIL_SCT=m
CONFIG_USB_SERIAL_MCT_U232=m
# CONFIG_USB_SERIAL_METRO is not set
CONFIG_USB_SERIAL_MOS7720=m
# CONFIG_USB_SERIAL_MOS7715_PARPORT is not set
CONFIG_USB_SERIAL_MOS7840=m
CONFIG_USB_SERIAL_MOTOROLA=m
CONFIG_USB_SERIAL_NAVMAN=m
CONFIG_USB_SERIAL_PL2303=m
CONFIG_USB_SERIAL_OTI6858=m
# CONFIG_USB_SERIAL_QCAUX is not set
CONFIG_USB_SERIAL_QUALCOMM=m
CONFIG_USB_SERIAL_SPCP8X5=m
CONFIG_USB_SERIAL_HP4X=m
CONFIG_USB_SERIAL_SAFE=m
# CONFIG_USB_SERIAL_SAFE_PADDED is not set
CONFIG_USB_SERIAL_SIEMENS_MPI=m
CONFIG_USB_SERIAL_SIERRAWIRELESS=m
CONFIG_USB_SERIAL_SYMBOL=m
CONFIG_USB_SERIAL_TI=m
CONFIG_USB_SERIAL_CYBERJACK=m
CONFIG_USB_SERIAL_XIRCOM=m
CONFIG_USB_SERIAL_WWAN=m
CONFIG_USB_SERIAL_OPTION=m
CONFIG_USB_SERIAL_OMNINET=m
CONFIG_USB_SERIAL_OPTICON=m
# CONFIG_USB_SERIAL_VIVOPAY_SERIAL is not set
# CONFIG_USB_SERIAL_ZIO is not set
# CONFIG_USB_SERIAL_SSU100 is not set
# CONFIG_USB_SERIAL_QT2 is not set
CONFIG_USB_SERIAL_DEBUG=m

#
# USB Miscellaneous drivers
#
CONFIG_USB_EMI62=m
CONFIG_USB_EMI26=m
CONFIG_USB_ADUTUX=m
CONFIG_USB_SEVSEG=m
CONFIG_USB_RIO500=m
CONFIG_USB_LEGOTOWER=m
CONFIG_USB_LCD=m
CONFIG_USB_LED=m
CONFIG_USB_CYPRESS_CY7C63=m
CONFIG_USB_CYTHERM=m
CONFIG_USB_IDMOUSE=m
CONFIG_USB_FTDI_ELAN=m
CONFIG_USB_APPLEDISPLAY=m
CONFIG_USB_SISUSBVGA=m
CONFIG_USB_SISUSBVGA_CON=y
CONFIG_USB_LD=m
CONFIG_USB_TRANCEVIBRATOR=m
CONFIG_USB_IOWARRIOR=m
CONFIG_USB_TEST=m
CONFIG_USB_ISIGHTFW=m
# CONFIG_USB_YUREX is not set

#
# USB Physical Layer drivers
#
# CONFIG_USB_ISP1301 is not set
CONFIG_USB_ATM=m
CONFIG_USB_SPEEDTOUCH=m
CONFIG_USB_CXACRU=m
CONFIG_USB_UEAGLEATM=m
CONFIG_USB_XUSBATM=m
# CONFIG_USB_GADGET is not set

#
# OTG and related infrastructure
#
CONFIG_USB_OTG_UTILS=y
# CONFIG_USB_GPIO_VBUS is not set
CONFIG_NOP_USB_XCEIV=m
CONFIG_UWB=m
CONFIG_UWB_HWA=m
CONFIG_UWB_WHCI=m
CONFIG_UWB_I1480U=m
CONFIG_MMC=m
# CONFIG_MMC_DEBUG is not set
# CONFIG_MMC_UNSAFE_RESUME is not set
# CONFIG_MMC_CLKGATE is not set

#
# MMC/SD/SDIO Card Drivers
#
CONFIG_MMC_BLOCK=m
CONFIG_MMC_BLOCK_MINORS=8
CONFIG_MMC_BLOCK_BOUNCE=y
CONFIG_SDIO_UART=m
# CONFIG_MMC_TEST is not set

#
# MMC/SD/SDIO Host Controller Drivers
#
CONFIG_MMC_SDHCI=m
CONFIG_MMC_SDHCI_PCI=m
# CONFIG_MMC_RICOH_MMC is not set
CONFIG_MMC_SDHCI_PLTFM=m
CONFIG_MMC_WBSD=m
CONFIG_MMC_TIFM_SD=m
CONFIG_MMC_SDRICOH_CS=m
CONFIG_MMC_CB710=m
CONFIG_MMC_VIA_SDMMC=m
# CONFIG_MMC_VUB300 is not set
# CONFIG_MMC_USHC is not set
CONFIG_MEMSTICK=m
# CONFIG_MEMSTICK_DEBUG is not set

#
# MemoryStick drivers
#
# CONFIG_MEMSTICK_UNSAFE_RESUME is not set
CONFIG_MSPRO_BLOCK=m

#
# MemoryStick Host Controller Drivers
#
CONFIG_MEMSTICK_TIFM_MS=m
CONFIG_MEMSTICK_JMICRON_38X=m
# CONFIG_MEMSTICK_R592 is not set
CONFIG_NEW_LEDS=y
CONFIG_LEDS_CLASS=m

#
# LED drivers
#
# CONFIG_LEDS_LM3530 is not set
CONFIG_LEDS_NET48XX=m
CONFIG_LEDS_WRAP=m
CONFIG_LEDS_PCA9532=m
# CONFIG_LEDS_PCA9532_GPIO is not set
# CONFIG_LEDS_GPIO is not set
CONFIG_LEDS_LP3944=m
# CONFIG_LEDS_LP5521 is not set
# CONFIG_LEDS_LP5523 is not set
CONFIG_LEDS_CLEVO_MAIL=m
CONFIG_LEDS_PCA955X=m
# CONFIG_LEDS_PCA9633 is not set
CONFIG_LEDS_DAC124S085=m
# CONFIG_LEDS_REGULATOR is not set
CONFIG_LEDS_BD2802=m
# CONFIG_LEDS_INTEL_SS4200 is not set
# CONFIG_LEDS_LT3593 is not set
# CONFIG_LEDS_DELL_NETBOOKS is not set
# CONFIG_LEDS_TCA6507 is not set
# CONFIG_LEDS_OT200 is not set
CONFIG_LEDS_TRIGGERS=y

#
# LED Triggers
#
CONFIG_LEDS_TRIGGER_TIMER=m
CONFIG_LEDS_TRIGGER_IDE_DISK=y
CONFIG_LEDS_TRIGGER_HEARTBEAT=m
CONFIG_LEDS_TRIGGER_BACKLIGHT=m
# CONFIG_LEDS_TRIGGER_GPIO is not set
CONFIG_LEDS_TRIGGER_DEFAULT_ON=m

#
# iptables trigger is under Netfilter config (LED target)
#
# CONFIG_LEDS_TRIGGER_TRANSIENT is not set
CONFIG_ACCESSIBILITY=y
CONFIG_A11Y_BRAILLE_CONSOLE=y
CONFIG_INFINIBAND=m
CONFIG_INFINIBAND_USER_MAD=m
CONFIG_INFINIBAND_USER_ACCESS=m
CONFIG_INFINIBAND_USER_MEM=y
CONFIG_INFINIBAND_ADDR_TRANS=y
CONFIG_INFINIBAND_MTHCA=m
CONFIG_INFINIBAND_MTHCA_DEBUG=y
CONFIG_INFINIBAND_AMSO1100=m
# CONFIG_INFINIBAND_AMSO1100_DEBUG is not set
CONFIG_INFINIBAND_CXGB3=m
# CONFIG_INFINIBAND_CXGB3_DEBUG is not set
CONFIG_MLX4_INFINIBAND=m
CONFIG_INFINIBAND_NES=m
# CONFIG_INFINIBAND_NES_DEBUG is not set
# CONFIG_INFINIBAND_OCRDMA is not set
CONFIG_INFINIBAND_IPOIB=m
CONFIG_INFINIBAND_IPOIB_CM=y
CONFIG_INFINIBAND_IPOIB_DEBUG=y
# CONFIG_INFINIBAND_IPOIB_DEBUG_DATA is not set
CONFIG_INFINIBAND_SRP=m
CONFIG_INFINIBAND_ISER=m
CONFIG_EDAC=y

#
# Reporting subsystems
#
# CONFIG_EDAC_DEBUG is not set
CONFIG_EDAC_DECODE_MCE=m
# CONFIG_EDAC_MCE_INJ is not set
CONFIG_EDAC_MM_EDAC=m
CONFIG_EDAC_AMD76X=m
CONFIG_EDAC_E7XXX=m
CONFIG_EDAC_E752X=m
CONFIG_EDAC_I82875P=m
CONFIG_EDAC_I82975X=m
CONFIG_EDAC_I3000=m
CONFIG_EDAC_I3200=m
CONFIG_EDAC_X38=m
CONFIG_EDAC_I5400=m
# CONFIG_EDAC_I7CORE is not set
CONFIG_EDAC_I82860=m
CONFIG_EDAC_R82600=m
CONFIG_EDAC_I5000=m
CONFIG_EDAC_I5100=m
# CONFIG_EDAC_I7300 is not set
CONFIG_RTC_LIB=y
CONFIG_RTC_CLASS=y
CONFIG_RTC_HCTOSYS=y
CONFIG_RTC_HCTOSYS_DEVICE="rtc0"
# CONFIG_RTC_DEBUG is not set

#
# RTC interfaces
#
CONFIG_RTC_INTF_SYSFS=y
CONFIG_RTC_INTF_PROC=y
CONFIG_RTC_INTF_DEV=y
# CONFIG_RTC_INTF_DEV_UIE_EMUL is not set
# CONFIG_RTC_DRV_TEST is not set

#
# I2C RTC drivers
#
CONFIG_RTC_DRV_DS1307=m
CONFIG_RTC_DRV_DS1374=m
CONFIG_RTC_DRV_DS1672=m
# CONFIG_RTC_DRV_DS3232 is not set
CONFIG_RTC_DRV_MAX6900=m
CONFIG_RTC_DRV_RS5C372=m
CONFIG_RTC_DRV_ISL1208=m
# CONFIG_RTC_DRV_ISL12022 is not set
CONFIG_RTC_DRV_X1205=m
CONFIG_RTC_DRV_PCF8563=m
CONFIG_RTC_DRV_PCF8583=m
CONFIG_RTC_DRV_M41T80=m
# CONFIG_RTC_DRV_M41T80_WDT is not set
# CONFIG_RTC_DRV_BQ32K is not set
CONFIG_RTC_DRV_S35390A=m
CONFIG_RTC_DRV_FM3130=m
CONFIG_RTC_DRV_RX8581=m
CONFIG_RTC_DRV_RX8025=m
# CONFIG_RTC_DRV_EM3027 is not set
# CONFIG_RTC_DRV_RV3029C2 is not set

#
# SPI RTC drivers
#
# CONFIG_RTC_DRV_M41T93 is not set
CONFIG_RTC_DRV_M41T94=m
CONFIG_RTC_DRV_DS1305=m
CONFIG_RTC_DRV_DS1390=m
CONFIG_RTC_DRV_MAX6902=m
CONFIG_RTC_DRV_R9701=m
CONFIG_RTC_DRV_RS5C348=m
CONFIG_RTC_DRV_DS3234=m
CONFIG_RTC_DRV_PCF2123=m

#
# Platform RTC drivers
#
CONFIG_RTC_DRV_CMOS=y
CONFIG_RTC_DRV_DS1286=m
CONFIG_RTC_DRV_DS1511=m
CONFIG_RTC_DRV_DS1553=m
CONFIG_RTC_DRV_DS1742=m
CONFIG_RTC_DRV_STK17TA8=m
CONFIG_RTC_DRV_M48T86=m
CONFIG_RTC_DRV_M48T35=m
CONFIG_RTC_DRV_M48T59=m
# CONFIG_RTC_DRV_MSM6242 is not set
CONFIG_RTC_DRV_BQ4802=m
# CONFIG_RTC_DRV_RP5C01 is not set
CONFIG_RTC_DRV_V3020=m
CONFIG_RTC_DRV_PCF50633=m

#
# on-CPU RTC drivers
#
CONFIG_DMADEVICES=y
# CONFIG_DMADEVICES_DEBUG is not set

#
# DMA Devices
#
# CONFIG_INTEL_MID_DMAC is not set
CONFIG_INTEL_IOATDMA=m
# CONFIG_TIMB_DMA is not set
# CONFIG_PCH_DMA is not set
CONFIG_DMA_ENGINE=y

#
# DMA Clients
#
CONFIG_NET_DMA=y
CONFIG_ASYNC_TX_DMA=y
# CONFIG_DMATEST is not set
CONFIG_DCA=m
# CONFIG_AUXDISPLAY is not set
CONFIG_UIO=m
CONFIG_UIO_CIF=m
CONFIG_UIO_PDRV=m
CONFIG_UIO_PDRV_GENIRQ=m
CONFIG_UIO_AEC=m
CONFIG_UIO_SERCOS3=m
CONFIG_UIO_PCI_GENERIC=m
# CONFIG_UIO_NETX is not set
CONFIG_VIRTIO=m
CONFIG_VIRTIO_RING=m

#
# Virtio drivers
#
CONFIG_VIRTIO_PCI=m
CONFIG_VIRTIO_BALLOON=m
# CONFIG_VIRTIO_MMIO is not set

#
# Microsoft Hyper-V guest support
#
# CONFIG_HYPERV is not set
CONFIG_STAGING=y
CONFIG_ET131X=m
# CONFIG_SLICOSS is not set
# CONFIG_USBIP_CORE is not set
# CONFIG_W35UND is not set
CONFIG_PRISM2_USB=m
# CONFIG_ECHO is not set
CONFIG_COMEDI=m
# CONFIG_COMEDI_DEBUG is not set
CONFIG_COMEDI_DEFAULT_BUF_SIZE_KB=2048
CONFIG_COMEDI_DEFAULT_BUF_MAXSIZE_KB=20480
# CONFIG_COMEDI_MISC_DRIVERS is not set
# CONFIG_COMEDI_ISA_DRIVERS is not set
CONFIG_COMEDI_PCI_DRIVERS=m
# CONFIG_COMEDI_ADDI_APCI_035 is not set
# CONFIG_COMEDI_ADDI_APCI_1032 is not set
# CONFIG_COMEDI_ADDI_APCI_1500 is not set
# CONFIG_COMEDI_ADDI_APCI_1516 is not set
# CONFIG_COMEDI_ADDI_APCI_1564 is not set
# CONFIG_COMEDI_ADDI_APCI_16XX is not set
# CONFIG_COMEDI_ADDI_APCI_2016 is not set
# CONFIG_COMEDI_ADDI_APCI_2032 is not set
# CONFIG_COMEDI_ADDI_APCI_2200 is not set
# CONFIG_COMEDI_ADDI_APCI_3001 is not set
# CONFIG_COMEDI_ADDI_APCI_3120 is not set
# CONFIG_COMEDI_ADDI_APCI_3501 is not set
# CONFIG_COMEDI_ADDI_APCI_3XXX is not set
# CONFIG_COMEDI_ADL_PCI6208 is not set
# CONFIG_COMEDI_ADL_PCI7230 is not set
# CONFIG_COMEDI_ADL_PCI7296 is not set
# CONFIG_COMEDI_ADL_PCI7432 is not set
# CONFIG_COMEDI_ADL_PCI8164 is not set
# CONFIG_COMEDI_ADL_PCI9111 is not set
# CONFIG_COMEDI_ADL_PCI9118 is not set
# CONFIG_COMEDI_ADV_PCI1710 is not set
# CONFIG_COMEDI_ADV_PCI1723 is not set
# CONFIG_COMEDI_ADV_PCI_DIO is not set
# CONFIG_COMEDI_AMPLC_DIO200_PCI is not set
# CONFIG_COMEDI_AMPLC_PC236_PCI is not set
# CONFIG_COMEDI_AMPLC_PC263_PCI is not set
# CONFIG_COMEDI_AMPLC_PCI224 is not set
# CONFIG_COMEDI_AMPLC_PCI230 is not set
# CONFIG_COMEDI_CONTEC_PCI_DIO is not set
# CONFIG_COMEDI_DAS08_PCI is not set
# CONFIG_COMEDI_DT3000 is not set
# CONFIG_COMEDI_DYNA_PCI10XX is not set
# CONFIG_COMEDI_UNIOXX5 is not set
# CONFIG_COMEDI_GSC_HPDI is not set
# CONFIG_COMEDI_ICP_MULTI is not set
# CONFIG_COMEDI_II_PCI20KC is not set
# CONFIG_COMEDI_DAQBOARD2000 is not set
# CONFIG_COMEDI_JR3_PCI is not set
# CONFIG_COMEDI_KE_COUNTER is not set
# CONFIG_COMEDI_CB_PCIDAS64 is not set
# CONFIG_COMEDI_CB_PCIDAS is not set
# CONFIG_COMEDI_CB_PCIDDA is not set
# CONFIG_COMEDI_CB_PCIDIO is not set
# CONFIG_COMEDI_CB_PCIMDAS is not set
# CONFIG_COMEDI_CB_PCIMDDA is not set
# CONFIG_COMEDI_ME4000 is not set
# CONFIG_COMEDI_ME_DAQ is not set
# CONFIG_COMEDI_RTD520 is not set
# CONFIG_COMEDI_S526 is not set
# CONFIG_COMEDI_S626 is not set
# CONFIG_COMEDI_SSV_DNP is not set
CONFIG_COMEDI_PCMCIA_DRIVERS=m
# CONFIG_COMEDI_CB_DAS16_CS is not set
# CONFIG_COMEDI_DAS08_CS is not set
# CONFIG_COMEDI_QUATECH_DAQP_CS is not set
CONFIG_COMEDI_USB_DRIVERS=m
# CONFIG_COMEDI_DT9812 is not set
# CONFIG_COMEDI_USBDUX is not set
# CONFIG_COMEDI_USBDUXFAST is not set
# CONFIG_COMEDI_USBDUXSIGMA is not set
# CONFIG_COMEDI_VMK80XX is not set
# CONFIG_COMEDI_NI_COMMON is not set
CONFIG_COMEDI_8255=m
# CONFIG_COMEDI_FC is not set
# CONFIG_ASUS_OLED is not set
# CONFIG_PANEL is not set
# CONFIG_R8187SE is not set
CONFIG_RTL8192U=m
# CONFIG_RTLLIB is not set
# CONFIG_R8712U is not set
# CONFIG_RTS_PSTOR is not set
# CONFIG_RTS5139 is not set
# CONFIG_TRANZPORT is not set
# CONFIG_IDE_PHISON is not set
# CONFIG_LINE6_USB is not set
# CONFIG_USB_SERIAL_QUATECH2 is not set
# CONFIG_VT6655 is not set
CONFIG_VT6656=m
# CONFIG_DX_SEP is not set
# CONFIG_ZRAM is not set
# CONFIG_ZSMALLOC is not set
# CONFIG_WLAGS49_H2 is not set
# CONFIG_WLAGS49_H25 is not set
# CONFIG_FB_SM7XX is not set
# CONFIG_CRYSTALHD is not set
# CONFIG_CXT1E1 is not set
# CONFIG_FB_XGI is not set
# CONFIG_ACPI_QUICKSTART is not set
# CONFIG_SBE_2T3E3 is not set
# CONFIG_USB_ENESTORAGE is not set
# CONFIG_BCM_WIMAX is not set
# CONFIG_FT1000 is not set

#
# Speakup console speech
#
CONFIG_SPEAKUP=m
CONFIG_SPEAKUP_SYNTH_ACNTSA=m
CONFIG_SPEAKUP_SYNTH_ACNTPC=m
CONFIG_SPEAKUP_SYNTH_APOLLO=m
CONFIG_SPEAKUP_SYNTH_AUDPTR=m
CONFIG_SPEAKUP_SYNTH_BNS=m
CONFIG_SPEAKUP_SYNTH_DECTLK=m
CONFIG_SPEAKUP_SYNTH_DECEXT=m
# CONFIG_SPEAKUP_SYNTH_DECPC is not set
CONFIG_SPEAKUP_SYNTH_DTLK=m
CONFIG_SPEAKUP_SYNTH_KEYPC=m
CONFIG_SPEAKUP_SYNTH_LTLK=m
CONFIG_SPEAKUP_SYNTH_SOFT=m
CONFIG_SPEAKUP_SYNTH_SPKOUT=m
CONFIG_SPEAKUP_SYNTH_TXPRT=m
CONFIG_SPEAKUP_SYNTH_DUMMY=m
# CONFIG_TOUCHSCREEN_CLEARPAD_TM1217 is not set
# CONFIG_TOUCHSCREEN_SYNAPTICS_I2C_RMI4 is not set
# CONFIG_STAGING_MEDIA is not set

#
# Android
#
# CONFIG_ANDROID is not set
CONFIG_PHONE=m
CONFIG_PHONE_IXJ=m
CONFIG_PHONE_IXJ_PCMCIA=m
# CONFIG_USB_WPAN_HCD is not set
# CONFIG_IPACK_BUS is not set
# CONFIG_WIMAX_GDM72XX is not set
CONFIG_X86_PLATFORM_DEVICES=y
CONFIG_ACER_WMI=m
CONFIG_ACERHDF=m
CONFIG_ASUS_LAPTOP=m
CONFIG_DELL_LAPTOP=m
CONFIG_DELL_WMI=m
# CONFIG_DELL_WMI_AIO is not set
CONFIG_FUJITSU_LAPTOP=m
# CONFIG_FUJITSU_LAPTOP_DEBUG is not set
# CONFIG_FUJITSU_TABLET is not set
# CONFIG_AMILO_RFKILL is not set
CONFIG_TC1100_WMI=m
# CONFIG_HP_ACCEL is not set
CONFIG_HP_WMI=m
CONFIG_MSI_LAPTOP=m
CONFIG_PANASONIC_LAPTOP=m
CONFIG_COMPAL_LAPTOP=m
CONFIG_SONY_LAPTOP=m
CONFIG_SONYPI_COMPAT=y
# CONFIG_IDEAPAD_LAPTOP is not set
CONFIG_THINKPAD_ACPI=m
CONFIG_THINKPAD_ACPI_ALSA_SUPPORT=y
# CONFIG_THINKPAD_ACPI_DEBUGFACILITIES is not set
# CONFIG_THINKPAD_ACPI_DEBUG is not set
# CONFIG_THINKPAD_ACPI_UNSAFE_LEDS is not set
CONFIG_THINKPAD_ACPI_VIDEO=y
CONFIG_THINKPAD_ACPI_HOTKEY_POLL=y
CONFIG_SENSORS_HDAPS=m
CONFIG_EEEPC_LAPTOP=m
# CONFIG_ASUS_WMI is not set
CONFIG_ACPI_WMI=m
# CONFIG_MSI_WMI is not set
CONFIG_TOPSTAR_LAPTOP=m
CONFIG_ACPI_TOSHIBA=m
# CONFIG_TOSHIBA_BT_RFKILL is not set
# CONFIG_ACPI_CMPC is not set
# CONFIG_INTEL_IPS is not set
# CONFIG_IBM_RTL is not set
# CONFIG_XO15_EBOOK is not set
CONFIG_SAMSUNG_LAPTOP=m
CONFIG_MXM_WMI=m
# CONFIG_INTEL_OAKTRAIL is not set
# CONFIG_SAMSUNG_Q10 is not set
# CONFIG_APPLE_GMUX is not set

#
# Hardware Spinlock drivers
#
CONFIG_CLKSRC_I8253=y
CONFIG_CLKEVT_I8253=y
CONFIG_I8253_LOCK=y
CONFIG_CLKBLD_I8253=y
CONFIG_IOMMU_SUPPORT=y

#
# Remoteproc drivers (EXPERIMENTAL)
#

#
# Rpmsg drivers (EXPERIMENTAL)
#
# CONFIG_VIRT_DRIVERS is not set
# CONFIG_PM_DEVFREQ is not set
# CONFIG_EXTCON is not set
# CONFIG_MEMORY is not set
# CONFIG_IIO is not set
# CONFIG_VME_BUS is not set

#
# Firmware Drivers
#
CONFIG_EDD=m
# CONFIG_EDD_OFF is not set
CONFIG_FIRMWARE_MEMMAP=y
CONFIG_EFI_VARS=m
CONFIG_DELL_RBU=m
CONFIG_DCDBAS=m
CONFIG_DMIID=y
# CONFIG_DMI_SYSFS is not set
CONFIG_ISCSI_IBFT_FIND=y
CONFIG_ISCSI_IBFT=m
# CONFIG_GOOGLE_FIRMWARE is not set

#
# File systems
#
CONFIG_DCACHE_WORD_ACCESS=y
CONFIG_EXT2_FS=m
CONFIG_EXT2_FS_XATTR=y
CONFIG_EXT2_FS_POSIX_ACL=y
CONFIG_EXT2_FS_SECURITY=y
# CONFIG_EXT2_FS_XIP is not set
CONFIG_EXT3_FS=m
CONFIG_EXT3_DEFAULTS_TO_ORDERED=y
CONFIG_EXT3_FS_XATTR=y
CONFIG_EXT3_FS_POSIX_ACL=y
CONFIG_EXT3_FS_SECURITY=y
CONFIG_EXT4_FS=m
CONFIG_EXT4_FS_XATTR=y
CONFIG_EXT4_FS_POSIX_ACL=y
CONFIG_EXT4_FS_SECURITY=y
# CONFIG_EXT4_DEBUG is not set
CONFIG_JBD=m
# CONFIG_JBD_DEBUG is not set
CONFIG_JBD2=m
# CONFIG_JBD2_DEBUG is not set
CONFIG_FS_MBCACHE=m
CONFIG_REISERFS_FS=m
# CONFIG_REISERFS_CHECK is not set
# CONFIG_REISERFS_PROC_INFO is not set
CONFIG_REISERFS_FS_XATTR=y
CONFIG_REISERFS_FS_POSIX_ACL=y
CONFIG_REISERFS_FS_SECURITY=y
CONFIG_JFS_FS=m
CONFIG_JFS_POSIX_ACL=y
CONFIG_JFS_SECURITY=y
# CONFIG_JFS_DEBUG is not set
# CONFIG_JFS_STATISTICS is not set
CONFIG_XFS_FS=m
CONFIG_XFS_QUOTA=y
CONFIG_XFS_POSIX_ACL=y
CONFIG_XFS_RT=y
# CONFIG_XFS_DEBUG is not set
CONFIG_GFS2_FS=m
CONFIG_GFS2_FS_LOCKING_DLM=y
CONFIG_OCFS2_FS=m
CONFIG_OCFS2_FS_O2CB=m
CONFIG_OCFS2_FS_USERSPACE_CLUSTER=m
CONFIG_OCFS2_FS_STATS=y
CONFIG_OCFS2_DEBUG_MASKLOG=y
# CONFIG_OCFS2_DEBUG_FS is not set
CONFIG_BTRFS_FS=m
CONFIG_BTRFS_FS_POSIX_ACL=y
# CONFIG_BTRFS_FS_CHECK_INTEGRITY is not set
CONFIG_NILFS2_FS=m
CONFIG_FS_POSIX_ACL=y
CONFIG_EXPORTFS=m
CONFIG_FILE_LOCKING=y
CONFIG_FSNOTIFY=y
CONFIG_DNOTIFY=y
CONFIG_INOTIFY_USER=y
# CONFIG_FANOTIFY is not set
CONFIG_QUOTA=y
CONFIG_QUOTA_NETLINK_INTERFACE=y
CONFIG_PRINT_QUOTA_WARNING=y
# CONFIG_QUOTA_DEBUG is not set
CONFIG_QUOTA_TREE=m
CONFIG_QFMT_V1=m
CONFIG_QFMT_V2=m
CONFIG_QUOTACTL=y
CONFIG_AUTOFS4_FS=m
CONFIG_FUSE_FS=m
CONFIG_CUSE=m
CONFIG_GENERIC_ACL=y

#
# Caches
#
CONFIG_FSCACHE=m
CONFIG_FSCACHE_STATS=y
# CONFIG_FSCACHE_HISTOGRAM is not set
# CONFIG_FSCACHE_DEBUG is not set
# CONFIG_FSCACHE_OBJECT_LIST is not set
CONFIG_CACHEFILES=m
# CONFIG_CACHEFILES_DEBUG is not set
# CONFIG_CACHEFILES_HISTOGRAM is not set

#
# CD-ROM/DVD Filesystems
#
CONFIG_ISO9660_FS=m
CONFIG_JOLIET=y
CONFIG_ZISOFS=y
CONFIG_UDF_FS=m
CONFIG_UDF_NLS=y

#
# DOS/FAT/NT Filesystems
#
CONFIG_FAT_FS=m
CONFIG_MSDOS_FS=m
CONFIG_VFAT_FS=m
CONFIG_FAT_DEFAULT_CODEPAGE=437
CONFIG_FAT_DEFAULT_IOCHARSET="utf8"
CONFIG_NTFS_FS=m
# CONFIG_NTFS_DEBUG is not set
CONFIG_NTFS_RW=y

#
# Pseudo filesystems
#
CONFIG_PROC_FS=y
CONFIG_PROC_KCORE=y
CONFIG_PROC_SYSCTL=y
CONFIG_PROC_PAGE_MONITOR=y
CONFIG_SYSFS=y
CONFIG_TMPFS=y
CONFIG_TMPFS_POSIX_ACL=y
CONFIG_TMPFS_XATTR=y
CONFIG_HUGETLBFS=y
CONFIG_HUGETLB_PAGE=y
CONFIG_CONFIGFS_FS=m
CONFIG_MISC_FILESYSTEMS=y
CONFIG_ADFS_FS=m
# CONFIG_ADFS_FS_RW is not set
CONFIG_AFFS_FS=m
CONFIG_ECRYPT_FS=m
CONFIG_HFS_FS=m
CONFIG_HFSPLUS_FS=m
CONFIG_BEFS_FS=m
# CONFIG_BEFS_DEBUG is not set
CONFIG_BFS_FS=m
CONFIG_EFS_FS=m
CONFIG_JFFS2_FS=m
CONFIG_JFFS2_FS_DEBUG=0
CONFIG_JFFS2_FS_WRITEBUFFER=y
# CONFIG_JFFS2_FS_WBUF_VERIFY is not set
CONFIG_JFFS2_SUMMARY=y
CONFIG_JFFS2_FS_XATTR=y
CONFIG_JFFS2_FS_POSIX_ACL=y
CONFIG_JFFS2_FS_SECURITY=y
CONFIG_JFFS2_COMPRESSION_OPTIONS=y
CONFIG_JFFS2_ZLIB=y
CONFIG_JFFS2_LZO=y
CONFIG_JFFS2_RTIME=y
# CONFIG_JFFS2_RUBIN is not set
# CONFIG_JFFS2_CMODE_NONE is not set
CONFIG_JFFS2_CMODE_PRIORITY=y
# CONFIG_JFFS2_CMODE_SIZE is not set
# CONFIG_JFFS2_CMODE_FAVOURLZO is not set
CONFIG_UBIFS_FS=m
CONFIG_UBIFS_FS_ADVANCED_COMPR=y
CONFIG_UBIFS_FS_LZO=y
CONFIG_UBIFS_FS_ZLIB=y
# CONFIG_LOGFS is not set
CONFIG_CRAMFS=m
CONFIG_SQUASHFS=m
# CONFIG_SQUASHFS_XATTR is not set
CONFIG_SQUASHFS_ZLIB=y
# CONFIG_SQUASHFS_LZO is not set
# CONFIG_SQUASHFS_XZ is not set
# CONFIG_SQUASHFS_4K_DEVBLK_SIZE is not set
# CONFIG_SQUASHFS_EMBEDDED is not set
CONFIG_SQUASHFS_FRAGMENT_CACHE_SIZE=3
CONFIG_VXFS_FS=m
CONFIG_MINIX_FS=m
CONFIG_OMFS_FS=m
CONFIG_HPFS_FS=m
CONFIG_QNX4FS_FS=m
# CONFIG_QNX6FS_FS is not set
CONFIG_ROMFS_FS=m
# CONFIG_ROMFS_BACKED_BY_BLOCK is not set
# CONFIG_ROMFS_BACKED_BY_MTD is not set
CONFIG_ROMFS_BACKED_BY_BOTH=y
CONFIG_ROMFS_ON_BLOCK=y
CONFIG_ROMFS_ON_MTD=y
# CONFIG_PSTORE is not set
CONFIG_SYSV_FS=m
CONFIG_UFS_FS=m
# CONFIG_UFS_FS_WRITE is not set
# CONFIG_UFS_DEBUG is not set
CONFIG_EXOFS_FS=m
# CONFIG_EXOFS_DEBUG is not set
CONFIG_ORE=m
CONFIG_NETWORK_FILESYSTEMS=y
CONFIG_NFS_FS=m
CONFIG_NFS_V2=y
CONFIG_NFS_V3=y
CONFIG_NFS_V3_ACL=y
CONFIG_NFS_V4=y
# CONFIG_NFS_V4_1 is not set
CONFIG_NFS_FSCACHE=y
# CONFIG_NFS_USE_LEGACY_DNS is not set
CONFIG_NFS_USE_KERNEL_DNS=y
CONFIG_NFSD=m
CONFIG_NFSD_V2_ACL=y
CONFIG_NFSD_V3=y
CONFIG_NFSD_V3_ACL=y
CONFIG_NFSD_V4=y
# CONFIG_NFSD_FAULT_INJECTION is not set
CONFIG_LOCKD=m
CONFIG_LOCKD_V4=y
CONFIG_NFS_ACL_SUPPORT=m
CONFIG_NFS_COMMON=y
CONFIG_SUNRPC=m
CONFIG_SUNRPC_GSS=m
CONFIG_SUNRPC_XPRT_RDMA=m
CONFIG_RPCSEC_GSS_KRB5=m
# CONFIG_SUNRPC_DEBUG is not set
# CONFIG_CEPH_FS is not set
CONFIG_CIFS=m
# CONFIG_CIFS_STATS is not set
CONFIG_CIFS_WEAK_PW_HASH=y
CONFIG_CIFS_UPCALL=y
CONFIG_CIFS_XATTR=y
CONFIG_CIFS_POSIX=y
# CONFIG_CIFS_DEBUG2 is not set
CONFIG_CIFS_DFS_UPCALL=y
# CONFIG_CIFS_FSCACHE is not set
# CONFIG_CIFS_ACL is not set
CONFIG_NCP_FS=m
CONFIG_NCPFS_PACKET_SIGNING=y
CONFIG_NCPFS_IOCTL_LOCKING=y
CONFIG_NCPFS_STRONG=y
CONFIG_NCPFS_NFS_NS=y
CONFIG_NCPFS_OS2_NS=y
# CONFIG_NCPFS_SMALLDOS is not set
CONFIG_NCPFS_NLS=y
CONFIG_NCPFS_EXTRAS=y
CONFIG_CODA_FS=m
CONFIG_AFS_FS=m
# CONFIG_AFS_DEBUG is not set
CONFIG_AFS_FSCACHE=y
CONFIG_9P_FS=m
CONFIG_9P_FSCACHE=y
# CONFIG_9P_FS_POSIX_ACL is not set
CONFIG_NLS=y
CONFIG_NLS_DEFAULT="utf8"
CONFIG_NLS_CODEPAGE_437=m
CONFIG_NLS_CODEPAGE_737=m
CONFIG_NLS_CODEPAGE_775=m
CONFIG_NLS_CODEPAGE_850=m
CONFIG_NLS_CODEPAGE_852=m
CONFIG_NLS_CODEPAGE_855=m
CONFIG_NLS_CODEPAGE_857=m
CONFIG_NLS_CODEPAGE_860=m
CONFIG_NLS_CODEPAGE_861=m
CONFIG_NLS_CODEPAGE_862=m
CONFIG_NLS_CODEPAGE_863=m
CONFIG_NLS_CODEPAGE_864=m
CONFIG_NLS_CODEPAGE_865=m
CONFIG_NLS_CODEPAGE_866=m
CONFIG_NLS_CODEPAGE_869=m
CONFIG_NLS_CODEPAGE_936=m
CONFIG_NLS_CODEPAGE_950=m
CONFIG_NLS_CODEPAGE_932=m
CONFIG_NLS_CODEPAGE_949=m
CONFIG_NLS_CODEPAGE_874=m
CONFIG_NLS_ISO8859_8=m
CONFIG_NLS_CODEPAGE_1250=m
CONFIG_NLS_CODEPAGE_1251=m
CONFIG_NLS_ASCII=m
CONFIG_NLS_ISO8859_1=m
CONFIG_NLS_ISO8859_2=m
CONFIG_NLS_ISO8859_3=m
CONFIG_NLS_ISO8859_4=m
CONFIG_NLS_ISO8859_5=m
CONFIG_NLS_ISO8859_6=m
CONFIG_NLS_ISO8859_7=m
CONFIG_NLS_ISO8859_9=m
CONFIG_NLS_ISO8859_13=m
CONFIG_NLS_ISO8859_14=m
CONFIG_NLS_ISO8859_15=m
CONFIG_NLS_KOI8_R=m
CONFIG_NLS_KOI8_U=m
# CONFIG_NLS_MAC_ROMAN is not set
# CONFIG_NLS_MAC_CELTIC is not set
# CONFIG_NLS_MAC_CENTEURO is not set
# CONFIG_NLS_MAC_CROATIAN is not set
# CONFIG_NLS_MAC_CYRILLIC is not set
# CONFIG_NLS_MAC_GAELIC is not set
# CONFIG_NLS_MAC_GREEK is not set
# CONFIG_NLS_MAC_ICELAND is not set
# CONFIG_NLS_MAC_INUIT is not set
# CONFIG_NLS_MAC_ROMANIAN is not set
# CONFIG_NLS_MAC_TURKISH is not set
CONFIG_NLS_UTF8=m
CONFIG_DLM=m
CONFIG_DLM_DEBUG=y

#
# Kernel hacking
#
CONFIG_TRACE_IRQFLAGS_SUPPORT=y
CONFIG_PRINTK_TIME=y
CONFIG_DEFAULT_MESSAGE_LOGLEVEL=4
CONFIG_ENABLE_WARN_DEPRECATED=y
CONFIG_ENABLE_MUST_CHECK=y
CONFIG_FRAME_WARN=1024
CONFIG_MAGIC_SYSRQ=y
CONFIG_STRIP_ASM_SYMS=y
# CONFIG_READABLE_ASM is not set
CONFIG_UNUSED_SYMBOLS=y
CONFIG_DEBUG_FS=y
# CONFIG_HEADERS_CHECK is not set
# CONFIG_DEBUG_SECTION_MISMATCH is not set
# CONFIG_IPIPE_DEBUG is not set
CONFIG_DEBUG_KERNEL=y
# CONFIG_DEBUG_SHIRQ is not set
# CONFIG_LOCKUP_DETECTOR is not set
# CONFIG_HARDLOCKUP_DETECTOR is not set
# CONFIG_PANIC_ON_OOPS is not set
CONFIG_PANIC_ON_OOPS_VALUE=0
CONFIG_DETECT_HUNG_TASK=y
CONFIG_DEFAULT_HUNG_TASK_TIMEOUT=120
# CONFIG_BOOTPARAM_HUNG_TASK_PANIC is not set
CONFIG_BOOTPARAM_HUNG_TASK_PANIC_VALUE=0
CONFIG_SCHED_DEBUG=y
# CONFIG_SCHEDSTATS is not set
CONFIG_TIMER_STATS=y
# CONFIG_DEBUG_OBJECTS is not set
# CONFIG_SLUB_DEBUG_ON is not set
# CONFIG_SLUB_STATS is not set
# CONFIG_DEBUG_KMEMLEAK is not set
CONFIG_DEBUG_PREEMPT=y
# CONFIG_DEBUG_RT_MUTEXES is not set
# CONFIG_RT_MUTEX_TESTER is not set
# CONFIG_DEBUG_SPINLOCK is not set
# CONFIG_DEBUG_MUTEXES is not set
# CONFIG_DEBUG_LOCK_ALLOC is not set
# CONFIG_PROVE_LOCKING is not set
# CONFIG_SPARSE_RCU_POINTER is not set
# CONFIG_LOCK_STAT is not set
# CONFIG_DEBUG_ATOMIC_SLEEP is not set
# CONFIG_DEBUG_LOCKING_API_SELFTESTS is not set
# CONFIG_DEBUG_STACK_USAGE is not set
# CONFIG_DEBUG_KOBJECT is not set
# CONFIG_DEBUG_HIGHMEM is not set
CONFIG_DEBUG_BUGVERBOSE=y
# CONFIG_DEBUG_INFO is not set
# CONFIG_DEBUG_VM is not set
# CONFIG_DEBUG_VIRTUAL is not set
# CONFIG_DEBUG_WRITECOUNT is not set
CONFIG_DEBUG_MEMORY_INIT=y
# CONFIG_DEBUG_LIST is not set
# CONFIG_TEST_LIST_SORT is not set
# CONFIG_DEBUG_SG is not set
# CONFIG_DEBUG_NOTIFIERS is not set
# CONFIG_DEBUG_CREDENTIALS is not set
CONFIG_ARCH_WANT_FRAME_POINTERS=y
# CONFIG_FRAME_POINTER is not set
# CONFIG_BOOT_PRINTK_DELAY is not set
# CONFIG_RCU_TORTURE_TEST is not set
CONFIG_RCU_CPU_STALL_TIMEOUT=60
CONFIG_RCU_CPU_STALL_VERBOSE=y
# CONFIG_RCU_CPU_STALL_INFO is not set
# CONFIG_RCU_TRACE is not set
# CONFIG_BACKTRACE_SELF_TEST is not set
# CONFIG_DEBUG_BLOCK_EXT_DEVT is not set
# CONFIG_DEBUG_FORCE_WEAK_PER_CPU is not set
# CONFIG_DEBUG_PER_CPU_MAPS is not set
# CONFIG_LKDTM is not set
# CONFIG_CPU_NOTIFIER_ERROR_INJECT is not set
# CONFIG_FAULT_INJECTION is not set
# CONFIG_LATENCYTOP is not set
# CONFIG_DEBUG_PAGEALLOC is not set
CONFIG_USER_STACKTRACE_SUPPORT=y
CONFIG_HAVE_FUNCTION_TRACER=y
CONFIG_HAVE_FUNCTION_GRAPH_TRACER=y
CONFIG_HAVE_FUNCTION_GRAPH_FP_TEST=y
CONFIG_HAVE_FUNCTION_TRACE_MCOUNT_TEST=y
CONFIG_HAVE_DYNAMIC_FTRACE=y
CONFIG_HAVE_FTRACE_MCOUNT_RECORD=y
CONFIG_HAVE_SYSCALL_TRACEPOINTS=y
CONFIG_HAVE_C_RECORDMCOUNT=y
CONFIG_TRACING_SUPPORT=y
# CONFIG_FTRACE is not set
# CONFIG_PROVIDE_OHCI1394_DMA_INIT is not set
# CONFIG_FIREWIRE_OHCI_REMOTE_DMA is not set
# CONFIG_DYNAMIC_DEBUG is not set
# CONFIG_DMA_API_DEBUG is not set
# CONFIG_ATOMIC64_SELFTEST is not set
# CONFIG_ASYNC_RAID6_TEST is not set
# CONFIG_SAMPLES is not set
CONFIG_HAVE_ARCH_KGDB=y
# CONFIG_KGDB is not set
CONFIG_HAVE_ARCH_KMEMCHECK=y
# CONFIG_TEST_KSTRTOX is not set
CONFIG_STRICT_DEVMEM=y
CONFIG_X86_VERBOSE_BOOTUP=y
CONFIG_EARLY_PRINTK=y
# CONFIG_EARLY_PRINTK_DBGP is not set
# CONFIG_X86_PTDUMP is not set
CONFIG_DEBUG_RODATA=y
# CONFIG_DEBUG_RODATA_TEST is not set
# CONFIG_DEBUG_SET_MODULE_RONX is not set
# CONFIG_DEBUG_NX_TEST is not set
CONFIG_DOUBLEFAULT=y
# CONFIG_IOMMU_STRESS is not set
CONFIG_HAVE_MMIOTRACE_SUPPORT=y
CONFIG_IO_DELAY_TYPE_0X80=0
CONFIG_IO_DELAY_TYPE_0XED=1
CONFIG_IO_DELAY_TYPE_UDELAY=2
CONFIG_IO_DELAY_TYPE_NONE=3
CONFIG_IO_DELAY_0X80=y
# CONFIG_IO_DELAY_0XED is not set
# CONFIG_IO_DELAY_UDELAY is not set
# CONFIG_IO_DELAY_NONE is not set
CONFIG_DEFAULT_IO_DELAY_TYPE=0
# CONFIG_DEBUG_BOOT_PARAMS is not set
# CONFIG_CPA_DEBUG is not set
CONFIG_OPTIMIZE_INLINING=y
# CONFIG_DEBUG_STRICT_USER_COPY_CHECKS is not set
# CONFIG_DEBUG_NMI_SELFTEST is not set

#
# Security options
#
CONFIG_KEYS=y
# CONFIG_TRUSTED_KEYS is not set
# CONFIG_ENCRYPTED_KEYS is not set
CONFIG_KEYS_DEBUG_PROC_KEYS=y
# CONFIG_SECURITY_DMESG_RESTRICT is not set
CONFIG_SECURITY=y
CONFIG_SECURITYFS=y
CONFIG_SECURITY_NETWORK=y
CONFIG_SECURITY_NETWORK_XFRM=y
CONFIG_SECURITY_PATH=y
CONFIG_SECURITY_TOMOYO=y
CONFIG_SECURITY_TOMOYO_MAX_ACCEPT_ENTRY=2048
CONFIG_SECURITY_TOMOYO_MAX_AUDIT_LOG=1024
# CONFIG_SECURITY_TOMOYO_OMIT_USERSPACE_LOADER is not set
CONFIG_SECURITY_TOMOYO_POLICY_LOADER="/sbin/tomoyo-init"
CONFIG_SECURITY_TOMOYO_ACTIVATION_TRIGGER="/sbin/init"
# CONFIG_SECURITY_APPARMOR is not set
# CONFIG_SECURITY_YAMA is not set
# CONFIG_IMA is not set
# CONFIG_EVM is not set
CONFIG_DEFAULT_SECURITY_TOMOYO=y
# CONFIG_DEFAULT_SECURITY_DAC is not set
CONFIG_DEFAULT_SECURITY="tomoyo"
CONFIG_XOR_BLOCKS=m
CONFIG_ASYNC_CORE=m
CONFIG_ASYNC_MEMCPY=m
CONFIG_ASYNC_XOR=m
CONFIG_ASYNC_PQ=m
CONFIG_ASYNC_RAID6_RECOV=m
CONFIG_ASYNC_TX_DISABLE_PQ_VAL_DMA=y
CONFIG_ASYNC_TX_DISABLE_XOR_VAL_DMA=y
CONFIG_CRYPTO=y

#
# Crypto core or helper
#
CONFIG_CRYPTO_ALGAPI=y
CONFIG_CRYPTO_ALGAPI2=y
CONFIG_CRYPTO_AEAD=m
CONFIG_CRYPTO_AEAD2=y
CONFIG_CRYPTO_BLKCIPHER=m
CONFIG_CRYPTO_BLKCIPHER2=y
CONFIG_CRYPTO_HASH=y
CONFIG_CRYPTO_HASH2=y
CONFIG_CRYPTO_RNG=m
CONFIG_CRYPTO_RNG2=y
CONFIG_CRYPTO_PCOMP=m
CONFIG_CRYPTO_PCOMP2=y
CONFIG_CRYPTO_MANAGER=y
CONFIG_CRYPTO_MANAGER2=y
# CONFIG_CRYPTO_USER is not set
CONFIG_CRYPTO_MANAGER_DISABLE_TESTS=y
CONFIG_CRYPTO_GF128MUL=m
CONFIG_CRYPTO_NULL=m
# CONFIG_CRYPTO_PCRYPT is not set
CONFIG_CRYPTO_WORKQUEUE=y
# CONFIG_CRYPTO_CRYPTD is not set
CONFIG_CRYPTO_AUTHENC=m
CONFIG_CRYPTO_TEST=m

#
# Authenticated Encryption with Associated Data
#
CONFIG_CRYPTO_CCM=m
CONFIG_CRYPTO_GCM=m
CONFIG_CRYPTO_SEQIV=m

#
# Block modes
#
CONFIG_CRYPTO_CBC=m
CONFIG_CRYPTO_CTR=m
CONFIG_CRYPTO_CTS=m
CONFIG_CRYPTO_ECB=m
CONFIG_CRYPTO_LRW=m
CONFIG_CRYPTO_PCBC=m
CONFIG_CRYPTO_XTS=m

#
# Hash modes
#
CONFIG_CRYPTO_HMAC=m
CONFIG_CRYPTO_XCBC=m
CONFIG_CRYPTO_VMAC=m

#
# Digest
#
CONFIG_CRYPTO_CRC32C=m
CONFIG_CRYPTO_CRC32C_INTEL=m
CONFIG_CRYPTO_GHASH=m
CONFIG_CRYPTO_MD4=m
CONFIG_CRYPTO_MD5=y
CONFIG_CRYPTO_MICHAEL_MIC=m
CONFIG_CRYPTO_RMD128=m
CONFIG_CRYPTO_RMD160=m
CONFIG_CRYPTO_RMD256=m
CONFIG_CRYPTO_RMD320=m
CONFIG_CRYPTO_SHA1=m
CONFIG_CRYPTO_SHA256=m
CONFIG_CRYPTO_SHA512=m
CONFIG_CRYPTO_TGR192=m
CONFIG_CRYPTO_WP512=m

#
# Ciphers
#
CONFIG_CRYPTO_AES=m
CONFIG_CRYPTO_AES_586=m
# CONFIG_CRYPTO_AES_NI_INTEL is not set
CONFIG_CRYPTO_ANUBIS=m
CONFIG_CRYPTO_ARC4=m
CONFIG_CRYPTO_BLOWFISH=m
CONFIG_CRYPTO_BLOWFISH_COMMON=m
CONFIG_CRYPTO_CAMELLIA=m
CONFIG_CRYPTO_CAST5=m
CONFIG_CRYPTO_CAST6=m
CONFIG_CRYPTO_DES=m
CONFIG_CRYPTO_FCRYPT=m
CONFIG_CRYPTO_KHAZAD=m
CONFIG_CRYPTO_SALSA20=m
CONFIG_CRYPTO_SALSA20_586=m
CONFIG_CRYPTO_SEED=m
CONFIG_CRYPTO_SERPENT=m
# CONFIG_CRYPTO_SERPENT_SSE2_586 is not set
CONFIG_CRYPTO_TEA=m
CONFIG_CRYPTO_TWOFISH=m
CONFIG_CRYPTO_TWOFISH_COMMON=m
CONFIG_CRYPTO_TWOFISH_586=m

#
# Compression
#
CONFIG_CRYPTO_DEFLATE=m
CONFIG_CRYPTO_ZLIB=m
CONFIG_CRYPTO_LZO=m

#
# Random Number Generation
#
CONFIG_CRYPTO_ANSI_CPRNG=m
# CONFIG_CRYPTO_USER_API_HASH is not set
# CONFIG_CRYPTO_USER_API_SKCIPHER is not set
CONFIG_CRYPTO_HW=y
CONFIG_CRYPTO_DEV_PADLOCK=m
CONFIG_CRYPTO_DEV_PADLOCK_AES=m
CONFIG_CRYPTO_DEV_PADLOCK_SHA=m
CONFIG_CRYPTO_DEV_GEODE=m
CONFIG_HAVE_KVM=y
CONFIG_HAVE_KVM_IRQCHIP=y
CONFIG_HAVE_KVM_EVENTFD=y
CONFIG_KVM_APIC_ARCHITECTURE=y
CONFIG_KVM_MMIO=y
CONFIG_KVM_ASYNC_PF=y
CONFIG_HAVE_KVM_MSI=y
CONFIG_VIRTUALIZATION=y
CONFIG_KVM=m
CONFIG_KVM_INTEL=m
CONFIG_KVM_AMD=m
# CONFIG_VHOST_NET is not set
# CONFIG_LGUEST is not set
# CONFIG_BINARY_PRINTF is not set

#
# Library routines
#
CONFIG_RAID6_PQ=m
CONFIG_BITREVERSE=y
CONFIG_GENERIC_STRNCPY_FROM_USER=y
CONFIG_GENERIC_STRNLEN_USER=y
CONFIG_GENERIC_FIND_FIRST_BIT=y
CONFIG_GENERIC_PCI_IOMAP=y
CONFIG_GENERIC_IOMAP=y
CONFIG_GENERIC_IO=y
CONFIG_CRC_CCITT=m
CONFIG_CRC16=m
CONFIG_CRC_T10DIF=m
CONFIG_CRC_ITU_T=m
CONFIG_CRC32=y
# CONFIG_CRC32_SELFTEST is not set
CONFIG_CRC32_SLICEBY8=y
# CONFIG_CRC32_SLICEBY4 is not set
# CONFIG_CRC32_SARWATE is not set
# CONFIG_CRC32_BIT is not set
CONFIG_CRC7=m
CONFIG_LIBCRC32C=m
# CONFIG_CRC8 is not set
CONFIG_ZLIB_INFLATE=y
CONFIG_ZLIB_DEFLATE=m
CONFIG_LZO_COMPRESS=y
CONFIG_LZO_DECOMPRESS=y
CONFIG_XZ_DEC=y
CONFIG_XZ_DEC_X86=y
CONFIG_XZ_DEC_POWERPC=y
CONFIG_XZ_DEC_IA64=y
CONFIG_XZ_DEC_ARM=y
CONFIG_XZ_DEC_ARMTHUMB=y
CONFIG_XZ_DEC_SPARC=y
CONFIG_XZ_DEC_BCJ=y
# CONFIG_XZ_DEC_TEST is not set
CONFIG_DECOMPRESS_GZIP=y
CONFIG_DECOMPRESS_BZIP2=y
CONFIG_DECOMPRESS_LZMA=y
CONFIG_DECOMPRESS_XZ=y
CONFIG_DECOMPRESS_LZO=y
CONFIG_GENERIC_ALLOCATOR=y
CONFIG_REED_SOLOMON=m
CONFIG_REED_SOLOMON_DEC16=y
CONFIG_TEXTSEARCH=y
CONFIG_TEXTSEARCH_KMP=m
CONFIG_TEXTSEARCH_BM=m
CONFIG_TEXTSEARCH_FSM=m
CONFIG_HAS_IOMEM=y
CONFIG_HAS_IOPORT=y
CONFIG_HAS_DMA=y
CONFIG_CHECK_SIGNATURE=y
CONFIG_CPU_RMAP=y
CONFIG_DQL=y
CONFIG_NLATTR=y
CONFIG_LRU_CACHE=m
CONFIG_AVERAGE=y
# CONFIG_CORDIC is not set
# CONFIG_DDR is not set

^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: [Xenomai] Decrease Latency (below 10 us) on x32 or x32_64?
  2013-03-19 20:14 [Xenomai] Decrease Latency (below 10 us) on x32 or x32_64? Manuel Huber
@ 2013-03-19 20:46 ` Gilles Chanteperdrix
  2013-03-26 10:18   ` Manuel Huber
  2013-04-13 16:42   ` Gilles Chanteperdrix
  0 siblings, 2 replies; 12+ messages in thread
From: Gilles Chanteperdrix @ 2013-03-19 20:46 UTC (permalink / raw)
  To: Manuel Huber; +Cc: xenomai

On 03/19/2013 09:14 PM, Manuel Huber wrote:

> Hello!
> 
> We use a AMD FX-61000 CPU together with Xenomai 2.6.2.1 and Kernel
> 3.5.7 (thanks to Jan Kiszka) and I was wondering if it's possible to
> further decrease the latency of the system. I currently can get more
> than 30 us when interacting with the system.
> 
> My first guess was the graphics card + graphics card driver because I
> read about such problems and tested another graphics card which caused
> a huge amount of extra-latency... I tried to get the real system
> latency by booting the system in recovery mode (single) with vga=792
> option + setting the nouveau driver on the blacklist... This seems to
> work, but I still get roughly the same latencies (>20us) even after
> 1hour by using the latency program in interrupt mode (-t 2). Only a
> few times the latency grows beyond 10us but still it does... I have
> unplugged the usb mouse and keyboard before running the test and
> started ten instances of burnK7 with nice -n -20.  I also tried
> booting with isolcpus=2,3 and assigned the latency program to cpu 3
> (-c 3). This didn't really improve the worst case latency (still the
> same setup as above, no gui, single). Is it possible to further
> decrease latency (especially worst case latency) by using one cpu just
> for real-time tasks? Is there some other way to keep Linux from using
> a core?
> 
> The next thing I want to test is using 64bits; It seems rational that
> using 32 bits with 16GB ram causes some extra latencies but is it
> possible that it causes about 10 us extra? Is there some other option
> I can tune? I know that the I-Pipe system isn't trivial but to me,
> using interrupts seems pretty low-level and I would expect this to
> have minimal latency (and jitter). I don't want to complain, it's just
> that my supervisor asked me about the source of the latency and I
> can't really explain... After having read just about all papers
> about I-Pipe, I still don't have a deep understanding of the system.
> Is there a good reference I missed?


First, to know where the latency comes from, enable the I-pipe tracer,
and run latency with the "-f" option.

Now, common ways to reduce latencies are:
- optimize the kernel for size
- disable high res timers, you can try fiddling with the various preempt
settings, this used to have a big impact on code size, but with the
"optimize for size" option, they no longer seem to have one.
- check what the processor does when idle; if it enters C1 state, try to
avoid that with the BIOS settings, or pass "nohlt" on the kernel command
line.

But of course, what you should do probably depends on the I-pipe tracer
results. And to really know what your worst case latency is, you should
always run the test the same time with the same load, you can use
xeno-test for that.

-- 
                                                                Gilles.


^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: [Xenomai] Decrease Latency (below 10 us) on x32 or x32_64?
  2013-03-19 20:46 ` Gilles Chanteperdrix
@ 2013-03-26 10:18   ` Manuel Huber
  2013-03-26 11:57     ` Gilles Chanteperdrix
  2013-04-13 16:42   ` Gilles Chanteperdrix
  1 sibling, 1 reply; 12+ messages in thread
From: Manuel Huber @ 2013-03-26 10:18 UTC (permalink / raw)
  To: Gilles Chanteperdrix; +Cc: xenomai

Hello!

Sorry for the delay. I have re-compiled the Kernel with the I-pipe
tracer enabled, and I disabled the HPET. Then, I tried to reset the
tracer by writing 0 to /proc/ipipe/trace/frozen and some string to
/proc/ipipe/trace/max. Then I started the latency program with the -f
option for some minutes and afterwards captured the variables in
/proc/ipipe/trace/. One test has been made in single-user mode and
without the nouveau driver (plain-vga_300.txt) and the other trace has
been made in normal multi-user mode with gdm running (and the nouveau
driver; gui_300.txt). There is one trace without any USB-device
attached (plain-vga_300_no_usb.txt), but I'm not sure if that makes
any difference.

I hope I used the I-pipe tracer correctly. I'm sorry to bother you
again, but I can't interpret the results :( Maybe you could interpret
the trace, if you have time for it...

Thanks for all your effort...


On 2013-03-19 21:46, Gilles Chanteperdrix wrote:
> On 03/19/2013 09:14 PM, Manuel Huber wrote:
>
>> Hello!
>>
>> We use a AMD FX-61000 CPU together with Xenomai 2.6.2.1 and Kernel
>> 3.5.7 (thanks to Jan Kiszka) and I was wondering if it's possible to
>> further decrease the latency of the system. I currently can get more
>> than 30 us when interacting with the system.
>>
>> My first guess was the graphics card + graphics card driver because I
>> read about such problems and tested another graphics card which caused
>> a huge amount of extra-latency... I tried to get the real system
>> latency by booting the system in recovery mode (single) with vga=792
>> option + setting the nouveau driver on the blacklist... This seems to
>> work, but I still get roughly the same latencies (>20us) even after
>> 1hour by using the latency program in interrupt mode (-t 2). Only a
>> few times the latency grows beyond 10us but still it does... I have
>> unplugged the usb mouse and keyboard before running the test and
>> started ten instances of burnK7 with nice -n -20.  I also tried
>> booting with isolcpus=2,3 and assigned the latency program to cpu 3
>> (-c 3). This didn't really improve the worst case latency (still the
>> same setup as above, no gui, single). Is it possible to further
>> decrease latency (especially worst case latency) by using one cpu just
>> for real-time tasks? Is there some other way to keep Linux from using
>> a core?
>>
>> The next thing I want to test is using 64bits; It seems rational that
>> using 32 bits with 16GB ram causes some extra latencies but is it
>> possible that it causes about 10 us extra? Is there some other option
>> I can tune? I know that the I-Pipe system isn't trivial but to me,
>> using interrupts seems pretty low-level and I would expect this to
>> have minimal latency (and jitter). I don't want to complain, it's just
>> that my supervisor asked me about the source of the latency and I
>> can't really explain... After having read just about all papers
>> about I-Pipe, I still don't have a deep understanding of the system.
>> Is there a good reference I missed?
>
> First, to know where the latency comes from, enable the I-pipe tracer,
> and run latency with the "-f" option.
>
> Now, common ways to reduce latencies are:
> - optimize the kernel for size
> - disable high res timers, you can try fiddling with the various preempt
> settings, this used to have a big impact on code size, but with the
> "optimize for size" option, they no longer seem to have one.
> - check what the processor does when idle; if it enters C1 state, try to
> avoid that with the BIOS settings, or pass "nohlt" on the kernel command
> line.
>
> But of course, what you should do probably depends on the I-pipe tracer
> results. And to really know what your worst case latency is, you should
> always run the test the same time with the same load, you can use
> xeno-test for that.
>

-------------- next part --------------
I-pipe trace results
--------------------


[parameters]
enable = 1
verbose = 5
pre_trace_points = 10
back_trace_points = 100
post_trace_points = 10


[frozen]
I-pipe frozen back-tracing service on 3.5.7-trace/ipipe release #3
------------------------------------------------------------
CPU: 0, Freeze: 30387304420200 cycles, Trace Points: 100 (+10)
Calibrated minimum trace-point overhead: 0.078 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
:|   #end     0x80000001   -63	  0.462  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -62	  0.506  update_rq_clock+0x6 (scheduler_tick+0x3d)
:|   #begin   0x80000001   -62	  0.407  debug_smp_processor_id+0x36 (__cycles_2_ns+0x17)
:|   #end     0x80000001   -61	  0.471  debug_smp_processor_id+0x82 (__cycles_2_ns+0x17)
:    #func                 -61	  0.466  __update_cpu_load+0x9 (scheduler_tick+0x54)
:    #func                 -60	  0.469  sched_avg_update+0x9 (__update_cpu_load+0xa5)
:    #func                 -60	  0.366  task_tick_idle+0x3 (scheduler_tick+0x9e)
:    #func                 -59	  0.331  _raw_spin_unlock+0x3 (scheduler_tick+0xa5)
:    #func                 -59	  0.476  sub_preempt_count+0x3 (_raw_spin_unlock+0x15)
:|   #begin   0x80000001   -59	  0.441  debug_smp_processor_id+0x36 (perf_event_task_tick+0x13)
:|   #end     0x80000001   -58	  0.516  debug_smp_processor_id+0x82 (perf_event_task_tick+0x13)
:    #func                 -58	  0.363  trigger_load_balance+0x9 (scheduler_tick+0xeb)
:    #func                 -57	  0.458  raise_softirq+0x4 (trigger_load_balance+0x3f)
:    #func                 -57	  0.366  __raise_softirq_irqoff+0x5 (raise_softirq_irqoff+0x8)
:    #func                 -57	  0.344  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -56	  0.398  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -56	  0.558  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -55	  0.511  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -55	  0.483  idle_cpu+0x3 (trigger_load_balance+0x4e)
:    #func                 -54	  0.548  run_posix_cpu_timers+0x9 (update_process_times+0x58)
:    #func                 -54	  0.450  hrtimer_forward+0xc (tick_sched_timer+0x74)
:    #func                 -53	  0.414  ktime_add_safe+0x8 (hrtimer_forward+0xfb)
:    #func                 -53	  0.411  ktime_add_safe+0x8 (hrtimer_forward+0x114)
:    #func                 -52	  0.327  _raw_spin_lock+0x4 (__run_hrtimer+0x10a)
:    #func                 -52	  0.391  add_preempt_count+0x4 (_raw_spin_lock+0x15)
:    #func                 -52	  0.363  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -51	  0.527  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -51	  0.487  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -50	  0.741  enqueue_hrtimer+0x6 (__run_hrtimer+0x123)
:    #func                 -50	  0.359  _raw_spin_unlock+0x3 (hrtimer_interrupt+0x127)
:    #func                 -49	  0.400  sub_preempt_count+0x3 (_raw_spin_unlock+0x15)
:    #func                 -49	  0.416  tick_program_event+0x4 (hrtimer_interrupt+0x13f)
:    #func                 -48	  0.348  clockevents_program_event+0x9 (tick_program_event+0x24)
:    #func                 -48	  0.568  ktime_get+0x9 (clockevents_program_event+0x71)
:    #func                 -47	  0.406  xnarch_next_htick_shot+0x5 (clockevents_program_event+0xd8)
:|   #begin   0x80000000   -47	  0.610  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  *#func                 -46	  0.456  xntimer_start_aperiodic+0x9 (xnarch_next_htick_shot+0x42)
:|  *#func                 -46	  0.843  xnarch_ns_to_tsc+0x9 (xntimer_start_aperiodic+0x78)
:|  *#func                 -45	  0.362  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|   #end     0x80000000   -45	  0.525  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:    #func                 -44	  0.391  irq_exit+0x3 (smp_apic_timer_interrupt+0x5d)
:    #func                 -44	  0.519  sub_preempt_count+0x3 (irq_exit+0x12)
:    #func                 -43	  0.575  do_softirq+0x9 (irq_exit+0x3a)
:    #func                 -43	  0.364  __do_softirq+0x9 (do_softirq+0x86)
:    #func                 -42	  0.320  add_preempt_count+0x4 (__do_softirq+0x1f)
:    #func                 -42	  0.331  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -42	  0.503  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -41	  0.409  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:|   #begin   0x80000001   -41	  0.420  debug_smp_processor_id+0x36 (__do_softirq+0x24)
:|   #end     0x80000001   -40+   1.265  debug_smp_processor_id+0x82 (__do_softirq+0x24)
:|   #begin   0x000000fd   -39	  0.390  reschedule_interrupt+0x37 (debug_smp_processor_id+0x86)
:|   #func                 -39	  0.475  __ipipe_handle_irq+0x9 (reschedule_interrupt+0x3e)
:|   #func                 -38	  0.449  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   #func                 -38	  0.508  __ipipe_ack_apic+0x3 (__ipipe_dispatch_irq+0xa4)
:|   #func                 -37	  0.650  __ipipe_set_irq_pending+0x6 (__ipipe_dispatch_irq+0x19a)
:|   #func                 -37	  0.768  __ipipe_do_sync_pipeline+0x4 (__ipipe_sync_pipeline+0x1c)
:|   #end     0x000000fd   -36+   1.720  reschedule_interrupt+0x4f (debug_smp_processor_id+0x86)
:|   #begin   0x000000ef   -34	  0.433  apic_timer_interrupt+0x37 (debug_smp_processor_id+0x86)
:|   #func                 -34	  0.493  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   #func                 -33	  0.375  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   #func                 -33	  0.396  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   #func                 -33	  0.604  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  #*func                 -32	  0.793  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  #*func                 -31+   3.220  __xnlock_spin+0x9 (T.1249+0x47)
:|  #*func                 -28	  0.784  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  #*func                 -27	  0.705  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  #*func                 -26	  0.952  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  #*[ 2722] -<?>-   99   -25+   1.144  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  #*func                 -24	  0.607  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  #*event   tick@57      -24	  0.597  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  #*func                 -23	  0.727  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  #*func                 -22+   1.501  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  #*func                 -21+   1.055  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  #*func                 -20+   1.743  __xnlock_spin+0x9 (T.1349+0x55)
:|  #*[    0] -<?>-   -1   -18	  0.562  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  #*func                 -18+   1.407  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  #*func                 -16+   1.576  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  #*[ 2722] -<?>-   99   -15+   1.453  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  #*func                 -13	  0.842  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  #*func                 -12	  0.423  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  +*end     0x80000000   -12	  0.645  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  +*begin   0x80000001   -11	  0.586  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  +*end     0x80000001   -11	  0.480  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  +*begin   0x80000001   -10+   1.896  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   +*func                  -8	  0.449  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   +*func                  -8	  0.392  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  +*begin   0x80000001    -7	  0.552  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  +*end     0x80000001    -7	  0.429  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   +*func                  -6	  0.434  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  +*begin   0x80000001    -6	  0.409  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  +*end     0x80000001    -6	  0.409  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   +*func                  -5	  0.740  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   +*func                  -4	  0.722  xnshadow_sys_trace+0x6 (hisyscall_event+0x11b)
:   +*func                  -4	  0.475  ipipe_trace_frozen_reset+0x6 (xnshadow_sys_trace+0x5c)
:   +*func                  -3	  0.381  __ipipe_global_path_lock+0x9 (ipipe_trace_frozen_reset+0x1a)
:   +*func                  -3	  0.363  __ipipe_spin_lock_irqsave+0x5 (__ipipe_global_path_lock+0x1d)
:|  +*begin   0x80000001    -2+   1.884  hard_local_irq_save+0x16 (__ipipe_spin_lock_irqsave+0x11)
:|  #*func                  -1	  0.562  __ipipe_spin_unlock_irqcomplete+0x4 (__ipipe_global_path_unlock+0x62)
:|  +*end     0x80000001     0	  0.495  hard_local_irq_restore+0x15 (__ipipe_spin_unlock_irqcomplete+0x24)
<   +*freeze  0x000070c6     0	  0.551  xnshadow_sys_trace+0x65 (hisyscall_event+0x11b)
 |  +*begin   0x80000001     0	  0.486  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
 |  +*end     0x80000001     1	  0.472  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
 |  +*begin   0x80000001     1	  1.392  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
    +*func                   2	  0.409  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
    +*func                   3	  0.409  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
 |  +*begin   0x80000001     3	  0.591  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
 |  +*end     0x80000001     4	  0.499  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
    +*func                   4	  0.344  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
 |  +*begin   0x80000001     5	  0.438  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
 |  +*end     0x80000001     5	  0.000  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)

[max]
I-pipe worst-case tracing service on 3.5.7-trace/ipipe release #3
-------------------------------------------------------------
CPU: 0, Begin: 29765921826239 cycles, Trace Points: 8 (-10/+5), Length: 1922 us
Calibrated minimum trace-point overhead: 0.078 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
     #func                  -3	  0.254  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
 |   #begin   0x80000001    -3	  0.381  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
 |   #end     0x80000001    -2	  0.374  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
     #func                  -2	  0.307  default_idle+0x3 (cpu_idle+0x5d)
 |   #begin   0x80000001    -1	  0.325  debug_smp_processor_id+0x36 (default_idle+0xd)
 |   #end     0x80000001    -1	  0.323  debug_smp_processor_id+0x82 (default_idle+0xd)
 |   #begin   0x80000001    -1	  0.327  debug_smp_processor_id+0x36 (default_idle+0x1e)
 |   #end     0x80000001     0	  0.380  debug_smp_processor_id+0x82 (default_idle+0x1e)
     #func                   0	  0.249  __ipipe_halt_root+0x3 (default_idle+0x48)
 |   #begin   0x80000000     0	  0.334  __ipipe_halt_root+0x1a (default_idle+0x48)
>|   +end     0x8000000e     0! 1920.059  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +func                1920	  0.417  __ipipe_handle_irq+0x9 (reschedule_interrupt+0x3e)
:|   +func                1920	  0.477  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                1920	  0.398  __ipipe_ack_apic+0x3 (__ipipe_dispatch_irq+0xa4)
:|   +func                1921	  0.492  __ipipe_set_irq_pending+0x6 (__ipipe_dispatch_irq+0x19a)
:|   +func                1921	  0.419  __ipipe_do_sync_pipeline+0x4 (__ipipe_sync_pipeline+0x1c)
:|   +func                1922	  0.438  __ipipe_do_sync_stage+0x9 (__ipipe_do_sync_pipeline+0x63)
<|   #end     0x80000000  1922	  0.369  hard_local_irq_enable+0x14 (__ipipe_do_sync_stage+0xbd)
     #func                1923	  0.322  __ipipe_do_IRQ+0x5 (__ipipe_do_sync_stage+0x137)
     #func                1923	  0.354  __ipipe_get_ioapic_irq_vector+0x3 (__ipipe_do_IRQ+0x1d)
     #func                1923	  0.337  smp_reschedule_interrupt+0x3 (__ipipe_do_IRQ+0x42)
     #func                1924	  0.376  scheduler_ipi+0x4 (smp_reschedule_interrupt+0x14)
 |   #begin   0x80000001  1924	  0.000  debug_smp_processor_id+0x36 (scheduler_ipi+0x13)
-------------- next part --------------
I-pipe trace results
--------------------


[parameters]
enable = 1
verbose = 1
pre_trace_points = 10
back_trace_points = 100
post_trace_points = 10


[frozen]
I-pipe frozen back-tracing service on 3.5.7-trace/ipipe release #3
------------------------------------------------------------
CPU: 0, Freeze: 1144846449662 cycles, Trace Points: 100 (+10)
Calibrated minimum trace-point overhead: 0.078 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
:   + func                -139	  0.282  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -139	  0.406  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -139	  0.328  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -138	  0.283  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -138	  0.335  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -138	  0.306  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -137	  0.305  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -137	  0.255  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -137	  0.265  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -136	  0.276  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -136	  0.479  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -136	  0.390  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -135	  0.461  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1187] -<?>-   99  -135	  0.313  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -135	  0.686  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -134	  0.706  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -133	  0.834  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -132	  0.483  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -132	  0.744  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -131	  0.352  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -131	  0.321  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -130	  0.336  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -130	  0.336  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -130	  0.323  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -129	  0.347  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -129	  0.325  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -129	  0.320  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -128	  0.325  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -128	  0.308  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -128	  0.263  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -128	  0.260  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -127	  0.371  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -127	  0.307  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -127	  0.260  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -126	  0.325  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -126	  0.401  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -126	  0.316  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -125	  0.352  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -125	  0.320  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -125	  0.281  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -124	  0.329  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -124	  0.342  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -124	  0.308  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -123	  0.278  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -123	  0.329  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -123	  0.327  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -122	  0.254  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -122	  0.262  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -122	  0.373  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -122	  0.320  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -121	  0.260  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -121	  0.322  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -121	  0.326  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -120	  0.321  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -120	  0.383  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -120	  0.261  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -119	  0.324  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -119!  68.058  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef   -51	  0.311  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                 -51	  0.362  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                 -50	  0.273  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                 -50	  0.296  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                 -50	  0.441  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                 -49	  0.567  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                 -49+   2.264  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                 -46	  0.364  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                 -46	  0.452  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1187] -<?>-   99   -46	  0.696  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                 -45	  0.388  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@45      -45	  0.384  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                 -44	  0.428  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                 -44+   1.980  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                 -42+   2.429  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # func                 -39!  21.147  __xnlock_spin+0x9 (T.1349+0x55)
:|  # [    0] -<?>-   -1   -18	  0.740  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                 -17+   1.250  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                 -16+   1.489  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1187] -<?>-   99   -15+   1.301  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                 -13	  0.806  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                 -13	  0.463  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000   -12	  0.654  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001   -11	  0.519  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001   -11	  0.445  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001   -10+   2.091  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                  -8	  0.417  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                  -8	  0.384  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001    -8	  0.549  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001    -7	  0.368  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                  -7	  0.381  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001    -6	  0.440  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001    -6	  0.403  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                  -5	  0.512  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                  -5+   1.265  xnshadow_sys_trace+0x6 (hisyscall_event+0x11b)
:   + func                  -4	  0.546  ipipe_trace_frozen_reset+0x6 (xnshadow_sys_trace+0x5c)
:   + func                  -3	  0.376  __ipipe_global_path_lock+0x9 (ipipe_trace_frozen_reset+0x1a)
:   + func                  -3	  0.392  __ipipe_spin_lock_irqsave+0x5 (__ipipe_global_path_lock+0x1d)
:|  + begin   0x80000001    -2+   1.843  hard_local_irq_save+0x16 (__ipipe_spin_lock_irqsave+0x11)
:|  # func                  -1	  0.575  __ipipe_spin_unlock_irqcomplete+0x4 (__ipipe_global_path_unlock+0x62)
:|  + end     0x80000001     0	  0.433  hard_local_irq_restore+0x15 (__ipipe_spin_unlock_irqcomplete+0x24)
<   + freeze  0x00009e32     0	  0.525  xnshadow_sys_trace+0x65 (hisyscall_event+0x11b)
 |  + begin   0x80000001     0	  0.536  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
 |  + end     0x80000001     1	  0.444  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
 |  + begin   0x80000001     1	  1.467  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
    + func                   2	  0.390  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
    + func                   3	  0.385  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
 |  + begin   0x80000001     3	  0.519  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
 |  + end     0x80000001     4	  0.414  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
    + func                   4	  0.371  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
 |  + begin   0x80000001     5	  0.451  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
 |  + end     0x80000001     5	  0.000  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)


[max]
I-pipe worst-case tracing service on 3.5.7-trace/ipipe release #3
-------------------------------------------------------------
CPU: 0, Begin: 265702610058 cycles, Trace Points: 17 (-10/+5), Length: 3861 us
Calibrated minimum trace-point overhead: 0.078 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
     #func                  -4	  0.381  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
 |   #begin   0x80000001    -4	  0.514  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
 |   #end     0x80000001    -3	  0.528  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
     #func                  -3	  0.395  default_idle+0x3 (cpu_idle+0x5d)
 |   #begin   0x80000001    -2	  0.448  debug_smp_processor_id+0x36 (default_idle+0xd)
 |   #end     0x80000001    -2	  0.475  debug_smp_processor_id+0x82 (default_idle+0xd)
 |   #begin   0x80000001    -1	  0.458  debug_smp_processor_id+0x36 (default_idle+0x1e)
 |   #end     0x80000001    -1	  0.599  debug_smp_processor_id+0x82 (default_idle+0x1e)
     #func                   0	  0.378  __ipipe_halt_root+0x3 (default_idle+0x48)
 |   #begin   0x80000000     0	  0.477  __ipipe_halt_root+0x1a (default_idle+0x48)
>|   +end     0x8000000e     0! 3849.338  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +func                3849	  0.670  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                3850	  0.435  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                3850	  0.439  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                3850	  0.967  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                3851	  0.925  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                3852+   2.877  __xnlock_spin+0x9 (T.1249+0x47)
:|  # func                3855	  0.555  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                3856	  0.468  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@972129 3856	  0.396  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                3857	  0.408  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                3857+   1.316  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                3858	  0.427  xnintr_host_tick+0x4 (xnintr_clock_handler+0x151)
:|  # func                3859	  0.881  __ipipe_set_irq_pending+0x6 (xnintr_host_tick+0x50)
:|   +func                3860	  0.729  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +func                3860	  0.653  __ipipe_do_sync_stage+0x9 (__ipipe_do_sync_pipeline+0x63)
<|   #end     0x80000000  3861	  0.682  hard_local_irq_enable+0x14 (__ipipe_do_sync_stage+0xbd)
     #func                3862	  0.444  __ipipe_do_IRQ+0x5 (__ipipe_do_sync_stage+0x137)
     #func                3862	  0.487  __ipipe_get_ioapic_irq_vector+0x3 (__ipipe_do_IRQ+0x1d)
     #func                3863	  0.417  smp_apic_timer_interrupt+0x5 (__ipipe_do_IRQ+0x42)
     #func                3863	  0.470  irq_enter+0x4 (smp_apic_timer_interrupt+0x21)
 |   #begin   0x80000001  3863	  0.000  debug_smp_processor_id+0x36 (irq_enter+0xe)
-------------- next part --------------
I-pipe trace results
--------------------


[parameters]
enable = 1
verbose = 1
pre_trace_points = 10
back_trace_points = 100
post_trace_points = 10


[frozen]
I-pipe frozen back-tracing service on 3.5.7-trace/ipipe release #3
------------------------------------------------------------
CPU: 0, Freeze: 2155918028459 cycles, Trace Points: 100 (+10)
Calibrated minimum trace-point overhead: 0.078 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
:|  # func                -123	  0.345  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -123	  0.394  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1205] -<?>-   99  -122	  0.314  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -122	  0.636  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -121	  0.710  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -121	  0.863  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -120	  0.478  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -119	  0.740  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -119	  0.335  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -118	  0.346  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -118	  0.330  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -118	  0.335  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -117	  0.337  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -117	  0.341  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -116	  0.320  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -116	  0.340  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -116	  0.315  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -116	  0.312  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -115	  0.288  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -115	  0.263  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -115	  0.369  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -114	  0.322  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -114	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -114	  0.317  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -113	  0.415  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -113	  0.299  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -113	  0.324  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -112	  0.322  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -112	  0.300  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -112	  0.322  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -111	  0.321  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -111	  0.310  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -111	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -111	  0.332  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -110	  0.321  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -110	  0.262  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -110	  0.249  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -109	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -109	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -109	  0.266  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -108	  0.317  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -108	  0.314  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -108	  0.347  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -107	  0.379  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -107	  0.259  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -107	  0.334  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -106!  68.184  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef   -38	  0.326  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                 -38	  0.355  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                 -38+   2.057  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                 -36	  0.478  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                 -35	  0.560  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                 -34	  0.622  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                 -34	  0.378  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                 -33	  0.344  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                 -33	  0.437  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1205] -<?>-   99   -33	  0.640  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                 -32	  0.518  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-31     -32	  0.338  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                 -31	  0.747  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                 -30	  0.627  ipipe_raise_irq+0x8 (ipipe_timer_set+0x82)
:|  # func                 -30	  0.948  __ipipe_handle_irq+0x9 (ipipe_raise_irq+0x2b)
:|  # func                 -29	  0.899  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|  # func                 -28+   1.301  __ipipe_set_irq_pending+0x6 (__ipipe_dispatch_irq+0x112)
:|  # func                 -27	  0.653  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # func                 -26+   6.431  __xnlock_spin+0x9 (T.1349+0x55)
:|  # [    0] -<?>-   -1   -20	  0.412  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                 -19	  0.828  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                 -18+   1.197  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1205] -<?>-   99   -17	  0.793  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                 -16	  0.626  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                 -16	  0.614  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + func                 -15	  0.707  __ipipe_do_sync_stage+0x9 (__ipipe_sync_pipeline+0x2e)
:|  # func                 -14	  0.639  xnintr_clock_handler+0x5 (__ipipe_do_sync_stage+0xd5)
:|  # func                 -14	  0.422  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                 -13	  0.643  xnsched_watchdog_handler+0x5 (xntimer_tick_aperiodic+0x78)
:|  # func                 -13	  0.388  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@58      -12	  0.379  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                 -12	  0.425  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                 -11	  0.852  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  + end     0x80000000   -11	  0.680  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001   -10	  0.562  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001    -9	  0.456  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001    -9+   1.795  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                  -7	  0.398  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                  -7	  0.408  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001    -6	  0.524  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001    -6	  0.392  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                  -5	  0.373  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001    -5	  0.391  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001    -5	  0.423  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                  -4	  0.567  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                  -4	  0.456  xnshadow_sys_trace+0x6 (hisyscall_event+0x11b)
:   + func                  -3	  0.395  ipipe_trace_frozen_reset+0x6 (xnshadow_sys_trace+0x5c)
:   + func                  -3	  0.384  __ipipe_global_path_lock+0x9 (ipipe_trace_frozen_reset+0x1a)
:   + func                  -2+   1.048  __ipipe_spin_lock_irqsave+0x5 (__ipipe_global_path_lock+0x1d)
:|  + begin   0x80000001    -1+   1.176  hard_local_irq_save+0x16 (__ipipe_spin_lock_irqsave+0x11)
:|  # func                   0	  0.367  __ipipe_spin_unlock_irqcomplete+0x4 (__ipipe_global_path_unlock+0x62)
:|  + end     0x80000001     0	  0.333  hard_local_irq_restore+0x15 (__ipipe_spin_unlock_irqcomplete+0x24)
<   + freeze  0x00007222     0	  0.356  xnshadow_sys_trace+0x65 (hisyscall_event+0x11b)
 |  + begin   0x80000001     0	  0.353  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
 |  + end     0x80000001     0	  0.378  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
 |  + begin   0x80000001     1	  1.140  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
    + func                   2	  0.256  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
    + func                   2	  0.335  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
 |  + begin   0x80000001     2	  0.371  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
 |  + end     0x80000001     3	  0.305  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
    + func                   3	  0.253  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
 |  + begin   0x80000001     3	  0.303  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
 |  + end     0x80000001     4	  0.000  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)


[max]
I-pipe worst-case tracing service on 3.5.7-trace/ipipe release #3
-------------------------------------------------------------
CPU: 0, Begin: 1681313869013 cycles, Trace Points: 8 (-10/+5), Length: 3884 us
Calibrated minimum trace-point overhead: 0.078 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
     #func                  -4	  0.333  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
 |   #begin   0x80000001    -3	  0.449  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
 |   #end     0x80000001    -3	  0.431  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
     #func                  -2	  0.426  default_idle+0x3 (cpu_idle+0x5d)
 |   #begin   0x80000001    -2	  0.388  debug_smp_processor_id+0x36 (default_idle+0xd)
 |   #end     0x80000001    -2	  0.412  debug_smp_processor_id+0x82 (default_idle+0xd)
 |   #begin   0x80000001    -1	  0.434  debug_smp_processor_id+0x36 (default_idle+0x1e)
 |   #end     0x80000001    -1	  0.461  debug_smp_processor_id+0x82 (default_idle+0x1e)
     #func                   0	  0.353  __ipipe_halt_root+0x3 (default_idle+0x48)
 |   #begin   0x80000000     0	  0.443  __ipipe_halt_root+0x1a (default_idle+0x48)
>|   +end     0x8000000e     0! 3880.483  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +func                3880	  0.532  __ipipe_handle_irq+0x9 (reschedule_interrupt+0x3e)
:|   +func                3881	  0.422  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                3881	  0.605  __ipipe_ack_apic+0x3 (__ipipe_dispatch_irq+0xa4)
:|   +func                3882	  0.756  __ipipe_set_irq_pending+0x6 (__ipipe_dispatch_irq+0x19a)
:|   +func                3882	  0.689  __ipipe_do_sync_pipeline+0x4 (__ipipe_sync_pipeline+0x1c)
:|   +func                3883	  0.545  __ipipe_do_sync_stage+0x9 (__ipipe_do_sync_pipeline+0x63)
<|   #end     0x80000000  3884	  0.600  hard_local_irq_enable+0x14 (__ipipe_do_sync_stage+0xbd)
     #func                3884	  0.393  __ipipe_do_IRQ+0x5 (__ipipe_do_sync_stage+0x137)
     #func                3885	  0.481  __ipipe_get_ioapic_irq_vector+0x3 (__ipipe_do_IRQ+0x1d)
     #func                3885	  0.621  smp_reschedule_interrupt+0x3 (__ipipe_do_IRQ+0x42)
     #func                3886	  0.383  scheduler_ipi+0x4 (smp_reschedule_interrupt+0x14)
 |   #begin   0x80000001  3886	  0.000  debug_smp_processor_id+0x36 (scheduler_ipi+0x13)

^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: [Xenomai] Decrease Latency (below 10 us) on x32 or x32_64?
  2013-03-26 10:18   ` Manuel Huber
@ 2013-03-26 11:57     ` Gilles Chanteperdrix
  2013-03-28 10:06       ` Manuel Huber
  0 siblings, 1 reply; 12+ messages in thread
From: Gilles Chanteperdrix @ 2013-03-26 11:57 UTC (permalink / raw)
  To: Manuel Huber; +Cc: xenomai

On 03/26/2013 11:18 AM, Manuel Huber wrote:

> Hello!
> 
> Sorry for the delay. I have re-compiled the Kernel with the I-pipe
> tracer enabled, and I disabled the HPET. Then, I tried to reset the
> tracer by writing 0 to /proc/ipipe/trace/frozen and some string to
> /proc/ipipe/trace/max. Then I started the latency program with the -f
> option for some minutes and afterwards captured the variables in
> /proc/ipipe/trace/. One test has been made in single-user mode and
> without the nouveau driver (plain-vga_300.txt) and the other trace has
> been made in normal multi-user mode with gdm running (and the nouveau
> driver; gui_300.txt). There is one trace without any USB-device
> attached (plain-vga_300_no_usb.txt), but I'm not sure if that makes
> any difference.
> 
> I hope I used the I-pipe tracer correctly. I'm sorry to bother you
> again, but I can't interpret the results :( Maybe you could interpret
> the trace, if you have time for it...


The traces are too short. Try:
echo 1000 > /proc/ipipe/trace/back_trace_points

There should be at least a "tick@" trace indicating the time when the
timer was supposed to tick and when it did not, so that we have an idea
of the latency.

What is the period you use for the latency test?

-- 
                                                                Gilles.


^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: [Xenomai] Decrease Latency (below 10 us) on x32 or x32_64?
  2013-03-26 11:57     ` Gilles Chanteperdrix
@ 2013-03-28 10:06       ` Manuel Huber
  2013-03-28 12:46         ` Gilles Chanteperdrix
  0 siblings, 1 reply; 12+ messages in thread
From: Manuel Huber @ 2013-03-28 10:06 UTC (permalink / raw)
  To: Gilles Chanteperdrix, xenomai

On 2013-03-26 12:57, Gilles Chanteperdrix wrote:
> On 03/26/2013 11:18 AM, Manuel Huber wrote:
>
>> Hello!
>>
>> Sorry for the delay. I have re-compiled the Kernel with the I-pipe
>> tracer enabled, and I disabled the HPET. Then, I tried to reset the
>> tracer by writing 0 to /proc/ipipe/trace/frozen and some string to
>> /proc/ipipe/trace/max. Then I started the latency program with the -f
>> option for some minutes and afterwards captured the variables in
>> /proc/ipipe/trace/. One test has been made in single-user mode and
>> without the nouveau driver (plain-vga_300.txt) and the other trace has
>> been made in normal multi-user mode with gdm running (and the nouveau
>> driver; gui_300.txt). There is one trace without any USB-device
>> attached (plain-vga_300_no_usb.txt), but I'm not sure if that makes
>> any difference.
>>
>> I hope I used the I-pipe tracer correctly. I'm sorry to bother you
>> again, but I can't interpret the results :( Maybe you could interpret
>> the trace, if you have time for it...
>
> The traces are too short. Try:
> echo 1000 > /proc/ipipe/trace/back_trace_points
>
> There should be at least a "tick@" trace indicating the time when the
> timer was supposed to tick and when it did not, so that we have an idea
> of the latency.
>
> What is the period you use for the latency test?
>
Hello!

Sorry, I have run the same tests again, just with back_trace_points
set to 1000. I've run the latency tool for 5 minutes with a period of
100 us (default).

I don't think it's related, but xeno-test fails on the machine, and I
think it's because of CONFIG_XENO_OPT_SYS_HEAPSZ. I have multiplied it
with a factor of 6 (as described here:
http://osdir.com/ml/linux.real-time.xenomai.users/2007-03/msg00251.html).
I will run the tests again after compiling the kernel and report if
there is significant change (or if you think it could have influenced
the latency measurement).

Thanks again for your help!

-------------- next part --------------
I-pipe trace results
--------------------
name: 'gui_300'

[parameters]
enable = 1
verbose = 1
pre_trace_points = 10
back_trace_points = 1000
post_trace_points = 10


[frozen]
I-pipe frozen back-tracing service on 3.5.7-trace/ipipe release #3
------------------------------------------------------------
CPU: 0, Freeze: 34406236736593 cycles, Trace Points: 1000 (+10)
Calibrated minimum trace-point overhead: 0.078 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
:|   #begin   0x80000001  -511	  0.338  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -511	  0.299  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -511	  0.276  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -510	  0.256  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -510	  0.406  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -510	  0.318  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -509	  0.258  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -509	  0.310  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -509	  0.427  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -508	  0.313  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -508	  0.356  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -508	  0.313  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -507	  0.266  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -507	  0.323  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -507	  0.344  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -507	  0.335  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -506	  0.265  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -506	  0.328  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -506	  0.327  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -505	  0.262  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -505	  0.255  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -505	  0.373  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -504	  0.327  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -504	  0.269  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -504	  0.319  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -503	  0.317  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -503	  0.317  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -503	  0.388  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -502	  0.260  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -502	  0.332  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -502!  67.132  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -435	  0.338  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -434	  0.410  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -434	  0.335  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -434	  0.291  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -433	  0.463  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -433	  0.574  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -432	  0.407  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -432	  0.313  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -432	  0.323  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 2447] -<?>-   99  -431	  0.427  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -431	  0.304  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-337   -431	  0.295  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -430	  0.293  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -430	  0.584  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -429	  0.493  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -429	  0.287  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -429	  0.891  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -428	  0.933  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 2447] -<?>-   99  -427	  0.666  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -426	  0.450  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -426	  0.297  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -425	  0.489  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -425	  0.432  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -424	  0.363  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -424+   1.583  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -422	  0.279  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -422	  0.312  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -422	  0.393  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -421	  0.312  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -421	  0.283  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -421	  0.337  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -421	  0.318  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -420	  0.329  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -420	  0.247  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -420	  0.249  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -419	  0.260  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -419	  0.484  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -419	  0.366  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -418	  0.367  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 2447] -<?>-   99  -418	  0.306  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -418	  0.921  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -417	  0.705  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -416	  0.848  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -415	  0.492  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -415	  0.747  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -414	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -414	  0.344  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -413	  0.315  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -413	  0.316  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -413	  0.327  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -412	  0.348  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -412	  0.323  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -412	  0.368  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -411	  0.325  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -411	  0.298  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -411	  0.254  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -410	  0.266  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -410	  0.374  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -410	  0.350  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -409	  0.254  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -409	  0.317  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -409	  0.427  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -408	  0.295  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -408	  0.385  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -408	  0.296  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -407	  0.304  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -407	  0.332  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -407	  0.360  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -406	  0.307  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -406	  0.268  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -406	  0.334  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -405	  0.325  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -405	  0.254  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -405	  0.257  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -405	  0.377  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -404	  0.317  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -404	  0.295  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -404	  0.332  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -403	  0.337  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -403	  0.329  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -403	  0.378  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -402	  0.237  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -402	  0.329  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -402!  67.062  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -335	  0.316  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -334	  0.378  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -334	  0.294  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -334	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -333	  0.437  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -333	  0.568  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -332	  0.367  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -332	  0.306  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -332	  0.335  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 2447] -<?>-   99  -331	  0.496  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -331	  0.292  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-237   -331	  0.242  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -330	  0.288  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -330	  0.567  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -329	  0.488  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -329	  0.270  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -329	  0.878  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -328	  0.922  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 2447] -<?>-   99  -327	  0.666  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -326	  0.474  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -326	  0.314  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -325	  0.504  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -325	  0.412  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -325	  0.387  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -324+   1.665  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -322	  0.291  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -322	  0.363  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -322	  0.417  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -321	  0.312  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -321	  0.283  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -321	  0.332  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -320	  0.313  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -320	  0.298  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -320	  0.260  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -320	  0.263  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -319	  0.262  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -319	  0.490  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -319	  0.366  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -318	  0.381  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 2447] -<?>-   99  -318	  0.305  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -318	  0.890  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -317	  0.712  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -316	  0.830  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -315	  0.508  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -315	  0.739  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -314	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -314	  0.312  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -313	  0.329  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -313	  0.335  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -313	  0.342  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -312	  0.393  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -312	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -311	  0.334  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -311	  0.339  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -311	  0.299  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -310	  0.276  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -310	  0.264  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -310	  0.371  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -310	  0.318  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -309	  0.258  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -309	  0.309  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -309	  0.431  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -308	  0.304  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -308	  0.351  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -308	  0.313  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -307	  0.266  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -307	  0.315  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -307	  0.341  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -306	  0.304  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -306	  0.268  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -306	  0.326  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -305	  0.316  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -305	  0.256  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -305	  0.256  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -305	  0.373  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -304	  0.327  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -304	  0.269  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -304	  0.319  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -303	  0.317  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -303	  0.316  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -303	  0.388  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -302	  0.265  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -302	  0.333  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -302+   6.409  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000fd  -295	  0.301  reschedule_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -295	  0.437  __ipipe_handle_irq+0x9 (reschedule_interrupt+0x3e)
:|   +func                -295	  0.481  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -294	  0.430  __ipipe_ack_apic+0x3 (__ipipe_dispatch_irq+0xa4)
:|   +func                -294	  0.554  __ipipe_set_irq_pending+0x6 (__ipipe_dispatch_irq+0x19a)
:|   +func                -293	  0.381  __ipipe_do_sync_pipeline+0x4 (__ipipe_sync_pipeline+0x1c)
:|   +func                -293	  0.410  __ipipe_do_sync_stage+0x9 (__ipipe_do_sync_pipeline+0x63)
:|   #end     0x80000000  -292	  0.344  hard_local_irq_enable+0x14 (__ipipe_do_sync_stage+0xbd)
:    #func                -292	  0.284  __ipipe_do_IRQ+0x5 (__ipipe_do_sync_stage+0x137)
:    #func                -292	  0.382  __ipipe_get_ioapic_irq_vector+0x3 (__ipipe_do_IRQ+0x1d)
:    #func                -291	  0.269  smp_reschedule_interrupt+0x3 (__ipipe_do_IRQ+0x42)
:    #func                -291	  0.363  scheduler_ipi+0x4 (smp_reschedule_interrupt+0x14)
:|   #begin   0x80000001  -291	  0.355  debug_smp_processor_id+0x36 (scheduler_ipi+0x13)
:|   #end     0x80000001  -290	  0.326  debug_smp_processor_id+0x82 (scheduler_ipi+0x13)
:|   #begin   0x80000001  -290	  0.330  debug_smp_processor_id+0x36 (got_nohz_idle_kick+0x8)
:|   #end     0x80000001  -290+   1.115  debug_smp_processor_id+0x82 (got_nohz_idle_kick+0x8)
:|   +end     0x000000fd  -289	  0.825  reschedule_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -288	  0.346  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -287	  0.319  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -287	  0.314  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -287	  0.309  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -286	  0.349  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -286	  0.337  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -286	  0.300  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -285	  0.315  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -285	  0.321  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -285	  0.275  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -285	  0.294  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -284	  0.285  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -284	  0.367  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -284	  0.317  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -283	  0.249  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -283	  0.305  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -283	  0.437  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -282	  0.346  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                -282	  0.292  tick_nohz_idle_exit+0x9 (cpu_idle+0x70)
:|   +begin   0x80000001  -282	  0.347  debug_smp_processor_id+0x36 (tick_nohz_idle_exit+0x18)
:|   +end     0x80000001  -281	  0.391  debug_smp_processor_id+0x82 (tick_nohz_idle_exit+0x18)
:    #func                -281	  0.521  ktime_get+0x9 (tick_nohz_idle_exit+0x72)
:    #func                -280	  0.333  tick_nohz_stop_idle+0x4 (tick_nohz_idle_exit+0x88)
:    #func                -280	  0.314  update_ts_time_stats+0x9 (tick_nohz_stop_idle+0x20)
:    #func                -280	  0.463  nr_iowait_cpu+0x3 (update_ts_time_stats+0x31)
:    #func                -279	  0.269  select_nohz_load_balancer+0x4 (tick_nohz_idle_exit+0x99)
:|   #begin   0x80000001  -279	  0.323  debug_smp_processor_id+0x36 (select_nohz_load_balancer+0x10)
:|   #end     0x80000001  -279	  0.344  debug_smp_processor_id+0x82 (select_nohz_load_balancer+0x10)
:    #func                -278	  0.493  tick_do_update_jiffies64+0x9 (tick_nohz_idle_exit+0xa2)
:    #func                -278	  0.256  update_cpu_load_nohz+0x5 (tick_nohz_idle_exit+0xa7)
:|   #begin   0x80000001  -278	  0.329  debug_smp_processor_id+0x36 (update_cpu_load_nohz+0x14)
:|   #end     0x80000001  -277	  0.365  debug_smp_processor_id+0x82 (update_cpu_load_nohz+0x14)
:    #func                -277	  0.246  _raw_spin_lock+0x4 (update_cpu_load_nohz+0x2d)
:    #func                -277	  0.264  add_preempt_count+0x4 (_raw_spin_lock+0x15)
:    #func                -276	  0.268  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001  -276	  0.376  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -276	  0.376  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -275	  0.648  __update_cpu_load+0x9 (update_cpu_load_nohz+0x40)
:    #func                -275	  0.397  sched_avg_update+0x9 (__update_cpu_load+0xa5)
:    #func                -274	  0.248  _raw_spin_unlock+0x3 (update_cpu_load_nohz+0x47)
:    #func                -274	  0.434  sub_preempt_count+0x3 (_raw_spin_unlock+0x15)
:    #func                -274	  0.362  account_idle_ticks+0x3 (tick_nohz_idle_exit+0xbf)
:    #func                -273	  0.282  account_idle_time+0x6 (account_idle_ticks+0xd)
:|   #begin   0x80000001  -273	  0.324  debug_smp_processor_id+0x36 (account_idle_time+0x1c)
:|   #end     0x80000001  -273	  0.314  debug_smp_processor_id+0x82 (account_idle_time+0x1c)
:|   #begin   0x80000001  -272	  0.318  debug_smp_processor_id+0x36 (account_idle_time+0x28)
:|   #end     0x80000001  -272	  0.372  debug_smp_processor_id+0x82 (account_idle_time+0x28)
:    #func                -272	  0.273  calc_load_exit_idle+0x4 (tick_nohz_idle_exit+0xc4)
:|   #begin   0x80000001  -271	  0.333  debug_smp_processor_id+0x36 (calc_load_exit_idle+0x13)
:|   #end     0x80000001  -271	  0.387  debug_smp_processor_id+0x82 (calc_load_exit_idle+0x13)
:    #func                -271	  0.283  hrtimer_cancel+0x4 (tick_nohz_idle_exit+0xd8)
:    #func                -270	  0.249  hrtimer_try_to_cancel+0x8 (hrtimer_cancel+0x12)
:    #func                -270	  0.261  lock_hrtimer_base+0x6 (hrtimer_try_to_cancel+0x1a)
:    #func                -270	  0.314  _raw_spin_lock_irqsave+0x5 (lock_hrtimer_base+0x1d)
:    #func                -270	  0.244  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                -269	  0.262  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001  -269	  0.376  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -269	  0.393  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:|   #begin   0x80000001  -268	  0.320  debug_smp_processor_id+0x36 (remove_hrtimer+0x32)
:|   #end     0x80000001  -268	  0.296  debug_smp_processor_id+0x82 (remove_hrtimer+0x32)
:    #func                -268	  0.353  __remove_hrtimer+0x9 (remove_hrtimer+0x51)
:    #func                -267	  0.268  __ipipe_spin_unlock_debug+0x3 (unlock_hrtimer_base+0x10)
:    #func                -267	  0.253  _raw_spin_unlock_irqrestore+0x3 (unlock_hrtimer_base+0x1c)
:    #func                -267	  0.252  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -267	  0.260  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -266	  0.370  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -266	  0.321  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -266	  0.441  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    #func                -265	  0.376  hrtimer_forward+0xc (tick_nohz_idle_exit+0x101)
:    #func                -265	  0.396  ktime_divns+0xc (hrtimer_forward+0x82)
:    #func                -264	  0.304  ktime_add_safe+0x8 (hrtimer_forward+0xfb)
:    #func                -264	  0.315  ktime_add_safe+0x8 (hrtimer_forward+0x114)
:    #func                -264	  0.257  hrtimer_start_range_ns+0x3 (T.838+0x1d)
:    #func                -263	  0.248  __hrtimer_start_range_ns+0x9 (hrtimer_start_range_ns+0x15)
:    #func                -263	  0.245  lock_hrtimer_base+0x6 (__hrtimer_start_range_ns+0x1d)
:    #func                -263	  0.304  _raw_spin_lock_irqsave+0x5 (lock_hrtimer_base+0x1d)
:    #func                -263	  0.313  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                -262	  0.351  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001  -262	  0.378  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -262	  0.369  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:|   #begin   0x80000001  -261	  0.366  debug_smp_processor_id+0x36 (__hrtimer_start_range_ns+0x31)
:|   #end     0x80000001  -261	  0.323  debug_smp_processor_id+0x82 (__hrtimer_start_range_ns+0x31)
:    #func                -261	  0.315  ktime_add_safe+0x8 (hrtimer_set_expires_range_ns+0x2a)
:    #func                -260	  0.602  enqueue_hrtimer+0x6 (__hrtimer_start_range_ns+0x196)
:|   #begin   0x80000001  -260	  0.369  debug_smp_processor_id+0x36 (__hrtimer_start_range_ns+0x1ad)
:|   #end     0x80000001  -259	  0.309  debug_smp_processor_id+0x82 (__hrtimer_start_range_ns+0x1ad)
:|   #begin   0x80000001  -259	  0.324  debug_smp_processor_id+0x36 (__hrtimer_start_range_ns+0x1d3)
:|   #end     0x80000001  -259	  0.325  debug_smp_processor_id+0x82 (__hrtimer_start_range_ns+0x1d3)
:    #func                -258	  0.255  tick_program_event+0x4 (__hrtimer_start_range_ns+0x24d)
:    #func                -258	  0.275  clockevents_program_event+0x9 (tick_program_event+0x24)
:    #func                -258	  0.393  ktime_get+0x9 (clockevents_program_event+0x71)
:    #func                -257	  0.266  xnarch_next_htick_shot+0x5 (clockevents_program_event+0xd8)
:|   #begin   0x80000000  -257	  0.456  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  *#func                -257	  0.361  xntimer_start_aperiodic+0x9 (xnarch_next_htick_shot+0x42)
:|  *#func                -256	  0.610  xnarch_ns_to_tsc+0x9 (xntimer_start_aperiodic+0x78)
:|  *#func                -256	  0.291  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|   #end     0x80000000  -255	  0.354  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:    #func                -255	  0.285  __ipipe_spin_unlock_debug+0x3 (unlock_hrtimer_base+0x10)
:    #func                -255	  0.269  _raw_spin_unlock_irqrestore+0x3 (unlock_hrtimer_base+0x1c)
:    #func                -255	  0.260  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -254	  0.256  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -254	  0.376  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -254	  0.334  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -253	  0.337  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    #func                -253	  0.264  ipipe_unstall_root+0x3 (tick_nohz_idle_exit+0x13e)
:|   #begin   0x80000000  -253	  0.308  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -252	  0.403  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -252	  0.298  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                -252	  0.307  sub_preempt_count+0x3 (cpu_idle+0x7a)
:    +func                -251	  0.405  schedule+0x3 (cpu_idle+0x7f)
:    +func                -251	  0.262  __schedule+0x9 (schedule+0x18)
:    +func                -251	  0.251  add_preempt_count+0x4 (__schedule+0x33)
:    +func                -250	  0.246  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   +begin   0x80000001  -250	  0.371  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   +end     0x80000001  -250	  0.310  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:|   +begin   0x80000001  -250	  0.333  debug_smp_processor_id+0x36 (__schedule+0x38)
:|   +end     0x80000001  -249	  0.296  debug_smp_processor_id+0x82 (__schedule+0x38)
:    +func                -249	  0.343  rcu_note_context_switch+0x9 (__schedule+0x4a)
:    #func                -249	  0.273  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -248	  0.278  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -248	  0.394  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -248	  0.345  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -247	  0.251  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -247	  0.309  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -247	  0.414  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -246	  0.297  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                -246	  0.275  ipipe_root_only+0x5 (__schedule+0x83)
:|   +begin   0x80000001  -246	  0.395  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   +end     0x80000001  -245	  0.305  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    +func                -245	  0.284  _raw_spin_lock_irq+0x4 (__schedule+0xcc)
:    #func                -245	  0.268  add_preempt_count+0x4 (_raw_spin_lock_irq+0x28)
:    #func                -244	  0.260  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001  -244	  0.375  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -244	  0.422  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -243	  0.319  put_prev_task_idle+0x3 (__schedule+0x21a)
:    #func                -243	  0.310  pick_next_task_fair+0x9 (pick_next_task+0x1e)
:    #func                -243	  0.350  clear_buddies+0x4 (pick_next_task_fair+0x98)
:    #func                -242	  0.664  __dequeue_entity+0x5 (pick_next_task_fair+0xa7)
:|   #begin   0x80000000  -242	  0.706  __schedule+0x3e1 (schedule+0x18)
:|   #func                -241	  0.339  __switch_to+0x9 (__schedule+0x495)
:|   #func                -241	  0.923  __switch_to_xtra+0x9 (__switch_to+0x13f)
:|   #func                -240	  0.313  __ipipe_switch_tail+0x4 (__schedule+0x49f)
:|   #end     0x80000000  -239	  0.288  hard_local_irq_enable+0x14 (__ipipe_switch_tail+0x33)
:|   #begin   0x80000001  -239	  0.360  debug_smp_processor_id+0x36 (__schedule+0x4af)
:|   #end     0x80000001  -239	  0.302  debug_smp_processor_id+0x82 (__schedule+0x4af)
:    #func                -239	  0.276  finish_task_switch+0x9 (__schedule+0x4c1)
:    #func                -238	  0.268  _raw_spin_unlock_irq+0x3 (finish_task_switch+0x4c)
:    #func                -238	  0.261  ipipe_unstall_root+0x3 (_raw_spin_unlock_irq+0x10)
:|   #begin   0x80000000  -238	  0.310  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -237	  0.409  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -237	  0.269  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                -237+   1.103  sub_preempt_count+0x3 (_raw_spin_unlock_irq+0x1a)
:|   +begin   0x000000ef  -236	  0.326  apic_timer_interrupt+0x37 (__ipipe_trace+0x51d)
:|   +func                -235	  0.416  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -235	  0.273  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -235	  0.288  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -234	  0.447  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -234	  0.662  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -233	  0.358  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -233	  0.305  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -233	  0.346  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 2447] -<?>-   99  -232	  0.481  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -232	  0.302  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-137   -231	  0.258  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -231	  0.295  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -231	  0.571  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -230	  0.465  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -230	  0.279  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -230	  0.995  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -229	  0.297  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # func                -228+   1.283  __switch_to_xtra+0x9 (__switch_to+0x13f)
:|  # [ 2447] -<?>-   99  -227	  0.709  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -226	  0.473  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -226	  0.307  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -225	  0.549  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -225	  0.451  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -224	  0.344  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -224+   1.793  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -222	  0.261  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -222	  0.312  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -222	  0.401  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -221	  0.316  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -221	  0.285  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -221	  0.336  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -220	  0.303  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -220	  0.304  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -220	  0.265  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -220	  0.256  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -219	  0.267  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -219	  0.483  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -219	  0.402  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -218	  0.391  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 2447] -<?>-   99  -218	  0.304  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -217	  0.908  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -217	  0.293  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # func                -216	  0.999  __switch_to_xtra+0x9 (__switch_to+0x13f)
:|  # [ 1996] Xorg    -1  -215	  0.864  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -214	  0.499  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -214	  0.950  apic_timer_interrupt+0x4f (__ipipe_trace+0x51d)
:|   +begin   0x80000001  -213	  0.376  debug_smp_processor_id+0x36 (__schedule+0x4c6)
:|   +end     0x80000001  -213	  0.313  debug_smp_processor_id+0x82 (__schedule+0x4c6)
:    +func                -212	  0.341  sub_preempt_count+0x3 (__schedule+0x4f4)
:    +func                -212	  0.307  hrtimer_cancel+0x4 (schedule_hrtimeout_range_clock+0xa1)
:    +func                -212	  0.264  hrtimer_try_to_cancel+0x8 (hrtimer_cancel+0x12)
:    +func                -211	  0.261  lock_hrtimer_base+0x6 (hrtimer_try_to_cancel+0x1a)
:    +func                -211	  0.304  _raw_spin_lock_irqsave+0x5 (lock_hrtimer_base+0x1d)
:    #func                -211	  0.272  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                -210	  0.271  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001  -210	  0.402  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -210	  0.416  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:|   #begin   0x80000001  -209	  0.332  debug_smp_processor_id+0x36 (remove_hrtimer+0x32)
:|   #end     0x80000001  -209	  0.302  debug_smp_processor_id+0x82 (remove_hrtimer+0x32)
:    #func                -209	  0.430  __remove_hrtimer+0x9 (remove_hrtimer+0x51)
:    #func                -208	  0.281  __ipipe_spin_unlock_debug+0x3 (unlock_hrtimer_base+0x10)
:    #func                -208	  0.251  _raw_spin_unlock_irqrestore+0x3 (unlock_hrtimer_base+0x1c)
:    #func                -208	  0.266  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -208	  0.257  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -207	  0.368  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -207	  0.344  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -207	  0.265  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -206	  0.306  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -206	  0.406  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -206	  0.285  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                -205	  0.602  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    +func                -205	  0.344  fget_light+0x6 (do_select+0x2b3)
:    +func                -204	  0.315  sock_poll+0x4 (do_select+0x303)
:    +func                -204	  0.388  unix_poll+0x4 (sock_poll+0x14)
:    +func                -204	  0.263  fget_light+0x6 (do_select+0x2b3)
:    +func                -203	  0.261  sock_poll+0x4 (do_select+0x303)
:    +func                -203	  0.355  unix_poll+0x4 (sock_poll+0x14)
:    +func                -203	  0.368  fget_light+0x6 (do_select+0x2b3)
:    +func                -202	  0.263  tty_poll+0x9 (do_select+0x303)
:    +func                -202	  0.312  tty_paranoia_check+0x4 (tty_poll+0x2a)
:    +func                -202	  0.276  tty_ldisc_ref_wait+0x9 (tty_poll+0x37)
:    +func                -202	  0.269  tty_ldisc_try+0x6 (tty_ldisc_ref_wait+0x15)
:    +func                -201	  0.298  _raw_spin_lock_irqsave+0x5 (tty_ldisc_try+0x19)
:    #func                -201	  0.274  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                -201	  0.307  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001  -200	  0.375  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -200	  0.516  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -199	  0.290  __ipipe_spin_unlock_debug+0x3 (tty_ldisc_try+0x38)
:    #func                -199	  0.272  _raw_spin_unlock_irqrestore+0x3 (tty_ldisc_try+0x44)
:    #func                -199	  0.276  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -199	  0.276  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -198	  0.384  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -198	  0.290  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -198	  0.260  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -197	  0.314  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -197	  0.397  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -197	  0.292  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                -196	  0.307  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    +func                -196	  0.363  n_tty_poll+0x9 (tty_poll+0x51)
:    +func                -196	  0.275  tty_flush_to_ldisc+0x3 (n_tty_poll+0x5b)
:    +func                -195	  0.262  flush_work+0x6 (tty_flush_to_ldisc+0x12)
:    +func                -195	  0.250  start_flush_work+0x9 (flush_work+0x18)
:    +func                -195	  0.256  ipipe_root_only+0x5 (start_flush_work+0x1a)
:|   +begin   0x80000001  -195	  0.392  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   +end     0x80000001  -194	  0.289  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    +func                -194	  0.270  get_work_gcwq+0x3 (start_flush_work+0x21)
:    +func                -194	  0.280  _raw_spin_lock_irq+0x4 (start_flush_work+0x30)
:    #func                -193	  0.305  add_preempt_count+0x4 (_raw_spin_lock_irq+0x28)
:    #func                -193	  0.273  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001  -193	  0.450  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -192	  0.366  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -192	  0.255  _raw_spin_unlock_irq+0x3 (start_flush_work+0x96)
:    #func                -192	  0.263  ipipe_unstall_root+0x3 (_raw_spin_unlock_irq+0x10)
:|   #begin   0x80000000  -192	  0.298  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -191	  0.412  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -191	  0.276  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                -191	  0.359  sub_preempt_count+0x3 (_raw_spin_unlock_irq+0x1a)
:    +func                -190	  0.305  tty_hung_up_p+0x3 (n_tty_poll+0xca)
:    +func                -190	  0.287  tty_chars_in_buffer+0x3 (n_tty_poll+0x11a)
:    +func                -190	  0.259  con_chars_in_buffer+0x3 (tty_chars_in_buffer+0x1a)
:    +func                -189	  0.278  tty_write_room+0x3 (n_tty_poll+0x128)
:    +func                -189	  0.291  con_write_room+0x3 (tty_write_room+0x1d)
:    +func                -189	  0.270  tty_ldisc_deref+0x3 (tty_poll+0x5d)
:    +func                -189	  0.522  put_ldisc+0x5 (tty_ldisc_deref+0xd)
:    #func                -188	  0.297  ipipe_restore_root+0x4 (put_ldisc+0xbb)
:    #func                -188	  0.348  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -187	  0.391  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -187	  0.296  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -187	  0.254  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -186	  0.315  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -186	  0.403  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -186	  0.286  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                -185	  0.283  __wake_up+0x8 (put_ldisc+0xcf)
:    +func                -185	  0.325  _raw_spin_lock_irqsave+0x5 (__wake_up+0x1a)
:    #func                -185	  0.261  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                -185	  0.274  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001  -184	  0.376  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -184	  0.344  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -184	  0.270  __wake_up_common+0x9 (__wake_up+0x2e)
:    #func                -183	  0.262  ipipe_root_only+0x5 (__wake_up_common+0x1b)
:|   #begin   0x80000001  -183	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -183	  0.307  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -182	  0.258  __ipipe_spin_unlock_debug+0x3 (__wake_up+0x35)
:    #func                -182	  0.258  _raw_spin_unlock_irqrestore+0x3 (__wake_up+0x3e)
:    #func                -182	  0.252  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -182	  0.263  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -181	  0.371  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -181	  0.327  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -181	  0.261  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -180	  0.313  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -180	  0.416  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -180	  0.288  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                -179	  0.313  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    +func                -179	  0.304  fget_light+0x6 (do_select+0x2b3)
:    +func                -179	  0.304  sock_poll+0x4 (do_select+0x303)
:    +func                -178	  0.390  unix_poll+0x4 (sock_poll+0x14)
:    +func                -178	  0.279  fget_light+0x6 (do_select+0x2b3)
:    +func                -178	  0.373  sock_poll+0x4 (do_select+0x303)
:    +func                -177	  0.386  datagram_poll+0x6 (sock_poll+0x14)
:    +func                -177	  0.281  fget_light+0x6 (do_select+0x2b3)
:    +func                -177	  0.325  sock_poll+0x4 (do_select+0x303)
:    +func                -176	  0.384  unix_poll+0x4 (sock_poll+0x14)
:    +func                -176	  0.273  fget_light+0x6 (do_select+0x2b3)
:    +func                -176	  0.276  sock_poll+0x4 (do_select+0x303)
:    +func                -175	  0.327  unix_poll+0x4 (sock_poll+0x14)
:    +func                -175	  0.270  fget_light+0x6 (do_select+0x2b3)
:    +func                -175	  0.259  sock_poll+0x4 (do_select+0x303)
:    +func                -175	  0.308  unix_poll+0x4 (sock_poll+0x14)
:    +func                -174	  0.264  fget_light+0x6 (do_select+0x2b3)
:    +func                -174	  0.258  sock_poll+0x4 (do_select+0x303)
:    +func                -174	  0.344  unix_poll+0x4 (sock_poll+0x14)
:    +func                -173	  0.261  fget_light+0x6 (do_select+0x2b3)
:    +func                -173	  0.263  sock_poll+0x4 (do_select+0x303)
:    +func                -173	  0.317  unix_poll+0x4 (sock_poll+0x14)
:    +func                -173	  0.268  fget_light+0x6 (do_select+0x2b3)
:    +func                -172	  0.256  sock_poll+0x4 (do_select+0x303)
:    +func                -172	  0.326  unix_poll+0x4 (sock_poll+0x14)
:    +func                -172	  0.261  fget_light+0x6 (do_select+0x2b3)
:    +func                -171	  0.258  sock_poll+0x4 (do_select+0x303)
:    +func                -171	  0.313  unix_poll+0x4 (sock_poll+0x14)
:    +func                -171	  0.273  fget_light+0x6 (do_select+0x2b3)
:    +func                -171	  0.272  sock_poll+0x4 (do_select+0x303)
:    +func                -170	  0.325  unix_poll+0x4 (sock_poll+0x14)
:    +func                -170	  0.270  fget_light+0x6 (do_select+0x2b3)
:    +func                -170	  0.258  sock_poll+0x4 (do_select+0x303)
:    +func                -169	  0.287  unix_poll+0x4 (sock_poll+0x14)
:    +func                -169	  0.282  fget_light+0x6 (do_select+0x2b3)
:    +func                -169	  0.281  sock_poll+0x4 (do_select+0x303)
:    +func                -169	  0.315  unix_poll+0x4 (sock_poll+0x14)
:    +func                -168	  0.273  fget_light+0x6 (do_select+0x2b3)
:    +func                -168	  0.268  sock_poll+0x4 (do_select+0x303)
:    +func                -168	  0.302  unix_poll+0x4 (sock_poll+0x14)
:    +func                -167	  0.276  fget_light+0x6 (do_select+0x2b3)
:    +func                -167	  0.250  sock_poll+0x4 (do_select+0x303)
:    +func                -167	  0.310  unix_poll+0x4 (sock_poll+0x14)
:    +func                -167	  0.260  fget_light+0x6 (do_select+0x2b3)
:    +func                -166	  0.271  sock_poll+0x4 (do_select+0x303)
:    +func                -166	  0.307  unix_poll+0x4 (sock_poll+0x14)
:    +func                -166	  0.271  fget_light+0x6 (do_select+0x2b3)
:    +func                -166	  0.257  sock_poll+0x4 (do_select+0x303)
:    +func                -165	  0.302  unix_poll+0x4 (sock_poll+0x14)
:    +func                -165	  0.276  fget_light+0x6 (do_select+0x2b3)
:    +func                -165	  0.251  sock_poll+0x4 (do_select+0x303)
:    +func                -164	  0.310  unix_poll+0x4 (sock_poll+0x14)
:    +func                -164	  0.259  fget_light+0x6 (do_select+0x2b3)
:    +func                -164	  0.263  sock_poll+0x4 (do_select+0x303)
:    +func                -164	  0.358  unix_poll+0x4 (sock_poll+0x14)
:    +func                -163	  0.298  _cond_resched+0x3 (do_select+0x3ed)
:    +func                -163	  0.292  fget_light+0x6 (do_select+0x2b3)
:    +func                -163	  0.259  sock_poll+0x4 (do_select+0x303)
:    +func                -162	  0.315  unix_poll+0x4 (sock_poll+0x14)
:    +func                -162	  0.269  fget_light+0x6 (do_select+0x2b3)
:    +func                -162	  0.261  sock_poll+0x4 (do_select+0x303)
:    +func                -162	  0.313  unix_poll+0x4 (sock_poll+0x14)
:    +func                -161	  0.259  fget_light+0x6 (do_select+0x2b3)
:    +func                -161	  0.291  sock_poll+0x4 (do_select+0x303)
:    +func                -161	  0.452  unix_poll+0x4 (sock_poll+0x14)
:    +func                -160	  0.267  fget_light+0x6 (do_select+0x2b3)
:    +func                -160	  0.304  sock_poll+0x4 (do_select+0x303)
:    +func                -160	  0.342  unix_poll+0x4 (sock_poll+0x14)
:    +func                -159	  0.260  fget_light+0x6 (do_select+0x2b3)
:    +func                -159	  0.257  sock_poll+0x4 (do_select+0x303)
:    +func                -159	  0.335  unix_poll+0x4 (sock_poll+0x14)
:    +func                -158	  0.263  fget_light+0x6 (do_select+0x2b3)
:    +func                -158	  0.254  sock_poll+0x4 (do_select+0x303)
:    +func                -158	  0.314  unix_poll+0x4 (sock_poll+0x14)
:    +func                -158	  0.265  fget_light+0x6 (do_select+0x2b3)
:    +func                -157	  0.260  sock_poll+0x4 (do_select+0x303)
:    +func                -157	  0.317  unix_poll+0x4 (sock_poll+0x14)
:    +func                -157	  0.266  fget_light+0x6 (do_select+0x2b3)
:    +func                -157	  0.265  sock_poll+0x4 (do_select+0x303)
:    +func                -156	  0.303  unix_poll+0x4 (sock_poll+0x14)
:    +func                -156	  0.263  fget_light+0x6 (do_select+0x2b3)
:    +func                -156	  0.266  sock_poll+0x4 (do_select+0x303)
:    +func                -155	  0.355  unix_poll+0x4 (sock_poll+0x14)
:    +func                -155	  0.327  _cond_resched+0x3 (do_select+0x3ed)
:    +func                -155	  0.287  poll_freewait+0x6 (do_select+0x4e3)
:    +func                -154	  0.310  free_poll_entry+0x4 (poll_freewait+0x23)
:    +func                -154	  0.265  remove_wait_queue+0x6 (free_poll_entry+0x16)
:    +func                -154	  0.310  _raw_spin_lock_irqsave+0x5 (remove_wait_queue+0x14)
:    #func                -154	  0.263  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                -153	  0.278  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001  -153	  0.368  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -153	  0.350  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -152	  0.307  __ipipe_spin_unlock_debug+0x3 (remove_wait_queue+0x36)
:    #func                -152	  0.292  _raw_spin_unlock_irqrestore+0x3 (remove_wait_queue+0x3f)
:    #func                -152	  0.276  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -151	  0.261  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -151	  0.413  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -151	  0.300  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -150	  0.256  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -150	  0.310  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -150	  0.428  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -149	  0.285  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                -149	  0.338  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    +func                -149	  0.429  fput+0x9 (free_poll_entry+0x1d)
:    +func                -148	  0.273  free_poll_entry+0x4 (poll_freewait+0x23)
:    +func                -148	  0.268  remove_wait_queue+0x6 (free_poll_entry+0x16)
:    +func                -148	  0.294  _raw_spin_lock_irqsave+0x5 (remove_wait_queue+0x14)
:    #func                -148	  0.270  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                -147	  0.307  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001  -147	  0.399  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -147	  0.358  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -146	  0.277  __ipipe_spin_unlock_debug+0x3 (remove_wait_queue+0x36)
:    #func                -146	  0.252  _raw_spin_unlock_irqrestore+0x3 (remove_wait_queue+0x3f)
:    #func                -146	  0.259  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -145	  0.261  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -145	  0.376  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -145	  0.300  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -144	  0.258  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -144	  0.307  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -144	  0.432  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -143	  0.280  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                -143	  0.270  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    +func                -143	  0.293  fput+0x9 (free_poll_entry+0x1d)
:    +func                -143	  0.279  free_poll_entry+0x4 (poll_freewait+0x23)
:    +func                -142	  0.266  remove_wait_queue+0x6 (free_poll_entry+0x16)
:    +func                -142	  0.311  _raw_spin_lock_irqsave+0x5 (remove_wait_queue+0x14)
:    #func                -142	  0.276  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                -142	  0.276  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001  -141	  0.391  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -141	  0.343  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -140	  0.271  __ipipe_spin_unlock_debug+0x3 (remove_wait_queue+0x36)
:    #func                -140	  0.255  _raw_spin_unlock_irqrestore+0x3 (remove_wait_queue+0x3f)
:    #func                -140	  0.264  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -140	  0.261  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -139	  0.374  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -139	  0.292  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -139	  0.267  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -139	  0.299  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -138	  0.414  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -138	  0.290  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                -138	  0.270  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    +func                -137	  0.382  fput+0x9 (free_poll_entry+0x1d)
:    +func                -137+   1.152  free_poll_entry+0x4 (poll_freewait+0x23)
:|   +begin   0x000000ef  -136	  0.319  apic_timer_interrupt+0x37 (ftrace_stub+0x0)
:|   +func                -135	  0.350  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -135	  0.285  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -135	  0.291  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -134	  0.456  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -134	  0.740  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -133	  0.362  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -133	  0.306  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -133	  0.347  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 2447] -<?>-   99  -132	  0.456  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -132	  0.304  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-37    -131	  0.260  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -131	  0.295  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -131	  0.600  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -130	  0.488  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [ 1996] Xorg    -1  -130	  0.277  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -130	  0.975  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -129	  0.377  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # func                -128+   1.254  __switch_to_xtra+0x9 (__switch_to+0x13f)
:|  # [ 2447] -<?>-   99  -127	  0.672  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -126	  0.491  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -126	  0.308  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -125	  0.543  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -125	  0.430  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -124+   3.173  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -121+   1.797  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -120	  0.278  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -119	  0.313  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -119	  0.405  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -119	  0.325  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -118	  0.276  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -118	  0.337  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -118	  0.292  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -117	  0.327  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -117	  0.259  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -117	  0.250  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -116	  0.259  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -116	  0.482  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -116	  0.395  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -115	  0.371  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 2447] -<?>-   99  -115	  0.305  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -115	  0.938  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -114	  0.329  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # func                -113	  0.989  __switch_to_xtra+0x9 (__switch_to+0x13f)
:|  # [ 1996] Xorg    -1  -112	  0.810  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -112	  0.495  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -111	  0.758  apic_timer_interrupt+0x4f (ftrace_stub+0x0)
:    +func                -110	  0.282  remove_wait_queue+0x6 (free_poll_entry+0x16)
:    +func                -110	  0.319  _raw_spin_lock_irqsave+0x5 (remove_wait_queue+0x14)
:    #func                -110	  0.275  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                -109	  0.310  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001  -109	  0.389  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -109	  0.339  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -108	  0.273  __ipipe_spin_unlock_debug+0x3 (remove_wait_queue+0x36)
:    #func                -108	  0.258  _raw_spin_unlock_irqrestore+0x3 (remove_wait_queue+0x3f)
:    #func                -108	  0.246  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -108	  0.251  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -107	  0.382  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -107	  0.294  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -107	  0.251  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -106	  0.305  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -106	  0.414  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -106	  0.291  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                -105	  0.307  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    +func                -105	  0.317  fput+0x9 (free_poll_entry+0x1d)
:    +func                -105	  0.278  free_poll_entry+0x4 (poll_freewait+0x23)
:    +func                -105	  0.269  remove_wait_queue+0x6 (free_poll_entry+0x16)
:    +func                -104	  0.294  _raw_spin_lock_irqsave+0x5 (remove_wait_queue+0x14)
:    #func                -104	  0.273  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                -104	  0.308  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001  -103	  0.396  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -103	  0.384  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -103	  0.276  __ipipe_spin_unlock_debug+0x3 (remove_wait_queue+0x36)
:    #func                -102	  0.252  _raw_spin_unlock_irqrestore+0x3 (remove_wait_queue+0x3f)
:    #func                -102	  0.264  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -102	  0.258  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -102	  0.371  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -101	  0.293  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -101	  0.267  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -101	  0.300  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -100	  0.415  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -100	  0.285  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                -100	  0.264  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    +func                 -99	  0.303  fput+0x9 (free_poll_entry+0x1d)
:    +func                 -99	  0.280  free_poll_entry+0x4 (poll_freewait+0x23)
:    +func                 -99	  0.267  remove_wait_queue+0x6 (free_poll_entry+0x16)
:    +func                 -99	  0.311  _raw_spin_lock_irqsave+0x5 (remove_wait_queue+0x14)
:    #func                 -98	  0.276  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                 -98	  0.276  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -98	  0.394  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -97	  0.337  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -97	  0.271  __ipipe_spin_unlock_debug+0x3 (remove_wait_queue+0x36)
:    #func                 -97	  0.255  _raw_spin_unlock_irqrestore+0x3 (remove_wait_queue+0x3f)
:    #func                 -96	  0.264  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -96	  0.267  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -96	  0.376  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -95	  0.285  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -95	  0.267  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000   -95	  0.299  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -95	  0.422  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -94	  0.285  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                 -94	  0.268  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    +func                 -94	  0.301  fput+0x9 (free_poll_entry+0x1d)
:    +func                 -93	  0.277  free_poll_entry+0x4 (poll_freewait+0x23)
:    +func                 -93	  0.264  remove_wait_queue+0x6 (free_poll_entry+0x16)
:    +func                 -93	  0.299  _raw_spin_lock_irqsave+0x5 (remove_wait_queue+0x14)
:    #func                 -92	  0.259  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                 -92	  0.275  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -92	  0.383  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -92	  0.350  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -91	  0.276  __ipipe_spin_unlock_debug+0x3 (remove_wait_queue+0x36)
:    #func                 -91	  0.252  _raw_spin_unlock_irqrestore+0x3 (remove_wait_queue+0x3f)
:    #func                 -91	  0.258  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -90	  0.261  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -90	  0.375  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -90	  0.300  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -90	  0.257  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000   -89	  0.295  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -89	  0.408  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -89	  0.281  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                 -88	  0.268  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    +func                 -88	  0.320  fput+0x9 (free_poll_entry+0x1d)
:    +func                 -88	  0.280  free_poll_entry+0x4 (poll_freewait+0x23)
:    +func                 -87	  0.269  remove_wait_queue+0x6 (free_poll_entry+0x16)
:    +func                 -87	  0.301  _raw_spin_lock_irqsave+0x5 (remove_wait_queue+0x14)
:    #func                 -87	  0.266  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                 -87	  0.310  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -86	  0.395  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -86	  0.343  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -86	  0.271  __ipipe_spin_unlock_debug+0x3 (remove_wait_queue+0x36)
:    #func                 -85	  0.255  _raw_spin_unlock_irqrestore+0x3 (remove_wait_queue+0x3f)
:    #func                 -85	  0.264  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -85	  0.267  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -84	  0.376  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -84	  0.285  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -84	  0.267  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000   -84	  0.298  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -83	  0.418  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -83	  0.281  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                 -83	  0.271  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    +func                 -82	  0.298  fput+0x9 (free_poll_entry+0x1d)
:    +func                 -82	  0.278  free_poll_entry+0x4 (poll_freewait+0x23)
:    +func                 -82	  0.267  remove_wait_queue+0x6 (free_poll_entry+0x16)
:    +func                 -81	  0.311  _raw_spin_lock_irqsave+0x5 (remove_wait_queue+0x14)
:    #func                 -81	  0.276  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                 -81	  0.308  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -81	  0.383  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -80	  0.350  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -80	  0.276  __ipipe_spin_unlock_debug+0x3 (remove_wait_queue+0x36)
:    #func                 -79	  0.254  _raw_spin_unlock_irqrestore+0x3 (remove_wait_queue+0x3f)
:    #func                 -79	  0.256  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -79	  0.263  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -79	  0.368  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -78	  0.300  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -78	  0.257  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000   -78	  0.295  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -77	  0.408  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -77	  0.281  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                 -77	  0.263  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    +func                 -77	  0.314  fput+0x9 (free_poll_entry+0x1d)
:    +func                 -76	  0.272  free_poll_entry+0x4 (poll_freewait+0x23)
:    +func                 -76	  0.269  remove_wait_queue+0x6 (free_poll_entry+0x16)
:    +func                 -76	  0.294  _raw_spin_lock_irqsave+0x5 (remove_wait_queue+0x14)
:    #func                 -75	  0.274  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                 -75	  0.271  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -75	  0.383  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -74	  0.354  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -74	  0.270  __ipipe_spin_unlock_debug+0x3 (remove_wait_queue+0x36)
:    #func                 -74	  0.250  _raw_spin_unlock_irqrestore+0x3 (remove_wait_queue+0x3f)
:    #func                 -74	  0.259  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -73	  0.255  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -73	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -73	  0.305  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -72	  0.255  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000   -72	  0.307  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -72	  0.417  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -71	  0.281  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                 -71	  0.281  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    +func                 -71	  0.299  fput+0x9 (free_poll_entry+0x1d)
:    +func                 -71	  0.268  free_poll_entry+0x4 (poll_freewait+0x23)
:    +func                 -70	  0.268  remove_wait_queue+0x6 (free_poll_entry+0x16)
:    +func                 -70	  0.311  _raw_spin_lock_irqsave+0x5 (remove_wait_queue+0x14)
:    #func                 -70	  0.271  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                 -69	  0.270  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -69	  0.394  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -69	  0.346  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -68	  0.276  __ipipe_spin_unlock_debug+0x3 (remove_wait_queue+0x36)
:    #func                 -68	  0.252  _raw_spin_unlock_irqrestore+0x3 (remove_wait_queue+0x3f)
:    #func                 -68	  0.259  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -68	  0.261  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -67	  0.376  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -67	  0.300  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -67	  0.256  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000   -66	  0.295  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -66	  0.408  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -66	  0.281  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                 -65	  0.268  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    +func                 -65	  0.305  fput+0x9 (free_poll_entry+0x1d)
:    +func                 -65	  0.270  free_poll_entry+0x4 (poll_freewait+0x23)
:    +func                 -65	  0.269  remove_wait_queue+0x6 (free_poll_entry+0x16)
:    +func                 -64	  0.294  _raw_spin_lock_irqsave+0x5 (remove_wait_queue+0x14)
:    #func                 -64	  0.274  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                 -64	  0.271  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -63	  0.383  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -63	  0.350  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -63	  0.276  __ipipe_spin_unlock_debug+0x3 (remove_wait_queue+0x36)
:    #func                 -62	  0.260  _raw_spin_unlock_irqrestore+0x3 (remove_wait_queue+0x3f)
:    #func                 -62	  0.254  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -62	  0.281  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -62	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -61	  0.292  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -61	  0.267  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000   -61	  0.299  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -60	  0.414  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -60	  0.288  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                 -60	  0.271  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    +func                 -59	  0.300  fput+0x9 (free_poll_entry+0x1d)
:    +func                 -59	  0.280  free_poll_entry+0x4 (poll_freewait+0x23)
:    +func                 -59	  0.267  remove_wait_queue+0x6 (free_poll_entry+0x16)
:    +func                 -59	  0.311  _raw_spin_lock_irqsave+0x5 (remove_wait_queue+0x14)
:    #func                 -58	  0.273  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                 -58	  0.267  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -58	  0.394  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -57	  0.362  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -57	  0.272  __ipipe_spin_unlock_debug+0x3 (remove_wait_queue+0x36)
:    #func                 -57	  0.255  _raw_spin_unlock_irqrestore+0x3 (remove_wait_queue+0x3f)
:    #func                 -56	  0.264  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -56	  0.267  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -56	  0.376  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -56	  0.285  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -55	  0.267  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000   -55	  0.299  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -55	  0.414  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -54	  0.284  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                 -54	  0.276  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    +func                 -54	  0.315  fput+0x9 (free_poll_entry+0x1d)
:    +func                 -53	  0.292  free_poll_entry+0x4 (poll_freewait+0x23)
:    +func                 -53	  0.269  remove_wait_queue+0x6 (free_poll_entry+0x16)
:    +func                 -53	  0.306  _raw_spin_lock_irqsave+0x5 (remove_wait_queue+0x14)
:    #func                 -53	  0.275  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                 -52	  0.271  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -52	  0.403  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -52	  0.343  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -51	  0.276  __ipipe_spin_unlock_debug+0x3 (remove_wait_queue+0x36)
:    #func                 -51	  0.267  _raw_spin_unlock_irqrestore+0x3 (remove_wait_queue+0x3f)
:    #func                 -51	  0.259  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -50	  0.264  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -50	  0.371  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -50	  0.300  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -50	  0.256  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000   -49	  0.295  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -49	  0.408  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -49	  0.281  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                 -48	  0.268  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    +func                 -48	  0.291  fput+0x9 (free_poll_entry+0x1d)
:    +func                 -48	  0.278  free_poll_entry+0x4 (poll_freewait+0x23)
:    +func                 -47	  0.269  remove_wait_queue+0x6 (free_poll_entry+0x16)
:    +func                 -47	  0.294  _raw_spin_lock_irqsave+0x5 (remove_wait_queue+0x14)
:    #func                 -47	  0.274  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                 -47	  0.271  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -46	  0.384  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -46	  0.350  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -46	  0.281  __ipipe_spin_unlock_debug+0x3 (remove_wait_queue+0x36)
:    #func                 -45	  0.263  _raw_spin_unlock_irqrestore+0x3 (remove_wait_queue+0x3f)
:    #func                 -45	  0.256  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -45	  0.285  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -45	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -44	  0.293  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -44	  0.267  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000   -44	  0.299  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -43	  0.414  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -43	  0.281  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                 -43	  0.270  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    +func                 -42	  0.300  fput+0x9 (free_poll_entry+0x1d)
:    +func                 -42	  0.280  free_poll_entry+0x4 (poll_freewait+0x23)
:    +func                 -42	  0.267  remove_wait_queue+0x6 (free_poll_entry+0x16)
:    +func                 -41	  0.311  _raw_spin_lock_irqsave+0x5 (remove_wait_queue+0x14)
:    #func                 -41	  0.276  add_preempt_count+0x4 (_raw_spin_lock_irqsave+0x49)
:    #func                 -41	  0.276  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -41	  0.393  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -40	  0.343  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -40	  0.271  __ipipe_spin_unlock_debug+0x3 (remove_wait_queue+0x36)
:    #func                 -40	  0.255  _raw_spin_unlock_irqrestore+0x3 (remove_wait_queue+0x3f)
:    #func                 -39	  0.264  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -39	  0.267  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -39	  0.376  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -38	  0.285  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -38	  0.267  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000   -38	  0.299  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -38	  0.408  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -37	  0.281  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                 -37	  0.268  sub_preempt_count+0x3 (_raw_spin_unlock_irqrestore+0x1e)
:    +func                 -37+   1.106  fput+0x9 (free_poll_entry+0x1d)
:|   +begin   0x000000ef   -36	  0.321  apic_timer_interrupt+0x37 (__ipipe_trace+0x51d)
:|   +func                 -35	  0.373  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                 -35	  0.271  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                 -35	  0.292  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                 -34	  0.459  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                 -34	  0.754  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                 -33	  0.361  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                 -33	  0.297  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                 -32	  0.328  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 2447] -<?>-   99   -32	  0.459  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                 -32	  0.292  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@62      -31	  0.260  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                 -31	  0.324  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                 -31+   8.732  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                 -22+   3.484  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # func                 -19+   5.443  __xnlock_spin+0x9 (T.1349+0x55)
:|  # [ 1996] Xorg    -1   -13	  0.211  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                 -13	  0.701  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                 -12	  0.235  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # func                 -12	  0.938  __switch_to_xtra+0x9 (__switch_to+0x13f)
:|  # [ 2447] -<?>-   99   -11	  0.548  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                 -10	  0.354  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                 -10	  0.242  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000   -10	  0.387  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001    -9	  0.341  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001    -9	  0.267  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001    -9+   2.918  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                  -6	  0.220  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                  -6	  0.241  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001    -5	  0.299  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001    -5	  0.231  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                  -5	  0.213  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001    -5	  0.250  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001    -4	  0.256  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                  -4+   1.345  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                  -3	  0.677  xnshadow_sys_trace+0x6 (hisyscall_event+0x11b)
:   + func                  -2	  0.301  ipipe_trace_frozen_reset+0x6 (xnshadow_sys_trace+0x5c)
:   + func                  -2	  0.252  __ipipe_global_path_lock+0x9 (ipipe_trace_frozen_reset+0x1a)
:   + func                  -2	  0.198  __ipipe_spin_lock_irqsave+0x5 (__ipipe_global_path_lock+0x1d)
:|  + begin   0x80000001    -1+   1.363  hard_local_irq_save+0x16 (__ipipe_spin_lock_irqsave+0x11)
:|  # func                   0	  0.286  __ipipe_spin_unlock_irqcomplete+0x4 (__ipipe_global_path_unlock+0x62)
:|  + end     0x80000001     0	  0.280  hard_local_irq_restore+0x15 (__ipipe_spin_unlock_irqcomplete+0x24)
<   + freeze  0x00006441     0	  0.317  xnshadow_sys_trace+0x65 (hisyscall_event+0x11b)
 |  + begin   0x80000001     0	  0.290  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
 |  + end     0x80000001     0	  0.260  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
 |  + begin   0x80000001     0	  0.959  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
    + func                   1	  0.221  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
    + func                   2	  0.204  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
 |  + begin   0x80000001     2	  0.303  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
 |  + end     0x80000001     2	  0.276  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
    + func                   2	  0.202  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
 |  + begin   0x80000001     3	  0.236  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
 |  + end     0x80000001     3	  0.000  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)


[max]
I-pipe worst-case tracing service on 3.5.7-trace/ipipe release #3
-------------------------------------------------------------
CPU: 0, Begin: 33561014667532 cycles, Trace Points: 17 (-10/+5), Length: 3937 us
Calibrated minimum trace-point overhead: 0.078 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
     #func                  -1	  0.139  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
 |   #begin   0x80000001    -1	  0.188  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
 |   #end     0x80000001    -1	  0.213  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
     #func                  -1	  0.167  default_idle+0x3 (cpu_idle+0x5d)
 |   #begin   0x80000001    -1	  0.172  debug_smp_processor_id+0x36 (default_idle+0xd)
 |   #end     0x80000001     0	  0.190  debug_smp_processor_id+0x82 (default_idle+0xd)
 |   #begin   0x80000001     0	  0.166  debug_smp_processor_id+0x36 (default_idle+0x1e)
 |   #end     0x80000001     0	  0.182  debug_smp_processor_id+0x82 (default_idle+0x1e)
     #func                   0	  0.133  __ipipe_halt_root+0x3 (default_idle+0x48)
 |   #begin   0x80000000     0	  0.176  __ipipe_halt_root+0x1a (default_idle+0x48)
>|   +end     0x8000000e     0! 3925.796  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +func                3925	  0.324  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                3926	  0.206  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                3926	  0.236  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                3926	  0.521  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                3927	  0.449  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                3927+   7.452  __xnlock_spin+0x9 (T.1249+0x47)
:|  # func                3934	  0.324  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                3935	  0.272  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@34347  3935	  0.180  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                3935	  0.193  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                3935	  0.351  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                3936	  0.217  xnintr_host_tick+0x4 (xnintr_clock_handler+0x151)
:|  # func                3936	  0.423  __ipipe_set_irq_pending+0x6 (xnintr_host_tick+0x50)
:|   +func                3936	  0.361  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +func                3937	  0.571  __ipipe_do_sync_stage+0x9 (__ipipe_do_sync_pipeline+0x63)
<|   #end     0x80000000  3937	  0.267  hard_local_irq_enable+0x14 (__ipipe_do_sync_stage+0xbd)
     #func                3938	  0.185  __ipipe_do_IRQ+0x5 (__ipipe_do_sync_stage+0x137)
     #func                3938	  0.199  __ipipe_get_ioapic_irq_vector+0x3 (__ipipe_do_IRQ+0x1d)
     #func                3938	  0.257  smp_apic_timer_interrupt+0x5 (__ipipe_do_IRQ+0x42)
     #func                3938	  0.158  irq_enter+0x4 (smp_apic_timer_interrupt+0x21)
 |   #begin   0x80000001  3938	  0.000  debug_smp_processor_id+0x36 (irq_enter+0xe)
-------------- next part --------------
I-pipe trace results
--------------------
name: 'plain-vga_300'

[parameters]
enable = 1
verbose = 1
pre_trace_points = 10
back_trace_points = 1000
post_trace_points = 10


[frozen]
I-pipe frozen back-tracing service on 3.5.7-trace/ipipe release #3
------------------------------------------------------------
CPU: 0, Freeze: 4709228979842 cycles, Trace Points: 1000 (+10)
Calibrated minimum trace-point overhead: 0.078 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
:|  # func               -1125	  0.298  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000 -1125	  0.509  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001 -1124	  0.459  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001 -1124	  0.314  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001 -1123+   1.356  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func               -1122	  0.274  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func               -1122	  0.290  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001 -1121	  0.391  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001 -1121	  0.291  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func               -1121	  0.274  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001 -1120	  0.330  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001 -1120	  0.301  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func               -1120	  0.298  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func               -1119	  0.257  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func               -1119	  0.246  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func               -1119	  0.259  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000 -1119	  0.482  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func               -1118	  0.349  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func               -1118	  0.371  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1327] -<?>-   99 -1117	  0.316  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func               -1117	  0.642  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func               -1117	  0.704  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1 -1116	  0.839  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func               -1115	  0.474  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef -1115	  0.733  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001 -1114	  0.323  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001 -1113	  0.310  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001 -1113	  0.326  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001 -1113	  0.324  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func               -1112	  0.323  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001 -1112	  0.347  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001 -1112	  0.316  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func               -1111	  0.322  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001 -1111	  0.334  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001 -1111	  0.309  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func               -1111	  0.247  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func               -1110	  0.260  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001 -1110	  0.375  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001 -1110	  0.310  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func               -1109	  0.334  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000 -1109	  0.311  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func               -1109	  0.429  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000 -1108	  0.317  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001 -1108	  0.333  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001 -1108	  0.330  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func               -1107	  0.305  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func               -1107	  0.332  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001 -1107	  0.335  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001 -1106	  0.310  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func               -1106	  0.254  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001 -1106	  0.325  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001 -1105	  0.332  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func               -1105	  0.262  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func               -1105	  0.261  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001 -1105	  0.373  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001 -1104	  0.325  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func               -1104	  0.262  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001 -1104	  0.319  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001 -1103	  0.315  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001 -1103	  0.324  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001 -1103	  0.384  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func               -1102	  0.254  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000 -1102	  0.321  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e -1102!  68.370  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef -1033	  0.324  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func               -1033	  0.359  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func               -1033	  0.289  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func               -1032	  0.291  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func               -1032	  0.449  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func               -1032	  0.524  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func               -1031	  0.349  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func               -1031	  0.272  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func               -1030	  0.300  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1327] -<?>-   99 -1030	  0.410  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func               -1030	  0.321  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-936  -1029	  0.256  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func               -1029	  0.298  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func               -1029	  0.553  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func               -1028	  0.465  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1 -1028	  0.270  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func               -1028	  0.626  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func               -1027	  0.956  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1327] -<?>-   99 -1026	  0.637  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func               -1025	  0.440  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func               -1025	  0.298  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000 -1025	  0.522  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001 -1024	  0.459  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001 -1024	  0.310  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001 -1023+   1.370  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func               -1022	  0.274  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func               -1022	  0.280  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001 -1021	  0.389  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001 -1021	  0.291  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func               -1021	  0.274  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001 -1020	  0.338  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001 -1020	  0.305  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func               -1020	  0.288  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func               -1020	  0.254  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func               -1019	  0.250  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func               -1019	  0.260  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000 -1019	  0.474  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func               -1018	  0.349  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func               -1018	  0.364  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1327] -<?>-   99 -1018	  0.344  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func               -1017	  0.624  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func               -1017	  0.707  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1 -1016	  0.839  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func               -1015	  0.478  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef -1015	  0.733  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001 -1014	  0.338  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001 -1013	  0.311  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001 -1013	  0.323  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001 -1013	  0.324  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func               -1013	  0.323  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001 -1012	  0.347  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001 -1012	  0.323  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func               -1012	  0.321  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001 -1011	  0.334  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001 -1011	  0.295  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func               -1011	  0.266  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func               -1010	  0.256  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001 -1010	  0.363  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001 -1010	  0.313  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func               -1009	  0.334  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000 -1009	  0.307  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func               -1009	  0.437  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000 -1008	  0.303  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001 -1008	  0.327  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001 -1008	  0.314  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func               -1007	  0.304  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func               -1007	  0.332  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001 -1007	  0.334  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001 -1006	  0.310  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func               -1006	  0.254  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001 -1006	  0.325  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001 -1005	  0.332  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func               -1005	  0.262  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func               -1005	  0.261  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001 -1005	  0.373  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001 -1004	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func               -1004	  0.252  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001 -1004	  0.332  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001 -1003	  0.313  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001 -1003	  0.324  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001 -1003	  0.384  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func               -1002	  0.264  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000 -1002	  0.328  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e -1002!  68.404  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -933	  0.322  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -933	  0.359  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -933	  0.274  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -932	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -932	  0.455  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -932	  0.540  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -931	  0.339  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -931	  0.304  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -930	  0.307  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1327] -<?>-   99  -930	  0.446  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -930	  0.344  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-836   -929	  0.251  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -929	  0.299  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -929	  0.561  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -928	  0.470  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -928	  0.280  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -927	  0.635  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -927	  0.955  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1327] -<?>-   99  -926	  0.637  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -925	  0.440  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -925	  0.298  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -925	  0.486  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -924	  0.459  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -924	  0.314  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -923+   1.356  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -922	  0.276  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -922	  0.284  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -921	  0.389  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -921	  0.315  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -921	  0.279  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -920	  0.339  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -920	  0.305  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -920	  0.293  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -919	  0.241  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -919	  0.273  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -919	  0.253  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -919	  0.486  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -918	  0.349  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -918	  0.363  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1327] -<?>-   99  -917	  0.314  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -917	  0.645  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -916	  0.710  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -916	  0.855  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -915	  0.507  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -914	  0.747  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -914	  0.323  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -913	  0.310  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -913	  0.323  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -913	  0.319  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -912	  0.345  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -912	  0.341  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -912	  0.321  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -911	  0.336  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -911	  0.327  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -911	  0.305  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -910	  0.273  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -910	  0.268  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -910	  0.383  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -909	  0.319  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -909	  0.332  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -909	  0.306  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -909	  0.437  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -908	  0.312  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -908	  0.322  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -907	  0.327  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -907	  0.304  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -907	  0.327  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -906	  0.317  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -906	  0.314  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -906	  0.282  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -906	  0.316  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -905	  0.330  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -905	  0.254  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -905	  0.257  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -904	  0.369  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -904	  0.339  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -904	  0.262  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -903	  0.319  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -903	  0.323  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -903	  0.325  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -902	  0.382  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -902	  0.265  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -902	  0.333  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -902!  68.274  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -833	  0.323  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -833	  0.358  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -833	  0.291  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -832	  0.288  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -832	  0.449  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -832	  0.530  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -831	  0.341  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -831	  0.262  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -830	  0.305  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1327] -<?>-   99  -830	  0.482  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -830	  0.349  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-736   -829	  0.252  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -829	  0.332  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -829	  0.562  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -828	  0.475  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -828	  0.270  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -827	  0.637  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -827	  0.956  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1327] -<?>-   99  -826	  0.638  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -825	  0.444  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -825	  0.302  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -824	  0.515  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -824	  0.443  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -823	  0.309  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -823+   1.372  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -822	  0.278  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -821	  0.276  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -821	  0.388  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -821	  0.292  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -820	  0.276  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -820	  0.327  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -820	  0.305  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -820	  0.298  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -819	  0.241  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -819	  0.261  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -819	  0.258  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -819	  0.478  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -818	  0.367  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -818	  0.394  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1327] -<?>-   99  -817	  0.311  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -817	  0.646  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -816	  0.703  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -816	  0.837  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -815	  0.479  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -814	  0.735  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -814	  0.331  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -813	  0.310  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -813	  0.316  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -813	  0.322  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -812	  0.347  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -812	  0.347  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -812	  0.320  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -811	  0.332  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -811	  0.339  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -811	  0.299  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -810	  0.275  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -810	  0.264  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -810	  0.363  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -809	  0.315  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -809	  0.288  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -809	  0.304  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -808	  0.436  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -808	  0.313  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -808	  0.317  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -807	  0.312  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -807	  0.294  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -807	  0.327  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -806	  0.332  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -806	  0.308  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -806	  0.268  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -806	  0.343  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -805	  0.325  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -805	  0.259  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -805	  0.245  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -804	  0.373  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -804	  0.361  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -804	  0.269  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -803	  0.319  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -803	  0.323  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -803	  0.317  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -802	  0.380  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -802	  0.260  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -802	  0.331  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -801!  68.211  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -733	  0.333  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -733	  0.362  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -733	  0.276  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -732	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -732	  0.429  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -732	  0.527  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -731	  0.325  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -731	  0.260  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -730	  0.334  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1327] -<?>-   99  -730	  0.409  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -730	  0.305  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-636   -729	  0.259  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -729	  0.289  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -729	  0.556  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -728	  0.472  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -728	  0.278  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -728	  0.640  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -727+   1.043  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1327] -<?>-   99  -726	  0.638  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -725	  0.444  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -725	  0.302  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -724	  0.517  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -724	  0.443  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -724	  0.314  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -723+   1.402  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -722	  0.297  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -722	  0.276  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -721	  0.393  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -721	  0.300  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -721	  0.273  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -720	  0.322  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -720	  0.299  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -720	  0.292  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -719	  0.251  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -719	  0.251  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -719	  0.253  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -719	  0.483  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -718	  0.376  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -718	  0.391  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1327] -<?>-   99  -717	  0.313  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -717	  0.633  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -716	  0.708  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -716	  0.841  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -715	  0.468  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -714	  0.740  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -714	  0.328  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -713	  0.310  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -713	  0.320  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -713	  0.326  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -712	  0.347  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -712	  0.349  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -712	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -711	  0.313  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -711	  0.329  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -711	  0.299  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -710	  0.280  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -710	  0.264  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -710	  0.363  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -709	  0.318  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -709	  0.292  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -709	  0.300  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -709	  0.436  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -708	  0.307  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -708	  0.324  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -707	  0.321  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -707	  0.301  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -707	  0.324  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -707	  0.317  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -706	  0.308  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -706	  0.259  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -706	  0.325  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -705	  0.320  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -705	  0.255  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -705	  0.256  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -705	  0.374  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -704	  0.338  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -704	  0.262  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -704	  0.320  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -703	  0.323  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -703	  0.325  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -703	  0.383  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -702	  0.266  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -702	  0.324  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -702!  68.265  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -633	  0.323  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -633	  0.362  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -633	  0.269  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -632	  0.279  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -632	  0.425  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -632	  0.510  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -631	  0.328  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -631	  0.269  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -631	  0.307  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1327] -<?>-   99  -630	  0.407  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -630	  0.325  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-536   -630	  0.255  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -629	  0.282  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -629	  0.562  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -628	  0.471  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -628	  0.272  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -628	  0.649  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -627	  0.956  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1327] -<?>-   99  -626	  0.638  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -625	  0.444  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -625	  0.302  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -625	  0.533  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -624	  0.443  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -624	  0.309  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -623+   1.409  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -622	  0.282  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -622	  0.278  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -621	  0.384  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -621	  0.309  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -621	  0.278  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -620	  0.322  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -620	  0.300  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -620	  0.326  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -619	  0.256  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -619	  0.270  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -619	  0.267  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -619	  0.481  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -618	  0.351  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -618	  0.395  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1327] -<?>-   99  -617	  0.312  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -617	  0.642  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -617	  0.704  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -616	  0.841  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -615	  0.468  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -615	  0.734  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -614	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -613	  0.308  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -613	  0.329  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -613	  0.337  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -612	  0.344  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -612	  0.342  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -612	  0.324  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -611	  0.333  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -611	  0.339  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -611	  0.299  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -610	  0.276  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -610	  0.264  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -610	  0.363  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -610	  0.318  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -609	  0.292  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -609	  0.300  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -609	  0.436  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -608	  0.312  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -608	  0.322  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -608	  0.329  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -607	  0.297  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -607	  0.325  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -607	  0.320  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -606	  0.299  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -606	  0.260  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -606	  0.334  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -605	  0.327  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -605	  0.258  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -605	  0.267  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -605	  0.375  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -604	  0.327  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -604	  0.260  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -604	  0.319  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -603	  0.323  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -603	  0.324  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -603	  0.383  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -602	  0.265  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -602	  0.333  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -602!  68.293  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -533	  0.323  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -533	  0.362  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -533	  0.269  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -532	  0.279  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -532	  0.437  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -532	  0.528  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -531	  0.341  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -531	  0.262  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -531	  0.305  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1327] -<?>-   99  -530	  0.459  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -530	  0.319  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-436   -529	  0.257  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -529	  0.300  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -529	  0.556  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -528	  0.516  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -528	  0.319  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -528	  0.637  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -527	  0.968  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1327] -<?>-   99  -526	  0.638  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -525	  0.444  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -525	  0.302  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -525	  0.550  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -524	  0.440  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -524	  0.309  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -523+   1.352  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -522	  0.281  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -522	  0.281  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -521	  0.405  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -521	  0.307  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -521	  0.290  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -520	  0.336  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -520	  0.291  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -520	  0.326  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -519	  0.256  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -519	  0.265  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -519	  0.264  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -519	  0.493  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -518	  0.350  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -518	  0.391  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1327] -<?>-   99  -517	  0.346  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -517	  0.630  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -516	  0.718  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -516	  0.841  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -515	  0.471  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -514	  0.735  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -514	  0.328  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -513	  0.310  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -513	  0.332  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -513	  0.326  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -512	  0.325  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -512	  0.348  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -512	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -511	  0.319  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -511	  0.330  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -511	  0.299  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -510	  0.254  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -510	  0.266  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -510	  0.373  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -509	  0.327  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -509	  0.292  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -509	  0.301  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -509	  0.436  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -508	  0.313  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -508	  0.322  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -507	  0.325  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -507	  0.302  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -507	  0.324  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -507	  0.324  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -506	  0.318  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -506	  0.259  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -506	  0.325  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -505	  0.320  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -505	  0.256  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -505	  0.260  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -504	  0.371  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -504	  0.327  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -504	  0.269  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -503	  0.319  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -503	  0.323  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -503	  0.324  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -503	  0.383  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -502	  0.265  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -502	  0.333  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -502!  68.205  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -433	  0.323  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -433	  0.362  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -433	  0.269  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -432	  0.279  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -432	  0.433  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -432	  0.527  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -431	  0.338  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -431	  0.262  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -431	  0.305  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1327] -<?>-   99  -430	  0.482  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -430	  0.321  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-336   -429	  0.255  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -429	  0.282  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -429	  0.562  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -428	  0.472  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -428	  0.278  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -428	  0.639  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -427	  0.956  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1327] -<?>-   99  -426	  0.638  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -425	  0.444  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -425	  0.302  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -425	  0.519  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -424	  0.443  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -424	  0.309  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -423+   1.376  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -422	  0.284  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -422	  0.278  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -421	  0.403  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -421	  0.307  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -421	  0.290  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -420	  0.323  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -420	  0.303  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -420	  0.298  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -419	  0.263  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -419	  0.248  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -419	  0.256  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -419	  0.490  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -418	  0.355  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -418	  0.381  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1327] -<?>-   99  -417	  0.349  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -417	  0.647  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -416	  0.700  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -416	  0.841  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -415	  0.471  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -414	  0.734  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -414	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -413	  0.313  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -413	  0.329  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -413	  0.337  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -412	  0.344  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -412	  0.346  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -412	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -411	  0.335  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -411	  0.336  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -411	  0.296  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -410	  0.276  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -410	  0.264  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -410	  0.370  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -410	  0.329  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -409	  0.292  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -409	  0.300  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -409	  0.436  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -408	  0.312  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -408	  0.322  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -408	  0.311  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -407	  0.295  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -407	  0.319  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -407	  0.328  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -406	  0.308  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -406	  0.259  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -406	  0.325  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -405	  0.320  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -405	  0.256  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -405	  0.256  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -405	  0.373  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -404	  0.327  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -404	  0.269  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -404	  0.319  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -403	  0.323  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -403	  0.324  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -403	  0.383  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -402	  0.260  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -402	  0.331  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -402!  68.270  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -333	  0.326  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -333	  0.362  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -333	  0.269  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -332	  0.279  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -332	  0.403  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -332	  0.534  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -331	  0.338  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -331	  0.262  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -331	  0.305  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1327] -<?>-   99  -330	  0.482  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -330	  0.332  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-236   -329	  0.247  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -329	  0.298  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -329	  0.558  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -328	  0.472  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -328	  0.285  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -328	  0.626  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -327	  0.958  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1327] -<?>-   99  -326	  0.638  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -325	  0.444  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -325	  0.302  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -325	  0.522  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -324	  0.478  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -324	  0.316  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -323+   1.366  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -322	  0.279  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -322	  0.280  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -321	  0.406  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -321	  0.304  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -321	  0.278  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -320	  0.322  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -320	  0.303  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -320	  0.303  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -319	  0.244  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -319	  0.259  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -319	  0.254  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -319	  0.483  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -318	  0.351  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -318	  0.391  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1327] -<?>-   99  -317	  0.347  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -317	  0.645  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -316	  0.711  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -316	  0.850  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -315	  0.474  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -314	  0.745  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -314	  0.328  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -313	  0.345  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -313	  0.334  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -313	  0.306  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -312	  0.351  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -312	  0.348  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -312	  0.288  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -311	  0.349  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -311	  0.332  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -311	  0.283  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -310	  0.272  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -310	  0.278  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -310	  0.371  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -310	  0.316  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -309	  0.286  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -309	  0.314  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -309	  0.429  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -308	  0.305  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -308	  0.319  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -308	  0.322  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -307	  0.297  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -307	  0.325  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -307	  0.317  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -306	  0.308  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -306	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -306	  0.321  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -305	  0.320  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -305	  0.256  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -305	  0.256  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -305	  0.373  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -304	  0.327  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -304	  0.251  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -304	  0.323  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -303	  0.323  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -303	  0.325  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -303	  0.380  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -302	  0.265  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -302	  0.333  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -302!  68.336  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -233	  0.312  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -233	  0.360  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -233	  0.272  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -232	  0.296  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -232	  0.441  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -232	  0.527  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -231	  0.327  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -231	  0.252  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -231	  0.297  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1327] -<?>-   99  -230	  0.444  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -230	  0.309  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-136   -229	  0.248  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -229	  0.296  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -229	  0.572  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -228	  0.472  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -228	  0.278  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -228	  0.648  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -227	  0.965  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1327] -<?>-   99  -226	  0.638  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -225	  0.444  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -225	  0.302  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -225	  0.522  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -224	  0.443  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -224	  0.309  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -223+   1.382  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -222	  0.282  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -222	  0.278  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -221	  0.384  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -221	  0.309  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -221	  0.278  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -220	  0.316  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -220	  0.295  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -220	  0.301  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -219	  0.255  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -219	  0.288  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -219	  0.250  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -219	  0.481  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -218	  0.350  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -218	  0.395  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1327] -<?>-   99  -217	  0.312  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -217	  0.627  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -217	  0.704  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -216	  0.841  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -215	  0.468  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -215	  0.735  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -214	  0.328  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -213	  0.308  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -213	  0.329  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -213	  0.337  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -212	  0.344  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -212	  0.342  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -212	  0.323  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -211	  0.335  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -211	  0.339  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -211	  0.299  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -210	  0.276  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -210	  0.256  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -210	  0.374  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -210	  0.318  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -209	  0.292  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -209	  0.310  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -209	  0.436  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -208	  0.313  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -208	  0.322  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -208	  0.311  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -207	  0.294  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -207	  0.320  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -207	  0.339  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -206	  0.308  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -206	  0.259  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -206	  0.325  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -205	  0.320  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -205	  0.256  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -205	  0.256  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -205	  0.373  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -204	  0.331  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -204	  0.263  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -204	  0.322  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -203	  0.312  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -203	  0.325  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -203	  0.382  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -202	  0.249  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -202	  0.335  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -202!  68.346  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -133	  0.326  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -133	  0.362  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -133	  0.276  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -132	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -132	  0.428  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -132	  0.534  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -131	  0.338  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -131	  0.262  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -131	  0.305  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1327] -<?>-   99  -130	  0.497  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -130	  0.322  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-71    -129	  0.257  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -129	  0.303  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -129	  0.580  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -128	  0.472  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -128	  0.278  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -128	  0.635  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -127	  0.979  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1327] -<?>-   99  -126	  0.637  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -125	  0.449  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -125	  0.279  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -125	  0.510  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -124	  0.444  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -124	  0.305  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -123+   1.318  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -122	  0.283  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -122	  0.279  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -121	  0.405  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -121	  0.307  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -121	  0.290  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -120	  0.336  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -120	  0.311  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -120	  0.304  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -119	  0.260  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -119	  0.266  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -119	  0.261  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -119	  0.481  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -118	  0.349  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -118	  0.385  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1327] -<?>-   99  -117	  0.359  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -117	  0.612  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -116	  0.701  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -116	  0.841  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -115	  0.486  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -114	  0.745  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -114	  0.336  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -113	  0.310  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -113	  0.321  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -113	  0.337  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -112	  0.322  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -112	  0.355  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -112	  0.320  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -111	  0.319  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -111	  0.333  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -111	  0.299  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -110	  0.248  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -110	  0.256  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -110	  0.365  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -110	  0.334  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -109	  0.286  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -109	  0.314  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -109	  0.432  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -108	  0.305  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -108	  0.319  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -108	  0.322  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -107	  0.297  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -107	  0.327  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -107	  0.317  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -106	  0.308  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -106	  0.259  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -106	  0.325  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -105	  0.325  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -105	  0.248  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -105	  0.246  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -105	  0.370  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -104	  0.327  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -104	  0.269  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -104	  0.319  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -103	  0.323  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -103	  0.325  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -103	  0.383  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -102	  0.265  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -102	  0.333  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -102!  33.373  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef   -68	  0.323  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                 -68	  0.362  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                 -68	  0.269  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                 -67	  0.279  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                 -67	  0.444  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                 -67	  0.527  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                 -66	  0.350  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                 -66	  0.464  xnsched_watchdog_handler+0x5 (xntimer_tick_aperiodic+0x78)
:|  # func                 -65	  0.322  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-36     -65	  0.257  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                 -65	  0.303  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                 -64	  0.779  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|   +func                 -64	  0.438  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef   -63	  0.750  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001   -62	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001   -62	  0.334  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001   -62	  0.348  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001   -61	  0.325  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                 -61	  0.325  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001   -61	  0.338  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001   -60	  0.320  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                 -60+   2.099  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001   -58	  0.488  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001   -58	  0.387  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                 -57	  0.365  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -57	  0.367  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -56	  0.512  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -56	  0.401  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -55	  0.342  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000   -55	  0.369  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -55	  0.711  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -54	  0.403  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001   -54	  0.404  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001   -53	  0.418  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                 -53	  0.429  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                 -52	  0.462  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001   -52	  0.457  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001   -51	  0.384  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                 -51	  0.336  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001   -51	  0.377  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001   -50	  0.381  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                 -50	  0.655  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -49	  0.365  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -49	  0.504  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -48	  0.444  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -48	  0.359  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001   -48	  0.441  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001   -47	  0.459  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001   -47	  0.438  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001   -46	  0.544  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                 -46	  0.343  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000   -45	  0.464  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e   -45!  11.737  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef   -33	  0.385  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                 -33	  0.542  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                 -32+   2.803  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                 -30	  0.438  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                 -29	  0.636  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                 -28	  0.723  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                 -28+   2.554  __xnlock_spin+0x9 (T.1249+0x47)
:|  # func                 -25	  0.512  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                 -25	  0.609  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                 -24	  0.722  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1327] -<?>-   99   -23+   1.106  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                 -22	  0.646  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@63      -22	  0.684  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                 -21	  0.771  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                 -20	  0.923  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                 -19	  0.627  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # func                 -19+   3.572  __xnlock_spin+0x9 (T.1349+0x55)
:|  # [    0] -<?>-   -1   -15	  0.379  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                 -15	  0.850  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                 -14+   1.496  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1327] -<?>-   99   -12	  0.808  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                 -11	  0.644  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                 -11	  0.375  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000   -10	  0.604  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001   -10	  0.646  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001    -9	  0.493  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001    -9+   1.818  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                  -7	  0.439  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                  -6	  0.335  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001    -6	  0.619  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001    -5	  0.423  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                  -5	  0.393  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001    -5	  0.444  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001    -4	  0.390  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                  -4	  0.483  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                  -3	  0.377  xnshadow_sys_trace+0x6 (hisyscall_event+0x11b)
:   + func                  -3	  0.404  ipipe_trace_frozen_reset+0x6 (xnshadow_sys_trace+0x5c)
:   + func                  -3	  0.319  __ipipe_global_path_lock+0x9 (ipipe_trace_frozen_reset+0x1a)
:   + func                  -2	  0.344  __ipipe_spin_lock_irqsave+0x5 (__ipipe_global_path_lock+0x1d)
:|  + begin   0x80000001    -2+   1.446  hard_local_irq_save+0x16 (__ipipe_spin_lock_irqsave+0x11)
:|  # func                   0	  0.540  __ipipe_spin_unlock_irqcomplete+0x4 (__ipipe_global_path_unlock+0x62)
:|  + end     0x80000001     0	  0.398  hard_local_irq_restore+0x15 (__ipipe_spin_unlock_irqcomplete+0x24)
<   + freeze  0x00006003     0	  0.426  xnshadow_sys_trace+0x65 (hisyscall_event+0x11b)
 |  + begin   0x80000001     0	  0.469  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
 |  + end     0x80000001     0	  0.437  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
 |  + begin   0x80000001     1	  1.370  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
    + func                   2	  0.378  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
    + func                   3	  0.345  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
 |  + begin   0x80000001     3	  0.659  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
 |  + end     0x80000001     4	  0.400  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
    + func                   4	  0.345  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
 |  + begin   0x80000001     4	  1.012  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
 |  + end     0x80000001     5	  0.000  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)


[max]
I-pipe worst-case tracing service on 3.5.7-trace/ipipe release #3
-------------------------------------------------------------
CPU: 0, Begin: 4606607934972 cycles, Trace Points: 8 (-10/+5), Length: 3899 us
Calibrated minimum trace-point overhead: 0.078 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
     #func                  -3	  0.253  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
 |   #begin   0x80000001    -2	  0.376  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
 |   #end     0x80000001    -2	  0.350  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
     #func                  -2	  0.271  default_idle+0x3 (cpu_idle+0x5d)
 |   #begin   0x80000001    -1	  0.330  debug_smp_processor_id+0x36 (default_idle+0xd)
 |   #end     0x80000001    -1	  0.317  debug_smp_processor_id+0x82 (default_idle+0xd)
 |   #begin   0x80000001    -1	  0.344  debug_smp_processor_id+0x36 (default_idle+0x1e)
 |   #end     0x80000001    -1	  0.389  debug_smp_processor_id+0x82 (default_idle+0x1e)
     #func                   0	  0.276  __ipipe_halt_root+0x3 (default_idle+0x48)
 |   #begin   0x80000000     0	  0.336  __ipipe_halt_root+0x1a (default_idle+0x48)
>|   +end     0x8000000e     0! 3896.339  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +func                3896	  0.577  __ipipe_handle_irq+0x9 (reschedule_interrupt+0x3e)
:|   +func                3896	  0.490  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                3897	  0.490  __ipipe_ack_apic+0x3 (__ipipe_dispatch_irq+0xa4)
:|   +func                3897	  0.583  __ipipe_set_irq_pending+0x6 (__ipipe_dispatch_irq+0x19a)
:|   +func                3898	  0.641  __ipipe_do_sync_pipeline+0x4 (__ipipe_sync_pipeline+0x1c)
:|   +func                3899	  0.613  __ipipe_do_sync_stage+0x9 (__ipipe_do_sync_pipeline+0x63)
<|   #end     0x80000000  3899	  0.472  hard_local_irq_enable+0x14 (__ipipe_do_sync_stage+0xbd)
     #func                3900	  0.412  __ipipe_do_IRQ+0x5 (__ipipe_do_sync_stage+0x137)
     #func                3900	  0.474  __ipipe_get_ioapic_irq_vector+0x3 (__ipipe_do_IRQ+0x1d)
     #func                3901	  0.389  smp_reschedule_interrupt+0x3 (__ipipe_do_IRQ+0x42)
     #func                3901	  0.372  scheduler_ipi+0x4 (smp_reschedule_interrupt+0x14)
 |   #begin   0x80000001  3901	  0.000  debug_smp_processor_id+0x36 (scheduler_ipi+0x13)
-------------- next part --------------
I-pipe trace results
--------------------
name: 'plain-vga_300_no_usb'

[parameters]
enable = 1
verbose = 1
pre_trace_points = 10
back_trace_points = 1000
post_trace_points = 10


[frozen]
I-pipe frozen back-tracing service on 3.5.7-trace/ipipe release #3
------------------------------------------------------------
CPU: 0, Freeze: 32787094157468 cycles, Trace Points: 1000 (+10)
Calibrated minimum trace-point overhead: 0.078 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
:|  # func               -1126	  0.468  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func               -1125	  0.322  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000 -1125	  0.487  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001 -1125	  0.409  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001 -1124	  0.357  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001 -1124+   1.300  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func               -1123	  0.271  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func               -1122	  0.278  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001 -1122	  0.384  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001 -1122	  0.309  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func               -1121	  0.281  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001 -1121	  0.340  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001 -1121	  0.295  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func               -1120	  0.270  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func               -1120	  0.254  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func               -1120	  0.264  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func               -1120	  0.284  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000 -1119	  0.511  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func               -1119	  0.368  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func               -1118	  0.408  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99 -1118	  0.311  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func               -1118	  0.633  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func               -1117	  0.705  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1 -1116	  0.818  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func               -1116	  0.506  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef -1115	  0.737  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001 -1114	  0.353  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001 -1114	  0.347  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001 -1114	  0.322  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001 -1113	  0.341  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func               -1113	  0.322  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001 -1113	  0.349  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001 -1112	  0.317  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func               -1112	  0.320  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001 -1112	  0.320  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001 -1111	  0.312  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func               -1111	  0.263  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func               -1111	  0.285  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001 -1111	  0.369  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001 -1110	  0.327  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func               -1110	  0.254  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000 -1110	  0.308  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func               -1109	  0.420  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000 -1109	  0.317  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001 -1109	  0.317  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001 -1108	  0.319  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func               -1108	  0.305  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func               -1108	  0.326  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001 -1107	  0.325  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001 -1107	  0.300  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func               -1107	  0.273  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001 -1106	  0.335  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001 -1106	  0.373  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func               -1106	  0.265  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func               -1105	  0.259  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001 -1105	  0.366  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001 -1105	  0.337  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func               -1104	  0.266  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001 -1104	  0.330  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001 -1104	  0.321  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001 -1103	  0.338  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001 -1103	  0.383  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func               -1103	  0.252  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000 -1103	  0.330  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e -1102!  68.125  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef -1034	  0.310  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func               -1034	  0.361  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func               -1033	  0.284  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func               -1033	  0.288  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func               -1033	  0.454  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func               -1032	  0.545  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func               -1032	  0.320  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func               -1031	  0.292  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func               -1031	  0.301  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99 -1031	  0.476  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func               -1030	  0.318  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-937  -1030	  0.254  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func               -1030	  0.295  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func               -1030	  0.572  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func               -1029	  0.483  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1 -1028	  0.269  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func               -1028	  0.637  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func               -1028+   1.019  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99 -1027	  0.639  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func               -1026	  0.468  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func               -1025	  0.315  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000 -1025	  0.475  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001 -1025	  0.412  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001 -1024	  0.344  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001 -1024+   1.304  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func               -1023	  0.278  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func               -1022	  0.279  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001 -1022	  0.384  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001 -1022	  0.309  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func               -1021	  0.280  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001 -1021	  0.326  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001 -1021	  0.301  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func               -1020	  0.274  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func               -1020	  0.246  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func               -1020	  0.251  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func               -1020	  0.269  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000 -1019	  0.480  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func               -1019	  0.348  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func               -1019	  0.367  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99 -1018	  0.320  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func               -1018	  0.645  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func               -1017	  0.707  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1 -1017	  0.842  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func               -1016	  0.488  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef -1015	  0.732  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001 -1014	  0.326  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001 -1014	  0.310  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001 -1014	  0.320  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001 -1014	  0.339  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func               -1013	  0.344  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001 -1013	  0.349  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001 -1012	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func               -1012	  0.335  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001 -1012	  0.336  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001 -1011	  0.298  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func               -1011	  0.286  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func               -1011	  0.260  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001 -1011	  0.371  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001 -1010	  0.322  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func               -1010	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000 -1010	  0.312  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func               -1009	  0.428  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000 -1009	  0.323  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001 -1009	  0.331  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001 -1008	  0.323  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func               -1008	  0.305  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func               -1008	  0.326  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001 -1007	  0.328  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001 -1007	  0.320  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func               -1007	  0.273  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001 -1006	  0.335  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001 -1006	  0.373  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func               -1006	  0.254  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func               -1005	  0.251  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001 -1005	  0.378  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001 -1005	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func               -1005	  0.266  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001 -1004	  0.317  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001 -1004	  0.314  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001 -1004	  0.346  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001 -1003	  0.384  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func               -1003	  0.252  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000 -1003	  0.330  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e -1002!  68.190  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -934	  0.310  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -934	  0.361  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -933	  0.269  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -933	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -933	  0.453  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -932	  0.548  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -932	  0.313  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -932	  0.290  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -931	  0.315  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -931	  0.434  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -931	  0.319  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-837   -930	  0.254  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -930	  0.294  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -930	  0.572  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -929	  0.503  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -929	  0.271  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -928	  0.648  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -928+   1.012  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -927	  0.640  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -926	  0.468  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -926	  0.310  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -925	  0.478  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -925	  0.452  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -924	  0.337  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -924+   1.296  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -923	  0.279  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -922	  0.295  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -922	  0.400  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -922	  0.307  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -921	  0.278  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -921	  0.341  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -921	  0.322  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -920	  0.285  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -920	  0.263  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -920	  0.261  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -920	  0.282  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -919	  0.488  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -919	  0.343  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -919	  0.363  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -918	  0.310  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -918	  0.634  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -917	  0.779  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -916	  0.856  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -916	  0.487  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -915	  0.732  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -914	  0.331  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -914	  0.336  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -914	  0.321  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -913	  0.339  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -913	  0.326  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -913	  0.349  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -912	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -912	  0.319  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -912	  0.320  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -911	  0.313  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -911	  0.253  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -911	  0.257  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -911	  0.377  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -910	  0.322  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -910	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -910	  0.313  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -909	  0.420  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -909	  0.322  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -909	  0.331  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -908	  0.323  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -908	  0.305  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -908	  0.326  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -907	  0.328  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -907	  0.309  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -907	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -906	  0.332  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -906	  0.373  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -906	  0.265  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -905	  0.259  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -905	  0.370  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -905	  0.322  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -904	  0.278  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -904	  0.332  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -904	  0.321  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -904	  0.349  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -903	  0.383  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -903	  0.252  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -903	  0.325  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -902!  68.134  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -834	  0.310  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -834	  0.361  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -833	  0.284  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -833	  0.288  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -833	  0.431  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -832	  0.539  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -832	  0.320  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -832	  0.292  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -831	  0.300  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -831	  0.476  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -830	  0.318  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-737   -830	  0.254  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -830	  0.295  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -830	  0.575  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -829	  0.484  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -829	  0.268  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -828	  0.640  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -828+   1.019  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -827	  0.639  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -826	  0.468  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -825	  0.315  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -825	  0.476  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -825	  0.412  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -824	  0.344  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -824+   1.299  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -823	  0.279  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -822	  0.278  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -822	  0.384  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -822	  0.309  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -821	  0.281  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -821	  0.326  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -821	  0.301  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -820	  0.283  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -820	  0.256  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -820	  0.260  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -820	  0.264  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -819	  0.487  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -819	  0.345  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -819	  0.366  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -818	  0.302  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -818	  0.645  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -817	  0.706  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -817	  0.842  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -816	  0.488  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -815	  0.732  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -814	  0.326  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -814	  0.342  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -814	  0.321  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -814	  0.339  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -813	  0.344  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -813	  0.348  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -812	  0.323  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -812	  0.335  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -812	  0.332  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -811	  0.298  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -811	  0.277  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -811	  0.269  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -811	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -810	  0.329  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -810	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -810	  0.324  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -809	  0.428  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -809	  0.313  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -809	  0.322  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -808	  0.312  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -808	  0.298  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -808	  0.322  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -807	  0.336  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -807	  0.309  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -807	  0.273  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -806	  0.335  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -806	  0.373  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -806	  0.265  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -805	  0.259  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -805	  0.370  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -805	  0.325  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -805	  0.266  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -804	  0.335  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -804	  0.321  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -804	  0.338  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -803	  0.383  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -803	  0.248  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -803	  0.320  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -802!  68.284  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -734	  0.310  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -734	  0.361  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -733	  0.269  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -733	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -733	  0.449  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -732	  0.545  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -732	  0.323  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -731	  0.320  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -731	  0.302  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -731	  0.459  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -730	  0.350  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-637   -730	  0.248  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -730	  0.295  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -729	  0.559  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -729	  0.473  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -728	  0.272  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -728	  0.655  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -728+   1.014  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -727	  0.642  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -726	  0.469  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -725	  0.317  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -725	  0.483  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -725	  0.412  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -724	  0.340  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -724+   1.327  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -723	  0.297  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -722	  0.298  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -722	  0.384  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -722	  0.300  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -721	  0.273  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -721	  0.324  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -721	  0.301  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -720	  0.280  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -720	  0.257  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -720	  0.292  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -720	  0.272  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -719	  0.478  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -719	  0.342  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -718	  0.417  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -718	  0.317  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -718	  0.630  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -717	  0.713  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -716	  0.845  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -715	  0.487  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -715	  0.738  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -714	  0.328  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -714	  0.340  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -714	  0.321  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -713	  0.339  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -713	  0.344  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -713	  0.349  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -712	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -712	  0.335  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -712	  0.332  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -711	  0.324  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -711	  0.272  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -711	  0.260  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -710	  0.380  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -710	  0.329  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -710	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -709	  0.320  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -709	  0.414  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -709	  0.317  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -708	  0.317  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -708	  0.323  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -708	  0.305  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -707	  0.326  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -707	  0.328  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -707	  0.309  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -706	  0.273  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -706	  0.335  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -706	  0.373  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -705	  0.265  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -705	  0.259  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -705	  0.370  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -705	  0.325  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -704	  0.266  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -704	  0.330  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -704	  0.321  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -703	  0.338  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -703	  0.383  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -703	  0.252  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -702	  0.330  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -702!  67.989  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -634	  0.310  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -634	  0.361  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -633	  0.284  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -633	  0.288  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -633	  0.448  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -632	  0.559  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -632	  0.316  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -631	  0.281  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -631	  0.300  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -631	  0.422  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -630	  0.321  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-537   -630	  0.254  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -630	  0.295  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -630	  0.572  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -629	  0.483  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -629	  0.269  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -628	  0.637  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -628+   1.019  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -627	  0.639  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -626	  0.468  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -626	  0.315  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -625	  0.476  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -625	  0.412  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -624	  0.344  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -624+   1.329  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -623	  0.283  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -622	  0.278  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -622	  0.384  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -622	  0.309  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -621	  0.280  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -621	  0.326  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -621	  0.301  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -620	  0.283  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -620	  0.256  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -620	  0.260  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -620	  0.264  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -619	  0.487  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -619	  0.345  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -619	  0.366  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -618	  0.303  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -618	  0.644  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -617	  0.713  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -617	  0.835  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -616	  0.487  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -615	  0.732  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -615	  0.326  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -614	  0.342  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -614	  0.321  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -614	  0.339  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -613	  0.344  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -613	  0.349  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -612	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -612	  0.335  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -612	  0.332  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -611	  0.298  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -611	  0.277  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -611	  0.260  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -611	  0.375  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -610	  0.322  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -610	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -610	  0.321  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -609	  0.431  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -609	  0.313  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -609	  0.322  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -608	  0.329  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -608	  0.305  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -608	  0.326  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -607	  0.328  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -607	  0.309  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -607	  0.273  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -606	  0.361  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -606	  0.376  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -606	  0.260  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -605	  0.251  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -605	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -605	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -604	  0.267  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -604	  0.330  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -604	  0.314  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -604	  0.347  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -603	  0.385  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -603	  0.259  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -603	  0.334  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -602!  68.191  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -534	  0.312  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -534	  0.358  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -533	  0.274  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -533	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -533	  0.453  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -532	  0.621  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -532	  0.324  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -531	  0.282  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -531	  0.309  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -531	  0.422  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -530	  0.309  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-437   -530	  0.262  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -530	  0.286  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -530	  0.566  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -529	  0.474  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -529	  0.270  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -528	  0.640  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -528+   1.013  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -527	  0.638  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -526	  0.469  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -525	  0.316  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -525	  0.490  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -525	  0.410  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -524	  0.337  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -524+   1.297  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -523	  0.274  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -522	  0.280  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -522	  0.389  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -522	  0.299  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -521	  0.276  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -521	  0.324  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -521	  0.314  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -520	  0.288  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -520	  0.255  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -520	  0.249  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -520	  0.268  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -519	  0.502  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -519	  0.353  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -519	  0.398  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -518	  0.315  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -518	  0.639  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -517	  0.718  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -516	  0.838  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -516	  0.491  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -515	  0.746  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -514	  0.341  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -514	  0.310  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -514	  0.332  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -513	  0.328  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -513	  0.345  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -513	  0.353  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -512	  0.320  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -512	  0.336  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -512	  0.314  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -511	  0.305  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -511	  0.285  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -511	  0.255  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -511	  0.378  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -510	  0.323  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -510	  0.254  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -510	  0.312  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -509	  0.415  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -509	  0.319  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -509	  0.329  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -508	  0.321  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -508	  0.310  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -508	  0.332  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -507	  0.320  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -507	  0.311  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -507	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -506	  0.332  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -506	  0.369  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -506	  0.248  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -505	  0.272  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -505	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -505	  0.334  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -504	  0.270  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -504	  0.319  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -504	  0.314  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -504	  0.347  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -503	  0.379  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -503	  0.259  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -503	  0.334  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -502!  68.117  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -434	  0.307  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -434	  0.358  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -433	  0.274  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -433	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -433	  0.420  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -432	  0.618  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -432	  0.323  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -432	  0.282  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -431	  0.302  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -431	  0.430  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -431	  0.314  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-337   -430	  0.255  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -430	  0.302  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -430	  0.572  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -429	  0.502  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -429	  0.276  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -428	  0.640  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -428+   1.016  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -427	  0.638  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -426	  0.469  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -426	  0.316  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -425	  0.466  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -425	  0.410  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -424	  0.336  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -424+   1.302  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -423	  0.274  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -422	  0.280  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -422	  0.389  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -422	  0.291  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -421	  0.276  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -421	  0.324  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -421	  0.302  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -421	  0.310  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -420	  0.286  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -420	  0.260  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -420	  0.311  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -419	  0.478  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -419	  0.347  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -419	  0.409  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -418	  0.305  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -418	  0.643  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -417	  0.711  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -416	  0.838  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -416	  0.488  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -415	  0.735  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -414	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -414	  0.305  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -414	  0.332  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -413	  0.383  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -413	  0.337  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -413	  0.341  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -412	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -412	  0.339  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -412	  0.315  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -411	  0.296  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -411	  0.281  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -411	  0.263  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -411	  0.369  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -410	  0.322  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -410	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -410	  0.317  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -409	  0.429  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -409	  0.304  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -409	  0.330  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -408	  0.324  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -408	  0.310  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -408	  0.332  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -407	  0.320  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -407	  0.311  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -407	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -406	  0.332  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -406	  0.376  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -406	  0.260  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -405	  0.251  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -405	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -405	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -404	  0.266  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -404	  0.317  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -404	  0.314  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -404	  0.346  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -403	  0.379  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -403	  0.259  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -403	  0.330  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -402!  68.232  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -334	  0.307  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -334	  0.358  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -333	  0.274  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -333	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -333	  0.433  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -332	  0.543  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -332	  0.324  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -332	  0.282  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -331	  0.312  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -331	  0.424  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -330	  0.317  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-237   -330	  0.258  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -330	  0.305  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -330	  0.569  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -329	  0.545  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -328	  0.276  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -328	  0.652  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -328+   1.018  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -327	  0.639  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -326	  0.469  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -325	  0.317  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -325	  0.506  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -325	  0.405  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -324	  0.337  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -324+   1.299  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -323	  0.274  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -322	  0.280  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -322	  0.389  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -322	  0.291  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -321	  0.274  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -321	  0.324  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -321	  0.306  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -320	  0.286  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -320	  0.249  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -320	  0.269  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -320	  0.273  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -319	  0.493  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -319	  0.353  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -318	  0.391  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -318	  0.315  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -318	  0.638  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -317	  0.731  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -316	  0.854  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -316	  0.527  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -315	  0.740  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -314	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -314	  0.343  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -314	  0.321  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -313	  0.340  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -313	  0.337  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -313	  0.341  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -312	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -312	  0.336  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -312	  0.315  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -311	  0.308  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -311	  0.274  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -311	  0.267  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -310	  0.378  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -310	  0.309  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -310	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -310	  0.317  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -309	  0.429  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -309	  0.299  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -308	  0.336  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -308	  0.324  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -308	  0.299  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -308	  0.322  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -307	  0.321  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -307	  0.310  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -307	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -306	  0.333  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -306	  0.380  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -306	  0.260  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -305	  0.251  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -305	  0.373  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -305	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -304	  0.269  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -304	  0.325  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -304	  0.314  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -303	  0.347  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -303	  0.379  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -303	  0.259  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -302	  0.334  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -302!  68.109  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -234	  0.307  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -234	  0.358  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -233	  0.274  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -233	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -233	  0.443  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -232	  0.621  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -232	  0.323  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -231	  0.282  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -231	  0.302  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -231	  0.430  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -230	  0.314  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-137   -230	  0.255  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -230	  0.302  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -230	  0.572  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -229	  0.503  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -228	  0.281  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -228	  0.659  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -228+   1.021  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -226	  0.638  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -226	  0.469  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -225	  0.316  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -225	  0.462  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -225	  0.410  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -224	  0.337  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -224+   1.301  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -223	  0.271  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -222	  0.280  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -222	  0.389  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -222	  0.291  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -221	  0.274  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -221	  0.324  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -221	  0.302  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -220	  0.310  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -220	  0.253  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -220	  0.259  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -220	  0.303  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -219	  0.481  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -219	  0.344  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -218	  0.363  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -218	  0.307  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -218	  0.648  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -217	  0.708  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -216	  0.837  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -216	  0.488  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -215	  0.735  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -214	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -214	  0.343  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -214	  0.332  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -213	  0.337  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -213	  0.337  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -213	  0.342  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -212	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -212	  0.336  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -212	  0.325  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -211	  0.305  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -211	  0.281  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -211	  0.263  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -211	  0.369  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -210	  0.322  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -210	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -210	  0.317  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -209	  0.430  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -209	  0.299  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -209	  0.336  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -208	  0.329  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -208	  0.305  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -208	  0.332  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -207	  0.320  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -207	  0.308  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -207	  0.264  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -206	  0.336  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -206	  0.376  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -206	  0.260  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -205	  0.251  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -205	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -205	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -204	  0.269  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -204	  0.320  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -204	  0.314  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -204	  0.345  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -203	  0.382  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -203	  0.259  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -203	  0.334  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -202!  68.112  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -134	  0.307  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -134	  0.358  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -133	  0.274  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -133	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -133	  0.453  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -132	  0.647  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -132	  0.337  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -131	  0.257  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -131	  0.316  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -131	  0.437  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -130	  0.334  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-72    -130	  0.258  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -130	  0.293  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -130	  0.574  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -129	  0.474  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -128	  0.270  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -128	  0.639  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -128+   1.018  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -127	  0.638  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -126	  0.469  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -125	  0.316  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -125	  0.462  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -125	  0.447  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -124	  0.348  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -124+   1.297  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -123	  0.276  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -122	  0.270  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -122	  0.389  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -122	  0.291  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -121	  0.274  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -121	  0.335  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -121	  0.295  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -120	  0.285  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -120	  0.257  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -120	  0.260  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -120	  0.268  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -119	  0.475  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -119	  0.344  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -119	  0.364  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -118	  0.316  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -118	  0.638  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -117	  0.704  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -117	  0.850  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -116	  0.508  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -115	  0.735  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -114	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -114	  0.341  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -114	  0.331  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -113	  0.302  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -113	  0.353  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -113	  0.339  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -112	  0.302  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -112	  0.335  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -112	  0.315  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -111	  0.280  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -111	  0.284  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -111	  0.318  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -111	  0.373  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -110	  0.309  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -110	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -110	  0.317  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -109	  0.429  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -109	  0.299  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -109	  0.336  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -108	  0.317  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -108	  0.296  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -108	  0.322  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -107	  0.321  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -107	  0.310  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -107	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -106	  0.332  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -106	  0.376  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -106	  0.260  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -105	  0.251  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -105	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -105	  0.337  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -105	  0.263  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -104	  0.332  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -104	  0.347  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -104	  0.350  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -103	  0.393  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -103	  0.259  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -103	  0.327  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -102!  33.416  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef   -69	  0.307  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                 -69	  0.358  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                 -68	  0.282  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                 -68	  0.298  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                 -68	  0.431  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                 -67	  0.611  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                 -67	  0.332  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                 -66	  0.446  xnsched_watchdog_handler+0x5 (xntimer_tick_aperiodic+0x78)
:|  # func                 -66	  0.320  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-37     -65	  0.253  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                 -65	  0.300  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                 -65	  0.779  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|   +func                 -64	  0.461  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef   -64	  0.743  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001   -63	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001   -63	  0.325  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001   -62	  0.359  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001   -62	  0.333  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                 -62	  0.324  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001   -61	  0.348  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001   -61	  0.322  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                 -61	  0.403  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001   -60	  0.352  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001   -60	  0.305  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                 -59	  0.257  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -59	  0.255  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -59	  0.375  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -59	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -58	  0.251  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000   -58	  0.302  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -58	  0.441  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -57	  0.313  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001   -57	  0.332  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001   -57	  0.322  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                 -56	  0.310  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                 -56	  0.332  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001   -56	  0.320  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001   -55	  0.311  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                 -55	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001   -55	  0.332  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001   -54	  0.321  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                 -54	  0.262  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -54	  0.249  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -54	  0.373  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -53	  0.333  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -53	  0.272  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001   -53	  0.325  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001   -52	  0.304  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001   -52	  0.332  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001   -52	  0.374  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                 -51	  0.251  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000   -51	  0.342  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e   -51!  16.602  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef   -34+   2.157  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                 -32	  0.471  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                 -31	  0.382  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                 -31	  0.396  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                 -31	  0.611  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                 -30	  0.697  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                 -29	  0.392  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                 -29	  0.534  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                 -28	  0.867  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99   -28	  0.698  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                 -27	  0.933  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@62      -26	  0.639  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                 -25	  0.717  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                 -25+   1.843  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                 -23+   1.286  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # func                 -21+   6.100  __xnlock_spin+0x9 (T.1349+0x55)
:|  # [    0] -<?>-   -1   -15	  0.361  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                 -15	  0.808  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                 -14+   1.508  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99   -13	  0.861  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                 -12	  0.608  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                 -11	  0.398  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000   -11	  0.707  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001   -10	  0.543  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001   -10	  0.465  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001    -9+   1.824  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                  -7	  0.403  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                  -7	  0.358  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001    -7	  0.522  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001    -6	  0.402  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                  -6	  0.416  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001    -5	  0.422  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001    -5	  0.411  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                  -4	  0.509  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                  -4	  0.519  xnshadow_sys_trace+0x6 (hisyscall_event+0x11b)
:   + func                  -3	  0.404  ipipe_trace_frozen_reset+0x6 (xnshadow_sys_trace+0x5c)
:   + func                  -3	  0.394  __ipipe_global_path_lock+0x9 (ipipe_trace_frozen_reset+0x1a)
:   + func                  -3	  0.395  __ipipe_spin_lock_irqsave+0x5 (__ipipe_global_path_lock+0x1d)
:|  + begin   0x80000001    -2+   1.533  hard_local_irq_save+0x16 (__ipipe_spin_lock_irqsave+0x11)
:|  # func                  -1	  0.586  __ipipe_spin_unlock_irqcomplete+0x4 (__ipipe_global_path_unlock+0x62)
:|  + end     0x80000001     0	  0.487  hard_local_irq_restore+0x15 (__ipipe_spin_unlock_irqcomplete+0x24)
<   + freeze  0x00006128     0	  0.538  xnshadow_sys_trace+0x65 (hisyscall_event+0x11b)
 |  + begin   0x80000001     0	  0.502  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
 |  + end     0x80000001     1	  0.465  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
 |  + begin   0x80000001     1	  1.384  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
    + func                   2	  0.377  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
    + func                   3	  0.332  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
 |  + begin   0x80000001     3	  0.502  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
 |  + end     0x80000001     4	  1.121  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
    + func                   5	  0.294  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
 |  + begin   0x80000001     5	  0.299  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
 |  + end     0x80000001     5	  0.000  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)


[max]
I-pipe worst-case tracing service on 3.5.7-trace/ipipe release #3
-------------------------------------------------------------
CPU: 0, Begin: 32286795377514 cycles, Trace Points: 17 (-10/+5), Length: 3854 us
Calibrated minimum trace-point overhead: 0.078 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
     #func                  -4	  0.351  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
 |   #begin   0x80000001    -4	  0.450  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
 |   #end     0x80000001    -4	  0.495  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
     #func                  -3	  0.397  default_idle+0x3 (cpu_idle+0x5d)
 |   #begin   0x80000001    -3	  0.437  debug_smp_processor_id+0x36 (default_idle+0xd)
 |   #end     0x80000001    -2	  0.425  debug_smp_processor_id+0x82 (default_idle+0xd)
 |   #begin   0x80000001    -2	  0.439  debug_smp_processor_id+0x36 (default_idle+0x1e)
 |   #end     0x80000001    -1	  0.509  debug_smp_processor_id+0x82 (default_idle+0x1e)
     #func                  -1	  0.388  __ipipe_halt_root+0x3 (default_idle+0x48)
 |   #begin   0x80000000    -1	  1.048  __ipipe_halt_root+0x1a (default_idle+0x48)
>|   +end     0x8000000e     0! 3842.189  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +func                3842	  0.621  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                3842	  0.478  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                3843	  0.430  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                3843	  0.700  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                3844+   1.266  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                3845+   3.607  __xnlock_spin+0x9 (T.1249+0x47)
:|  # func                3849	  0.569  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                3849	  0.406  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@599884 3850	  0.403  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                3850	  0.408  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                3851	  0.672  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                3851	  0.400  xnintr_host_tick+0x4 (xnintr_clock_handler+0x151)
:|  # func                3852	  0.723  __ipipe_set_irq_pending+0x6 (xnintr_host_tick+0x50)
:|   +func                3852	  0.643  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +func                3853	  0.508  __ipipe_do_sync_stage+0x9 (__ipipe_do_sync_pipeline+0x63)
<|   #end     0x80000000  3854	  0.472  hard_local_irq_enable+0x14 (__ipipe_do_sync_stage+0xbd)
     #func                3854	  0.454  __ipipe_do_IRQ+0x5 (__ipipe_do_sync_stage+0x137)
     #func                3854	  0.407  __ipipe_get_ioapic_irq_vector+0x3 (__ipipe_do_IRQ+0x1d)
     #func                3855	  0.362  smp_apic_timer_interrupt+0x5 (__ipipe_do_IRQ+0x42)
     #func                3855	  0.365  irq_enter+0x4 (smp_apic_timer_interrupt+0x21)
 |   #begin   0x80000001  3856	  0.000  debug_smp_processor_id+0x36 (irq_enter+0xe)

^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: [Xenomai] Decrease Latency (below 10 us) on x32 or x32_64?
  2013-03-28 10:06       ` Manuel Huber
@ 2013-03-28 12:46         ` Gilles Chanteperdrix
  2013-03-28 13:04           ` Manuel Huber
  0 siblings, 1 reply; 12+ messages in thread
From: Gilles Chanteperdrix @ 2013-03-28 12:46 UTC (permalink / raw)
  To: Manuel Huber; +Cc: xenomai

On 03/28/2013 11:06 AM, Manuel Huber wrote:

> On 2013-03-26 12:57, Gilles Chanteperdrix wrote:
>> On 03/26/2013 11:18 AM, Manuel Huber wrote:
>>
>>> Hello!
>>>
>>> Sorry for the delay. I have re-compiled the Kernel with the I-pipe
>>> tracer enabled, and I disabled the HPET. Then, I tried to reset the
>>> tracer by writing 0 to /proc/ipipe/trace/frozen and some string to
>>> /proc/ipipe/trace/max. Then I started the latency program with the -f
>>> option for some minutes and afterwards captured the variables in
>>> /proc/ipipe/trace/. One test has been made in single-user mode and
>>> without the nouveau driver (plain-vga_300.txt) and the other trace has
>>> been made in normal multi-user mode with gdm running (and the nouveau
>>> driver; gui_300.txt). There is one trace without any USB-device
>>> attached (plain-vga_300_no_usb.txt), but I'm not sure if that makes
>>> any difference.
>>>
>>> I hope I used the I-pipe tracer correctly. I'm sorry to bother you
>>> again, but I can't interpret the results :( Maybe you could interpret
>>> the trace, if you have time for it...
>>
>> The traces are too short. Try:
>> echo 1000 > /proc/ipipe/trace/back_trace_points
>>
>> There should be at least a "tick@" trace indicating the time when the
>> timer was supposed to tick and when it did not, so that we have an idea
>> of the latency.
>>
>> What is the period you use for the latency test?
>>
> Hello!
> 
> Sorry, I have run the same tests again, just with back_trace_points
> set to 1000. I've run the latency tool for 5 minutes with a period of
> 100 us (default).


Well, there is only one strange spot:
:|  # func                 -31	  0.324  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                 -31+   8.732  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                 -22+   3.484  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # func                 -19+   5.443  __xnlock_spin+0x9 (T.1349+0x55)
:|  # [ 1996] Xorg    -1   -13	  0.211  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)

Which would indicate that maybe the bus is busy with another core.
But strangely the latency is around 36us as measure with the other traces.
>From your traces, I do not see anything pathological.

> 
> I don't think it's related, but xeno-test fails on the machine, and I
> think it's because of CONFIG_XENO_OPT_SYS_HEAPSZ. I have multiplied it
> with a factor of 6 (as described here:
> http://osdir.com/ml/linux.real-time.xenomai.users/2007-03/msg00251.html).


And the error message is...?

-- 
                                                                Gilles.


^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: [Xenomai] Decrease Latency (below 10 us) on x32 or x32_64?
  2013-03-28 12:46         ` Gilles Chanteperdrix
@ 2013-03-28 13:04           ` Manuel Huber
  2013-03-28 20:24             ` Gilles Chanteperdrix
  0 siblings, 1 reply; 12+ messages in thread
From: Manuel Huber @ 2013-03-28 13:04 UTC (permalink / raw)
  To: Gilles Chanteperdrix, xenomai

On 2013-03-28 13:46, Gilles Chanteperdrix wrote:
> On 03/28/2013 11:06 AM, Manuel Huber wrote:
>
>> On 2013-03-26 12:57, Gilles Chanteperdrix wrote:
>>> On 03/26/2013 11:18 AM, Manuel Huber wrote:
>>>
>>>> Hello!
>>>>
>>>> Sorry for the delay. I have re-compiled the Kernel with the I-pipe
>>>> tracer enabled, and I disabled the HPET. Then, I tried to reset the
>>>> tracer by writing 0 to /proc/ipipe/trace/frozen and some string to
>>>> /proc/ipipe/trace/max. Then I started the latency program with the -f
>>>> option for some minutes and afterwards captured the variables in
>>>> /proc/ipipe/trace/. One test has been made in single-user mode and
>>>> without the nouveau driver (plain-vga_300.txt) and the other trace has
>>>> been made in normal multi-user mode with gdm running (and the nouveau
>>>> driver; gui_300.txt). There is one trace without any USB-device
>>>> attached (plain-vga_300_no_usb.txt), but I'm not sure if that makes
>>>> any difference.
>>>>
>>>> I hope I used the I-pipe tracer correctly. I'm sorry to bother you
>>>> again, but I can't interpret the results :( Maybe you could interpret
>>>> the trace, if you have time for it...
>>> The traces are too short. Try:
>>> echo 1000 > /proc/ipipe/trace/back_trace_points
>>>
>>> There should be at least a "tick@" trace indicating the time when the
>>> timer was supposed to tick and when it did not, so that we have an idea
>>> of the latency.
>>>
>>> What is the period you use for the latency test?
>>>
>> Hello!
>>
>> Sorry, I have run the same tests again, just with back_trace_points
>> set to 1000. I've run the latency tool for 5 minutes with a period of
>> 100 us (default).
>
> Well, there is only one strange spot:
> :|  # func                 -31	  0.324  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
> :|  # func                 -31+   8.732  lapic_next_event+0x3 (ipipe_timer_set+0x77)
> :|  # func                 -22+   3.484  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
> :|  # func                 -19+   5.443  __xnlock_spin+0x9 (T.1349+0x55)
> :|  # [ 1996] Xorg    -1   -13	  0.211  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
>
> Which would indicate that maybe the bus is busy with another core.
> But strangely the latency is around 36us as measure with the other traces.
>  From your traces, I do not see anything pathological.
>
>> I don't think it's related, but xeno-test fails on the machine, and I
>> think it's because of CONFIG_XENO_OPT_SYS_HEAPSZ. I have multiplied it
>> with a factor of 6 (as described here:
>> http://osdir.com/ml/linux.real-time.xenomai.users/2007-03/msg00251.html).
>
> And the error message is...?
>
Hello!

>  From your traces, I do not see anything pathological.
Would you expect the timing to be better with a 64bit-Kernel? Could
it be related to memory management overhead of the Kernel...

> And the error message is...?
Oh, sorry; The message was:
ioctl(RTTST_RTIOC_SWTEST_CREATE_KTASK): Cannot allocate memory
I multiplied CONFIG_XENO_OPT_SYS_HEAPSZ and CONFIG_XENO_OPT_SYS_STACKPOOLSZ
each by a factor of 6. The resulting values are:
CONFIG_XENO_OPT_SYS_HEAPSZ = 1536
CONFIG_XENO_OPT_SYS_STACKPOOLSZ = 768

I got the info from an old posting you wrote and it fixed the
problem as expected.




^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: [Xenomai] Decrease Latency (below 10 us) on x32 or x32_64?
  2013-03-28 13:04           ` Manuel Huber
@ 2013-03-28 20:24             ` Gilles Chanteperdrix
  2013-04-02 17:49               ` Manuel Huber
  0 siblings, 1 reply; 12+ messages in thread
From: Gilles Chanteperdrix @ 2013-03-28 20:24 UTC (permalink / raw)
  To: Manuel Huber; +Cc: xenomai

On 03/28/2013 02:04 PM, Manuel Huber wrote:

> On 2013-03-28 13:46, Gilles Chanteperdrix wrote:
>> On 03/28/2013 11:06 AM, Manuel Huber wrote:
>>
>>> On 2013-03-26 12:57, Gilles Chanteperdrix wrote:
>>>> On 03/26/2013 11:18 AM, Manuel Huber wrote:
>>>>
>>>>> Hello!
>>>>>
>>>>> Sorry for the delay. I have re-compiled the Kernel with the I-pipe
>>>>> tracer enabled, and I disabled the HPET. Then, I tried to reset the
>>>>> tracer by writing 0 to /proc/ipipe/trace/frozen and some string to
>>>>> /proc/ipipe/trace/max. Then I started the latency program with the -f
>>>>> option for some minutes and afterwards captured the variables in
>>>>> /proc/ipipe/trace/. One test has been made in single-user mode and
>>>>> without the nouveau driver (plain-vga_300.txt) and the other trace has
>>>>> been made in normal multi-user mode with gdm running (and the nouveau
>>>>> driver; gui_300.txt). There is one trace without any USB-device
>>>>> attached (plain-vga_300_no_usb.txt), but I'm not sure if that makes
>>>>> any difference.
>>>>>
>>>>> I hope I used the I-pipe tracer correctly. I'm sorry to bother you
>>>>> again, but I can't interpret the results :( Maybe you could interpret
>>>>> the trace, if you have time for it...
>>>> The traces are too short. Try:
>>>> echo 1000 > /proc/ipipe/trace/back_trace_points
>>>>
>>>> There should be at least a "tick@" trace indicating the time when the
>>>> timer was supposed to tick and when it did not, so that we have an idea
>>>> of the latency.
>>>>
>>>> What is the period you use for the latency test?
>>>>
>>> Hello!
>>>
>>> Sorry, I have run the same tests again, just with back_trace_points
>>> set to 1000. I've run the latency tool for 5 minutes with a period of
>>> 100 us (default).
>>
>> Well, there is only one strange spot:
>> :|  # func                 -31	  0.324  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
>> :|  # func                 -31+   8.732  lapic_next_event+0x3 (ipipe_timer_set+0x77)
>> :|  # func                 -22+   3.484  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
>> :|  # func                 -19+   5.443  __xnlock_spin+0x9 (T.1349+0x55)
>> :|  # [ 1996] Xorg    -1   -13	  0.211  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
>>
>> Which would indicate that maybe the bus is busy with another core.
>> But strangely the latency is around 36us as measure with the other traces.
>>  From your traces, I do not see anything pathological.
>>
>>> I don't think it's related, but xeno-test fails on the machine, and I
>>> think it's because of CONFIG_XENO_OPT_SYS_HEAPSZ. I have multiplied it
>>> with a factor of 6 (as described here:
>>> http://osdir.com/ml/linux.real-time.xenomai.users/2007-03/msg00251.html).
>>
>> And the error message is...?
>>
> Hello!
> 
>>  From your traces, I do not see anything pathological.
> Would you expect the timing to be better with a 64bit-Kernel? Could
> it be related to memory management overhead of the Kernel...


You would probably have better latencies with using Xenomai on only one 
core. But 36us with the tracer on does not look so bad, does it?

Did you try the configuration options I gave in the answer to your 
first mail?

> 
>> And the error message is...?
> Oh, sorry; The message was:
> ioctl(RTTST_RTIOC_SWTEST_CREATE_KTASK): Cannot allocate memory
> I multiplied CONFIG_XENO_OPT_SYS_HEAPSZ and CONFIG_XENO_OPT_SYS_STACKPOOLSZ
> each by a factor of 6. The resulting values are:
> CONFIG_XENO_OPT_SYS_HEAPSZ = 1536
> CONFIG_XENO_OPT_SYS_STACKPOOLSZ = 768
> 
> I got the info from an old posting you wrote and it fixed the
> problem as expected.


This is also documented in the TROUBLESHOOTING guide:
http://www.xenomai.org/documentation/xenomai-2.6/html/TROUBLESHOOTING/#_switchtest_fails_with_pthread_create_resource_temporarily_unavailable

-- 
                                                                Gilles.


^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: [Xenomai] Decrease Latency (below 10 us) on x32 or x32_64?
  2013-03-28 20:24             ` Gilles Chanteperdrix
@ 2013-04-02 17:49               ` Manuel Huber
  2013-04-02 22:20                 ` Gilles Chanteperdrix
  0 siblings, 1 reply; 12+ messages in thread
From: Manuel Huber @ 2013-04-02 17:49 UTC (permalink / raw)
  To: Gilles Chanteperdrix, xenomai

Hello!

Okay, I miss-configured the last kernel, HPET was still on. Now I compiled
one version on 32bit and one on 64bit. Sorry for the delay, I had some
issues with 64bit (RTL8169 card doesn't work; I have to check what's the
problem (I will open another thread for this, but maybe it's just related
to our machine because there is an on-board chip that may cause the
problem...). I've included two trace-files, one for 32bits and one for
64bits, both with HPET disabled.

I also checked the C1 Setting in BIOS and the kernel configuration:

|---------------------------+----------|
| AMD C1E Support           | Disabled |
| AMD K8 Cool&Quiet control | Disabled |
|---------------------------+----------|
| HPET Support              | Disabled |
|---------------------------+----------|

> You would probably have better latencies with using Xenomai on only one
> core. But 36us with the tracer on does not look so bad, does it?

Is it enough to boot the kernel with isolcpus=cpu-id and then run the
latency tool with the -c option or do I have to restrict IRQ's to the
specific cpu-id? Do I have to adjust /proc/irq/<some-number>/smp_affinity,
or is there some other thing I have to do?

So, the timing of the system is awesome most of the time. I just wanted to
clarify, whether there is a problem with my setup, or it's normal. It would
be cool to get rid of let's say all above 10µs. It just rarely happens, but
it does.

These were the results (tracer disabled) of a test in single/vga mode
(nouveau driver not in use), with heavy stress on the system (nice -20; 10
instances of burnK7) and IRQ mode (latency -t 2) for 1 hour. (I have
already posted them, just to point out the problem)

Thanks again for your help!

Statistics
----------

|-----+---------+---------+---------+---------+-----+-------------------|
| RTH | lat min | lat avg | lat max | overrun | msw | time              |
| RTS |  -3.386 |  -2.725 |  19.469 |       0 |   0 | 01:00:00/01:00:00 |
|-----+---------+---------+---------+---------+-----+-------------------|

|-----+-------+----------+---------+--------|
| HSH | param |  samples | average | stddev |
| HSS | min   |     3599 |  29.278 |  1.983 |
| HSS | avg   | 35994101 |  26.799 |  0.940 |
| HSS | max   |     3599 |  35.500 | 13.080 |
|-----+-------+----------+---------+--------|

Histogram
---------

+-----+--------+
|0    |1       |
+-----+--------+
|0.05 |2289    |
+-----+--------+
|0.15 |2305    |
+-----+--------+
|0.25 |2363    |
+-----+--------+
|0.35 |2327    |
+-----+--------+
|0.45 |2311    |
+-----+--------+
|0.55 |2334    |
+-----+--------+
|0.65 |2446    |
+-----+--------+
|0.75 |2551    |
+-----+--------+
|0.85 |2502    |
+-----+--------+
|0.95 |2561    |
+-----+--------+
|1.05 |2694    |
+-----+--------+
|1.15 |2721    |
+-----+--------+
|1.25 |2726    |
+-----+--------+
|1.35 |2907    |
+-----+--------+
|1.45 |3203    |
+-----+--------+
|1.55 |4114    |
+-----+--------+
|1.65 |4049    |
+-----+--------+
|1.75 |3856    |
+-----+--------+
|1.85 |4423    |
+-----+--------+
|1.95 |5150    |
+-----+--------+
|2.05 |6381    |
+-----+--------+
|2.15 |9045    |
+-----+--------+
|2.25 |17539   |
+-----+--------+
|2.35 |51949   |
+-----+--------+
|2.45 |167344  |
+-----+--------+
|2.55 |444769  |
+-----+--------+
|2.65 |6966129 |
+-----+--------+
|2.75 |25850498|
+-----+--------+
|2.85 |2407380 |
+-----+--------+
|2.95 |3263    |
+-----+--------+
|3.05 |2117    |
+-----+--------+
|3.15 |1878    |
+-----+--------+
|3.25 |1655    |
+-----+--------+
|3.35 |951     |
+-----+--------+
|3.45 |221     |
+-----+--------+
|3.55 |227     |
+-----+--------+
|3.65 |272     |
+-----+--------+
|3.75 |303     |
+-----+--------+
|3.85 |367     |
+-----+--------+
|3.95 |355     |
+-----+--------+
|4.05 |238     |
+-----+--------+
|4.15 |362     |
+-----+--------+
|4.25 |467     |
+-----+--------+
|4.35 |69      |
+-----+--------+
|4.45 |38      |
+-----+--------+
|4.55 |33      |
+-----+--------+
|4.65 |32      |
+-----+--------+
|4.75 |31      |
+-----+--------+
|4.85 |24      |
+-----+--------+
|4.95 |26      |
+-----+--------+
|5.05 |18      |
+-----+--------+
|5.15 |22      |
+-----+--------+
|5.25 |11      |
+-----+--------+
|5.35 |21      |
+-----+--------+
|5.45 |11      |
+-----+--------+
|5.55 |23      |
+-----+--------+
|5.65 |23      |
+-----+--------+
|5.75 |10      |
+-----+--------+
|5.85 |16      |
+-----+--------+
|5.95 |9       |
+-----+--------+
|6.05 |11      |
+-----+--------+
|6.15 |7       |
+-----+--------+
|6.25 |3       |
+-----+--------+
|6.35 |7       |
+-----+--------+
|6.45 |15      |
+-----+--------+
|6.55 |8       |
+-----+--------+
|6.65 |11      |
+-----+--------+
|6.75 |7       |
+-----+--------+
|6.85 |7       |
+-----+--------+
|6.95 |6       |
+-----+--------+
|7.05 |4       |
+-----+--------+
|7.15 |1       |
+-----+--------+
|7.25 |5       |
+-----+--------+
|7.35 |6       |
+-----+--------+
|7.45 |4       |
+-----+--------+
|7.55 |8       |
+-----+--------+
|7.65 |2       |
+-----+--------+
|7.75 |6       |
+-----+--------+
|7.85 |2       |
+-----+--------+
|7.95 |3       |
+-----+--------+
|8.15 |1       |
+-----+--------+
|8.45 |1       |
+-----+--------+
|8.55 |1       |
+-----+--------+
|9.15 |1       |
+-----+--------+
|9.65 |1       |
+-----+--------+
|10.15|1       |
+-----+--------+
|10.55|2       |
+-----+--------+
|10.65|1       |
+-----+--------+
|11.25|1       |
+-----+--------+
|11.35|1       |
+-----+--------+
|12.75|2       |
+-----+--------+
|13.75|1       |
+-----+--------+
|14.15|1       |
+-----+--------+
|15.35|1       |
+-----+--------+
|15.65|1       |
+-----+--------+
|16.95|1       |
+-----+--------+
|19.45|1       |
+-----+--------+
|19.5 |1       |
+-----+--------+

-------------- next part --------------
I-pipe trace results
--------------------
name: 'plain-vga_300_32b_nohpet'

[parameters]
enable = 1
verbose = 1
pre_trace_points = 10
back_trace_points = 1000
post_trace_points = 10


[frozen]
I-pipe frozen back-tracing service on 3.5.7-trace3-nohpet/ipipe release #3
------------------------------------------------------------
CPU: 0, Freeze: 1161030721374 cycles, Trace Points: 1000 (+10)
Calibrated minimum trace-point overhead: 0.077 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
:|   +begin   0x000000ef  -936	  0.233  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -935	  0.275  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -935	  0.216  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -935	  0.222  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -935	  0.339  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -934	  0.418  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -934	  0.259  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -934	  0.205  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -933	  0.250  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1168] -<?>-   99  -933	  0.344  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -933	  0.242  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-838   -933	  0.205  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -932	  0.245  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -932	  0.438  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -932	  0.375  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -931	  0.232  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -931	  0.517  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -931	  0.815  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1168] -<?>-   99  -930	  0.544  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -929	  0.342  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -929	  0.259  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -929	  0.382  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -928	  0.310  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -928	  0.263  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -928+   1.014  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -927	  0.229  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -926	  0.229  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -926	  0.338  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -926	  0.253  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -926	  0.254  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -925	  0.280  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -925	  0.218  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -925	  0.248  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -925	  0.205  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -924	  0.200  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -924	  0.214  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -924	  0.368  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  # func                -924	  0.284  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -923	  0.298  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1168] -<?>-   99  -923	  0.238  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -923	  0.543  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -922	  0.627  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -922	  0.641  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -921	  0.373  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -921	  0.592  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -920	  0.245  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -920	  0.259  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -920	  0.243  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -919	  0.266  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -919	  0.263  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -919	  0.264  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -919	  0.244  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -918	  0.245  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -918	  0.240  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -918	  0.227  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -918	  0.189  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -917	  0.208  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -917	  0.290  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -917	  0.244  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -917	  0.196  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -916	  0.235  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -916	  0.338  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -916	  0.241  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -916	  0.249  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -915	  0.240  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -915	  0.235  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -915	  0.251  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -915	  0.248  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -914	  0.234  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -914	  0.210  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -914	  0.250  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -914	  0.242  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -913	  0.200  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -913	  0.208  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -913	  0.276  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -913	  0.254  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -913	  0.199  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -912	  0.247  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -912	  0.236  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -912	  0.247  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -912	  0.288  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -911	  0.198  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -911	  0.249  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -911!  75.176  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -836	  0.259  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -835	  0.276  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -835	  0.216  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -835	  0.222  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -835	  0.350  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -834	  0.413  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -834	  0.259  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -834	  0.205  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -833	  0.263  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1168] -<?>-   99  -833	  0.344  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -833	  0.245  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-738   -833	  0.211  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -832	  0.240  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -832	  0.432  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -832	  0.380  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -831	  0.228  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -831	  0.525  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -831	  0.816  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1168] -<?>-   99  -830	  0.550  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -829	  0.341  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -829	  0.260  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -829	  0.396  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -828	  0.307  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -828	  0.263  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -828+   1.032  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -827	  0.239  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -826	  0.232  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -826	  0.338  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -826	  0.256  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -826	  0.254  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -825	  0.283  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -825	  0.224  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -825	  0.244  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -825	  0.196  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -824	  0.209  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -824	  0.201  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -824	  0.364  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  # func                -824	  0.292  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -823	  0.315  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1168] -<?>-   99  -823	  0.273  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -823	  0.516  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -822	  0.562  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -822	  0.667  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -821	  0.393  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -821	  0.590  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -820	  0.248  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -820	  0.255  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -819	  0.256  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -819	  0.257  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -819	  0.254  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -819	  0.256  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -818	  0.243  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -818	  0.238  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -818	  0.260  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -818	  0.235  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -817	  0.199  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -817	  0.198  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -817	  0.283  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -817	  0.243  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -817	  0.197  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -816	  0.237  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -816	  0.333  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -816	  0.234  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -816	  0.246  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -815	  0.241  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -815	  0.230  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -815	  0.249  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -815	  0.248  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -814	  0.234  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -814	  0.210  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -814	  0.258  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -814	  0.281  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -813	  0.192  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -813	  0.193  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -813	  0.278  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -813	  0.252  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -812	  0.204  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -812	  0.287  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -812	  0.241  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -812	  0.253  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -811	  0.297  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -811	  0.198  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -811	  0.259  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -811!  75.037  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -736	  0.232  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -735	  0.280  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -735	  0.205  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -735	  0.229  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -735	  0.341  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -734	  0.425  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -734	  0.253  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -734	  0.215  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -733	  0.247  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1168] -<?>-   99  -733	  0.324  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -733	  0.260  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-638   -733	  0.203  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -732	  0.235  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -732	  0.431  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -732	  0.375  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -731	  0.225  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -731	  0.514  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -731	  0.737  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1168] -<?>-   99  -730	  0.543  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -729	  0.344  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -729	  0.251  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -729	  0.403  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -728	  0.307  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -728	  0.267  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -728+   1.019  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -727	  0.220  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -727	  0.217  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -726	  0.306  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -726	  0.225  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -726	  0.220  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -726	  0.253  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -725	  0.223  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -725	  0.212  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -725	  0.197  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -725	  0.202  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -724	  0.204  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -724	  0.364  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  # func                -724	  0.297  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -724	  0.299  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1168] -<?>-   99  -723	  0.239  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -723	  0.518  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -723	  0.560  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -722	  0.659  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -721	  0.378  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -721	  0.592  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -720	  0.258  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -720	  0.257  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -720	  0.251  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -720	  0.260  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -719	  0.261  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -719	  0.260  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -719	  0.245  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -719	  0.240  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -718	  0.257  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -718	  0.233  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -718	  0.226  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -718	  0.198  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -717	  0.291  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -717	  0.246  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -717	  0.196  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -717	  0.234  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -716	  0.325  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -716	  0.234  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -716	  0.246  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -716	  0.236  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -715	  0.226  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -715	  0.250  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -715	  0.248  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -715	  0.234  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -714	  0.210  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -714	  0.243  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -714	  0.244  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -714	  0.200  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -714	  0.208  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -713	  0.276  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -713	  0.254  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -713	  0.199  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -713	  0.247  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -712	  0.236  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -712	  0.254  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -712	  0.286  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -712	  0.202  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -711	  0.253  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -711!  75.469  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -636	  0.229  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -635	  0.280  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -635	  0.205  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -635	  0.229  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -635	  0.347  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -634	  0.420  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -634	  0.253  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -634	  0.215  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -633	  0.247  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1168] -<?>-   99  -633	  0.338  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -633	  0.258  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-538   -633	  0.217  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -632	  0.250  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -632	  0.437  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -632	  0.380  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -631	  0.224  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -631	  0.527  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -631	  0.742  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1168] -<?>-   99  -630	  0.547  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -629	  0.341  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -629	  0.251  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -629	  0.403  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -628	  0.319  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -628	  0.266  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -628+   1.052  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -627	  0.217  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -626	  0.219  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -626	  0.301  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -626	  0.217  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -626	  0.223  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -625	  0.251  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -625	  0.225  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -625	  0.235  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -625	  0.195  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -625	  0.198  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -624	  0.207  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -624	  0.363  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  # func                -624	  0.284  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -624	  0.300  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1168] -<?>-   99  -623	  0.240  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -623	  0.523  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -622	  0.562  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -622	  0.663  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -621	  0.392  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -621	  0.584  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -620	  0.248  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -620	  0.255  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -620	  0.249  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -619	  0.263  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -619	  0.257  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -619	  0.256  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -619	  0.241  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -618	  0.241  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -618	  0.256  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -618	  0.236  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -618	  0.189  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -618	  0.195  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -617	  0.284  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -617	  0.249  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -617	  0.199  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -617	  0.236  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -616	  0.329  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -616	  0.234  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -616	  0.246  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -616	  0.242  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -615	  0.239  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -615	  0.250  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -615	  0.248  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -615	  0.234  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -614	  0.210  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -614	  0.243  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -614	  0.243  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -614	  0.235  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -613	  0.201  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -613	  0.288  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -613	  0.247  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -613	  0.209  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -612	  0.245  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -612	  0.229  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -612	  0.247  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -612	  0.286  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -611	  0.199  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -611	  0.259  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -611!  75.416  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -536	  0.229  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -535	  0.280  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -535	  0.205  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -535	  0.229  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -535	  0.347  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -534	  0.419  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -534	  0.254  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -534	  0.215  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -533	  0.252  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1168] -<?>-   99  -533	  0.336  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -533	  0.247  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-438   -533	  0.204  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -532	  0.245  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -532	  0.429  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -532	  0.375  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -531	  0.225  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -531	  0.500  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -531	  0.737  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1168] -<?>-   99  -530	  0.543  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -529	  0.344  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -529	  0.251  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -529	  0.403  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -528	  0.309  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -528	  0.266  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -528+   1.029  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -527	  0.220  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -526	  0.205  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -526	  0.306  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -526	  0.217  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -526	  0.223  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -526	  0.249  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -525	  0.225  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -525	  0.225  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -525	  0.193  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -525	  0.191  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -524	  0.204  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -524	  0.362  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  # func                -524	  0.297  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -524	  0.299  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1168] -<?>-   99  -523	  0.247  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -523	  0.554  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -522	  0.564  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -522	  0.650  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -521	  0.379  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -521	  0.586  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -520	  0.252  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -520	  0.259  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -520	  0.256  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -520	  0.260  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -519	  0.255  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -519	  0.264  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -519	  0.244  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -518	  0.241  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -518	  0.256  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -518	  0.237  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -518	  0.223  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -518	  0.199  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -517	  0.281  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -517	  0.249  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -517	  0.196  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -517	  0.234  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -516	  0.331  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -516	  0.234  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -516	  0.246  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -516	  0.242  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -515	  0.230  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -515	  0.252  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -515	  0.245  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -515	  0.234  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -514	  0.210  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -514	  0.243  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -514	  0.244  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -514	  0.200  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -513	  0.208  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -513	  0.276  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -513	  0.249  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -513	  0.205  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -513	  0.249  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -512	  0.229  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -512	  0.247  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -512	  0.286  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -512	  0.199  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -511	  0.255  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -511!  75.391  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -436	  0.228  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -435	  0.280  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -435	  0.205  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -435	  0.229  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -435	  0.355  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -434	  0.419  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -434	  0.254  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -434	  0.214  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -433	  0.254  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1168] -<?>-   99  -433	  0.338  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -433	  0.258  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-338   -433	  0.206  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -432	  0.244  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -432	  0.442  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -432	  0.381  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -431	  0.226  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -431	  0.515  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -431	  0.738  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1168] -<?>-   99  -430	  0.564  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -429	  0.341  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -429	  0.251  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -429	  0.395  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -428	  0.310  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -428	  0.264  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -428+   1.004  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -427	  0.249  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -426	  0.219  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -426	  0.301  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -426	  0.217  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -426	  0.218  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -426	  0.245  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -425	  0.223  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -425	  0.232  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -425	  0.201  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -425	  0.196  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -424	  0.205  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -424	  0.364  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  # func                -424	  0.297  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -424	  0.309  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1168] -<?>-   99  -423	  0.239  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -423	  0.518  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -422	  0.560  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -422	  0.659  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -421	  0.395  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -421	  0.597  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -420	  0.261  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -420	  0.257  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -420	  0.255  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -420	  0.257  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -419	  0.254  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -419	  0.256  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -419	  0.244  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -418	  0.241  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -418	  0.255  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -418	  0.236  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -418	  0.189  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -418	  0.195  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -417	  0.284  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -417	  0.249  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -417	  0.204  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -417	  0.231  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -416	  0.329  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -416	  0.235  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -416	  0.249  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -416	  0.242  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -415	  0.230  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -415	  0.268  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -415	  0.251  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -415	  0.226  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -414	  0.208  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -414	  0.262  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -414	  0.270  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -414	  0.193  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -413	  0.193  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -413	  0.278  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -413	  0.252  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -413	  0.204  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -413	  0.248  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -412	  0.230  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -412	  0.247  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -412	  0.286  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -411	  0.199  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -411	  0.259  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -411!  75.408  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -336	  0.233  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -335	  0.279  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -335	  0.216  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -335	  0.222  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -335	  0.350  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -334	  0.428  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -334	  0.260  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -334	  0.215  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -333	  0.241  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1168] -<?>-   99  -333	  0.412  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -333	  0.244  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-238   -333	  0.205  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -332	  0.238  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -332	  0.437  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -332	  0.379  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -331	  0.229  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -331	  0.515  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -331	  0.815  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1168] -<?>-   99  -330	  0.542  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -329	  0.341  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -329	  0.260  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -329	  0.382  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -328	  0.310  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -328	  0.263  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -328+   1.013  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -327	  0.229  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -326	  0.229  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -326	  0.337  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -326	  0.254  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -326	  0.254  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -325	  0.280  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -325	  0.225  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -325	  0.226  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -325	  0.192  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -324	  0.198  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -324	  0.203  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -324	  0.369  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  # func                -324	  0.294  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -323	  0.298  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1168] -<?>-   99  -323	  0.247  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -323	  0.529  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -322	  0.579  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -322	  0.643  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -321	  0.372  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -321	  0.586  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -320	  0.240  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -320	  0.259  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -320	  0.243  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -319	  0.266  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -319	  0.254  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -319	  0.256  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -319	  0.241  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -318	  0.241  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -318	  0.256  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -318	  0.237  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -318	  0.205  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -317	  0.201  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -317	  0.285  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -317	  0.247  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -317	  0.204  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -316	  0.227  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -316	  0.338  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -316	  0.241  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -316	  0.252  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -315	  0.235  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -315	  0.238  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -315	  0.257  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -315	  0.256  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -314	  0.231  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -314	  0.210  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -314	  0.258  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -314	  0.270  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -313	  0.193  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -313	  0.193  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -313	  0.284  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -313	  0.252  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -312	  0.195  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -312	  0.250  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -312	  0.236  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -312	  0.247  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -312	  0.288  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -311	  0.198  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -311	  0.249  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -311!  75.134  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -236	  0.230  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -235	  0.276  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -235	  0.206  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -235	  0.221  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -235	  0.337  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -234	  0.416  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -234	  0.259  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -234	  0.215  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -233	  0.244  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1168] -<?>-   99  -233	  0.417  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -233	  0.247  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-138   -233	  0.205  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -232	  0.244  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -232	  0.446  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -232	  0.380  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -231	  0.228  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -231	  0.521  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -231	  0.816  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1168] -<?>-   99  -230	  0.542  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -229	  0.343  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -229	  0.260  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -229	  0.382  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -228	  0.310  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -228	  0.263  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -228+   1.023  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -227	  0.228  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -226	  0.226  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -226	  0.332  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -226	  0.247  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -226	  0.251  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -225	  0.285  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -225	  0.227  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -225	  0.231  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -225	  0.200  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -224	  0.220  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -224	  0.206  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -224	  0.367  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  # func                -224	  0.294  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -223	  0.299  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1168] -<?>-   99  -223	  0.247  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -223	  0.521  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -222	  0.621  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -222	  0.642  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -221	  0.377  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -221	  0.592  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -220	  0.276  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -220	  0.270  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -219	  0.256  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -219	  0.263  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -219	  0.255  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -219	  0.263  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -218	  0.242  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -218	  0.248  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -218	  0.240  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -218	  0.231  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -217	  0.199  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -217	  0.198  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -217	  0.283  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -217	  0.255  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -216	  0.224  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -216	  0.241  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -216	  0.337  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -216	  0.236  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -215	  0.253  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -215	  0.246  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -215	  0.227  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -215	  0.253  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -214	  0.265  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -214	  0.225  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -214	  0.210  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -214	  0.241  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -214	  0.249  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -213	  0.201  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -213	  0.208  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -213	  0.289  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -213	  0.245  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -212	  0.212  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -212	  0.256  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -212	  0.231  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -212	  0.252  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -211	  0.293  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -211	  0.207  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -211	  0.250  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -211!  74.976  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -136	  0.232  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -135	  0.283  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -135	  0.216  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -135	  0.221  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -135	  0.342  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -134	  0.439  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -134	  0.257  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -134	  0.217  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -133	  0.247  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1168] -<?>-   99  -133	  0.354  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -133	  0.260  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-38    -133	  0.198  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -132	  0.230  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -132	  0.476  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -132	  0.396  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -131	  0.214  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -131	  0.509  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -131	  0.833  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1168] -<?>-   99  -130	  0.544  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -129	  0.358  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -129	  0.239  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -129	  0.375  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -128	  0.310  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -128	  0.266  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -128+   1.024  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -127	  0.227  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -126	  0.233  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -126	  0.323  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -126	  0.240  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -126	  0.233  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -125	  0.266  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -125	  0.237  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -125	  0.234  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -125	  0.213  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -124	  0.222  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -124	  0.220  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -124	  0.388  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  # func                -124	  0.292  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -123	  0.302  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1168] -<?>-   99  -123	  0.228  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -123	  0.279  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -122	  0.279  xntimer_next_local_shot+0x9 (__xnpod_schedule+0x1e0)
:|  # event   tick@-107   -122	  0.211  xntimer_next_local_shot+0xbd (__xnpod_schedule+0x1e0)
:|  # func                -122	  0.231  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -122	  0.504  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -121	  0.623  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -121	  0.648  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -120	  0.366  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -120	  0.591  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -119	  0.251  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -119	  0.259  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -118	  0.264  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -118	  0.267  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -118	  0.254  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -118	  0.256  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -117	  0.240  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -117	  0.241  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -117	  0.255  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -117	  0.232  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -116	  0.204  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -116	  0.198  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -116	  0.291  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -116	  0.244  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -116	  0.196  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -115	  0.235  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -115	  0.338  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -115	  0.241  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -115	  0.249  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -114	  0.240  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -114	  0.235  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -114	  0.257  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -114	  0.256  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -113	  0.231  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -113	  0.233  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -113	  0.259  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -113	  0.244  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -112	  0.199  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -112	  0.205  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -112	  0.283  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -112	  0.248  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -111	  0.196  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -111	  0.248  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -111	  0.234  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -111	  0.253  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -110	  0.296  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -110	  0.196  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -110	  0.257  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -110+   4.796  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -105	  0.233  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -105+   1.861  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -103	  0.342  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -102	  0.311  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -102	  0.442  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -102	  0.558  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -101	  0.376  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -101	  0.353  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-38    -100	  0.332  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -100	  0.513  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -100	  0.754  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                 -99	  0.302  xnintr_host_tick+0x4 (xnintr_clock_handler+0x151)
:|  # func                 -99	  0.553  __ipipe_set_irq_pending+0x6 (xnintr_host_tick+0x50)
:|   +func                 -98	  0.407  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +func                 -98	  0.521  __ipipe_do_sync_stage+0x9 (__ipipe_do_sync_pipeline+0x63)
:|   #end     0x80000000   -97	  0.289  hard_local_irq_enable+0x14 (__ipipe_do_sync_stage+0xbd)
:    #func                 -97	  0.278  __ipipe_do_IRQ+0x5 (__ipipe_do_sync_stage+0x137)
:    #func                 -96	  0.311  __ipipe_get_ioapic_irq_vector+0x3 (__ipipe_do_IRQ+0x1d)
:    #func                 -96	  0.279  smp_apic_timer_interrupt+0x5 (__ipipe_do_IRQ+0x42)
:    #func                 -96	  0.280  irq_enter+0x4 (smp_apic_timer_interrupt+0x21)
:|   #begin   0x80000001   -96	  0.334  debug_smp_processor_id+0x36 (irq_enter+0xe)
:|   #end     0x80000001   -95	  0.317  debug_smp_processor_id+0x82 (irq_enter+0xe)
:    #func                 -95	  0.338  rcu_irq_enter+0x9 (irq_enter+0x15)
:|   #begin   0x80000001   -95	  0.320  debug_smp_processor_id+0x36 (rcu_irq_enter+0x4d)
:|   #end     0x80000001   -94	  0.303  debug_smp_processor_id+0x82 (rcu_irq_enter+0x4d)
:    #func                 -94	  0.286  rcu_idle_exit_common+0x5 (rcu_irq_enter+0x9e)
:|   #begin   0x80000001   -94	  0.334  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001   -93	  0.326  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                 -93	  0.303  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -93	  0.261  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -92	  0.387  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -92	  0.370  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -92	  0.290  local_bh_disable+0x3 (irq_enter+0x39)
:    #func                 -91	  0.289  add_preempt_count+0x4 (local_bh_disable+0x12)
:    #func                 -91	  0.291  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -91	  0.358  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -90	  0.327  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -90	  0.304  tick_check_idle+0x9 (irq_enter+0x40)
:    #func                 -90	  0.284  tick_check_oneshot_broadcast+0x3 (tick_check_idle+0x1b)
:    #func                 -90	  0.392  ktime_get+0x9 (tick_check_idle+0x3a)
:    #func                 -89	  0.297  tick_nohz_stop_idle+0x4 (tick_check_idle+0x50)
:    #func                 -89	  0.272  update_ts_time_stats+0x9 (tick_nohz_stop_idle+0x20)
:    #func                 -89	  0.339  nr_iowait_cpu+0x3 (update_ts_time_stats+0x31)
:    #func                 -88	  0.272  _local_bh_enable+0x3 (irq_enter+0x45)
:    #func                 -88	  0.347  __local_bh_enable+0x4 (_local_bh_enable+0x12)
:    #func                 -88	  0.312  sub_preempt_count+0x3 (__local_bh_enable+0x83)
:    #func                 -87	  0.353  add_preempt_count+0x4 (irq_enter+0x4f)
:    #func                 -87	  0.327  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -87	  0.412  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -86	  0.387  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:|   #begin   0x80000001   -86	  0.341  debug_smp_processor_id+0x36 (smp_apic_timer_interrupt+0x26)
:|   #end     0x80000001   -86	  0.349  debug_smp_processor_id+0x82 (smp_apic_timer_interrupt+0x26)
:    #func                 -85	  0.288  tick_nohz_handler+0x9 (smp_apic_timer_interrupt+0x58)
:|   #begin   0x80000001   -85	  0.337  debug_smp_processor_id+0x36 (tick_nohz_handler+0x1b)
:|   #end     0x80000001   -85	  0.327  debug_smp_processor_id+0x82 (tick_nohz_handler+0x1b)
:|   #begin   0x80000001   -84	  0.355  debug_smp_processor_id+0x36 (tick_nohz_handler+0x30)
:|   #end     0x80000001   -84	  0.307  debug_smp_processor_id+0x82 (tick_nohz_handler+0x30)
:    #func                 -84	  0.379  ktime_get+0x9 (tick_nohz_handler+0x38)
:    #func                 -83	  0.288  update_root_process_times+0x4 (tick_nohz_handler+0x81)
:    #func                 -83	  0.276  update_process_times+0x6 (update_root_process_times+0x24)
:|   #begin   0x80000001   -83	  0.331  debug_smp_processor_id+0x36 (update_process_times+0x19)
:|   #end     0x80000001   -82	  0.306  debug_smp_processor_id+0x82 (update_process_times+0x19)
:    #func                 -82	  0.317  account_process_tick+0x6 (update_process_times+0x24)
:|   #begin   0x80000001   -82	  0.335  debug_smp_processor_id+0x36 (account_process_tick+0x19)
:|   #end     0x80000001   -81	  0.366  debug_smp_processor_id+0x82 (account_process_tick+0x19)
:    #func                 -81	  0.307  account_idle_time+0x6 (account_process_tick+0x76)
:|   #begin   0x80000001   -81	  0.328  debug_smp_processor_id+0x36 (account_idle_time+0x1c)
:|   #end     0x80000001   -80	  0.345  debug_smp_processor_id+0x82 (account_idle_time+0x1c)
:|   #begin   0x80000001   -80	  0.357  debug_smp_processor_id+0x36 (account_idle_time+0x28)
:|   #end     0x80000001   -80	  0.378  debug_smp_processor_id+0x82 (account_idle_time+0x28)
:    #func                 -79	  0.251  run_local_timers+0x3 (update_process_times+0x29)
:    #func                 -79	  0.296  hrtimer_run_queues+0x9 (run_local_timers+0xd)
:|   #begin   0x80000001   -79	  0.331  debug_smp_processor_id+0x36 (hrtimer_run_queues+0x1b)
:|   #end     0x80000001   -78	  0.320  debug_smp_processor_id+0x82 (hrtimer_run_queues+0x1b)
:    #func                 -78	  0.326  get_xtime_and_monotonic_and_sleep_offset+0x6 (hrtimer_run_queues+0x58)
:    #func                 -78	  0.251  _raw_spin_lock+0x4 (hrtimer_run_queues+0xc9)
:    #func                 -77	  0.267  add_preempt_count+0x4 (_raw_spin_lock+0x15)
:    #func                 -77	  0.262  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -77	  0.394  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -77	  0.380  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -76	  0.262  _raw_spin_unlock+0x3 (hrtimer_run_queues+0x267)
:    #func                 -76	  0.339  sub_preempt_count+0x3 (_raw_spin_unlock+0x15)
:    #func                 -76	  0.323  raise_softirq+0x4 (run_local_timers+0x17)
:    #func                 -75	  0.279  __raise_softirq_irqoff+0x5 (raise_softirq_irqoff+0x8)
:    #func                 -75	  0.277  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -75	  0.286  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -74	  0.390  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -74	  0.385  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -74	  0.272  rcu_check_callbacks+0x5 (update_process_times+0x32)
:    #func                 -73	  0.265  rcu_is_cpu_rrupt_from_idle+0x4 (rcu_check_callbacks+0x21)
:|   #begin   0x80000001   -73	  0.376  debug_smp_processor_id+0x36 (rcu_is_cpu_rrupt_from_idle+0x13)
:|   #end     0x80000001   -73	  0.326  debug_smp_processor_id+0x82 (rcu_is_cpu_rrupt_from_idle+0x13)
:    #func                 -72	  0.328  __rcu_pending+0x9 (rcu_check_callbacks+0xc3)
:    #func                 -72	  0.295  __rcu_pending+0x9 (rcu_check_callbacks+0xdd)
:    #func                 -72	  0.439  __rcu_pending+0x9 (rcu_check_callbacks+0xf7)
:    #func                 -71	  0.362  raise_softirq+0x4 (rcu_check_callbacks+0x105)
:    #func                 -71	  0.301  __raise_softirq_irqoff+0x5 (raise_softirq_irqoff+0x8)
:    #func                 -71	  0.285  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -70	  0.285  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -70	  0.394  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -70	  0.361  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -69	  0.282  printk_tick+0x5 (update_process_times+0x37)
:|   #begin   0x80000001   -69	  0.394  debug_smp_processor_id+0x36 (irq_work_run+0x10)
:|   #end     0x80000001   -69	  0.328  debug_smp_processor_id+0x82 (irq_work_run+0x10)
:    #func                 -68	  0.315  scheduler_tick+0x9 (update_process_times+0x51)
:|   #begin   0x80000001   -68	  0.344  debug_smp_processor_id+0x36 (scheduler_tick+0x18)
:|   #end     0x80000001   -68	  0.306  debug_smp_processor_id+0x82 (scheduler_tick+0x18)
:    #func                 -67	  0.287  _raw_spin_lock+0x4 (scheduler_tick+0x36)
:    #func                 -67	  0.310  add_preempt_count+0x4 (_raw_spin_lock+0x15)
:    #func                 -67	  0.295  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -66	  0.416  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -66	  0.380  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -66	  0.414  update_rq_clock+0x6 (scheduler_tick+0x3d)
:|   #begin   0x80000001   -65	  0.357  debug_smp_processor_id+0x36 (__cycles_2_ns+0x17)
:|   #end     0x80000001   -65	  0.374  debug_smp_processor_id+0x82 (__cycles_2_ns+0x17)
:    #func                 -64	  0.338  __update_cpu_load+0x9 (scheduler_tick+0x54)
:    #func                 -64	  0.303  sched_avg_update+0x9 (__update_cpu_load+0xa5)
:    #func                 -64	  0.288  task_tick_idle+0x3 (scheduler_tick+0x9e)
:    #func                 -64	  0.295  _raw_spin_unlock+0x3 (scheduler_tick+0xa5)
:    #func                 -63	  0.404  sub_preempt_count+0x3 (_raw_spin_unlock+0x15)
:|   #begin   0x80000001   -63	  0.327  debug_smp_processor_id+0x36 (perf_event_task_tick+0x13)
:|   #end     0x80000001   -63	  0.378  debug_smp_processor_id+0x82 (perf_event_task_tick+0x13)
:    #func                 -62	  0.288  trigger_load_balance+0x9 (scheduler_tick+0xeb)
:    #func                 -62	  0.313  idle_cpu+0x3 (trigger_load_balance+0x4e)
:    #func                 -62	  0.404  run_posix_cpu_timers+0x9 (update_process_times+0x58)
:    #func                 -61	  0.362  hrtimer_forward+0xc (tick_nohz_handler+0xa8)
:    #func                 -61	  0.296  ktime_add_safe+0x8 (hrtimer_forward+0xfb)
:    #func                 -60	  0.285  ktime_add_safe+0x8 (hrtimer_forward+0x114)
:    #func                 -60	  0.275  tick_program_event+0x4 (tick_nohz_handler+0xb5)
:    #func                 -60	  0.282  clockevents_program_event+0x9 (tick_program_event+0x24)
:    #func                 -60	  0.440  ktime_get+0x9 (clockevents_program_event+0x71)
:    #func                 -59	  0.354  xnarch_next_htick_shot+0x5 (clockevents_program_event+0xd8)
:|   #begin   0x80000000   -59	  0.525  ipipe_test_and_stall_pipeline_head+0x15 (T.1341+0x16)
:|  *#func                 -58	  0.322  xntimer_start_aperiodic+0x9 (xnarch_next_htick_shot+0x42)
:|  *#func                 -58	  0.564  xnarch_ns_to_tsc+0x9 (xntimer_start_aperiodic+0x78)
:|  *#func                 -57	  0.364  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|   #end     0x80000000   -57	  0.358  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:    #func                 -57	  0.290  irq_exit+0x3 (smp_apic_timer_interrupt+0x5d)
:    #func                 -56	  0.288  sub_preempt_count+0x3 (irq_exit+0x12)
:    #func                 -56	  0.328  do_softirq+0x9 (irq_exit+0x3a)
:    #func                 -56	  0.290  __do_softirq+0x9 (do_softirq+0x86)
:    #func                 -56	  0.268  add_preempt_count+0x4 (__do_softirq+0x1f)
:    #func                 -55	  0.317  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -55	  0.387  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -55	  0.368  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:|   #begin   0x80000001   -54	  0.317  debug_smp_processor_id+0x36 (__do_softirq+0x24)
:|   #end     0x80000001   -54	  0.319  debug_smp_processor_id+0x82 (__do_softirq+0x24)
:    #func                 -54	  0.269  ipipe_unstall_root+0x3 (__do_softirq+0x43)
:|   #begin   0x80000000   -53	  0.315  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -53	  0.490  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -52	  0.319  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                 -52	  0.276  run_timer_softirq+0x9 (__do_softirq+0xa4)
:    +func                 -52	  0.295  hrtimer_run_pending+0x3 (run_timer_softirq+0x1a)
:    +func                 -52	  0.294  tick_check_oneshot_change+0x6 (hrtimer_run_pending+0x12)
:|   +begin   0x80000001   -51	  0.313  debug_smp_processor_id+0x36 (tick_check_oneshot_change+0x17)
:|   +end     0x80000001   -51	  0.418  debug_smp_processor_id+0x82 (tick_check_oneshot_change+0x17)
:    +func                 -51	  0.335  _raw_spin_lock_irq+0x4 (run_timer_softirq+0x2f)
:    #func                 -50	  0.283  add_preempt_count+0x4 (_raw_spin_lock_irq+0x28)
:    #func                 -50	  0.295  ipipe_root_only+0x5 (add_preempt_count+0x10)
:|   #begin   0x80000001   -50	  0.422  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -49	  0.430  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -49	  0.284  _raw_spin_unlock_irq+0x3 (run_timer_softirq+0x219)
:    #func                 -48	  0.288  ipipe_unstall_root+0x3 (_raw_spin_unlock_irq+0x10)
:|   #begin   0x80000000   -48	  0.313  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -48	  0.464  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -47	  0.303  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                 -47	  0.323  sub_preempt_count+0x3 (_raw_spin_unlock_irq+0x1a)
:    +func                 -47	  0.355  rcu_bh_qs+0x3 (__do_softirq+0x118)
:    +func                 -46	  0.358  rcu_process_callbacks+0x4 (__do_softirq+0xa4)
:|   +begin   0x80000001   -46	  0.327  debug_smp_processor_id+0x36 (rcu_process_callbacks+0x1d)
:|   +end     0x80000001   -46	  0.305  debug_smp_processor_id+0x82 (rcu_process_callbacks+0x1d)
:    +func                 -45	  0.310  __rcu_process_callbacks+0x9 (rcu_process_callbacks+0x35)
:    +func                 -45	  0.329  force_quiescent_state+0x9 (__rcu_process_callbacks+0x57)
:    +func                 -45	  0.307  rcu_process_gp_end+0x6 (__rcu_process_callbacks+0x61)
:    #func                 -44	  0.331  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -44	  0.315  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -44	  0.418  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -43	  0.352  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -43	  0.294  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000   -43	  0.326  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -42	  0.425  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -42	  0.331  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:    +func                 -42	  0.378  check_for_new_grace_period+0x9 (__rcu_process_callbacks+0x6b)
:    #func                 -41	  0.261  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -41	  0.270  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -41	  0.351  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -40	  0.314  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -40	  0.300  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000   -40	  0.336  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -39	  0.445  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -39	  0.303  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001   -39	  0.354  debug_smp_processor_id+0x36 (rcu_process_callbacks+0x3a)
:|   +end     0x80000001   -38	  0.307  debug_smp_processor_id+0x82 (rcu_process_callbacks+0x3a)
:    +func                 -38	  0.317  __rcu_process_callbacks+0x9 (rcu_process_callbacks+0x52)
:    +func                 -38	  0.286  force_quiescent_state+0x9 (__rcu_process_callbacks+0x57)
:    +func                 -37	  0.347  rcu_process_gp_end+0x6 (__rcu_process_callbacks+0x61)
:    #func                 -37	  0.347  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -37+   1.002  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x000000ef   -36	  0.360  apic_timer_interrupt+0x37 (__ipipe_trace+0x527)
:|   #func                 -35	  0.374  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   #func                 -35	  0.326  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   #func                 -35	  0.333  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   #func                 -34	  0.568  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  #*func                 -34+   1.291  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  #*func                 -33!  17.026  __xnlock_spin+0x9 (T.1241+0x47)
:|  #*func                 -15	  0.342  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  #*func                 -15	  0.291  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  #*func                 -15	  0.356  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  #*[ 1168] -<?>-   99   -15	  0.438  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  #*func                 -14	  0.310  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  #*event   tick@61      -14	  0.282  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  #*func                 -13	  0.307  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  #*func                 -13	  0.523  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  #*func                 -13	  0.490  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  #*[    0] -<?>-   -1   -12	  0.268  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  #*func                 -12	  0.699  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  #*func                 -11	  0.937  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  #*[ 1168] -<?>-   99   -10	  0.735  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  #*func                 -10	  0.496  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  #*func                  -9	  0.319  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  +*end     0x80000000    -9	  0.564  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  +*begin   0x80000001    -8	  0.490  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  +*end     0x80000001    -8	  0.393  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  +*begin   0x80000001    -7+   1.430  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   +*func                  -6	  0.329  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   +*func                  -5	  0.352  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  +*begin   0x80000001    -5	  0.429  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  +*end     0x80000001    -5	  0.348  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   +*func                  -4	  0.295  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  +*begin   0x80000001    -4	  0.379  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  +*end     0x80000001    -4	  0.325  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   +*func                  -3	  0.390  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   +*func                  -3	  0.298  xnshadow_sys_trace+0x6 (hisyscall_event+0x11b)
:   +*func                  -3	  0.404  ipipe_trace_frozen_reset+0x6 (xnshadow_sys_trace+0x5c)
:   +*func                  -2	  0.310  __ipipe_global_path_lock+0x9 (ipipe_trace_frozen_reset+0x1a)
:   +*func                  -2	  0.342  __ipipe_spin_lock_irqsave+0x5 (__ipipe_global_path_lock+0x1d)
:|  +*begin   0x80000001    -2+   1.274  hard_local_irq_save+0x16 (__ipipe_spin_lock_irqsave+0x11)
:|  #*func                   0	  0.459  __ipipe_spin_unlock_irqcomplete+0x4 (__ipipe_global_path_unlock+0x62)
:|  +*end     0x80000001     0	  0.371  hard_local_irq_restore+0x15 (__ipipe_spin_unlock_irqcomplete+0x24)
<   +*freeze  0x00006bee     0	  0.327  xnshadow_sys_trace+0x65 (hisyscall_event+0x11b)
 |  +*begin   0x80000001     0	  0.448  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
 |  +*end     0x80000001     0	  0.325  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
 |  +*begin   0x80000001     1	  1.071  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
    +*func                   2	  0.306  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
    +*func                   2	  0.270  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
 |  +*begin   0x80000001     2	  0.431  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
 |  +*end     0x80000001     3	  0.340  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
    +*func                   3	  0.286  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
 |  +*begin   0x80000001     3	  0.338  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
 |  +*end     0x80000001     4	  0.000  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)


[max]
I-pipe worst-case tracing service on 3.5.7-trace3-nohpet/ipipe release #3
-------------------------------------------------------------
CPU: 0, Begin: 333249077817 cycles, Trace Points: 8 (-10/+5), Length: 3880 us
Calibrated minimum trace-point overhead: 0.077 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
     #func                  -3	  0.245  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
 |   #begin   0x80000001    -2	  0.344  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
 |   #end     0x80000001    -2	  0.314  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
     #func                  -2	  0.260  default_idle+0x3 (cpu_idle+0x5d)
 |   #begin   0x80000001    -1	  0.320  debug_smp_processor_id+0x36 (default_idle+0xd)
 |   #end     0x80000001    -1	  0.307  debug_smp_processor_id+0x82 (default_idle+0xd)
 |   #begin   0x80000001    -1	  0.325  debug_smp_processor_id+0x36 (default_idle+0x1e)
 |   #end     0x80000001     0	  0.391  debug_smp_processor_id+0x82 (default_idle+0x1e)
     #func                   0	  0.257  __ipipe_halt_root+0x3 (default_idle+0x48)
 |   #begin   0x80000000     0	  0.347  __ipipe_halt_root+0x1a (default_idle+0x48)
>|   +end     0x8000000e     0! 3877.882  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +func                3877	  0.471  __ipipe_handle_irq+0x9 (reschedule_interrupt+0x3e)
:|   +func                3878	  0.434  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                3878	  0.491  __ipipe_ack_apic+0x3 (__ipipe_dispatch_irq+0xa4)
:|   +func                3879	  0.594  __ipipe_set_irq_pending+0x6 (__ipipe_dispatch_irq+0x19a)
:|   +func                3879	  0.510  __ipipe_do_sync_pipeline+0x4 (__ipipe_sync_pipeline+0x1c)
:|   +func                3880	  0.527  __ipipe_do_sync_stage+0x9 (__ipipe_do_sync_pipeline+0x63)
<|   #end     0x80000000  3880	  0.456  hard_local_irq_enable+0x14 (__ipipe_do_sync_stage+0xbd)
     #func                3881	  0.397  __ipipe_do_IRQ+0x5 (__ipipe_do_sync_stage+0x137)
     #func                3881	  0.477  __ipipe_get_ioapic_irq_vector+0x3 (__ipipe_do_IRQ+0x1d)
     #func                3882	  0.334  smp_reschedule_interrupt+0x3 (__ipipe_do_IRQ+0x42)
     #func                3882	  0.377  scheduler_ipi+0x4 (smp_reschedule_interrupt+0x14)
 |   #begin   0x80000001  3882	  0.000  debug_smp_processor_id+0x36 (scheduler_ipi+0x13)
-------------- next part --------------
I-pipe trace results
--------------------
name: 'plain-vga_300_no_usb'

[parameters]
enable = 1
verbose = 1
pre_trace_points = 10
back_trace_points = 1000
post_trace_points = 10


[frozen]
I-pipe frozen back-tracing service on 3.5.7-trace/ipipe release #3
------------------------------------------------------------
CPU: 0, Freeze: 32787094157468 cycles, Trace Points: 1000 (+10)
Calibrated minimum trace-point overhead: 0.078 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
:|  # func               -1126	  0.468  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func               -1125	  0.322  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000 -1125	  0.487  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001 -1125	  0.409  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001 -1124	  0.357  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001 -1124+   1.300  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func               -1123	  0.271  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func               -1122	  0.278  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001 -1122	  0.384  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001 -1122	  0.309  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func               -1121	  0.281  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001 -1121	  0.340  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001 -1121	  0.295  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func               -1120	  0.270  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func               -1120	  0.254  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func               -1120	  0.264  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func               -1120	  0.284  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000 -1119	  0.511  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func               -1119	  0.368  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func               -1118	  0.408  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99 -1118	  0.311  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func               -1118	  0.633  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func               -1117	  0.705  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1 -1116	  0.818  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func               -1116	  0.506  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef -1115	  0.737  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001 -1114	  0.353  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001 -1114	  0.347  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001 -1114	  0.322  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001 -1113	  0.341  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func               -1113	  0.322  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001 -1113	  0.349  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001 -1112	  0.317  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func               -1112	  0.320  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001 -1112	  0.320  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001 -1111	  0.312  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func               -1111	  0.263  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func               -1111	  0.285  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001 -1111	  0.369  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001 -1110	  0.327  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func               -1110	  0.254  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000 -1110	  0.308  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func               -1109	  0.420  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000 -1109	  0.317  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001 -1109	  0.317  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001 -1108	  0.319  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func               -1108	  0.305  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func               -1108	  0.326  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001 -1107	  0.325  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001 -1107	  0.300  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func               -1107	  0.273  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001 -1106	  0.335  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001 -1106	  0.373  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func               -1106	  0.265  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func               -1105	  0.259  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001 -1105	  0.366  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001 -1105	  0.337  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func               -1104	  0.266  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001 -1104	  0.330  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001 -1104	  0.321  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001 -1103	  0.338  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001 -1103	  0.383  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func               -1103	  0.252  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000 -1103	  0.330  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e -1102!  68.125  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef -1034	  0.310  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func               -1034	  0.361  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func               -1033	  0.284  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func               -1033	  0.288  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func               -1033	  0.454  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func               -1032	  0.545  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func               -1032	  0.320  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func               -1031	  0.292  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func               -1031	  0.301  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99 -1031	  0.476  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func               -1030	  0.318  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-937  -1030	  0.254  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func               -1030	  0.295  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func               -1030	  0.572  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func               -1029	  0.483  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1 -1028	  0.269  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func               -1028	  0.637  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func               -1028+   1.019  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99 -1027	  0.639  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func               -1026	  0.468  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func               -1025	  0.315  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000 -1025	  0.475  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001 -1025	  0.412  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001 -1024	  0.344  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001 -1024+   1.304  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func               -1023	  0.278  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func               -1022	  0.279  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001 -1022	  0.384  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001 -1022	  0.309  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func               -1021	  0.280  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001 -1021	  0.326  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001 -1021	  0.301  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func               -1020	  0.274  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func               -1020	  0.246  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func               -1020	  0.251  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func               -1020	  0.269  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000 -1019	  0.480  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func               -1019	  0.348  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func               -1019	  0.367  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99 -1018	  0.320  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func               -1018	  0.645  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func               -1017	  0.707  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1 -1017	  0.842  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func               -1016	  0.488  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef -1015	  0.732  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001 -1014	  0.326  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001 -1014	  0.310  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001 -1014	  0.320  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001 -1014	  0.339  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func               -1013	  0.344  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001 -1013	  0.349  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001 -1012	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func               -1012	  0.335  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001 -1012	  0.336  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001 -1011	  0.298  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func               -1011	  0.286  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func               -1011	  0.260  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001 -1011	  0.371  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001 -1010	  0.322  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func               -1010	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000 -1010	  0.312  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func               -1009	  0.428  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000 -1009	  0.323  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001 -1009	  0.331  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001 -1008	  0.323  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func               -1008	  0.305  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func               -1008	  0.326  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001 -1007	  0.328  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001 -1007	  0.320  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func               -1007	  0.273  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001 -1006	  0.335  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001 -1006	  0.373  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func               -1006	  0.254  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func               -1005	  0.251  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001 -1005	  0.378  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001 -1005	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func               -1005	  0.266  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001 -1004	  0.317  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001 -1004	  0.314  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001 -1004	  0.346  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001 -1003	  0.384  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func               -1003	  0.252  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000 -1003	  0.330  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e -1002!  68.190  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -934	  0.310  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -934	  0.361  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -933	  0.269  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -933	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -933	  0.453  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -932	  0.548  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -932	  0.313  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -932	  0.290  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -931	  0.315  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -931	  0.434  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -931	  0.319  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-837   -930	  0.254  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -930	  0.294  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -930	  0.572  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -929	  0.503  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -929	  0.271  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -928	  0.648  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -928+   1.012  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -927	  0.640  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -926	  0.468  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -926	  0.310  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -925	  0.478  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -925	  0.452  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -924	  0.337  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -924+   1.296  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -923	  0.279  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -922	  0.295  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -922	  0.400  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -922	  0.307  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -921	  0.278  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -921	  0.341  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -921	  0.322  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -920	  0.285  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -920	  0.263  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -920	  0.261  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -920	  0.282  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -919	  0.488  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -919	  0.343  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -919	  0.363  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -918	  0.310  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -918	  0.634  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -917	  0.779  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -916	  0.856  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -916	  0.487  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -915	  0.732  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -914	  0.331  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -914	  0.336  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -914	  0.321  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -913	  0.339  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -913	  0.326  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -913	  0.349  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -912	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -912	  0.319  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -912	  0.320  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -911	  0.313  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -911	  0.253  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -911	  0.257  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -911	  0.377  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -910	  0.322  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -910	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -910	  0.313  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -909	  0.420  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -909	  0.322  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -909	  0.331  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -908	  0.323  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -908	  0.305  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -908	  0.326  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -907	  0.328  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -907	  0.309  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -907	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -906	  0.332  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -906	  0.373  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -906	  0.265  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -905	  0.259  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -905	  0.370  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -905	  0.322  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -904	  0.278  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -904	  0.332  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -904	  0.321  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -904	  0.349  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -903	  0.383  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -903	  0.252  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -903	  0.325  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -902!  68.134  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -834	  0.310  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -834	  0.361  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -833	  0.284  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -833	  0.288  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -833	  0.431  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -832	  0.539  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -832	  0.320  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -832	  0.292  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -831	  0.300  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -831	  0.476  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -830	  0.318  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-737   -830	  0.254  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -830	  0.295  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -830	  0.575  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -829	  0.484  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -829	  0.268  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -828	  0.640  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -828+   1.019  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -827	  0.639  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -826	  0.468  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -825	  0.315  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -825	  0.476  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -825	  0.412  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -824	  0.344  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -824+   1.299  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -823	  0.279  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -822	  0.278  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -822	  0.384  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -822	  0.309  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -821	  0.281  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -821	  0.326  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -821	  0.301  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -820	  0.283  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -820	  0.256  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -820	  0.260  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -820	  0.264  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -819	  0.487  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -819	  0.345  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -819	  0.366  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -818	  0.302  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -818	  0.645  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -817	  0.706  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -817	  0.842  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -816	  0.488  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -815	  0.732  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -814	  0.326  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -814	  0.342  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -814	  0.321  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -814	  0.339  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -813	  0.344  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -813	  0.348  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -812	  0.323  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -812	  0.335  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -812	  0.332  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -811	  0.298  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -811	  0.277  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -811	  0.269  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -811	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -810	  0.329  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -810	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -810	  0.324  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -809	  0.428  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -809	  0.313  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -809	  0.322  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -808	  0.312  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -808	  0.298  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -808	  0.322  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -807	  0.336  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -807	  0.309  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -807	  0.273  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -806	  0.335  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -806	  0.373  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -806	  0.265  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -805	  0.259  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -805	  0.370  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -805	  0.325  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -805	  0.266  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -804	  0.335  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -804	  0.321  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -804	  0.338  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -803	  0.383  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -803	  0.248  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -803	  0.320  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -802!  68.284  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -734	  0.310  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -734	  0.361  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -733	  0.269  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -733	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -733	  0.449  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -732	  0.545  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -732	  0.323  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -731	  0.320  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -731	  0.302  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -731	  0.459  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -730	  0.350  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-637   -730	  0.248  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -730	  0.295  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -729	  0.559  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -729	  0.473  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -728	  0.272  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -728	  0.655  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -728+   1.014  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -727	  0.642  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -726	  0.469  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -725	  0.317  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -725	  0.483  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -725	  0.412  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -724	  0.340  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -724+   1.327  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -723	  0.297  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -722	  0.298  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -722	  0.384  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -722	  0.300  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -721	  0.273  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -721	  0.324  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -721	  0.301  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -720	  0.280  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -720	  0.257  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -720	  0.292  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -720	  0.272  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -719	  0.478  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -719	  0.342  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -718	  0.417  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -718	  0.317  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -718	  0.630  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -717	  0.713  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -716	  0.845  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -715	  0.487  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -715	  0.738  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -714	  0.328  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -714	  0.340  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -714	  0.321  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -713	  0.339  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -713	  0.344  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -713	  0.349  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -712	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -712	  0.335  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -712	  0.332  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -711	  0.324  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -711	  0.272  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -711	  0.260  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -710	  0.380  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -710	  0.329  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -710	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -709	  0.320  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -709	  0.414  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -709	  0.317  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -708	  0.317  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -708	  0.323  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -708	  0.305  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -707	  0.326  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -707	  0.328  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -707	  0.309  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -706	  0.273  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -706	  0.335  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -706	  0.373  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -705	  0.265  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -705	  0.259  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -705	  0.370  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -705	  0.325  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -704	  0.266  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -704	  0.330  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -704	  0.321  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -703	  0.338  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -703	  0.383  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -703	  0.252  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -702	  0.330  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -702!  67.989  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -634	  0.310  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -634	  0.361  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -633	  0.284  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -633	  0.288  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -633	  0.448  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -632	  0.559  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -632	  0.316  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -631	  0.281  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -631	  0.300  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -631	  0.422  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -630	  0.321  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-537   -630	  0.254  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -630	  0.295  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -630	  0.572  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -629	  0.483  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -629	  0.269  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -628	  0.637  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -628+   1.019  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -627	  0.639  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -626	  0.468  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -626	  0.315  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -625	  0.476  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -625	  0.412  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -624	  0.344  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -624+   1.329  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -623	  0.283  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -622	  0.278  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -622	  0.384  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -622	  0.309  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -621	  0.280  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -621	  0.326  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -621	  0.301  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -620	  0.283  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -620	  0.256  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -620	  0.260  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -620	  0.264  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -619	  0.487  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -619	  0.345  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -619	  0.366  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -618	  0.303  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -618	  0.644  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -617	  0.713  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -617	  0.835  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -616	  0.487  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -615	  0.732  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -615	  0.326  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -614	  0.342  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -614	  0.321  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -614	  0.339  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -613	  0.344  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -613	  0.349  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -612	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -612	  0.335  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -612	  0.332  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -611	  0.298  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -611	  0.277  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -611	  0.260  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -611	  0.375  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -610	  0.322  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -610	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -610	  0.321  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -609	  0.431  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -609	  0.313  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -609	  0.322  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -608	  0.329  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -608	  0.305  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -608	  0.326  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -607	  0.328  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -607	  0.309  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -607	  0.273  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -606	  0.361  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -606	  0.376  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -606	  0.260  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -605	  0.251  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -605	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -605	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -604	  0.267  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -604	  0.330  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -604	  0.314  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -604	  0.347  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -603	  0.385  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -603	  0.259  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -603	  0.334  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -602!  68.191  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -534	  0.312  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -534	  0.358  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -533	  0.274  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -533	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -533	  0.453  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -532	  0.621  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -532	  0.324  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -531	  0.282  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -531	  0.309  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -531	  0.422  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -530	  0.309  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-437   -530	  0.262  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -530	  0.286  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -530	  0.566  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -529	  0.474  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -529	  0.270  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -528	  0.640  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -528+   1.013  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -527	  0.638  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -526	  0.469  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -525	  0.316  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -525	  0.490  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -525	  0.410  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -524	  0.337  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -524+   1.297  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -523	  0.274  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -522	  0.280  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -522	  0.389  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -522	  0.299  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -521	  0.276  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -521	  0.324  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -521	  0.314  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -520	  0.288  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -520	  0.255  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -520	  0.249  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -520	  0.268  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -519	  0.502  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -519	  0.353  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -519	  0.398  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -518	  0.315  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -518	  0.639  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -517	  0.718  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -516	  0.838  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -516	  0.491  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -515	  0.746  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -514	  0.341  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -514	  0.310  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -514	  0.332  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -513	  0.328  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -513	  0.345  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -513	  0.353  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -512	  0.320  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -512	  0.336  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -512	  0.314  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -511	  0.305  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -511	  0.285  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -511	  0.255  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -511	  0.378  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -510	  0.323  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -510	  0.254  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -510	  0.312  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -509	  0.415  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -509	  0.319  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -509	  0.329  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -508	  0.321  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -508	  0.310  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -508	  0.332  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -507	  0.320  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -507	  0.311  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -507	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -506	  0.332  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -506	  0.369  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -506	  0.248  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -505	  0.272  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -505	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -505	  0.334  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -504	  0.270  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -504	  0.319  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -504	  0.314  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -504	  0.347  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -503	  0.379  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -503	  0.259  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -503	  0.334  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -502!  68.117  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -434	  0.307  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -434	  0.358  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -433	  0.274  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -433	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -433	  0.420  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -432	  0.618  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -432	  0.323  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -432	  0.282  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -431	  0.302  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -431	  0.430  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -431	  0.314  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-337   -430	  0.255  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -430	  0.302  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -430	  0.572  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -429	  0.502  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -429	  0.276  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -428	  0.640  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -428+   1.016  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -427	  0.638  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -426	  0.469  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -426	  0.316  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -425	  0.466  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -425	  0.410  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -424	  0.336  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -424+   1.302  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -423	  0.274  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -422	  0.280  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -422	  0.389  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -422	  0.291  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -421	  0.276  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -421	  0.324  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -421	  0.302  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -421	  0.310  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -420	  0.286  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -420	  0.260  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -420	  0.311  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -419	  0.478  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -419	  0.347  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -419	  0.409  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -418	  0.305  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -418	  0.643  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -417	  0.711  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -416	  0.838  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -416	  0.488  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -415	  0.735  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -414	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -414	  0.305  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -414	  0.332  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -413	  0.383  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -413	  0.337  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -413	  0.341  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -412	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -412	  0.339  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -412	  0.315  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -411	  0.296  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -411	  0.281  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -411	  0.263  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -411	  0.369  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -410	  0.322  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -410	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -410	  0.317  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -409	  0.429  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -409	  0.304  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -409	  0.330  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -408	  0.324  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -408	  0.310  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -408	  0.332  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -407	  0.320  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -407	  0.311  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -407	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -406	  0.332  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -406	  0.376  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -406	  0.260  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -405	  0.251  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -405	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -405	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -404	  0.266  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -404	  0.317  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -404	  0.314  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -404	  0.346  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -403	  0.379  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -403	  0.259  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -403	  0.330  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -402!  68.232  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -334	  0.307  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -334	  0.358  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -333	  0.274  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -333	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -333	  0.433  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -332	  0.543  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -332	  0.324  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -332	  0.282  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -331	  0.312  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -331	  0.424  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -330	  0.317  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-237   -330	  0.258  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -330	  0.305  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -330	  0.569  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -329	  0.545  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -328	  0.276  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -328	  0.652  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -328+   1.018  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -327	  0.639  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -326	  0.469  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -325	  0.317  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -325	  0.506  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -325	  0.405  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -324	  0.337  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -324+   1.299  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -323	  0.274  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -322	  0.280  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -322	  0.389  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -322	  0.291  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -321	  0.274  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -321	  0.324  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -321	  0.306  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -320	  0.286  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -320	  0.249  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -320	  0.269  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -320	  0.273  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -319	  0.493  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -319	  0.353  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -318	  0.391  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -318	  0.315  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -318	  0.638  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -317	  0.731  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -316	  0.854  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -316	  0.527  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -315	  0.740  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -314	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -314	  0.343  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -314	  0.321  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -313	  0.340  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -313	  0.337  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -313	  0.341  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -312	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -312	  0.336  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -312	  0.315  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -311	  0.308  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -311	  0.274  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -311	  0.267  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -310	  0.378  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -310	  0.309  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -310	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -310	  0.317  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -309	  0.429  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -309	  0.299  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -308	  0.336  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -308	  0.324  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -308	  0.299  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -308	  0.322  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -307	  0.321  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -307	  0.310  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -307	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -306	  0.333  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -306	  0.380  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -306	  0.260  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -305	  0.251  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -305	  0.373  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -305	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -304	  0.269  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -304	  0.325  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -304	  0.314  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -303	  0.347  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -303	  0.379  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -303	  0.259  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -302	  0.334  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -302!  68.109  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -234	  0.307  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -234	  0.358  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -233	  0.274  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -233	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -233	  0.443  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -232	  0.621  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -232	  0.323  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -231	  0.282  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -231	  0.302  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -231	  0.430  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -230	  0.314  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-137   -230	  0.255  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -230	  0.302  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -230	  0.572  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -229	  0.503  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -228	  0.281  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -228	  0.659  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -228+   1.021  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -226	  0.638  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -226	  0.469  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -225	  0.316  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -225	  0.462  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -225	  0.410  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -224	  0.337  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -224+   1.301  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -223	  0.271  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -222	  0.280  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -222	  0.389  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -222	  0.291  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -221	  0.274  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -221	  0.324  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -221	  0.302  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -220	  0.310  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -220	  0.253  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -220	  0.259  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -220	  0.303  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -219	  0.481  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -219	  0.344  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -218	  0.363  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -218	  0.307  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -218	  0.648  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -217	  0.708  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -216	  0.837  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -216	  0.488  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -215	  0.735  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -214	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -214	  0.343  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -214	  0.332  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -213	  0.337  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -213	  0.337  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -213	  0.342  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -212	  0.319  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -212	  0.336  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -212	  0.325  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -211	  0.305  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -211	  0.281  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -211	  0.263  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -211	  0.369  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -210	  0.322  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -210	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -210	  0.317  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -209	  0.430  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -209	  0.299  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -209	  0.336  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -208	  0.329  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -208	  0.305  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -208	  0.332  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -207	  0.320  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -207	  0.308  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -207	  0.264  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -206	  0.336  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -206	  0.376  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -206	  0.260  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -205	  0.251  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -205	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -205	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -204	  0.269  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -204	  0.320  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -204	  0.314  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -204	  0.345  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -203	  0.382  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -203	  0.259  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -203	  0.334  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -202!  68.112  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef  -134	  0.307  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                -134	  0.358  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                -133	  0.274  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                -133	  0.283  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                -133	  0.453  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                -132	  0.647  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                -132	  0.337  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                -131	  0.257  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                -131	  0.316  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99  -131	  0.437  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                -130	  0.334  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-72    -130	  0.258  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                -130	  0.293  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                -130	  0.574  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                -129	  0.474  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # [    0] -<?>-   -1  -128	  0.270  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                -128	  0.639  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -128+   1.018  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99  -127	  0.638  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                -126	  0.469  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                -125	  0.316  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000  -125	  0.462  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001  -125	  0.447  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001  -124	  0.348  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001  -124+   1.297  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                -123	  0.276  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                -122	  0.270  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001  -122	  0.389  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001  -122	  0.291  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                -121	  0.274  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001  -121	  0.335  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001  -121	  0.295  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                -120	  0.285  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                -120	  0.257  __rt_task_wait_period+0x7 (hisyscall_event+0x11b)
:   + func                -120	  0.260  rt_task_wait_period+0x3 (__rt_task_wait_period+0x16)
:   + func                -120	  0.268  xnpod_wait_thread_period+0x9 (rt_task_wait_period+0x3d)
:|  + begin   0x80000000  -119	  0.475  ipipe_test_and_stall_pipeline_head+0x15 (T.1349+0x16)
:|  # func                -119	  0.344  xnpod_suspend_thread+0x9 (xnpod_wait_thread_period+0x7b)
:|  # func                -119	  0.364  __xnpod_schedule+0x9 (xnpod_schedule+0x32)
:|  # [ 1422] -<?>-   99  -118	  0.316  __xnpod_schedule+0x69 (xnpod_schedule+0x32)
:|  # func                -118	  0.638  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                -117	  0.704  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [    0] -<?>-   -1  -117	  0.850  __xnpod_schedule+0x43e (xnintr_clock_handler+0x124)
:|   +func                -116	  0.508  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef  -115	  0.735  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001  -114	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001  -114	  0.341  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001  -114	  0.331  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001  -113	  0.302  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                -113	  0.353  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001  -113	  0.339  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001  -112	  0.302  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                -112	  0.335  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001  -112	  0.315  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001  -111	  0.280  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                -111	  0.284  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -111	  0.318  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -111	  0.373  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -110	  0.309  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -110	  0.246  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000  -110	  0.317  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                -109	  0.429  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000  -109	  0.299  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001  -109	  0.336  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001  -108	  0.317  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                -108	  0.296  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                -108	  0.322  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001  -107	  0.321  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001  -107	  0.310  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                -107	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001  -106	  0.332  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001  -106	  0.376  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                -106	  0.260  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                -105	  0.251  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001  -105	  0.372  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001  -105	  0.337  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                -105	  0.263  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001  -104	  0.332  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001  -104	  0.347  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001  -104	  0.350  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001  -103	  0.393  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                -103	  0.259  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000  -103	  0.327  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e  -102!  33.416  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef   -69	  0.307  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                 -69	  0.358  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                 -68	  0.282  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                 -68	  0.298  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                 -68	  0.431  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                 -67	  0.611  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                 -67	  0.332  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                 -66	  0.446  xnsched_watchdog_handler+0x5 (xntimer_tick_aperiodic+0x78)
:|  # func                 -66	  0.320  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@-37     -65	  0.253  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                 -65	  0.300  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                 -65	  0.779  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|   +func                 -64	  0.461  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +end     0x000000ef   -64	  0.743  apic_timer_interrupt+0x4f (__ipipe_halt_root+0x4e)
:|   +begin   0x80000001   -63	  0.329  debug_smp_processor_id+0x36 (default_idle+0x5f)
:|   +end     0x80000001   -63	  0.325  debug_smp_processor_id+0x82 (default_idle+0x5f)
:|   +begin   0x80000001   -62	  0.359  debug_smp_processor_id+0x36 (default_idle+0x69)
:|   +end     0x80000001   -62	  0.333  debug_smp_processor_id+0x82 (default_idle+0x69)
:    +func                 -62	  0.324  rcu_idle_exit+0x9 (cpu_idle+0x62)
:|   #begin   0x80000001   -61	  0.348  debug_smp_processor_id+0x36 (rcu_idle_exit+0x4b)
:|   #end     0x80000001   -61	  0.322  debug_smp_processor_id+0x82 (rcu_idle_exit+0x4b)
:    #func                 -61	  0.403  rcu_idle_exit_common+0x5 (rcu_idle_exit+0xaa)
:|   #begin   0x80000001   -60	  0.352  debug_smp_processor_id+0x36 (rcu_idle_exit_common+0x39)
:|   #end     0x80000001   -60	  0.305  debug_smp_processor_id+0x82 (rcu_idle_exit_common+0x39)
:    #func                 -59	  0.257  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -59	  0.255  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -59	  0.375  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -59	  0.326  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -58	  0.251  ipipe_unstall_root+0x3 (ipipe_restore_root+0x2e)
:|   #begin   0x80000000   -58	  0.302  hard_local_irq_disable+0x15 (ipipe_unstall_root+0xd)
:|   #func                 -58	  0.441  ipipe_root_only+0x5 (ipipe_unstall_root+0x12)
:|   +end     0x80000000   -57	  0.313  hard_local_irq_enable+0x14 (ipipe_unstall_root+0x2b)
:|   +begin   0x80000001   -57	  0.332  debug_smp_processor_id+0x36 (cpu_idle+0x2b)
:|   +end     0x80000001   -57	  0.322  debug_smp_processor_id+0x82 (cpu_idle+0x2b)
:    +func                 -56	  0.310  local_touch_nmi+0x3 (cpu_idle+0x3f)
:    #func                 -56	  0.332  rcu_idle_enter+0x9 (cpu_idle+0x57)
:|   #begin   0x80000001   -56	  0.320  debug_smp_processor_id+0x36 (rcu_idle_enter+0x4b)
:|   #end     0x80000001   -55	  0.311  debug_smp_processor_id+0x82 (rcu_idle_enter+0x4b)
:    #func                 -55	  0.263  rcu_idle_enter_common+0x6 (rcu_idle_enter+0xb0)
:|   #begin   0x80000001   -55	  0.332  debug_smp_processor_id+0x36 (rcu_idle_enter_common+0x79)
:|   #end     0x80000001   -54	  0.321  debug_smp_processor_id+0x82 (rcu_idle_enter_common+0x79)
:    #func                 -54	  0.262  ipipe_restore_root+0x4 (arch_local_irq_restore+0x11)
:    #func                 -54	  0.249  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
:|   #begin   0x80000001   -54	  0.373  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
:|   #end     0x80000001   -53	  0.333  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
:    #func                 -53	  0.272  default_idle+0x3 (cpu_idle+0x5d)
:|   #begin   0x80000001   -53	  0.325  debug_smp_processor_id+0x36 (default_idle+0xd)
:|   #end     0x80000001   -52	  0.304  debug_smp_processor_id+0x82 (default_idle+0xd)
:|   #begin   0x80000001   -52	  0.332  debug_smp_processor_id+0x36 (default_idle+0x1e)
:|   #end     0x80000001   -52	  0.374  debug_smp_processor_id+0x82 (default_idle+0x1e)
:    #func                 -51	  0.251  __ipipe_halt_root+0x3 (default_idle+0x48)
:|   #begin   0x80000000   -51	  0.342  __ipipe_halt_root+0x1a (default_idle+0x48)
:|   +end     0x8000000e   -51!  16.602  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +begin   0x000000ef   -34+   2.157  apic_timer_interrupt+0x37 (__ipipe_halt_root+0x4e)
:|   +func                 -32	  0.471  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                 -31	  0.382  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                 -31	  0.396  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                 -31	  0.611  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                 -30	  0.697  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                 -29	  0.392  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                 -29	  0.534  xnthread_periodic_handler+0x3 (xntimer_tick_aperiodic+0x78)
:|  # func                 -28	  0.867  xnpod_resume_thread+0x9 (xnthread_periodic_handler+0x20)
:|  # [ 1422] -<?>-   99   -28	  0.698  xnpod_resume_thread+0x4a (xnthread_periodic_handler+0x20)
:|  # func                 -27	  0.933  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@62      -26	  0.639  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                 -25	  0.717  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                 -25+   1.843  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                 -23+   1.286  __xnpod_schedule+0x9 (xnintr_clock_handler+0x124)
:|  # func                 -21+   6.100  __xnlock_spin+0x9 (T.1349+0x55)
:|  # [    0] -<?>-   -1   -15	  0.361  __xnpod_schedule+0x69 (xnintr_clock_handler+0x124)
:|  # func                 -15	  0.808  xnsched_pick_next+0x6 (__xnpod_schedule+0xae)
:|  # func                 -14+   1.508  __switch_to+0x9 (__xnpod_schedule+0x3c6)
:|  # [ 1422] -<?>-   99   -13	  0.861  __xnpod_schedule+0x43e (xnpod_schedule+0x32)
:|  # func                 -12	  0.608  xntimer_get_overruns+0x9 (xnpod_wait_thread_period+0xa8)
:|  # func                 -11	  0.398  __ipipe_restore_head+0x4 (ipipe_restore_pipeline_head+0x4d)
:|  + end     0x80000000   -11	  0.707  hard_local_irq_enable+0x14 (__ipipe_restore_head+0x66)
:|  + begin   0x80000001   -10	  0.543  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
:|  + end     0x80000001   -10	  0.465  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
:|  + begin   0x80000001    -9+   1.824  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
:   + func                  -7	  0.403  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
:   + func                  -7	  0.358  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
:|  + begin   0x80000001    -7	  0.522  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
:|  + end     0x80000001    -6	  0.402  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
:   + func                  -6	  0.416  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
:|  + begin   0x80000001    -5	  0.422  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
:|  + end     0x80000001    -5	  0.411  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)
:   + func                  -4	  0.509  hisyscall_event+0x9 (ipipe_syscall_hook+0x88)
:   + func                  -4	  0.519  xnshadow_sys_trace+0x6 (hisyscall_event+0x11b)
:   + func                  -3	  0.404  ipipe_trace_frozen_reset+0x6 (xnshadow_sys_trace+0x5c)
:   + func                  -3	  0.394  __ipipe_global_path_lock+0x9 (ipipe_trace_frozen_reset+0x1a)
:   + func                  -3	  0.395  __ipipe_spin_lock_irqsave+0x5 (__ipipe_global_path_lock+0x1d)
:|  + begin   0x80000001    -2+   1.533  hard_local_irq_save+0x16 (__ipipe_spin_lock_irqsave+0x11)
:|  # func                  -1	  0.586  __ipipe_spin_unlock_irqcomplete+0x4 (__ipipe_global_path_unlock+0x62)
:|  + end     0x80000001     0	  0.487  hard_local_irq_restore+0x15 (__ipipe_spin_unlock_irqcomplete+0x24)
<   + freeze  0x00006128     0	  0.538  xnshadow_sys_trace+0x65 (hisyscall_event+0x11b)
 |  + begin   0x80000001     0	  0.502  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x6a)
 |  + end     0x80000001     1	  0.465  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0xc5)
 |  + begin   0x80000001     1	  1.384  hard_local_irq_save+0x16 (__ipipe_syscall_root+0x35)
    + func                   2	  0.377  __ipipe_syscall_root+0x6 (sysenter_past_esp+0x55)
    + func                   3	  0.332  __ipipe_notify_syscall+0x9 (__ipipe_syscall_root+0x2e)
 |  + begin   0x80000001     3	  0.502  hard_local_irq_save+0x16 (__ipipe_notify_syscall+0x18)
 |  + end     0x80000001     4	  1.121  hard_local_irq_restore+0x15 (__ipipe_notify_syscall+0x58)
    + func                   5	  0.294  ipipe_syscall_hook+0x9 (__ipipe_notify_syscall+0x63)
 |  + begin   0x80000001     5	  0.299  ipipe_syscall_hook+0x2b (__ipipe_notify_syscall+0x63)
 |  + end     0x80000001     5	  0.000  ipipe_syscall_hook+0x75 (__ipipe_notify_syscall+0x63)


[max]
I-pipe worst-case tracing service on 3.5.7-trace/ipipe release #3
-------------------------------------------------------------
CPU: 0, Begin: 32286795377514 cycles, Trace Points: 17 (-10/+5), Length: 3854 us
Calibrated minimum trace-point overhead: 0.078 us

 +----- Hard IRQs ('|': locked)
 |+-- Xenomai
 ||+- Linux ('*': domain stalled, '+': current, '#': current+stalled)
 |||			  +---------- Delay flag ('+': > 1 us, '!': > 10 us)
 |||			  |	   +- NMI noise ('N')
 |||			  |	   |
	  Type	  User Val.   Time    Delay  Function (Parent)
     #func                  -4	  0.351  ipipe_root_only+0x5 (ipipe_restore_root+0x10)
 |   #begin   0x80000001    -4	  0.450  hard_local_irq_save+0x16 (ipipe_root_only+0xf)
 |   #end     0x80000001    -4	  0.495  hard_local_irq_restore+0x15 (ipipe_root_only+0x40)
     #func                  -3	  0.397  default_idle+0x3 (cpu_idle+0x5d)
 |   #begin   0x80000001    -3	  0.437  debug_smp_processor_id+0x36 (default_idle+0xd)
 |   #end     0x80000001    -2	  0.425  debug_smp_processor_id+0x82 (default_idle+0xd)
 |   #begin   0x80000001    -2	  0.439  debug_smp_processor_id+0x36 (default_idle+0x1e)
 |   #end     0x80000001    -1	  0.509  debug_smp_processor_id+0x82 (default_idle+0x1e)
     #func                  -1	  0.388  __ipipe_halt_root+0x3 (default_idle+0x48)
 |   #begin   0x80000000    -1	  1.048  __ipipe_halt_root+0x1a (default_idle+0x48)
>|   +end     0x8000000e     0! 3842.189  __ipipe_halt_root+0x4c (default_idle+0x48)
:|   +func                3842	  0.621  __ipipe_handle_irq+0x9 (apic_timer_interrupt+0x3e)
:|   +func                3842	  0.478  __ipipe_dispatch_irq+0x9 (__ipipe_handle_irq+0xba)
:|   +func                3843	  0.430  __ipipe_ack_hrtimer_irq+0x6 (__ipipe_dispatch_irq+0xa4)
:|   +func                3843	  0.700  lapic_itimer_ack+0x3 (__ipipe_ack_hrtimer_irq+0x59)
:|  # func                3844+   1.266  xnintr_clock_handler+0x5 (__ipipe_dispatch_irq+0x14d)
:|  # func                3845+   3.607  __xnlock_spin+0x9 (T.1249+0x47)
:|  # func                3849	  0.569  xntimer_tick_aperiodic+0x9 (xnintr_clock_handler+0x97)
:|  # func                3849	  0.406  xntimer_next_local_shot+0x9 (xntimer_tick_aperiodic+0x143)
:|  # event   tick@599884 3850	  0.403  xntimer_next_local_shot+0xbd (xntimer_tick_aperiodic+0x143)
:|  # func                3850	  0.408  ipipe_timer_set+0x9 (xntimer_next_local_shot+0xc4)
:|  # func                3851	  0.672  lapic_next_event+0x3 (ipipe_timer_set+0x77)
:|  # func                3851	  0.400  xnintr_host_tick+0x4 (xnintr_clock_handler+0x151)
:|  # func                3852	  0.723  __ipipe_set_irq_pending+0x6 (xnintr_host_tick+0x50)
:|   +func                3852	  0.643  __ipipe_do_sync_pipeline+0x4 (__ipipe_dispatch_irq+0x18c)
:|   +func                3853	  0.508  __ipipe_do_sync_stage+0x9 (__ipipe_do_sync_pipeline+0x63)
<|   #end     0x80000000  3854	  0.472  hard_local_irq_enable+0x14 (__ipipe_do_sync_stage+0xbd)
     #func                3854	  0.454  __ipipe_do_IRQ+0x5 (__ipipe_do_sync_stage+0x137)
     #func                3854	  0.407  __ipipe_get_ioapic_irq_vector+0x3 (__ipipe_do_IRQ+0x1d)
     #func                3855	  0.362  smp_apic_timer_interrupt+0x5 (__ipipe_do_IRQ+0x42)
     #func                3855	  0.365  irq_enter+0x4 (smp_apic_timer_interrupt+0x21)
 |   #begin   0x80000001  3856	  0.000  debug_smp_processor_id+0x36 (irq_enter+0xe)

^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: [Xenomai] Decrease Latency (below 10 us) on x32 or x32_64?
  2013-04-02 17:49               ` Manuel Huber
@ 2013-04-02 22:20                 ` Gilles Chanteperdrix
  0 siblings, 0 replies; 12+ messages in thread
From: Gilles Chanteperdrix @ 2013-04-02 22:20 UTC (permalink / raw)
  To: Manuel Huber; +Cc: xenomai

On 04/02/2013 07:49 PM, Manuel Huber wrote:

> Hello!
> 
> Okay, I miss-configured the last kernel, HPET was still on. Now I compiled
> one version on 32bit and one on 64bit. Sorry for the delay, I had some
> issues with 64bit (RTL8169 card doesn't work; I have to check what's the
> problem (I will open another thread for this, but maybe it's just related
> to our machine because there is an on-board chip that may cause the
> problem...). I've included two trace-files, one for 32bits and one for
> 64bits, both with HPET disabled.
> 
> I also checked the C1 Setting in BIOS and the kernel configuration:
> 
> |---------------------------+----------|
> | AMD C1E Support           | Disabled |
> | AMD K8 Cool&Quiet control | Disabled |
> |---------------------------+----------|
> | HPET Support              | Disabled |
> |---------------------------+----------|
> 
>> You would probably have better latencies with using Xenomai on only one
>> core. But 36us with the tracer on does not look so bad, does it?
> 
> Is it enough to boot the kernel with isolcpus=cpu-id and then run the
> latency tool with the -c option or do I have to restrict IRQ's to the
> specific cpu-id? Do I have to adjust /proc/irq/<some-number>/smp_affinity,
> or is there some other thing I have to do?


Hi,

You have to use the "supported_cpus" argument. If xenomai is not
compiled as a module, pass the "xeno_nucleus.supported_cpus" argument on
the kernel command line.

> 
> So, the timing of the system is awesome most of the time. I just wanted to
> clarify, whether there is a problem with my setup, or it's normal. It would
> be cool to get rid of let's say all above 10µs. It just rarely happens, but
> it does.


If there is a problem with your setup, it does not appear clearly on the
traces you sent. Maybe what would help is to trigger a trace on the
opposite cpus when the current cpu has spun for some time on a nucleus lock.

> 
> These were the results (tracer disabled) of a test in single/vga mode
> (nouveau driver not in use), with heavy stress on the system (nice -20; 10
> instances of burnK7) and IRQ mode (latency -t 2) for 1 hour. (I have


I do not know what burnK7 does, but if it only uses cpu it is not really
a heavy stress. See "dohell" for stressing the system with a more
composite load.

> already posted them, just to point out the problem)
> 
> Thanks again for your help!
> 
> Statistics
> ----------
> 
> |-----+---------+---------+---------+---------+-----+-------------------|
> | RTH | lat min | lat avg | lat max | overrun | msw | time              |
> | RTS |  -3.386 |  -2.725 |  19.469 |       0 |   0 | 01:00:00/01:00:00 |
> |-----+---------+---------+---------+---------+-----+-------------------|



Your system is not calibrated correctly. In order to measure latency you
should run:

echo 0 > /proc/xenomai/latency

Then when you have run the latency test for a sufficient time, echo the
minimum latency you measured, minus some safety margin, to
/proc/xenomai/latency again. If you want to avoid setting the latency
again every time you boot, use the kernel configuration parameter
CONFIG_XENO_OPT_TIMING_SCHEDLAT



-- 
                                                                Gilles.



^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: [Xenomai] Decrease Latency (below 10 us) on x32 or x32_64?
  2013-03-19 20:46 ` Gilles Chanteperdrix
  2013-03-26 10:18   ` Manuel Huber
@ 2013-04-13 16:42   ` Gilles Chanteperdrix
  2013-04-18  5:51     ` Manuel Huber
  1 sibling, 1 reply; 12+ messages in thread
From: Gilles Chanteperdrix @ 2013-04-13 16:42 UTC (permalink / raw)
  To: Manuel Huber; +Cc: xenomai

On 03/19/2013 09:46 PM, Gilles Chanteperdrix wrote:

> On 03/19/2013 09:14 PM, Manuel Huber wrote:
> 
>> Hello!
>>
>> We use a AMD FX-61000 CPU together with Xenomai 2.6.2.1 and Kernel
>> 3.5.7 (thanks to Jan Kiszka) and I was wondering if it's possible to
>> further decrease the latency of the system. I currently can get more
>> than 30 us when interacting with the system.
>>
>> My first guess was the graphics card + graphics card driver because I
>> read about such problems and tested another graphics card which caused
>> a huge amount of extra-latency... I tried to get the real system
>> latency by booting the system in recovery mode (single) with vga=792
>> option + setting the nouveau driver on the blacklist... This seems to
>> work, but I still get roughly the same latencies (>20us) even after
>> 1hour by using the latency program in interrupt mode (-t 2). Only a
>> few times the latency grows beyond 10us but still it does... I have
>> unplugged the usb mouse and keyboard before running the test and
>> started ten instances of burnK7 with nice -n -20.  I also tried
>> booting with isolcpus=2,3 and assigned the latency program to cpu 3
>> (-c 3). This didn't really improve the worst case latency (still the
>> same setup as above, no gui, single). Is it possible to further
>> decrease latency (especially worst case latency) by using one cpu just
>> for real-time tasks? Is there some other way to keep Linux from using
>> a core?
>>
>> The next thing I want to test is using 64bits; It seems rational that
>> using 32 bits with 16GB ram causes some extra latencies but is it
>> possible that it causes about 10 us extra? Is there some other option
>> I can tune? I know that the I-Pipe system isn't trivial but to me,
>> using interrupts seems pretty low-level and I would expect this to
>> have minimal latency (and jitter). I don't want to complain, it's just
>> that my supervisor asked me about the source of the latency and I
>> can't really explain... After having read just about all papers
>> about I-Pipe, I still don't have a deep understanding of the system.
>> Is there a good reference I missed?
> 
> 
> First, to know where the latency comes from, enable the I-pipe tracer,
> and run latency with the "-f" option.
> 
> Now, common ways to reduce latencies are:
> - optimize the kernel for size
> - disable high res timers, you can try fiddling with the various preempt
> settings, this used to have a big impact on code size, but with the
> "optimize for size" option, they no longer seem to have one.
> - check what the processor does when idle; if it enters C1 state, try to
> avoid that with the BIOS settings, or pass "nohlt" on the kernel command
> line.


Some more advices after some tests:
- try passing "idle=poll" on the kernel command line
- disable MTRR

-- 
                                                                Gilles.


^ permalink raw reply	[flat|nested] 12+ messages in thread

* Re: [Xenomai] Decrease Latency (below 10 us) on x32 or x32_64?
  2013-04-13 16:42   ` Gilles Chanteperdrix
@ 2013-04-18  5:51     ` Manuel Huber
  0 siblings, 0 replies; 12+ messages in thread
From: Manuel Huber @ 2013-04-18  5:51 UTC (permalink / raw)
  To: Gilles Chanteperdrix, xenomai

I'm currently not working on the system, but I will continue in a few
weeks and try the suggested options. I'm thankful for all your help. I
will definitely test and report back!


On 2013-04-13 18:42, Gilles Chanteperdrix wrote:
> On 03/19/2013 09:46 PM, Gilles Chanteperdrix wrote:
>
>> On 03/19/2013 09:14 PM, Manuel Huber wrote:
>>
>>> Hello!
>>>
>>> We use a AMD FX-61000 CPU together with Xenomai 2.6.2.1 and Kernel
>>> 3.5.7 (thanks to Jan Kiszka) and I was wondering if it's possible to
>>> further decrease the latency of the system. I currently can get more
>>> than 30 us when interacting with the system.
>>>
>>> My first guess was the graphics card + graphics card driver because I
>>> read about such problems and tested another graphics card which caused
>>> a huge amount of extra-latency... I tried to get the real system
>>> latency by booting the system in recovery mode (single) with vga=792
>>> option + setting the nouveau driver on the blacklist... This seems to
>>> work, but I still get roughly the same latencies (>20us) even after
>>> 1hour by using the latency program in interrupt mode (-t 2). Only a
>>> few times the latency grows beyond 10us but still it does... I have
>>> unplugged the usb mouse and keyboard before running the test and
>>> started ten instances of burnK7 with nice -n -20.  I also tried
>>> booting with isolcpus=2,3 and assigned the latency program to cpu 3
>>> (-c 3). This didn't really improve the worst case latency (still the
>>> same setup as above, no gui, single). Is it possible to further
>>> decrease latency (especially worst case latency) by using one cpu just
>>> for real-time tasks? Is there some other way to keep Linux from using
>>> a core?
>>>
>>> The next thing I want to test is using 64bits; It seems rational that
>>> using 32 bits with 16GB ram causes some extra latencies but is it
>>> possible that it causes about 10 us extra? Is there some other option
>>> I can tune? I know that the I-Pipe system isn't trivial but to me,
>>> using interrupts seems pretty low-level and I would expect this to
>>> have minimal latency (and jitter). I don't want to complain, it's just
>>> that my supervisor asked me about the source of the latency and I
>>> can't really explain... After having read just about all papers
>>> about I-Pipe, I still don't have a deep understanding of the system.
>>> Is there a good reference I missed?
>>
>> First, to know where the latency comes from, enable the I-pipe tracer,
>> and run latency with the "-f" option.
>>
>> Now, common ways to reduce latencies are:
>> - optimize the kernel for size
>> - disable high res timers, you can try fiddling with the various preempt
>> settings, this used to have a big impact on code size, but with the
>> "optimize for size" option, they no longer seem to have one.
>> - check what the processor does when idle; if it enters C1 state, try to
>> avoid that with the BIOS settings, or pass "nohlt" on the kernel command
>> line.
>
> Some more advices after some tests:
> - try passing "idle=poll" on the kernel command line
> - disable MTRR
>



^ permalink raw reply	[flat|nested] 12+ messages in thread

end of thread, other threads:[~2013-04-18  5:51 UTC | newest]

Thread overview: 12+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2013-03-19 20:14 [Xenomai] Decrease Latency (below 10 us) on x32 or x32_64? Manuel Huber
2013-03-19 20:46 ` Gilles Chanteperdrix
2013-03-26 10:18   ` Manuel Huber
2013-03-26 11:57     ` Gilles Chanteperdrix
2013-03-28 10:06       ` Manuel Huber
2013-03-28 12:46         ` Gilles Chanteperdrix
2013-03-28 13:04           ` Manuel Huber
2013-03-28 20:24             ` Gilles Chanteperdrix
2013-04-02 17:49               ` Manuel Huber
2013-04-02 22:20                 ` Gilles Chanteperdrix
2013-04-13 16:42   ` Gilles Chanteperdrix
2013-04-18  5:51     ` Manuel Huber

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.