All of lore.kernel.org
 help / color / mirror / Atom feed
From: david ahern <daahern-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org>
To: Avi Kivity <avi-atKUWr5tajBWk0Htik3J/w@public.gmane.org>
Cc: kvm-devel <kvm-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org>
Subject: RHEL5 smp guests on RHE5.1 hosts hang with kvm-52
Date: Mon, 12 Nov 2007 15:37:00 -0700	[thread overview]
Message-ID: <4738D58C.70304@cisco.com> (raw)
In-Reply-To: <4738C9B5.6060609-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org>

[-- Attachment #1: Type: text/plain, Size: 9147 bytes --]

(Changed the subject to correspond with email.)

I am having the same problem on the 64-bit host running RHEL5.1 as well, it just takes more reboots. Same symptoms as I mentioned for the 32-bit host. kernel side stack traces for each qemu thread for one of the lockups is attached; the file contains traces for each thread at 3 sample times in case it helps get some insight.

david


david ahern wrote:
> With kvm-52 my 32-bit host running RHEL5.1 can start an RHEL 5 SMP guest only once. Second and subsequent attempts hang. Removing kvm and kvm_intel modules have no affect; I need to reboot the host to get an SMP guest to start. My similarly configured 64-bit host does not seem to have this problem.
> 
> 
> Second attempts to start the RHEL5 SMP guest hang at:
> Starting udev: _
> 
> 
> Looking at top on the host shows qemu in a loop:
>   PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND                                                
>  3909 root      18   0 1625m  67m 9476 R  400  2.1   2:52.32 qemu-system-x86                                         
> 
> 
> In this case the qemu threads are:
> 
>   PID   LWP TTY          TIME CMD
>  3909  3909 pts/0    00:01:12 qemu-system-x86
>  3909  3911 pts/0    00:01:05 qemu-system-x86
>  3909  3912 pts/0    00:01:05 qemu-system-x86
>  3909  3913 pts/0    00:01:07 qemu-system-x86
>  3909  3917 pts/0    00:00:00 qemu-system-x86
> 
> 
> 
> and their kernel side backtraces are:
> 
>  process trace for qemu-system-x86(3909)
>         f5967d88 00000082 f8c125e4 bbdec465 000001c6 f5230da4 00000001 f7acf000 
>         f7d7d000 bbded629 000001c6 000011c4 00000000 f7acf110 c30126e0 00000001 
>         f4d8a000 f5967d90 f5967d80 f5230da0 f5967000 f8c11120 f5230da0 f4d8a000 
>  Call Trace:
>   [<f8c125e4>] vmx_vcpu_put+0xef/0xf6 [kvm_intel]
>   [<f8c11120>] handle_external_interrupt+0x0/0xc [kvm_intel]
>   [<c042169f>] __cond_resched+0x16/0x34
>   [<c0604218>] cond_resched+0x2a/0x31
>   [<f8b96d7f>] kvm_arch_vcpu_ioctl_run+0x28d/0x333 [kvm]
>   [<f8b94319>] kvm_vcpu_ioctl+0x0/0x366 [kvm]
>   [<f8b943d4>] kvm_vcpu_ioctl+0xbb/0x366 [kvm]
>   [<c042169f>] __cond_resched+0x16/0x34
>   [<c0604218>] cond_resched+0x2a/0x31
>   [<c0480305>] core_sys_select+0x1ef/0x2ca
>   [<c041ea84>] __wake_up_common+0x2f/0x53
>   [<c0604141>] schedule+0x90d/0x9ba
>   [<c0405953>] reschedule_interrupt+0x1f/0x24
>   [<c042e759>] __dequeue_signal+0x151/0x15c
>   [<c042fa99>] dequeue_signal+0x2d/0x9c
>   [<c043062c>] sys_rt_sigtimedwait+0xc5/0x2c2
>   [<c042cc0e>] getnstimeofday+0x30/0xb6
>   [<c04386d6>] ktime_get_ts+0x16/0x44
>   [<c04388b6>] ktime_get+0x12/0x34
>   [<c04352a6>] common_timer_get+0xee/0x129
>   [<f8b94319>] kvm_vcpu_ioctl+0x0/0x366 [kvm]
>   [<c047f1e8>] do_ioctl+0x1c/0x5d
>   [<c047f473>] vfs_ioctl+0x24a/0x25c
>   [<c047f4cd>] sys_ioctl+0x48/0x5f
>   [<c0404eff>] syscall_call+0x7/0xb
>   =======================
>  process trace for qemu-system-x86(3911)
>         c301a6e0 00000100 000001c7 f749baa0 00000001 c301a6e0 f749baa0 00000001 
>         f51fed44 f51fed44 f51fed6c 00000001 00000001 00000046 f579ce20 f57ee000 
>         00000001 c04059bf f579ce20 8005003b 00006c00 f8c113e5 f579ce20 f579ce20 
>  Call Trace:
>   [<c04059bf>] apic_timer_interrupt+0x1f/0x24
>   [<f8c113e5>] vmcs_writel+0x1b/0x2c [kvm_intel]
>   [<f8b96cf4>] kvm_arch_vcpu_ioctl_run+0x202/0x333 [kvm]
>   [<f8b94319>] kvm_vcpu_ioctl+0x0/0x366 [kvm]
>   [<f8b943d4>] kvm_vcpu_ioctl+0xbb/0x366 [kvm]
>   [<c041fa31>] enqueue_task+0x29/0x39
>   [<c041fa5d>] __activate_task+0x1c/0x29
>   [<c04202a7>] try_to_wake_up+0x371/0x37b
>   [<c0604141>] schedule+0x90d/0x9ba
>   [<c041ea84>] __wake_up_common+0x2f/0x53
>   [<c041f871>] __wake_up+0x2a/0x3d
>   [<c0438eb7>] wake_futex+0x3a/0x44
>   [<c0439187>] futex_wake+0xa9/0xb3
>   [<c0439d66>] do_futex+0x20d/0xb15
>   [<f8b94696>] kvm_ack_smp_call+0x17/0x27 [kvm]
>   [<c042e759>] __dequeue_signal+0x151/0x15c
>   [<c042fa99>] dequeue_signal+0x2d/0x9c
>   [<f8b93ea9>] kvm_vm_ioctl+0x0/0x277 [kvm]
>   [<f8b9410d>] kvm_vm_ioctl+0x264/0x277 [kvm]
>   [<c04202b1>] default_wake_function+0x0/0xc
>   [<c040599b>] call_function_interrupt+0x1f/0x24
>   [<f8b94319>] kvm_vcpu_ioctl+0x0/0x366 [kvm]
>   [<c047f1e8>] do_ioctl+0x1c/0x5d
>   [<c047f473>] vfs_ioctl+0x24a/0x25c
>   [<c047f4cd>] sys_ioctl+0x48/0x5f
>   [<c0404eff>] syscall_call+0x7/0xb
>   =======================
>  process trace for qemu-system-x86(3912)
>         f560fd88 00000082 f8c125e4 193272c5 000001c8 f52b6074 00000004 f7f09000 
>         f7f09000 19328fc9 000001c8 00001d04 00000002 f52b6070 55eefb90 00000000 
>         f52b6070 f5693000 f52b6070 8005003b 00006c00 f8c113e5 f52b6070 f52b6070 
>  Call Trace:
>   [<f8c125e4>] vmx_vcpu_put+0xef/0xf6 [kvm_intel]
>   [<f8c113e5>] vmcs_writel+0x1b/0x2c [kvm_intel]
>   [<f8b96cf4>] kvm_arch_vcpu_ioctl_run+0x202/0x333 [kvm]
>   [<f8b94319>] kvm_vcpu_ioctl+0x0/0x366 [kvm]
>   [<f8b943d4>] kvm_vcpu_ioctl+0xbb/0x366 [kvm]
>   [<c0604141>] schedule+0x90d/0x9ba
>   [<c041ea84>] __wake_up_common+0x2f/0x53
>   [<c0461e10>] find_extend_vma+0x12/0x49
>   [<c0438d53>] get_futex_key+0x40/0xd0
>   [<c0439187>] futex_wake+0xa9/0xb3
>   [<c0439d66>] do_futex+0x20d/0xb15
>   [<f888f9b0>] ext3_ordered_writepage+0x0/0x162 [ext3]
>   [<c042e759>] __dequeue_signal+0x151/0x15c
>   [<c042fa99>] dequeue_signal+0x2d/0x9c
>   [<f8b93ea9>] kvm_vm_ioctl+0x0/0x277 [kvm]
>   [<f8b9410d>] kvm_vm_ioctl+0x264/0x277 [kvm]
>   [<c04202b1>] default_wake_function+0x0/0xc
>   [<f8b94319>] kvm_vcpu_ioctl+0x0/0x366 [kvm]
>   [<c047f1e8>] do_ioctl+0x1c/0x5d
>   [<c047f473>] vfs_ioctl+0x24a/0x25c
>   [<c047f4cd>] sys_ioctl+0x48/0x5f
>   [<c0404eff>] syscall_call+0x7/0xb
>   =======================
>  process trace for qemu-system-x86(3913)
>         c302a6e0 00000100 000001c8 f7488550 00000003 c302a6e0 f7488550 00000003 
>         f4d92d44 f4d92d44 f4d92d6c 00000001 00000001 00000046 f52b6de0 f5aaa000 
>         00000001 c04059bf f52b6de0 8005003b 00006c00 f8c113e5 f52b6de0 f52b6de0 
>  Call Trace:
>   [<c04059bf>] apic_timer_interrupt+0x1f/0x24
>   [<f8c113e5>] vmcs_writel+0x1b/0x2c [kvm_intel]
>   [<f8b96cf4>] kvm_arch_vcpu_ioctl_run+0x202/0x333 [kvm]
>   [<f8b94319>] kvm_vcpu_ioctl+0x0/0x366 [kvm]
>   [<f8b943d4>] kvm_vcpu_ioctl+0xbb/0x366 [kvm]
>   [<c0604141>] schedule+0x90d/0x9ba
>   [<c041ea84>] __wake_up_common+0x2f/0x53
>   [<c0461e10>] find_extend_vma+0x12/0x49
>   [<c0438d53>] get_futex_key+0x40/0xd0
>   [<c0439187>] futex_wake+0xa9/0xb3
>   [<c0439d66>] do_futex+0x20d/0xb15
>   [<c040599b>] call_function_interrupt+0x1f/0x24
>   [<c042e759>] __dequeue_signal+0x151/0x15c
>   [<f8b93ea9>] kvm_vm_ioctl+0x0/0x277 [kvm]
>   [<f8b9410d>] kvm_vm_ioctl+0x264/0x277 [kvm]
>   [<c04202b1>] default_wake_function+0x0/0xc
>   [<f8b94319>] kvm_vcpu_ioctl+0x0/0x366 [kvm]
>   [<c047f1e8>] do_ioctl+0x1c/0x5d
>   [<c047f473>] vfs_ioctl+0x24a/0x25c
>   [<c047f4cd>] sys_ioctl+0x48/0x5f
>   [<c0404eff>] syscall_call+0x7/0xb
>   =======================
> 
> david
> 
> 
> Avi Kivity wrote:
>> david ahern wrote:
>>> The patch worked for me -- rhel4 smp guests boot fine on stock RHEL5
>>> hosts, both 32-bit and 64-bit.
>>>
>>>   
>> Excellent.  I had a premonition so it is already committed.
>>
>> Do note that smp_call_function_mask() emulation is pretty bad in terms
>> of performance on large multicores.  On a dual code it's basically
>> equivalent to mainline, I guess it's okay for four-way, but above
>> four-way you will need either mainline or a better
>> smp_call_function_mask() (which is nontrivial but doable).
>>
>>> david
>>>
>>>
>>> Avi Kivity wrote:
>>>  
>>>> david ahern wrote:
>>>>    
>>>>> In RHEL 5.1 <linux/notifier.h> defines:
>>>>>
>>>>> #define CPU_TASKS_FROZEN    0x0010
>>>>>
>>>>> #define CPU_ONLINE_FROZEN   (CPU_ONLINE | CPU_TASKS_FROZEN)
>>>>> #define CPU_DEAD_FROZEN     (CPU_DEAD | CPU_TASKS_FROZEN)
>>>>>
>>>>> which means in kvm-51/kernel/external-module-compat.h the '#ifndef
>>>>> CPU_TASKS_FROZEN' needs to have a case. For my purposes, I just moved
>>>>> up the endif around what was defined.
>>>>>         
>>>> I committed a change which renders this unnecessary.  Will be part of
>>>> kvm-52.
>>>>
>>>>    
>>>>> With that change, kvm-51 compiles. I am still seeing 32-bit SMP guests
>>>>> hang on boot for both 32-bit and 64-bit hosts (again running RHEL5.1).
>>>>>         
>>>> I still don't.  Can you test the attached patch?
>>>>
>>>>
>>>>
>>>> ------------------------------------------------------------------------
>>>>
>>>> -------------------------------------------------------------------------
>>>>
>>>> This SF.net email is sponsored by: Splunk Inc.
>>>> Still grepping through log files to find problems?  Stop.
>>>> Now Search log events and configuration files using AJAX and a browser.
>>>> Download your FREE copy of Splunk now >> http://get.splunk.com/
>>>>
>>>>
>>>> ------------------------------------------------------------------------
>>>>
>>>> _______________________________________________
>>>> kvm-devel mailing list
>>>> kvm-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org
>>>> https://lists.sourceforge.net/lists/listinfo/kvm-devel
>>>>     
>>
> 

[-- Attachment #2: messages --]
[-- Type: text/plain, Size: 27242 bytes --]

Nov 12 15:30:40 bldr-ccm20 syslogd 1.4.1: restart.
Nov 12 15:31:06 bldr-ccm20 kernel: process trace for qemu-system-x86(3853)
Nov 12 15:31:06 bldr-ccm20 kernel:  0000000000000000 0000000000000086 ffff81011c30b1e8 00000000ffffd0b0
Nov 12 15:31:06 bldr-ccm20 kernel:  0000000000000006 ffff81012db4e100 ffff81012f9f8080 0000015310c2502a
Nov 12 15:31:06 bldr-ccm20 kernel:  0000000000001a33 ffff81012db4e2f0 ffff810100000001 ffff81012f9f8080
Nov 12 15:31:06 bldr-ccm20 kernel: Call Trace:
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8848475b>] :kvm_intel:vmcs_writel+0x20/0x35
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff80089a00>] __cond_resched+0x1c/0x44
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8006104f>] cond_resched+0x3b/0x42
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8846463b>] :kvm:kvm_arch_vcpu_ioctl_run+0x23f/0x393
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8846150e>] :kvm:kvm_vcpu_ioctl+0xc3/0x388
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff80021d2f>] __up_read+0x19/0x7f
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff800dd3ac>] core_sys_select+0x234/0x265
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8006b75e>] do_gettimeofday+0x50/0x92
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff80093c20>] __dequeue_signal+0x18b/0x19a
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8006b75e>] do_gettimeofday+0x50/0x92
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff80058baf>] getnstimeofday+0x10/0x28
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8009d3fc>] ktime_get_ts+0x1a/0x4e
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8003fc22>] do_ioctl+0x21/0x6b
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8006b098>] syscall_trace_leave+0x2c/0x87
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8004a242>] sys_ioctl+0x59/0x78
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Nov 12 15:31:06 bldr-ccm20 kernel: 
Nov 12 15:31:06 bldr-ccm20 kernel: process trace for qemu-system-x86(3855)
Nov 12 15:31:06 bldr-ccm20 kernel:  ffff81010b72dca8 0000000000000086 ffff81011c30d228 00000000ffffd0b0
Nov 12 15:31:06 bldr-ccm20 kernel:  0000000000000001 ffff81012dbd5040 ffff81012c799860 0000015310ba11ff
Nov 12 15:31:06 bldr-ccm20 kernel:  0000000000001502 ffff81012dbd5230 ffff810100000003 ffff81012c799860
Nov 12 15:31:06 bldr-ccm20 kernel: Call Trace:
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8848475b>] :kvm_intel:vmcs_writel+0x20/0x35
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff80089a00>] __cond_resched+0x1c/0x44
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8006104f>] cond_resched+0x3b/0x42
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff884646e2>] :kvm:kvm_arch_vcpu_ioctl_run+0x2e6/0x393
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8846150e>] :kvm:kvm_vcpu_ioctl+0xc3/0x388
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff80021d2f>] __up_read+0x19/0x7f
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8009dcf1>] futex_wake+0xc6/0xd5
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8003d808>] do_futex+0x241/0xbc7
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff80093c20>] __dequeue_signal+0x18b/0x19a
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff88461432>] :kvm:kvm_vm_ioctl+0x277/0x290
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff80094cd3>] dequeue_signal+0x3c/0xbd
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff80060f29>] thread_return+0x0/0xeb
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8009527c>] sys_rt_sigtimedwait+0xcb/0x2b4
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8003fc22>] do_ioctl+0x21/0x6b
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8002fc67>] vfs_ioctl+0x248/0x261
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8004a242>] sys_ioctl+0x59/0x78
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Nov 12 15:31:06 bldr-ccm20 kernel: 
Nov 12 15:31:06 bldr-ccm20 kernel: process trace for qemu-system-x86(3856)
Nov 12 15:31:06 bldr-ccm20 kernel:  ffff81010b6edca8 0000000000000086 0000000000000000 0000000000000001
Nov 12 15:31:06 bldr-ccm20 kernel:  0000000000000001 ffff81012db040c0 ffff81012fa0a0c0 000001531107de18
Nov 12 15:31:06 bldr-ccm20 kernel:  000000000000ae62 ffff81012db042b0 0000000000000000 ffff81012fa0a0c0
Nov 12 15:31:06 bldr-ccm20 kernel: Call Trace:
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff884843f3>] :kvm_intel:handle_external_interrupt+0x0/0xc
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff884843f3>] :kvm_intel:handle_external_interrupt+0x0/0xc
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8848475b>] :kvm_intel:vmcs_writel+0x20/0x35
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8846463b>] :kvm:kvm_arch_vcpu_ioctl_run+0x23f/0x393
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8846150e>] :kvm:kvm_vcpu_ioctl+0xc3/0x388
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff80021d2f>] __up_read+0x19/0x7f
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8009dcf1>] futex_wake+0xc6/0xd5
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8003d808>] do_futex+0x241/0xbc7
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff80093c20>] __dequeue_signal+0x18b/0x19a
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff80094cd3>] dequeue_signal+0x3c/0xbd
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8009527c>] sys_rt_sigtimedwait+0xcb/0x2b4
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8003fc22>] do_ioctl+0x21/0x6b
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8002fc67>] vfs_ioctl+0x248/0x261
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8004a242>] sys_ioctl+0x59/0x78
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Nov 12 15:31:06 bldr-ccm20 kernel: 
Nov 12 15:31:06 bldr-ccm20 kernel: process trace for qemu-system-x86(3857)
Nov 12 15:31:06 bldr-ccm20 kernel:  ffff810125e8f480 ffffffff8846dd0a ffff81010b767328 00000000ffffd0b0
Nov 12 15:31:06 bldr-ccm20 kernel:  ffffffff88479c60 ffffffff88466d94 0000000100000001 ffff81010b766240
Nov 12 15:31:06 bldr-ccm20 kernel:  00000000fee000b0 0000000000000004 ffff81010b767328 00000000ffffd0b0
Nov 12 15:31:06 bldr-ccm20 kernel: Call Trace:
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8846dd0a>] :kvm:apic_mmio_write+0x198/0x48b
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff88466d94>] :kvm:paging32_gva_to_gpa+0x21/0x47
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff884629fb>] :kvm:emulator_write_emulated_onepage+0xa6/0xe5
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8846b2da>] :kvm:x86_emulate_insn+0x2e21/0x40db
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8848475b>] :kvm_intel:vmcs_writel+0x20/0x35
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8848475b>] :kvm_intel:vmcs_writel+0x20/0x35
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8846463b>] :kvm:kvm_arch_vcpu_ioctl_run+0x23f/0x393
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8846150e>] :kvm:kvm_vcpu_ioctl+0xc3/0x388
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff80021d2f>] __up_read+0x19/0x7f
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8009dcf1>] futex_wake+0xc6/0xd5
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8003d808>] do_futex+0x241/0xbc7
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff80093c20>] __dequeue_signal+0x18b/0x19a
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff88461432>] :kvm:kvm_vm_ioctl+0x277/0x290
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff80094cd3>] dequeue_signal+0x3c/0xbd
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff80095415>] sys_rt_sigtimedwait+0x264/0x2b4
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8009527c>] sys_rt_sigtimedwait+0xcb/0x2b4
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8003fc22>] do_ioctl+0x21/0x6b
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8002fc67>] vfs_ioctl+0x248/0x261
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8004a242>] sys_ioctl+0x59/0x78
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Nov 12 15:31:06 bldr-ccm20 kernel: 
Nov 12 15:31:06 bldr-ccm20 kernel: process trace for qemu-system-x86(3859)
Nov 12 15:31:06 bldr-ccm20 kernel:  ffff81012269fd48 0000000000000086 ffff810103efe6a0 ffffffff8000bf9a
Nov 12 15:31:06 bldr-ccm20 kernel:  000000000000000a ffff81012c2160c0 ffff81012db4e100 00000133b7237c71
Nov 12 15:31:06 bldr-ccm20 kernel:  00000000000020c7 ffff81012c2162a8 0000000000000002 0000000000039b64
Nov 12 15:31:06 bldr-ccm20 kernel: Call Trace:
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8000bf9a>] do_generic_mapping_read+0x3b6/0x3f8
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8003d03b>] lock_timer_base+0x1b/0x3c
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8001c40f>] __mod_timer+0xb0/0xbe
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff80061839>] schedule_timeout+0x8a/0xad
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff80092ada>] process_timeout+0x0/0x5
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8003d7a1>] do_futex+0x1da/0xbc7
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff800884ac>] default_wake_function+0x0/0xe
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff80058a29>] group_send_sig_info+0x62/0x6f
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff800947af>] kill_proc_info+0x48/0x60
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8009e935>] sys_futex+0x101/0x123
Nov 12 15:31:06 bldr-ccm20 kernel:  [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Nov 12 15:31:06 bldr-ccm20 kernel: 
Nov 12 15:32:31 bldr-ccm20 kernel: process trace for qemu-system-x86(3853)
Nov 12 15:32:31 bldr-ccm20 kernel:  ffff81011e469978 0000000000000086 0000000000000000 0000000000000000
Nov 12 15:32:31 bldr-ccm20 kernel:  0000000000000007 ffff81012db4e100 ffff810104375100 00000166b812b5f2
Nov 12 15:32:31 bldr-ccm20 kernel:  00000000001e5bf4 ffff81012db4e2e8 0000000000000001 ffff810104375100
Nov 12 15:32:31 bldr-ccm20 kernel: Call Trace:
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8846e2cb>] :kvm:ioapic_deliver+0x151/0x1f1
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8002dfa2>] __wake_up+0x38/0x4f
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff800342a2>] follow_page+0x217/0x2b8
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff800c4dad>] get_user_pages+0x32f/0x3a9
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff88460362>] :kvm:__gfn_to_page+0x76/0xa9
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80021d2f>] __up_read+0x19/0x7f
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8846087d>] :kvm:gfn_to_page+0x4d/0x56
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff88466d1b>] :kvm:paging32_walk_addr+0x2a3/0x2fb
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8846d1ca>] :kvm:apic_update_ppr+0x1e/0x49
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8846dd0a>] :kvm:apic_mmio_write+0x198/0x48b
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff88466d94>] :kvm:paging32_gva_to_gpa+0x21/0x47
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80060f29>] thread_return+0x0/0xeb
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8848475b>] :kvm_intel:vmcs_writel+0x20/0x35
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8848475b>] :kvm_intel:vmcs_writel+0x20/0x35
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8846463b>] :kvm:kvm_arch_vcpu_ioctl_run+0x23f/0x393
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8846150e>] :kvm:kvm_vcpu_ioctl+0xc3/0x388
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80021d2f>] __up_read+0x19/0x7f
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff800dd3ac>] core_sys_select+0x234/0x265
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8006b75e>] do_gettimeofday+0x50/0x92
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80058baf>] getnstimeofday+0x10/0x28
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8009d243>] enqueue_hrtimer+0x55/0x70
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8003bb73>] hrtimer_start+0xbc/0xce
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8003fc22>] do_ioctl+0x21/0x6b
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8002fc67>] vfs_ioctl+0x248/0x261
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8004a242>] sys_ioctl+0x59/0x78
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Nov 12 15:32:31 bldr-ccm20 kernel: 
Nov 12 15:32:31 bldr-ccm20 kernel: process trace for qemu-system-x86(3855)
Nov 12 15:32:31 bldr-ccm20 kernel:  ffff81010b72dc38 0000000000000086 0000000000001000 ffffffff80060f29
Nov 12 15:32:31 bldr-ccm20 kernel:  0000000000000001 ffff81012dbd5040 ffff81010439a080 00000166b8e1911c
Nov 12 15:32:31 bldr-ccm20 kernel:  00000000000004ef ffff81012dbd5228 ffff810100000002 00000166b8dfdbd6
Nov 12 15:32:31 bldr-ccm20 kernel: Call Trace:
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80060f29>] thread_return+0x0/0xeb
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80061be8>] __mutex_lock_slowpath+0x55/0x90
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80089a00>] __cond_resched+0x1c/0x44
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80061c32>] .text.lock.mutex+0xf/0x14
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff88484480>] :kvm_intel:vmcs_readl+0x17/0x1c
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff884660c0>] :kvm:kvm_mmu_page_fault+0x1b/0xb4
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff88464673>] :kvm:kvm_arch_vcpu_ioctl_run+0x277/0x393
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8846150e>] :kvm:kvm_vcpu_ioctl+0xc3/0x388
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80021d2f>] __up_read+0x19/0x7f
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8009dcf1>] futex_wake+0xc6/0xd5
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8003d808>] do_futex+0x241/0xbc7
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80093c20>] __dequeue_signal+0x18b/0x19a
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff88461432>] :kvm:kvm_vm_ioctl+0x277/0x290
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80094cd3>] dequeue_signal+0x3c/0xbd
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80060f29>] thread_return+0x0/0xeb
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8009527c>] sys_rt_sigtimedwait+0xcb/0x2b4
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8003fc22>] do_ioctl+0x21/0x6b
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8002fc67>] vfs_ioctl+0x248/0x261
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8004a242>] sys_ioctl+0x59/0x78
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Nov 12 15:32:31 bldr-ccm20 kernel: 
Nov 12 15:32:31 bldr-ccm20 kernel: process trace for qemu-system-x86(3856)
Nov 12 15:32:31 bldr-ccm20 kernel:  ffff81010b6edca8 0000000000000086 0000000000000000 0000000000000001
Nov 12 15:32:31 bldr-ccm20 kernel:  0000000000000001 ffff81012db040c0 ffff81012fa0a0c0 00000166b94a772c
Nov 12 15:32:31 bldr-ccm20 kernel:  0000000000008f94 ffff81012db042b0 0000000000000000 ffff81012fa0a0c0
Nov 12 15:32:31 bldr-ccm20 kernel: Call Trace:
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8848475b>] :kvm_intel:vmcs_writel+0x20/0x35
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8846463b>] :kvm:kvm_arch_vcpu_ioctl_run+0x23f/0x393
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8846150e>] :kvm:kvm_vcpu_ioctl+0xc3/0x388
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80021d2f>] __up_read+0x19/0x7f
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8009dcf1>] futex_wake+0xc6/0xd5
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8003d808>] do_futex+0x241/0xbc7
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80093c20>] __dequeue_signal+0x18b/0x19a
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80094cd3>] dequeue_signal+0x3c/0xbd
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8009527c>] sys_rt_sigtimedwait+0xcb/0x2b4
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8003fc22>] do_ioctl+0x21/0x6b
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8002fc67>] vfs_ioctl+0x248/0x261
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8004a242>] sys_ioctl+0x59/0x78
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Nov 12 15:32:31 bldr-ccm20 kernel: 
Nov 12 15:32:31 bldr-ccm20 kernel: process trace for qemu-system-x86(3857)
Nov 12 15:32:31 bldr-ccm20 kernel:  ffff81010b571c38 0000000000000086 ffff81010b767328 00000000ffffd0b0
Nov 12 15:32:31 bldr-ccm20 kernel:  0000000000000007 ffff81010ad3c820 ffff81010439a080 00000166b9793501
Nov 12 15:32:31 bldr-ccm20 kernel:  0000000000009420 ffff81010ad3ca08 ffffffff00000002 ffff81000100c400
Nov 12 15:32:31 bldr-ccm20 kernel: Call Trace:
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80061be8>] __mutex_lock_slowpath+0x55/0x90
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80061c32>] .text.lock.mutex+0xf/0x14
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff88484480>] :kvm_intel:vmcs_readl+0x17/0x1c
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff884660c0>] :kvm:kvm_mmu_page_fault+0x1b/0xb4
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff88464673>] :kvm:kvm_arch_vcpu_ioctl_run+0x277/0x393
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8846150e>] :kvm:kvm_vcpu_ioctl+0xc3/0x388
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80021d2f>] __up_read+0x19/0x7f
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8009dcf1>] futex_wake+0xc6/0xd5
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8003d808>] do_futex+0x241/0xbc7
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80093c20>] __dequeue_signal+0x18b/0x19a
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff88461432>] :kvm:kvm_vm_ioctl+0x277/0x290
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80094cd3>] dequeue_signal+0x3c/0xbd
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80095415>] sys_rt_sigtimedwait+0x264/0x2b4
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8009527c>] sys_rt_sigtimedwait+0xcb/0x2b4
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8003fc22>] do_ioctl+0x21/0x6b
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8002fc67>] vfs_ioctl+0x248/0x261
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8004a242>] sys_ioctl+0x59/0x78
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Nov 12 15:32:31 bldr-ccm20 kernel: 
Nov 12 15:32:31 bldr-ccm20 kernel: process trace for qemu-system-x86(3859)
Nov 12 15:32:31 bldr-ccm20 kernel:  ffff81012269fd48 0000000000000086 ffff810103efe6a0 ffffffff8000bf9a
Nov 12 15:32:31 bldr-ccm20 kernel:  000000000000000a ffff81012c2160c0 ffff81012db4e100 00000133b7237c71
Nov 12 15:32:31 bldr-ccm20 kernel:  00000000000020c7 ffff81012c2162a8 0000000000000002 0000000000039b64
Nov 12 15:32:31 bldr-ccm20 kernel: Call Trace:
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8000bf9a>] do_generic_mapping_read+0x3b6/0x3f8
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8003d03b>] lock_timer_base+0x1b/0x3c
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8001c40f>] __mod_timer+0xb0/0xbe
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80061839>] schedule_timeout+0x8a/0xad
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80092ada>] process_timeout+0x0/0x5
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8003d7a1>] do_futex+0x1da/0xbc7
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff800884ac>] default_wake_function+0x0/0xe
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff80058a29>] group_send_sig_info+0x62/0x6f
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff800947af>] kill_proc_info+0x48/0x60
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8009e935>] sys_futex+0x101/0x123
Nov 12 15:32:31 bldr-ccm20 kernel:  [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Nov 12 15:32:31 bldr-ccm20 kernel: 
Nov 12 15:33:44 bldr-ccm20 kernel: process trace for qemu-system-x86(3853)
Nov 12 15:33:44 bldr-ccm20 kernel:  0000000000000000 0000000000000086 ffff81011c30b1e8 00000000ffffd0b0
Nov 12 15:33:44 bldr-ccm20 kernel:  0000000000000007 ffff81012db4e100 ffff81012f9f8080 00000177a9ebb592
Nov 12 15:33:44 bldr-ccm20 kernel:  000000000000719d ffff81012db4e2f0 ffff810100000001 ffff81012f9f8080
Nov 12 15:33:44 bldr-ccm20 kernel: Call Trace:
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8848475b>] :kvm_intel:vmcs_writel+0x20/0x35
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff80089a00>] __cond_resched+0x1c/0x44
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8006104f>] cond_resched+0x3b/0x42
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8846463b>] :kvm:kvm_arch_vcpu_ioctl_run+0x23f/0x393
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8846150e>] :kvm:kvm_vcpu_ioctl+0xc3/0x388
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8005fdf0>] copy_user_generic+0x7c/0x126
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff800dd3ac>] core_sys_select+0x234/0x265
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8006b75e>] do_gettimeofday+0x50/0x92
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff80058baf>] getnstimeofday+0x10/0x28
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff88461432>] :kvm:kvm_vm_ioctl+0x277/0x290
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8009d243>] enqueue_hrtimer+0x55/0x70
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8003bb73>] hrtimer_start+0xbc/0xce
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8003fc22>] do_ioctl+0x21/0x6b
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8002fc67>] vfs_ioctl+0x248/0x261
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8004a242>] sys_ioctl+0x59/0x78
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Nov 12 15:33:44 bldr-ccm20 kernel: 
Nov 12 15:33:44 bldr-ccm20 kernel: process trace for qemu-system-x86(3855)
Nov 12 15:33:44 bldr-ccm20 kernel:  ffff81010b72dc38 0000000000000001 00000000000003d7 00000000ffffd0b0
Nov 12 15:33:44 bldr-ccm20 kernel:  ffffffff88479c60 ffffffff88466d94 0000000100000001 0000000000000000
Nov 12 15:33:44 bldr-ccm20 kernel:  ffff81012dbd5040 ffff81012f81d8c0 ffff81012e9832c0 ffff810001004400
Nov 12 15:33:44 bldr-ccm20 kernel: Call Trace:
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8846dd0a>] :kvm:apic_mmio_write+0x198/0x48b
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff88466d94>] :kvm:paging32_gva_to_gpa+0x21/0x47
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff80060f29>] thread_return+0x0/0xeb
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8848475b>] :kvm_intel:vmcs_writel+0x20/0x35
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8848475b>] :kvm_intel:vmcs_writel+0x20/0x35
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8846463b>] :kvm:kvm_arch_vcpu_ioctl_run+0x23f/0x393
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8846150e>] :kvm:kvm_vcpu_ioctl+0xc3/0x388
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff80021d2f>] __up_read+0x19/0x7f
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8009dcf1>] futex_wake+0xc6/0xd5
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8003d808>] do_futex+0x241/0xbc7
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff80093c20>] __dequeue_signal+0x18b/0x19a
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff88461432>] :kvm:kvm_vm_ioctl+0x277/0x290
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8003fc22>] do_ioctl+0x21/0x6b
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8002fc67>] vfs_ioctl+0x248/0x261
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8004a242>] sys_ioctl+0x59/0x78
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Nov 12 15:33:44 bldr-ccm20 kernel: 
Nov 12 15:33:44 bldr-ccm20 kernel: process trace for qemu-system-x86(3856)
Nov 12 15:33:44 bldr-ccm20 kernel:  ffff81010b6edca8 0000000000000086 ffff81011bcf7d10 ffff81000101e4e0
Nov 12 15:33:44 bldr-ccm20 kernel:  0000000000000001 ffff81012db040c0 ffff81012c799860 00000177a9e2f4cb
Nov 12 15:33:44 bldr-ccm20 kernel:  0000000000001433 ffff81012db042b0 0000000000000003 ffff81012c799860
Nov 12 15:33:44 bldr-ccm20 kernel: Call Trace:
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff80089a00>] __cond_resched+0x1c/0x44
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8006104f>] cond_resched+0x3b/0x42
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff884646e2>] :kvm:kvm_arch_vcpu_ioctl_run+0x2e6/0x393
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8846150e>] :kvm:kvm_vcpu_ioctl+0xc3/0x388
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff80021d2f>] __up_read+0x19/0x7f
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8009dcf1>] futex_wake+0xc6/0xd5
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8003d808>] do_futex+0x241/0xbc7
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff80093c20>] __dequeue_signal+0x18b/0x19a
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff80094cd3>] dequeue_signal+0x3c/0xbd
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8009527c>] sys_rt_sigtimedwait+0xcb/0x2b4
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8003fc22>] do_ioctl+0x21/0x6b
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8002fc67>] vfs_ioctl+0x248/0x261
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8004a242>] sys_ioctl+0x59/0x78
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Nov 12 15:33:44 bldr-ccm20 kernel: 
Nov 12 15:33:44 bldr-ccm20 kernel: process trace for qemu-system-x86(3857)
Nov 12 15:33:44 bldr-ccm20 kernel:  ffff810125e8f480 ffffffff8846dd0a ffff81010b767328 00000000ffffd0b0
Nov 12 15:33:44 bldr-ccm20 kernel:  ffffffff88479c60 ffffffff88466d94 0000000100000001 ffff810001004478
Nov 12 15:33:44 bldr-ccm20 kernel:  ffff81010b571bc0 ffff81012dbd5040 ffffffff80087ccd ffff810001004400
Nov 12 15:33:44 bldr-ccm20 kernel: Call Trace:
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff884676a1>] :kvm:paging32_page_fault+0x215/0x25a
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8848475b>] :kvm_intel:vmcs_writel+0x20/0x35
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8848475b>] :kvm_intel:vmcs_writel+0x20/0x35
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8846463b>] :kvm:kvm_arch_vcpu_ioctl_run+0x23f/0x393
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8846150e>] :kvm:kvm_vcpu_ioctl+0xc3/0x388
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff80021d2f>] __up_read+0x19/0x7f
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8009dcf1>] futex_wake+0xc6/0xd5
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8003d808>] do_futex+0x241/0xbc7
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff80093c20>] __dequeue_signal+0x18b/0x19a
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff88461432>] :kvm:kvm_vm_ioctl+0x277/0x290
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff80094cd3>] dequeue_signal+0x3c/0xbd
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff80095415>] sys_rt_sigtimedwait+0x264/0x2b4
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8009527c>] sys_rt_sigtimedwait+0xcb/0x2b4
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8003fc22>] do_ioctl+0x21/0x6b
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8002fc67>] vfs_ioctl+0x248/0x261
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8004a242>] sys_ioctl+0x59/0x78
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Nov 12 15:33:44 bldr-ccm20 kernel: 
Nov 12 15:33:44 bldr-ccm20 kernel: process trace for qemu-system-x86(3859)
Nov 12 15:33:44 bldr-ccm20 kernel:  ffff81012269fd48 0000000000000086 ffff810103efe6a0 ffffffff8000bf9a
Nov 12 15:33:44 bldr-ccm20 kernel:  000000000000000a ffff81012c2160c0 ffff81012db4e100 00000133b7237c71
Nov 12 15:33:44 bldr-ccm20 kernel:  00000000000020c7 ffff81012c2162a8 0000000000000002 0000000000039b64
Nov 12 15:33:44 bldr-ccm20 kernel: Call Trace:
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8000bf9a>] do_generic_mapping_read+0x3b6/0x3f8
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8003d03b>] lock_timer_base+0x1b/0x3c
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8001c40f>] __mod_timer+0xb0/0xbe
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff80061839>] schedule_timeout+0x8a/0xad
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff80092ada>] process_timeout+0x0/0x5
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8003d7a1>] do_futex+0x1da/0xbc7
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff800884ac>] default_wake_function+0x0/0xe
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff80058a29>] group_send_sig_info+0x62/0x6f
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff800947af>] kill_proc_info+0x48/0x60
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8009e935>] sys_futex+0x101/0x123
Nov 12 15:33:44 bldr-ccm20 kernel:  [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Nov 12 15:33:44 bldr-ccm20 kernel: 

[-- Attachment #3: Type: text/plain, Size: 314 bytes --]

-------------------------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >> http://get.splunk.com/

[-- Attachment #4: Type: text/plain, Size: 186 bytes --]

_______________________________________________
kvm-devel mailing list
kvm-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org
https://lists.sourceforge.net/lists/listinfo/kvm-devel

  parent reply	other threads:[~2007-11-12 22:37 UTC|newest]

Thread overview: 32+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2007-11-07 17:28 [ANNOUNCE] kvm-51 release Avi Kivity
     [not found] ` <4731F5B5.1000108-atKUWr5tajBWk0Htik3J/w@public.gmane.org>
2007-11-07 19:35   ` Haydn Solomon
     [not found]     ` <47321384.8060405-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2007-11-07 19:48       ` Amit Shah
     [not found]         ` <200711080118.46304.amit.shah-atKUWr5tajBWk0Htik3J/w@public.gmane.org>
2007-11-07 19:55           ` Haydn Solomon
2007-11-08  5:51       ` Avi Kivity
     [not found]         ` <4732A3F6.8070903-atKUWr5tajBWk0Htik3J/w@public.gmane.org>
2007-11-08 13:05           ` Haydn Solomon
2007-11-09 10:25   ` Farkas Levente
     [not found]     ` <473435B6.1000503-lWVWdrzSO4GHXe+LvDLADg@public.gmane.org>
2007-11-09 14:59       ` david ahern
     [not found]         ` <473475C2.1070908-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org>
2007-11-10  0:22           ` Farkas Levente
2007-11-11  9:08           ` Avi Kivity
2007-11-11  9:11       ` Avi Kivity
     [not found]         ` <4736C752.7060703-atKUWr5tajBWk0Htik3J/w@public.gmane.org>
2007-11-11 12:58           ` Farkas Levente
     [not found]             ` <4736FC77.2080804-lWVWdrzSO4GHXe+LvDLADg@public.gmane.org>
2007-11-11 14:43               ` Avi Kivity
     [not found]                 ` <47371510.3020804-atKUWr5tajBWk0Htik3J/w@public.gmane.org>
2007-11-11 15:32                   ` david ahern
     [not found]                     ` <47372070.30604-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org>
2007-11-11 15:55                       ` david ahern
     [not found]                         ` <47372600.9080009-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org>
2007-11-11 16:53                           ` Avi Kivity
     [not found]                             ` <47373380.8040809-atKUWr5tajBWk0Htik3J/w@public.gmane.org>
2007-11-11 17:09                               ` Farkas Levente
     [not found]                                 ` <4737373C.3080009-lWVWdrzSO4GHXe+LvDLADg@public.gmane.org>
2007-11-11 17:11                                   ` Avi Kivity
     [not found]                                     ` <473737D9.4020708-atKUWr5tajBWk0Htik3J/w@public.gmane.org>
2007-11-11 17:20                                       ` Farkas Levente
     [not found]                                         ` <473739EA.9070804-lWVWdrzSO4GHXe+LvDLADg@public.gmane.org>
2007-11-12  8:22                                           ` Avi Kivity
2007-11-11 21:10                               ` david ahern
     [not found]                                 ` <47376FB3.30303-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org>
2007-11-12  8:19                                   ` Avi Kivity
     [not found]                                     ` <47380C95.1030502-atKUWr5tajBWk0Htik3J/w@public.gmane.org>
2007-11-12 21:46                                       ` david ahern
     [not found]                                         ` <4738C9B5.6060609-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org>
2007-11-12 22:37                                           ` david ahern [this message]
     [not found]                                             ` <4738D58C.70304-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org>
2007-11-13 10:07                                               ` RHEL5 smp guests on RHE5.1 hosts hang with kvm-52 Farkas Levente
2007-11-13  8:29                                           ` [ANNOUNCE] kvm-51 release Avi Kivity
     [not found]                                             ` <4739605A.4010309-atKUWr5tajBWk0Htik3J/w@public.gmane.org>
2007-11-13 16:12                                               ` david ahern
     [not found]                                                 ` <4739CCED.2060105-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org>
2007-11-13 16:15                                                   ` Avi Kivity
     [not found]                                                     ` <4739CDAD.1030506-atKUWr5tajBWk0Htik3J/w@public.gmane.org>
2007-11-13 16:31                                                       ` david ahern
     [not found]                                                         ` <4739D167.6020508-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org>
2007-11-13 16:32                                                           ` Avi Kivity
     [not found]                                                             ` <4739D188.5020606-atKUWr5tajBWk0Htik3J/w@public.gmane.org>
2007-11-13 16:54                                                               ` david ahern
     [not found]                                                                 ` <4739D6B5.2040802-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org>
2007-11-13 16:58                                                                   ` Avi Kivity

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4738D58C.70304@cisco.com \
    --to=daahern-fyb4gu1cfyuavxtiumwx3w@public.gmane.org \
    --cc=avi-atKUWr5tajBWk0Htik3J/w@public.gmane.org \
    --cc=kvm-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.