From mboxrd@z Thu Jan 1 00:00:00 1970 From: david ahern Subject: RHEL5 smp guests on RHE5.1 hosts hang with kvm-52 Date: Mon, 12 Nov 2007 15:37:00 -0700 Message-ID: <4738D58C.70304@cisco.com> References: <4731F5B5.1000108@qumranet.com> <473435B6.1000503@bppiac.hu> <4736C752.7060703@qumranet.com> <4736FC77.2080804@bppiac.hu> <47371510.3020804@qumranet.com> <47372070.30604@cisco.com> <47372600.9080009@cisco.com> <47373380.8040809@qumranet.com> <47376FB3.30303@cisco.com> <47380C95.1030502@qumranet.com> <4738C9B5.6060609@cisco.com> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="------------010608000709070103040505" Cc: kvm-devel To: Avi Kivity Return-path: In-Reply-To: <4738C9B5.6060609-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org> List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: kvm-devel-bounces-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org Errors-To: kvm-devel-bounces-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org List-Id: kvm.vger.kernel.org This is a multi-part message in MIME format. --------------010608000709070103040505 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit (Changed the subject to correspond with email.) I am having the same problem on the 64-bit host running RHEL5.1 as well, it just takes more reboots. Same symptoms as I mentioned for the 32-bit host. kernel side stack traces for each qemu thread for one of the lockups is attached; the file contains traces for each thread at 3 sample times in case it helps get some insight. david david ahern wrote: > With kvm-52 my 32-bit host running RHEL5.1 can start an RHEL 5 SMP guest only once. Second and subsequent attempts hang. Removing kvm and kvm_intel modules have no affect; I need to reboot the host to get an SMP guest to start. My similarly configured 64-bit host does not seem to have this problem. > > > Second attempts to start the RHEL5 SMP guest hang at: > Starting udev: _ > > > Looking at top on the host shows qemu in a loop: > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND > 3909 root 18 0 1625m 67m 9476 R 400 2.1 2:52.32 qemu-system-x86 > > > In this case the qemu threads are: > > PID LWP TTY TIME CMD > 3909 3909 pts/0 00:01:12 qemu-system-x86 > 3909 3911 pts/0 00:01:05 qemu-system-x86 > 3909 3912 pts/0 00:01:05 qemu-system-x86 > 3909 3913 pts/0 00:01:07 qemu-system-x86 > 3909 3917 pts/0 00:00:00 qemu-system-x86 > > > > and their kernel side backtraces are: > > process trace for qemu-system-x86(3909) > f5967d88 00000082 f8c125e4 bbdec465 000001c6 f5230da4 00000001 f7acf000 > f7d7d000 bbded629 000001c6 000011c4 00000000 f7acf110 c30126e0 00000001 > f4d8a000 f5967d90 f5967d80 f5230da0 f5967000 f8c11120 f5230da0 f4d8a000 > Call Trace: > [] vmx_vcpu_put+0xef/0xf6 [kvm_intel] > [] handle_external_interrupt+0x0/0xc [kvm_intel] > [] __cond_resched+0x16/0x34 > [] cond_resched+0x2a/0x31 > [] kvm_arch_vcpu_ioctl_run+0x28d/0x333 [kvm] > [] kvm_vcpu_ioctl+0x0/0x366 [kvm] > [] kvm_vcpu_ioctl+0xbb/0x366 [kvm] > [] __cond_resched+0x16/0x34 > [] cond_resched+0x2a/0x31 > [] core_sys_select+0x1ef/0x2ca > [] __wake_up_common+0x2f/0x53 > [] schedule+0x90d/0x9ba > [] reschedule_interrupt+0x1f/0x24 > [] __dequeue_signal+0x151/0x15c > [] dequeue_signal+0x2d/0x9c > [] sys_rt_sigtimedwait+0xc5/0x2c2 > [] getnstimeofday+0x30/0xb6 > [] ktime_get_ts+0x16/0x44 > [] ktime_get+0x12/0x34 > [] common_timer_get+0xee/0x129 > [] kvm_vcpu_ioctl+0x0/0x366 [kvm] > [] do_ioctl+0x1c/0x5d > [] vfs_ioctl+0x24a/0x25c > [] sys_ioctl+0x48/0x5f > [] syscall_call+0x7/0xb > ======================= > process trace for qemu-system-x86(3911) > c301a6e0 00000100 000001c7 f749baa0 00000001 c301a6e0 f749baa0 00000001 > f51fed44 f51fed44 f51fed6c 00000001 00000001 00000046 f579ce20 f57ee000 > 00000001 c04059bf f579ce20 8005003b 00006c00 f8c113e5 f579ce20 f579ce20 > Call Trace: > [] apic_timer_interrupt+0x1f/0x24 > [] vmcs_writel+0x1b/0x2c [kvm_intel] > [] kvm_arch_vcpu_ioctl_run+0x202/0x333 [kvm] > [] kvm_vcpu_ioctl+0x0/0x366 [kvm] > [] kvm_vcpu_ioctl+0xbb/0x366 [kvm] > [] enqueue_task+0x29/0x39 > [] __activate_task+0x1c/0x29 > [] try_to_wake_up+0x371/0x37b > [] schedule+0x90d/0x9ba > [] __wake_up_common+0x2f/0x53 > [] __wake_up+0x2a/0x3d > [] wake_futex+0x3a/0x44 > [] futex_wake+0xa9/0xb3 > [] do_futex+0x20d/0xb15 > [] kvm_ack_smp_call+0x17/0x27 [kvm] > [] __dequeue_signal+0x151/0x15c > [] dequeue_signal+0x2d/0x9c > [] kvm_vm_ioctl+0x0/0x277 [kvm] > [] kvm_vm_ioctl+0x264/0x277 [kvm] > [] default_wake_function+0x0/0xc > [] call_function_interrupt+0x1f/0x24 > [] kvm_vcpu_ioctl+0x0/0x366 [kvm] > [] do_ioctl+0x1c/0x5d > [] vfs_ioctl+0x24a/0x25c > [] sys_ioctl+0x48/0x5f > [] syscall_call+0x7/0xb > ======================= > process trace for qemu-system-x86(3912) > f560fd88 00000082 f8c125e4 193272c5 000001c8 f52b6074 00000004 f7f09000 > f7f09000 19328fc9 000001c8 00001d04 00000002 f52b6070 55eefb90 00000000 > f52b6070 f5693000 f52b6070 8005003b 00006c00 f8c113e5 f52b6070 f52b6070 > Call Trace: > [] vmx_vcpu_put+0xef/0xf6 [kvm_intel] > [] vmcs_writel+0x1b/0x2c [kvm_intel] > [] kvm_arch_vcpu_ioctl_run+0x202/0x333 [kvm] > [] kvm_vcpu_ioctl+0x0/0x366 [kvm] > [] kvm_vcpu_ioctl+0xbb/0x366 [kvm] > [] schedule+0x90d/0x9ba > [] __wake_up_common+0x2f/0x53 > [] find_extend_vma+0x12/0x49 > [] get_futex_key+0x40/0xd0 > [] futex_wake+0xa9/0xb3 > [] do_futex+0x20d/0xb15 > [] ext3_ordered_writepage+0x0/0x162 [ext3] > [] __dequeue_signal+0x151/0x15c > [] dequeue_signal+0x2d/0x9c > [] kvm_vm_ioctl+0x0/0x277 [kvm] > [] kvm_vm_ioctl+0x264/0x277 [kvm] > [] default_wake_function+0x0/0xc > [] kvm_vcpu_ioctl+0x0/0x366 [kvm] > [] do_ioctl+0x1c/0x5d > [] vfs_ioctl+0x24a/0x25c > [] sys_ioctl+0x48/0x5f > [] syscall_call+0x7/0xb > ======================= > process trace for qemu-system-x86(3913) > c302a6e0 00000100 000001c8 f7488550 00000003 c302a6e0 f7488550 00000003 > f4d92d44 f4d92d44 f4d92d6c 00000001 00000001 00000046 f52b6de0 f5aaa000 > 00000001 c04059bf f52b6de0 8005003b 00006c00 f8c113e5 f52b6de0 f52b6de0 > Call Trace: > [] apic_timer_interrupt+0x1f/0x24 > [] vmcs_writel+0x1b/0x2c [kvm_intel] > [] kvm_arch_vcpu_ioctl_run+0x202/0x333 [kvm] > [] kvm_vcpu_ioctl+0x0/0x366 [kvm] > [] kvm_vcpu_ioctl+0xbb/0x366 [kvm] > [] schedule+0x90d/0x9ba > [] __wake_up_common+0x2f/0x53 > [] find_extend_vma+0x12/0x49 > [] get_futex_key+0x40/0xd0 > [] futex_wake+0xa9/0xb3 > [] do_futex+0x20d/0xb15 > [] call_function_interrupt+0x1f/0x24 > [] __dequeue_signal+0x151/0x15c > [] kvm_vm_ioctl+0x0/0x277 [kvm] > [] kvm_vm_ioctl+0x264/0x277 [kvm] > [] default_wake_function+0x0/0xc > [] kvm_vcpu_ioctl+0x0/0x366 [kvm] > [] do_ioctl+0x1c/0x5d > [] vfs_ioctl+0x24a/0x25c > [] sys_ioctl+0x48/0x5f > [] syscall_call+0x7/0xb > ======================= > > david > > > Avi Kivity wrote: >> david ahern wrote: >>> The patch worked for me -- rhel4 smp guests boot fine on stock RHEL5 >>> hosts, both 32-bit and 64-bit. >>> >>> >> Excellent. I had a premonition so it is already committed. >> >> Do note that smp_call_function_mask() emulation is pretty bad in terms >> of performance on large multicores. On a dual code it's basically >> equivalent to mainline, I guess it's okay for four-way, but above >> four-way you will need either mainline or a better >> smp_call_function_mask() (which is nontrivial but doable). >> >>> david >>> >>> >>> Avi Kivity wrote: >>> >>>> david ahern wrote: >>>> >>>>> In RHEL 5.1 defines: >>>>> >>>>> #define CPU_TASKS_FROZEN 0x0010 >>>>> >>>>> #define CPU_ONLINE_FROZEN (CPU_ONLINE | CPU_TASKS_FROZEN) >>>>> #define CPU_DEAD_FROZEN (CPU_DEAD | CPU_TASKS_FROZEN) >>>>> >>>>> which means in kvm-51/kernel/external-module-compat.h the '#ifndef >>>>> CPU_TASKS_FROZEN' needs to have a case. For my purposes, I just moved >>>>> up the endif around what was defined. >>>>> >>>> I committed a change which renders this unnecessary. Will be part of >>>> kvm-52. >>>> >>>> >>>>> With that change, kvm-51 compiles. I am still seeing 32-bit SMP guests >>>>> hang on boot for both 32-bit and 64-bit hosts (again running RHEL5.1). >>>>> >>>> I still don't. Can you test the attached patch? >>>> >>>> >>>> >>>> ------------------------------------------------------------------------ >>>> >>>> ------------------------------------------------------------------------- >>>> >>>> This SF.net email is sponsored by: Splunk Inc. >>>> Still grepping through log files to find problems? Stop. >>>> Now Search log events and configuration files using AJAX and a browser. >>>> Download your FREE copy of Splunk now >> http://get.splunk.com/ >>>> >>>> >>>> ------------------------------------------------------------------------ >>>> >>>> _______________________________________________ >>>> kvm-devel mailing list >>>> kvm-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org >>>> https://lists.sourceforge.net/lists/listinfo/kvm-devel >>>> >> > --------------010608000709070103040505 Content-Type: text/plain; name="messages" Content-Transfer-Encoding: 7bit Content-Disposition: inline; filename="messages" Nov 12 15:30:40 bldr-ccm20 syslogd 1.4.1: restart. Nov 12 15:31:06 bldr-ccm20 kernel: process trace for qemu-system-x86(3853) Nov 12 15:31:06 bldr-ccm20 kernel: 0000000000000000 0000000000000086 ffff81011c30b1e8 00000000ffffd0b0 Nov 12 15:31:06 bldr-ccm20 kernel: 0000000000000006 ffff81012db4e100 ffff81012f9f8080 0000015310c2502a Nov 12 15:31:06 bldr-ccm20 kernel: 0000000000001a33 ffff81012db4e2f0 ffff810100000001 ffff81012f9f8080 Nov 12 15:31:06 bldr-ccm20 kernel: Call Trace: Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm_intel:vmcs_writel+0x20/0x35 Nov 12 15:31:06 bldr-ccm20 kernel: [] __cond_resched+0x1c/0x44 Nov 12 15:31:06 bldr-ccm20 kernel: [] cond_resched+0x3b/0x42 Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm:kvm_arch_vcpu_ioctl_run+0x23f/0x393 Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm:kvm_vcpu_ioctl+0xc3/0x388 Nov 12 15:31:06 bldr-ccm20 kernel: [] __up_read+0x19/0x7f Nov 12 15:31:06 bldr-ccm20 kernel: [] core_sys_select+0x234/0x265 Nov 12 15:31:06 bldr-ccm20 kernel: [] do_gettimeofday+0x50/0x92 Nov 12 15:31:06 bldr-ccm20 kernel: [] __dequeue_signal+0x18b/0x19a Nov 12 15:31:06 bldr-ccm20 kernel: [] do_gettimeofday+0x50/0x92 Nov 12 15:31:06 bldr-ccm20 kernel: [] getnstimeofday+0x10/0x28 Nov 12 15:31:06 bldr-ccm20 kernel: [] ktime_get_ts+0x1a/0x4e Nov 12 15:31:06 bldr-ccm20 kernel: [] do_ioctl+0x21/0x6b Nov 12 15:31:06 bldr-ccm20 kernel: [] syscall_trace_leave+0x2c/0x87 Nov 12 15:31:06 bldr-ccm20 kernel: [] sys_ioctl+0x59/0x78 Nov 12 15:31:06 bldr-ccm20 kernel: [] tracesys+0xd5/0xe0 Nov 12 15:31:06 bldr-ccm20 kernel: Nov 12 15:31:06 bldr-ccm20 kernel: process trace for qemu-system-x86(3855) Nov 12 15:31:06 bldr-ccm20 kernel: ffff81010b72dca8 0000000000000086 ffff81011c30d228 00000000ffffd0b0 Nov 12 15:31:06 bldr-ccm20 kernel: 0000000000000001 ffff81012dbd5040 ffff81012c799860 0000015310ba11ff Nov 12 15:31:06 bldr-ccm20 kernel: 0000000000001502 ffff81012dbd5230 ffff810100000003 ffff81012c799860 Nov 12 15:31:06 bldr-ccm20 kernel: Call Trace: Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm_intel:vmcs_writel+0x20/0x35 Nov 12 15:31:06 bldr-ccm20 kernel: [] __cond_resched+0x1c/0x44 Nov 12 15:31:06 bldr-ccm20 kernel: [] cond_resched+0x3b/0x42 Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm:kvm_arch_vcpu_ioctl_run+0x2e6/0x393 Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm:kvm_vcpu_ioctl+0xc3/0x388 Nov 12 15:31:06 bldr-ccm20 kernel: [] __up_read+0x19/0x7f Nov 12 15:31:06 bldr-ccm20 kernel: [] futex_wake+0xc6/0xd5 Nov 12 15:31:06 bldr-ccm20 kernel: [] do_futex+0x241/0xbc7 Nov 12 15:31:06 bldr-ccm20 kernel: [] __dequeue_signal+0x18b/0x19a Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm:kvm_vm_ioctl+0x277/0x290 Nov 12 15:31:06 bldr-ccm20 kernel: [] dequeue_signal+0x3c/0xbd Nov 12 15:31:06 bldr-ccm20 kernel: [] thread_return+0x0/0xeb Nov 12 15:31:06 bldr-ccm20 kernel: [] sys_rt_sigtimedwait+0xcb/0x2b4 Nov 12 15:31:06 bldr-ccm20 kernel: [] do_ioctl+0x21/0x6b Nov 12 15:31:06 bldr-ccm20 kernel: [] vfs_ioctl+0x248/0x261 Nov 12 15:31:06 bldr-ccm20 kernel: [] sys_ioctl+0x59/0x78 Nov 12 15:31:06 bldr-ccm20 kernel: [] tracesys+0xd5/0xe0 Nov 12 15:31:06 bldr-ccm20 kernel: Nov 12 15:31:06 bldr-ccm20 kernel: process trace for qemu-system-x86(3856) Nov 12 15:31:06 bldr-ccm20 kernel: ffff81010b6edca8 0000000000000086 0000000000000000 0000000000000001 Nov 12 15:31:06 bldr-ccm20 kernel: 0000000000000001 ffff81012db040c0 ffff81012fa0a0c0 000001531107de18 Nov 12 15:31:06 bldr-ccm20 kernel: 000000000000ae62 ffff81012db042b0 0000000000000000 ffff81012fa0a0c0 Nov 12 15:31:06 bldr-ccm20 kernel: Call Trace: Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm_intel:handle_external_interrupt+0x0/0xc Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm_intel:handle_external_interrupt+0x0/0xc Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm_intel:vmcs_writel+0x20/0x35 Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm:kvm_arch_vcpu_ioctl_run+0x23f/0x393 Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm:kvm_vcpu_ioctl+0xc3/0x388 Nov 12 15:31:06 bldr-ccm20 kernel: [] __up_read+0x19/0x7f Nov 12 15:31:06 bldr-ccm20 kernel: [] futex_wake+0xc6/0xd5 Nov 12 15:31:06 bldr-ccm20 kernel: [] do_futex+0x241/0xbc7 Nov 12 15:31:06 bldr-ccm20 kernel: [] __dequeue_signal+0x18b/0x19a Nov 12 15:31:06 bldr-ccm20 kernel: [] dequeue_signal+0x3c/0xbd Nov 12 15:31:06 bldr-ccm20 kernel: [] sys_rt_sigtimedwait+0xcb/0x2b4 Nov 12 15:31:06 bldr-ccm20 kernel: [] do_ioctl+0x21/0x6b Nov 12 15:31:06 bldr-ccm20 kernel: [] vfs_ioctl+0x248/0x261 Nov 12 15:31:06 bldr-ccm20 kernel: [] sys_ioctl+0x59/0x78 Nov 12 15:31:06 bldr-ccm20 kernel: [] tracesys+0xd5/0xe0 Nov 12 15:31:06 bldr-ccm20 kernel: Nov 12 15:31:06 bldr-ccm20 kernel: process trace for qemu-system-x86(3857) Nov 12 15:31:06 bldr-ccm20 kernel: ffff810125e8f480 ffffffff8846dd0a ffff81010b767328 00000000ffffd0b0 Nov 12 15:31:06 bldr-ccm20 kernel: ffffffff88479c60 ffffffff88466d94 0000000100000001 ffff81010b766240 Nov 12 15:31:06 bldr-ccm20 kernel: 00000000fee000b0 0000000000000004 ffff81010b767328 00000000ffffd0b0 Nov 12 15:31:06 bldr-ccm20 kernel: Call Trace: Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm:apic_mmio_write+0x198/0x48b Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm:paging32_gva_to_gpa+0x21/0x47 Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm:emulator_write_emulated_onepage+0xa6/0xe5 Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm:x86_emulate_insn+0x2e21/0x40db Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm_intel:vmcs_writel+0x20/0x35 Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm_intel:vmcs_writel+0x20/0x35 Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm:kvm_arch_vcpu_ioctl_run+0x23f/0x393 Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm:kvm_vcpu_ioctl+0xc3/0x388 Nov 12 15:31:06 bldr-ccm20 kernel: [] __up_read+0x19/0x7f Nov 12 15:31:06 bldr-ccm20 kernel: [] futex_wake+0xc6/0xd5 Nov 12 15:31:06 bldr-ccm20 kernel: [] do_futex+0x241/0xbc7 Nov 12 15:31:06 bldr-ccm20 kernel: [] __dequeue_signal+0x18b/0x19a Nov 12 15:31:06 bldr-ccm20 kernel: [] :kvm:kvm_vm_ioctl+0x277/0x290 Nov 12 15:31:06 bldr-ccm20 kernel: [] dequeue_signal+0x3c/0xbd Nov 12 15:31:06 bldr-ccm20 kernel: [] sys_rt_sigtimedwait+0x264/0x2b4 Nov 12 15:31:06 bldr-ccm20 kernel: [] sys_rt_sigtimedwait+0xcb/0x2b4 Nov 12 15:31:06 bldr-ccm20 kernel: [] do_ioctl+0x21/0x6b Nov 12 15:31:06 bldr-ccm20 kernel: [] vfs_ioctl+0x248/0x261 Nov 12 15:31:06 bldr-ccm20 kernel: [] sys_ioctl+0x59/0x78 Nov 12 15:31:06 bldr-ccm20 kernel: [] tracesys+0xd5/0xe0 Nov 12 15:31:06 bldr-ccm20 kernel: Nov 12 15:31:06 bldr-ccm20 kernel: process trace for qemu-system-x86(3859) Nov 12 15:31:06 bldr-ccm20 kernel: ffff81012269fd48 0000000000000086 ffff810103efe6a0 ffffffff8000bf9a Nov 12 15:31:06 bldr-ccm20 kernel: 000000000000000a ffff81012c2160c0 ffff81012db4e100 00000133b7237c71 Nov 12 15:31:06 bldr-ccm20 kernel: 00000000000020c7 ffff81012c2162a8 0000000000000002 0000000000039b64 Nov 12 15:31:06 bldr-ccm20 kernel: Call Trace: Nov 12 15:31:06 bldr-ccm20 kernel: [] do_generic_mapping_read+0x3b6/0x3f8 Nov 12 15:31:06 bldr-ccm20 kernel: [] lock_timer_base+0x1b/0x3c Nov 12 15:31:06 bldr-ccm20 kernel: [] __mod_timer+0xb0/0xbe Nov 12 15:31:06 bldr-ccm20 kernel: [] schedule_timeout+0x8a/0xad Nov 12 15:31:06 bldr-ccm20 kernel: [] process_timeout+0x0/0x5 Nov 12 15:31:06 bldr-ccm20 kernel: [] do_futex+0x1da/0xbc7 Nov 12 15:31:06 bldr-ccm20 kernel: [] default_wake_function+0x0/0xe Nov 12 15:31:06 bldr-ccm20 kernel: [] group_send_sig_info+0x62/0x6f Nov 12 15:31:06 bldr-ccm20 kernel: [] kill_proc_info+0x48/0x60 Nov 12 15:31:06 bldr-ccm20 kernel: [] sys_futex+0x101/0x123 Nov 12 15:31:06 bldr-ccm20 kernel: [] tracesys+0xd5/0xe0 Nov 12 15:31:06 bldr-ccm20 kernel: Nov 12 15:32:31 bldr-ccm20 kernel: process trace for qemu-system-x86(3853) Nov 12 15:32:31 bldr-ccm20 kernel: ffff81011e469978 0000000000000086 0000000000000000 0000000000000000 Nov 12 15:32:31 bldr-ccm20 kernel: 0000000000000007 ffff81012db4e100 ffff810104375100 00000166b812b5f2 Nov 12 15:32:31 bldr-ccm20 kernel: 00000000001e5bf4 ffff81012db4e2e8 0000000000000001 ffff810104375100 Nov 12 15:32:31 bldr-ccm20 kernel: Call Trace: Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm:ioapic_deliver+0x151/0x1f1 Nov 12 15:32:31 bldr-ccm20 kernel: [] __wake_up+0x38/0x4f Nov 12 15:32:31 bldr-ccm20 kernel: [] follow_page+0x217/0x2b8 Nov 12 15:32:31 bldr-ccm20 kernel: [] get_user_pages+0x32f/0x3a9 Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm:__gfn_to_page+0x76/0xa9 Nov 12 15:32:31 bldr-ccm20 kernel: [] __up_read+0x19/0x7f Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm:gfn_to_page+0x4d/0x56 Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm:paging32_walk_addr+0x2a3/0x2fb Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm:apic_update_ppr+0x1e/0x49 Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm:apic_mmio_write+0x198/0x48b Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm:paging32_gva_to_gpa+0x21/0x47 Nov 12 15:32:31 bldr-ccm20 kernel: [] thread_return+0x0/0xeb Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm_intel:vmcs_writel+0x20/0x35 Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm_intel:vmcs_writel+0x20/0x35 Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm:kvm_arch_vcpu_ioctl_run+0x23f/0x393 Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm:kvm_vcpu_ioctl+0xc3/0x388 Nov 12 15:32:31 bldr-ccm20 kernel: [] __up_read+0x19/0x7f Nov 12 15:32:31 bldr-ccm20 kernel: [] core_sys_select+0x234/0x265 Nov 12 15:32:31 bldr-ccm20 kernel: [] do_gettimeofday+0x50/0x92 Nov 12 15:32:31 bldr-ccm20 kernel: [] getnstimeofday+0x10/0x28 Nov 12 15:32:31 bldr-ccm20 kernel: [] enqueue_hrtimer+0x55/0x70 Nov 12 15:32:31 bldr-ccm20 kernel: [] hrtimer_start+0xbc/0xce Nov 12 15:32:31 bldr-ccm20 kernel: [] do_ioctl+0x21/0x6b Nov 12 15:32:31 bldr-ccm20 kernel: [] vfs_ioctl+0x248/0x261 Nov 12 15:32:31 bldr-ccm20 kernel: [] sys_ioctl+0x59/0x78 Nov 12 15:32:31 bldr-ccm20 kernel: [] tracesys+0xd5/0xe0 Nov 12 15:32:31 bldr-ccm20 kernel: Nov 12 15:32:31 bldr-ccm20 kernel: process trace for qemu-system-x86(3855) Nov 12 15:32:31 bldr-ccm20 kernel: ffff81010b72dc38 0000000000000086 0000000000001000 ffffffff80060f29 Nov 12 15:32:31 bldr-ccm20 kernel: 0000000000000001 ffff81012dbd5040 ffff81010439a080 00000166b8e1911c Nov 12 15:32:31 bldr-ccm20 kernel: 00000000000004ef ffff81012dbd5228 ffff810100000002 00000166b8dfdbd6 Nov 12 15:32:31 bldr-ccm20 kernel: Call Trace: Nov 12 15:32:31 bldr-ccm20 kernel: [] thread_return+0x0/0xeb Nov 12 15:32:31 bldr-ccm20 kernel: [] __mutex_lock_slowpath+0x55/0x90 Nov 12 15:32:31 bldr-ccm20 kernel: [] __cond_resched+0x1c/0x44 Nov 12 15:32:31 bldr-ccm20 kernel: [] .text.lock.mutex+0xf/0x14 Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm_intel:vmcs_readl+0x17/0x1c Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm:kvm_mmu_page_fault+0x1b/0xb4 Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm:kvm_arch_vcpu_ioctl_run+0x277/0x393 Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm:kvm_vcpu_ioctl+0xc3/0x388 Nov 12 15:32:31 bldr-ccm20 kernel: [] __up_read+0x19/0x7f Nov 12 15:32:31 bldr-ccm20 kernel: [] futex_wake+0xc6/0xd5 Nov 12 15:32:31 bldr-ccm20 kernel: [] do_futex+0x241/0xbc7 Nov 12 15:32:31 bldr-ccm20 kernel: [] __dequeue_signal+0x18b/0x19a Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm:kvm_vm_ioctl+0x277/0x290 Nov 12 15:32:31 bldr-ccm20 kernel: [] dequeue_signal+0x3c/0xbd Nov 12 15:32:31 bldr-ccm20 kernel: [] thread_return+0x0/0xeb Nov 12 15:32:31 bldr-ccm20 kernel: [] sys_rt_sigtimedwait+0xcb/0x2b4 Nov 12 15:32:31 bldr-ccm20 kernel: [] do_ioctl+0x21/0x6b Nov 12 15:32:31 bldr-ccm20 kernel: [] vfs_ioctl+0x248/0x261 Nov 12 15:32:31 bldr-ccm20 kernel: [] sys_ioctl+0x59/0x78 Nov 12 15:32:31 bldr-ccm20 kernel: [] tracesys+0xd5/0xe0 Nov 12 15:32:31 bldr-ccm20 kernel: Nov 12 15:32:31 bldr-ccm20 kernel: process trace for qemu-system-x86(3856) Nov 12 15:32:31 bldr-ccm20 kernel: ffff81010b6edca8 0000000000000086 0000000000000000 0000000000000001 Nov 12 15:32:31 bldr-ccm20 kernel: 0000000000000001 ffff81012db040c0 ffff81012fa0a0c0 00000166b94a772c Nov 12 15:32:31 bldr-ccm20 kernel: 0000000000008f94 ffff81012db042b0 0000000000000000 ffff81012fa0a0c0 Nov 12 15:32:31 bldr-ccm20 kernel: Call Trace: Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm_intel:vmcs_writel+0x20/0x35 Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm:kvm_arch_vcpu_ioctl_run+0x23f/0x393 Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm:kvm_vcpu_ioctl+0xc3/0x388 Nov 12 15:32:31 bldr-ccm20 kernel: [] __up_read+0x19/0x7f Nov 12 15:32:31 bldr-ccm20 kernel: [] futex_wake+0xc6/0xd5 Nov 12 15:32:31 bldr-ccm20 kernel: [] do_futex+0x241/0xbc7 Nov 12 15:32:31 bldr-ccm20 kernel: [] __dequeue_signal+0x18b/0x19a Nov 12 15:32:31 bldr-ccm20 kernel: [] dequeue_signal+0x3c/0xbd Nov 12 15:32:31 bldr-ccm20 kernel: [] sys_rt_sigtimedwait+0xcb/0x2b4 Nov 12 15:32:31 bldr-ccm20 kernel: [] do_ioctl+0x21/0x6b Nov 12 15:32:31 bldr-ccm20 kernel: [] vfs_ioctl+0x248/0x261 Nov 12 15:32:31 bldr-ccm20 kernel: [] sys_ioctl+0x59/0x78 Nov 12 15:32:31 bldr-ccm20 kernel: [] tracesys+0xd5/0xe0 Nov 12 15:32:31 bldr-ccm20 kernel: Nov 12 15:32:31 bldr-ccm20 kernel: process trace for qemu-system-x86(3857) Nov 12 15:32:31 bldr-ccm20 kernel: ffff81010b571c38 0000000000000086 ffff81010b767328 00000000ffffd0b0 Nov 12 15:32:31 bldr-ccm20 kernel: 0000000000000007 ffff81010ad3c820 ffff81010439a080 00000166b9793501 Nov 12 15:32:31 bldr-ccm20 kernel: 0000000000009420 ffff81010ad3ca08 ffffffff00000002 ffff81000100c400 Nov 12 15:32:31 bldr-ccm20 kernel: Call Trace: Nov 12 15:32:31 bldr-ccm20 kernel: [] __mutex_lock_slowpath+0x55/0x90 Nov 12 15:32:31 bldr-ccm20 kernel: [] .text.lock.mutex+0xf/0x14 Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm_intel:vmcs_readl+0x17/0x1c Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm:kvm_mmu_page_fault+0x1b/0xb4 Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm:kvm_arch_vcpu_ioctl_run+0x277/0x393 Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm:kvm_vcpu_ioctl+0xc3/0x388 Nov 12 15:32:31 bldr-ccm20 kernel: [] __up_read+0x19/0x7f Nov 12 15:32:31 bldr-ccm20 kernel: [] futex_wake+0xc6/0xd5 Nov 12 15:32:31 bldr-ccm20 kernel: [] do_futex+0x241/0xbc7 Nov 12 15:32:31 bldr-ccm20 kernel: [] __dequeue_signal+0x18b/0x19a Nov 12 15:32:31 bldr-ccm20 kernel: [] :kvm:kvm_vm_ioctl+0x277/0x290 Nov 12 15:32:31 bldr-ccm20 kernel: [] dequeue_signal+0x3c/0xbd Nov 12 15:32:31 bldr-ccm20 kernel: [] sys_rt_sigtimedwait+0x264/0x2b4 Nov 12 15:32:31 bldr-ccm20 kernel: [] sys_rt_sigtimedwait+0xcb/0x2b4 Nov 12 15:32:31 bldr-ccm20 kernel: [] do_ioctl+0x21/0x6b Nov 12 15:32:31 bldr-ccm20 kernel: [] vfs_ioctl+0x248/0x261 Nov 12 15:32:31 bldr-ccm20 kernel: [] sys_ioctl+0x59/0x78 Nov 12 15:32:31 bldr-ccm20 kernel: [] tracesys+0xd5/0xe0 Nov 12 15:32:31 bldr-ccm20 kernel: Nov 12 15:32:31 bldr-ccm20 kernel: process trace for qemu-system-x86(3859) Nov 12 15:32:31 bldr-ccm20 kernel: ffff81012269fd48 0000000000000086 ffff810103efe6a0 ffffffff8000bf9a Nov 12 15:32:31 bldr-ccm20 kernel: 000000000000000a ffff81012c2160c0 ffff81012db4e100 00000133b7237c71 Nov 12 15:32:31 bldr-ccm20 kernel: 00000000000020c7 ffff81012c2162a8 0000000000000002 0000000000039b64 Nov 12 15:32:31 bldr-ccm20 kernel: Call Trace: Nov 12 15:32:31 bldr-ccm20 kernel: [] do_generic_mapping_read+0x3b6/0x3f8 Nov 12 15:32:31 bldr-ccm20 kernel: [] lock_timer_base+0x1b/0x3c Nov 12 15:32:31 bldr-ccm20 kernel: [] __mod_timer+0xb0/0xbe Nov 12 15:32:31 bldr-ccm20 kernel: [] schedule_timeout+0x8a/0xad Nov 12 15:32:31 bldr-ccm20 kernel: [] process_timeout+0x0/0x5 Nov 12 15:32:31 bldr-ccm20 kernel: [] do_futex+0x1da/0xbc7 Nov 12 15:32:31 bldr-ccm20 kernel: [] default_wake_function+0x0/0xe Nov 12 15:32:31 bldr-ccm20 kernel: [] group_send_sig_info+0x62/0x6f Nov 12 15:32:31 bldr-ccm20 kernel: [] kill_proc_info+0x48/0x60 Nov 12 15:32:31 bldr-ccm20 kernel: [] sys_futex+0x101/0x123 Nov 12 15:32:31 bldr-ccm20 kernel: [] tracesys+0xd5/0xe0 Nov 12 15:32:31 bldr-ccm20 kernel: Nov 12 15:33:44 bldr-ccm20 kernel: process trace for qemu-system-x86(3853) Nov 12 15:33:44 bldr-ccm20 kernel: 0000000000000000 0000000000000086 ffff81011c30b1e8 00000000ffffd0b0 Nov 12 15:33:44 bldr-ccm20 kernel: 0000000000000007 ffff81012db4e100 ffff81012f9f8080 00000177a9ebb592 Nov 12 15:33:44 bldr-ccm20 kernel: 000000000000719d ffff81012db4e2f0 ffff810100000001 ffff81012f9f8080 Nov 12 15:33:44 bldr-ccm20 kernel: Call Trace: Nov 12 15:33:44 bldr-ccm20 kernel: [] :kvm_intel:vmcs_writel+0x20/0x35 Nov 12 15:33:44 bldr-ccm20 kernel: [] __cond_resched+0x1c/0x44 Nov 12 15:33:44 bldr-ccm20 kernel: [] cond_resched+0x3b/0x42 Nov 12 15:33:44 bldr-ccm20 kernel: [] :kvm:kvm_arch_vcpu_ioctl_run+0x23f/0x393 Nov 12 15:33:44 bldr-ccm20 kernel: [] :kvm:kvm_vcpu_ioctl+0xc3/0x388 Nov 12 15:33:44 bldr-ccm20 kernel: [] copy_user_generic+0x7c/0x126 Nov 12 15:33:44 bldr-ccm20 kernel: [] core_sys_select+0x234/0x265 Nov 12 15:33:44 bldr-ccm20 kernel: [] do_gettimeofday+0x50/0x92 Nov 12 15:33:44 bldr-ccm20 kernel: [] getnstimeofday+0x10/0x28 Nov 12 15:33:44 bldr-ccm20 kernel: [] :kvm:kvm_vm_ioctl+0x277/0x290 Nov 12 15:33:44 bldr-ccm20 kernel: [] enqueue_hrtimer+0x55/0x70 Nov 12 15:33:44 bldr-ccm20 kernel: [] hrtimer_start+0xbc/0xce Nov 12 15:33:44 bldr-ccm20 kernel: [] do_ioctl+0x21/0x6b Nov 12 15:33:44 bldr-ccm20 kernel: [] vfs_ioctl+0x248/0x261 Nov 12 15:33:44 bldr-ccm20 kernel: [] sys_ioctl+0x59/0x78 Nov 12 15:33:44 bldr-ccm20 kernel: [] tracesys+0xd5/0xe0 Nov 12 15:33:44 bldr-ccm20 kernel: Nov 12 15:33:44 bldr-ccm20 kernel: process trace for qemu-system-x86(3855) Nov 12 15:33:44 bldr-ccm20 kernel: ffff81010b72dc38 0000000000000001 00000000000003d7 00000000ffffd0b0 Nov 12 15:33:44 bldr-ccm20 kernel: ffffffff88479c60 ffffffff88466d94 0000000100000001 0000000000000000 Nov 12 15:33:44 bldr-ccm20 kernel: ffff81012dbd5040 ffff81012f81d8c0 ffff81012e9832c0 ffff810001004400 Nov 12 15:33:44 bldr-ccm20 kernel: Call Trace: Nov 12 15:33:44 bldr-ccm20 kernel: [] :kvm:apic_mmio_write+0x198/0x48b Nov 12 15:33:44 bldr-ccm20 kernel: [] :kvm:paging32_gva_to_gpa+0x21/0x47 Nov 12 15:33:44 bldr-ccm20 kernel: [] thread_return+0x0/0xeb Nov 12 15:33:44 bldr-ccm20 kernel: [] :kvm_intel:vmcs_writel+0x20/0x35 Nov 12 15:33:44 bldr-ccm20 kernel: [] :kvm_intel:vmcs_writel+0x20/0x35 Nov 12 15:33:44 bldr-ccm20 kernel: [] :kvm:kvm_arch_vcpu_ioctl_run+0x23f/0x393 Nov 12 15:33:44 bldr-ccm20 kernel: [] :kvm:kvm_vcpu_ioctl+0xc3/0x388 Nov 12 15:33:44 bldr-ccm20 kernel: [] __up_read+0x19/0x7f Nov 12 15:33:44 bldr-ccm20 kernel: [] futex_wake+0xc6/0xd5 Nov 12 15:33:44 bldr-ccm20 kernel: [] do_futex+0x241/0xbc7 Nov 12 15:33:44 bldr-ccm20 kernel: [] __dequeue_signal+0x18b/0x19a Nov 12 15:33:44 bldr-ccm20 kernel: [] :kvm:kvm_vm_ioctl+0x277/0x290 Nov 12 15:33:44 bldr-ccm20 kernel: [] do_ioctl+0x21/0x6b Nov 12 15:33:44 bldr-ccm20 kernel: [] vfs_ioctl+0x248/0x261 Nov 12 15:33:44 bldr-ccm20 kernel: [] sys_ioctl+0x59/0x78 Nov 12 15:33:44 bldr-ccm20 kernel: [] tracesys+0xd5/0xe0 Nov 12 15:33:44 bldr-ccm20 kernel: Nov 12 15:33:44 bldr-ccm20 kernel: process trace for qemu-system-x86(3856) Nov 12 15:33:44 bldr-ccm20 kernel: ffff81010b6edca8 0000000000000086 ffff81011bcf7d10 ffff81000101e4e0 Nov 12 15:33:44 bldr-ccm20 kernel: 0000000000000001 ffff81012db040c0 ffff81012c799860 00000177a9e2f4cb Nov 12 15:33:44 bldr-ccm20 kernel: 0000000000001433 ffff81012db042b0 0000000000000003 ffff81012c799860 Nov 12 15:33:44 bldr-ccm20 kernel: Call Trace: Nov 12 15:33:44 bldr-ccm20 kernel: [] __cond_resched+0x1c/0x44 Nov 12 15:33:44 bldr-ccm20 kernel: [] cond_resched+0x3b/0x42 Nov 12 15:33:44 bldr-ccm20 kernel: [] :kvm:kvm_arch_vcpu_ioctl_run+0x2e6/0x393 Nov 12 15:33:44 bldr-ccm20 kernel: [] :kvm:kvm_vcpu_ioctl+0xc3/0x388 Nov 12 15:33:44 bldr-ccm20 kernel: [] __up_read+0x19/0x7f Nov 12 15:33:44 bldr-ccm20 kernel: [] futex_wake+0xc6/0xd5 Nov 12 15:33:44 bldr-ccm20 kernel: [] do_futex+0x241/0xbc7 Nov 12 15:33:44 bldr-ccm20 kernel: [] __dequeue_signal+0x18b/0x19a Nov 12 15:33:44 bldr-ccm20 kernel: [] dequeue_signal+0x3c/0xbd Nov 12 15:33:44 bldr-ccm20 kernel: [] sys_rt_sigtimedwait+0xcb/0x2b4 Nov 12 15:33:44 bldr-ccm20 kernel: [] do_ioctl+0x21/0x6b Nov 12 15:33:44 bldr-ccm20 kernel: [] vfs_ioctl+0x248/0x261 Nov 12 15:33:44 bldr-ccm20 kernel: [] sys_ioctl+0x59/0x78 Nov 12 15:33:44 bldr-ccm20 kernel: [] tracesys+0xd5/0xe0 Nov 12 15:33:44 bldr-ccm20 kernel: Nov 12 15:33:44 bldr-ccm20 kernel: process trace for qemu-system-x86(3857) Nov 12 15:33:44 bldr-ccm20 kernel: ffff810125e8f480 ffffffff8846dd0a ffff81010b767328 00000000ffffd0b0 Nov 12 15:33:44 bldr-ccm20 kernel: ffffffff88479c60 ffffffff88466d94 0000000100000001 ffff810001004478 Nov 12 15:33:44 bldr-ccm20 kernel: ffff81010b571bc0 ffff81012dbd5040 ffffffff80087ccd ffff810001004400 Nov 12 15:33:44 bldr-ccm20 kernel: Call Trace: Nov 12 15:33:44 bldr-ccm20 kernel: [] :kvm:paging32_page_fault+0x215/0x25a Nov 12 15:33:44 bldr-ccm20 kernel: [] :kvm_intel:vmcs_writel+0x20/0x35 Nov 12 15:33:44 bldr-ccm20 kernel: [] :kvm_intel:vmcs_writel+0x20/0x35 Nov 12 15:33:44 bldr-ccm20 kernel: [] :kvm:kvm_arch_vcpu_ioctl_run+0x23f/0x393 Nov 12 15:33:44 bldr-ccm20 kernel: [] :kvm:kvm_vcpu_ioctl+0xc3/0x388 Nov 12 15:33:44 bldr-ccm20 kernel: [] __up_read+0x19/0x7f Nov 12 15:33:44 bldr-ccm20 kernel: [] futex_wake+0xc6/0xd5 Nov 12 15:33:44 bldr-ccm20 kernel: [] do_futex+0x241/0xbc7 Nov 12 15:33:44 bldr-ccm20 kernel: [] __dequeue_signal+0x18b/0x19a Nov 12 15:33:44 bldr-ccm20 kernel: [] :kvm:kvm_vm_ioctl+0x277/0x290 Nov 12 15:33:44 bldr-ccm20 kernel: [] dequeue_signal+0x3c/0xbd Nov 12 15:33:44 bldr-ccm20 kernel: [] sys_rt_sigtimedwait+0x264/0x2b4 Nov 12 15:33:44 bldr-ccm20 kernel: [] sys_rt_sigtimedwait+0xcb/0x2b4 Nov 12 15:33:44 bldr-ccm20 kernel: [] do_ioctl+0x21/0x6b Nov 12 15:33:44 bldr-ccm20 kernel: [] vfs_ioctl+0x248/0x261 Nov 12 15:33:44 bldr-ccm20 kernel: [] sys_ioctl+0x59/0x78 Nov 12 15:33:44 bldr-ccm20 kernel: [] tracesys+0xd5/0xe0 Nov 12 15:33:44 bldr-ccm20 kernel: Nov 12 15:33:44 bldr-ccm20 kernel: process trace for qemu-system-x86(3859) Nov 12 15:33:44 bldr-ccm20 kernel: ffff81012269fd48 0000000000000086 ffff810103efe6a0 ffffffff8000bf9a Nov 12 15:33:44 bldr-ccm20 kernel: 000000000000000a ffff81012c2160c0 ffff81012db4e100 00000133b7237c71 Nov 12 15:33:44 bldr-ccm20 kernel: 00000000000020c7 ffff81012c2162a8 0000000000000002 0000000000039b64 Nov 12 15:33:44 bldr-ccm20 kernel: Call Trace: Nov 12 15:33:44 bldr-ccm20 kernel: [] do_generic_mapping_read+0x3b6/0x3f8 Nov 12 15:33:44 bldr-ccm20 kernel: [] lock_timer_base+0x1b/0x3c Nov 12 15:33:44 bldr-ccm20 kernel: [] __mod_timer+0xb0/0xbe Nov 12 15:33:44 bldr-ccm20 kernel: [] schedule_timeout+0x8a/0xad Nov 12 15:33:44 bldr-ccm20 kernel: [] process_timeout+0x0/0x5 Nov 12 15:33:44 bldr-ccm20 kernel: [] do_futex+0x1da/0xbc7 Nov 12 15:33:44 bldr-ccm20 kernel: [] default_wake_function+0x0/0xe Nov 12 15:33:44 bldr-ccm20 kernel: [] group_send_sig_info+0x62/0x6f Nov 12 15:33:44 bldr-ccm20 kernel: [] kill_proc_info+0x48/0x60 Nov 12 15:33:44 bldr-ccm20 kernel: [] sys_futex+0x101/0x123 Nov 12 15:33:44 bldr-ccm20 kernel: [] tracesys+0xd5/0xe0 Nov 12 15:33:44 bldr-ccm20 kernel: --------------010608000709070103040505 Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline ------------------------------------------------------------------------- This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ --------------010608000709070103040505 Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ kvm-devel mailing list kvm-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org https://lists.sourceforge.net/lists/listinfo/kvm-devel --------------010608000709070103040505--