All of lore.kernel.org
 help / color / mirror / Atom feed
From: Darren Blaber <dmbtech-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
To: kvm-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org
Subject: Bad Performance
Date: Wed, 28 Nov 2007 10:55:47 -0500	[thread overview]
Message-ID: <474D8F83.3010303@gmail.com> (raw)

 Hello, I was wondering if any of you were able to to help me figure out
why I am getting poor performance with kvm.  When running windows as a
guest os, when windows is idle, using 1-2% cpu, the kvm process  uses
about 20-30% cpu. Whenever I am doing any kind of activity (especially
disk activity) its shoots right up to 99%.  Anyway, have a readprofile
snap shot as well as kvm stat output.

    17 cpu_idle                                   0.0759
     4 get_wchan                                  0.0250
     2 do_notify_resume                           0.0011
   381 sysenter_past_esp                          2.2544
   929 system_call                               15.7458
     2 syscall_exit                               0.0741
     2 device_not_available                       0.0351
     1 convert_fxsr_from_user                     0.0042
     1 init_fpu                                   0.0069
     1 save_i387                                  0.0027
    10 sched_clock                                0.0893
     1 flush_tlb_all                              0.0312
    15 send_IPI_mask_bitmask                      0.0781
  1214 native_smp_call_function_mask              3.1615
     1 flush_tlb_page                             0.0069
     3 smp_call_function                          0.0625
    44 read_hpet                                  2.7500
  7383 hpet_rtc_timer_init                       35.4952
     1 native_write_cr0                           0.0625
    57 native_load_tr_desc                        3.5625
     2 native_set_pte                             0.1250
    88 native_flush_tlb_single                    5.5000
     2 native_set_pte_at                          0.1250
     1 check_pgt_cache                            0.0312
    41 kmap_atomic_prot                           0.2135
     5 kmap_atomic                                0.3125
    36 kunmap_atomic                              0.2250
     3 __wake_up                                  0.0375
     5 try_to_wake_up                             0.0043
     2 __cond_resched                             0.0312
     3 jiffies_to_usecs                           0.1875
     3 timespec_trunc                             0.0375
    13 set_normalized_timespec                    0.2708
    10 sys_gettimeofday                           0.0781
     7 current_fs_time                            0.0875
    67 on_each_cpu                                0.8375
    60 __do_softirq                               0.2206
     1 ksoftirqd                                  0.0042
     1 __timer_stats_timer_set_start_info         0.0104
     1 init_timer                                 0.0156
     1 lock_timer_base                            0.0104
     1 try_to_del_timer_sync                      0.0125
     2 __mod_timer                                0.0114
     5 sys_getuid                                 0.3125
     2 sys_geteuid                                0.1250
   251 sigprocmask                                0.9805
     7 check_kill_permission                      0.0312
     9 lock_task_sighand                          0.0938
    10 copy_siginfo_to_user                       0.0231
    90 group_send_sig_info                        0.7031
     1 kill_pid_info                              0.0078
     1 kill_proc_info                             0.0208
     3 sys_rt_sigqueueinfo                        0.0375
    15 do_sigaction                               0.0335
     7 sys_rt_sigaction                           0.0437
     2 get_signal_to_deliver                      0.0019
     9 sys_rt_sigprocmask                         0.0352
   637 sys_rt_sigtimedwait                        0.9479
     1 groups_search                              0.0089
     1 run_workqueue                              0.0037
     1 queue_work                                 0.0156
     7 find_pid                                   0.0875
     1 find_get_pid                               0.0625
    16 posix_ktime_get_ts                         1.0000
    26 lock_timer                                 0.1625
   108 sys_clock_gettime                          0.7500
     7 posix_timer_fn                             0.0337
  2360 sys_timer_gettime                         18.4375
   640 sys_timer_settime                          0.9524
     3 init_waitqueue_head                        0.1875
     3 __wake_up_bit                              0.0469
     1 finish_wait                                0.0089
     1 prepare_to_wait_exclusive                  0.0089
     1 prepare_to_wait                            0.0089
     9 remove_wait_queue                          0.1125
    12 add_wait_queue                             0.1500
     7 hrtimer_init                               0.0547
   126 ktime_get_ts                               1.5750
     2 ktime_get                                  0.0417
     8 lock_hrtimer_base                          0.1000
    27 hrtimer_try_to_cancel                      0.1875
     2 hrtimer_cancel                             0.0625
    17 hrtimer_start                              0.0559
     1 run_hrtimer_softirq                        0.0045
    22 up_read                                    0.6875
    39 down_read                                  1.2188
     2 system_latency_constraint                  0.1250
    45 do_gettimeofday                            0.1758
   314 getnstimeofday                             1.5096
    45 clockevents_notify                         0.4688
  1402 tick_notify                                1.5932
   834 tick_broadcast_oneshot_control             3.0662
   236 tick_nohz_stop_sched_tick                  0.3512
    12 tick_nohz_restart_sched_tick               0.0375
    17 hash_futex                                 0.1181
    95 wake_futex                                 1.1875
     6 drop_futex_key_refs                        0.0938
     8 unqueue_me                                 0.0556
    10 get_futex_key                              0.0298
    47 futex_wait                                 0.0599
    11 futex_wake                                 0.0529
    47 do_futex                                   0.0155
    20 sys_futex                                  0.0781
   312 handle_IRQ_event                           3.2500
     1 generic_segment_checks                     0.0063
     1 remove_suid                                0.0312
     7 file_read_actor                            0.0292
     2 find_get_pages_tag                         0.0139
    16 find_get_page                              0.1667
     3 find_lock_page                             0.0156
     1 end_page_writeback                         0.0156
     8 add_to_page_cache                          0.0455
    24 do_generic_mapping_read                    0.0161
     7 generic_file_buffered_write                0.0042
     1 generic_file_aio_write                     0.0048
     1 filemap_nopage                             0.0012
     2 generic_file_aio_read                      0.0043
     3 zone_watermark_ok                          0.0170
    14 free_hot_cold_page                         0.0365
     2 __free_pages                               0.0417
     1 free_pages                                 0.0312
   133 get_page_from_freelist                     0.1433
     4 __alloc_pages                              0.0048
     3 __set_page_dirty_nobuffers                 0.0134
     1 file_ra_state_init                         0.0625
     4 __do_page_cache_readahead                  0.0068
     1 make_ahead_window                          0.0052
     6 page_cache_readahead                       0.0114
     3 release_pages                              0.0078
     4 __pagevec_lru_add_active                   0.0192
    34 put_page                                   0.1417
    17 mark_page_accessed                         0.2656
     7 lru_cache_add_active                       0.0875
     2 vma_prio_tree_remove                       0.0096
     1 __inc_zone_page_state                      0.0312
     3 page_address                               0.0156
     7 vm_normal_page                             0.0547
     2 do_wp_page                                 0.0015
    83 follow_page                                0.1995
     1 unmap_vmas                                 0.0007
    26 __handle_mm_fault                          0.0092
    28 get_user_pages                             0.0380
    25 find_vma                                   0.2232
    14 find_extend_vma                            0.1250
     1 anon_vma_prepare                           0.0045
   200 __get_vm_area_node                         0.4808
     1 __get_vm_area                              0.0208
     1 get_vm_area                                0.0125
     5 map_vm_area                                0.0130
    10 unmap_vm_area                              0.0298
    56 remove_vm_area                             0.5833
     1 __vunmap                                   0.0042
     2 vunmap                                     0.0625
     2 vmap                                       0.0250
     1 shmem_getpage                              0.0006
     3 kmem_cache_zalloc                          0.0170
    14 kfree                                      0.0729
    12 kmem_cache_free                            0.0750
    13 kmem_cache_alloc                           0.0903
     4 __kmalloc_track_caller                     0.0250
    12 quicklist_trim                             0.0625
     1 do_sys_open                                0.0042
     1 do_sync_readv_writev                       0.0037
     2 do_sync_write                              0.0069
     9 do_sync_read                               0.0312
     1 rw_verify_area                             0.0052
     1 do_readv_writev                            0.0023
     4 vfs_write                                  0.0109
     7 vfs_read                                   0.0199
     1 sys_read                                   0.0089
     5 sys_pread64                                0.0446
     1 sys_pwrite64                               0.0089
     1 __fput                                     0.0024
    87 fput                                       2.7188
   194 fget_light                                 1.3472
     1 get_empty_filp                             0.0028
     1 cp_new_stat64                              0.0037
    16 pipe_poll                                  0.1111
     1 __follow_mount                             0.0089
     1 getname                                    0.0048
     6 __link_path_walk                           0.0016
     2 do_path_lookup                             0.0043
    21 do_ioctl                                   0.1094
    23 vfs_ioctl                                  0.0351
    44 sys_ioctl                                  0.3056
     8 poll_initwait                              0.2500
    18 free_poll_entry                            0.5625
    11 poll_freewait                              0.1146
     7 do_sys_poll                                0.0071
   201 do_select                                  0.1721
    75 core_sys_select                            0.0977
    13 __pollwait                                 0.0542
    44 sys_select                                 0.1019
     1 locks_remove_posix                         0.0063
     7 __d_lookup                                 0.0257
     1 d_alloc                                    0.0025
     2 touch_atime                                0.0069
     1 __lookup_mnt                               0.0104
     1 alloc_buffer_head                          0.0156
     1 alloc_page_buffers                         0.0042
     1 __find_get_block                           0.0022
     1 __block_commit_write                       0.0063
     1 generic_commit_write                       0.0063
     1 sync_buffer                                0.0156
     6 __block_prepare_write                      0.0049
     1 block_prepare_write                        0.0156
     1 end_buffer_async_write                     0.0031
     2 bio_put                                    0.0417
     2 bio_alloc_bioset                           0.0060
     2 do_mpage_readpage                          0.0011
     1 mpage_end_io_read                          0.0078
     1 mpage_readpages                            0.0030
     4 inotify_inode_queue_event                  0.0156
     1 inotify_dentry_parent_queue_event          0.0057
     1 inotify_poll                               0.0156
     1 sys_epoll_wait                             0.0008
    13 dnotify_parent                             0.0903
     1 render_sigset_t                            0.0057
     1 dummy_capable                              0.0312
    12 dummy_file_ioctl                           0.7500
     1 dummy_task_kill                            0.0625
     1 rq_init                                    0.0063
     1 blk_recount_segments                       0.0018
     1 init_request_from_bio                      0.0045
     2 __end_that_request_first                   0.0016
     3 get_request                                0.0038
     4 blk_done_softirq                           0.0357
     1 __make_request                             0.0007
     1 cfq_set_request                            0.0013
     1 __next_cpu                                 0.0312
     2 _atomic_dec_and_lock                       0.0179
     1 kref_put                                   0.0063
     9 number                                     0.0115
     5 vsnprintf                                  0.0032
     1 find_next_zero_bit                         0.0057
     1 __put_user_4                               0.0312
     1 __copy_user_intel                          0.0057
   410 __copy_to_user_ll                          3.6607
   245 __copy_from_user_ll                        1.0208
    11 __copy_from_user_ll_nocache_nozero         0.0430
   103 copy_from_user                             0.9196
    82 copy_to_user                               0.8542
     1 hweight32                                  0.0156
     3 plist_add                                  0.0170
     5 plist_del                                  0.0446
    10 acpi_os_write_port                         0.2000
     1 acpi_ds_exec_end_op                        0.0010
   840 acpi_set_register                          2.3333
     2 acpi_ns_delete_namespace_by_owner          0.0101
     2 acpi_ns_get_parent_node                    0.1000
     1 acpi_ns_get_next_valid_node                0.0714
     1 acpi_ns_opens_scope                        0.0149
     1 acpi_ns_get_next_node                      0.0192
     1 acpi_ns_walk_namespace                     0.0035
     1 acpi_ps_parse_loop                         0.0005
     1 acpi_ut_delete_internal_obj                0.0030
     5 add_timer_randomness                       0.0120
     1 add_disk_randomness                        0.0208
     1 extract_buf                                0.0039
     2 tty_ldisc_try                              0.0312
     1 tty_ldisc_ref_wait                         0.0057
     2 tty_poll                                   0.0156
     1 tty_ioctl                                  0.0003
     3 n_tty_receive_buf                          0.0008
     5 normal_poll                                0.0149
     1 pty_write                                  0.0104
     1 con_chars_in_buffer                        0.0625
     2 dma_pool_alloc                             0.0040
    30 serio_interrupt                            0.2344
    78 i8042_interrupt                            0.1283
    23 sock_poll                                  1.4375
     2 sock_mmap                                  0.1250
     1 alloc_sock_iocb                            0.0156
     1 sock_aio_write                             0.0033
     1 sock_aio_read                              0.0033
     1 sock_ioctl                                 0.0019
     4 sock_def_readable                          0.0312
     3 sock_wfree                                 0.0469
     3 skb_dequeue                                0.0312
     1 __kfree_skb                                0.0033
     1 __alloc_skb                                0.0035
     1 memcpy_toiovec                             0.0104
    24 datagram_poll                              0.1154
     1 netif_receive_skb                          0.0010
     1 __qdisc_run                                0.0021
     1 ip_rcv                                     0.0007
    18 tcp_poll                                   0.0511
     1 tcp_rcv_space_adjust                       0.0027
     1 __tcp_checksum_complete_user               0.0208
     1 tcp_rcv_established                        0.0004
     1 tcp_send_ack                               0.0039
    13 udp_poll                                   0.0542
    66 unix_poll                                  0.4125
     5 unix_stream_recvmsg                        0.0035
     1 unix_ioctl                                 0.0048
     7 unix_stream_sendmsg                        0.0083
     2 unix_write_space                           0.0156
     5 unix_shutdown                              0.0149
   436 schedule                                   0.1989
   102 cond_resched                               1.5938
     3 wait_for_completion_interruptible_timeout   0.0094
     1 io_schedule                                0.0208
     3 schedule_timeout                           0.0144
     3 __wait_on_bit                              0.0268
    50 mutex_unlock                               3.1250
    96 mutex_lock                                 3.0000
     2 __down_interruptible                       0.0069
     1 __down                                     0.0041
    15 do_page_fault                              0.0089
     4 notifier_call_chain                        0.0312
 57115 *unknown*
 22898 total                                      0.0111

That is when it is idle (20-30% cpu)

    21 cpu_idle                                   0.0938
     4 get_wchan                                  0.0250
     1 setup_sigcontext                           0.0025
     3 do_notify_resume                           0.0016
   667 sysenter_past_esp                          3.9467
  1645 system_call                               27.8814
     3 syscall_call                               0.2727
     7 syscall_exit                               0.2593
     5 device_not_available                       0.0877
     2 math_state_restore                         0.0250
     2 convert_fxsr_from_user                     0.0083
     1 init_fpu                                   0.0069
     1 save_i387                                  0.0027
    11 sched_clock                                0.0982
     1 flush_tlb_all                              0.0312
    35 send_IPI_mask_bitmask                      0.1823
  2333 native_smp_call_function_mask              6.0755
     1 flush_tlb_page                             0.0069
     6 smp_call_function                          0.1250
    66 read_hpet                                  4.1250
 12411 hpet_rtc_timer_init                       59.6683
     1 native_write_cr0                           0.0625
   102 native_load_tr_desc                        6.3750
     6 native_set_pte                             0.3750
     1 native_flush_tlb                           0.0625
   164 native_flush_tlb_single                   10.2500
     8 native_set_pte_at                          0.5000
     3 check_pgt_cache                            0.0938
    69 kmap_atomic_prot                           0.3594
    10 kmap_atomic                                0.6250
    74 kunmap_atomic                              0.4625
     6 __wake_up                                  0.0750
     1 task_rq_lock                               0.0078
     7 try_to_wake_up                             0.0061
     2 __cond_resched                             0.0312
     1 set_cpus_allowed                           0.0063
     4 jiffies_to_usecs                           0.2500
     6 timespec_trunc                             0.0750
    23 set_normalized_timespec                    0.4792
    17 sys_gettimeofday                           0.1328
    10 current_fs_time                            0.1250
   127 on_each_cpu                                1.5875
    74 __do_softirq                               0.2721
     1 ksoftirqd                                  0.0042
     2 __timer_stats_timer_set_start_info         0.0208
     1 init_timer                                 0.0156
     2 lock_timer_base                            0.0208
     1 try_to_del_timer_sync                      0.0125
     4 __mod_timer                                0.0227
     6 sys_getuid                                 0.3750
     2 sys_geteuid                                0.1250
   474 sigprocmask                                1.8516
    14 check_kill_permission                      0.0625
    13 lock_task_sighand                          0.1354
    17 copy_siginfo_to_user                       0.0394
   150 group_send_sig_info                        1.1719
     1 kill_pid_info                              0.0078
     5 kill_proc_info                             0.1042
     6 sys_rt_sigqueueinfo                        0.0750
    23 do_sigaction                               0.0513
     9 sys_rt_sigaction                           0.0563
     2 get_signal_to_deliver                      0.0019
    14 sys_rt_sigprocmask                         0.0547
   883 sys_rt_sigtimedwait                        1.3140
     1 groups_search                              0.0089
     1 run_workqueue                              0.0037
     1 queue_work                                 0.0156
     9 find_pid                                   0.1125
     1 find_get_pid                               0.0625
    30 posix_ktime_get_ts                         1.8750
    41 lock_timer                                 0.2562
   166 sys_clock_gettime                          1.1528
    17 posix_timer_fn                             0.0817
  4028 sys_timer_gettime                         31.4688
  1100 sys_timer_settime                          1.6369
     4 init_waitqueue_head                        0.2500
     4 __wake_up_bit                              0.0625
     1 finish_wait                                0.0089
     1 prepare_to_wait_exclusive                  0.0089
     1 prepare_to_wait                            0.0089
    13 remove_wait_queue                          0.1625
    26 add_wait_queue                             0.3250
    14 hrtimer_init                               0.1094
     2 hrtimer_init_sleeper                       0.0625
   221 ktime_get_ts                               2.7625
     2 ktime_get                                  0.0417
     8 lock_hrtimer_base                          0.1000
    41 hrtimer_try_to_cancel                      0.2847
     3 hrtimer_cancel                             0.0938
    33 hrtimer_start                              0.1086
     2 run_hrtimer_softirq                        0.0089
    43 up_read                                    1.3438
    65 down_read                                  2.0312
     4 system_latency_constraint                  0.2500
    75 do_gettimeofday                            0.2930
   536 getnstimeofday                             2.5769
    69 clockevents_notify                         0.7188
  2002 tick_notify                                2.2750
  1087 tick_broadcast_oneshot_control             3.9963
   334 tick_nohz_stop_sched_tick                  0.4970
    14 tick_nohz_restart_sched_tick               0.0437
    36 hash_futex                                 0.2500
   162 wake_futex                                 2.0250
    12 drop_futex_key_refs                        0.1875
    12 unqueue_me                                 0.0833
    19 get_futex_key                              0.0565
    85 futex_wait                                 0.1084
    24 futex_wake                                 0.1154
    77 do_futex                                   0.0253
    42 sys_futex                                  0.1641
   408 handle_IRQ_event                           4.2500
     3 generic_segment_checks                     0.0187
     1 should_remove_suid                         0.0125
     1 remove_suid                                0.0312
    11 file_read_actor                            0.0458
     4 find_get_pages_tag                         0.0278
    35 find_get_page                              0.3646
     1 unlock_page                                0.0208
     4 find_lock_page                             0.0208
     2 end_page_writeback                         0.0312
     8 add_to_page_cache                          0.0455
    36 do_generic_mapping_read                    0.0242
     1 wait_on_page_writeback_range               0.0039
    10 generic_file_buffered_write                0.0060
     4 __generic_file_aio_write_nolock            0.0030
     2 generic_file_aio_write                     0.0096
     4 filemap_nopage                             0.0048
     8 generic_file_aio_read                      0.0172
     5 zone_watermark_ok                          0.0284
    27 free_hot_cold_page                         0.0703
     6 __free_pages                               0.1250
     1 free_pages                                 0.0312
   228 get_page_from_freelist                     0.2457
     8 __alloc_pages                              0.0096
     3 __set_page_dirty_nobuffers                 0.0134
     1 file_ra_state_init                         0.0625
     5 __do_page_cache_readahead                  0.0084
     1 make_ahead_window                          0.0052
    11 page_cache_readahead                       0.0208
     6 release_pages                              0.0156
     6 __pagevec_lru_add_active                   0.0288
    58 put_page                                   0.2417
    23 mark_page_accessed                         0.3594
    13 lru_cache_add_active                       0.1625
     2 vma_prio_tree_remove                       0.0096
     1 __dec_zone_page_state                      0.0312
     2 __inc_zone_state                           0.0179
     1 __inc_zone_page_state                      0.0312
     7 page_address                               0.0365
    16 vm_normal_page                             0.1250
     3 do_wp_page                                 0.0023
   156 follow_page                                0.3750
     8 unmap_vmas                                 0.0054
    37 __handle_mm_fault                          0.0131
    47 get_user_pages                             0.0639
    47 find_vma                                   0.4196
    29 find_extend_vma                            0.2589
     1 __page_set_anon_rmap                       0.0208
     1 page_add_new_anon_rmap                     0.0312
     1 anon_vma_unlink                            0.0089
     2 anon_vma_prepare                           0.0089
   417 __get_vm_area_node                         1.0024
     2 __get_vm_area                              0.0417
     6 get_vm_area                                0.0750
     9 map_vm_area                                0.0234
    24 unmap_vm_area                              0.0714
   115 remove_vm_area                             1.1979
     7 __vunmap                                   0.0292
     4 vunmap                                     0.1250
     5 vmap                                       0.0625
     1 shmem_getpage                              0.0006
     9 kmem_cache_zalloc                          0.0511
    23 kfree                                      0.1198
    17 kmem_cache_free                            0.1062
    31 kmem_cache_alloc                           0.2153
     1 __kmalloc                                  0.0063
     6 __kmalloc_track_caller                     0.0375
    20 quicklist_trim                             0.1042
     1 get_unused_fd                              0.0052
     1 do_sys_open                                0.0042
     1 sys_close                                  0.0048
     1 do_sync_readv_writev                       0.0037
     3 do_sync_write                              0.0104
    13 do_sync_read                               0.0451
     5 rw_verify_area                             0.0260
     1 do_readv_writev                            0.0023
     4 vfs_write                                  0.0109
    11 vfs_read                                   0.0312
     1 sys_writev                                 0.0078
     1 sys_read                                   0.0089
     7 sys_pread64                                0.0625
     1 sys_pwrite64                               0.0089
     1 __fput                                     0.0024
   139 fput                                       4.3438
   324 fget_light                                 2.2500
     1 get_empty_filp                             0.0028
     1 fget                                       0.0104
     1 cp_new_stat64                              0.0037
    28 pipe_poll                                  0.1944
     1 __follow_mount                             0.0089
     1 permission                                 0.0035
     1 getname                                    0.0048
     7 __link_path_walk                           0.0019
     2 do_path_lookup                             0.0043
     1 vfs_follow_link                            0.0030
    46 do_ioctl                                   0.2396
    47 vfs_ioctl                                  0.0716
    81 sys_ioctl                                  0.5625
    12 poll_initwait                              0.3750
    28 free_poll_entry                            0.8750
    15 poll_freewait                              0.1562
    27 do_sys_poll                                0.0272
   333 do_select                                  0.2851
   125 core_sys_select                            0.1628
    26 __pollwait                                 0.1083
    71 sys_select                                 0.1644
     1 locks_remove_posix                         0.0063
    12 __d_lookup                                 0.0441
     1 d_alloc                                    0.0025
     1 d_path                                     0.0042
     7 touch_atime                                0.0243
     1 __lookup_mnt                               0.0104
     1 alloc_buffer_head                          0.0156
     1 __find_get_block_slow                      0.0031
     1 alloc_page_buffers                         0.0042
     2 __find_get_block                           0.0045
     1 __block_commit_write                       0.0063
     2 generic_commit_write                       0.0125
     1 sync_buffer                                0.0156
     6 __block_prepare_write                      0.0049
     1 block_prepare_write                        0.0156
     2 end_buffer_async_write                     0.0063
     2 bio_put                                    0.0417
     2 bio_alloc_bioset                           0.0060
     2 do_mpage_readpage                          0.0011
     1 mpage_end_io_read                          0.0078
     1 mpage_readpages                            0.0030
     6 inotify_inode_queue_event                  0.0234
     2 inotify_dentry_parent_queue_event          0.0114
     2 inotify_poll                               0.0312
     1 sys_epoll_wait                             0.0008
    18 dnotify_parent                             0.1250
     1 proc_get_inode                             0.0039
     1 render_sigset_t                            0.0057
     1 dummy_capable                              0.0312
    23 dummy_file_ioctl                           1.4375
     2 dummy_task_kill                            0.1250
     2 rq_init                                    0.0125
     1 blk_recount_segments                       0.0018
     1 init_request_from_bio                      0.0045
     3 __end_that_request_first                   0.0024
     3 get_request                                0.0038
     4 blk_done_softirq                           0.0357
     2 __make_request                             0.0015
     1 cfq_set_request                            0.0013
     1 __next_cpu                                 0.0312
     2 _atomic_dec_and_lock                       0.0179
     1 kref_put                                   0.0063
     9 number                                     0.0115
     7 vsnprintf                                  0.0044
     1 find_next_zero_bit                         0.0057
     2 delay_tsc                                  0.0250
     1 memcpy                                     0.0156
     1 __put_user_4                               0.0312
     4 __copy_user_intel                          0.0227
   682 __copy_to_user_ll                          6.0893
   414 __copy_from_user_ll                        1.7250
    13 __copy_from_user_ll_nocache_nozero         0.0508
   174 copy_from_user                             1.5536
   149 copy_to_user                               1.5521
     3 hweight32                                  0.0469
     9 plist_add                                  0.0511
    12 plist_del                                  0.1071
     1 percpu_counter_mod                         0.0089
    21 acpi_os_write_port                         0.4200
     1 acpi_os_delete_semaphore                   0.0526
     1 acpi_ds_exec_end_op                        0.0010
     1 acpi_ds_init_object_from_op                0.0019
  1495 acpi_set_register                          4.1528
     1 acpi_get_sleep_type_data                   0.0022
     2 acpi_ns_delete_namespace_by_owner          0.0101
     4 acpi_ns_get_parent_node                    0.2000
     1 acpi_ns_get_next_valid_node                0.0714
     1 acpi_ns_opens_scope                        0.0149
     5 acpi_ns_get_next_node                      0.0962
     1 acpi_ns_walk_namespace                     0.0035
     1 acpi_ps_parse_loop                         0.0005
     1 acpi_ps_get_opcode_info                    0.0169
     1 acpi_ut_delete_internal_obj                0.0030
     1 __add_entropy_words                        0.0022
     5 add_timer_randomness                       0.0120
     1 add_disk_randomness                        0.0208
     1 extract_buf                                0.0039
     3 tty_ldisc_try                              0.0469
     1 tty_ldisc_ref_wait                         0.0057
     2 tty_poll                                   0.0156
     1 tty_ioctl                                  0.0003
     1 check_unthrottle                           0.0208
     1 n_tty_chars_in_buffer                      0.0078
     3 n_tty_receive_buf                          0.0008
     6 normal_poll                                0.0179
     1 read_chan                                  0.0006
     1 pty_write                                  0.0104
     1 con_chars_in_buffer                        0.0625
     2 dma_pool_alloc                             0.0040
    40 serio_interrupt                            0.3125
    98 i8042_interrupt                            0.1612
    38 sock_poll                                  2.3750
     4 sock_mmap                                  0.2500
     1 alloc_sock_iocb                            0.0156
     2 sock_aio_write                             0.0066
     3 sock_aio_read                              0.0099
     1 sock_ioctl                                 0.0019
     1 sock_alloc_send_skb                        0.0022
    11 sock_def_readable                          0.0859
     7 sock_wfree                                 0.1094
     4 skb_dequeue                                0.0417
     1 kfree_skbmem                               0.0078
     1 __kfree_skb                                0.0033
     1 skb_release_data                           0.0078
     3 __alloc_skb                                0.0104
     3 memcpy_toiovec                             0.0312
    37 datagram_poll                              0.1779
     1 netif_receive_skb                          0.0010
     1 __qdisc_run                                0.0021
     1 ip_rcv                                     0.0007
    31 tcp_poll                                   0.0881
     2 tcp_rcv_space_adjust                       0.0054
     1 __tcp_checksum_complete_user               0.0208
     1 tcp_rcv_established                        0.0004
     1 tcp_send_ack                               0.0039
    19 udp_poll                                   0.0792
    94 unix_poll                                  0.5875
     9 unix_stream_recvmsg                        0.0063
     1 unix_ioctl                                 0.0048
    11 unix_stream_sendmsg                        0.0130
     2 unix_write_space                           0.0156
     8 unix_shutdown                              0.0238
     2 sha_transform                              0.0038
   755 schedule                                   0.3444
   182 cond_resched                               2.8438
     2 wait_for_completion                        0.0089
     3 wait_for_completion_interruptible_timeout   0.0094
     1 io_schedule                                0.0208
     4 schedule_timeout                           0.0192
     3 __wait_on_bit                              0.0268
    88 mutex_unlock                               5.5000
   183 mutex_lock                                 5.7188
     2 __down_interruptible                       0.0069
     1 __down                                     0.0041
    23 do_page_fault                              0.0137
     6 notifier_call_chain                        0.0469
104006 *unknown*
 38285 total                                      0.0186

That is when it is at 99% cpu.

kvm statistics

 efer_reload                  0       0
 exits                  7736565    5845
 fpu_reload              318339      48
 halt_exits              902157    2653
 halt_wakeup                  0       0
 host_state_reload      3255275    3709
 insn_emulation         1341400     958
 insn_emulation_fail         12       0
 invlpg                       0       0
 io_exits               4096473    1365
 irq_exits                69079      75
 irq_window                   0       0
 mmio_exits              204713       0
 mmu_flooded             191451     274
 mmu_pde_zapped            7098       8
 mmu_pte_updated         515359     584
 mmu_pte_write           704129     855
 mmu_recycled                 0       0
 mmu_shadow_zapped       196813     274
 pf_fixed               1221297    1560
 pf_guest                 10381       0
 remote_tlb_flush             6       0
And those are the stats when it is idle.

Any help on anylyzing this information is greatly appreciated, Thanks.




-------------------------------------------------------------------------
SF.Net email is sponsored by: The Future of Linux Business White Paper
from Novell.  From the desktop to the data center, Linux is going
mainstream.  Let it simplify your IT future.
http://altfarm.mediaplex.com/ad/ck/8857-50307-18918-4

             reply	other threads:[~2007-11-28 15:55 UTC|newest]

Thread overview: 5+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2007-11-28 15:55 Darren Blaber [this message]
     [not found] ` <474D8F83.3010303-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2007-11-28 16:15   ` Bad Performance Izik Eidus
     [not found]     ` <1196266531.6456.1.camel-bi+AKbBUZKY6gyzm1THtWbp2dZbC/Bob@public.gmane.org>
2007-11-28 16:15       ` Darren Blaber
2007-11-28 16:15   ` Avi Kivity
     [not found]     ` <474D9435.3040608-atKUWr5tajBWk0Htik3J/w@public.gmane.org>
2007-11-28 20:06       ` Darren Blaber

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=474D8F83.3010303@gmail.com \
    --to=dmbtech-re5jqeeqqe8avxtiumwx3w@public.gmane.org \
    --cc=kvm-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.