From: Fam Zheng <famz@redhat.com>
To: Ed Swierk <eswierk@skyportsystems.com>
Cc: qemu-devel@nongnu.org, stefanha@redhat.com
Subject: Re: [Qemu-devel] virtio-scsi-pci iothread spins at 100%
Date: Thu, 9 Feb 2017 10:52:12 +0800 [thread overview]
Message-ID: <20170209025212.GG22807@lemon.lan> (raw)
In-Reply-To: <CAO_EM_mJYNoxTLjKmTy18JhrL_zs_VLA32Y=Cw+LYqAGPzLN=w@mail.gmail.com>
On Wed, 02/08 18:11, Ed Swierk wrote:
> On Wed, Feb 8, 2017 at 5:47 PM, Fam Zheng <famz@redhat.com> wrote:
> > No, something is wrong. The polling shouldn't keep running when there is no I/O
> > activity.
> >
> > Can you try "perf top" to see what poll handlers are spinning?
>
> Samples: 288K of event 'cycles', Event count (approx.): 57149970643
> Overhead Shared Object Symbol
> 16.96% qemu-system-x86_64 [.] lduw_le_phys
> 15.77% [vdso] [.] __vdso_clock_gettime
> 7.25% qemu-system-x86_64 [.] qemu_lockcnt_cmpxchg_or_wait
> 7.16% qemu-system-x86_64 [.] aio_poll
> 3.94% qemu-system-x86_64 [.] address_space_translate
> 3.69% qemu-system-x86_64 [.] qemu_lockcnt_dec
> 3.46% qemu-system-x86_64 [.] virtio_queue_host_notifier_aio_poll
> 3.32% qemu-system-x86_64 [.] address_space_translate_internal
> 2.54% qemu-system-x86_64 [.] run_poll_handlers_once
> 2.54% libpthread-2.19.so [.] pthread_mutex_lock
> 2.53% libpthread-2.19.so [.] __pthread_mutex_unlock_usercnt
> 2.53% qemu-system-x86_64 [.] aio_notify_accept
> 2.40% qemu-system-x86_64 [.] timerlist_deadline_ns
> 2.38% qemu-system-x86_64 [.] address_space_lookup_region
> 2.23% qemu-system-x86_64 [.] timerlistgroup_deadline_ns
> 2.21% qemu-system-x86_64 [.] qemu_lockcnt_inc
> 2.08% qemu-system-x86_64 [.] qemu_clock_get_ns
> 1.91% qemu-system-x86_64 [.] object_dynamic_cast_assert
> 1.54% qemu-system-x86_64 [.] virtio_queue_notify_aio_vq.part.16
> 1.21% qemu-system-x86_64 [.] qemu_map_ram_ptr
> 1.16% libc-2.19.so [.] __clock_gettime
> 1.02% qemu-system-x86_64 [.] event_notifier_poll
> 1.02% qemu-system-x86_64 [.] timerlistgroup_run_timers
> 1.02% qemu-system-x86_64 [.] virtio_queue_set_notification
> 0.82% qemu-system-x86_64 [.] aio_bh_poll
> 0.81% qemu-system-x86_64 [.] timerlist_run_timers
> 0.70% qemu-system-x86_64 [.] aio_dispatch
> 0.66% qemu-system-x86_64 [.] virtio_queue_empty.part.32
> 0.62% qemu-system-x86_64 [.] aio_compute_timeout
> 0.50% qemu-system-x86_64 [.] virtio_scsi_data_plane_handle_event
> 0.32% qemu-system-x86_64 [.] clock_gettime@plt
> 0.26% qemu-system-x86_64 [.] memory_region_is_ram_device
> 0.21% qemu-system-x86_64 [.] qemu_mutex_unlock
> 0.12% qemu-system-x86_64 [.] aio_context_acquire
> 0.12% qemu-system-x86_64 [.] iothread_run
> 0.12% qemu-system-x86_64 [.] qemu_lockcnt_count
> 0.11% qemu-system-x86_64 [.] pthread_mutex_lock@plt
> 0.11% qemu-system-x86_64 [.] qemu_mutex_lock
> 0.11% [kernel] [k] vmx_vcpu_run
> 0.10% libpthread-2.19.so [.] pthread_mutex_unlock
> 0.09% qemu-system-x86_64 [.] aio_context_release
> 0.09% qemu-system-x86_64 [.] pthread_mutex_unlock@plt
> 0.09% [kernel] [k] native_write_msr_safe
> 0.08% [kernel] [k] ksm_do_scan
> 0.07% qemu-system-x86_64 [.] virtio_scsi_handle_event_vq
This means virtio-scsi event vq handler is returning true but actually no
progress is made. Can you try the following patch to see if it's because a
stalled cache of VQ index?
diff --git a/hw/virtio/virtio.c b/hw/virtio/virtio.c
index 6365706..7f7ab57 100644
--- a/hw/virtio/virtio.c
+++ b/hw/virtio/virtio.c
@@ -2126,7 +2126,7 @@ static bool virtio_queue_host_notifier_aio_poll(void *opaque)
EventNotifier *n = opaque;
VirtQueue *vq = container_of(n, VirtQueue, host_notifier);
- if (virtio_queue_empty(vq)) {
+ if (vring_avail_idx(vq) == vq->last_avail_idx) {
return false;
}
next prev parent reply other threads:[~2017-02-09 2:52 UTC|newest]
Thread overview: 11+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-02-08 16:33 [Qemu-devel] virtio-scsi-pci iothread spins at 100% Ed Swierk
2017-02-08 16:54 ` Ed Swierk
2017-02-09 1:47 ` Fam Zheng
2017-02-09 2:11 ` Ed Swierk
2017-02-09 2:52 ` Fam Zheng [this message]
2017-02-09 3:44 ` Ed Swierk
2017-02-09 5:39 ` Fam Zheng
2017-02-09 6:43 ` Fam Zheng
2017-02-09 10:12 ` Fam Zheng
2017-02-09 13:52 ` Ed Swierk
2017-02-09 14:16 ` Fam Zheng
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20170209025212.GG22807@lemon.lan \
--to=famz@redhat.com \
--cc=eswierk@skyportsystems.com \
--cc=qemu-devel@nongnu.org \
--cc=stefanha@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.