kvm.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: "Michael S. Tsirkin" <mst@redhat.com>
To: Sridhar Samudrala <sri@us.ibm.com>
Cc: Shirley Ma <mashirle@us.ibm.com>, Shirley Ma <xma@us.ibm.com>,
	David Stevens <dlstevens@us.ibm.com>,
	kvm@vger.kernel.org, sri@linux.vnet.ibm.com,
	mashirle@linux.vnet.ibm.com
Subject: Re: vhost-net patches
Date: Fri, 23 Oct 2009 09:12:31 +0200	[thread overview]
Message-ID: <20091023071231.GA12260@redhat.com> (raw)
In-Reply-To: <1256234420.27706.5.camel@w-sridhar.beaverton.ibm.com>

On Thu, Oct 22, 2009 at 11:00:20AM -0700, Sridhar Samudrala wrote:
> On Thu, 2009-10-22 at 19:43 +0200, Michael S. Tsirkin wrote:
> 
> > 
> > Possibly we'll have to debug this in vhost in host kernel.
> > I would debug this directly, it's just that my setup is somehow
> > different and I do not see this issue, otherwise I would not
> > waste your time.
> > 
> > Can we add some printks?
> > handle_tx has this at the top:
> > 
> >         if (!sock || !sock_writeable(sock->sk))
> >                 return;
> 
> I added some debug printks in handle_rx and handle_tx
> get_user() calls are failing with EFAULT.
> 
> Oct 21 10:51:41 IBM-19B5263ED41-009047018100 kernel: handle_rx: net:f5494800
> Oct 21 10:51:41 IBM-19B5263ED41-009047018100 kernel: Failed to enable notification: -14
> Oct 21 10:51:41 IBM-19B5263ED41-009047018100 kernel: Failed to access avail idx at 00000002 ret:-14
> Oct 21 10:51:41 IBM-19B5263ED41-009047018100 kernel: Failed to disable notification: -14
> Oct 21 10:51:41 IBM-19B5263ED41-009047018100 kernel: Failed to access avail idx at 00000002 ret:-14

Aha, we are getting somewhere!
Thanks very much for looking into this.  This suggests strongly that
available index pointer is not set up correctly in vhost.
I would like to verify this and understand how it came to be
incorrect.

Sridhar, Shirley, could you please try this:
        - make sure to enable CONFIG_DYNAMIC_DEBUG=y in .config
          (if it's not there, you'll have to rebuild kernel, or
           hack drivers/vhost/vhost.h to use pr_err instead of
           pr_debug).
        - echo 'module vhost_net +p' > /sys/kernel/debug/dynamic_debug/control

the above will make vhost print address which we tried to access, on error,
and they will apear in the output of the dmesg command.

In addition, please apply the following debugging patch to qemu.
this will make it output data about available index on startup.
Thanks!


diff --git a/hw/vhost_net.c b/hw/vhost_net.c
index bc179ab..d651504 100644
--- a/hw/vhost_net.c
+++ b/hw/vhost_net.c
@@ -66,6 +66,11 @@ static int vhost_virtqueue_init(struct vhost_dev *dev,
 	r = ioctl(dev->control, VHOST_SET_VRING_AVAIL, &addr);
 	if (r < 0)
 		return -errno;
+
+	fprintf(stderr, "VQ %d, avail va %p(=%llx), pa %llx, num %x size %llx\n",
+		idx, vq->avail, (unsigned long long)addr.user_addr,
+		(unsigned long long)q->vring.avail, (unsigned)q->vring.num, s);
+
 	s = l = offsetof(struct vring_used, ring) +
 		sizeof(struct vring_used_elem) * q->vring.num;
 	vq->used = cpu_physical_memory_map(q->vring.used, &l, 1);

  reply	other threads:[~2009-10-23  7:14 UTC|newest]

Thread overview: 55+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <1255721369.10322.38.camel@w-sridhar.beaverton.ibm.com>
     [not found] ` <20091018105356.GA8374@redhat.com>
     [not found]   ` <20091018173202.GA32441@redhat.com>
2009-10-19 22:56     ` vhost-net patches Sridhar Samudrala
2009-10-20 10:24       ` Michael S. Tsirkin
     [not found]       ` <OFE487449E.75D4E72D-ON87257654.007E61BF-88257654.007F1CCC@us.ibm.com>
2009-10-20 11:34         ` Michael S. Tsirkin
     [not found]           ` <OF491C5580.D14A9827-ON87257655.005E2B42-88257655.005EBFDD@us.ibm.com>
2009-10-20 17:18             ` Michael S. Tsirkin
     [not found]               ` <OF519C21FE.3A50884E-ON87257655.005FB73B-88257655.005FEA00@us.ibm.com>
2009-10-20 17:33                 ` Michael S. Tsirkin
     [not found]                   ` <OFAA36418A.2A0716E0-ON87257656.006D1231-88257656.006DD91D@us.ibm.com>
2009-10-21 20:19                     ` Michael S. Tsirkin
     [not found]                       ` <OF2487602C.0F4CA77B-ON87257656.00834AC0-88257656.0083C68B@us.ibm.com>
2009-10-22  9:24                         ` Michael S. Tsirkin
2009-10-22 10:56                         ` Michael S. Tsirkin
2009-10-22 12:34                         ` Michael S. Tsirkin
2009-10-22 13:13                           ` Michael S. Tsirkin
2009-10-22 17:23                             ` Shirley Ma
2009-10-22 17:32                               ` Shirley Ma
2009-10-22 17:36                                 ` Michael S. Tsirkin
2009-10-22 17:44                                   ` Shirley Ma
2009-10-22 17:47                                     ` Michael S. Tsirkin
2009-10-22 17:56                                       ` Shirley Ma
2009-10-22 18:13                                         ` Shirley Ma
2009-10-22 17:43                               ` Michael S. Tsirkin
2009-10-22 18:00                                 ` Sridhar Samudrala
2009-10-23  7:12                                   ` Michael S. Tsirkin [this message]
2009-10-23 11:04                                   ` Michael S. Tsirkin
2009-10-23 15:02                                     ` Shirley Ma
2009-10-23 15:12                                       ` Shirley Ma
2009-10-23 16:23                                         ` Shirley Ma
2009-10-25 10:52                                           ` Michael S. Tsirkin
2009-10-25 17:05                                           ` Michael S. Tsirkin
2009-10-26  9:27                                           ` Michael S. Tsirkin
2009-10-26 21:35                                             ` Shirley Ma
2009-10-26 20:05                                           ` Michael S. Tsirkin
2009-10-26 21:34                                             ` Shirley Ma
2009-10-27  6:43                                               ` Michael S. Tsirkin
2009-10-27 14:46                                                 ` Shirley Ma
2009-10-27 15:27                                                   ` Michael S. Tsirkin
2009-10-27 16:36                                                     ` Shirley Ma
2009-10-27 20:58                                                       ` Michael S. Tsirkin
2009-10-28 15:55                                                         ` Shirley Ma
2009-10-28 15:39                                                       ` Michael S. Tsirkin
2009-10-28 16:45                                                         ` Shirley Ma
2009-10-28 16:53                                                           ` Michael S. Tsirkin
2009-10-28 18:12                                                             ` Shirley Ma
2009-10-29  7:11                                                               ` Shirley Ma
2009-11-02 19:46                                                                 ` Michael S. Tsirkin
2009-11-03  1:06                                                                   ` Xin, Xiaohui
2009-11-03 15:52                                                                     ` Shirley Ma
2009-10-28 20:55                                                             ` Shirley Ma
2009-10-28 16:46                                                       ` kvm memory leak (Was Re: vhost-net patches) Michael S. Tsirkin
2009-10-29 12:21                                                         ` Avi Kivity
2009-10-29 12:50                                                           ` Avi Kivity
2009-10-23 19:24                                         ` vhost-net patches Shirley Ma
2009-10-25  9:11                                           ` Michael S. Tsirkin
2009-10-26 21:37                                             ` Shirley Ma
2009-10-27  6:38                                               ` Michael S. Tsirkin
2009-10-27 14:48                                                 ` Shirley Ma
2009-10-28 17:46                                               ` Arnd Bergmann
2009-10-28 18:13                                                 ` Shirley Ma

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20091023071231.GA12260@redhat.com \
    --to=mst@redhat.com \
    --cc=dlstevens@us.ibm.com \
    --cc=kvm@vger.kernel.org \
    --cc=mashirle@linux.vnet.ibm.com \
    --cc=mashirle@us.ibm.com \
    --cc=sri@linux.vnet.ibm.com \
    --cc=sri@us.ibm.com \
    --cc=xma@us.ibm.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).