From mboxrd@z Thu Jan 1 00:00:00 1970 From: Shirley Ma Subject: Re: vhost-net patches Date: Thu, 29 Oct 2009 00:11:33 -0700 Message-ID: <1256800293.16022.7.camel@localhost.localdomain> References: <1256310765.4443.4.camel@localhost.localdomain> <1256315020.4443.12.camel@localhost.localdomain> <20091026200513.GA26623@redhat.com> <1256592889.10142.8.camel@localhost.localdomain> <20091027064302.GB26914@redhat.com> <1256654819.4753.6.camel@localhost.localdomain> <20091027152753.GA4622@redhat.com> <1256661378.6745.2.camel@localhost.localdomain> <20091028153859.GA28926@redhat.com> <1256748337.6433.11.camel@localhost.localdomain> <20091028165302.GB29235@redhat.com> <1256753537.24155.3.camel@localhost.localdomain> Mime-Version: 1.0 Content-Type: text/plain Content-Transfer-Encoding: 7bit Cc: Sridhar Samudrala , Shirley Ma , David Stevens , kvm@vger.kernel.org, sri@linux.vnet.ibm.com, mashirle@linux.vnet.ibm.com To: "Michael S. Tsirkin" Return-path: Received: from e4.ny.us.ibm.com ([32.97.182.144]:33371 "EHLO e4.ny.us.ibm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1756557AbZJ2HLd (ORCPT ); Thu, 29 Oct 2009 03:11:33 -0400 Received: from d01relay05.pok.ibm.com (d01relay05.pok.ibm.com [9.56.227.237]) by e4.ny.us.ibm.com (8.14.3/8.13.1) with ESMTP id n9T73gMh024640 for ; Thu, 29 Oct 2009 03:03:42 -0400 Received: from d01av01.pok.ibm.com (d01av01.pok.ibm.com [9.56.224.215]) by d01relay05.pok.ibm.com (8.13.8/8.13.8/NCO v10.0) with ESMTP id n9T7BbUW097268 for ; Thu, 29 Oct 2009 03:11:37 -0400 Received: from d01av01.pok.ibm.com (loopback [127.0.0.1]) by d01av01.pok.ibm.com (8.14.3/8.13.1/NCO v10.0 AVout) with ESMTP id n9T7BaL5001687 for ; Thu, 29 Oct 2009 03:11:36 -0400 In-Reply-To: <1256753537.24155.3.camel@localhost.localdomain> Sender: kvm-owner@vger.kernel.org List-ID: Hello Michael, I am able to get 63xxMb/s throughput with 10% less cpu utilization when I apply deferring skb patch on top of your most recent vhost patch. The userspace TCP_STREAM BW used to be 3xxxMb/s from upper stream git tree. After applying your recent vhost patch, it goes up to 53xxMb/s. Now it can reach 63xxMb/s, pretty good news. (this test with transmission descriptors = 1K) netperf output with recent vhost patch: [root@localhost ~]# netperf -H 192.168.122.1 -c -C -l60 TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 192.168.122.1 (192.168.122.1) port 0 AF_INET Recv Send Send Utilization Service Demand Socket Socket Message Elapsed Send Recv Send Recv Size Size Size Time Throughput local remote local remote bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB 87380 16384 16384 60.03 5325.82 99.58 83.33 1.532 2.564 netperf output with vhost + deferring skb allocation patch [root@localhost linux-2.6.32-rc5]# netperf -H 192.168.122.1 -c -C -l60 TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 192.168.122.1 (192.168.122.1) port 0 AF_INET Recv Send Send Utilization Service Demand Socket Socket Message Elapsed Send Recv Send Recv Size Size Size Time Throughput local remote local remote bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB 87380 16384 16384 60.02 6332.38 99.33 76.16 1.285 1.970 Thanks Shirley