From: "Michael S. Tsirkin" <mst@redhat.com>
To: Krishna Kumar2 <krkumar2@in.ibm.com>
Cc: anthony@codemonkey.ws, arnd@arndb.de, avi@redhat.com,
davem@davemloft.net, eric.dumazet@gmail.com, kvm@vger.kernel.org,
netdev@vger.kernel.org, rusty@rustcorp.com.au
Subject: Re: [v3 RFC PATCH 0/4] Implement multiqueue virtio-net
Date: Tue, 9 Nov 2010 15:22:39 +0200 [thread overview]
Message-ID: <20101109132239.GF22705@redhat.com> (raw)
In-Reply-To: <OF529E89EE.84DB37B8-ON652577D6.001665CF-652577D6.00192784@in.ibm.com>
On Tue, Nov 09, 2010 at 10:08:21AM +0530, Krishna Kumar2 wrote:
> "Michael S. Tsirkin" <mst@redhat.com> wrote on 10/26/2010 02:27:09 PM:
>
> > Re: [v3 RFC PATCH 0/4] Implement multiqueue virtio-net
> >
> > On Mon, Oct 25, 2010 at 09:20:38PM +0530, Krishna Kumar2 wrote:
> > > > Krishna Kumar2/India/IBM@IBMIN wrote on 10/20/2010 02:24:52 PM:
> > >
> > > Any feedback, comments, objections, issues or bugs about the
> > > patches? Please let me know if something needs to be done.
> > >
> > > Some more test results:
> > > _____________________________________________________
> > > Host->Guest BW (numtxqs=2)
> > > # BW% CPU% RCPU% SD% RSD%
> > > _____________________________________________________
> >
> > I think we discussed the need for external to guest testing
> > over 10G. For large messages we should not see any change
> > but you should be able to get better numbers for small messages
> > assuming a MQ NIC card.
>
> I had to make a few changes to qemu (and a minor change in macvtap
> driver) to get multiple TXQ support using macvtap working. The NIC
> is a ixgbe card.
>
> __________________________________________________________________________
> Org vs New (I/O: 512 bytes, #numtxqs=2, #vhosts=3)
> # BW1 BW2 (%) SD1 SD2 (%) RSD1 RSD2 (%)
> __________________________________________________________________________
> 1 14367 13142 (-8.5) 56 62 (10.7) 8 8 (0)
> 2 3652 3855 (5.5) 37 35 (-5.4) 7 6 (-14.2)
> 4 12529 12059 (-3.7) 65 77 (18.4) 35 35 (0)
> 8 13912 14668 (5.4) 288 332 (15.2) 175 184 (5.1)
> 16 13433 14455 (7.6) 1218 1321 (8.4) 920 943 (2.5)
> 24 12750 13477 (5.7) 2876 2985 (3.7) 2514 2348 (-6.6)
> 32 11729 12632 (7.6) 5299 5332 (.6) 4934 4497 (-8.8)
> 40 11061 11923 (7.7) 8482 8364 (-1.3) 8374 7495 (-10.4)
> 48 10624 11267 (6.0) 12329 12258 (-.5) 12762 11538 (-9.5)
> 64 10524 10596 (.6) 21689 22859 (5.3) 23626 22403 (-5.1)
> 80 9856 10284 (4.3) 35769 36313 (1.5) 39932 36419 (-8.7)
> 96 9691 10075 (3.9) 52357 52259 (-.1) 58676 53463 (-8.8)
> 128 9351 9794 (4.7) 114707 94275 (-17.8) 114050 97337 (-14.6)
> __________________________________________________________________________
> Avg: BW: (3.3) SD: (-7.3) RSD: (-11.0)
>
> __________________________________________________________________________
> Org vs New (I/O: 1K, #numtxqs=8, #vhosts=5)
> # BW1 BW2 (%) SD1 SD2 (%) RSD1 RSD2 (%)
> __________________________________________________________________________
> 1 16509 15985 (-3.1) 45 47 (4.4) 7 7 (0)
> 2 6963 4499 (-35.3) 17 51 (200.0) 7 7 (0)
> 4 12932 11080 (-14.3) 49 74 (51.0) 35 35 (0)
> 8 13878 14095 (1.5) 223 292 (30.9) 175 181 (3.4)
> 16 13440 13698 (1.9) 980 1131 (15.4) 926 942 (1.7)
> 24 12680 12927 (1.9) 2387 2463 (3.1) 2526 2342 (-7.2)
> 32 11714 12261 (4.6) 4506 4486 (-.4) 4941 4463 (-9.6)
> 40 11059 11651 (5.3) 7244 7081 (-2.2) 8349 7437 (-10.9)
> 48 10580 11095 (4.8) 10811 10500 (-2.8) 12809 11403 (-10.9)
> 64 10569 10566 (0) 19194 19270 (.3) 23648 21717 (-8.1)
> 80 9827 10753 (9.4) 31668 29425 (-7.0) 39991 33824 (-15.4)
> 96 10043 10150 (1.0) 45352 44227 (-2.4) 57766 51131 (-11.4)
> 128 9360 9979 (6.6) 92058 79198 (-13.9) 114381 92873 (-18.8)
> __________________________________________________________________________
> Avg: BW: (-.5) SD: (-7.5) RSD: (-14.7)
>
> Is there anything else you would like me to test/change, or shall
> I submit the next version (with the above macvtap changes)?
>
> Thanks,
>
> - KK
Something strange here, right?
1. You are consistently getting >10G/s here, and even with a single stream?
2. With 2 streams, is where we get < 10G/s originally. Instead of
doubling that we get a marginal improvement with 2 queues and
about 30% worse with 1 queue.
Is your card MQ?
--
MST
next prev parent reply other threads:[~2010-11-09 13:22 UTC|newest]
Thread overview: 34+ messages / expand[flat|nested] mbox.gz Atom feed top
2010-10-20 8:54 [v3 RFC PATCH 0/4] Implement multiqueue virtio-net Krishna Kumar
2010-10-20 8:54 ` [v3 RFC PATCH 1/4] Change virtqueue structure Krishna Kumar
2010-10-20 8:55 ` [v3 RFC PATCH 2/4] Changes for virtio-net Krishna Kumar
2010-10-20 8:55 ` [v3 RFC PATCH 3/4] Changes for vhost Krishna Kumar
2010-10-20 8:55 ` [v3 RFC PATCH 4/4] qemu changes Krishna Kumar
2010-10-25 15:50 ` [v3 RFC PATCH 0/4] Implement multiqueue virtio-net Krishna Kumar2
2010-10-25 16:17 ` Michael S. Tsirkin
2010-10-26 5:10 ` Krishna Kumar2
[not found] ` <OF5C53E9CF.FFDF2CE7-ON652577C8.00191D14-652577C8.001C2154@LocalDomain>
2010-10-26 9:08 ` Krishna Kumar2
2010-10-26 9:38 ` Michael S. Tsirkin
2010-10-26 10:01 ` Krishna Kumar2
2010-10-26 11:09 ` Michael S. Tsirkin
2010-10-28 5:14 ` Krishna Kumar2
2010-10-28 5:50 ` Michael S. Tsirkin
2010-10-28 6:12 ` Krishna Kumar2
2010-10-28 6:18 ` Michael S. Tsirkin
[not found] ` <OFC29C4491.59069AD1-ON652577CA.00170F0D-652577CA.001C76C8@LocalDomain>
2010-10-28 7:18 ` Krishna Kumar2
2010-10-29 11:26 ` Michael S. Tsirkin
2010-11-03 7:01 ` Michael S. Tsirkin
2010-10-26 8:57 ` Michael S. Tsirkin
2010-11-09 4:38 ` Krishna Kumar2
2010-11-09 13:22 ` Michael S. Tsirkin [this message]
2010-11-09 15:28 ` Krishna Kumar2
2010-11-09 15:33 ` Michael S. Tsirkin
2010-11-09 17:24 ` Krishna Kumar2
2010-11-10 16:16 ` Michael S. Tsirkin
[not found] ` <OF24E08752.2087FFA4-ON652577D6.00532DF1-652577D6.0054B291@LocalDomain>
2010-11-16 7:25 ` MQ performance on other cards (cxgb3) Krishna Kumar2
2011-02-22 7:47 ` [v3 RFC PATCH 0/4] Implement multiqueue virtio-net Simon Horman
2011-02-23 5:22 ` Krishna Kumar2
2011-02-23 6:39 ` Michael S. Tsirkin
2011-02-23 6:48 ` Krishna Kumar2
2011-02-23 15:55 ` Michael S. Tsirkin
2011-02-24 11:48 ` Krishna Kumar2
2011-02-23 22:59 ` Simon Horman
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20101109132239.GF22705@redhat.com \
--to=mst@redhat.com \
--cc=anthony@codemonkey.ws \
--cc=arnd@arndb.de \
--cc=avi@redhat.com \
--cc=davem@davemloft.net \
--cc=eric.dumazet@gmail.com \
--cc=krkumar2@in.ibm.com \
--cc=kvm@vger.kernel.org \
--cc=netdev@vger.kernel.org \
--cc=rusty@rustcorp.com.au \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).