From: Tom Quetchenbach <virtualphtn@gmail.com>
To: Jarek Poplawski <jarkao2@gmail.com>
Cc: netdev@vger.kernel.org, ram.vepa@neterion.com,
santosh.rastapur@neterion.com, sivakumar.subramani@neterion.com,
sreenivasa.honnur@neterion.com
Subject: Re: s2io: packet reordering with 2.6.25.4
Date: Thu, 26 Jun 2008 17:05:35 -0700 [thread overview]
Message-ID: <48642ECF.4090905@gmail.com> (raw)
In-Reply-To: <48635708.8070100@gmail.com>
Jarek Poplawski wrote:
>
>> Out of curiosity: is there affinity set for eths' irqs or they are
>> balanced between cpus? (/proc/interrupts?)
No affinity set, but they're not exactly balanced either:
CPU0 CPU1
0: 73 0 IO-APIC-edge timer
1: 0 2 IO-APIC-edge i8042
2: 0 0 XT-PIC-XT cascade
8: 0 1 IO-APIC-edge rtc
12: 0 5 IO-APIC-edge i8042
25: 47 53074 IO-APIC-fasteoi eth0
26: 21 334 IO-APIC-fasteoi eth1
28: 358 1280440 IO-APIC-fasteoi eth2 Neterion 10 Gigabit
Ethernet-SR PCI-X 2.0 DDR Adapter
NMI: 0 0 Non-maskable interrupts
LOC: 227793 227721 Local timer interrupts
RES: 6483 3213 Rescheduling interrupts
CAL: 40 31 function call interrupts
TLB: 1119 105 TLB shootdowns
TRM: 0 0 Thermal event interrupts
THR: 0 0 Threshold APIC interrupts
SPU: 0 0 Spurious interrupts
ERR: 0
Anyhow, it looks like setting CPU affinity for the card on the receiver
(echo 1 > /proc/irq/28/smp_affinity) does eliminate the reordering, at
least with UDP at up to 2.5 Gbit/s (which is as fast as iperf can spit
out packets on this machine). So, it looks like the "mystery" is solved :-)
>
> ...and maybe ifconfig on TX side?
eth2 Link encap:Ethernet HWaddr 00:0C:FC:00:0D:3F
inet addr:10.4.72.3 Bcast:10.4.72.15 Mask:255.255.255.240
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:7 errors:0 dropped:0 overruns:0 frame:0
TX packets:10 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:496 (496.0 b) TX bytes:532 (532.0 b)
Interrupt:28
Thanks
-Tom
prev parent reply other threads:[~2008-06-27 0:05 UTC|newest]
Thread overview: 6+ messages / expand[flat|nested] mbox.gz Atom feed top
2008-06-26 0:11 s2io: packet reordering with 2.6.25.4 Tom Quetchenbach
2008-06-26 0:36 ` Ramkrishna Vepa
2008-06-26 1:27 ` David Miller
2008-06-26 8:28 ` Jarek Poplawski
2008-06-26 8:44 ` Jarek Poplawski
2008-06-27 0:05 ` Tom Quetchenbach [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=48642ECF.4090905@gmail.com \
--to=virtualphtn@gmail.com \
--cc=jarkao2@gmail.com \
--cc=netdev@vger.kernel.org \
--cc=ram.vepa@neterion.com \
--cc=santosh.rastapur@neterion.com \
--cc=sivakumar.subramani@neterion.com \
--cc=sreenivasa.honnur@neterion.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.