From: hiroyuki <mogwaing@gmail.com>
To: netdev@vger.kernel.org
Subject: Some nodes have higher frame values in ifconfig
Date: Sun, 4 Nov 2012 01:04:13 +0000 (UTC) [thread overview]
Message-ID: <loom.20121104T014210-495@post.gmane.org> (raw)
Hello,
I am running a cluster consisting of 22 nodes.
(22 nodes under the same 1Gbps switch.)
I noticed some nodes in the cluster has higher frame value
in ifconfig like the following.
some nodes (higher frame):
eth0 Link encap:Ethernet HWaddr 90:B1:1C:09:D2:F8
inet addr:192.168.121.20 Bcast:192.168.121.255 Mask:255.255.255.0
inet6 addr: fe80::92b1:1cff:fe09:d2f8/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:643150667 errors:0 dropped:790 overruns:0 frame:280072
TX packets:908361364 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:377424658828 (351.5 GiB) TX bytes:864099883266 (804.7 GiB)
Interrupt:170 Memory:d91a0000-d91b0000
other nodes (lower frame):
eth0 Link encap:Ethernet HWaddr 24:B6:FD:F6:DF:34
inet addr:192.168.121.3 Bcast:192.168.121.255 Mask:255.255.255.0
inet6 addr: fe80::26b6:fdff:fef6:df34/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:1126524649 errors:0 dropped:118 overruns:0 frame:43775
TX packets:847071691 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:992080311726 (923.9 GiB) TX bytes:385366462299 (358.9 GiB)
Interrupt:170 Memory:d91a0000-d91b0000
What might be wrong with it ?
I also ran ethtool and
"rxbds_empty" value is the same value as frame in ifconfig.
whta is rxbds_empty ?
I have investigated rxbds_empty, but there is almost no information about it.
The weird thing is newly added 6 nodes have that higher value.
Also, I noticed some program runs slower than before we added those 6 nodes.
What the program is doing is that
every node requests huge amount of short messages
to other random nodes in parallel.
Ideally, every node has the some completion time with the program,
but the added 6 nodes run slower than others.
Could anyone give me any advice ?
reply other threads:[~2012-11-04 1:10 UTC|newest]
Thread overview: [no followups] expand[flat|nested] mbox.gz Atom feed
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=loom.20121104T014210-495@post.gmane.org \
--to=mogwaing@gmail.com \
--cc=netdev@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox