From: "Paweł Staszewski" <pstaszewski@itcare.pl>
To: Linux Network Development list <netdev@vger.kernel.org>
Subject: Problem wit route cache
Date: Mon, 08 Feb 2010 14:16:50 +0100 [thread overview]
Message-ID: <4B700EC2.5090207@itcare.pl> (raw)
Hello
From some time i have problem with route cache in linux
this is an info that i have in dmesg:
Route hash chain too long!
Adjust your secret_interval!
Route hash chain too long!
Adjust your secret_interval!
Route hash chain too long!
Adjust your secret_interval!
Route hash chain too long!
Adjust your secret_interval!
Route hash chain too long!
Adjust your secret_interval!
Route hash chain too long!
Adjust your secret_interval!
Route hash chain too long!
Adjust your secret_interval!
Route hash chain too long!
Adjust your secret_interval!
vlan0811: 9 rebuilds is over limit, route caching disabled
Route hash chain too long!
Adjust your secret_interval!
The problem is that change of net.ipv4.route.secret_interval is change
nothing -- no matter that i set secret_interval from dfault 3600 to 2 or
10000 i have always the same info about route cahce is disabled.
Also i change this parameter net.ipv4.rt_cache_rebuild_count from
default 4 to 9 and the same info - i try also change this to 12 but also
this change nothing.
The machine that have this info is:
2x Intel(R) Xeon(R) CPU X5450 @ 3.00GHz
12GB of RAM
Network controllers are:
04:00.0 Ethernet controller: Intel Corporation 82573E Gigabit Ethernet
Controller (Copper) (rev 03)
05:00.0 Ethernet controller: Intel Corporation 82573L Gigabit Ethernet
Controller
And the weird thing is that i need to set affinity for my nics to "ff"
because when i bind network card to one cpu this cpu have always 100%
Router traffic is about 700Mbit/s RX + 700Mbit/s TX on eth0 (with 2
tagged vlans) and the same traffic on eth1 that is untagged
This traffic is forwarded by this router.
Simple topology:
Clients<- ibgp -> [ vlan0811@eth0 + vlan0508@eth0 - BGP process - eth1 ]<- ebgp -> Internet Provisers
Some info about fibtrie:
cat /proc/net/fib_triestat
Basic info: size of leaf: 40 bytes, size of tnode: 56 bytes.
Main:
Aver depth: 2.58
Max depth: 6
Leaves: 297506
Prefixes: 312472
Internal nodes: 69968
1: 35673 2: 14840 3: 10980 4: 4729 5: 2315 6: 956 7: 364 8: 109 9: 1 16: 1
Pointers: 570018
Null ptrs: 202545
Total size: 36990 kB
Counters:
---------
gets = 2797832581
backtracks = 149015808
semantic match passed = 2789993308
semantic match miss = 766703
null node hit= 860359377
skipped node resize = 0
Local:
Aver depth: 3.66
Max depth: 4
Leaves: 15
Prefixes: 16
Internal nodes: 11
1: 8 2: 3
Pointers: 28
Null ptrs: 3
Total size: 3 kB
Counters:
---------
gets = 2792656726
backtracks = 2185449412
semantic match passed = 5895311
semantic match miss = 0
null node hit= 818902
skipped node resize = 0
And interrupts
cat /proc/interrupts
CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7
0: 80 21 32 27 38 39 38 34 IO-APIC-edge timer
1: 0 1 0 0 0 0 1 0 IO-APIC-edge i8042
9: 0 0 0 0 0 0 0 0 IO-APIC-fasteoi acpi
14: 0 0 0 0 0 0 0 0 IO-APIC-edge ide0
15: 0 0 0 0 0 0 0 0 IO-APIC-edge ide1
20: 0 0 0 0 0 0 0 0 IO-APIC-fasteoi uhci_hcd:usb3
21: 0 0 0 0 0 0 0 0 IO-APIC-fasteoi uhci_hcd:usb6
22: 0 0 0 0 0 0 0 0 IO-APIC-fasteoi ehci_hcd:usb1, uhci_hcd:usb5
23: 0 0 0 0 0 0 0 0 IO-APIC-fasteoi ehci_hcd:usb2, uhci_hcd:usb4
29: 73903 136 135 135 134 138 136 136 PCI-MSI-edge ahci
30: 101136854 101509497 101627297 100701508 101684077 101870217 101154425 100604465 PCI-MSI-edge eth0
31: 91772747 92037311 92317341 92231065 91248484 91062342 91778136 92328099 PCI-MSI-edge eth1
32: 0 0 0 0 0 1 1 0 PCI-MSI-edge
33: 0 1 0 0 0 0 0 1 PCI-MSI-edge
34: 0 0 1 0 0 1 0 0 PCI-MSI-edge
35: 1 0 0 1 0 0 0 0 PCI-MSI-edge
36: 0 0 0 0 1 0 0 1 PCI-MSI-edge
37: 1 0 0 0 0 0 1 0 PCI-MSI-edge
38: 0 0 0 1 1 0 0 0 PCI-MSI-edge
39: 0 1 1 0 0 0 0 0 PCI-MSI-edge
NMI: 0 0 0 0 0 0 0 0 Non-maskable interrupts
LOC: 407733660 395964025 431438426 402307801 434522968 420170984 400450633 390318324 Local timer interrupts
SPU: 0 0 0 0 0 0 0 0 Spurious interrupts
PMI: 0 0 0 0 0 0 0 0 Performance monitoring interrupts
PND: 0 0 0 0 0 0 0 0 Performance pending work
RES: 14378 15781 19276 5691 14761 13579 16846 15629 Rescheduling interrupts
CAL: 378 383 92 86 364 354 92 89 Function call interrupts
TLB: 551 577 433 272 602 543 329 683 TLB shootdowns
ERR: 0
MIS: 0
Regards
Pawel
next reply other threads:[~2010-02-08 13:23 UTC|newest]
Thread overview: 22+ messages / expand[flat|nested] mbox.gz Atom feed top
2010-02-08 13:16 Paweł Staszewski [this message]
2010-02-08 13:28 ` Problem wit route cache Eric Dumazet
2010-02-08 13:33 ` Paweł Staszewski
2010-02-08 13:51 ` Eric Dumazet
2010-02-08 13:59 ` Paweł Staszewski
2010-02-08 14:06 ` Eric Dumazet
2010-02-08 14:16 ` Paweł Staszewski
2010-02-08 14:32 ` Eric Dumazet
2010-02-08 19:32 ` [PATCH] dst: call cond_resched() in dst_gc_task() Eric Dumazet
2010-02-08 23:01 ` David Miller
2010-02-09 6:07 ` Eric Dumazet
2010-02-08 23:26 ` Andrew Morton
2010-02-08 23:34 ` David Miller
2010-02-08 23:37 ` Andrew Morton
2010-02-08 23:50 ` David Miller
2010-02-08 23:50 ` Stephen Hemminger
2010-02-09 6:06 ` Eric Dumazet
2010-02-09 6:35 ` Andrew Morton
2010-02-09 7:20 ` Eric Dumazet
2010-02-09 7:31 ` Andrew Morton
2010-02-08 14:32 ` Problem wit route cache Paweł Staszewski
2010-02-08 14:45 ` Paweł Staszewski
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=4B700EC2.5090207@itcare.pl \
--to=pstaszewski@itcare.pl \
--cc=netdev@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.