From: "Francois Baligant" <francois@baligant.net>
To: <netdev@oss.sgi.com>
Subject: 2.6.0-test11: dst_cache_overflow causing unresponsive box
Date: Tue, 2 Dec 2003 02:32:17 +0100 [thread overview]
Message-ID: <072501c3b874$2542ae70$15fea8c0@fortress> (raw)
[-- Attachment #1: Type: text/plain, Size: 3968 bytes --]
We have a problem with a box running 2.6.0-test11-mjb1 and supporting around 90k simultaneous TCP connection. After a few hours/days of running,
when a lots of clients connects/disconnects, the console will start to display:
dst cache overflow
NET: 1860 messages suppressed.
dst cache overflow
NET: 1858 messages suppressed.
>From there, the box is completely unresponsive, apparently eating all its CPU in trying to shrink the routing cache. Only solution is reboot.
Current sysctl:
net.ipv4.route.max_size = 655360 # I know we shouldn't rise it that high but it's only cure for now.. it lasts a bit longer like this
net.ipv4.route.gc_min_interval = 2
net.ipv4.route.gc_interval = 10
net.ipv4.route.gc_timeout = 30
rtstat:
size IN: hit tot mc no_rt bcast madst masrc OUT: hit tot mc GC: tot ignored goal_miss ovrf HASH: in_search out_search
139566 12393 123 0 0 0 0 0 184 21 0 143 142 0 0 26039 375
138876 13080 136 0 0 0 0 0 159 19 0 155 154 0 0 27153 277
139006 12317 125 0 0 0 0 0 180 28 0 153 153 0 0 25810 377
139138 13799 140 0 0 0 0 0 159 16 0 156 156 0 0 28375 331
139275 11610 128 0 0 0 0 0 177 27 0 154 153 0 0 23977 343
139383 12679 124 0 0 0 0 0 173 17 0 141 140 0 0 26717 398
139256 11946 135 0 0 0 0 0 166 17 0 152 151 0 0 24874 304
139353 11646 109 0 0 0 0 0 174 14 0 122 122 0 0 24165 320
138257 12702 116 0 0 0 0 0 180 16 0 131 130 0 0 26324 358
138369 12897 115 0 0 0 0 0 166 20 0 134 134 0 0 26819 339
138553 11309 133 0 0 0 0 0 158 33 0 165 165 0 0 21270 389
138172 17232 182 0 0 0 0 0 125 44 0 225 225 0 0 29702 375
138420 17407 182 0 0 0 0 0 165 73 0 254 253 0 0 29946 548
138833 17052 257 0 0 0 0 0 195 126 0 382 381 0 0 29715 812
139051 16606 224 0 0 0 0 0 238 97 0 320 319 0 0 28559 721
139217 18115 176 0 0 0 0 0 268 51 0 224 224 0 0 32983 527
139326 17531 178 0 0 0 0 0 291 44 0 220 220 0 0 33320 445
139422 15244 140 0 0 0 0 0 357 20 0 160 160 0 0 29934 415
139548 13123 142 0 0 0 0 0 281 12 0 154 154 0 0 26430 351
139684 13290 142 0 0 0 0 0 235 10 0 152 151 0 0 27341 309
OBJS ACTIVE USE OBJ SIZE SLABS OBJ/SLAB CACHE SIZE NAME
142340 142296 99% 0.38K 14234 10 56936K ip_dst_cache
Are we tuning the rt_cache in a wrong way ?
regards,
Francois
Francois Baligant - http://www.pingouin.be
Change the numbers, change your Life!
next reply other threads:[~2003-12-02 1:32 UTC|newest]
Thread overview: 6+ messages / expand[flat|nested] mbox.gz Atom feed top
2003-12-02 1:32 Francois Baligant [this message]
2003-12-02 10:44 ` 2.6.0-test11: dst_cache_overflow causing unresponsive box Robert Olsson
2003-12-02 11:26 ` David S. Miller
2003-12-02 12:47 ` jamal
2003-12-02 17:56 ` Robert Olsson
2003-12-03 0:15 ` Francois Baligant
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='072501c3b874$2542ae70$15fea8c0@fortress' \
--to=francois@baligant.net \
--cc=netdev@oss.sgi.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox