Re: V2.4 policy router operates faster/better than V2.6

["Jeremy M. Guthrie" <jeremy.guthrie@berbee.com>]

[-- Attachment #1: Type: text/plain, Size: 2632 bytes --]

On Wednesday 05 January 2005 07:18 am, Robert Olsson wrote:
> Jeremy M. Guthrie writes:
>  > How would I check?  It should be in the hundreds of thousands.
>
>  Good question  Stephen,..
>
>  Yes it seems like this pretty hefty load. Forwarding rate of 92k kpps
>  and a drop rate of 10 kpps and dst hash mostly at 50-60 kentries if
>  I read the stats correctly.
Yeah, the load will be high.  I'm expecting this to be watching ~ 750 mbps by 
next December.  The app profiles all traffic going in and out of our data 
centers.

>  And 2.4 were able handle this but not 2.6.10?
Yes.  It does handle it.  It runs harder ie. 2.6 caps out at ~ 50% utilization 
where 2.4 might run 60-75% utilized.

>  Assuming things are uses and setup identically. 2.6 uses RCU for route
> hash locking. Any dst cache overslow messages seen?
No.

>  A couple of lines of rtstat would be very interesing from this box.
I'm not showing the /proc/net/rt_cache_stat file.  Was there a kernel option I 
need to recompile with for rt_cache_stat to show up in proc?

>  Also check that the CPU shares the RX packet load. CPU0 affinty to eth0
>  and CPU1 to eth1 seems to be best. It gives cache bouncing at "TX" and
>  slab jobs but we have accept that for now.
How would I go about doing this?

>  13:37:25     CPU   %user   %nice %system %iowait    %irq   %soft   %idle
>
> > intr/s
> > 13:38:24     all    0.14    0.00    0.12    0.12    2.02   42.89   54.71
> > 25900.70
> > 13:38:24       0    0.03    0.00    0.05    0.22    0.00   16.67   83.03
> > 2246.10
> > 13:38:24       1    0.25    0.00    0.20    0.03    4.02   69.12   26.40
> > 23654.55
>
> This looks weird to me... we cannot have CPU left? Due to the imbalance?

> Check /proc/net/softnet_stat,
cat /proc/net/softnet_stat
5592c972 00000000 00001fc8 00000000 00000000 00000000 00000000 00000000 
00391c3f
000f1991 00000000 00000000 00000000 00000000 00000000 00000000 00000000 
001292ba


> Haven't used mpstat. %soft is that *all* softirq's or only softirq's
> deferred to ksoftird only?
"%soft"
Show  the percentage of time spent by the CPU or CPUs to service               
softirqs.  A softirq (software interrupt) is one  of  up  to  32               
enumerated software interrupts which can run on multiple CPUs at               
once.


-- 

--------------------------------------------------
Jeremy M. Guthrie        jeremy.guthrie@berbee.com
Senior Network Engineer        Phone: 608-298-1061
Berbee                           Fax: 608-288-3007
5520 Research Park Drive         NOC: 608-298-1102
Madison, WI 53711

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]