[LARTC] Re: big problem with HTB/CBQ and CPU for more than 1.700

[LARTC] Re: big problem with HTB/CBQ and CPU for more than 1.700

[Pablo Fernandes Yahoo]

[-- Attachment #1.1: Type: text/plain, Size: 1224 bytes --]

Hey,

 

I have some links that you could be interested on them:

 

http://www.geocities.com/asimshankar/notes/linux-networking-code.txt

http://oss.sgi.com/archives/netdev/2004-06/msg00162.html

http://www.spec.org/osg/web99/results/res2003q3/web99-20030818-00245.html

http://www.intel.com/support/network/sb/cs-009209.htm

 

All of them talks about the interrupts.

 

So, what do you think should i do with my e1000? What do you think could be
the best board for sites as 8.000 customers? My problem is exact these lots
of interruptions.

 

Thank you in advance!

 

Regards

 

>I have classes configured by protocol..

> 

>My NIC is the e1000 too (default parameters), but I'm using off-board cards
(with scalable i/o support - good for multi->core setups). The main problem
I had was the number of interruptions (~ 10.000/s)...  

>With IRQ balance activated, each NIC got used with a specific processor
core, and the use of CPU on these cores was always >100%.

> 

>I've solved this problem in my setup (2 Quad-Cores), deactivating the IRQ
balance, that caused the interruptions to be >processed by all the

>8 cores.

> 

>Are you doing p2p control on this server? This is usually what takes more
CPU usage..


[-- Attachment #1.2: Type: text/html, Size: 7506 bytes --]

[-- Attachment #2: Type: text/plain, Size: 143 bytes --]

_______________________________________________
LARTC mailing list
LARTC@mailman.ds9a.nl
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc

Re: [LARTC] Re: big problem with HTB/CBQ and CPU for more than

[Marek Kierdelewicz]

>So, what do you think should i do with my e1000? What do you think
>could be the best board for sites as 8.000 customers? My problem is
>exact these lots of interruptions.

Plug as many network interfaces (e1000) as cpu cores you have. E1000
multiport nics have separate irq assigned to each "port", so having 2 x
Quad-Core Xeon and 2 x 4-port e1000 would allow you to configure static
affinity of each port to one core:
http://bcr2.uwaterloo.ca/~brecht/servers/apic/SMP-affinity.txt

Sometimes symmetric usage of network interfaces (for symmetric
core usage) is the problem. I think you can achieve it by plugging all 8
ports to managed switch and configuring some form of aggregation. The
best would be src/dst IP EtherChannel or something similar. For some
deployments (where router sees all the clients on OSI layer 2) src/dst
MAC EtherChannel would suffice. On linux side you would have to
configure bonding:
http://linux-net.osdl.org/index.php/Bonding

pozdrawiam,
Marek Kierdelewicz
KoBa ISP
_______________________________________________
LARTC mailing list
LARTC@mailman.ds9a.nl
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc