skb processing in SMP kernel

skb processing in SMP kernel

[Marek Kierdelewicz]

Hi there,

I'm looking at file /usr/src/linux/net/core/dev.c
function "int netif_rx(struct sk_buff *skb)"
and following line:
 
queue = &__get_cpu_var(softnet_data);

Is it possible to put skb into the queue of another CPU then the one
servicing the interrupt? (Disclaimer: Yeah, I know it's probably not
the smartest thing to do because of locks and cache line bounces). How
could it be accomplished? Any lead, comment, link appreciated.


pozdrawiam
-- 
Marek Kierdelewicz
Kierownik Działu Systemów Sieciowych, KoBa
Manager of Network Systems Department, KoBa
tel. (85) 7406466; fax. (85) 7406467
e-mail: admin@koba.pl

Re: skb processing in SMP kernel

[Stephen Hemminger]

On Wed, 14 Nov 2007 21:14:37 +0100
Marek Kierdelewicz <marek@koba.pl> wrote:

> Hi there,
> 
> I'm looking at file /usr/src/linux/net/core/dev.c
> function "int netif_rx(struct sk_buff *skb)"
> and following line:
>  
> queue = &__get_cpu_var(softnet_data);
> 
> Is it possible to put skb into the queue of another CPU then the one
> servicing the interrupt? (Disclaimer: Yeah, I know it's probably not
> the smartest thing to do because of locks and cache line bounces). How
> could it be accomplished? Any lead, comment, link appreciated.
> 
> 
> pozdrawiam

You could but then you would need locking on the queue, and that would
defeat the whole purpose of per-cpu queue's.  You would also need to do
an IPI to notify the other processor.

If you are trying to do packet distribution, look at the newest drivers that use MSI-X
and napi to do packet distribution.

-- 
Stephen Hemminger <shemminger@linux-foundation.org>