OT: netmap - a novel framework for fast packet I/O

OT: netmap - a novel framework for fast packet I/O

[Yann Droneaud]

Hi,

I have discovered today the netmap project[1] through an ACM Queue
article[2].

Netmap is a new interface to send and receive packets through an
Ethernet interface (NIC). It seems to provide a raw access to network
interface in order to process packets at high rate with a low overhead.

This is an another example of "kernel-bypass"/"zero-copy" which are core
features of InfiniBand verbs/RDMA.

But unlike InfiniBand verbs/RDMA, Netmap seems to have a very small API.

Such API could be enough to build an unreliable datagram messaging
system on "low cost" hardware (without concerns of determinism, flow
control, etc.).

I'm asking myself if the way netmap exposes internal NIC rings could be
applicable for IB/IBoE HCA ? e.g. beyond 10GbE NIC, is netmap relevant ?

Regards.

[1] http://info.iet.unipi.it/~luigi/netmap/

netmap - a novel framework for fast packet I/O
Luigi Rizzo Università di Pisa

[2] http://queue.acm.org/detail.cfm?id=2103536

Revisiting Network I/O APIs: The netmap Framework 
Luigi Rizzo, 2012-01-17  

-- 
Yann Droneaud


--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: OT: netmap - a novel framework for fast packet I/O

[Atchley, Scott]

Interesting. It totally hijacks the NIC; all traffic is captured. You would have to implement your own IP stack, Verbs stack, etc.

Scott

On Jan 19, 2012, at 11:50 AM, Yann Droneaud wrote:

> Hi,
> 
> I have discovered today the netmap project[1] through an ACM Queue
> article[2].
> 
> Netmap is a new interface to send and receive packets through an
> Ethernet interface (NIC). It seems to provide a raw access to network
> interface in order to process packets at high rate with a low overhead.
> 
> This is an another example of "kernel-bypass"/"zero-copy" which are core
> features of InfiniBand verbs/RDMA.
> 
> But unlike InfiniBand verbs/RDMA, Netmap seems to have a very small API.
> 
> Such API could be enough to build an unreliable datagram messaging
> system on "low cost" hardware (without concerns of determinism, flow
> control, etc.).
> 
> I'm asking myself if the way netmap exposes internal NIC rings could be
> applicable for IB/IBoE HCA ? e.g. beyond 10GbE NIC, is netmap relevant ?
> 
> Regards.
> 
> [1] http://info.iet.unipi.it/~luigi/netmap/
> 
> netmap - a novel framework for fast packet I/O
> Luigi Rizzo Università di Pisa
> 
> [2] http://queue.acm.org/detail.cfm?id=2103536
> 
> Revisiting Network I/O APIs: The netmap Framework 
> Luigi Rizzo, 2012-01-17  
> 
> -- 
> Yann Droneaud
> 
> 
> --
> To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
> the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: OT: netmap - a novel framework for fast packet I/O

[Ira Weiny]

On Fri, 20 Jan 2012 06:18:44 -0800
"Atchley, Scott" <atchleyes-1Heg1YXhbW8@public.gmane.org> wrote:

> Interesting. It totally hijacks the NIC; all traffic is captured. You would have to implement your own IP stack, Verbs stack, etc.
> 

Can multiple user space processes share the card?  If so, how is security handled between them?

Ira

> Scott
> 
> On Jan 19, 2012, at 11:50 AM, Yann Droneaud wrote:
> 
> > Hi,
> > 
> > I have discovered today the netmap project[1] through an ACM Queue
> > article[2].
> > 
> > Netmap is a new interface to send and receive packets through an
> > Ethernet interface (NIC). It seems to provide a raw access to network
> > interface in order to process packets at high rate with a low overhead.
> > 
> > This is an another example of "kernel-bypass"/"zero-copy" which are core
> > features of InfiniBand verbs/RDMA.
> > 
> > But unlike InfiniBand verbs/RDMA, Netmap seems to have a very small API.
> > 
> > Such API could be enough to build an unreliable datagram messaging
> > system on "low cost" hardware (without concerns of determinism, flow
> > control, etc.).
> > 
> > I'm asking myself if the way netmap exposes internal NIC rings could be
> > applicable for IB/IBoE HCA ? e.g. beyond 10GbE NIC, is netmap relevant ?
> > 
> > Regards.
> > 
> > [1] http://info.iet.unipi.it/~luigi/netmap/
> > 
> > netmap - a novel framework for fast packet I/O
> > Luigi Rizzo Università di Pisa
> > 
> > [2] http://queue.acm.org/detail.cfm?id=2103536
> > 
> > Revisiting Network I/O APIs: The netmap Framework 
> > Luigi Rizzo, 2012-01-17  
> > 
> > -- 
> > Yann Droneaud
> > 
> > 
> > --
> > To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
> > the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
> > More majordomo info at  http://vger.kernel.org/majordomo-info.html
> 
> --
> To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
> the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html


-- 
Ira Weiny
Member of Technical Staff
Lawrence Livermore National Lab
925-423-8008
weiny2-i2BcT+NCU+M@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: OT: netmap - a novel framework for fast packet I/O

[Atchley, Scott]

On Jan 20, 2012, at 11:20 AM, Ira Weiny wrote:

> On Fri, 20 Jan 2012 06:18:44 -0800
> "Atchley, Scott" <atchleyes-1Heg1YXhbW8@public.gmane.org> wrote:
> 
>> Interesting. It totally hijacks the NIC; all traffic is captured. You would have to implement your own IP stack, Verbs stack, etc.
>> 
> 
> Can multiple user space processes share the card?  If so, how is security handled between them?

It is not clear from the paper I scanned.

There does seem to be a mechanism to send selected packets up the host stack.

Scott

> 
> Ira
> 
>> Scott
>> 
>> On Jan 19, 2012, at 11:50 AM, Yann Droneaud wrote:
>> 
>>> Hi,
>>> 
>>> I have discovered today the netmap project[1] through an ACM Queue
>>> article[2].
>>> 
>>> Netmap is a new interface to send and receive packets through an
>>> Ethernet interface (NIC). It seems to provide a raw access to network
>>> interface in order to process packets at high rate with a low overhead.
>>> 
>>> This is an another example of "kernel-bypass"/"zero-copy" which are core
>>> features of InfiniBand verbs/RDMA.
>>> 
>>> But unlike InfiniBand verbs/RDMA, Netmap seems to have a very small API.
>>> 
>>> Such API could be enough to build an unreliable datagram messaging
>>> system on "low cost" hardware (without concerns of determinism, flow
>>> control, etc.).
>>> 
>>> I'm asking myself if the way netmap exposes internal NIC rings could be
>>> applicable for IB/IBoE HCA ? e.g. beyond 10GbE NIC, is netmap relevant ?
>>> 
>>> Regards.
>>> 
>>> [1] http://info.iet.unipi.it/~luigi/netmap/
>>> 
>>> netmap - a novel framework for fast packet I/O
>>> Luigi Rizzo Università di Pisa
>>> 
>>> [2] http://queue.acm.org/detail.cfm?id=2103536
>>> 
>>> Revisiting Network I/O APIs: The netmap Framework 
>>> Luigi Rizzo, 2012-01-17  
>>> 
>>> -- 
>>> Yann Droneaud
>>> 
>>> 
>>> --
>>> To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
>>> the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>> 
>> --
>> To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
>> the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> 
> 
> -- 
> Ira Weiny
> Member of Technical Staff
> Lawrence Livermore National Lab
> 925-423-8008
> weiny2-i2BcT+NCU+M@public.gmane.org

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html