DPDK Demos at IDF conference using DDIO

DPDK Demos at IDF conference using DDIO

[Anjali Kulkarni]

Hi,

There were a few DPDK demos at IDF, and from one of them I gathered that you can use DDIO to enhance performance by using certain lookup APIs in DPDK. Can someone shed light on this? Is DDIO enabled by default? It is available only on the v3 chip and needs DPDK 1.7 or how can get the performance boost of DDIO in my application?

Thanks
Anjali

Re: DPDK Demos at IDF conference using DDIO

[Jeff Shaw]

On Thu, Sep 25, 2014 at 03:19:31PM +0000, Anjali Kulkarni wrote:
> Hi,
> 
> There were a few DPDK demos at IDF, and from one of them I gathered that you can use DDIO to enhance performance by using certain lookup APIs in DPDK. Can someone shed light on this? Is DDIO enabled by default? It is available only on the v3 chip and needs DPDK 1.7 or how can get the performance boost of DDIO in my application?
> 
> Thanks
> Anjali

Intel(R) Data Direct I/O Technology (Intel(R) DDIO) is a feature introduced with the Intel(R) Xeon(R) processor E5 family.
It has been around for several years and is available at least on all Xeon E5 processors. DDIO is part of the platform, so any DPDK version can take advantage of the feature.  There are several papers and videos available on the Internet that can provide more details.


Thanks,
Jeff

Re: DPDK Demos at IDF conference using DDIO

[Matthew Hall]

On Thu, Sep 25, 2014 at 09:11:24AM -0700, Jeff Shaw wrote:
> Intel(R) Data Direct I/O Technology (Intel(R) DDIO) is a feature introduced 
> with the Intel(R) Xeon(R) processor E5 family.
> 
> It has been around for several years and is available at least on all Xeon 
> E5 processors. DDIO is part of the platform, so any DPDK version can take 
> advantage of the feature.  There are several papers and videos available on 
> the Internet that can provide more details.

One difficulty I run into with a lot of these Intel accelerations... each one 
is described as an atomic entity independent of all the other possible 
accelerations. Nobody explains how to take all of them together to make a 
complete high-speend low-latency packet processing solution from L1-L7.

It'd be nice to see an architecture level view of DPDK, along with the 
accelerations one could / should apply at each level, so there's some kind of 
checklist you can follow to be sure you used everything you should where you 
should. Otherwise you'll miss some stuff and waste the features you paid for.

Also, how is DDIO different from the previous DCA accelerations?

Thanks,
Matthew.

Re: DPDK Demos at IDF conference using DDIO

[Anjali Kulkarni]

Actually, in the demo that I saw they had probably used as many of the
accelerations as possible to get the kind of rates they described. Even if
we could see (a documentation of) what all things they used in this
particular application, it would help.
>From my discussions, it seemed as if there were some specific lookup APIs
that they used to get better performance.

Anjali

On 9/25/14 12:18 PM, "Matthew Hall" <mhall-Hv3ogNYU3JfZZajBQzqCxQ@public.gmane.org> wrote:

>On Thu, Sep 25, 2014 at 09:11:24AM -0700, Jeff Shaw wrote:
>> Intel(R) Data Direct I/O Technology (Intel(R) DDIO) is a feature
>>introduced 
>> with the Intel(R) Xeon(R) processor E5 family.
>> 
>> It has been around for several years and is available at least on all
>>Xeon 
>> E5 processors. DDIO is part of the platform, so any DPDK version can
>>take 
>> advantage of the feature.  There are several papers and videos
>>available on 
>> the Internet that can provide more details.
>
>One difficulty I run into with a lot of these Intel accelerations... each
>one 
>is described as an atomic entity independent of all the other possible
>accelerations. Nobody explains how to take all of them together to make a
>complete high-speend low-latency packet processing solution from L1-L7.
>
>It'd be nice to see an architecture level view of DPDK, along with the
>accelerations one could / should apply at each level, so there's some
>kind of 
>checklist you can follow to be sure you used everything you should where
>you 
>should. Otherwise you'll miss some stuff and waste the features you paid
>for.
>
>Also, how is DDIO different from the previous DCA accelerations?
>
>Thanks,
>Matthew.

Re: DPDK Demos at IDF conference using DDIO

[Matthew Hall]

On Thu, Sep 25, 2014 at 07:27:21PM +0000, Anjali Kulkarni wrote:
> Actually, in the demo that I saw they had probably used as many of the
> accelerations as possible to get the kind of rates they described. Even if
> we could see (a documentation of) what all things they used in this
> particular application, it would help.
> From my discussions, it seemed as if there were some specific lookup APIs
> that they used to get better performance.
> 
> Anjali

Indeed it would be best if this stuff were documented first, then demoed. 
Otherwise it's hard to get reliably reproducible results.

In particular something which went all the way through the processing pipeline 
from Rx to Tx L1-L7.

Matthew.

Re: DPDK Demos at IDF conference using DDIO

[Alex Markuze]

Even IF only the Demo is available it would be useful.
I assume the people behind the Demo are pert of this mailing list (Or
someone on the mailing list knows them).
It would be great if the demo was publicly available anywhere.

On Thu, Sep 25, 2014 at 11:09 PM, Matthew Hall <mhall-Hv3ogNYU3JfZZajBQzqCxQ@public.gmane.org> wrote:
> On Thu, Sep 25, 2014 at 07:27:21PM +0000, Anjali Kulkarni wrote:
>> Actually, in the demo that I saw they had probably used as many of the
>> accelerations as possible to get the kind of rates they described. Even if
>> we could see (a documentation of) what all things they used in this
>> particular application, it would help.
>> From my discussions, it seemed as if there were some specific lookup APIs
>> that they used to get better performance.
>>
>> Anjali
>
> Indeed it would be best if this stuff were documented first, then demoed.
> Otherwise it's hard to get reliably reproducible results.
>
> In particular something which went all the way through the processing pipeline
> from Rx to Tx L1-L7.
>
> Matthew.

Re: DPDK Demos at IDF conference using DDIO

[Jayakumar, Muthurajan]

One of the DPDK demos that comes closer to the description here is http://www.advantech.com/networks-telecom/News.aspx?doc_id=BFEDE586-0FDC-4600-B808-3C09FBE6F910
However, this does not have detailed info. 
Will see what additional info. we can get on this.

Thanks


-----Original Message-----
From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Alex Markuze
Sent: Sunday, September 28, 2014 12:08 AM
To: Matthew Hall
Cc: dev@dpdk.org
Subject: Re: [dpdk-dev] DPDK Demos at IDF conference using DDIO

Even IF only the Demo is available it would be useful.
I assume the people behind the Demo are pert of this mailing list (Or someone on the mailing list knows them).
It would be great if the demo was publicly available anywhere.

On Thu, Sep 25, 2014 at 11:09 PM, Matthew Hall <mhall@mhcomputing.net> wrote:
> On Thu, Sep 25, 2014 at 07:27:21PM +0000, Anjali Kulkarni wrote:
>> Actually, in the demo that I saw they had probably used as many of 
>> the accelerations as possible to get the kind of rates they 
>> described. Even if we could see (a documentation of) what all things 
>> they used in this particular application, it would help.
>> From my discussions, it seemed as if there were some specific lookup 
>> APIs that they used to get better performance.
>>
>> Anjali
>
> Indeed it would be best if this stuff were documented first, then demoed.
> Otherwise it's hard to get reliably reproducible results.
>
> In particular something which went all the way through the processing 
> pipeline from Rx to Tx L1-L7.
>
> Matthew.