CFP: RDMA Microconference - Call for presentations

CFP: RDMA Microconference - Call for presentations

[Leon Romanovsky]

[-- Attachment #1: Type: text/plain, Size: 1597 bytes --]

Hi All,

We want to point your attention to the following [1] announcement that
RDMA microconference is accepted into LPC 2017.

This is a call for presentations for the 2nd RDMA microconference which will be
held on September 13-15 in Los Angeles, CA. The event is intended to gather
developers of the RDMA stack and the main intent is to provide room for discussion
between developers with focus on resolving things.

If you are interested to present, please submit a proposal to
leon-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org and/or to Linux RDMA mailing list linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
before August 14th, 2017, at 23:59 EST.

Thanks

-------
[1] https://lwn.net/Articles/725266/

Following on from the successful RDMA Microconference last year, which
resulted in a lot of fruitful discussions [2] we're pleased to announce
there will be a follow-on at Plumbers in Los Angeles this year.

In addition to looking at the usual kernel core gaps and ABI issues,
documentation, and testing, we'll also be looking at new fabrics
(including NVME), challenges to implementing a virtual RDMA device [3],
and integration possibilities with netdev.

For more details on this, please see this microconference's wiki
page [4].

Linux Plumbers Conference [5] will be held in Los Angeles, CA, US on
13-15 September in conjunction with The Linux Foundation Open Source
Summit.

[2] https://www.spinics.net/lists/linux-rdma/msg43074.html
[3] https://www.spinics.net/lists/linux-rdma/msg48038.html
[4] http://wiki.linuxplumbersconf.org/2017:rdma
[5] http://www.linuxplumbersconf.org/2017/

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: CFP: RDMA Microconference - Call for presentations

[Leon Romanovsky]

[-- Attachment #1: Type: text/plain, Size: 1750 bytes --]

REMINDER !!!!!!!

On Thu, Jun 15, 2017 at 08:03:05AM +0300, Leon Romanovsky wrote:
> Hi All,
>
> We want to point your attention to the following [1] announcement that
> RDMA microconference is accepted into LPC 2017.
>
> This is a call for presentations for the 2nd RDMA microconference which will be
> held on September 13-15 in Los Angeles, CA. The event is intended to gather
> developers of the RDMA stack and the main intent is to provide room for discussion
> between developers with focus on resolving things.
>
> If you are interested to present, please submit a proposal to
> leon-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org and/or to Linux RDMA mailing list linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
> before August 14th, 2017, at 23:59 EST.
>
> Thanks
>
> -------
> [1] https://lwn.net/Articles/725266/
>
> Following on from the successful RDMA Microconference last year, which
> resulted in a lot of fruitful discussions [2] we're pleased to announce
> there will be a follow-on at Plumbers in Los Angeles this year.
>
> In addition to looking at the usual kernel core gaps and ABI issues,
> documentation, and testing, we'll also be looking at new fabrics
> (including NVME), challenges to implementing a virtual RDMA device [3],
> and integration possibilities with netdev.
>
> For more details on this, please see this microconference's wiki
> page [4].
>
> Linux Plumbers Conference [5] will be held in Los Angeles, CA, US on
> 13-15 September in conjunction with The Linux Foundation Open Source
> Summit.
>
> [2] https://www.spinics.net/lists/linux-rdma/msg43074.html
> [3] https://www.spinics.net/lists/linux-rdma/msg48038.html
> [4] http://wiki.linuxplumbersconf.org/2017:rdma
> [5] http://www.linuxplumbersconf.org/2017/



[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: CFP: RDMA Microconference - Call for presentations

[Sagi Grimberg]

Hey All,

> REMINDER !!!!!!!

I won't be able to attend, but I'd be very happy if a group
of smart people can discuss some random topics I had in mind:

1. Adding NUMA hints to *all* rdma resources. Right now
there is no way to ask the core to allocate a queue-pair on
a specific numa-node. Some drivers use the device home node
for memory allocation but application locality will usually be
much much better (sq/rq/cq spinlock cost *a lot* more if accessed
across numa nodes for example).

Applications that don't care can simply skip the hint (or pass
NUMA_NO_NODE) and then drivers can do whatever they want.

In just about any kernel driver, resource setup and IO path run on 
different contexts, so numa locality is pretty much always wrong
(or right by accident). Its also true for a lot of user-space
applications.

I also wander what is the least intrusive way to add it.


2. SRQ sizing. No one knows what is a correct SRQ size. This leads
to magic random numbers for SRQ sizes (often copied) pretty much
anywhere used (usually crazy deep). Can the drivers hint applications
what is a "reasonable" size? Can it know? What if I want SRQ per core
or per numa-node?


3. Adaptive interrupt moderation. In order to effectively use irq-poll
(or any other napi-like functionality), interrupt moderation is
important, but its pretty useless if its not adaptive (always too early 
or too late). IMO It would be very useful to have, But before drivers
can start implementing it, we need a good core framework in place.
Does anyone think this is useful to have?


4. I wander if there is any interest to have a striding receive queue
core API? It would be *very* useful to just about any existing kernel
ULP. Who wouldn't like to reduce the frequency of post receive
operations.


Cheers,
Sagi.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: CFP: RDMA Microconference - Call for presentations

[Leon Romanovsky]

[-- Attachment #1: Type: text/plain, Size: 2149 bytes --]

On Thu, Jul 20, 2017 at 05:59:02PM +0300, Sagi Grimberg wrote:
> Hey All,
>
> > REMINDER !!!!!!!
>
> I won't be able to attend, but I'd be very happy if a group
> of smart people can discuss some random topics I had in mind:
>
> 1. Adding NUMA hints to *all* rdma resources. Right now
> there is no way to ask the core to allocate a queue-pair on
> a specific numa-node. Some drivers use the device home node
> for memory allocation but application locality will usually be
> much much better (sq/rq/cq spinlock cost *a lot* more if accessed
> across numa nodes for example).
>
> Applications that don't care can simply skip the hint (or pass
> NUMA_NO_NODE) and then drivers can do whatever they want.
>
> In just about any kernel driver, resource setup and IO path run on different
> contexts, so numa locality is pretty much always wrong
> (or right by accident). Its also true for a lot of user-space
> applications.
>
> I also wander what is the least intrusive way to add it.
>
>
> 2. SRQ sizing. No one knows what is a correct SRQ size. This leads
> to magic random numbers for SRQ sizes (often copied) pretty much
> anywhere used (usually crazy deep). Can the drivers hint applications
> what is a "reasonable" size? Can it know? What if I want SRQ per core
> or per numa-node?
>
>
> 3. Adaptive interrupt moderation. In order to effectively use irq-poll
> (or any other napi-like functionality), interrupt moderation is
> important, but its pretty useless if its not adaptive (always too early or
> too late). IMO It would be very useful to have, But before drivers
> can start implementing it, we need a good core framework in place.
> Does anyone think this is useful to have?
>
>
> 4. I wander if there is any interest to have a striding receive queue
> core API? It would be *very* useful to just about any existing kernel
> ULP. Who wouldn't like to reduce the frequency of post receive
> operations.

Thanks Sagi,

The topics look interesting, but it is unclear to me if ULP developers
plan to attend LPC, due to SNIA timing. It is hard to discuss those
hardcore topics without people who will actually use it.

>
>
> Cheers,
> Sagi.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: CFP: RDMA Microconference - Call for presentations

[Dennis Dalessandro]

On 7/20/2017 12:07 AM, Leon Romanovsky wrote:
> REMINDER !!!!!!!
> 
> On Thu, Jun 15, 2017 at 08:03:05AM +0300, Leon Romanovsky wrote:
>> Hi All,
>>
>> We want to point your attention to the following [1] announcement that
>> RDMA microconference is accepted into LPC 2017.
>>
>> This is a call for presentations for the 2nd RDMA microconference which will be
>> held on September 13-15 in Los Angeles, CA. The event is intended to gather
>> developers of the RDMA stack and the main intent is to provide room for discussion
>> between developers with focus on resolving things.
>>
>> If you are interested to present, please submit a proposal to
>> leon-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org and/or to Linux RDMA mailing list linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
>> before August 14th, 2017, at 23:59 EST.

> 
> 

Have exchanged a separate email thread with Leon. I am planning to 
attend and present for a discussion on how we can add statistics to RDMA 
Tool. This will focus on device related counters and how an architecture 
could look that is easy to add more counters and have different counters 
across devices without requiring a lot of updates to the user space tool.

-Denny
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

RE: CFP: RDMA Microconference - Call for presentations

[Parav Pandit]

> -----Original Message-----
> From: linux-rdma-owner-u79uwXL29TY76Z2rM5mHXA@public.gmane.org [mailto:linux-rdma-
> owner-u79uwXL29TY76Z2rM5mHXA@public.gmane.org] On Behalf Of Dennis Dalessandro
> Sent: Thursday, July 20, 2017 11:03 AM
> To: Leon Romanovsky <leon-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>; RDMA mailing list <linux-
> rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>
> Cc: Doug Ledford <dledford-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>; Christoph Lameter <cl-vYTEC60ixJUAvxtiuMwx3w@public.gmane.org>;
> Jason Gunthorpe <jgunthorpe-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>; Liran Liss
> <liranl-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>; Ira Weiny <ira.weiny-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org>; Matan Barak
> <matanb-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>; Tzahi Oved <tzahio-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
> Subject: Re: CFP: RDMA Microconference - Call for presentations
> 
> On 7/20/2017 12:07 AM, Leon Romanovsky wrote:
> > REMINDER !!!!!!!
> >
> > On Thu, Jun 15, 2017 at 08:03:05AM +0300, Leon Romanovsky wrote:
> >> Hi All,
> >>
> >> We want to point your attention to the following [1] announcement
> >> that RDMA microconference is accepted into LPC 2017.
> >>
> >> This is a call for presentations for the 2nd RDMA microconference
> >> which will be held on September 13-15 in Los Angeles, CA. The event
> >> is intended to gather developers of the RDMA stack and the main
> >> intent is to provide room for discussion between developers with focus on
> resolving things.
> >>
> >> If you are interested to present, please submit a proposal to
> >> leon-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org and/or to Linux RDMA mailing list
> >> linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org before August 14th, 2017, at 23:59 EST.
> 
> >
> >
> 
> Have exchanged a separate email thread with Leon. I am planning to attend and
> present for a discussion on how we can add statistics to RDMA Tool. This will
> focus on device related counters and how an architecture could look that is easy
> to add more counters and have different counters across devices without
> requiring a lot of updates to the user space tool.
> 

I haven't synced with Leon yet, nor I have followed any past rdmatool discussion actively for statistics.
So feel free to ignore my comment.

Having ethtool style mechanism that allows device related counters is good starting point instead of reinventing a new mechanism.
Probably a good starting point to follow existing mechanism via 3 similar callbacks get_strings(), get_sset_count(), get_ethtool_stats().
May be such 3 callbacks for rdamtool from ibdev.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: CFP: RDMA Microconference - Call for presentations

[Leon Romanovsky]

[-- Attachment #1: Type: text/plain, Size: 3278 bytes --]

On Thu, Jul 20, 2017 at 05:15:40PM +0000, Parav Pandit wrote:
>
>
> > -----Original Message-----
> > From: linux-rdma-owner-u79uwXL29TY76Z2rM5mHXA@public.gmane.org [mailto:linux-rdma-
> > owner-u79uwXL29TY76Z2rM5mHXA@public.gmane.org] On Behalf Of Dennis Dalessandro
> > Sent: Thursday, July 20, 2017 11:03 AM
> > To: Leon Romanovsky <leon-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>; RDMA mailing list <linux-
> > rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>
> > Cc: Doug Ledford <dledford-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>; Christoph Lameter <cl-vYTEC60ixJUAvxtiuMwx3w@public.gmane.org>;
> > Jason Gunthorpe <jgunthorpe-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>; Liran Liss
> > <liranl-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>; Ira Weiny <ira.weiny-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org>; Matan Barak
> > <matanb-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>; Tzahi Oved <tzahio-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
> > Subject: Re: CFP: RDMA Microconference - Call for presentations
> >
> > On 7/20/2017 12:07 AM, Leon Romanovsky wrote:
> > > REMINDER !!!!!!!
> > >
> > > On Thu, Jun 15, 2017 at 08:03:05AM +0300, Leon Romanovsky wrote:
> > >> Hi All,
> > >>
> > >> We want to point your attention to the following [1] announcement
> > >> that RDMA microconference is accepted into LPC 2017.
> > >>
> > >> This is a call for presentations for the 2nd RDMA microconference
> > >> which will be held on September 13-15 in Los Angeles, CA. The event
> > >> is intended to gather developers of the RDMA stack and the main
> > >> intent is to provide room for discussion between developers with focus on
> > resolving things.
> > >>
> > >> If you are interested to present, please submit a proposal to
> > >> leon-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org and/or to Linux RDMA mailing list
> > >> linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org before August 14th, 2017, at 23:59 EST.
> >
> > >
> > >
> >
> > Have exchanged a separate email thread with Leon. I am planning to attend and
> > present for a discussion on how we can add statistics to RDMA Tool. This will
> > focus on device related counters and how an architecture could look that is easy
> > to add more counters and have different counters across devices without
> > requiring a lot of updates to the user space tool.
> >
>
> I haven't synced with Leon yet, nor I have followed any past rdmatool discussion actively for statistics.
> So feel free to ignore my comment.

There were no discussion about it yet :)

>
> Having ethtool style mechanism that allows device related counters is good starting point instead of reinventing a new mechanism.
> Probably a good starting point to follow existing mechanism via 3 similar callbacks get_strings(), get_sset_count(), get_ethtool_stats().
> May be such 3 callbacks for rdamtool from ibdev.

AFAIK, (may be wrong here) the ethtool requires to allocate memory in advance.
It works not bad for small systems, but in large installations with many PF-VF
counters, it starts to be unusable due to out-of-memory failures.

Thanks

> --
> To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
> the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]