From: Leon Romanovsky <leon-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
To: Sagi Grimberg <sagi-NQWnxTmZq1alnMjI0IkVqw@public.gmane.org>
Cc: RDMA mailing list
<linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>,
Doug Ledford <dledford-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>,
Christoph Lameter <cl-vYTEC60ixJUAvxtiuMwx3w@public.gmane.org>,
Jason Gunthorpe
<jgunthorpe-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>,
Liran Liss <liranl-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>,
Dennis Dalessandro
<dennis.dalessandro-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org>,
Ira Weiny <ira.weiny-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org>,
Matan Barak <matanb-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>,
Tzahi Oved <tzahio-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
Subject: Re: CFP: RDMA Microconference - Call for presentations
Date: Mon, 24 Jul 2017 10:00:42 +0300 [thread overview]
Message-ID: <20170724070042.GM3259@mtr-leonro.local> (raw)
In-Reply-To: <ddcc4ea0-1df4-f954-973c-43f8e65b324b-NQWnxTmZq1alnMjI0IkVqw@public.gmane.org>
[-- Attachment #1: Type: text/plain, Size: 2149 bytes --]
On Thu, Jul 20, 2017 at 05:59:02PM +0300, Sagi Grimberg wrote:
> Hey All,
>
> > REMINDER !!!!!!!
>
> I won't be able to attend, but I'd be very happy if a group
> of smart people can discuss some random topics I had in mind:
>
> 1. Adding NUMA hints to *all* rdma resources. Right now
> there is no way to ask the core to allocate a queue-pair on
> a specific numa-node. Some drivers use the device home node
> for memory allocation but application locality will usually be
> much much better (sq/rq/cq spinlock cost *a lot* more if accessed
> across numa nodes for example).
>
> Applications that don't care can simply skip the hint (or pass
> NUMA_NO_NODE) and then drivers can do whatever they want.
>
> In just about any kernel driver, resource setup and IO path run on different
> contexts, so numa locality is pretty much always wrong
> (or right by accident). Its also true for a lot of user-space
> applications.
>
> I also wander what is the least intrusive way to add it.
>
>
> 2. SRQ sizing. No one knows what is a correct SRQ size. This leads
> to magic random numbers for SRQ sizes (often copied) pretty much
> anywhere used (usually crazy deep). Can the drivers hint applications
> what is a "reasonable" size? Can it know? What if I want SRQ per core
> or per numa-node?
>
>
> 3. Adaptive interrupt moderation. In order to effectively use irq-poll
> (or any other napi-like functionality), interrupt moderation is
> important, but its pretty useless if its not adaptive (always too early or
> too late). IMO It would be very useful to have, But before drivers
> can start implementing it, we need a good core framework in place.
> Does anyone think this is useful to have?
>
>
> 4. I wander if there is any interest to have a striding receive queue
> core API? It would be *very* useful to just about any existing kernel
> ULP. Who wouldn't like to reduce the frequency of post receive
> operations.
Thanks Sagi,
The topics look interesting, but it is unclear to me if ULP developers
plan to attend LPC, due to SNIA timing. It is hard to discuss those
hardcore topics without people who will actually use it.
>
>
> Cheers,
> Sagi.
[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]
next prev parent reply other threads:[~2017-07-24 7:00 UTC|newest]
Thread overview: 7+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-06-15 5:03 CFP: RDMA Microconference - Call for presentations Leon Romanovsky
[not found] ` <20170615050305.GF17846-U/DQcQFIOTAAJjI8aNfphQ@public.gmane.org>
2017-07-20 4:07 ` Leon Romanovsky
[not found] ` <20170720040739.GU3259-U/DQcQFIOTAAJjI8aNfphQ@public.gmane.org>
2017-07-20 14:59 ` Sagi Grimberg
[not found] ` <ddcc4ea0-1df4-f954-973c-43f8e65b324b-NQWnxTmZq1alnMjI0IkVqw@public.gmane.org>
2017-07-24 7:00 ` Leon Romanovsky [this message]
2017-07-20 16:02 ` Dennis Dalessandro
[not found] ` <aa1dc549-ce54-d5b7-00e6-0fe07a5f3736-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org>
2017-07-20 17:15 ` Parav Pandit
[not found] ` <VI1PR0502MB3008B5B0E8C0D48FD77C0FEFD1A70-o1MPJYiShExKsLr+rGaxW8DSnupUy6xnnBOFsp37pqbUKgpGm//BTAC/G2K4zDHf@public.gmane.org>
2017-07-24 7:10 ` Leon Romanovsky
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20170724070042.GM3259@mtr-leonro.local \
--to=leon-dgejt+ai2ygdnm+yrofe0a@public.gmane.org \
--cc=cl-vYTEC60ixJUAvxtiuMwx3w@public.gmane.org \
--cc=dennis.dalessandro-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org \
--cc=dledford-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org \
--cc=ira.weiny-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org \
--cc=jgunthorpe-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org \
--cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=liranl-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org \
--cc=matanb-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org \
--cc=sagi-NQWnxTmZq1alnMjI0IkVqw@public.gmane.org \
--cc=tzahio-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox