* RDMA without rdma_create_event_channel()
@ 2020-02-01 5:00 Dimitrios Dimitropoulos
2020-02-01 8:38 ` Leon Romanovsky
0 siblings, 1 reply; 6+ messages in thread
From: Dimitrios Dimitropoulos @ 2020-02-01 5:00 UTC (permalink / raw)
To: linux-rdma
Hi,
I'm looking to connect an RDMA hardware accelerator to a Centos 8.0
server with RoCE_V2 capability.
Is there a way to implement RDMA RC functionality without invoking the
Connection Manager (skipping the rdma_create_event_channel()) ?
Perhaps with a simple exchange of the necessary information through an
external protocol, say UDP packets ? And then initialize the QPs with
the received parameters.
A bit unsure if this is the appropriate forum for it, let me know if
it's off topic.
Regards,
Dimitris
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: RDMA without rdma_create_event_channel()
2020-02-01 5:00 RDMA without rdma_create_event_channel() Dimitrios Dimitropoulos
@ 2020-02-01 8:38 ` Leon Romanovsky
2020-02-02 0:44 ` Dimitris Dimitropoulos
0 siblings, 1 reply; 6+ messages in thread
From: Leon Romanovsky @ 2020-02-01 8:38 UTC (permalink / raw)
To: Dimitrios Dimitropoulos; +Cc: linux-rdma
On Fri, Jan 31, 2020 at 09:00:24PM -0800, Dimitrios Dimitropoulos wrote:
> Hi,
>
> I'm looking to connect an RDMA hardware accelerator to a Centos 8.0
> server with RoCE_V2 capability.
>
> Is there a way to implement RDMA RC functionality without invoking the
> Connection Manager (skipping the rdma_create_event_channel()) ?
> Perhaps with a simple exchange of the necessary information through an
> external protocol, say UDP packets ? And then initialize the QPs with
> the received parameters.
You can do it without RDMA-CM, see libibverbs//examples/rc_pingpong.c
for exactly that.
Thanks
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: RDMA without rdma_create_event_channel()
2020-02-01 8:38 ` Leon Romanovsky
@ 2020-02-02 0:44 ` Dimitris Dimitropoulos
2020-02-02 8:06 ` Parav Pandit
0 siblings, 1 reply; 6+ messages in thread
From: Dimitris Dimitropoulos @ 2020-02-02 0:44 UTC (permalink / raw)
To: linux-rdma
It seems RDMA RC is completely optional, only the default/standardized
way of exchanging parameters and any custom way will do.
Most helpful, thank you.
Dimitris
On Sat, Feb 1, 2020 at 12:39 AM Leon Romanovsky <leon@kernel.org> wrote:
>
> On Fri, Jan 31, 2020 at 09:00:24PM -0800, Dimitrios Dimitropoulos wrote:
> > Hi,
> >
> > I'm looking to connect an RDMA hardware accelerator to a Centos 8.0
> > server with RoCE_V2 capability.
> >
> > Is there a way to implement RDMA RC functionality without invoking the
> > Connection Manager (skipping the rdma_create_event_channel()) ?
> > Perhaps with a simple exchange of the necessary information through an
> > external protocol, say UDP packets ? And then initialize the QPs with
> > the received parameters.
>
>
> You can do it without RDMA-CM, see libibverbs//examples/rc_pingpong.c
> for exactly that.
>
> Thanks
^ permalink raw reply [flat|nested] 6+ messages in thread
* RE: RDMA without rdma_create_event_channel()
2020-02-02 0:44 ` Dimitris Dimitropoulos
@ 2020-02-02 8:06 ` Parav Pandit
2020-02-02 17:06 ` Dimitrios Dimitropoulos
0 siblings, 1 reply; 6+ messages in thread
From: Parav Pandit @ 2020-02-02 8:06 UTC (permalink / raw)
To: Dimitris Dimitropoulos, linux-rdma@vger.kernel.org
Hi Dimtris,
>
> It seems RDMA RC is completely optional, only the default/standardized way of
> exchanging parameters and any custom way will do.
>
> Most helpful, thank you.
May I ask the limitation that you are facing with rdmacm due to which
(a) you want to avoid it and ready to do extra code for IP to right GID mapping for RoCEv2.
(b) implement new connection management
With that some how you are also ensuring that both packets (connection management via some socket) and rdma_v2 follow the same path in network?
I am curious to know how are you going to ensure this at cluster scale?
If you can please share it, it will be useful to me.
Parav
>
> Dimitris
>
> On Sat, Feb 1, 2020 at 12:39 AM Leon Romanovsky <leon@kernel.org> wrote:
> >
> > On Fri, Jan 31, 2020 at 09:00:24PM -0800, Dimitrios Dimitropoulos wrote:
> > > Hi,
> > >
> > > I'm looking to connect an RDMA hardware accelerator to a Centos 8.0
> > > server with RoCE_V2 capability.
> > >
> > > Is there a way to implement RDMA RC functionality without invoking
> > > the Connection Manager (skipping the rdma_create_event_channel()) ?
> > > Perhaps with a simple exchange of the necessary information through
> > > an external protocol, say UDP packets ? And then initialize the QPs
> > > with the received parameters.
> >
> >
> > You can do it without RDMA-CM, see libibverbs//examples/rc_pingpong.c
> > for exactly that.
> >
> > Thanks
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: RDMA without rdma_create_event_channel()
2020-02-02 8:06 ` Parav Pandit
@ 2020-02-02 17:06 ` Dimitrios Dimitropoulos
2020-02-03 9:32 ` Parav Pandit
0 siblings, 1 reply; 6+ messages in thread
From: Dimitrios Dimitropoulos @ 2020-02-02 17:06 UTC (permalink / raw)
To: Parav Pandit; +Cc: linux-rdma@vger.kernel.org
Hi Parav,
This is not meant to scale. I'm just looking to connect a small number
of devices, some of them are required to have real-time capability.
I can either use a simple custom parameter exchange (eg udp) or add a
processor and a software layer that implements the rdma-cm.
So the 1st just seems more desirable.
Regards,
Dimitris
On Sun, Feb 2, 2020 at 12:06 AM Parav Pandit <parav@mellanox.com> wrote:
>
> Hi Dimtris,
>
> >
> > It seems RDMA RC is completely optional, only the default/standardized way of
> > exchanging parameters and any custom way will do.
> >
> > Most helpful, thank you.
>
> May I ask the limitation that you are facing with rdmacm due to which
> (a) you want to avoid it and ready to do extra code for IP to right GID mapping for RoCEv2.
> (b) implement new connection management
>
> With that some how you are also ensuring that both packets (connection management via some socket) and rdma_v2 follow the same path in network?
> I am curious to know how are you going to ensure this at cluster scale?
> If you can please share it, it will be useful to me.
>
> Parav
>
> >
> > Dimitris
> >
> > On Sat, Feb 1, 2020 at 12:39 AM Leon Romanovsky <leon@kernel.org> wrote:
> > >
> > > On Fri, Jan 31, 2020 at 09:00:24PM -0800, Dimitrios Dimitropoulos wrote:
> > > > Hi,
> > > >
> > > > I'm looking to connect an RDMA hardware accelerator to a Centos 8.0
> > > > server with RoCE_V2 capability.
> > > >
> > > > Is there a way to implement RDMA RC functionality without invoking
> > > > the Connection Manager (skipping the rdma_create_event_channel()) ?
> > > > Perhaps with a simple exchange of the necessary information through
> > > > an external protocol, say UDP packets ? And then initialize the QPs
> > > > with the received parameters.
> > >
> > >
> > > You can do it without RDMA-CM, see libibverbs//examples/rc_pingpong.c
> > > for exactly that.
> > >
> > > Thanks
^ permalink raw reply [flat|nested] 6+ messages in thread
* RE: RDMA without rdma_create_event_channel()
2020-02-02 17:06 ` Dimitrios Dimitropoulos
@ 2020-02-03 9:32 ` Parav Pandit
0 siblings, 0 replies; 6+ messages in thread
From: Parav Pandit @ 2020-02-03 9:32 UTC (permalink / raw)
To: Dimitrios Dimitropoulos; +Cc: linux-rdma@vger.kernel.org
> From: Dimitrios Dimitropoulos <d.dimitropoulos@imatrex.com>
> Sent: Sunday, February 2, 2020 10:36 PM
> To: Parav Pandit <parav@mellanox.com>
> Cc: linux-rdma@vger.kernel.org
> Subject: Re: RDMA without rdma_create_event_channel()
>
> Hi Parav,
>
> This is not meant to scale. I'm just looking to connect a small number of
> devices, some of them are required to have real-time capability.
>
> I can either use a simple custom parameter exchange (eg udp) or add a
> processor and a software layer that implements the rdma-cm.
>
> So the 1st just seems more desirable.
Ok. got it. thanks.
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2020-02-03 9:32 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2020-02-01 5:00 RDMA without rdma_create_event_channel() Dimitrios Dimitropoulos
2020-02-01 8:38 ` Leon Romanovsky
2020-02-02 0:44 ` Dimitris Dimitropoulos
2020-02-02 8:06 ` Parav Pandit
2020-02-02 17:06 ` Dimitrios Dimitropoulos
2020-02-03 9:32 ` Parav Pandit
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.