does i need compat-rdma package

does i need compat-rdma package

[Vasiliy Tolstov]

Hello. I want to develop some software under linux 3.14 and using
infiniband libraries. I'm download latest ofed (3.12 ?) and see that
some packages i don't need (i'm use only mellanox connect x3)
But i can't understand in case of linux 3.14 does i need compat-rdma ?


-- 
Vasiliy Tolstov,
e-mail: v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
jabber: vase-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: does i need compat-rdma package

[Or Gerlitz]

On 12/23/2014 4:47 PM, Vasiliy Tolstov wrote:
> Hello. I want to develop some software under linux 3.14 and using
> infiniband libraries.

You can use the inbox libraries and install them through your distro 
package installer, with RHEL, Fedora and such
it would be just

$ yum groupinstall "infiniband support"

to get you the set of required RPMS [1] SLES and Ubuntu should have 
similar means, no need to use OFED, compat, etc.

Or.

[1] you mentioned ConnectX-3, so your basic needs are libmlx4, 
libibverbs and librdmacm

> I'm download latest ofed (3.12 ?) and see that
> some packages i don't need (i'm use only mellanox connect x3)
> But i can't understand in case of linux 3.14 does i need compat-rdma ?
>
>

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: does i need compat-rdma package

[Hiroyuki Sato]

Hello Vasilly Tolstov

This URL might be help.
http://www.rdmamojo.com

There are RDMA configuration for many OSs. (RHEL, Ubuntu, SLES..)

--
Hiroyuki Sato



2014-12-24 17:19 GMT+09:00 Or Gerlitz <ogerlitz-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>:
> On 12/23/2014 4:47 PM, Vasiliy Tolstov wrote:
>>
>> Hello. I want to develop some software under linux 3.14 and using
>> infiniband libraries.
>
>
> You can use the inbox libraries and install them through your distro package
> installer, with RHEL, Fedora and such
> it would be just
>
> $ yum groupinstall "infiniband support"
>
> to get you the set of required RPMS [1] SLES and Ubuntu should have similar
> means, no need to use OFED, compat, etc.
>
> Or.
>
> [1] you mentioned ConnectX-3, so your basic needs are libmlx4, libibverbs
> and librdmacm
>
>> I'm download latest ofed (3.12 ?) and see that
>> some packages i don't need (i'm use only mellanox connect x3)
>> But i can't understand in case of linux 3.14 does i need compat-rdma ?
>>
>>
>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
> the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html



-- 
Hiroyuki Sato
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: does i need compat-rdma package

[Vasiliy Tolstov]

2014-12-24 12:03 GMT+03:00 Hiroyuki Sato <hiroysato-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>:
> Hello Vasilly Tolstov
>
> This URL might be help.
> http://www.rdmamojo.com
>
> There are RDMA configuration for many OSs. (RHEL, Ubuntu, SLES..)


Thanks, but.. i'm using source based disto that not listed in this site =(

-- 
Vasiliy Tolstov,
e-mail: v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
jabber: vase-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: does i need compat-rdma package

[Bart Van Assche]

[-- Attachment #1: Type: text/plain, Size: 670 bytes --]

On 12/24/14 11:19, Vasiliy Tolstov wrote:
> 2014-12-24 12:03 GMT+03:00 Hiroyuki Sato <hiroysato-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>:
>> Hello Vasilly Tolstov
>>
>> This URL might be help.
>> http://www.rdmamojo.com
>>
>> There are RDMA configuration for many OSs. (RHEL, Ubuntu, SLES..)
> 
> Thanks, but.. i'm using source based disto that not listed in this site =(

Hello Vasiliy,

A possible alternative is to start from a recent upstream kernel and to
build and install the latest RDMA libraries from the upstream git
repositories. I have attached the script I use myself since considerable
time to install the latest RDMA libraries on openSUSE systems.

Bart.

[-- Attachment #2: ofed-rebuild --]
[-- Type: text/plain, Size: 3505 bytes --]

#!/bin/bash

# See also http://www.openfabrics.org/downloads/MAINTAINERS
clone() {
  case "$1" in
    ibacm)
      git clone git://git.openfabrics.org/~shefty/ibacm.git;;
    ibutils)
      git clone git://git.openfabrics.org/~vlad/ibutils.git;;
    infiniband-diags)
      git clone git://git.openfabrics.org/~iraweiny/infiniband-diags.git;;
    libibcm)
      git clone git://git.openfabrics.org/~shefty/libibcm.git;;
    libibmad)
      git clone git://git.openfabrics.org/~iraweiny/libibmad.git;;
    libibumad)
      git clone git://git.openfabrics.org/~halr/libibumad.git;;
    libibverbs)
      git clone git://git.kernel.org/pub/scm/libs/infiniband/libibverbs.git;;
    libmlx4)
      git clone git://git.kernel.org/pub/scm/libs/infiniband/libmlx4.git;;
    librdmacm)
      git clone git://git.openfabrics.org/~shefty/librdmacm.git;;
    mstflint)
      git clone git://git.openfabrics.org/~mohammads/mstflint.git;;
    opensm)
      git clone git://git.openfabrics.org/~halr/opensm;;
    perftest)
      git clone git://git.openfabrics.org/~grockah/perftest.git;;
    srptools)
      git clone git://git.openfabrics.org/~bvanassche/srptools.git;;
    *)
      false;;
  esac
}

build() {
  local rc

  ${scripts_dir}/clean-source-tree &&
  ./autogen.sh &&
  rpm --eval '%configure' | sh &&
  make -s &&
  sudo make -s install
  rc=$?
  ${scripts_dir}/change-owner-to-bart
  return $rc
}

build_lib() {
  local rc

  ${scripts_dir}/clean-source-tree &&
  ./autogen.sh &&
  rpm --eval '%configure' \
    | sed "s|\(\./configure \)|\1 --disable-static $@ |" \
    | sh &&
  make -s &&
  sudo make -s install
  rc=$?
  ${scripts_dir}/change-owner-to-bart
  return $rc
}

build_libibcm() {
  build_lib --with-valgrind
}

build_libibverbs() {
  build_lib --with-valgrind
}

# Depends on libibverbs.
build_libmlx4() {
  build_lib --with-valgrind
}

build_libibumad() {
  build_lib --with-valgrind
}

# Depends on libibumad.
build_libibmad() {
  build_lib
}

build_librdmacm() {
  build_lib --with-valgrind
}

build_ibacm() {
  build_lib
}

build_ibutils() {
  build_lib
}

# Depends on libibumad and libosmcomp.
build_infiniband_diags() {
  build_lib --with-ibpath_override=$prefix/sbin
}

build_mstflint() {
  build
}

build_opensm() {
  build_lib
}

# Depends on librdmacm.
build_perftest() {
  if [ -e autogen.sh ]; then
    build
  else
    ${scripts_dir}/clean-source-tree &&
    make &&
    sudo cp \
      ib_atomic_bw \
      ib_atomic_lat \
      ib_clock_test \
      ib_read_bw \
      ib_read_lat \
      ib_send_bw \
      ib_send_lat \
      ib_write_bw \
      ib_write_bw_postlist \
      ib_write_lat \
      $prefix/bin
  fi
}

build_srptools() {
  build
}

prefix=/usr
scripts_dir="$(dirname $0)"
if [ "${scripts_dir#/}" = "${scripts_dir}" ]; then
  scripts_dir="$PWD/$scripts_dir"
fi

if type -p zypper >/dev/null 2>&1; then
    zypper install -y autoconf automake bison flex gcc gcc-c++ glib2-devel libtool make python-docutils valgrind-devel # graphviz-tcl swig tcl-devel tk-devel
elif type -p apt-get >/dev/null 2>&1; then
    apt-get install -q -y autoconf automake bison flex gcc libglib2.0-dev libtool make python-docutils valgrind # graphviz-tcl swig tcl-dev tk-dev
fi

components="${@:-libibverbs libmlx4 libibumad libibmad opensm infiniband-diags libibcm librdmacm srptools perftest mstflint}" # ibutils
for p in ${components}
do
  (
    echo
    echo ==== $p ====
    echo
    if [ ! -e $p ]; then
      clone $p
    fi
    cd $p &&
    build_${p/-/_}
  ) || exit $?
done

Re: does i need compat-rdma package

[Vasiliy Tolstov]

2014-12-24 15:29 GMT+03:00 Bart Van Assche <bvanassche-HInyCGIudOg@public.gmane.org>:
> Hello Vasiliy,
>
> A possible alternative is to start from a recent upstream kernel and to
> build and install the latest RDMA libraries from the upstream git
> repositories. I have attached the script I use myself since considerable
> time to install the latest RDMA libraries on openSUSE systems.


Nice! Thanks. I'm recheck my build (i'm already build all needed stuff).

-- 
Vasiliy Tolstov,
e-mail: v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
jabber: vase-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: does i need compat-rdma package

[Vasiliy Tolstov]

2014-12-24 11:19 GMT+03:00 Or Gerlitz <ogerlitz-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>:
> You can use the inbox libraries and install them through your distro package
> installer, with RHEL, Fedora and such
> it would be just
>
> $ yum groupinstall "infiniband support"
>
> to get you the set of required RPMS [1] SLES and Ubuntu should have similar
> means, no need to use OFED, compat, etc.
>
> Or.
>
> [1] you mentioned ConnectX-3, so your basic needs are libmlx4, libibverbs
> and librdmacm


Thanks, last question - i'm try to use rsocket and AF_IB in my app,
what minimal kernel version does support this?


-- 
Vasiliy Tolstov,
e-mail: v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
jabber: vase-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: does i need compat-rdma package

[Or Gerlitz]

On 12/24/2014 12:20 PM, Vasiliy Tolstov wrote:
> Thanks, last question - i'm try to use rsocket and AF_IB in my app,
> what minimal kernel version does support this?
AF_IB was merged in 3.11, BTW - can you share what's your motivation to 
use it? as for rsockets, basically any kernel thatsupports the rdma_cm 
along with it's user-space device, this goes a while back... you 
mentioned 3.14, should be OK
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: does i need compat-rdma package

[Vasiliy Tolstov]

2014-12-24 14:38 GMT+03:00 Or Gerlitz <ogerlitz-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>:
> AF_IB was merged in 3.11, BTW - can you share what's your motivation to use
> it? as for rsockets, basically any kernel thatsupports the rdma_cm along
> with it's user-space device, this goes a while back... you mentioned 3.14,
> should be OK


I'm try to modify sheepdog and qemu to allows via name name guid and
establish communication with remote node without IPoIB.
But my knowledge about rdma not very good, and i try to see sources
and write simple app =).


-- 
Vasiliy Tolstov,
e-mail: v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
jabber: vase-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html