* [ANNOUNCE] OFED-3.5-rc2 is available
@ 2012-10-03 15:54 Vladimir Sokolovsky
[not found] ` <506C5FBE.1080004-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
0 siblings, 1 reply; 11+ messages in thread
From: Vladimir Sokolovsky @ 2012-10-03 15:54 UTC (permalink / raw)
To: OpenFabrics EWG; +Cc: linux-rdma
[-- Attachment #1: Type: text/plain, Size: 1619 bytes --]
Hi,
OFED 3.5-rc2 is available.
The tarball is available on:
http://www.openfabrics.org/downloads/OFED/ofed-3.5/OFED-3.5-rc2.tgz
To get BUILD_ID run ofed_info
Please report any issues in bugzilla https://bugs.openfabrics.org/ for OFED 3.5
Regards,
Vladimir
OFED-3.5-rc2 Main Changes from OFED 3.5-rc1
-------------------------------------------------------------------------------
compat-rdma: Add SRP backport
compat-rdma: /etc/init.d/openibd: Fix LSB header
compat-rdma: IB/qib: linux-3.6 patches backported
compat-rdma: iw_cxgb4: Fix bug 2369 in OFED bugzilla
compat-rdma: IB/qib: fix compliance regression in 3.5
compat-rdma: RDMA/nes: Added linux-next-pending patches
compat-rdma: RDMA/nes: Updated backports
compat-rdma: NFSRDMA RHEL6.3 backport
compat-rdma: NFSRDMA SLES11SP2 backport
compat-rdma: linux-next-cherry-picks: RDMA/ucma.c: Different fix for ucma context uid=0, causing iWarp RDMA applications to fail in connection establishment
Updated packages:
infinipath-psm-3.0.1-115.1015_open
perftest-1.4.0-0.80.gd1763bd
qperf-0.4.7-0.2.gf3f7001
Supported Platforms and Operating Systems
---------------------------------------------
o CPU architectures:
- x86_64
- x86
- ppc64
- ia64
o Linux Operating Systems:
- RedHat EL6.2 2.6.32-220.el6
- RedHat EL6.3 2.6.32-279.el6
- SLES11 SP2 3.0.13-0.27-default
- kernel.org 3.5 *
* Minimal QA for these versions.
OFED_release_notes.txt
Note: See the release notes of each component for additional issues.
[-- Attachment #2: OFED_release_notes.txt --]
[-- Type: text/plain, Size: 13887 bytes --]
Open Fabrics Enterprise Distribution (OFED)
Version 3.5-rc2
Release Notes
October 2012
===============================================================================
Table of Contents
===============================================================================
1. Overview, which includes:
- OFED Distribution Rev 3.5 Contents
- Supported Platforms and Operating Systems
- Supported HCA and RNIC Adapter Cards and Firmware Versions
- Tested Switch Platforms
- Third party Test Packages
- OFED sources
2. Change log
3. Known Issues
===============================================================================
1. Overview
===============================================================================
These are the release notes of OpenFabrics Enterprise Distribution (OFED)
release 3.5. The OFED software package is composed of several software modules,
and is intended for use on a computer cluster constructed as an InfiniBand
subnet or iWARP network.
Note: If you plan to upgrade the OFED package on your cluster, please upgrade
all of its nodes to this new version.
1.1 OFED 3.5 Contents
-----------------------
The OFED package contains the following components:
- OpenFabrics core and ULPs:
- IB HCA drivers (mthca, mlx4, qib, ehca)
- iWARP RNIC driver (cxgb3, cxgb4, nes)
- core
- Upper Layer Protocols: IPoIB, SRP Initiator and target, iSER
Initiator and target, RDS, uDAPL, qlgc_vnic and NFS-RDMA*.
- OpenFabrics utilities:
- OpenSM (OSM): InfiniBand Subnet Manager
- Diagnostic tools
- Performance tests
- Extra packages:
- infinipath-psm: Performance-Scaled Messaging API, an accelerated
interface to QLogic HCAs
- Sources of all software modules (under conditions mentioned in the modules'
LICENSE files)
- Documentation
1.2 Supported Platforms and Operating Systems
---------------------------------------------
o CPU architectures:
- x86_64
- x86
- ppc64
- ia64
o Linux Operating Systems:
- RedHat EL6.2 2.6.32-220.el6
- RedHat EL6.3 2.6.32-279.el6
- SLES11 SP2 3.0.13-0.27-default
- kernel.org 3.5 *
* Minimal QA for these versions.
1.3 HCAs and RNICs Supported
----------------------------
This release supports IB HCAs by Mellanox Technologies, Qlogic and IBM as
well as iWARP RNICs by Chelsio Communications and Intel.
o Mellanox Technologies HCAs (SDR, DDR and QDR Modes are Supported):
- ConnectX(R) and ConnectX EN (fw-25408 Rev 2.9.1000)
- ConnectX-2 (fw-ConnectX2 Rev 2.9.1000)
- ConnectX-2 EN (fw-ConnectX2 Rev 2.9.1200)
- ConnectX-3 (fw-ConnectX3 Rev 2.10.0700) (FDR and FDR10 Modes are Supported)
- ConnectX-3 EN (fw-ConnectX3 Rev 2.10.0800)
For official firmware versions please see:
http://www.mellanox.com/content/pages.php?pg=firmware_download
o Qlogic HCAs:
- QLogic TrueScale DDR PCIe x8 and x16 HCAs
- QLogic TrueScale QDR PCIe x8 Gen2 HCAs
o IBM HCAs:
- GX Dual-port SDR 4x IB HCA
- GX Dual-port SDR 12x IB HCA
- GX Dual-port DDR 4x IB HCA
- GX Dual-port DDR 12x IB HCA
o Chelsio RNICs:
- S310/S320 10GbE Storage Accelerators
- R310/R320 10GbE iWARP Adapters
o Intel RNICs:
- NE020 10Gb iWARP Adapter
1.4 Switches Supported
----------------------
This release was tested with switches and gateways provided by the following
companies:
- Qlogic
- Flextronics
- Oracle (Sun)
- Mellanox
1.5 Third Party Packages
------------------------
The following third party packages have been tested with OFED 3.2:
- MVAPICH2 - 1.8
- Intel MPI - 4.0.3
- Open MPI - 1.6/1.6.1
1.6 OFED Sources
----------------
All sources are located under git://git.openfabrics.org/
Linux:
------
URL: git://git.openfabrics.org/compat-rdma/linux-3.5.git
Branch: for-ofed-3.5
- Linux kernel subtree that includes files relevant for the OFED project only.
Based on v3.5. Used to shorten git clone time.
Note: the regular Linux git tree can be used as well.
compat:
-------
URL: git://git.openfabrics.org/compat-rdma/compat.git
Branch: ofed
- Based on compat project (https://github.com/mcgrof/compat). The compat module
provides functionality introduced in newer kernels to older kernels through a
set of header files and exported symbols.
See https://github.com/mcgrof/compat/wiki for details.
- Used to replace kernel_addons in the previous OFED kernel tree.
compat-rdma:
------------
URL: git://git.openfabrics.org/compat-rdma/compat-rdma.git
Branch: master
User level Sources are downloaded from http://www.openfabrics.org/downloads/
as written in the BUILD_ID
The kernel sources are based on Linux 3.5 mainline kernel. Its patches
are included in the OFED sources directory.
For details see HOWTO.build_ofed.
The list of maintainers is available under:
http://www.openfabrics.org/downloads/MAINTAINERS
===============================================================================
2. Change log
===============================================================================
OFED-3.5-rc2 Main Changes from OFED 3.5-rc1
-------------------------------------------------------------------------------
compat-rdma: Add SRP backport
compat-rdma: /etc/init.d/openibd: Fix LSB header
compat-rdma: IB/qib: linux-3.6 patches backported
compat-rdma: iw_cxgb4: Fix bug 2369 in OFED bugzilla
compat-rdma: IB/qib: fix compliance regression in 3.5
compat-rdma: RDMA/nes: Add linux-next-pending patches
compat-rdma: RDMA/nes: Updated backports
compat-rdma: NFSRDMA RHEL6.3 backport
compat-rdma: NFSRDMA SLES11SP2 backport
compat-rdma: linux-next-cherry-picks: RDMA/ucma.c: Different fix for ucma context uid=0, causing iWarp RDMA applications to fail in connection establishment
Updated packages:
infinipath-psm-3.0.1-115.1015_open
perftest-1.4.0-0.80.gd1763bd
qperf-0.4.7-0.2.gf3f7001
OFED-3.5-rc1 Main Changes from OFED 3.2-rc1
-------------------------------------------------------------------------------
1. Based on linux-3.5 kernel
2. Updated packages:
ibacm-1.0.7
librdmacm-1.0.16
dapl-2.0.36
Management:
libibumad-1.3.8
infiniband-diags-1.6.1
opensm-3.3.15
3. Removed libsdp, sdpnetstat
OFED-3.5-rc1 Main Changes from OFED 1.5.4.1
-------------------------------------------------------------------------------
1. Based on linux-3.2 kernel
2. kernel-ib RPM renamed to compat-rdma
3. Removed MPI packages
4. Updated packages:
libibverbs-1.1.6
libmlx4-1.0.4
dapl-2.0.35
ibacm-1.0.6
perftest-1.4.0-0.66.g9074687
Management:
libibmad-1.3.9
opensm-3.3.14
infiniband-diags-1.6.0
OFED-1.5.4 Main Changes from OFED 1.5.3.2
-------------------------------------------------------------------------------
1. Add kernel 3.0 support
2. Add RHEL6.2 support
3. Add NFSRDMA to the list of packages to be installed by default on supported
platforms
4. Add new InfiniBand link speeds: EDR/FDR/FDR10
5. OFA Kernel: See ofa_kernel.changelog.txt
6. Updated packages:
libibverbs-1.1.4-1.24.gb89d4d7
libmlx4-1.0.1-1.20.g6771d22
libnes-1.1.3
libcxgb3-1.3.1
libcxgb4-1.2.0
dapl-2.0.34
ibacm-1.0.5
librdmacm-1.0.15
infinipath-psm-2.9-926.1005_open
ibutils-1.5.7-0.1.g05a9d1a
perftest-1.3.0-0.56.gd6f6093
mstflint-1.4-1.18.g1adcfbf
Management:
libibmad-1.3.8
infiniband-diags-1.5.12
opensm-3.3.12
MPI:
mvapich2-1.7-5.2011svn5031
OFED-1.5.3.2 Main Changes from OFED 1.5.3.1
-------------------------------------------------------------------------------
1. Add RHEL5.7 support
2. Add RHEL6.1 support
3. Add kernel.org 2.6.37 - 2.6.39 support
4. ib-bonding-0.9.0-43 (SLES10 SP4 support)
OFED-1.5.3.1 Main Changes from OFED 1.5.3
-------------------------------------------------------------------------------
1. Fix QIB support on SLES10 SP3
OFED-1.5.3 Main Changes from OFED 1.5.2
-------------------------------------------------------------------------------
1. Updated packages:
dapl-2.0.32
librdmacm-1.0.14.1
ibacm-1.0.4
libibmad-1.3.7
libibumad-1.3.7
infiniband-diags-1.5.8
opensm-3.3.9
ibutils-1.5.7
libibverbs-1.1.4-1.22.g7257cd3.tar.gz
libmlx4-1.0.1-1.18.gb810a27.tar.gz
libnes-1.1.1
infinipath-psm-1.14
libsdp-1.1.108-0.15.gd7fdb72
mstflint-1.4-0.9.gc683022
sdpnetstat-1.60-0.3.gb6e7425
perftest-1.3.0-0.42.gf350d3d
- MPI
openmpi-1.4.3-1
mvapich2-1.6-2
2. Added RHEL6 support
3. Added RHEL5.6 support
4. Improved RAW Ethernet QP support (requires ConnectX/ConnectX2 FW >= 2.8.0600)
5. NFSoRDMA was removed from the list of packages in the install script to
prevent its installation by default.
To force NFSoRDMA installation, add the following lines to the ofed.conf:
nfsrdma=y
rnfs-utils=y
To get ofed.conf, run
# ./install.pl -p
After adding the lines above to ofed.conf, to install OFED run
# ./install.pl -c ofed.conf
OFED-1.5.2 Main Changes from OFED 1.5.1
-------------------------------------------------------------------------------
1. Added RHEL5.5, SLES11 SP1 and kernel 2.6.33 support
2. /etc/modprobe.conf deprecated
ib_ipoib use /etc/modprobe.d/ib_ipoib.conf
ib_sdp use /etc/modprobe.d/ib_sdp.conf
mlx4_en use /etc/modprobe.d/mlx4_en.conf
3. Added RAW Ethernet QP support in libibverbs
4. Added multicast support in perftest
5. Added new package: ibacm. See ibacm_release_notes.txt
6. Added new package infinipath-psm.
7. Updated packages:
libibverbs to rev 1.1.4-0.14.gb6c138b
libehca to rev 1.2.2-0.1.g69e1a88
libmlx4 to rev 1.0-0.13.g4e5c43f
libnes to rev 1.1.0
librdmacm to rev 1.0.13
dapl to rev 2.0.30
compat-depl to rev 1.2.19
libsdp to rev 1.1.103
mstflint to rev 1.4-0.6.g63179f4
perftest to rev 1.3.0-0.27
rds-tools to rev 2.0.4
Management:
opensm to rev 3.3.7
libibmad to rev 1.3.6
libibumad to rev 1.3.6
infiniband-diags to rev 1.5.7
MPI:
openmpi to rev 1.4.2-1
mvapich2 to rev 1.5.1-2.p1
mpitests to rev 3.2-923
OFED-1.5.1 Main Changes from OFED 1.5
-------------------------------------------------------------------------------
1. Added RoCEE support - see RoCEE_README.txt
2. Added enhanced atomic operations to ConnectX (kernel only).
See mlx4_release_notes.txt.
3. Updated Open MPI to rev 1.4.1-2ofed
4. Updated MVAPICH2 to rev 1.4.1
5. Updated DAPL to rev 2.0.27
6. Updated libnes to rev 1.0.1
7. Updated librdmacm to rev 1.0.11
8. Removed tvflash RPM
9. NFS-RDMA is not supported on SLES10 SP3
10. Fixed IPv6 support and IPv4 routing corner cases for RDMA CM
11. Bug fixes
OFED-1.5 Main Changes from OFED 1.4.2
-------------------------------------------------------------------------------
Note: For details regarding the various changes, please see the release notes
for each package in the docs directory.
2.1 General changes
o Kernel code based on 2.6.30
o libraries location - all userspace libraries can be downloaded from
http://www.openfabrics.org/downloads/
See BUILD_ID for exact locations
o Qlogic moved the low level driver from ipath to qib.
2.2 SDP
o Performance improvements
o Zero copy in beta level
2.3 uDAPL
o New UCM provider (ofa-v2-mlx4_0-1u) with IB UD-based CM per process.
It is more scalable than rdma_cm (cma) or socket cm (scm).
o Common code base with WinOF 2.1
o Bug fixes
2.4 perftest
o Renamed tests:
ib_rdma_bw -> rdma_bw
ib_rdma_lat -> rdma_lat
2.5 Management
o OpenSM
- Support for Mesh Analysis for LASH routing algorithm
- Reloadable OpenSM configuration (preliminary implementation)
- Routing paths sorted balancing (for UpDown and MinHops)
- Weighted LID matrices calculation (for UpDown, MinHop and DOR)
- I/O nodes connectivity (for FatTree)
2.6 MPI:
a. OSU MVAPICH 1.2.0
b. Open MPI 1.4
c. OSU MVAPICH2 1.4
d. MPI tests 3.2
2.7 iSER:
o Available on:
- kernel.org: 2.6.30 and higher
- RHEL5.4
2.8 NFS-RDMA
o Added support for RHEL5.4, SLES10 SP3, kernel.org 2.6.25 and 2.6.30.
Kernels 2.6.26 and 2.6.27 are not supported
o NFS-RDMA is in Beta level
===============================================================================
3. Known Issues
===============================================================================
The following is a list of general limitations and known issues of the various
components of the OFED 3.5-rc2 release.
1. When upgrading from an earlier OFED version, the installation script does
not stop the earlier OFED version prior to uninstalling it.
Workaround: Stop the old OFED stack (/etc/init.d/openibd stop) before
upgrading to OFED 3.5 or reboot the server after OFED installation.
2. Memory registration by the user is limited according to administrator
setting. See "Pinning (Locking) User Memory Pages" in OFED_tips.txt for
system configuration.
3. Fork support from kernel 2.6.12 and above is available provided
that applications do not use threads. fork() is supported as long as the
parent process does not run before the child exits or calls exec().
The former can be achieved by calling wait(childpid), and the latter can be
achieved by application specific means. The Posix system() call is
supported.
4. The qib driver is supported only on 64-bit platforms.
5. IPoIB: brctl utilities do not work on IPoIB interfaces. The reason for that
is that these utilities support devices of type Ethernet only.
6. In case uninstall is failing, check the error log and remove
the remaining RPMs manually using 'rpm -e <rpms list>'.
7. On SLES11.x, set allow_unsupported_modules parameter to 1 in file:
/etc/modprobe.d/unsupported-modules. Without this the modules will not
load.
Note: See the release notes of each component for additional issues.
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [ANNOUNCE] OFED-3.5-rc2 is available
[not found] ` <506C5FBE.1080004-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
@ 2012-10-03 16:13 ` Jeff Becker
2012-10-03 20:30 ` Woodruff, Robert J
` (2 subsequent siblings)
3 siblings, 0 replies; 11+ messages in thread
From: Jeff Becker @ 2012-10-03 16:13 UTC (permalink / raw)
To: Vladimir Sokolovsky; +Cc: linux-rdma, OpenFabrics EWG
Hi Vlad. Happy New Year (belated) ! One additional note below...
On 10/03/2012 08:54 AM, Vladimir Sokolovsky wrote:
> Hi,
> OFED 3.5-rc2 is available.
>
> The tarball is available on:
> http://www.openfabrics.org/downloads/OFED/ofed-3.5/OFED-3.5-rc2.tgz
>
> To get BUILD_ID run ofed_info
>
> Please report any issues in bugzilla https://bugs.openfabrics.org/ for OFED 3.5
>
> Regards,
> Vladimir
>
>
> OFED-3.5-rc2 Main Changes from OFED 3.5-rc1
> -------------------------------------------------------------------------------
> compat-rdma: Add SRP backport
> compat-rdma: /etc/init.d/openibd: Fix LSB header
> compat-rdma: IB/qib: linux-3.6 patches backported
> compat-rdma: iw_cxgb4: Fix bug 2369 in OFED bugzilla
> compat-rdma: IB/qib: fix compliance regression in 3.5
> compat-rdma: RDMA/nes: Added linux-next-pending patches
> compat-rdma: RDMA/nes: Updated backports
> compat-rdma: NFSRDMA RHEL6.3 backport
> compat-rdma: NFSRDMA SLES11SP2 backport
> compat-rdma: linux-next-cherry-picks: RDMA/ucma.c: Different fix for ucma context uid=0, causing iWarp RDMA applications to fail in connection establishment
Although it didn't require additional patches, I have verified that
NFSRDMA is also supported on RHEL6.2. Thanks.
-jeff
>
> Updated packages:
> infinipath-psm-3.0.1-115.1015_open
> perftest-1.4.0-0.80.gd1763bd
> qperf-0.4.7-0.2.gf3f7001
>
> Supported Platforms and Operating Systems
> ---------------------------------------------
> o CPU architectures:
> - x86_64
> - x86
> - ppc64
> - ia64
>
> o Linux Operating Systems:
> - RedHat EL6.2 2.6.32-220.el6
> - RedHat EL6.3 2.6.32-279.el6
> - SLES11 SP2 3.0.13-0.27-default
> - kernel.org 3.5 *
>
> * Minimal QA for these versions.
>
>
> OFED_release_notes.txt
>
> Note: See the release notes of each component for additional issues.
>
^ permalink raw reply [flat|nested] 11+ messages in thread
* RE: [ANNOUNCE] OFED-3.5-rc2 is available
[not found] ` <506C5FBE.1080004-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2012-10-03 16:13 ` Jeff Becker
@ 2012-10-03 20:30 ` Woodruff, Robert J
2012-10-04 10:05 ` Sebastian Riemer
2012-12-11 9:02 ` [ANNOUNCE] OFED-3.5-rc3 " Vladimir Sokolovsky
3 siblings, 0 replies; 11+ messages in thread
From: Woodruff, Robert J @ 2012-10-03 20:30 UTC (permalink / raw)
To: Vladimir Sokolovsky, OpenFabrics EWG; +Cc: linux-rdma
I seem to be getting this compile error on sles 11 sp 2.
/var/tmp/OFED_topdir/BUILD/compat-rdma-3.5/drivers/infiniband/ulp/srp/ib_srp.c:33:1: warning: "pr_fmt" redefined
In file included from /var/tmp/OFED_topdir/BUILD/compat-rdma-3.5/include/linux/printk.h:7,
from /usr/src/linux-3.0.13-0.27/include/linux/kernel.h:20,
from /usr/src/linux-3.0.13-0.27/include/linux/skbuff.h:17,
from /usr/src/linux-3.0.13-0.27/include/linux/if_ether.h:127,
from /usr/src/linux-3.0.13-0.27/include/linux/netdevice.h:29,
from /var/tmp/OFED_topdir/BUILD/compat-rdma-3.5/include/linux/compat-2.6.29.h:5,
from /var/tmp/OFED_topdir/BUILD/compat-rdma-3.5/include/linux/compat-2.6.h:48,
from <command-line>:0:
/usr/src/linux-3.0.13-0.27/include/linux/printk.h:152:1: warning: this is the location of the previous definition
/var/tmp/OFED_topdir/BUILD/compat-rdma-3.5/drivers/infiniband/ulp/srp/ib_srp.c:70:2: warning: "RHEL_MAJOR" is not defined
/var/tmp/OFED_topdir/BUILD/compat-rdma-3.5/drivers/infiniband/ulp/srp/ib_srp.c:71: error: redefinition of ?struct srp_cred_req?
/var/tmp/OFED_topdir/BUILD/compat-rdma-3.5/drivers/infiniband/ulp/srp/ib_srp.c:79: error: redefinition of ?struct srp_cred_rsp?
/var/tmp/OFED_topdir/BUILD/compat-rdma-3.5/drivers/infiniband/ulp/srp/ib_srp.c:90: error: redefinition of ?struct srp_aer_req?
/var/tmp/OFED_topdir/BUILD/compat-rdma-3.5/drivers/infiniband/ulp/srp/ib_srp.c:103: error: redefinition of ?struct srp_aer_rsp?
make[6]: *** [/var/tmp/OFED_topdir/BUILD/compat-rdma-3.5/drivers/infiniband/ulp/srp/ib_srp.o] Error 1
make[5]: *** [/var/tmp/OFED_topdir/BUILD/compat-rdma-3.5/drivers/infiniband/ulp/srp] Error 2
@
-----Original Message-----
From: linux-rdma-owner-u79uwXL29TY76Z2rM5mHXA@public.gmane.org [mailto:linux-rdma-owner-u79uwXL29TY76Z2rM5mHXA@public.gmane.org] On Behalf Of Vladimir Sokolovsky
Sent: Wednesday, October 03, 2012 8:55 AM
To: OpenFabrics EWG
Cc: linux-rdma
Subject: [ANNOUNCE] OFED-3.5-rc2 is available
Hi,
OFED 3.5-rc2 is available.
The tarball is available on:
http://www.openfabrics.org/downloads/OFED/ofed-3.5/OFED-3.5-rc2.tgz
To get BUILD_ID run ofed_info
Please report any issues in bugzilla https://bugs.openfabrics.org/ for OFED 3.5
Regards,
Vladimir
OFED-3.5-rc2 Main Changes from OFED 3.5-rc1
-------------------------------------------------------------------------------
compat-rdma: Add SRP backport
compat-rdma: /etc/init.d/openibd: Fix LSB header
compat-rdma: IB/qib: linux-3.6 patches backported
compat-rdma: iw_cxgb4: Fix bug 2369 in OFED bugzilla
compat-rdma: IB/qib: fix compliance regression in 3.5
compat-rdma: RDMA/nes: Added linux-next-pending patches
compat-rdma: RDMA/nes: Updated backports
compat-rdma: NFSRDMA RHEL6.3 backport
compat-rdma: NFSRDMA SLES11SP2 backport
compat-rdma: linux-next-cherry-picks: RDMA/ucma.c: Different fix for ucma context uid=0, causing iWarp RDMA applications to fail in connection establishment
Updated packages:
infinipath-psm-3.0.1-115.1015_open
perftest-1.4.0-0.80.gd1763bd
qperf-0.4.7-0.2.gf3f7001
Supported Platforms and Operating Systems
---------------------------------------------
o CPU architectures:
- x86_64
- x86
- ppc64
- ia64
o Linux Operating Systems:
- RedHat EL6.2 2.6.32-220.el6
- RedHat EL6.3 2.6.32-279.el6
- SLES11 SP2 3.0.13-0.27-default
- kernel.org 3.5 *
* Minimal QA for these versions.
OFED_release_notes.txt
Note: See the release notes of each component for additional issues.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [ANNOUNCE] OFED-3.5-rc2 is available
[not found] ` <506C5FBE.1080004-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2012-10-03 16:13 ` Jeff Becker
2012-10-03 20:30 ` Woodruff, Robert J
@ 2012-10-04 10:05 ` Sebastian Riemer
[not found] ` <506D5F5D.9050308-EIkl63zCoXaH+58JC4qpiA@public.gmane.org>
2012-12-11 9:02 ` [ANNOUNCE] OFED-3.5-rc3 " Vladimir Sokolovsky
3 siblings, 1 reply; 11+ messages in thread
From: Sebastian Riemer @ 2012-10-04 10:05 UTC (permalink / raw)
To: Vladimir Sokolovsky; +Cc: OpenFabrics EWG, linux-rdma
Hi Vladimir,
why do you put OFED together for a kernel nobody uses? Perhaps SLES and
Red Hat do it like this but nobody else.
Have a look at http://en.wikipedia.org/wiki/Linux_kernel - 3.0, 3.2 and
3.4 are the long-term stable releases.
This approach is worse than the approach before IMHO. Since 1.5.4.1
there is no real stable release. No wonder that everyone puts his own
OFED together.
I'm so glad that we don't need too much OFED user space and we just use
the IB stuff from the mainline kernel. We need to surf close to mainline
kernel development anyway.
The only thing that we would need is a list which packet with which
version matches our mainline kernel. Updating it from Git directly from
a tag or branch with no external patches or SRPM/tar.gz stuff would make
it much easier - also for other distributions. Things are getting better
for us with the switch-over to Gentoo. There, we can leave out the
packages that we don't actually need.
Cheers,
Sebastian
On 03.10.2012 17:54, Vladimir Sokolovsky wrote:
> Hi,
> OFED 3.5-rc2 is available.
>
> The tarball is available on:
> http://www.openfabrics.org/downloads/OFED/ofed-3.5/OFED-3.5-rc2.tgz
>
> To get BUILD_ID run ofed_info
>
> Please report any issues in bugzilla https://bugs.openfabrics.org/ for
> OFED 3.5
>
> Regards,
> Vladimir
>
>
> OFED-3.5-rc2 Main Changes from OFED 3.5-rc1
> -------------------------------------------------------------------------------
>
> compat-rdma: Add SRP backport
> compat-rdma: /etc/init.d/openibd: Fix LSB header
> compat-rdma: IB/qib: linux-3.6 patches backported
> compat-rdma: iw_cxgb4: Fix bug 2369 in OFED bugzilla
> compat-rdma: IB/qib: fix compliance regression in 3.5
> compat-rdma: RDMA/nes: Added linux-next-pending patches
> compat-rdma: RDMA/nes: Updated backports
> compat-rdma: NFSRDMA RHEL6.3 backport
> compat-rdma: NFSRDMA SLES11SP2 backport
> compat-rdma: linux-next-cherry-picks: RDMA/ucma.c: Different fix for
> ucma context uid=0, causing iWarp RDMA applications to fail in
> connection establishment
>
> Updated packages:
> infinipath-psm-3.0.1-115.1015_open
> perftest-1.4.0-0.80.gd1763bd
> qperf-0.4.7-0.2.gf3f7001
>
> Supported Platforms and Operating Systems
> ---------------------------------------------
> o CPU architectures:
> - x86_64
> - x86
> - ppc64
> - ia64
>
> o Linux Operating Systems:
> - RedHat EL6.2 2.6.32-220.el6
> - RedHat EL6.3 2.6.32-279.el6
> - SLES11 SP2 3.0.13-0.27-default
> - kernel.org 3.5 *
>
> * Minimal QA for these versions.
>
>
> OFED_release_notes.txt
>
> Note: See the release notes of each component for additional issues.
>
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [ANNOUNCE] OFED-3.5-rc2 is available
[not found] ` <506D5F5D.9050308-EIkl63zCoXaH+58JC4qpiA@public.gmane.org>
@ 2012-10-04 15:49 ` Vladimir Sokolovsky
0 siblings, 0 replies; 11+ messages in thread
From: Vladimir Sokolovsky @ 2012-10-04 15:49 UTC (permalink / raw)
To: Sebastian Riemer; +Cc: OpenFabrics EWG, linux-rdma
On 10/04/2012 12:05 PM, Sebastian Riemer wrote:
> Hi Vladimir,
>
> why do you put OFED together for a kernel nobody uses? Perhaps SLES and
> Red Hat do it like this but nobody else.
>
Hi Sebastian,
The point of OFED-3.5 was to provide an infrastructure to make the latest
upstream RDMA features be available and tested on Distros.
By the time the work started the latest upstream kernel version
was 3.5-rc3 and, therefore, we started with this kernel.
The plan is to create such OFED for every kernel version, or, maybe skip odd versions as you suggest.
Due to limited resources we did not start to work on 3.6 yet, but once OFED-3.5 will have stable infrastructure it will be easier to build OFED-3.6...
> Have a look at http://en.wikipedia.org/wiki/Linux_kernel - 3.0, 3.2 and
> 3.4 are the long-term stable releases.
>
> This approach is worse than the approach before IMHO. Since 1.5.4.1
> there is no real stable release. No wonder that everyone puts his own
> OFED together.
This approach should increase motivation to push new features/fixes upstream which will lead to more stable drivers in all Distros (in-box).
> I'm so glad that we don't need too much OFED user space and we just use
> the IB stuff from the mainline kernel. We need to surf close to mainline
> kernel development anyway.
>
> The only thing that we would need is a list which packet with which
> version matches our mainline kernel. Updating it from Git directly from
> a tag or branch with no external patches or SRPM/tar.gz stuff would make
> it much easier - also for other distributions. Things are getting better
> for us with the switch-over to Gentoo. There, we can leave out the
> packages that we don't actually need.
>
For the list of packages and maintainers please refer to http://www.openfabrics.org/downloads/MAINTAINERS
Regards,
Vladimir
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 11+ messages in thread
* [ANNOUNCE] OFED-3.5-rc3 is available
[not found] ` <506C5FBE.1080004-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
` (2 preceding siblings ...)
2012-10-04 10:05 ` Sebastian Riemer
@ 2012-12-11 9:02 ` Vladimir Sokolovsky
[not found] ` <50C6F6BC.6090701-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
3 siblings, 1 reply; 11+ messages in thread
From: Vladimir Sokolovsky @ 2012-12-11 9:02 UTC (permalink / raw)
To: OpenFabrics EWG, linux-rdma
[-- Attachment #1: Type: text/plain, Size: 1856 bytes --]
Hi,
OFED 3.5-rc3 is available.
The tarball is available on:
http://www.openfabrics.org/downloads/OFED/ofed-3.5/OFED-3.5-rc3.tgz
To get BUILD_ID run ofed_info
Please report any issues in bugzilla https://bugs.openfabrics.org/ for OFED 3.5
OFED-3.5-rc3 Main Changes from OFED 3.5-rc2
-------------------------------------------------------------------------------
RDMA/nes: Fix for terminate timer crash
RDMA/nes: Fix for crash when adding timer and timer is pending
RDMA/nes: Fix for incorrect multicast address
RDMA/nes: Fix for crash when adding timer
RDMA/nes: Locking fix to prevent race conditions
RDMA/nes: Changing nes driver version
RDMA/nes: Fixes for PAU handling
cxgb4: Initialize data structures before using.
cxgb4: Fix initialization of SGE_CONTROL register
cxgb4: Add embedded firmware and its configuration file support
cxgb4/iw_cxgb4: Add LE hash collision bug fix for active and passive offloaded connections
cxgb4: Fix unable to get UP event from the LLD
cxgb4: Remove unnecessary #ifdef condition
cxgb4: Fix build warnings introduced after T4 configuration file support
cxgb4: Add support for T4 configuration file
iw_cxgb4: only log rx_data warnings if cpl status is non zero.
RDMA/cxgb4: fix mpa version mismatch
RDMA/cxgb4: abort connections that receive unexpected streaming mode data
RDMA/cxgb4: Insert hwtid in pass_accept_req instead in pass_establish
RDMA/cxgb4: Remove the limitation on maximum number of STAGs
linux-next-cherry-picks: Fix build failure for kernel < 3.2
IB/qib: remove EBUSY patch
ib_srp: Avoid that module removal can trigger a deadlock
ib_srp: Unbreak build on SLES 11 SP2
ib_srp: Add post-3.5 upstream patches
ib_srp: Avoid use-after-free during module unload on pre-2.6.36 kernels
Updated packages:
mstflint-1.4-1.23.g5c2032a
perftest-2.0-0.8.gaeb562e
qperf-0.4.9
Regards,
Vladimir
[-- Attachment #2: OFED_release_notes.txt --]
[-- Type: text/plain, Size: 15477 bytes --]
Open Fabrics Enterprise Distribution (OFED)
Version 3.5-rc3
Release Notes
December 2012
===============================================================================
Table of Contents
===============================================================================
1. Overview, which includes:
- OFED Distribution Rev 3.5 Contents
- Supported Platforms and Operating Systems
- Supported HCA and RNIC Adapter Cards and Firmware Versions
- Tested Switch Platforms
- Third party Test Packages
- OFED sources
2. Change log
3. Known Issues
===============================================================================
1. Overview
===============================================================================
These are the release notes of OpenFabrics Enterprise Distribution (OFED)
release 3.5. The OFED software package is composed of several software modules,
and is intended for use on a computer cluster constructed as an InfiniBand
subnet or iWARP network.
Note: If you plan to upgrade the OFED package on your cluster, please upgrade
all of its nodes to this new version.
1.1 OFED 3.5 Contents
-----------------------
The OFED package contains the following components:
- OpenFabrics core and ULPs:
- IB HCA drivers (mthca, mlx4, qib, ehca)
- iWARP RNIC driver (cxgb3, cxgb4, nes)
- core
- Upper Layer Protocols: IPoIB, SRP Initiator and target, iSER
Initiator and target, RDS, uDAPL, qlgc_vnic and NFS-RDMA*.
- OpenFabrics utilities:
- OpenSM (OSM): InfiniBand Subnet Manager
- Diagnostic tools
- Performance tests
- Extra packages:
- infinipath-psm: Performance-Scaled Messaging API, an accelerated
interface to QLogic HCAs
- Sources of all software modules (under conditions mentioned in the modules'
LICENSE files)
- Documentation
1.2 Supported Platforms and Operating Systems
---------------------------------------------
o CPU architectures:
- x86_64
- x86
- ppc64
- ia64
o Linux Operating Systems:
- RedHat EL6.2 2.6.32-220.el6
- RedHat EL6.3 2.6.32-279.el6
- SLES11 SP2 3.0.13-0.27-default
- kernel.org 3.5 *
* Minimal QA for these versions.
1.3 HCAs and RNICs Supported
----------------------------
This release supports IB HCAs by Mellanox Technologies, Qlogic and IBM as
well as iWARP RNICs by Chelsio Communications and Intel.
o Mellanox Technologies HCAs (SDR, DDR and QDR Modes are Supported):
- ConnectX(R) and ConnectX EN (fw-25408 Rev 2.9.1000)
- ConnectX-2 (fw-ConnectX2 Rev 2.9.1000)
- ConnectX-2 EN (fw-ConnectX2 Rev 2.9.1200)
- ConnectX-3 (fw-ConnectX3 Rev 2.10.0700) (FDR and FDR10 Modes are Supported)
- ConnectX-3 EN (fw-ConnectX3 Rev 2.10.0800)
For official firmware versions please see:
http://www.mellanox.com/content/pages.php?pg=firmware_download
o Qlogic HCAs:
- QLogic TrueScale DDR PCIe x8 and x16 HCAs
- QLogic TrueScale QDR PCIe x8 Gen2 HCAs
o IBM HCAs:
- GX Dual-port SDR 4x IB HCA
- GX Dual-port SDR 12x IB HCA
- GX Dual-port DDR 4x IB HCA
- GX Dual-port DDR 12x IB HCA
o Chelsio RNICs:
- S310/S320 10GbE Storage Accelerators
- R310/R320 10GbE iWARP Adapters
o Intel RNICs:
- NE020 10Gb iWARP Adapter
1.4 Switches Supported
----------------------
This release was tested with switches and gateways provided by the following
companies:
- Qlogic
- Flextronics
- Oracle (Sun)
- Mellanox
1.5 Third Party Packages
------------------------
The following third party packages have been tested with OFED 3.2:
- MVAPICH2 - 1.8
- Intel MPI - 4.0.3
- Open MPI - 1.6/1.6.1
1.6 OFED Sources
----------------
All sources are located under git://git.openfabrics.org/
Linux:
------
URL: git://git.openfabrics.org/compat-rdma/linux-3.5.git
Branch: for-ofed-3.5
- Linux kernel subtree that includes files relevant for the OFED project only.
Based on v3.5. Used to shorten git clone time.
Note: the regular Linux git tree can be used as well.
compat:
-------
URL: git://git.openfabrics.org/compat-rdma/compat.git
Branch: ofed
- Based on compat project (https://github.com/mcgrof/compat). The compat module
provides functionality introduced in newer kernels to older kernels through a
set of header files and exported symbols.
See https://github.com/mcgrof/compat/wiki for details.
- Used to replace kernel_addons in the previous OFED kernel tree.
compat-rdma:
------------
URL: git://git.openfabrics.org/compat-rdma/compat-rdma.git
Branch: master
User level Sources are downloaded from http://www.openfabrics.org/downloads/
as written in the BUILD_ID
The kernel sources are based on Linux 3.5 mainline kernel. Its patches
are included in the OFED sources directory.
For details see HOWTO.build_ofed.
The list of maintainers is available under:
http://www.openfabrics.org/downloads/MAINTAINERS
===============================================================================
2. Change log
===============================================================================
OFED-3.5-rc3 Main Changes from OFED 3.5-rc2
-------------------------------------------------------------------------------
RDMA/nes: Fix for terminate timer crash
RDMA/nes: Fix for crash when adding timer and timer is pending
RDMA/nes: Fix for incorrect multicast address
RDMA/nes: Fix for crash when adding timer
RDMA/nes: Locking fix to prevent race conditions
RDMA/nes: Changing nes driver version
RDMA/nes: Fixes for PAU handling
cxgb4: Initialize data structures before using.
cxgb4: Fix initialization of SGE_CONTROL register
cxgb4: Add embedded firmware and its configuration file support
cxgb4/iw_cxgb4: Add LE hash collision bug fix for active and passive offloaded connections
cxgb4: Fix unable to get UP event from the LLD
cxgb4: Remove unnecessary #ifdef condition
cxgb4: Fix build warnings introduced after T4 configuration file support
cxgb4: Add support for T4 configuration file
iw_cxgb4: only log rx_data warnings if cpl status is non zero.
RDMA/cxgb4: fix mpa version mismatch
RDMA/cxgb4: abort connections that receive unexpected streaming mode data
RDMA/cxgb4: Insert hwtid in pass_accept_req instead in pass_establish
RDMA/cxgb4: Remove the limitation on maximum number of STAGs
linux-next-cherry-picks: Fix build failure for kernel < 3.2
IB/qib: remove EBUSY patch
ib_srp: Avoid that module removal can trigger a deadlock
ib_srp: Unbreak build on SLES 11 SP2
ib_srp: Add post-3.5 upstream patches
ib_srp: Avoid use-after-free during module unload on pre-2.6.36 kernels
Updated packages:
mstflint-1.4-1.23.g5c2032a
perftest-2.0-0.8.gaeb562e
qperf-0.4.9
OFED-3.5-rc2 Main Changes from OFED 3.5-rc1
-------------------------------------------------------------------------------
compat-rdma: Add SRP backport
compat-rdma: /etc/init.d/openibd: Fix LSB header
compat-rdma: IB/qib: linux-3.6 patches backported
compat-rdma: iw_cxgb4: Fix bug 2369 in OFED bugzilla
compat-rdma: IB/qib: fix compliance regression in 3.5
compat-rdma: RDMA/nes: Add linux-next-pending patches
compat-rdma: RDMA/nes: Updated backports
compat-rdma: NFSRDMA RHEL6.3 backport
compat-rdma: NFSRDMA SLES11SP2 backport
compat-rdma: linux-next-cherry-picks: RDMA/ucma.c: Different fix for ucma context uid=0, causing iWarp RDMA applications to fail in connection establishment
Updated packages:
infinipath-psm-3.0.1-115.1015_open
perftest-1.4.0-0.80.gd1763bd
qperf-0.4.7-0.2.gf3f7001
OFED-3.5-rc1 Main Changes from OFED 3.2-rc1
-------------------------------------------------------------------------------
1. Based on linux-3.5 kernel
2. Updated packages:
ibacm-1.0.7
librdmacm-1.0.16
dapl-2.0.36
Management:
libibumad-1.3.8
infiniband-diags-1.6.1
opensm-3.3.15
3. Removed libsdp, sdpnetstat
OFED-3.5-rc1 Main Changes from OFED 1.5.4.1
-------------------------------------------------------------------------------
1. Based on linux-3.2 kernel
2. kernel-ib RPM renamed to compat-rdma
3. Removed MPI packages
4. Updated packages:
libibverbs-1.1.6
libmlx4-1.0.4
dapl-2.0.35
ibacm-1.0.6
perftest-1.4.0-0.66.g9074687
Management:
libibmad-1.3.9
opensm-3.3.14
infiniband-diags-1.6.0
OFED-1.5.4 Main Changes from OFED 1.5.3.2
-------------------------------------------------------------------------------
1. Add kernel 3.0 support
2. Add RHEL6.2 support
3. Add NFSRDMA to the list of packages to be installed by default on supported
platforms
4. Add new InfiniBand link speeds: EDR/FDR/FDR10
5. OFA Kernel: See ofa_kernel.changelog.txt
6. Updated packages:
libibverbs-1.1.4-1.24.gb89d4d7
libmlx4-1.0.1-1.20.g6771d22
libnes-1.1.3
libcxgb3-1.3.1
libcxgb4-1.2.0
dapl-2.0.34
ibacm-1.0.5
librdmacm-1.0.15
infinipath-psm-2.9-926.1005_open
ibutils-1.5.7-0.1.g05a9d1a
perftest-1.3.0-0.56.gd6f6093
mstflint-1.4-1.18.g1adcfbf
Management:
libibmad-1.3.8
infiniband-diags-1.5.12
opensm-3.3.12
MPI:
mvapich2-1.7-5.2011svn5031
OFED-1.5.3.2 Main Changes from OFED 1.5.3.1
-------------------------------------------------------------------------------
1. Add RHEL5.7 support
2. Add RHEL6.1 support
3. Add kernel.org 2.6.37 - 2.6.39 support
4. ib-bonding-0.9.0-43 (SLES10 SP4 support)
OFED-1.5.3.1 Main Changes from OFED 1.5.3
-------------------------------------------------------------------------------
1. Fix QIB support on SLES10 SP3
OFED-1.5.3 Main Changes from OFED 1.5.2
-------------------------------------------------------------------------------
1. Updated packages:
dapl-2.0.32
librdmacm-1.0.14.1
ibacm-1.0.4
libibmad-1.3.7
libibumad-1.3.7
infiniband-diags-1.5.8
opensm-3.3.9
ibutils-1.5.7
libibverbs-1.1.4-1.22.g7257cd3.tar.gz
libmlx4-1.0.1-1.18.gb810a27.tar.gz
libnes-1.1.1
infinipath-psm-1.14
libsdp-1.1.108-0.15.gd7fdb72
mstflint-1.4-0.9.gc683022
sdpnetstat-1.60-0.3.gb6e7425
perftest-1.3.0-0.42.gf350d3d
- MPI
openmpi-1.4.3-1
mvapich2-1.6-2
2. Added RHEL6 support
3. Added RHEL5.6 support
4. Improved RAW Ethernet QP support (requires ConnectX/ConnectX2 FW >= 2.8.0600)
5. NFSoRDMA was removed from the list of packages in the install script to
prevent its installation by default.
To force NFSoRDMA installation, add the following lines to the ofed.conf:
nfsrdma=y
rnfs-utils=y
To get ofed.conf, run
# ./install.pl -p
After adding the lines above to ofed.conf, to install OFED run
# ./install.pl -c ofed.conf
OFED-1.5.2 Main Changes from OFED 1.5.1
-------------------------------------------------------------------------------
1. Added RHEL5.5, SLES11 SP1 and kernel 2.6.33 support
2. /etc/modprobe.conf deprecated
ib_ipoib use /etc/modprobe.d/ib_ipoib.conf
ib_sdp use /etc/modprobe.d/ib_sdp.conf
mlx4_en use /etc/modprobe.d/mlx4_en.conf
3. Added RAW Ethernet QP support in libibverbs
4. Added multicast support in perftest
5. Added new package: ibacm. See ibacm_release_notes.txt
6. Added new package infinipath-psm.
7. Updated packages:
libibverbs to rev 1.1.4-0.14.gb6c138b
libehca to rev 1.2.2-0.1.g69e1a88
libmlx4 to rev 1.0-0.13.g4e5c43f
libnes to rev 1.1.0
librdmacm to rev 1.0.13
dapl to rev 2.0.30
compat-depl to rev 1.2.19
libsdp to rev 1.1.103
mstflint to rev 1.4-0.6.g63179f4
perftest to rev 1.3.0-0.27
rds-tools to rev 2.0.4
Management:
opensm to rev 3.3.7
libibmad to rev 1.3.6
libibumad to rev 1.3.6
infiniband-diags to rev 1.5.7
MPI:
openmpi to rev 1.4.2-1
mvapich2 to rev 1.5.1-2.p1
mpitests to rev 3.2-923
OFED-1.5.1 Main Changes from OFED 1.5
-------------------------------------------------------------------------------
1. Added RoCEE support - see RoCEE_README.txt
2. Added enhanced atomic operations to ConnectX (kernel only).
See mlx4_release_notes.txt.
3. Updated Open MPI to rev 1.4.1-2ofed
4. Updated MVAPICH2 to rev 1.4.1
5. Updated DAPL to rev 2.0.27
6. Updated libnes to rev 1.0.1
7. Updated librdmacm to rev 1.0.11
8. Removed tvflash RPM
9. NFS-RDMA is not supported on SLES10 SP3
10. Fixed IPv6 support and IPv4 routing corner cases for RDMA CM
11. Bug fixes
OFED-1.5 Main Changes from OFED 1.4.2
-------------------------------------------------------------------------------
Note: For details regarding the various changes, please see the release notes
for each package in the docs directory.
2.1 General changes
o Kernel code based on 2.6.30
o libraries location - all userspace libraries can be downloaded from
http://www.openfabrics.org/downloads/
See BUILD_ID for exact locations
o Qlogic moved the low level driver from ipath to qib.
2.2 SDP
o Performance improvements
o Zero copy in beta level
2.3 uDAPL
o New UCM provider (ofa-v2-mlx4_0-1u) with IB UD-based CM per process.
It is more scalable than rdma_cm (cma) or socket cm (scm).
o Common code base with WinOF 2.1
o Bug fixes
2.4 perftest
o Renamed tests:
ib_rdma_bw -> rdma_bw
ib_rdma_lat -> rdma_lat
2.5 Management
o OpenSM
- Support for Mesh Analysis for LASH routing algorithm
- Reloadable OpenSM configuration (preliminary implementation)
- Routing paths sorted balancing (for UpDown and MinHops)
- Weighted LID matrices calculation (for UpDown, MinHop and DOR)
- I/O nodes connectivity (for FatTree)
2.6 MPI:
a. OSU MVAPICH 1.2.0
b. Open MPI 1.4
c. OSU MVAPICH2 1.4
d. MPI tests 3.2
2.7 iSER:
o Available on:
- kernel.org: 2.6.30 and higher
- RHEL5.4
2.8 NFS-RDMA
o Added support for RHEL5.4, SLES10 SP3, kernel.org 2.6.25 and 2.6.30.
Kernels 2.6.26 and 2.6.27 are not supported
o NFS-RDMA is in Beta level
===============================================================================
3. Known Issues
===============================================================================
The following is a list of general limitations and known issues of the various
components of the OFED 3.5-rc2 release.
1. When upgrading from an earlier OFED version, the installation script does
not stop the earlier OFED version prior to uninstalling it.
Workaround: Stop the old OFED stack (/etc/init.d/openibd stop) before
upgrading to OFED 3.5 or reboot the server after OFED installation.
2. Memory registration by the user is limited according to administrator
setting. See "Pinning (Locking) User Memory Pages" in OFED_tips.txt for
system configuration.
3. Fork support from kernel 2.6.12 and above is available provided
that applications do not use threads. fork() is supported as long as the
parent process does not run before the child exits or calls exec().
The former can be achieved by calling wait(childpid), and the latter can be
achieved by application specific means. The Posix system() call is
supported.
4. The qib driver is supported only on 64-bit platforms.
5. IPoIB: brctl utilities do not work on IPoIB interfaces. The reason for that
is that these utilities support devices of type Ethernet only.
6. In case uninstall is failing, check the error log and remove
the remaining RPMs manually using 'rpm -e <rpms list>'.
7. On SLES11.x, set allow_unsupported_modules parameter to 1 in file:
/etc/modprobe.d/unsupported-modules. Without this the modules will not
load.
Note: See the release notes of each component for additional issues.
^ permalink raw reply [flat|nested] 11+ messages in thread
* [ANNOUNCE] OFED-3.5-rc4 is available
[not found] ` <50C6F6BC.6090701-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
@ 2013-01-03 16:11 ` Vladimir Sokolovsky
[not found] ` <50E5AD97.8030300-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
0 siblings, 1 reply; 11+ messages in thread
From: Vladimir Sokolovsky @ 2013-01-03 16:11 UTC (permalink / raw)
To: OpenFabrics EWG; +Cc: linux-rdma
[-- Attachment #1: Type: text/plain, Size: 552 bytes --]
Hi,
OFED 3.5-rc4 is available.
The tarball is available on:
http://www.openfabrics.org/downloads/OFED/ofed-3.5/OFED-3.5-rc4.tgz
To get BUILD_ID run ofed_info
Please report any issues in bugzilla https://bugs.openfabrics.org/ for OFED 3.5
OFED-3.5-rc4 Main Changes from OFED 3.5-rc3
-------------------------------------------------------------------------------
RDMA/nes: Fixes for OFED-3.5 RC3
RDMA/cxgb4: Keep the maximum number of stag limited to T4_MAX_NUM_STAG
Updated packages:
infinipath-psm-3.1-364.1140_open
Regards,
Vladimir
[-- Attachment #2: OFED_release_notes.txt --]
[-- Type: text/plain, Size: 15768 bytes --]
Open Fabrics Enterprise Distribution (OFED)
Version 3.5-rc4
Release Notes
January 2013
===============================================================================
Table of Contents
===============================================================================
1. Overview, which includes:
- OFED Distribution Rev 3.5 Contents
- Supported Platforms and Operating Systems
- Supported HCA and RNIC Adapter Cards and Firmware Versions
- Tested Switch Platforms
- Third party Test Packages
- OFED sources
2. Change log
3. Known Issues
===============================================================================
1. Overview
===============================================================================
These are the release notes of OpenFabrics Enterprise Distribution (OFED)
release 3.5. The OFED software package is composed of several software modules,
and is intended for use on a computer cluster constructed as an InfiniBand
subnet or iWARP network.
Note: If you plan to upgrade the OFED package on your cluster, please upgrade
all of its nodes to this new version.
1.1 OFED 3.5 Contents
-----------------------
The OFED package contains the following components:
- OpenFabrics core and ULPs:
- IB HCA drivers (mthca, mlx4, qib, ehca)
- iWARP RNIC driver (cxgb3, cxgb4, nes)
- core
- Upper Layer Protocols: IPoIB, SRP Initiator and target, iSER
Initiator and target, RDS, uDAPL, qlgc_vnic and NFS-RDMA*.
- OpenFabrics utilities:
- OpenSM (OSM): InfiniBand Subnet Manager
- Diagnostic tools
- Performance tests
- Extra packages:
- infinipath-psm: Performance-Scaled Messaging API, an accelerated
interface to Intel(R) HCAs
- Sources of all software modules (under conditions mentioned in the modules'
LICENSE files)
- Documentation
1.2 Supported Platforms and Operating Systems
---------------------------------------------
o CPU architectures:
- x86_64
- x86
- ppc64
- ia64
o Linux Operating Systems:
- RedHat EL6.2 2.6.32-220.el6
- RedHat EL6.3 2.6.32-279.el6
- SLES11 SP2 3.0.13-0.27-default
- kernel.org 3.5 *
* Minimal QA for these versions.
1.3 HCAs and RNICs Supported
----------------------------
This release supports IB HCAs by Mellanox Technologies, Qlogic and IBM as
well as iWARP RNICs by Chelsio Communications and Intel.
o Mellanox Technologies HCAs (SDR, DDR and QDR Modes are Supported):
- ConnectX(R) and ConnectX EN (fw-25408 Rev 2.9.1000)
- ConnectX-2 (fw-ConnectX2 Rev 2.9.1000)
- ConnectX-2 EN (fw-ConnectX2 Rev 2.9.1200)
- ConnectX-3 (fw-ConnectX3 Rev 2.10.0700) (FDR and FDR10 Modes are Supported)
- ConnectX-3 EN (fw-ConnectX3 Rev 2.10.0800)
For official firmware versions please see:
http://www.mellanox.com/content/pages.php?pg=firmware_download
o Qlogic HCAs:
- Intel(R) True Scale DDR PCIe x8 and x16 HCAs
- Intel(R) True Scale QDR PCIe x8 Gen2 HCAs
o IBM HCAs:
- GX Dual-port SDR 4x IB HCA
- GX Dual-port SDR 12x IB HCA
- GX Dual-port DDR 4x IB HCA
- GX Dual-port DDR 12x IB HCA
o Chelsio RNICs:
- S310/S320 10GbE Storage Accelerators
- R310/R320 10GbE iWARP Adapters
o Intel RNICs:
- NE020 10Gb iWARP Adapter
1.4 Switches Supported
----------------------
This release was tested with switches and gateways provided by the following
companies:
- Qlogic
- Flextronics
- Oracle (Sun)
- Mellanox
1.5 Third Party Packages
------------------------
The following third party packages have been tested with OFED 3.2:
- MVAPICH2 - 1.8
- Intel MPI - 4.0.3
- Open MPI - 1.6/1.6.1
1.6 OFED Sources
----------------
All sources are located under git://git.openfabrics.org/
Linux:
------
URL: git://git.openfabrics.org/compat-rdma/linux-3.5.git
Branch: for-ofed-3.5
- Linux kernel subtree that includes files relevant for the OFED project only.
Based on v3.5. Used to shorten git clone time.
Note: the regular Linux git tree can be used as well.
compat:
-------
URL: git://git.openfabrics.org/compat-rdma/compat.git
Branch: ofed
- Based on compat project (https://github.com/mcgrof/compat). The compat module
provides functionality introduced in newer kernels to older kernels through a
set of header files and exported symbols.
See https://github.com/mcgrof/compat/wiki for details.
- Used to replace kernel_addons in the previous OFED kernel tree.
compat-rdma:
------------
URL: git://git.openfabrics.org/compat-rdma/compat-rdma.git
Branch: master
User level Sources are downloaded from http://www.openfabrics.org/downloads/
as written in the BUILD_ID
The kernel sources are based on Linux 3.5 mainline kernel. Its patches
are included in the OFED sources directory.
For details see HOWTO.build_ofed.
The list of maintainers is available under:
http://www.openfabrics.org/downloads/MAINTAINERS
===============================================================================
2. Change log
===============================================================================
OFED-3.5-rc4 Main Changes from OFED 3.5-rc3
-------------------------------------------------------------------------------
RDMA/nes: Fixes for OFED-3.5 RC3
RDMA/cxgb4: Keep the maximum number of stag limited to T4_MAX_NUM_STAG
Updated packages:
infinipath-psm-3.1-364.1140_open
OFED-3.5-rc3 Main Changes from OFED 3.5-rc2
-------------------------------------------------------------------------------
RDMA/nes: Fix for terminate timer crash
RDMA/nes: Fix for crash when adding timer and timer is pending
RDMA/nes: Fix for incorrect multicast address
RDMA/nes: Fix for crash when adding timer
RDMA/nes: Locking fix to prevent race conditions
RDMA/nes: Changing nes driver version
RDMA/nes: Fixes for PAU handling
cxgb4: Initialize data structures before using.
cxgb4: Fix initialization of SGE_CONTROL register
cxgb4: Add embedded firmware and its configuration file support
cxgb4/iw_cxgb4: Add LE hash collision bug fix for active and passive offloaded connections
cxgb4: Fix unable to get UP event from the LLD
cxgb4: Remove unnecessary #ifdef condition
cxgb4: Fix build warnings introduced after T4 configuration file support
cxgb4: Add support for T4 configuration file
iw_cxgb4: only log rx_data warnings if cpl status is non zero.
RDMA/cxgb4: fix mpa version mismatch
RDMA/cxgb4: abort connections that receive unexpected streaming mode data
RDMA/cxgb4: Insert hwtid in pass_accept_req instead in pass_establish
RDMA/cxgb4: Remove the limitation on maximum number of STAGs
linux-next-cherry-picks: Fix build failure for kernel < 3.2
IB/qib: remove EBUSY patch
ib_srp: Avoid that module removal can trigger a deadlock
ib_srp: Unbreak build on SLES 11 SP2
ib_srp: Add post-3.5 upstream patches
ib_srp: Avoid use-after-free during module unload on pre-2.6.36 kernels
Updated packages:
mstflint-1.4-1.23.g5c2032a
perftest-2.0-0.8.gaeb562e
qperf-0.4.9
OFED-3.5-rc2 Main Changes from OFED 3.5-rc1
-------------------------------------------------------------------------------
compat-rdma: Add SRP backport
compat-rdma: /etc/init.d/openibd: Fix LSB header
compat-rdma: IB/qib: linux-3.6 patches backported
compat-rdma: iw_cxgb4: Fix bug 2369 in OFED bugzilla
compat-rdma: IB/qib: fix compliance regression in 3.5
compat-rdma: RDMA/nes: Add linux-next-pending patches
compat-rdma: RDMA/nes: Updated backports
compat-rdma: NFSRDMA RHEL6.3 backport
compat-rdma: NFSRDMA SLES11SP2 backport
compat-rdma: linux-next-cherry-picks: RDMA/ucma.c: Different fix for ucma context uid=0, causing iWarp RDMA applications to fail in connection establishment
Updated packages:
infinipath-psm-3.0.1-115.1015_open
perftest-1.4.0-0.80.gd1763bd
qperf-0.4.7-0.2.gf3f7001
OFED-3.5-rc1 Main Changes from OFED 3.2-rc1
-------------------------------------------------------------------------------
1. Based on linux-3.5 kernel
2. Updated packages:
ibacm-1.0.7
librdmacm-1.0.16
dapl-2.0.36
Management:
libibumad-1.3.8
infiniband-diags-1.6.1
opensm-3.3.15
3. Removed libsdp, sdpnetstat
OFED-3.5-rc1 Main Changes from OFED 1.5.4.1
-------------------------------------------------------------------------------
1. Based on linux-3.5 kernel
2. kernel-ib RPM renamed to compat-rdma
3. Removed MPI packages
4. Updated packages:
libibverbs-1.1.6
libmlx4-1.0.4
dapl-2.0.35
ibacm-1.0.6
perftest-1.4.0-0.66.g9074687
Management:
libibmad-1.3.9
opensm-3.3.14
infiniband-diags-1.6.0
OFED-1.5.4 Main Changes from OFED 1.5.3.2
-------------------------------------------------------------------------------
1. Add kernel 3.0 support
2. Add RHEL6.2 support
3. Add NFSRDMA to the list of packages to be installed by default on supported
platforms
4. Add new InfiniBand link speeds: EDR/FDR/FDR10
5. OFA Kernel: See ofa_kernel.changelog.txt
6. Updated packages:
libibverbs-1.1.4-1.24.gb89d4d7
libmlx4-1.0.1-1.20.g6771d22
libnes-1.1.3
libcxgb3-1.3.1
libcxgb4-1.2.0
dapl-2.0.34
ibacm-1.0.5
librdmacm-1.0.15
infinipath-psm-2.9-926.1005_open
ibutils-1.5.7-0.1.g05a9d1a
perftest-1.3.0-0.56.gd6f6093
mstflint-1.4-1.18.g1adcfbf
Management:
libibmad-1.3.8
infiniband-diags-1.5.12
opensm-3.3.12
MPI:
mvapich2-1.7-5.2011svn5031
OFED-1.5.3.2 Main Changes from OFED 1.5.3.1
-------------------------------------------------------------------------------
1. Add RHEL5.7 support
2. Add RHEL6.1 support
3. Add kernel.org 2.6.37 - 2.6.39 support
4. ib-bonding-0.9.0-43 (SLES10 SP4 support)
OFED-1.5.3.1 Main Changes from OFED 1.5.3
-------------------------------------------------------------------------------
1. Fix QIB support on SLES10 SP3
OFED-1.5.3 Main Changes from OFED 1.5.2
-------------------------------------------------------------------------------
1. Updated packages:
dapl-2.0.32
librdmacm-1.0.14.1
ibacm-1.0.4
libibmad-1.3.7
libibumad-1.3.7
infiniband-diags-1.5.8
opensm-3.3.9
ibutils-1.5.7
libibverbs-1.1.4-1.22.g7257cd3.tar.gz
libmlx4-1.0.1-1.18.gb810a27.tar.gz
libnes-1.1.1
infinipath-psm-1.14
libsdp-1.1.108-0.15.gd7fdb72
mstflint-1.4-0.9.gc683022
sdpnetstat-1.60-0.3.gb6e7425
perftest-1.3.0-0.42.gf350d3d
- MPI
openmpi-1.4.3-1
mvapich2-1.6-2
2. Added RHEL6 support
3. Added RHEL5.6 support
4. Improved RAW Ethernet QP support (requires ConnectX/ConnectX2 FW >= 2.8.0600)
5. NFSoRDMA was removed from the list of packages in the install script to
prevent its installation by default.
To force NFSoRDMA installation, add the following lines to the ofed.conf:
nfsrdma=y
rnfs-utils=y
To get ofed.conf, run
# ./install.pl -p
After adding the lines above to ofed.conf, to install OFED run
# ./install.pl -c ofed.conf
OFED-1.5.2 Main Changes from OFED 1.5.1
-------------------------------------------------------------------------------
1. Added RHEL5.5, SLES11 SP1 and kernel 2.6.33 support
2. /etc/modprobe.conf deprecated
ib_ipoib use /etc/modprobe.d/ib_ipoib.conf
ib_sdp use /etc/modprobe.d/ib_sdp.conf
mlx4_en use /etc/modprobe.d/mlx4_en.conf
3. Added RAW Ethernet QP support in libibverbs
4. Added multicast support in perftest
5. Added new package: ibacm. See ibacm_release_notes.txt
6. Added new package infinipath-psm.
7. Updated packages:
libibverbs to rev 1.1.4-0.14.gb6c138b
libehca to rev 1.2.2-0.1.g69e1a88
libmlx4 to rev 1.0-0.13.g4e5c43f
libnes to rev 1.1.0
librdmacm to rev 1.0.13
dapl to rev 2.0.30
compat-depl to rev 1.2.19
libsdp to rev 1.1.103
mstflint to rev 1.4-0.6.g63179f4
perftest to rev 1.3.0-0.27
rds-tools to rev 2.0.4
Management:
opensm to rev 3.3.7
libibmad to rev 1.3.6
libibumad to rev 1.3.6
infiniband-diags to rev 1.5.7
MPI:
openmpi to rev 1.4.2-1
mvapich2 to rev 1.5.1-2.p1
mpitests to rev 3.2-923
OFED-1.5.1 Main Changes from OFED 1.5
-------------------------------------------------------------------------------
1. Added RoCEE support - see RoCEE_README.txt
2. Added enhanced atomic operations to ConnectX (kernel only).
See mlx4_release_notes.txt.
3. Updated Open MPI to rev 1.4.1-2ofed
4. Updated MVAPICH2 to rev 1.4.1
5. Updated DAPL to rev 2.0.27
6. Updated libnes to rev 1.0.1
7. Updated librdmacm to rev 1.0.11
8. Removed tvflash RPM
9. NFS-RDMA is not supported on SLES10 SP3
10. Fixed IPv6 support and IPv4 routing corner cases for RDMA CM
11. Bug fixes
OFED-1.5 Main Changes from OFED 1.4.2
-------------------------------------------------------------------------------
Note: For details regarding the various changes, please see the release notes
for each package in the docs directory.
2.1 General changes
o Kernel code based on 2.6.30
o libraries location - all userspace libraries can be downloaded from
http://www.openfabrics.org/downloads/
See BUILD_ID for exact locations
o Qlogic moved the low level driver from ipath to qib.
2.2 SDP
o Performance improvements
o Zero copy in beta level
2.3 uDAPL
o New UCM provider (ofa-v2-mlx4_0-1u) with IB UD-based CM per process.
It is more scalable than rdma_cm (cma) or socket cm (scm).
o Common code base with WinOF 2.1
o Bug fixes
2.4 perftest
o Renamed tests:
ib_rdma_bw -> rdma_bw
ib_rdma_lat -> rdma_lat
2.5 Management
o OpenSM
- Support for Mesh Analysis for LASH routing algorithm
- Reloadable OpenSM configuration (preliminary implementation)
- Routing paths sorted balancing (for UpDown and MinHops)
- Weighted LID matrices calculation (for UpDown, MinHop and DOR)
- I/O nodes connectivity (for FatTree)
2.6 MPI:
a. OSU MVAPICH 1.2.0
b. Open MPI 1.4
c. OSU MVAPICH2 1.4
d. MPI tests 3.2
2.7 iSER:
o Available on:
- kernel.org: 2.6.30 and higher
- RHEL5.4
2.8 NFS-RDMA
o Added support for RHEL5.4, SLES10 SP3, kernel.org 2.6.25 and 2.6.30.
Kernels 2.6.26 and 2.6.27 are not supported
o NFS-RDMA is in Beta level
===============================================================================
3. Known Issues
===============================================================================
The following is a list of general limitations and known issues of the various
components of the OFED 3.5-rc2 release.
1. When upgrading from an earlier OFED version, the installation script does
not stop the earlier OFED version prior to uninstalling it.
Workaround: Stop the old OFED stack (/etc/init.d/openibd stop) before
upgrading to OFED 3.5 or reboot the server after OFED installation.
2. Memory registration by the user is limited according to administrator
setting. See "Pinning (Locking) User Memory Pages" in OFED_tips.txt for
system configuration.
3. Fork support from kernel 2.6.12 and above is available provided
that applications do not use threads. fork() is supported as long as the
parent process does not run before the child exits or calls exec().
The former can be achieved by calling wait(childpid), and the latter can be
achieved by application specific means. The Posix system() call is
supported.
4. The qib driver is supported only on 64-bit platforms.
5. IPoIB: brctl utilities do not work on IPoIB interfaces. The reason for that
is that these utilities support devices of type Ethernet only.
6. In case uninstall is failing, check the error log and remove
the remaining RPMs manually using 'rpm -e <rpms list>'.
7. On SLES11.x, set allow_unsupported_modules parameter to 1 in file:
/etc/modprobe.d/unsupported-modules. Without this the modules will not
load.
Note: See the release notes of each component for additional issues.
[-- Attachment #3: Type: text/plain, Size: 176 bytes --]
_______________________________________________
ewg mailing list
ewg-ZwoEplunGu1OwGhvXhtEPSCwEArCW2h5@public.gmane.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [ANNOUNCE] OFED-3.5-rc4 is available
[not found] ` <50E5AD97.8030300-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
@ 2013-01-03 19:53 ` Vasiliy Tolstov
2013-01-17 9:32 ` [ANNOUNCE] OFED-3.5-rc5 " Vladimir Sokolovsky
1 sibling, 0 replies; 11+ messages in thread
From: Vasiliy Tolstov @ 2013-01-03 19:53 UTC (permalink / raw)
To: Vladimir Sokolovsky; +Cc: OpenFabrics EWG, linux-rdma
Hello. Does this release production ready for heavy load?
Or now best to use ofed 1.5.x?
2013/1/3 Vladimir Sokolovsky <vlad-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>:
> Hi,
> OFED 3.5-rc4 is available.
>
> The tarball is available on:
> http://www.openfabrics.org/downloads/OFED/ofed-3.5/OFED-3.5-rc4.tgz
>
> To get BUILD_ID run ofed_info
>
> Please report any issues in bugzilla https://bugs.openfabrics.org/ for OFED
> 3.5
>
> OFED-3.5-rc4 Main Changes from OFED 3.5-rc3
> -------------------------------------------------------------------------------
> RDMA/nes: Fixes for OFED-3.5 RC3
> RDMA/cxgb4: Keep the maximum number of stag limited to T4_MAX_NUM_STAG
> Updated packages:
> infinipath-psm-3.1-364.1140_open
>
>
>
> Regards,
> Vladimir
>
>
>
>
>
--
Vasiliy Tolstov,
Clodo.ru
e-mail: v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
jabber: vase-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 11+ messages in thread
* [ANNOUNCE] OFED-3.5-rc5 is available
[not found] ` <50E5AD97.8030300-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2013-01-03 19:53 ` Vasiliy Tolstov
@ 2013-01-17 9:32 ` Vladimir Sokolovsky
[not found] ` <50F7C532.8050500-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
1 sibling, 1 reply; 11+ messages in thread
From: Vladimir Sokolovsky @ 2013-01-17 9:32 UTC (permalink / raw)
To: OpenFabrics EWG; +Cc: linux-rdma
[-- Attachment #1: Type: text/plain, Size: 421 bytes --]
Hi,
OFED 3.5-rc5 is available.
The tarball is available on:
http://www.openfabrics.org/downloads/OFED/ofed-3.5/OFED-3.5-rc5.tgz
To get BUILD_ID run ofed_info
Please report any issues in bugzilla https://bugs.openfabrics.org/ for OFED 3.5
OFED-3.5-rc5 Main Changes from OFED 3.5-rc4
-------------------------------------------------------------------------------
perftest-2.0-0.25.g971259d
Regards,
Vladimir
[-- Attachment #2: OFED_release_notes.txt --]
[-- Type: text/plain, Size: 15953 bytes --]
Open Fabrics Enterprise Distribution (OFED)
Version 3.5-rc5
Release Notes
January 2013
===============================================================================
Table of Contents
===============================================================================
1. Overview, which includes:
- OFED Distribution Rev 3.5 Contents
- Supported Platforms and Operating Systems
- Supported HCA and RNIC Adapter Cards and Firmware Versions
- Tested Switch Platforms
- Third party Test Packages
- OFED sources
2. Change log
3. Known Issues
===============================================================================
1. Overview
===============================================================================
These are the release notes of OpenFabrics Enterprise Distribution (OFED)
release 3.5. The OFED software package is composed of several software modules,
and is intended for use on a computer cluster constructed as an InfiniBand
subnet or iWARP network.
Note: If you plan to upgrade the OFED package on your cluster, please upgrade
all of its nodes to this new version.
1.1 OFED 3.5 Contents
-----------------------
The OFED package contains the following components:
- OpenFabrics core and ULPs:
- IB HCA drivers (mthca, mlx4, qib, ehca)
- iWARP RNIC driver (cxgb3, cxgb4, nes)
- core
- Upper Layer Protocols: IPoIB, SRP Initiator and target, iSER
Initiator and target, RDS, uDAPL, qlgc_vnic and NFS-RDMA*.
- OpenFabrics utilities:
- OpenSM (OSM): InfiniBand Subnet Manager
- Diagnostic tools
- Performance tests
- Extra packages:
- infinipath-psm: Performance-Scaled Messaging API, an accelerated
interface to Intel(R) HCAs
- Sources of all software modules (under conditions mentioned in the modules'
LICENSE files)
- Documentation
1.2 Supported Platforms and Operating Systems
---------------------------------------------
o CPU architectures:
- x86_64
- x86
- ppc64
- ia64
o Linux Operating Systems:
- RedHat EL6.2 2.6.32-220.el6
- RedHat EL6.3 2.6.32-279.el6
- SLES11 SP2 3.0.13-0.27-default
- kernel.org 3.5 *
* Minimal QA for these versions.
1.3 HCAs and RNICs Supported
----------------------------
This release supports IB HCAs by Mellanox Technologies, Intel and IBM as
well as iWARP RNICs by Chelsio Communications and Intel.
o Mellanox Technologies HCAs (SDR, DDR and QDR Modes are Supported):
- ConnectX(R) and ConnectX EN (fw-25408 Rev 2.9.1000)
- ConnectX-2 (fw-ConnectX2 Rev 2.9.1000)
- ConnectX-2 EN (fw-ConnectX2 Rev 2.9.1200)
- ConnectX-3 (fw-ConnectX3 Rev 2.10.0700) (FDR and FDR10 Modes are Supported)
- ConnectX-3 EN (fw-ConnectX3 Rev 2.10.0800)
For official firmware versions please see:
http://www.mellanox.com/content/pages.php?pg=firmware_download
o Intel (formerly QLogic) HCAs:
- Intel(R) True Scale DDR PCIe x8 and x16 HCAs
- Intel(R) True Scale QDR PCIe x8 Gen2 HCAs
o IBM HCAs:
- GX Dual-port SDR 4x IB HCA
- GX Dual-port SDR 12x IB HCA
- GX Dual-port DDR 4x IB HCA
- GX Dual-port DDR 12x IB HCA
o Chelsio RNICs:
- S310/S320 10GbE Storage Accelerators
- R310/R320 10GbE iWARP Adapters
o Intel RNICs:
- NE020 10Gb iWARP Adapter
1.4 Switches Supported
----------------------
This release was tested with switches and gateways provided by the following
companies:
- Intel (formerly QLogic)
- Flextronics
- Oracle (Sun)
- Mellanox
1.5 Third Party Packages
------------------------
The following third party packages have been tested with OFED 3.2:
- MVAPICH2 - 1.8
- Intel MPI - 4.0.3
- Open MPI - 1.6/1.6.1
1.6 OFED Sources
----------------
All sources are located under git://git.openfabrics.org/
Linux:
------
URL: git://git.openfabrics.org/compat-rdma/linux-3.5.git
Branch: for-ofed-3.5
- Linux kernel subtree that includes files relevant for the OFED project only.
Based on v3.5. Used to shorten git clone time.
Note: the regular Linux git tree can be used as well.
compat:
-------
URL: git://git.openfabrics.org/compat-rdma/compat.git
Branch: ofed
- Based on compat project (https://github.com/mcgrof/compat). The compat module
provides functionality introduced in newer kernels to older kernels through a
set of header files and exported symbols.
See https://github.com/mcgrof/compat/wiki for details.
- Used to replace kernel_addons in the previous OFED kernel tree.
compat-rdma:
------------
URL: git://git.openfabrics.org/compat-rdma/compat-rdma.git
Branch: master
User level Sources are downloaded from http://www.openfabrics.org/downloads/
as written in the BUILD_ID
The kernel sources are based on Linux 3.5 mainline kernel. Its patches
are included in the OFED sources directory.
For details see HOWTO.build_ofed.
The list of maintainers is available under:
http://www.openfabrics.org/downloads/MAINTAINERS
===============================================================================
2. Change log
===============================================================================
OFED-3.5-rc5 Main Changes from OFED 3.5-rc4
-------------------------------------------------------------------------------
perftest-2.0-0.25.g971259d
OFED-3.5-rc4 Main Changes from OFED 3.5-rc3
-------------------------------------------------------------------------------
RDMA/nes: Fixes for OFED-3.5 RC3
RDMA/cxgb4: Keep the maximum number of stag limited to T4_MAX_NUM_STAG
Updated packages:
infinipath-psm-3.1-364.1140_open
OFED-3.5-rc3 Main Changes from OFED 3.5-rc2
-------------------------------------------------------------------------------
RDMA/nes: Fix for terminate timer crash
RDMA/nes: Fix for crash when adding timer and timer is pending
RDMA/nes: Fix for incorrect multicast address
RDMA/nes: Fix for crash when adding timer
RDMA/nes: Locking fix to prevent race conditions
RDMA/nes: Changing nes driver version
RDMA/nes: Fixes for PAU handling
cxgb4: Initialize data structures before using.
cxgb4: Fix initialization of SGE_CONTROL register
cxgb4: Add embedded firmware and its configuration file support
cxgb4/iw_cxgb4: Add LE hash collision bug fix for active and passive offloaded connections
cxgb4: Fix unable to get UP event from the LLD
cxgb4: Remove unnecessary #ifdef condition
cxgb4: Fix build warnings introduced after T4 configuration file support
cxgb4: Add support for T4 configuration file
iw_cxgb4: only log rx_data warnings if cpl status is non zero.
RDMA/cxgb4: fix mpa version mismatch
RDMA/cxgb4: abort connections that receive unexpected streaming mode data
RDMA/cxgb4: Insert hwtid in pass_accept_req instead in pass_establish
RDMA/cxgb4: Remove the limitation on maximum number of STAGs
linux-next-cherry-picks: Fix build failure for kernel < 3.2
IB/qib: remove EBUSY patch
ib_srp: Avoid that module removal can trigger a deadlock
ib_srp: Unbreak build on SLES 11 SP2
ib_srp: Add post-3.5 upstream patches
ib_srp: Avoid use-after-free during module unload on pre-2.6.36 kernels
Updated packages:
mstflint-1.4-1.23.g5c2032a
perftest-2.0-0.8.gaeb562e
qperf-0.4.9
OFED-3.5-rc2 Main Changes from OFED 3.5-rc1
-------------------------------------------------------------------------------
compat-rdma: Add SRP backport
compat-rdma: /etc/init.d/openibd: Fix LSB header
compat-rdma: IB/qib: linux-3.6 patches backported
compat-rdma: iw_cxgb4: Fix bug 2369 in OFED bugzilla
compat-rdma: IB/qib: fix compliance regression in 3.5
compat-rdma: RDMA/nes: Add linux-next-pending patches
compat-rdma: RDMA/nes: Updated backports
compat-rdma: NFSRDMA RHEL6.3 backport
compat-rdma: NFSRDMA SLES11SP2 backport
compat-rdma: linux-next-cherry-picks: RDMA/ucma.c: Different fix for ucma context uid=0, causing iWarp RDMA applications to fail in connection establishment
Updated packages:
infinipath-psm-3.0.1-115.1015_open
perftest-1.4.0-0.80.gd1763bd
qperf-0.4.7-0.2.gf3f7001
OFED-3.5-rc1 Main Changes from OFED 3.2-rc1
-------------------------------------------------------------------------------
1. Based on linux-3.5 kernel
2. Updated packages:
ibacm-1.0.7
librdmacm-1.0.16
dapl-2.0.36
Management:
libibumad-1.3.8
infiniband-diags-1.6.1
opensm-3.3.15
3. Removed libsdp, sdpnetstat
OFED-3.5-rc1 Main Changes from OFED 1.5.4.1
-------------------------------------------------------------------------------
1. Based on linux-3.5 kernel
2. kernel-ib RPM renamed to compat-rdma
3. Removed MPI packages
4. Updated packages:
libibverbs-1.1.6
libmlx4-1.0.4
dapl-2.0.35
ibacm-1.0.6
perftest-1.4.0-0.66.g9074687
Management:
libibmad-1.3.9
opensm-3.3.14
infiniband-diags-1.6.0
OFED-1.5.4 Main Changes from OFED 1.5.3.2
-------------------------------------------------------------------------------
1. Add kernel 3.0 support
2. Add RHEL6.2 support
3. Add NFSRDMA to the list of packages to be installed by default on supported
platforms
4. Add new InfiniBand link speeds: EDR/FDR/FDR10
5. OFA Kernel: See ofa_kernel.changelog.txt
6. Updated packages:
libibverbs-1.1.4-1.24.gb89d4d7
libmlx4-1.0.1-1.20.g6771d22
libnes-1.1.3
libcxgb3-1.3.1
libcxgb4-1.2.0
dapl-2.0.34
ibacm-1.0.5
librdmacm-1.0.15
infinipath-psm-2.9-926.1005_open
ibutils-1.5.7-0.1.g05a9d1a
perftest-1.3.0-0.56.gd6f6093
mstflint-1.4-1.18.g1adcfbf
Management:
libibmad-1.3.8
infiniband-diags-1.5.12
opensm-3.3.12
MPI:
mvapich2-1.7-5.2011svn5031
OFED-1.5.3.2 Main Changes from OFED 1.5.3.1
-------------------------------------------------------------------------------
1. Add RHEL5.7 support
2. Add RHEL6.1 support
3. Add kernel.org 2.6.37 - 2.6.39 support
4. ib-bonding-0.9.0-43 (SLES10 SP4 support)
OFED-1.5.3.1 Main Changes from OFED 1.5.3
-------------------------------------------------------------------------------
1. Fix QIB support on SLES10 SP3
OFED-1.5.3 Main Changes from OFED 1.5.2
-------------------------------------------------------------------------------
1. Updated packages:
dapl-2.0.32
librdmacm-1.0.14.1
ibacm-1.0.4
libibmad-1.3.7
libibumad-1.3.7
infiniband-diags-1.5.8
opensm-3.3.9
ibutils-1.5.7
libibverbs-1.1.4-1.22.g7257cd3.tar.gz
libmlx4-1.0.1-1.18.gb810a27.tar.gz
libnes-1.1.1
infinipath-psm-1.14
libsdp-1.1.108-0.15.gd7fdb72
mstflint-1.4-0.9.gc683022
sdpnetstat-1.60-0.3.gb6e7425
perftest-1.3.0-0.42.gf350d3d
- MPI
openmpi-1.4.3-1
mvapich2-1.6-2
2. Added RHEL6 support
3. Added RHEL5.6 support
4. Improved RAW Ethernet QP support (requires ConnectX/ConnectX2 FW >= 2.8.0600)
5. NFSoRDMA was removed from the list of packages in the install script to
prevent its installation by default.
To force NFSoRDMA installation, add the following lines to the ofed.conf:
nfsrdma=y
rnfs-utils=y
To get ofed.conf, run
# ./install.pl -p
After adding the lines above to ofed.conf, to install OFED run
# ./install.pl -c ofed.conf
OFED-1.5.2 Main Changes from OFED 1.5.1
-------------------------------------------------------------------------------
1. Added RHEL5.5, SLES11 SP1 and kernel 2.6.33 support
2. /etc/modprobe.conf deprecated
ib_ipoib use /etc/modprobe.d/ib_ipoib.conf
ib_sdp use /etc/modprobe.d/ib_sdp.conf
mlx4_en use /etc/modprobe.d/mlx4_en.conf
3. Added RAW Ethernet QP support in libibverbs
4. Added multicast support in perftest
5. Added new package: ibacm. See ibacm_release_notes.txt
6. Added new package infinipath-psm.
7. Updated packages:
libibverbs to rev 1.1.4-0.14.gb6c138b
libehca to rev 1.2.2-0.1.g69e1a88
libmlx4 to rev 1.0-0.13.g4e5c43f
libnes to rev 1.1.0
librdmacm to rev 1.0.13
dapl to rev 2.0.30
compat-depl to rev 1.2.19
libsdp to rev 1.1.103
mstflint to rev 1.4-0.6.g63179f4
perftest to rev 1.3.0-0.27
rds-tools to rev 2.0.4
Management:
opensm to rev 3.3.7
libibmad to rev 1.3.6
libibumad to rev 1.3.6
infiniband-diags to rev 1.5.7
MPI:
openmpi to rev 1.4.2-1
mvapich2 to rev 1.5.1-2.p1
mpitests to rev 3.2-923
OFED-1.5.1 Main Changes from OFED 1.5
-------------------------------------------------------------------------------
1. Added RoCEE support - see RoCEE_README.txt
2. Added enhanced atomic operations to ConnectX (kernel only).
See mlx4_release_notes.txt.
3. Updated Open MPI to rev 1.4.1-2ofed
4. Updated MVAPICH2 to rev 1.4.1
5. Updated DAPL to rev 2.0.27
6. Updated libnes to rev 1.0.1
7. Updated librdmacm to rev 1.0.11
8. Removed tvflash RPM
9. NFS-RDMA is not supported on SLES10 SP3
10. Fixed IPv6 support and IPv4 routing corner cases for RDMA CM
11. Bug fixes
OFED-1.5 Main Changes from OFED 1.4.2
-------------------------------------------------------------------------------
Note: For details regarding the various changes, please see the release notes
for each package in the docs directory.
2.1 General changes
o Kernel code based on 2.6.30
o libraries location - all userspace libraries can be downloaded from
http://www.openfabrics.org/downloads/
See BUILD_ID for exact locations
o Qlogic moved the low level driver from ipath to qib.
2.2 SDP
o Performance improvements
o Zero copy in beta level
2.3 uDAPL
o New UCM provider (ofa-v2-mlx4_0-1u) with IB UD-based CM per process.
It is more scalable than rdma_cm (cma) or socket cm (scm).
o Common code base with WinOF 2.1
o Bug fixes
2.4 perftest
o Renamed tests:
ib_rdma_bw -> rdma_bw
ib_rdma_lat -> rdma_lat
2.5 Management
o OpenSM
- Support for Mesh Analysis for LASH routing algorithm
- Reloadable OpenSM configuration (preliminary implementation)
- Routing paths sorted balancing (for UpDown and MinHops)
- Weighted LID matrices calculation (for UpDown, MinHop and DOR)
- I/O nodes connectivity (for FatTree)
2.6 MPI:
a. OSU MVAPICH 1.2.0
b. Open MPI 1.4
c. OSU MVAPICH2 1.4
d. MPI tests 3.2
2.7 iSER:
o Available on:
- kernel.org: 2.6.30 and higher
- RHEL5.4
2.8 NFS-RDMA
o Added support for RHEL5.4, SLES10 SP3, kernel.org 2.6.25 and 2.6.30.
Kernels 2.6.26 and 2.6.27 are not supported
o NFS-RDMA is in Beta level
===============================================================================
3. Known Issues
===============================================================================
The following is a list of general limitations and known issues of the various
components of the OFED 3.5-rc2 release.
1. When upgrading from an earlier OFED version, the installation script does
not stop the earlier OFED version prior to uninstalling it.
Workaround: Stop the old OFED stack (/etc/init.d/openibd stop) before
upgrading to OFED 3.5 or reboot the server after OFED installation.
2. Memory registration by the user is limited according to administrator
setting. See "Pinning (Locking) User Memory Pages" in OFED_tips.txt for
system configuration.
3. Fork support from kernel 2.6.12 and above is available provided
that applications do not use threads. fork() is supported as long as the
parent process does not run before the child exits or calls exec().
The former can be achieved by calling wait(childpid), and the latter can be
achieved by application specific means. The Posix system() call is
supported.
4. The qib driver is supported only on 64-bit platforms.
5. IPoIB: brctl utilities do not work on IPoIB interfaces. The reason for that
is that these utilities support devices of type Ethernet only.
6. In case uninstall is failing, check the error log and remove
the remaining RPMs manually using 'rpm -e <rpms list>'.
7. On SLES11.x, set allow_unsupported_modules parameter to 1 in file:
/etc/modprobe.d/unsupported-modules. Without this the modules will not
load.
Note: See the release notes of each component for additional issues.
^ permalink raw reply [flat|nested] 11+ messages in thread
* [ANNOUNCE] OFED-3.5-rc6 is available
[not found] ` <50F7C532.8050500-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
@ 2013-01-29 17:25 ` Vladimir Sokolovsky
[not found] ` <5108060C.1000505-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
0 siblings, 1 reply; 11+ messages in thread
From: Vladimir Sokolovsky @ 2013-01-29 17:25 UTC (permalink / raw)
To: OpenFabrics EWG; +Cc: linux-rdma
[-- Attachment #1: Type: text/plain, Size: 453 bytes --]
Hi,
OFED 3.5-rc6 is available.
The tarball is available on:
http://www.openfabrics.org/downloads/OFED/ofed-3.5/OFED-3.5-rc6.tgz
To get BUILD_ID run ofed_info
Please report any issues in bugzilla https://bugs.openfabrics.org/ for OFED 3.5
OFED-3.5-rc6 Main Changes from OFED 3.5-rc5
-------------------------------------------------------------------------------
IB/rds: correct IB api usage
perftest-2.0-0.27.g2edd80a
Regards,
Vladimir
[-- Attachment #2: OFED_release_notes.txt --]
[-- Type: text/plain, Size: 16144 bytes --]
Open Fabrics Enterprise Distribution (OFED)
Version 3.5-rc6
Release Notes
January 2013
===============================================================================
Table of Contents
===============================================================================
1. Overview, which includes:
- OFED Distribution Rev 3.5 Contents
- Supported Platforms and Operating Systems
- Supported HCA and RNIC Adapter Cards and Firmware Versions
- Tested Switch Platforms
- Third party Test Packages
- OFED sources
2. Change log
3. Known Issues
===============================================================================
1. Overview
===============================================================================
These are the release notes of OpenFabrics Enterprise Distribution (OFED)
release 3.5. The OFED software package is composed of several software modules,
and is intended for use on a computer cluster constructed as an InfiniBand
subnet or iWARP network.
Note: If you plan to upgrade the OFED package on your cluster, please upgrade
all of its nodes to this new version.
1.1 OFED 3.5 Contents
-----------------------
The OFED package contains the following components:
- OpenFabrics core and ULPs:
- IB HCA drivers (mthca, mlx4, qib, ehca)
- iWARP RNIC driver (cxgb3, cxgb4, nes)
- core
- Upper Layer Protocols: IPoIB, SRP Initiator and target, iSER
Initiator and target, RDS, uDAPL, qlgc_vnic and NFS-RDMA*.
- OpenFabrics utilities:
- OpenSM (OSM): InfiniBand Subnet Manager
- Diagnostic tools
- Performance tests
- Extra packages:
- infinipath-psm: Performance-Scaled Messaging API, an accelerated
interface to Intel(R) HCAs
- Sources of all software modules (under conditions mentioned in the modules'
LICENSE files)
- Documentation
1.2 Supported Platforms and Operating Systems
---------------------------------------------
o CPU architectures:
- x86_64
- x86
- ppc64
- ia64
o Linux Operating Systems:
- RedHat EL6.2 2.6.32-220.el6
- RedHat EL6.3 2.6.32-279.el6
- SLES11 SP2 3.0.13-0.27-default
- kernel.org 3.5 *
* Minimal QA for these versions.
1.3 HCAs and RNICs Supported
----------------------------
This release supports IB HCAs by Mellanox Technologies, Intel and IBM as
well as iWARP RNICs by Chelsio Communications and Intel.
o Mellanox Technologies HCAs (SDR, DDR and QDR Modes are Supported):
- ConnectX(R) and ConnectX EN (fw-25408 Rev 2.9.1000)
- ConnectX-2 (fw-ConnectX2 Rev 2.9.1000)
- ConnectX-2 EN (fw-ConnectX2 Rev 2.9.1200)
- ConnectX-3 (fw-ConnectX3 Rev 2.10.0700) (FDR and FDR10 Modes are Supported)
- ConnectX-3 EN (fw-ConnectX3 Rev 2.10.0800)
For official firmware versions please see:
http://www.mellanox.com/content/pages.php?pg=firmware_download
o Intel (formerly QLogic) HCAs:
- Intel(R) True Scale DDR PCIe x8 and x16 HCAs
- Intel(R) True Scale QDR PCIe x8 Gen2 HCAs
o IBM HCAs:
- GX Dual-port SDR 4x IB HCA
- GX Dual-port SDR 12x IB HCA
- GX Dual-port DDR 4x IB HCA
- GX Dual-port DDR 12x IB HCA
o Chelsio RNICs:
- S310/S320 10GbE Storage Accelerators
- R310/R320 10GbE iWARP Adapters
o Intel RNICs:
- NE020 10Gb iWARP Adapter
1.4 Switches Supported
----------------------
This release was tested with switches and gateways provided by the following
companies:
- Intel (formerly QLogic)
- Flextronics
- Oracle (Sun)
- Mellanox
1.5 Third Party Packages
------------------------
The following third party packages have been tested with OFED 3.5:
- MVAPICH2 - 1.8
- Intel MPI - 4.0.3/4.1
- Open MPI - 1.6/1.6.1/1.6.3
1.6 OFED Sources
----------------
All sources are located under git://git.openfabrics.org/
Linux:
------
URL: git://git.openfabrics.org/compat-rdma/linux-3.5.git
Branch: for-ofed-3.5
- Linux kernel subtree that includes files relevant for the OFED project only.
Based on v3.5. Used to shorten git clone time.
Note: the regular Linux git tree can be used as well.
compat:
-------
URL: git://git.openfabrics.org/compat-rdma/compat.git
Branch: ofed
- Based on compat project (https://github.com/mcgrof/compat). The compat module
provides functionality introduced in newer kernels to older kernels through a
set of header files and exported symbols.
See https://github.com/mcgrof/compat/wiki for details.
- Used to replace kernel_addons in the previous OFED kernel tree.
compat-rdma:
------------
URL: git://git.openfabrics.org/compat-rdma/compat-rdma.git
Branch: master
User level Sources are downloaded from http://www.openfabrics.org/downloads/
as written in the BUILD_ID
The kernel sources are based on Linux 3.5 mainline kernel. Its patches
are included in the OFED sources directory.
For details see HOWTO.build_ofed.
The list of maintainers is available under:
http://www.openfabrics.org/downloads/MAINTAINERS
===============================================================================
2. Change log
===============================================================================
OFED-3.5-rc6 Main Changes from OFED 3.5-rc5
-------------------------------------------------------------------------------
IB/rds: correct IB api usage
perftest-2.0-0.27.g2edd80a
OFED-3.5-rc5 Main Changes from OFED 3.5-rc4
-------------------------------------------------------------------------------
perftest-2.0-0.25.g971259d
OFED-3.5-rc4 Main Changes from OFED 3.5-rc3
-------------------------------------------------------------------------------
RDMA/nes: Fixes for OFED-3.5 RC3
RDMA/cxgb4: Keep the maximum number of stag limited to T4_MAX_NUM_STAG
Updated packages:
infinipath-psm-3.1-364.1140_open
OFED-3.5-rc3 Main Changes from OFED 3.5-rc2
-------------------------------------------------------------------------------
RDMA/nes: Fix for terminate timer crash
RDMA/nes: Fix for crash when adding timer and timer is pending
RDMA/nes: Fix for incorrect multicast address
RDMA/nes: Fix for crash when adding timer
RDMA/nes: Locking fix to prevent race conditions
RDMA/nes: Changing nes driver version
RDMA/nes: Fixes for PAU handling
cxgb4: Initialize data structures before using.
cxgb4: Fix initialization of SGE_CONTROL register
cxgb4: Add embedded firmware and its configuration file support
cxgb4/iw_cxgb4: Add LE hash collision bug fix for active and passive offloaded connections
cxgb4: Fix unable to get UP event from the LLD
cxgb4: Remove unnecessary #ifdef condition
cxgb4: Fix build warnings introduced after T4 configuration file support
cxgb4: Add support for T4 configuration file
iw_cxgb4: only log rx_data warnings if cpl status is non zero.
RDMA/cxgb4: fix mpa version mismatch
RDMA/cxgb4: abort connections that receive unexpected streaming mode data
RDMA/cxgb4: Insert hwtid in pass_accept_req instead in pass_establish
RDMA/cxgb4: Remove the limitation on maximum number of STAGs
linux-next-cherry-picks: Fix build failure for kernel < 3.2
IB/qib: remove EBUSY patch
ib_srp: Avoid that module removal can trigger a deadlock
ib_srp: Unbreak build on SLES 11 SP2
ib_srp: Add post-3.5 upstream patches
ib_srp: Avoid use-after-free during module unload on pre-2.6.36 kernels
Updated packages:
mstflint-1.4-1.23.g5c2032a
perftest-2.0-0.8.gaeb562e
qperf-0.4.9
OFED-3.5-rc2 Main Changes from OFED 3.5-rc1
-------------------------------------------------------------------------------
compat-rdma: Add SRP backport
compat-rdma: /etc/init.d/openibd: Fix LSB header
compat-rdma: IB/qib: linux-3.6 patches backported
compat-rdma: iw_cxgb4: Fix bug 2369 in OFED bugzilla
compat-rdma: IB/qib: fix compliance regression in 3.5
compat-rdma: RDMA/nes: Add linux-next-pending patches
compat-rdma: RDMA/nes: Updated backports
compat-rdma: NFSRDMA RHEL6.3 backport
compat-rdma: NFSRDMA SLES11SP2 backport
compat-rdma: linux-next-cherry-picks: RDMA/ucma.c: Different fix for ucma context uid=0, causing iWarp RDMA applications to fail in connection establishment
Updated packages:
infinipath-psm-3.0.1-115.1015_open
perftest-1.4.0-0.80.gd1763bd
qperf-0.4.7-0.2.gf3f7001
OFED-3.5-rc1 Main Changes from OFED 3.2-rc1
-------------------------------------------------------------------------------
1. Based on linux-3.5 kernel
2. Updated packages:
ibacm-1.0.7
librdmacm-1.0.16
dapl-2.0.36
Management:
libibumad-1.3.8
infiniband-diags-1.6.1
opensm-3.3.15
3. Removed libsdp, sdpnetstat
OFED-3.5-rc1 Main Changes from OFED 1.5.4.1
-------------------------------------------------------------------------------
1. Based on linux-3.5 kernel
2. kernel-ib RPM renamed to compat-rdma
3. Removed MPI packages
4. Updated packages:
libibverbs-1.1.6
libmlx4-1.0.4
dapl-2.0.35
ibacm-1.0.6
perftest-1.4.0-0.66.g9074687
Management:
libibmad-1.3.9
opensm-3.3.14
infiniband-diags-1.6.0
OFED-1.5.4 Main Changes from OFED 1.5.3.2
-------------------------------------------------------------------------------
1. Add kernel 3.0 support
2. Add RHEL6.2 support
3. Add NFSRDMA to the list of packages to be installed by default on supported
platforms
4. Add new InfiniBand link speeds: EDR/FDR/FDR10
5. OFA Kernel: See ofa_kernel.changelog.txt
6. Updated packages:
libibverbs-1.1.4-1.24.gb89d4d7
libmlx4-1.0.1-1.20.g6771d22
libnes-1.1.3
libcxgb3-1.3.1
libcxgb4-1.2.0
dapl-2.0.34
ibacm-1.0.5
librdmacm-1.0.15
infinipath-psm-2.9-926.1005_open
ibutils-1.5.7-0.1.g05a9d1a
perftest-1.3.0-0.56.gd6f6093
mstflint-1.4-1.18.g1adcfbf
Management:
libibmad-1.3.8
infiniband-diags-1.5.12
opensm-3.3.12
MPI:
mvapich2-1.7-5.2011svn5031
OFED-1.5.3.2 Main Changes from OFED 1.5.3.1
-------------------------------------------------------------------------------
1. Add RHEL5.7 support
2. Add RHEL6.1 support
3. Add kernel.org 2.6.37 - 2.6.39 support
4. ib-bonding-0.9.0-43 (SLES10 SP4 support)
OFED-1.5.3.1 Main Changes from OFED 1.5.3
-------------------------------------------------------------------------------
1. Fix QIB support on SLES10 SP3
OFED-1.5.3 Main Changes from OFED 1.5.2
-------------------------------------------------------------------------------
1. Updated packages:
dapl-2.0.32
librdmacm-1.0.14.1
ibacm-1.0.4
libibmad-1.3.7
libibumad-1.3.7
infiniband-diags-1.5.8
opensm-3.3.9
ibutils-1.5.7
libibverbs-1.1.4-1.22.g7257cd3.tar.gz
libmlx4-1.0.1-1.18.gb810a27.tar.gz
libnes-1.1.1
infinipath-psm-1.14
libsdp-1.1.108-0.15.gd7fdb72
mstflint-1.4-0.9.gc683022
sdpnetstat-1.60-0.3.gb6e7425
perftest-1.3.0-0.42.gf350d3d
- MPI
openmpi-1.4.3-1
mvapich2-1.6-2
2. Added RHEL6 support
3. Added RHEL5.6 support
4. Improved RAW Ethernet QP support (requires ConnectX/ConnectX2 FW >= 2.8.0600)
5. NFSoRDMA was removed from the list of packages in the install script to
prevent its installation by default.
To force NFSoRDMA installation, add the following lines to the ofed.conf:
nfsrdma=y
rnfs-utils=y
To get ofed.conf, run
# ./install.pl -p
After adding the lines above to ofed.conf, to install OFED run
# ./install.pl -c ofed.conf
OFED-1.5.2 Main Changes from OFED 1.5.1
-------------------------------------------------------------------------------
1. Added RHEL5.5, SLES11 SP1 and kernel 2.6.33 support
2. /etc/modprobe.conf deprecated
ib_ipoib use /etc/modprobe.d/ib_ipoib.conf
ib_sdp use /etc/modprobe.d/ib_sdp.conf
mlx4_en use /etc/modprobe.d/mlx4_en.conf
3. Added RAW Ethernet QP support in libibverbs
4. Added multicast support in perftest
5. Added new package: ibacm. See ibacm_release_notes.txt
6. Added new package infinipath-psm.
7. Updated packages:
libibverbs to rev 1.1.4-0.14.gb6c138b
libehca to rev 1.2.2-0.1.g69e1a88
libmlx4 to rev 1.0-0.13.g4e5c43f
libnes to rev 1.1.0
librdmacm to rev 1.0.13
dapl to rev 2.0.30
compat-depl to rev 1.2.19
libsdp to rev 1.1.103
mstflint to rev 1.4-0.6.g63179f4
perftest to rev 1.3.0-0.27
rds-tools to rev 2.0.4
Management:
opensm to rev 3.3.7
libibmad to rev 1.3.6
libibumad to rev 1.3.6
infiniband-diags to rev 1.5.7
MPI:
openmpi to rev 1.4.2-1
mvapich2 to rev 1.5.1-2.p1
mpitests to rev 3.2-923
OFED-1.5.1 Main Changes from OFED 1.5
-------------------------------------------------------------------------------
1. Added RoCEE support - see RoCEE_README.txt
2. Added enhanced atomic operations to ConnectX (kernel only).
See mlx4_release_notes.txt.
3. Updated Open MPI to rev 1.4.1-2ofed
4. Updated MVAPICH2 to rev 1.4.1
5. Updated DAPL to rev 2.0.27
6. Updated libnes to rev 1.0.1
7. Updated librdmacm to rev 1.0.11
8. Removed tvflash RPM
9. NFS-RDMA is not supported on SLES10 SP3
10. Fixed IPv6 support and IPv4 routing corner cases for RDMA CM
11. Bug fixes
OFED-1.5 Main Changes from OFED 1.4.2
-------------------------------------------------------------------------------
Note: For details regarding the various changes, please see the release notes
for each package in the docs directory.
2.1 General changes
o Kernel code based on 2.6.30
o libraries location - all userspace libraries can be downloaded from
http://www.openfabrics.org/downloads/
See BUILD_ID for exact locations
o Qlogic moved the low level driver from ipath to qib.
2.2 SDP
o Performance improvements
o Zero copy in beta level
2.3 uDAPL
o New UCM provider (ofa-v2-mlx4_0-1u) with IB UD-based CM per process.
It is more scalable than rdma_cm (cma) or socket cm (scm).
o Common code base with WinOF 2.1
o Bug fixes
2.4 perftest
o Renamed tests:
ib_rdma_bw -> rdma_bw
ib_rdma_lat -> rdma_lat
2.5 Management
o OpenSM
- Support for Mesh Analysis for LASH routing algorithm
- Reloadable OpenSM configuration (preliminary implementation)
- Routing paths sorted balancing (for UpDown and MinHops)
- Weighted LID matrices calculation (for UpDown, MinHop and DOR)
- I/O nodes connectivity (for FatTree)
2.6 MPI:
a. OSU MVAPICH 1.2.0
b. Open MPI 1.4
c. OSU MVAPICH2 1.4
d. MPI tests 3.2
2.7 iSER:
o Available on:
- kernel.org: 2.6.30 and higher
- RHEL5.4
2.8 NFS-RDMA
o Added support for RHEL5.4, SLES10 SP3, kernel.org 2.6.25 and 2.6.30.
Kernels 2.6.26 and 2.6.27 are not supported
o NFS-RDMA is in Beta level
===============================================================================
3. Known Issues
===============================================================================
The following is a list of general limitations and known issues of the various
components of the OFED 3.5-rc2 release.
1. When upgrading from an earlier OFED version, the installation script does
not stop the earlier OFED version prior to uninstalling it.
Workaround: Stop the old OFED stack (/etc/init.d/openibd stop) before
upgrading to OFED 3.5 or reboot the server after OFED installation.
2. Memory registration by the user is limited according to administrator
setting. See "Pinning (Locking) User Memory Pages" in OFED_tips.txt for
system configuration.
3. Fork support from kernel 2.6.12 and above is available provided
that applications do not use threads. fork() is supported as long as the
parent process does not run before the child exits or calls exec().
The former can be achieved by calling wait(childpid), and the latter can be
achieved by application specific means. The Posix system() call is
supported.
4. The qib driver is supported only on 64-bit platforms.
5. IPoIB: brctl utilities do not work on IPoIB interfaces. The reason for that
is that these utilities support devices of type Ethernet only.
6. In case uninstall is failing, check the error log and remove
the remaining RPMs manually using 'rpm -e <rpms list>'.
7. On SLES11.x, set allow_unsupported_modules parameter to 1 in file:
/etc/modprobe.d/unsupported-modules. Without this the modules will not
load.
Note: See the release notes of each component for additional issues.
^ permalink raw reply [flat|nested] 11+ messages in thread
* [ANNOUNCE] OFED-3.5 is available
[not found] ` <5108060C.1000505-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
@ 2013-02-14 16:59 ` Vladimir Sokolovsky
0 siblings, 0 replies; 11+ messages in thread
From: Vladimir Sokolovsky @ 2013-02-14 16:59 UTC (permalink / raw)
To: OpenFabrics EWG; +Cc: linux-rdma
[-- Attachment #1: Type: text/plain, Size: 994 bytes --]
Hi,
OFED 3.5 is available.
The tarball is available on:
http://www.openfabrics.org/downloads/OFED/ofed-3.5/OFED-3.5.tgz
To get BUILD_ID run ofed_info
Please report any issues in bugzilla https://bugs.openfabrics.org/ for OFED 3.5
OFED-3.5 Main Changes from OFED 1.5.4.1 and 1.5.4
-------------------------------------------------------------------------------
1. Based on linux-3.5 kernel
2. kernel-ib RPM renamed to compat-rdma
3. Removed MPI packages and tests
4. Removed SDP kernel module and libsdp, sdpnetstat
5. XRC is supported in kernel only
6. Removed support for the OSes:
- RHEL 5.X
- SLES 10 SPx
7. Updated packages:
- libibverbs-1.1.6
- librdmacm-1.0.16
- ibacm-1.0.7
- dapl-2.0.36
- opensm-3.3.15
- infiniband-diags-1.6.1
- libibmad-1.3.9
- libibumad-1.3.8
- infinipath-psm-3.1-364.1140_open
- libmlx4-1.0.4
- mstflint-1.4-1.23.g5c2032a
- perftest-2.0-0.27.g2edd80a
- qperf-0.4.9
Regards,
Vladimir
[-- Attachment #2: OFED_release_notes.txt --]
[-- Type: text/plain, Size: 8051 bytes --]
Open Fabrics Enterprise Distribution (OFED)
Version 3.5
Release Notes
February 2013
===============================================================================
Table of Contents
===============================================================================
1. Overview, which includes:
- OFED Distribution Rev 3.5 Contents
- Supported Platforms and Operating Systems
- Supported HCA and RNIC Adapter Cards and Firmware Versions
- Tested Switch Platforms
- Third party Test Packages
- OFED sources
2. Change log
3. Known Issues
===============================================================================
1. Overview
===============================================================================
These are the release notes of OpenFabrics Enterprise Distribution (OFED)
release 3.5. The OFED software package is composed of several software modules,
and is intended for use on a computer cluster constructed as an InfiniBand
Fabric, an iWARP Network or a RoCE Fabric.
Note: If you plan to upgrade the OFED package on your cluster, please upgrade
all of its nodes to this new version.
1.1 OFED 3.5 Contents
-----------------------
The OFED package contains the following components:
- OpenFabrics core and ULPs:
- IB HCA drivers (mthca, mlx4, qib, ehca)
- iWARP RNIC driver (cxgb3, cxgb4, nes)
- RoCE drivers (mlx4)
- ib core
- Upper Layer Protocols: IPoIB, SRP Initiator and target, iSER
Initiator and target, RDS, uDAPL, qlgc_vnic and NFS-RDMA*.
- OpenFabrics utilities:
- OpenSM (OSM): InfiniBand Subnet Manager
- Diagnostic tools
- Performance tests
- Extra packages:
- infinipath-psm: Performance-Scaled Messaging API, an accelerated
interface to Intel(R) HCAs
- Sources of all software modules (under conditions mentioned in the modules'
LICENSE files)
- Documentation
1.2 Supported Platforms and Operating Systems
---------------------------------------------
o CPU architectures:
- x86_64
- x86
- ppc64
o Linux Operating Systems:
- RedHat EL6.2 2.6.32-220.el6
- RedHat EL6.3 2.6.32-279.el6
- SLES11 SP2 3.0.13-0.27-default
- kernel.org 3.5 *
* Minimal QA for these versions.
1.3 HCAs and RNICs Supported
----------------------------
This release supports IB HCAs by IBM, Intel and Mellanox Technologies, iWARP RNICs by Chelsio Communications and Intel and RoCE adapters by IBM and Mellanox.
InfiniBand Adapters
o IBM HCAs:
- GX Dual-port SDR 4x IB HCA
- GX Dual-port SDR 12x IB HCA
- GX Dual-port DDR 4x IB HCA
- GX Dual-port DDR 12x IB HCA
o Intel (formerly QLogic) HCAs:
- Intel(R) True Scale DDR PCIe x8 and x16 HCAs
- Intel(R) True Scale QDR PCIe x8 Gen2 HCAs
o Mellanox Technologies HCAs (SDR, DDR and QDR Modes are Supported):
- ConnectX(R) and ConnectX EN (fw-25408 Rev 2.9.1000)
- ConnectX-2 (fw-ConnectX2 Rev 2.9.1000)
- ConnectX-3 (fw-ConnectX3 Rev 2.11.0500) (FDR and FDR10 Modes are Supported)
For official firmware versions please see:
http://www.mellanox.com/content/pages.php?pg=firmware_download
iWARP Adapters
o Chelsio RNICs:
- S310/S320 10GbE Storage Accelerators
- R310/R320 10GbE iWARP Adapters
- T4 Based Adapters with the exception of the T420-SO-CR
o Intel RNICs:
- NE020 10Gb iWARP Adapter
RoCE Adapters
o IBM
- IBM Flex System EN4132 2-port 10 GbE RoCE
- IBM EL27 PCIe LP 2-Port 10GbE RoCE SFP+ adapter
- IBM EC28 PCIe 2-Port 10GbE RoCE SFP+ adapter
o Mellanox
- ConnectX-2 EN (fw-ConnectX2 Rev 2.9.1200)
- ConnectX-3 EN (fw-ConnectX3 Rev 2.11.0500)
1.4 Switches Supported
----------------------
This release was tested with switches and gateways provided by the following
companies:
InfiniBand Switches
o Flextronics
- F-X430044
o Intel (formerly QLogic)
- 12200
o Mellanox
- IS-5030
- SX6025
- SX6036
iWARP Switches
o Fujitisu
- XG2000C 10Gb Ethernet Switch
RoCE Switches
o Arista
o BLADE Network Technologies (BNT)
o Mellanox
- SX1036
- SX1024
- SX1016
1.5 Third Party Packages
------------------------
The following third party packages have been tested with OFED 3.5:
- MVAPICH2 - 1.8
- Intel MPI - 4.1
- Open MPI - 1.6/1.6.1
1.6 OFED Sources
----------------
All sources are located under git://git.openfabrics.org/
Linux:
------
URL: git://git.openfabrics.org/compat-rdma/linux-3.5.git
Branch: for-ofed-3.5
- Linux kernel sub-tree that includes files relevant for the OFED project only.
Based on v3.5. Used to shorten git clone time.
Note: the regular Linux git tree can be used as well.
compat:
-------
URL: git://git.openfabrics.org/compat-rdma/compat.git
Branch: ofed
- Based on compat project (https://github.com/mcgrof/compat). The compat module
provides functionality introduced in newer kernels to older kernels through a
set of header files and exported symbols.
See https://github.com/mcgrof/compat/wiki for details.
- Used to replace kernel_addons in the previous OFED kernel tree.
compat-rdma:
------------
URL: git://git.openfabrics.org/compat-rdma/compat-rdma.git
Branch: master
User level Sources are downloaded from http://www.openfabrics.org/downloads/
as written in the BUILD_ID
The kernel sources are based on Linux 3.5 mainline kernel. Its patches
are included in the OFED sources directory.
For details see HOWTO.build_ofed.
The list of maintainers is available under:
http://www.openfabrics.org/downloads/MAINTAINERS
===============================================================================
2. Change log
===============================================================================
OFED-3.5 Main Changes from OFED 1.5.4.1 and 1.5.4
-------------------------------------------------------------------------------
1. Based on linux-3.5 kernel
2. kernel-ib RPM renamed to compat-rdma
3. Removed MPI packages and tests
4. Removed SDP kernel module and libsdp, sdpnetstat
5. XRC is supported in kernel only
6. Removed support for the OSes:
- RHEL 5.X
- SLES 10 SPx
7. Updated packages:
- libibverbs-1.1.6
- librdmacm-1.0.16
- ibacm-1.0.7
- dapl-2.0.36
- opensm-3.3.15
- infiniband-diags-1.6.1
- libibmad-1.3.9
- libibumad-1.3.8
- infinipath-psm-3.1-364.1140_open
- libmlx4-1.0.4
- mstflint-1.4-1.23.g5c2032a
- perftest-2.0-0.27.g2edd80a
- qperf-0.4.9
===============================================================================
3. Known Issues
===============================================================================
The following is a list of general limitations and known issues of the various
components of the OFED 3.5-rc2 release.
1. When upgrading from an earlier OFED version, the installation script does
not stop the earlier OFED version prior to uninstalling it.
Workaround: Stop the old OFED stack (/etc/init.d/openibd stop) before
upgrading to OFED 3.5 or reboot the server after OFED installation.
2. Memory registration by the user is limited according to administrator
setting. See "Pinning (Locking) User Memory Pages" in OFED_tips.txt for
system configuration.
3. Fork support from kernel 2.6.12 and above is available provided
that applications do not use threads. fork() is supported as long as the
parent process does not run before the child exits or calls exec().
The former can be achieved by calling wait(childpid), and the latter can be
achieved by application specific means. The Posix system() call is
supported.
4. The qib driver is supported only on 64-bit platforms.
5. IPoIB: brctl utilities do not work on IPoIB interfaces. The reason for that
is that these utilities support devices of type Ethernet only.
6. In case uninstall is failing, check the error log and remove
the remaining RPMs manually using 'rpm -e <rpms list>'.
7. On SLES11.x, set allow_unsupported_modules parameter to 1 in file:
/etc/modprobe.d/unsupported-modules. Without this the modules will not
load.
8. RDS is supported only on kernel.org 3.5 and not on any distro OS.
Note: See the release notes of each component for additional issues.
^ permalink raw reply [flat|nested] 11+ messages in thread
end of thread, other threads:[~2013-02-14 16:59 UTC | newest]
Thread overview: 11+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2012-10-03 15:54 [ANNOUNCE] OFED-3.5-rc2 is available Vladimir Sokolovsky
[not found] ` <506C5FBE.1080004-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2012-10-03 16:13 ` Jeff Becker
2012-10-03 20:30 ` Woodruff, Robert J
2012-10-04 10:05 ` Sebastian Riemer
[not found] ` <506D5F5D.9050308-EIkl63zCoXaH+58JC4qpiA@public.gmane.org>
2012-10-04 15:49 ` Vladimir Sokolovsky
2012-12-11 9:02 ` [ANNOUNCE] OFED-3.5-rc3 " Vladimir Sokolovsky
[not found] ` <50C6F6BC.6090701-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2013-01-03 16:11 ` [ANNOUNCE] OFED-3.5-rc4 " Vladimir Sokolovsky
[not found] ` <50E5AD97.8030300-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2013-01-03 19:53 ` Vasiliy Tolstov
2013-01-17 9:32 ` [ANNOUNCE] OFED-3.5-rc5 " Vladimir Sokolovsky
[not found] ` <50F7C532.8050500-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2013-01-29 17:25 ` [ANNOUNCE] OFED-3.5-rc6 " Vladimir Sokolovsky
[not found] ` <5108060C.1000505-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2013-02-14 16:59 ` [ANNOUNCE] OFED-3.5 " Vladimir Sokolovsky
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).