[LU-2847] configure --with-o2ib

• Status: Open
• Project: Lustre
• Affects Version/s: Lustre 2.4.0
• Type: Story
• Priority: Minor
• Reporter: Frank Heckes (Inactive)
• Assignee: WC Triage
• Resolution: Unresolved

Description

Lustre Jenkins builds:

eval ./configure --build=x86_64-unknown-linux-gnu --host=x86_64-unknown-linux-gnu --target=x86_64-redhat-linux-gnu --program-prefix= --prefix=/usr --exec-prefix=/usr --bindir=/usr/bin --sbindir=/usr/sbin --sysconfdir=/etc --datadir=/usr/share --includedir=/usr/include --libdir=/usr/lib64 --libexecdir=/usr/libexec --localstatedir=/var --sharedstatedir=/var/lib --mandir=/usr/share/man --infodir=/usr/share/info --with-linux=/var/lib/jenkins/workspace/lustre-reviews-vib/arch/x86_64/build_type/server/distro/el6/ib_stack/vofa/BUILD/reused/usr/src/kernels/2.6.32-279.19.1.el6_lustre.g216f3d9.x86_64 --with-linux-obj=/var/lib/jenkins/workspace/lustre-reviews-vib/arch/x86_64/build_type/server/distro/el6/ib_stack/vofa/BUILD/reused/usr/src/kernels/2.6.32-279.19.1.el6_lustre.g216f3d9.x86_64 --with-ldiskfs=/var/lib/jenkins/workspace/lustre-reviews-vib/arch/x86_64/build_type/server/distro/el6/ib_stack/vofa/BUILD/BUILD/lustre-ldiskfs-3.3.0 --with-zfs=/var/lib/jenkins/workspace/lustre-reviews-vib/arch/x86_64/build_type/server/distro/el6/ib_stack/vofa/BUILD/usr/src/zfs-0.6.0-rc10/2.6.32-279.19.1.el6_lustre.g216f3d9.x86_64 --with-spl=/var/lib/jenkins/workspace/lustre-reviews-vib/arch/x86_64/build_type/server/distro/el6/ib_stack/vofa/BUILD/usr/src/spl-0.6.0-rc10/2.6.32-279.19.1.el6_lustre.g216f3d9.x86_64 --with-o2ib=/var/lib/jenkins/workspace/lustre-reviews-vib/arch/x86_64/build_type/server/distro/el6/ib_stack/vofa/BUILD/kernel-ib-devel/usr/src/ofa_kernel --enable-liblustre --enable-liblustre-tests --with-release=2.6.32_279.19.1.el6_lustre.g216f3d9.x86_64_ge95d360 --enable-tests --enable-liblustre-tests

or 'manual' Lustre build:

./configure --with-linux=/usr/src/kernels/2.6.32-279.19.1.el6.x86_64 --with-o2ib=/usr/src/ofa_kernel/default

break with error:

checking whether to enable OpenIB gen2 support... no
configure: error: can't compile with OpenIB gen2 headers under /usr/src/ofa_kernel/default

Reason is that compiler environment (O2IBCPPFLAGS, EXTRA_KCFLAGS, EXTRA_LNET_INCLUDE) is not set correct in section `checking whether to enable OpenIB gen2 support...´, since variables O2IBPATHS, ENABLEO2IB or not set although option `--with-o2ib´ was specified on the command line.
I.e. code section:

else
O2IBPATH=$(readlink --canonicalize $O2IBPATH)
O2IBCPPFLAGS="-I$O2IBPATH/include"
EXTRA_KCFLAGS_save="$EXTRA_KCFLAGS"
EXTRA_KCFLAGS="$EXTRA_KCFLAGS $O2IBCPPFLAGS"
EXTRA_LNET_INCLUDE="$EXTRA_LNET_INCLUDE $O2IBCPPFLAGS"

cat >conftest.$ac_ext <<_ACEOF

isn't reached.

Setting O2IBPATHS to the argument set, ENABLEO2IB explicitly works as a 'work-around' (okay, dirty hack) to make builds possible.

Comments

[Brian Murrell (Inactive)]

Which build was this? The most recent el6/x86 build on lustre-master seems to be building with OpenIB gen2 support:

checking whether to enable OpenIB gen2 support... yes

[Frank Heckes (Inactive)]

It was a build associated with change with change gerrit:5295,patch7. It's based on a Mellanox (SR-IOV enabled) OFED stack. You can see the builds on jenkins-staging@lustre-reviews-vib.

[Brian Murrell (Inactive)]

OK. So this is a problem with a specific patch being worked on and not a general --with-o2ib issue.