[LU-5952] ko2iblnd not built with kernel 2.6.32-504.1.3

• Type: Bug
• Resolution: Fixed
• Priority: Minor
• Affects Version/s: Lustre 1.8.7
• Environment: Scientific Linux 6.5
• Severity: 3
• Assignee: WC Triage
• Reporter: John DeSantis (Inactive)

Description

Hello Lustre tream!

We're seeing an issue with the ko2iblnd module not being built properly any longer with our lustre 1.8.7 source with the latest 2.6.32-504.x Linux kernel.

We have successfully been building RPM's utilizing the command below for several kernel revisions: 2.6.32_220.x, 2.6.32_279.x, 2.6.32_358.x, and 2.6.32_431.x.

./configure --with-linux=/lib/modules/KERNEL_VERSION/build --disable-lru-resize --enable-ext4 --disable-server

However, with the release of 2.6.32_504.x we are now seeing that the ko2iblnd module isn't built, and as a result we get I/O errors when loading the lustre module:

LustreError: 2897:0:(api-ni.c:1081:lnet_startup_lndnis()) Can't load LND o2ib, module ko2iblnd, rc=256
LustreError: 2897:0:(events.c:725:ptlrpc_init_portals()) network initialisation failed

Looking over Google and other Jira tickets, we found that using "--with-o2ib=yes" produces the error (which is probably just a red herring):

configure: error: can't compile with kernel OpenIB gen2 headers

Given that the other builds were successful, I am fairly certain that this is a kernel issue, but I wanted to double-check here first. I've attached the config.log for perusal.

Here is an RPM package query from the latest build to the most recent twp:

1. pwd
   /root/rpmbuild/RPMS/x86_64

1. ls -1t lustre-modules-1.8.7-2.6.32_*|head -3
   lustre-modules-1.8.7-2.6.32_504.1.3.el6.x86_64.x86_64.rpm
   lustre-modules-1.8.7-2.6.32_431.29.2.el6.x86_64.x86_64.rpm
   lustre-modules-1.8.7-2.6.32_431.23.3.el6.x86_64.x86_64.rpm

1. ls -1t lustre-modules-1.8.7-2.6.32_*|head -3|xargs -I'{}' rpm -qlp {} |grep ko2iblnd
   /lib/modules/2.6.32-431.29.2.el6.x86_64/updates/kernel/net/lustre/ko2iblnd.ko
   /lib/modules/2.6.32-431.23.3.el6.x86_64/updates/kernel/net/lustre/ko2iblnd.ko

Thank you for any guidance and/or additional information.

John DeSantis

Issue Links

• is related to: LU-5909 Kernel update [RHEL6.6 2.6.32-504.1.3.el6]