https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-1327 Lustre <p>RHEL5.8 support has just been landed to b1_8 and there is unfortunately no external version of OFED which supports this kernel yet. The consequence is that builds with external OFED are failing.<br/> Shall we disable builds with external OFED temporarily?</p> LU-1327

No OFED support for RHEL5.8 2.6.18-308.1.1.el5

Bug Minor Resolved Fixed Minh Diep Johann Lombardi Thu, 12 Apr 2012 18:19:32 +0000 Thu, 3 May 2012 13:26:10 +0000 Mon, 30 Apr 2012 12:04:33 +0000 0 6 <p>I just added Brian and Minh as watchers. I would like to know what the likelihood of there being an OFED release soon that supports RHEL5.8.</p> <p>Also, any idea why there is an OFED 3.2 version? That seems a jump from the current 1.5.x....</p> <p>My guess re: OFED 3.2: they are changing their development model so that they are working against (i.e. backporting to using the "compat" library) what is in the kernel and adjusting their versions to be in parity with the kernel they are working against.</p> <p>This might help explain: <a href="http://lists.openfabrics.org/pipermail/ewg/2012-February/017303.html" class="external-link" target="_blank" rel="nofollow noopener">http://lists.openfabrics.org/pipermail/ewg/2012-February/017303.html</a></p> <p>This git tree shows some sign of backports for RHEL 6.2: <a href="http://git.openfabrics.org/git?p=compat-rdma/compat-rdma.git;a=summary" class="external-link" target="_blank" rel="nofollow noopener">http://git.openfabrics.org/git?p=compat-rdma/compat-rdma.git;a=summary</a> but nothing older (i.e. RHEL 5.8)</p> <p>As for RHEL 5.8 support elsewhere, I don't really know. I have been "unplugged" from the OFED development stream for quite a while now. IMHO, if we want to be tracking and supporting OFED for our releases, we need to have somebody at least monitoring what's going on with the OFA group and what they are doing so that we don't wind up "out of the loop" like this and trying to piece together what they are up to.</p> <p>That said, there doesn't seem to be any new activity in <a href="http://git.openfabrics.org/git?p=ofed_1_5/linux-2.6.git;a=summary" class="external-link" target="_blank" rel="nofollow noopener">http://git.openfabrics.org/git?p=ofed_1_5/linux-2.6.git;a=summary</a> with 1.5.4.1 being the last thing done there which only seems to have support for RHEL up to 5.7.</p> <p>For b1_8 master builds external ofed is now not supported. Rather than just remove the builds which could lead to confusion a README file is produced with the following contents;</p> <p>16th April 2011.<br/> ****************<br/> OFED does not currently support RHEL5.8 and so cannot be built for b1_8. See <a href="https://jira.whamcloud.com/browse/LU-1327" title="No OFED support for RHEL5.8 2.6.18-308.1.1.el5" class="issue-link" data-issue-key="LU-1327"><del>LU-1327</del></a> for more information.<br/> If 5.8 support becomes available for OFED then raise a ticket to have the build renabled.</p> <p>I have gotten Lustre 1.8 on RHEL5.8 to build with OFED 1.5.4.1. You need to set the BACKPORT_DIR variable to 2.6.18-EL5.7. I also have built and tested a file system with this combo.</p> <p>Minh</p> <p>Could you please try this out?</p> <p>Thanks</p> <p>Peter</p> <p>...and thanks for the suggestion James!</p> <p>Hi James,</p> <p>Here is the configure command we ran to build ofed</p> <p>+ ./configure --prefix=/usr --kernel-version 2.6.18-308.1.1.el5 --kernel-sources /home/mdiep/build/b1_8/lustre/reused/usr/src/kernels/2.6.18-308.1.1.el5-x86_64 --modules-dir /lib/modules/2.6.18-308.1.1.el5/updates --without-quilt --with-core-mod --with-ipoib-mod --with-sdp-mod --with-user_mad-mod --with-user_access-mod --with-addr_trans-mod --with-rds-mod --with-qlgc_vnic-mod --with-madeye-mod --with-mthca-mod --with-mlx4-mod --with-mlx4_en-mod --with-cxgb3-mod --with-nes-mod<br/> config.mk does not exist. running ofed_patch.sh<br/> /home/mdiep/build/b1_8/lustre/BUILD/ofa_kernel-1.5.4.1/ofed_scripts/ofed_patch.sh --kernel-version 2.6.18-308.1.1.el5 --without-quilt</p> <p>...<br/> and we see that it actually used the 2.6.18-EL5.7 backport patches</p> <p>Applying patches for 2.6.18-EL5.7 kernel:<br/> /home/mdiep/build/b1_8/lustre/BUILD/ofa_kernel-1.5.4.1/kernel_patches/backport/2.6.18-EL5.7/2_misc_device_to_2_6_19.patch<br/> patching file drivers/infiniband/core/ucma.c<br/> Hunk #1 succeeded at 1298 (offset 91 lines).<br/> Hunk #3 succeeded at 1326 (offset 91 lines).</p> <p>...</p> <p>but it still failed</p> <p>-I/home/mdiep/build/b1_8/lustre/reused/usr/src/kernels/2.6.18-308.1.1.el5-x86_64/arch//include \<br/> -Wall -Wundef -Wstrict-prototypes -Wno-trigraphs -fno-strict-aliasing -fno-common -Wstrict-prototypes -Wundef -Werror-implicit-function-declaration -fno-delete-null-pointer-checks -fwrapv -Os -mtune=generic -m64 -mno-red-zone -mcmodel=kernel -pipe -fno-reorder-blocks -Wno-sign-compare -fno-asynchronous-unwind-tables -funit-at-a-time -mno-sse -mno-mmx -mno-sse2 -mno-3dnow -fomit-frame-pointer -g -fno-stack-protector -Wdeclaration-after-statement -Wno-pointer-sign -DMODULE -D"KBUILD_STR(s)=#s" -D"KBUILD_BASENAME=KBUILD_STR(notice)" -D"KBUILD_MODNAME=KBUILD_STR(ib_sa)" -c -o /home/mdiep/build/b1_8/lustre/BUILD/ofa_kernel-1.5.4.1/drivers/infiniband/core/.tmp_notice.o /home/mdiep/build/b1_8/lustre/BUILD/ofa_kernel-1.5.4.1/drivers/infiniband/core/notice.c<br/> In file included from /home/mdiep/build/b1_8/lustre/BUILD/ofa_kernel-1.5.4.1/drivers/infiniband/core/notice.c:37:<br/> /home/mdiep/build/b1_8/lustre/BUILD/ofa_kernel-1.5.4.1/kernel_addons/backport/2.6.18-EL5.7/include/linux/pci.h:164: error: conflicting types for ‘pci_pcie_cap’<br/> include/linux/pci.h:1015: error: previous definition of ‘pci_pcie_cap’ was here<br/> make<span class="error">&#91;4&#93;</span>: *** <span class="error">&#91;/home/mdiep/build/b1_8/lustre/BUILD/ofa_kernel-1.5.4.1/drivers/infiniband/core/notice.o&#93;</span> Error 1<br/> make<span class="error">&#91;3&#93;</span>: *** <span class="error">&#91;/home/mdiep/build/b1_8/lustre/BUILD/ofa_kernel-1.5.4.1/drivers/infiniband/core&#93;</span> Error 2<br/> make<span class="error">&#91;2&#93;</span>: *** <span class="error">&#91;/home/mdiep/build/b1_8/lustre/BUILD/ofa_kernel-1.5.4.1/drivers/infiniband&#93;</span> Error 2<br/> make<span class="error">&#91;1&#93;</span>: *** <span class="error">&#91;_module_/home/mdiep/build/b1_8/lustre/BUILD/ofa_kernel-1.5.4.1&#93;</span> Error 2<br/> make<span class="error">&#91;1&#93;</span>: Leaving directory `/home/mdiep/build/b1_8/lustre/reused/usr/src/kernels/2.6.18-308.1.1.el5-x86_64'<br/> make: *** <span class="error">&#91;kernel&#93;</span> Error 2<br/> error: Bad exit status from /var/tmp/rpm-tmp.763 (%build)</p> <p>Oh, I forgot I did patch the OFED kernel for this problem. The question is how to work this so your build system would work out of the box. Thinking.... Perhaps we can add kernel patch in the Lustre tree to make this work. Yes I know it is hocky but it would work. It seems we have no choice since OFED is moving on to 3.2 now which is not even ready. Le me see what I can come up with.</p> <p>James</p> <p>I think that the correct approach would be for us to proceed with 1.8.8-wc1 with inkernel OFED only and then those looking to use external OFED with 1.8.8-wc1 will be able to do so with a patched version of OFED.</p> <p>Peter</p> <p>James,</p> <p>Can I close this bug since it has nothing to do with lustre? We can reopen when OFED provide a patch for new kernel</p> <p>Yes go ahead. It's not really a Lustre issue. Once OFED 3.2 comes out then we can deal with this.</p> <p>closing, please reopen when it's needed</p> <p>I have tried ofed 1.5.3.2 and it worked</p> <p>To be clear, this is the <em>Mellanox</em> version of OFED.</p> <p>Sorry about not being clear. I have tried both Mellanox version which I think is based on ofed 1.5.3.2; and standard ofed 1.5.3.2. I reason they worked because this ofed version does not have the patch for pci.h file where it declares pci_pcie_cap (which linux kernel added in 5.8)</p> Development Rank 1|hzus1b: Rank (Obsolete) 2204 Severity