<!-- 
RSS generated by JIRA (9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c) at Sat Feb 10 03:08:32 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>Whamcloud Community JIRA</title>
    <link>https://jira.whamcloud.com</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.4.14</version>
        <build-number>940014</build-number>
        <build-date>05-12-2023</build-date>
    </build-info>


<item>
            <title>[LU-14297] Can&apos;t compile lustre client against MLNX OFED-5.2-1.0.4 on Centos 7.8</title>
                <link>https://jira.whamcloud.com/browse/LU-14297</link>
                <project id="10000" key="LU">Lustre</project>
                    <description>&lt;p&gt;Hello, I am trying to install lustre on our lnet routers which have connectx-5 cards installed in them using dkms on Centos 7.8 with kernel 3.10.0-1127.19.1.el7.x86_64. Also Mellanox just released their latest driver version OFED-5.2-1.0.4 yesterday Jan 4, 2021. When dkms tries to compile lustre, it fails with the following at end:&lt;/p&gt;

&lt;p&gt;configure: LNet kernel checks&lt;br/&gt;
==============================================================================&lt;br/&gt;
checking whether to enable CPU affinity support... yes&lt;br/&gt;
checking if Linux kernel has cpu affinity support... yes&lt;br/&gt;
checking whether to enable tunable backoff TCP support... yes&lt;br/&gt;
checking if Linux kernel has tunable backoff TCP support... no&lt;br/&gt;
checking whether to use Compat RDMA... /bin/ofed_info&lt;br/&gt;
no&lt;br/&gt;
configure: error: no OFED nor kernel OpenIB gen2 headers present&lt;br/&gt;
configure error, check /var/lib/dkms/lustre-client/2.12.5/build/config.log&lt;/p&gt;

&lt;p&gt;Building module:&lt;br/&gt;
cleaning build area...(bad exit status: 2)&lt;br/&gt;
make -j8 KERNELRELEASE=3.10.0-1127.19.1.el7.x86_64...(bad exit status: 2)&lt;br/&gt;
Error! Bad return status for module build on kernel: 3.10.0-1127.19.1.el7.x86_64 (x86_64)&lt;br/&gt;
Consult /var/lib/dkms/lustre-client/2.12.5/build/make.log for more information.&lt;/p&gt;

&lt;p&gt;Also, I did verify that the MLNX rpms that are supposed to be installed, are installed.&lt;br/&gt;
On the machine I am trying to install on, I did check and ibstat states that both the cards have an active LinkUP:&lt;/p&gt;

&lt;p&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;root@lnet08 ~&amp;#93;&lt;/span&gt;# ibstat&lt;br/&gt;
CA &apos;mlx5_0&apos;&lt;br/&gt;
	CA type: MT4119&lt;br/&gt;
	Number of ports: 1&lt;br/&gt;
	Firmware version: 16.26.1040&lt;br/&gt;
	Hardware version: 0&lt;br/&gt;
	Node GUID: 0xb8599f03002f8318&lt;br/&gt;
	System image GUID: 0xb8599f03002f8318&lt;br/&gt;
	Port 1:&lt;br/&gt;
		State: Active&lt;br/&gt;
		Physical state: LinkUp&lt;br/&gt;
		Rate: 100&lt;br/&gt;
		Base lid: 1522&lt;br/&gt;
		LMC: 0&lt;br/&gt;
		SM lid: 1434&lt;br/&gt;
		Capability mask: 0x2651e848&lt;br/&gt;
		Port GUID: 0xb8599f03002f8318&lt;br/&gt;
		Link layer: InfiniBand&lt;br/&gt;
CA &apos;mlx5_1&apos;&lt;br/&gt;
	CA type: MT4119&lt;br/&gt;
	Number of ports: 1&lt;br/&gt;
	Firmware version: 16.26.1040&lt;br/&gt;
	Hardware version: 0&lt;br/&gt;
	Node GUID: 0xb8599f03002f8319&lt;br/&gt;
	System image GUID: 0xb8599f03002f8318&lt;br/&gt;
	Port 1:&lt;br/&gt;
		State: Active&lt;br/&gt;
		Physical state: LinkUp&lt;br/&gt;
		Rate: 56&lt;br/&gt;
		Base lid: 2260&lt;br/&gt;
		LMC: 0&lt;br/&gt;
		SM lid: 158&lt;br/&gt;
		Capability mask: 0x2651e848&lt;br/&gt;
		Port GUID: 0xb8599f03002f8319&lt;br/&gt;
		Link layer: InfiniBand&lt;/p&gt;

&lt;p&gt;Any ideas how to get this to work ?&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Mike&lt;/p&gt;
</description>
                <environment>Dell and Lenovo hardware. MLNX OFED-5.2-1.0.4. Lustre 2.12.5. OS is Centos 7.8. Kernel is 3.10.0-1127.19.1.el7.x86_64</environment>
        <key id="62224">LU-14297</key>
            <summary>Can&apos;t compile lustre client against MLNX OFED-5.2-1.0.4 on Centos 7.8</summary>
                <type id="1" iconUrl="https://jira.whamcloud.com/secure/viewavatar?size=xsmall&amp;avatarId=11303&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.whamcloud.com/images/icons/priorities/major.svg">Major</priority>
                        <status id="5" iconUrl="https://jira.whamcloud.com/images/icons/statuses/resolved.png" description="A resolution has been taken, and it is awaiting verification by reporter. From here issues are either reopened, or are closed.">Resolved</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="1">Fixed</resolution>
                                        <assignee username="yujian">Jian Yu</assignee>
                                    <reporter username="mre64">Michael Ethier</reporter>
                        <labels>
                    </labels>
                <created>Wed, 6 Jan 2021 01:04:59 +0000</created>
                <updated>Tue, 23 Jan 2024 08:15:33 +0000</updated>
                            <resolved>Tue, 23 Jan 2024 08:15:33 +0000</resolved>
                                    <version>Lustre 2.12.5</version>
                                    <fixVersion>Lustre 2.12.7</fixVersion>
                                        <due></due>
                            <votes>0</votes>
                                    <watches>6</watches>
                                                                            <comments>
                            <comment id="288849" author="pjones" created="Wed, 6 Jan 2021 18:54:14 +0000"  >&lt;p&gt;Jian&lt;/p&gt;

&lt;p&gt;Could you please investigate?&lt;/p&gt;

&lt;p&gt;Thanks&lt;/p&gt;

&lt;p&gt;Peter&lt;/p&gt;</comment>
                            <comment id="288850" author="yujian" created="Wed, 6 Jan 2021 19:07:53 +0000"  >&lt;p&gt;Hi Mike,&lt;/p&gt;
&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;checking whether to use Compat RDMA... /bin/ofed_info
no
configure: error: no OFED nor kernel OpenIB gen2 headers present
configure error, check /var/lib/dkms/lustre-client/2.12.5/build/config.log
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;
&lt;p&gt;Could you please upload the &lt;tt&gt;config.log&lt;/tt&gt; to this ticket for investigation?&lt;/p&gt;</comment>
                            <comment id="288855" author="mre64" created="Wed, 6 Jan 2021 19:36:19 +0000"  >&lt;p&gt;Hi sure its attached.&lt;br/&gt;
Thanks,&lt;br/&gt;
Mike&lt;br/&gt;
 &lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.whamcloud.com/secure/attachment/37106/37106_config.log&quot; title=&quot;config.log attached to LU-14297&quot;&gt;config.log&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.whamcloud.com/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt; &lt;/p&gt;</comment>
                            <comment id="288865" author="yujian" created="Wed, 6 Jan 2021 20:50:59 +0000"  >&lt;p&gt;Hi Mike,&lt;/p&gt;
&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;        o2ib_found=false
        for O2IBPATH in $O2IBPATHS; do
                AS_IF([test \( -f ${O2IBPATH}/include/rdma/rdma_cm.h -a \
                           -f ${O2IBPATH}/include/rdma/ib_cm.h -a \
                           -f ${O2IBPATH}/include/rdma/ib_verbs.h -a \
                           -f ${O2IBPATH}/include/rdma/ib_fmr_pool.h \)], [
                        o2ib_found=true
                        break
                ])
        done
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;
&lt;p&gt;Could you please check if the above header files are located under &lt;tt&gt;/usr/src/ofa_kernel/default&lt;/tt&gt;?&lt;/p&gt;</comment>
                            <comment id="288867" author="mre64" created="Wed, 6 Jan 2021 21:11:34 +0000"  >&lt;p&gt;Hi Jian,&lt;br/&gt;
This is what I found:&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;root@cannonlnet08 ~&amp;#93;&lt;/span&gt;# cd /usr/src/ofa_kernel/default&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;root@cannonlnet08 default&amp;#93;&lt;/span&gt;# find . -name rdma_cm.h -print&lt;br/&gt;
./include/rdma/rdma_cm.h&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;root@cannonlnet08 default&amp;#93;&lt;/span&gt;# find . -name ib_verbs.h -print&lt;br/&gt;
./include/rdma/ib_verbs.h&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;root@cannonlnet08 default&amp;#93;&lt;/span&gt;# find . -name ib_fmr_pool.h -print&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;root@cannonlnet08 default&amp;#93;&lt;/span&gt;# &lt;/p&gt;

&lt;p&gt;Looks like ib_fmr_pool.h is missing ?&lt;/p&gt;

&lt;p&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;root@cannonlnet08 default&amp;#93;&lt;/span&gt;# cd ./include/rdma&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;root@cannonlnet08 rdma&amp;#93;&lt;/span&gt;# ls&lt;br/&gt;
ib_addr.h   ib_hdrs.h      ib_sa.h          ib_verbs.h           lag.h            opa_vnic.h      rdma_netlink.h  restrack.h       uverbs_named_ioctl.h&lt;br/&gt;
iba.h       ib_mad.h       ib_smi.h         ib_verbs_nvmf_def.h  mr_pool.h        peer_mem.h      rdmavt_cq.h     rw.h             uverbs_std_types.h&lt;br/&gt;
ib_cache.h  ib_marshall.h  ibta_vol1_c12.h  ib_verbs_nvmf.h      opa_addr.h       rdma_cm.h       rdma_vt.h       signature.h      uverbs_types.h&lt;br/&gt;
ib_cm.h     ib_pack.h      ib_umem.h        iw_cm.h              opa_port_info.h  rdma_cm_ib.h    rdmavt_mr.h     tid_rdma_defs.h&lt;br/&gt;
ib.h        ib_pma.h       ib_umem_odp.h    iw_portmap.h         opa_smi.h        rdma_counter.h  rdmavt_qp.h     uverbs_ioctl.h&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Mike&lt;/p&gt;</comment>
                            <comment id="288871" author="yujian" created="Wed, 6 Jan 2021 21:51:14 +0000"  >&lt;p&gt;Yes, Mike. If one or more of those files is missing, then configure will return &quot;error: no OFED nor kernel OpenIB gen2 headers present&quot;.&lt;br/&gt;
The files are usually included in mlnx-ofa_kernel-devel rpm. It seems ib_fmr_pool.h is missing from MLNX_OFED 5.2-1.0.4.0. Let me investigate further.&lt;/p&gt;</comment>
                            <comment id="288874" author="simmonsja" created="Wed, 6 Jan 2021 23:03:12 +0000"  >&lt;p&gt;Can you try patch&#160;&lt;a href=&quot;https://review.whamcloud.com/#/c/40287&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/#/c/40287&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="288878" author="mre64" created="Wed, 6 Jan 2021 23:27:26 +0000"  >&lt;p&gt;Hi James, can you point me to the procedure to apply the patch ?&lt;br/&gt;
Thanks, Mike&lt;/p&gt;</comment>
                            <comment id="288879" author="mre64" created="Wed, 6 Jan 2021 23:36:29 +0000"  >&lt;p&gt;Is the the procedure ? I would run without --dryrun to implement the changes.&lt;/p&gt;

&lt;p&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;root@cannonlnet08 lustre-client-2.12.5&amp;#93;&lt;/span&gt;# pwd&lt;br/&gt;
/usr/src/lustre-client-2.12.5&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;root@cannonlnet08 lustre-client-2.12.5&amp;#93;&lt;/span&gt;# patch -p1 --dry-run &amp;lt; ~/14b20ca6.diff&lt;br/&gt;
checking file lnet/autoconf/lustre-lnet.m4&lt;br/&gt;
Hunk #1 succeeded at 157 (offset 48 lines).&lt;br/&gt;
Hunk #2 succeeded at 234 (offset 48 lines).&lt;br/&gt;
Hunk #3 succeeded at 567 with fuzz 2 (offset 25 lines).&lt;br/&gt;
checking file lnet/klnds/o2iblnd/o2iblnd.c&lt;br/&gt;
Hunk #1 succeeded at 1469 (offset 56 lines).&lt;br/&gt;
Hunk #2 succeeded at 1528 (offset 56 lines).&lt;br/&gt;
Hunk #3 succeeded at 1557 (offset 56 lines).&lt;br/&gt;
Hunk #4 succeeded at 1566 (offset 56 lines).&lt;br/&gt;
Hunk #5 succeeded at 1675 (offset 56 lines).&lt;br/&gt;
Hunk #6 succeeded at 1767 (offset 57 lines).&lt;br/&gt;
Hunk #7 succeeded at 1789 (offset 57 lines).&lt;br/&gt;
Hunk #8 succeeded at 1799 (offset 57 lines).&lt;br/&gt;
Hunk #9 succeeded at 1813 (offset 57 lines).&lt;br/&gt;
Hunk #10 succeeded at 1855 (offset 57 lines).&lt;br/&gt;
Hunk #11 succeeded at 1871 (offset 57 lines).&lt;br/&gt;
Hunk #12 succeeded at 1894 (offset 57 lines).&lt;br/&gt;
Hunk #13 FAILED at 1885.&lt;br/&gt;
Hunk #14 succeeded at 1960 (offset 57 lines).&lt;br/&gt;
Hunk #15 succeeded at 1987 (offset 57 lines).&lt;br/&gt;
Hunk #16 succeeded at 2586 (offset -21 lines).&lt;br/&gt;
Hunk #17 succeeded at 2600 (offset -21 lines).&lt;br/&gt;
1 out of 17 hunks FAILED&lt;br/&gt;
checking file lnet/klnds/o2iblnd/o2iblnd.h&lt;br/&gt;
Hunk #1 succeeded at 71 (offset -12 lines).&lt;br/&gt;
Hunk #2 succeeded at 174 (offset -7 lines).&lt;br/&gt;
Hunk #3 succeeded at 337 with fuzz 2 (offset -13 lines).&lt;br/&gt;
Hunk #4 FAILED at 388.&lt;br/&gt;
1 out of 4 hunks FAILED&lt;br/&gt;
checking file lnet/klnds/o2iblnd/o2iblnd_cb.c&lt;br/&gt;
Hunk #3 succeeded at 625 (offset -1 lines).&lt;br/&gt;
Hunk #4 succeeded at 656 (offset -1 lines).&lt;br/&gt;
Hunk #5 succeeded at 687 (offset -1 lines).&lt;/p&gt;</comment>
                            <comment id="288880" author="yujian" created="Wed, 6 Jan 2021 23:39:52 +0000"  >&lt;p&gt;Hi Mike,&lt;br/&gt;
I&apos;m back-porting the patch to Lustre 2.12.5 and will share it with you.&lt;br/&gt;
BTW, it turns out ib_fmr_pool.h exists in kernel-devel-3.10.0-1127.19.1.el7:&lt;/p&gt;
&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;# rpm -qlp kernel-devel-3.10.0-1127.19.1.el7.x86_64.rpm | grep ib_fmr_pool.h
/usr/src/kernels/3.10.0-1127.19.1.el7.x86_64/include/rdma/ib_fmr_pool.h
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;
&lt;p&gt;While installing MLNX_OFED 5.2-1.0.4.0 on the node, did you pass &quot;--add-kernel-support&quot; option to mlnxofedinstall or run mlnx_add_kernel_support.sh to generate an MLNX_OFED package with drivers for the kernel 3.10.0-1127.19.1.el7 on the node?&lt;/p&gt;</comment>
                            <comment id="288881" author="mre64" created="Wed, 6 Jan 2021 23:43:06 +0000"  >&lt;p&gt;Hi Jian,&lt;br/&gt;
Yes I ran mlnx_add_kernel_support.sh to generate an MLNX_OFED package with drivers for the kernel 3.10.0-1127.19.1.el7 on the node. Then I took the resulting .gz file and extracted the RPMS from it, and used them to install MLNX OFED on this node via the yum repo method.&lt;br/&gt;
Thanks,&lt;br/&gt;
Mike&lt;/p&gt;</comment>
                            <comment id="288884" author="yujian" created="Thu, 7 Jan 2021 00:16:59 +0000"  >&lt;p&gt;Thank you Mike for the info.&lt;br/&gt;
Here is the back-ported patch for Lustre 2.12.5: &lt;a href=&quot;https://review.whamcloud.com/41153&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/41153&lt;/a&gt;. You can apply the patch and build manually or wait for Jenkins build to be finished.&lt;/p&gt;</comment>
                            <comment id="288886" author="mre64" created="Thu, 7 Jan 2021 01:36:54 +0000"  >&lt;p&gt;Hi Jian,&lt;br/&gt;
I applied your patch and tried to build lustre 2.12.5 client and it failed the same way:&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;root@cannonlnet08 lustre-client-2.12.5&amp;#93;&lt;/span&gt;# patch -p1 &amp;lt; ~/f4d9b03a.diff&lt;br/&gt;
patching file lnet/autoconf/lustre-lnet.m4&lt;br/&gt;
patching file lnet/klnds/o2iblnd/o2iblnd.c&lt;br/&gt;
patching file lnet/klnds/o2iblnd/o2iblnd.h&lt;br/&gt;
patching file lnet/klnds/o2iblnd/o2iblnd_cb.c&lt;/p&gt;

&lt;p&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;root@cannonlnet08 ~&amp;#93;&lt;/span&gt;# dkms install -k $(uname -r) lustre-client/2.12.5&lt;/p&gt;

&lt;p&gt;Kernel preparation unnecessary for this kernel.  Skipping...&lt;/p&gt;

&lt;p&gt;Running the pre_build script:&lt;br/&gt;
checking build system type... x86_64-unknown-linux-gnu&lt;br/&gt;
checking host system type... x86_64-unknown-linux-gnu&lt;br/&gt;
...&lt;br/&gt;
...&lt;br/&gt;
configure: LNet kernel checks&lt;br/&gt;
==============================================================================&lt;br/&gt;
checking whether to enable CPU affinity support... yes&lt;br/&gt;
checking if Linux kernel has cpu affinity support... yes&lt;br/&gt;
checking whether to enable tunable backoff TCP support... yes&lt;br/&gt;
checking if Linux kernel has tunable backoff TCP support... no&lt;br/&gt;
checking whether to use Compat RDMA... /bin/ofed_info&lt;br/&gt;
no&lt;br/&gt;
configure: error: no OFED nor kernel OpenIB gen2 headers present&lt;br/&gt;
configure error, check /var/lib/dkms/lustre-client/2.12.5/build/config.log&lt;/p&gt;

&lt;p&gt;Building module:&lt;br/&gt;
cleaning build area...(bad exit status: 2)&lt;br/&gt;
make -j8 KERNELRELEASE=3.10.0-1127.19.1.el7.x86_64...(bad exit status: 2)&lt;br/&gt;
Error! Bad return status for module build on kernel: 3.10.0-1127.19.1.el7.x86_64 (x86_64)&lt;br/&gt;
Consult /var/lib/dkms/lustre-client/2.12.5/build/make.log for more information.&lt;/p&gt;</comment>
                            <comment id="288887" author="yujian" created="Thu, 7 Jan 2021 02:00:23 +0000"  >&lt;p&gt;Hi Mike,&lt;br/&gt;
I&apos;m setting up a test node to reproduce the issue and verify the patch.&lt;/p&gt;</comment>
                            <comment id="288908" author="yujian" created="Thu, 7 Jan 2021 09:44:16 +0000"  >&lt;p&gt;Hi Mike,&lt;br/&gt;
I can reproduce the ib_fmr_pool.h missing issue on my test node. However, with patch &lt;a href=&quot;https://review.whamcloud.com/41153&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/41153&lt;/a&gt; applied to Lustre 2.12.5, the issue was resolved. I installed the el7.8/x86_64 lustre-client-dkms rpm from Jenkins build &lt;a href=&quot;https://build.whamcloud.com/job/lustre-reviews/78554/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://build.whamcloud.com/job/lustre-reviews/78554/&lt;/a&gt; :&lt;/p&gt;
&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;# rpm -ivh lustre-client-dkms-2.12.5_1_gf4d9b03-1.el7.noarch.rpm 
Preparing...                          ################################# [100%]
Updating / installing...
   1:lustre-client-dkms-2.12.5_1_gf4d9################################# [100%]
Loading new lustre-client-2.12.5_1_gf4d9b03 DKMS files...
Building for 3.10.0-1127.19.1.el7.x86_64
Building initial module for 3.10.0-1127.19.1.el7.x86_64
&amp;lt;~snip~&amp;gt;
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;
&lt;p&gt;The config.log showed that:&lt;/p&gt;
&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;configure:18577: checking whether to use Compat RDMA
configure:18673: result: yes
configure:18708: checking whether to use any OFED backport headers
configure:18716: result: no
configure:18725: checking whether to enable OpenIB gen2 support
&amp;lt;~snip~&amp;gt;
configure:18794: result: yes
configure:18817: adding /usr/src/ofa_kernel/default/Module.symvers to Symbol Path
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;
&lt;p&gt;&lt;tt&gt;configure&lt;/tt&gt; passed.&lt;/p&gt;</comment>
                            <comment id="288909" author="yujian" created="Thu, 7 Jan 2021 10:08:01 +0000"  >&lt;p&gt;After &lt;tt&gt;configure&lt;/tt&gt; passed, building the codes hit the following error:&lt;/p&gt;
&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;/var/lib/dkms/lustre-client/2.12.5_1_gf4d9b03/build/lnet/klnds/o2iblnd/o2iblnd_cb.c: In function &#8216;kiblnd_reject&#8217;:
/var/lib/dkms/lustre-client/2.12.5_1_gf4d9b03/build/lnet/klnds/o2iblnd/o2iblnd_cb.c:2421:9: error: too few arguments to function &#8216;rdma_reject&#8217;
         rc = rdma_reject(cmid, rej, sizeof(*rej));
         ^
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;
&lt;p&gt;The error has been fixed in patch &lt;a href=&quot;https://review.whamcloud.com/39781&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/39781&lt;/a&gt; and landed for Lustre 2.12.6.&lt;/p&gt;

&lt;p&gt;With patch &lt;a href=&quot;https://review.whamcloud.com/41152&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/41152&lt;/a&gt; applied to Lustre 2.12.6, I can successfully build Lustre 2.12.6 client on CentOS 7.8 with kernel 3.10.0-1127.19.1.el7.x86_64 and MLNX_OFED 5.2-1.0.4.0:&lt;/p&gt;
&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;# rpm -ivh lustre-client-dkms-2.12.6_1_g14e02fb-1.el7.noarch.rpm
Preparing...                          ################################# [100%]
Updating / installing...
   1:lustre-client-dkms-2.12.6_1_g14e0################################# [100%]
Loading new lustre-client-2.12.6_1_g14e02fb DKMS files...
Building for 3.10.0-1127.19.1.el7.x86_64
Building initial module for 3.10.0-1127.19.1.el7.x86_64
Done.
&amp;lt;~snip~&amp;gt;
ko2iblnd.ko.xz:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/3.10.0-1127.19.1.el7.x86_64/extra/
&amp;lt;~snip~&amp;gt;
Adding any weak-modules

depmod....

DKMS: install completed.
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;</comment>
                            <comment id="288945" author="mre64" created="Thu, 7 Jan 2021 15:41:17 +0000"  >&lt;p&gt;Hi Jian,&lt;/p&gt;

&lt;p&gt;Thanks for the feedback. However, we are running Lustre client 2.12.5 almost everywhere on our production infrastructure.&lt;/p&gt;

&lt;p&gt;I am working currently on updating out LNET routers from Centos 7.7 Lustre 2.12.4 and OFED-4.7-1.0.0 to Centos 7.8 and was hoping to keep the lustre version the same (ie 2.12.5).&lt;/p&gt;

&lt;p&gt;Based on your info I have to use lustre 2.12.6 in order to get this to work with the latest MLNX OFED. And Mellanox recommends I use their latest OFED version. Do you know of any compatibility issues or other issues updating our LNET routers to 2.12.6 ? Or should I just leave them alone as they seem to be working fine.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Mike&lt;/p&gt;
</comment>
                            <comment id="288967" author="yujian" created="Thu, 7 Jan 2021 18:25:14 +0000"  >&lt;p&gt;Hi Mike,&lt;br/&gt;
There are some LNet fixups and improvements in Lustre 2.12.6, but I&apos;m not sure if there are compatibility issues.&lt;br/&gt;
I just verified that with the following two patches applied to Lustre 2.12.5, the client build also passed on CentOS 7.8 with kernel 3.10.0-1127.19.1.el7.x86_64 and MLNX_OFED 5.2-1.0.4.0:&lt;/p&gt;
&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;&lt;a href=&quot;https://review.whamcloud.com/41152&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/41152&lt;/a&gt; &quot;&lt;a href=&quot;https://jira.whamcloud.com/browse/LU-13783&quot; title=&quot;Support for linux kernel version 5.8&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-13783&quot;&gt;&lt;del&gt;LU-13783&lt;/del&gt;&lt;/a&gt; o2iblnd: make FMR-pool support optional.&quot;&lt;/li&gt;
	&lt;li&gt;&lt;a href=&quot;https://review.whamcloud.com/39781&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/39781&lt;/a&gt; &quot;&lt;a href=&quot;https://jira.whamcloud.com/browse/LU-13761&quot; title=&quot;MOFED 5.1 support&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-13761&quot;&gt;&lt;del&gt;LU-13761&lt;/del&gt;&lt;/a&gt; o2ib: Fix compilation with MOFED 5.1&quot;&lt;/li&gt;
&lt;/ul&gt;
</comment>
                            <comment id="288992" author="mre64" created="Fri, 8 Jan 2021 01:12:47 +0000"  >&lt;p&gt;Hi Jian,&lt;br/&gt;
Thanks you have been very responsive in regards to my issue. I will see if I can make this work.&lt;br/&gt;
Mike&lt;/p&gt;</comment>
                            <comment id="288993" author="mre64" created="Fri, 8 Jan 2021 01:14:53 +0000"  >&lt;p&gt;BTW, do you know when this issue will be fixed in the general lustre release ? 2.12.6 is already released.&lt;/p&gt;</comment>
                            <comment id="288995" author="mre64" created="Fri, 8 Jan 2021 01:32:18 +0000"  >&lt;p&gt;Hi Jian,&lt;br/&gt;
I just tried those 2 patches you recommended to lustre 2.12.5 and its failing the same way still. How exactly are you applying those 2 patches ? This is what I did:&lt;/p&gt;

&lt;p&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;root@cannonlnet08 lustre-client-2.12.5&amp;#93;&lt;/span&gt;# pwd&lt;br/&gt;
/usr/src/lustre-client-2.12.5&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;root@cannonlnet08 lustre-client-2.12.5&amp;#93;&lt;/span&gt;# patch -p1 &amp;lt; ~/14e02fb3.diff&lt;br/&gt;
patching file lnet/autoconf/lustre-lnet.m4&lt;br/&gt;
Hunk #3 succeeded at 567 with fuzz 2 (offset -23 lines).&lt;br/&gt;
patching file lnet/klnds/o2iblnd/o2iblnd.c&lt;br/&gt;
patching file lnet/klnds/o2iblnd/o2iblnd.h&lt;br/&gt;
patching file lnet/klnds/o2iblnd/o2iblnd_cb.c&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;root@cannonlnet08 lustre-client-2.12.5&amp;#93;&lt;/span&gt;# patch -p1 &amp;lt; ~/ba702c79.diff&lt;br/&gt;
patching file lnet/autoconf/lustre-lnet.m4&lt;br/&gt;
Hunk #1 succeeded at 579 with fuzz 2 (offset 9 lines).&lt;br/&gt;
patching file lnet/klnds/o2iblnd/o2iblnd_cb.c&lt;br/&gt;
Hunk #1 succeeded at 2418 (offset 11 lines).&lt;/p&gt;

&lt;p&gt;Then I started the build:&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;root@cannonlnet08 lustre-client-2.12.5&amp;#93;&lt;/span&gt;# dkms install -k $(uname -r) lustre-client/2.12.5&lt;/p&gt;

&lt;p&gt;Kernel preparation unnecessary for this kernel.  Skipping...&lt;/p&gt;

&lt;p&gt;Running the pre_build script:&lt;br/&gt;
checking build system type... x86_64-unknown-linux-gnu&lt;br/&gt;
...&lt;br/&gt;
...&lt;/p&gt;</comment>
                            <comment id="288998" author="yujian" created="Fri, 8 Jan 2021 02:17:18 +0000"  >&lt;p&gt;You&apos;re welcome, Mike. I&apos;m not sure when the next 2.12.x version will be released.&lt;br/&gt;
I directly installed the lustre-client-dkms rpm generated by Jenkins build system &lt;a href=&quot;https://build.whamcloud.com/job/lustre-reviews/78580/arch=x86_64,build_type=client,distro=el7.8,ib_stack=inkernel/artifact/artifacts/RPMS/x86_64/lustre-client-dkms-2.12.5_1_g726eed2-1.el7.noarch.rpm&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://build.whamcloud.com/job/lustre-reviews/78580/arch=x86_64,build_type=client,distro=el7.8,ib_stack=inkernel/artifact/artifacts/RPMS/x86_64/lustre-client-dkms-2.12.5_1_g726eed2-1.el7.noarch.rpm&lt;/a&gt; without problem.&lt;br/&gt;
I will try your method to see how it goes. &lt;/p&gt;</comment>
                            <comment id="289275" author="mre64" created="Tue, 12 Jan 2021 14:38:38 +0000"  >&lt;p&gt;Hi Jian,&lt;br/&gt;
Any luck in trying my method ?&lt;br/&gt;
Thanks,&lt;br/&gt;
Mike&lt;/p&gt;</comment>
                            <comment id="289276" author="pjones" created="Tue, 12 Jan 2021 14:43:01 +0000"  >&lt;p&gt;My suggestion is that we expedite landing &lt;a href=&quot;https://review.whamcloud.com/#/c/41152/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/#/c/41152/&lt;/a&gt; to b2_12 and then the tip of b2_12 will be what is needed to to build 2.12.6 for MOFED 5.2. We have not thought about 2.12.7 timing yet, but we will certainly want to include this fix.&lt;/p&gt;</comment>
                            <comment id="289301" author="mre64" created="Tue, 12 Jan 2021 16:31:51 +0000"  >&lt;p&gt;So I have an lnet router out of service that I was trying to get running with the latest MOFED and lustre 2.12.5. Should I just rebuilt it back to its previous functioning setup ? I don&apos;t want to leave it down for a long time.&lt;/p&gt;</comment>
                            <comment id="289316" author="yujian" created="Tue, 12 Jan 2021 18:48:01 +0000"  >&lt;p&gt;Hi Mike,&lt;br/&gt;
I can reproduce your issue. After applying the patches, could you please run the attached  &lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.whamcloud.com/secure/attachment/37150/37150_autogen.sh&quot; title=&quot;autogen.sh attached to LU-14297&quot;&gt;autogen.sh&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.whamcloud.com/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt;  under &lt;tt&gt;/usr/src/lustre-client-2.12.5&lt;/tt&gt; before running &lt;tt&gt;dkms install ...&lt;/tt&gt;?&lt;/p&gt;
&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;# pwd
/usr/src/lustre-client-2.12.5
# sh ./autogen.sh
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;</comment>
                            <comment id="289321" author="yujian" created="Tue, 12 Jan 2021 19:56:05 +0000"  >&lt;p&gt;And before running &lt;tt&gt;autogen.sh&lt;/tt&gt;, the attached  &lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.whamcloud.com/secure/attachment/37152/37152_lustre-version.m4&quot; title=&quot;lustre-version.m4 attached to LU-14297&quot;&gt;lustre-version.m4&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.whamcloud.com/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt; also needs to be put into &lt;tt&gt;/usr/src/lustre-client-2.12.5/config&lt;/tt&gt;.&lt;br/&gt;
The following steps work for me from scratch:&lt;/p&gt;
&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;# rpm -ivh lustre-client-dkms-2.12.5-1.el7.noarch.rpm
# cd /usr/src/lustre-client-2.12.5/
# patch -p1 &amp;lt; /root/0001-LU-13761-o2ib-Fix-compilation-with-MOFED-5.1.patch 
# patch -p1 &amp;lt; /root/0001-LU-13783-o2iblnd-make-FMR-pool-support-optional.patch
# cp /root/autogen.sh .
# cp /root/lustre-version.m4 config/
# sh ./autogen.sh 
# dkms install -k $(uname -r) lustre-client/2.12.5
...
...
 - Installation
   - Installing to /lib/modules/3.10.0-1127.19.1.el7.x86_64/extra/
Adding any weak-modules

depmod....

DKMS: install completed.
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;</comment>
                            <comment id="289325" author="mre64" created="Tue, 12 Jan 2021 20:50:35 +0000"  >&lt;p&gt;Hi Jian,&lt;br/&gt;
The patches I should apply are they the same ones or different ones ? Can you give me pointers to them ?&lt;br/&gt;
Thanks,&lt;br/&gt;
Mike&lt;/p&gt;</comment>
                            <comment id="289333" author="yujian" created="Tue, 12 Jan 2021 21:25:14 +0000"  >&lt;p&gt;Hi Mike,&lt;br/&gt;
The same ones as those in &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-14297?focusedCommentId=288967&amp;amp;page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-288967&quot; class=&quot;external-link&quot; rel=&quot;nofollow&quot;&gt;#comment-288967&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="289414" author="mre64" created="Wed, 13 Jan 2021 15:40:25 +0000"  >&lt;p&gt;Hi Jian,&lt;br/&gt;
I followed your instructions and that seems to have worked and the lnet route is running. I need to rebuild 9 other lnet routers and this is what I should correct ? Or is there going to be an &quot;official&quot; release that will include this fix soon ?&lt;br/&gt;
It won&apos;t be an official version of 2.12.5 correct ?&lt;br/&gt;
Thanks,&lt;br/&gt;
Mike&lt;/p&gt;</comment>
                            <comment id="289416" author="pjones" created="Wed, 13 Jan 2021 15:42:55 +0000"  >&lt;p&gt;Mike&lt;/p&gt;

&lt;p&gt;The &quot;official&quot; release will be 2.12.7 but we don&apos;t have an exact timeline for it yet&lt;/p&gt;

&lt;p&gt;Peter&lt;/p&gt;</comment>
                            <comment id="289421" author="mre64" created="Wed, 13 Jan 2021 16:16:01 +0000"  >&lt;p&gt;Peter, our group is going to wait for 2.12.7 to be release before we update all our lnet routers. Do you think the 2.12.7 will be released in weeks or months ? Thanks.&lt;/p&gt;</comment>
                            <comment id="289424" author="pjones" created="Wed, 13 Jan 2021 16:44:58 +0000"  >&lt;p&gt;Michael&lt;/p&gt;

&lt;p&gt;It&apos;s possible something new might come to light that quickly changes this but, as things stand today, my best guess is months.&lt;/p&gt;

&lt;p&gt;Peter&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10011">
                    <name>Related</name>
                                            <outwardlinks description="is related to ">
                                        <issuelink>
            <issuekey id="59953">LU-13783</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="59873">LU-13761</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                            <attachment id="37150" name="autogen.sh" size="282" author="yujian" created="Tue, 12 Jan 2021 18:45:54 +0000"/>
                            <attachment id="37106" name="config.log" size="213347" author="mre64" created="Wed, 6 Jan 2021 19:36:12 +0000"/>
                            <attachment id="37152" name="lustre-version.m4" size="1212" author="yujian" created="Tue, 12 Jan 2021 19:50:05 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                                                                                                                                            <customfield id="customfield_10890" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10030" key="com.atlassian.jira.plugin.system.customfieldtypes:labels">
                        <customfieldname>Epic/Theme</customfieldname>
                        <customfieldvalues>
                                        <label>MLNX</label>
            <label>OFED-5.2-1.0.4</label>
            <label>lustre-2.12.5</label>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10390" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i01ilj:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10090" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10060" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Severity</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10022"><![CDATA[3]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        </customfields>
    </item>
</channel>
</rss>