https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-12395 Lustre <p>While installing lustre-client-tests and lustre-iokit rpms on RHEL 8.0 client, they hit the following dependency issues:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>error: Failed dependencies: libmpi.so.40()(64bit) is needed by lustre-client-tests-2.12.54-1.el8.x86_64 python &gt; 2.2 is needed by lustre-iokit-2.12.54-1.el8.x86_64 </pre> </div></div> <p>On RHEL 8.0, openmpi provides "libmpi.so.40()(64bit)(openmpi-x86_64)", not "libmpi.so.40()(64bit)". There are python2 and python3 on RHEL 8.0, no python.</p> LU-12395

Failed dependencies while installing lustre-client-tests and lustre-iokit rpms on RHEL 8.0 client

Bug Critical Resolved Fixed Dongyang Li Jian Yu Thu, 6 Jun 2019 00:16:50 +0000 Tue, 10 Mar 2020 14:43:20 +0000 Wed, 10 Jul 2019 20:20:53 +0000 Lustre 2.13.0 Lustre 2.12.3 0 8 <p>Dongyang is looking into this</p> <p>Jian,</p> <p>Can you share how did you built the rpms? I just built the client rpms and lustre-client-tests doesn't have dependency on libmpi, and I could not find where do we insert the dependency on libmpi in the spec:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> [root@rhel8 lustre-release]# rpm -qpR ./lustre-client-tests-2.12.54-1.el8.x86_64.rpm /bin/bash /bin/sh /usr/bin/getconf /usr/bin/perl attr kmod-lustre-client = 2.12.54 kmod-lustre-client-tests = 2.12.54 libc.so.6()(64bit) libc.so.6(GLIBC_2.14)(64bit) libc.so.6(GLIBC_2.2.5)(64bit) libc.so.6(GLIBC_2.28)(64bit) libc.so.6(GLIBC_2.3)(64bit) libc.so.6(GLIBC_2.3.4)(64bit) libc.so.6(GLIBC_2.4)(64bit) libkeyutils.so.1()(64bit) liblustreapi.so.1()(64bit) libpthread.so.0()(64bit) libpthread.so.0(GLIBC_2.2.5)(64bit) libtool lsof lustre-client = 2.12.54 lustre-iokit perl perl(FileHandle) perl(Getopt::Std) perl(IO::Handle) perl(POSIX) perl(Socket) perl(strict) perl(vars) rpmlib(CompressedFileNames) &lt;= 3.0.4-1 rpmlib(FileDigests) &lt;= 4.6.0-1 rpmlib(PayloadFilesHavePrefix) &lt;= 4.0-1 rpmlib(PayloadIsXz) &lt;= 5.2-1 rsync rtld(GNU_HASH) </pre> </div></div> <p>Can you also share the output of "rpm --qpR" on the lustre-client-tests rpm file and the output of "rpm -qa | grep mpi"?</p> <p>the dependency on python by lustre-iokit is there and can be easily fixed.</p> <p>Hi Dongyang,<br/> I used the client rpms built by Jenkins:<br/> <a href="https://build.whamcloud.com/job/lustre-master/3904/arch=x86_64,build_type=client,distro=el8,ib_stack=inkernel/" class="external-link" target="_blank" rel="nofollow noopener">https://build.whamcloud.com/job/lustre-master/3904/arch=x86_64,build_type=client,distro=el8,ib_stack=inkernel/</a><br/> Here is the build log:<br/> <a href="https://build.whamcloud.com/job/lustre-master/3904/arch=x86_64,build_type=client,distro=el8,ib_stack=inkernel/consoleFull" class="external-link" target="_blank" rel="nofollow noopener">https://build.whamcloud.com/job/lustre-master/3904/arch=x86_64,build_type=client,distro=el8,ib_stack=inkernel/consoleFull</a></p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre># rpm -qpR lustre-client-tests-2.12.54-1.el8.x86_64.rpm /bin/bash /bin/sh /usr/bin/getconf /usr/bin/perl attr kmod-lustre-client = 2.12.54 kmod-lustre-client-tests = 2.12.54 libc.so.6()(64bit) libc.so.6(GLIBC_2.14)(64bit) libc.so.6(GLIBC_2.2.5)(64bit) libc.so.6(GLIBC_2.28)(64bit) libc.so.6(GLIBC_2.3)(64bit) libc.so.6(GLIBC_2.3.4)(64bit) libc.so.6(GLIBC_2.4)(64bit) libc.so.6(GLIBC_2.7)(64bit) libkeyutils.so.1()(64bit) liblustreapi.so.1()(64bit) libmpi.so.40()(64bit) libpthread.so.0()(64bit) libpthread.so.0(GLIBC_2.2.5)(64bit) libreadline.so.7()(64bit) libtool lsof lustre-client = 2.12.54 lustre-iokit perl perl(FileHandle) perl(Getopt::Std) perl(IO::Handle) perl(POSIX) perl(Socket) perl(strict) perl(vars) rpmlib(CompressedFileNames) &lt;= 3.0.4-1 rpmlib(FileDigests) &lt;= 4.6.0-1 rpmlib(PayloadFilesHavePrefix) &lt;= 4.0-1 rpmlib(PayloadIsXz) &lt;= 5.2-1 rsync rtld(GNU_HASH) </pre> </div></div> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre># rpm -qa | grep mpi orc-compiler-0.4.28-2.el8.x86_64 compiler-rt-7.0.1-1.module+el8+2560+c32c7af1.x86_64 mpitests-mvapich2-psm2-5.4.2-4.el8.x86_64 rpm-mpi-hooks-5-4.el8.noarch openmpi-devel-3.1.2-5.el8.x86_64 omping-0.0.4-14.el8.x86_64 mpitests-mvapich2-5.4.2-4.el8.x86_64 exempi-2.4.5-2.el8.x86_64 mpich-devel-3.2.1-9.el8.x86_64 libcmpiCppImpl0-2.0.3-15.el8.x86_64 openmpi-3.1.2-5.el8.x86_64 mpich-3.2.1-9.el8.x86_64 mpitests-openmpi-5.4.2-4.el8.x86_64 mpitests-mpich-5.4.2-4.el8.x86_64 </pre> </div></div> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre># rpm -ivh IOR-2.10.3-wc1.x86_64.rpm error: Failed dependencies: libmpi.so.40()(64bit) is needed by IOR-2.10.3-wc1.x86_64 </pre> </div></div> <p>Li Dongyang (dongyangli@ddn.com) uploaded a new patch: <a href="https://review.whamcloud.com/35094" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/35094</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12395" title="Failed dependencies while installing lustre-client-tests and lustre-iokit rpms on RHEL 8.0 client" class="issue-link" data-issue-key="LU-12395"><del>LU-12395</del></a> build: require python2 for lustre-iokit<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: f56ae83d3125e2b5a32732386ba30f48f5151725</p> <p>I think I know what's going on with the MPI dependencies now.</p> <p>RHEL8 has rpm-mpi-hooks, which will generate the provides/requires for different mpi libs.</p> <p><a href="https://fedoraproject.org//wiki/Changes/RpmMPIReqProv" class="external-link" target="_blank" rel="nofollow noopener">https://fedoraproject.org//wiki/Changes/RpmMPIReqProv</a></p> <p>This is done to distinguish e.g. libmpi.so from openmpi and mpich. What that means is we should have 2 additional lutre-client-tests rpms, like lustre-client-tests-openmpi and lustre-client-tests-mpich to package the mpi tests, and they will have different dependencies on libmpi.so</p> <p>According to <a href="https://fedoraproject.org/wiki/Packaging:MPI" class="external-link" target="_blank" rel="nofollow noopener">https://fedoraproject.org/wiki/Packaging:MPI</a></p> <p>the binary should be placed under /usr/lib64/openmpi/bin or /usr/lib64/mpich/bin</p> <p>This means we need to change the rpm build spec and maybe the test scripts assuming the location of the mpi tests.</p> <p>The same should also be done for the IOR package.</p> <p>Before that happens a walkaround is disabling the mpi tests, can be achieved by removing the openmpi/mpich packages from the build system, or use --enable-mpitests=no configure option.</p> <p>Does it make sense to split out the MPI tests into a separate RPM, namely <tt>lustre-client-tests-openmpi</tt> and <tt>lustre-client-tests-mpich</tt>, but keep the rest of the test binaries/scripts in <tt>lustre-client-tests</tt>? That avoids increasing the size of the build products. Alternately, we just build one or the other MPI RPMs, but name them appropriately and add the appropriate <tt>Requires:</tt> line so that it will refuse to install with the wrong packages.</p> <p>Since very few users beyond autotest will ever install <tt>lustre-client-tests-*mpi</tt> I don't think we need to spend too much time making this work everywhere.</p> <p>Yes we should still have the lustre-client-tests rpm which has the common binary and scripts,</p> <p>and 2 additional lustre-client-tests-openmpi and lustre-client-tests-mpich for the mpt tests only, like the example listed in the fedora wiki:</p> <p><a href="https://fedoraproject.org/wiki/Packaging:MPI" class="external-link" target="_blank" rel="nofollow noopener">https://fedoraproject.org/wiki/Packaging:MPI</a></p> <p>Still we need to make sure changing the specs won't break the build for old distros like CentOS7</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/35094/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/35094/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12395" title="Failed dependencies while installing lustre-client-tests and lustre-iokit rpms on RHEL 8.0 client" class="issue-link" data-issue-key="LU-12395"><del>LU-12395</del></a> build: require python2 for lustre-iokit<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 6f0fcc289887737f45687b5f8a15835aeab32ef4</p> <p>Landed for 2.13</p> <p>Jian Yu (yujian@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/35251" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/35251</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12395" title="Failed dependencies while installing lustre-client-tests and lustre-iokit rpms on RHEL 8.0 client" class="issue-link" data-issue-key="LU-12395"><del>LU-12395</del></a> build: require python2 for lustre-iokit<br/> Project: fs/lustre-release<br/> Branch: b2_12<br/> Current Patch Set: 1<br/> Commit: 58fc7991c903e15d49b814130f663667d01a24b5</p> <p>this issue has not completed. we still need to split the lustre-client-tests rpm</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/35251/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/35251/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12395" title="Failed dependencies while installing lustre-client-tests and lustre-iokit rpms on RHEL 8.0 client" class="issue-link" data-issue-key="LU-12395"><del>LU-12395</del></a> build: require python2 for lustre-iokit<br/> Project: fs/lustre-release<br/> Branch: b2_12<br/> Current Patch Set: <br/> Commit: 9ffeaac8ec9ad338f6d2639fd5a2d7fafb6725c6</p> <p>Minh Diep (mdiep@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/35374" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/35374</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12395" title="Failed dependencies while installing lustre-client-tests and lustre-iokit rpms on RHEL 8.0 client" class="issue-link" data-issue-key="LU-12395"><del>LU-12395</del></a> build: build mpitests for el8<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: edb4cd7414988cb7fdce3aa2332876377131d764</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/35374/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/35374/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12395" title="Failed dependencies while installing lustre-client-tests and lustre-iokit rpms on RHEL 8.0 client" class="issue-link" data-issue-key="LU-12395"><del>LU-12395</del></a> build: build mpitests for el8<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 3c7aca74729edb5339d2b84259ba042bf83c214a</p> <p>Now I think this is complete for 2.13</p> <p>Minh Diep (mdiep@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/35473" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/35473</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12395" title="Failed dependencies while installing lustre-client-tests and lustre-iokit rpms on RHEL 8.0 client" class="issue-link" data-issue-key="LU-12395"><del>LU-12395</del></a> build: build mpitests for el8<br/> Project: fs/lustre-release<br/> Branch: b2_12<br/> Current Patch Set: 1<br/> Commit: 9f1d8b7b976f6fd444ff76f8b203672b21618b6d</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/35473/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/35473/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12395" title="Failed dependencies while installing lustre-client-tests and lustre-iokit rpms on RHEL 8.0 client" class="issue-link" data-issue-key="LU-12395"><del>LU-12395</del></a> build: build mpitests for el8<br/> Project: fs/lustre-release<br/> Branch: b2_12<br/> Current Patch Set: <br/> Commit: 3d3b453e3a4204dd1a9f4cc601abb9cd85e84add</p> Related LU-13348 LU-12269 LU-13086 Development Rank 1|i00hof: Rank (Obsolete) 9223372036854775807 Severity