https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-15976 Lustre <p>The Lustre-ZFS packages from the official Whamcloud repo do not install </p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> dnf install lustre  lustre-osd-zfs-mount lustre-zfs-dkms</pre> </div></div> <p>because package <em>lustre-osd-zfs-mount</em> depends invariably on package <em>kmod-lustre-osd-zfs</em>.<br/> kmod-packages were built for kernel ...345.2.1.. and thus do not fit (<em>nothing provides ksym...</em>)<br/> That's what dkms is for?</p> Alma Linux 8.5, kernel 4.18.0-348.23.1.el8_5.x86_64 LU-15976

2.15.0 - zfs-dkms packages cannot be installed under rhel8.5

Bug Minor Resolved Duplicate WC Triage Thomas Roth DKMS Tue, 28 Jun 2022 06:39:42 +0000 Mon, 22 Aug 2022 17:18:04 +0000 Mon, 22 Aug 2022 17:18:04 +0000 Lustre 2.15.0 1 6 <p>Actually, this might be due to some issue with the supplied zfs packages:<br/> I installed (from downloads.whamcloud.com/public/lustre/lustre-2.15.0/el8.5.2111)</p> <p>zfs.x86_64                   2.0.7-1.el8      <br/> zfs-dkms.noarch         2.0.7-1.el8<br/> libzpool4.x86_64                     2.0.7-1.el8    <br/> libzfs4.x86_64 2.0.7-1.el8<br/> libzfs4-devel.x86_64 2.0.7-1.el8</p> <p>Then tried the above installation of the Lustre packages, which failed, then got the git repo, configure</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> ./configure --prefix=/usr --enable-modules --disable-iokit --disable-snmp --disable-doc --disable-tests --disable-maintainer-mode --with-linux=/lib/modules/4.18.0-348.23.1.el8_5.x86_64/build --with-linux-obj=/lib/modules/4.18.0-348.23.1.el8_5.x86_64/build --with-o2ib=/usr/src/kernels/4.18.0-348.23.1.el8_5.x86_64 --disable-gss --enable-server --disable-ldiskfs --with-linux=/lib/modules/4.18.0-348.23.1.el8_5.x86_64/build --with-linux-obj=/lib/modules/4.18.0-348.23.1.el8_5.x86_64/build --disable-manpages --disable-mpitests </pre> </div></div> <p>, <em>make rpms</em>, resulting in the expected <em>kmod-lustre-2.15.0-1, kmod-lustre-osd-zfs-2.15.0-1, ... lustre-osd-zfs-mount-2.15.0-1  -</em> rpms, but</p> <p> </p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> rpm -i ./kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64.rpm error: Failed dependencies:     ksym(__cv_broadcast) = 0x03cebd8a is needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64     ksym(arc_add_prune_callback) = 0x1363912f is needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64     ksym(arc_buf_size) = 0xa2990474 is needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64     ksym(arc_remove_prune_callback) = 0x1ab2d851 is needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 ... </pre> </div></div> <p>ZFS by itself seems ok.<br/>  </p> <p><em>2022-06-29 Update</em></p> <p>These self-compiled packages can be installed by</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> rpm -i --nodeps ...</pre> </div></div> <p>Imho this points to the rpm-creating part of the code.</p> <p> </p> <p><a href="https://jira.whamcloud.com/secure/ViewProfile.jspa?name=thomasr" class="user-hover" rel="thomasr">thomasr</a>, to use ZFS, you can't really use any of lustre's binaries directly since they were built against lustre's patched kernel.</p> <p>I assume you use on non-patches kernel, so you might need to install zfs-dkms and lustre-zfs-dkms + lustre user tools.</p> <p>Next iteration: Boot the kernel supplied by Whamcloud,</p> <p> </p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> uname -r 4.18.0-348.2.1.el8_lustre.x86_64 </pre> </div></div> <p>Reinstall zfs, zfs-dkms -&gt; works<br/> Try Lustre:</p> <p> </p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> dnf install lustre kmod-lustre kmod-lustre-osd-zfs lustre-osd-zfs-mount Error: Problem 1: conflicting requests nothing provides ksym(dmu_tx_abort) = 0xa9691ccd needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 nothing provides ksym(zio_buf_alloc) = 0x0c211976 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 ... </pre> </div></div> <p>And again, with dkms</p> <p> </p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> dnf install lustre lustre-zfs-dkms lustre-osd-zfs-mount Error: Problem 1: <span class="code-keyword">package</span> lustre-osd-zfs-mount-2.15.0-1.el8.x86_64 requires kmod-lustre-osd-zfs, but none of the providers can be installed conflicting requests nothing provides ksym(dmu_tx_abort) = 0xa9691ccd needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 ... </pre> </div></div> <p>Maybe I'm misunderstanding something fundamental but AFAICS at least in the ZFS+DKMS (patchless kernel) case the rpm "lustre-osd-zfs-mount" shouldn't have a hard requirement (introduced in <a href="https://jira.whamcloud.com/browse/LU-13120" title="lustre-osd-zfs-mount depends on zfs, kmod-lustre-osd-zfs" class="issue-link" data-issue-key="LU-13120"><del>LU-13120</del></a>) for the (kernel-specific!)  "kmod-lustre-osd-zfs" rpm because the `lustre-zfs`DKMS module (rpm: lustre-zfs-dkms) does already compile and provide the kernel module osd_zfs.ko for the current kernel. And this is the only module the `kmod-lustre-osd-zfs` rpm contains.</p> <p>I.e. if we are using DKMS for lustre server there should not be a kmod requirement.</p> <p>If you install via zfs-dkms, you need to install lustre-all-dkms or lustre-zfs-dkms, not the kmod-lustre-* rpms.</p> <p>To clarify, I did several different attempts:</p> <ul> <li>whamcloud-supplied kernel (348.2.1) plus kmod-packages -&gt; errors</li> <li>distribution-supplied kernel (348.23.1) plus dkms-packages -&gt; errors</li> <li>distribution-supplied kernel (348.23.1) plus self-compiled Lustre (from git) -&gt; errors</li> </ul> <p>In the last step, I did "<em>configure + make rpms</em>", which yields new kmod-packages, obviously.</p> <p>These can be force-installed by supplying <em>--nodeps.</em></p> <p>(I did not try "<em>configure; make; make install</em>"  - if that exists. That might avoid the fatal dependencies check, which seems to be introduced by the package-bundling step ?)</p> <p>Nathaniel, this is not a personal choice but a rpm dependency of the official rpms:</p> <p> </p> <p>$ rpm -q --requires -p lustre-all-dkms-2.15.0-1.el8.noarch.rpm |grep lustre-osd-zfs-mount<br/> lustre-osd-zfs-mount<br/> $ rpm -q --requires -p lustre-osd-zfs-mount-2.15.0-1.el8.x86_64.rpm|grep kmod<br/> kmod-lustre-osd-zfs</p> <p> </p> <p>Please also see my comment above.</p> <p>This dependency was added by <a href="https://review.whamcloud.com/37809" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/37809</a> (<a href="https://jira.whamcloud.com/browse/LU-13120" title="lustre-osd-zfs-mount depends on zfs, kmod-lustre-osd-zfs" class="issue-link" data-issue-key="LU-13120"><del>LU-13120</del></a>) for 2.14.  The solution is to either remove the kmod dependency from lustre-osd-zfs-mount, which may be the right answer because the dependencies have run kmod to utils packages prior to this, or add kmod to the "Provides" for dkms.</p> <p>The issue is being fixed in <a href="https://jira.whamcloud.com/browse/LU-16059" title="Fix dkms server build installation" class="issue-link" data-issue-key="LU-16059"><del>LU-16059</del></a>.</p> Related LU-16006 Development Epic/Theme zfs Rank 1|i02t6v: Rank (Obsolete) 9223372036854775807 Severity