Whamcloud Community JIRA

Whamcloud Community JIRA https://jira.whamcloud.com This file is an XML representation of an issue en-us

9.4.14

940014

05-12-2023

[LU-10997] Ubuntu 18 support https://jira.whamcloud.com/browse/LU-10997 Lustre <p>The next LTS release of Ubuntu is now available. It includes ZFS by default and runs a 4.15 kernel. This ticket will track all the work needed to support this platform.</p> Ubuntu 18 LU-10997

Ubuntu 18 support

New Feature Minor Resolved Fixed James A Simmons James A Simmons Fri, 4 May 2018 13:57:52 +0000 Thu, 13 Aug 2020 14:45:11 +0000 Thu, 13 Aug 2020 14:45:11 +0000 Lustre 2.12.0 Lustre 2.14.0 0 5 <p>For my testing I grabbed the master-next branch and rebased <a href="https://review.whamcloud.com/#/c/31790" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/#/c/31790</a></p> <p>In my initial testing using the default ZFS (0.7.5) that comes with Ubuntu I see the following error on startup.</p> <p><span class="error">[312807.501231]</span> Lustre: DEBUG MARKER: /usr/src/lustre-2.11.51/lustre/tests/../utils/.libs/lctl get_param -n version 2>/dev/null || /usr/src/lustre-2.11.51/lustre/tests/../utils/.libs/lctl lustre_build_version 2>/dev/null || /usr/src/lustre-2.11.51/lustre/tests/../utils/.libs/lctl --version 2><br/> <span class="error">[312807.980495]</span> osd_zfs: Unknown symbol dmu_objset_projectquota_enabled (err 0)<br/> <span class="error">[312807.980574]</span> osd_zfs: Unknown symbol dmu_assign_arcbuf_by_dbuf (err 0)</p> <p>So looking at the zfs code ZFS_PROJINHERIT is defined but dmu_objset_projectquota_enabled() is missing. Also I can't seem to find where dmu_assign_archbuf_by_dbuf is being used.</p> <p>James Simmons (uja.ornl@yahoo.com) uploaded a new patch: <a href="https://review.whamcloud.com/32304" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/32304</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-10997" title="Ubuntu 18 support" class="issue-link" data-issue-key="LU-10997"><del>LU-10997</del></a> build: add files to .gitignore<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 07056f71248838e678aba5ce8bae2bfcda941343</p> <p>I see what went wrong. I had some newer ZFS sources in /usr/src which don't match what Ubuntu 18 ships with. So I moved it out of the way. Looking to see where the zfs source are I found them in /usr/src/linux-source-4.15.0/{spl/zfs}. So they are looked in the kernel source itself. We will have to update the source paths for the Ubuntu case.</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="https://review.whamcloud.com/32304/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/32304/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-10997" title="Ubuntu 18 support" class="issue-link" data-issue-key="LU-10997"><del>LU-10997</del></a> build: add files to .gitignore<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 734d944d98f4cbcaeebc462e979624e8bdfb7711</p> <p>Their is something really wrong with the test setup with Ubuntu. Anything I push fails with:</p> <p>Trying to load: pxelinux.cfg/1545a47a-0617-0b4b-bafe-af4b2b9c27ce�[1S Trying to load: pxelinux.cfg/01-52-54-00-70-0d-c7�[1S Booting from local disk...�[1S Could not boot image: Error 0x7f8d81ff (<a href="http://ipxe.org/7f8d81ff)" class="external-link" target="_blank" rel="nofollow noopener">http://ipxe.org/7f8d81ff)</a></p> <p> </p> <p>I noticed the ARM64 is constantly crashing in the recent testing. Its the same reason as Ubuntu18 is now broken :</p> <p><b>/usr/src/lustre-2.11.56/lustre/osd-ldiskfs/osd_io.c:</b> In function ‘<b>osd_bio_integrity_compare</b>’:</p> <p><b>/usr/src/lustre-2.11.56/lustre/osd-ldiskfs/osd_io.c:345:53:</b> <b>error:</b> ‘<b>struct bio</b>’ has no member named ‘<b>bi_bdev</b>’; did you mean ‘<b>bi_iter</b>’?</p> <p> struct blk_integrity <b>bi = bdev_get_integrity(bio->*bi_bdev</b>);</p> <p> <b>^~~~~~~</b></p> <p> bi_iter</p> <p>scripts/Makefile.build:332: recipe for target '/usr/src/lustre-2.11.56/lustre/osd-ldiskfs/osd_io.o' failed</p> <p>make<span class="error">[6]</span>: *** <span class="error">[/usr/src/lustre-2.11.56/lustre/osd-ldiskfs/osd_io.o]</span> Error 1</p> <p>Minh Sebastien found the staging module usage error but now we see the following when building:<br/> checking whether to use Compat RDMA... /usr/bin/ofed_info*10:40:52* xargs: rpm: No such file or directory*10:40:52* configure: error: <b>10:40:52</b> You seem to have an OFED installed but have not installed it's devel package.<b>10:40:52</b> If you still want to build Lustre for your OFED I/B stack, you need to install its devel headers RPM.<b>10:40:52</b> Instead, if you want to build Lustre for your kernel's built-in I/B stack rather than your installed OFED stack, either remove the OFED package(s) or use -<del>with-o2ib=no.<b>10:40:52</b> <b>10:40:52</b> dh_testdir*10:40:52* /usr/bin/make -C . -j 4*10:40:52* make<span class="error">[2]</span>: Entering directory '/var/lib/jenkins/workspace/lustre</del><br/> </p> <p>Resolved all the major Ubuntu issues!! Just took many patches <img class="emoticon" src="https://jira.whamcloud.com/images/icons/emoticons/sad.png" height="16" width="16" align="absmiddle" alt="" border="0"/></p> <p>Last patch <a href="https://review.whamcloud.com/#/c/33492" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/#/c/33492</a> for complete Ubuntu18 client support <img class="emoticon" src="https://jira.whamcloud.com/images/icons/emoticons/smile.png" height="16" width="16" align="absmiddle" alt="" border="0"/></p> <p>Now that we are moving to Ubuntu 20 LTS we can close this and move the remaining tickets to that work to resolve.</p> Related LU-10335 LU-10947 LU-11575 LU-11246 LU-11071 LU-9087 LU-12019 LU-10366 LU-11176 LU-11635 LU-12474 LU-10328 LU-10334 LU-10365 LU-10560 LU-10575 LU-10805 LU-11541 LU-12229 LU-12282 LU-13019 LU-13740 LU-11034 LU-11244 LU-12137 Development Rank 1|hzzwsv: Rank (Obsolete) 9223372036854775807