https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-11440 Lustre <p>Need to make a release of e2fsprogs-1.44.3-wc1 from the master-lustre-test branch. </p> <p>This also needs a patch to <tt>lustre/Changelog</tt> to update the release version. </p> LU-11440

Make e2fsprogs-1.44.3-wc1 release

Improvement Major Resolved Fixed Minh Diep Andreas Dilger Thu, 27 Sep 2018 17:12:07 +0000 Sat, 8 Dec 2018 05:33:28 +0000 Tue, 23 Oct 2018 05:35:34 +0000 Lustre 2.12.0 Lustre 2.12.0 0 7 <p>Testing e2fsprogs-1.44.3-wc1 with SLES12 reports a filesystem corruption in conf-sanity test_99 "Adding meta_bg option" at mount time:<br/> <a href="https://testing.whamcloud.com/test_sets/a1c1f34a-c5c2-11e8-b143-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/a1c1f34a-c5c2-11e8-b143-52540065bddc</a></p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>LDISKFS-fs (dm-10): ldiskfs_check_descriptors: Block bitmap for group 0 overlaps block group descriptors LDISKFS-fs (dm-10): group descriptors corrupted! mkfs.lustre: Unable to mount /dev/mapper/ost1_flakey: Structure needs cleaning </pre> </div></div> <p>Turns out the kernel of SLES12SP3 is missing a fix:</p> <p>44de022c4382541cebdd6de4465d1f4f465ff1dd</p> <p>ext4: fix false negatives <b>and</b> false positives in ext4_check_descriptors()</p> <p>the bug was introduced in v4.4.140 and suse included the fix after v4.4.147, we are having the issue as the kernel is v4.4.143 on the test vms. I'm talking about the sles12 kernel versions here.</p> <p>What's our approach for this? open another Jira ticket and add this as a ldiskfs patch for kernels between v4.4.140 and v4.4.147 only?</p> <p>Dongyang</p> <p>If I understand correctly, will this disappear as soon as <a href="https://review.whamcloud.com/#/c/33236/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/#/c/33236/</a> is landed (which may even be today)?</p> <p>Peter</p> <p>Peter,</p> <p>Yes that's right, given we also use the new kernel on the test boxes.</p> <p>Then we should be all set now as it's landed</p> <p>It looks like SLES12 is now passing with e2fsprogs-1.44.3-wc1 so I think it makes sense to push master-lustre-test to master-lustre.</p> <p>Dongyang, can you please also push a patch to Lustre to update lustre/Changelog to reference the new version.</p> <p>Li Dongyang (dongyangli@ddn.com) uploaded a new patch: <a href="https://review.whamcloud.com/33370" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/33370</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11440" title="Make e2fsprogs-1.44.3-wc1 release" class="issue-link" data-issue-key="LU-11440"><del>LU-11440</del></a> doc: recommend e2fsprogs 1.44.3.wc1<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 014f4f4564344c18b0ccc6895110f24777142768</p> <p>The old master-lustre branch is now  v1.42.13.wc6-lustre</p> <p>master-lustre-test has been renamed to master-lustre</p> <p>lustre/Changelog also updated.</p> <p>Minh, the build artifacts are available for RHEL6/7, and SLES 11/12. Can you please please move them to the download site. </p> <p>If we don't already have a ticket for it, we also need to look into adding an Ubuntu builder for e2fsprogs. Building should be fairly straight forward, as the upstream Debian e2fsprogs is built directly from the e2fsprogs repo. </p> <p>The last testing with this gave:</p> <p>mke2fs 1.44.3.wc1 (23-July-2018)</p> <p>mke2fs: Size of device (0x448000000 blocks) /dev/mapper/crius-ddn-l12 too big to be expressed in 32 bits using a blocksize of 4096.</p> <p>It looks like a -o 64 option will be needed.</p> <p>I will look into it tomorrow to track down the issue.</p> <p>James, that must be formatting an MDT? By default the OST already uses "-o 64bit". With DoM it probably makes sense to enable "-o 64bit" on the MDT if it is large, but this forces the use of extents, which can hurt directory performance because directories are typically random 4KB blocks. </p> <p>Yes its the MDT being formatted that reports the problem. What should be the policy here? Give a warning and just format the disk at the maximum large size in the default case.</p> <p>BTW is the test harness now using this version of e2fsprogs?</p> <p>Yes, e2fsprogs-1.44.3.wc1 is currently being used by all autotest runs.</p> <p>I don't think the over-16TB MDT issue is related to e2fsprogs-1.44.3, so it should probably go into its own LU ticket. I do recall a similar issue being seen in the past, so if you search with the actual error message you may find it.</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/33370/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/33370/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11440" title="Make e2fsprogs-1.44.3-wc1 release" class="issue-link" data-issue-key="LU-11440"><del>LU-11440</del></a> doc: recommend e2fsprogs 1.44.3.wc1<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: e5753f64de77d56f5ab0f5b518a7b1315352aedd</p> <p>Landed for 2.12</p> <p>Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/33766" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/33766</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11440" title="Make e2fsprogs-1.44.3-wc1 release" class="issue-link" data-issue-key="LU-11440"><del>LU-11440</del></a> misc: require ldiskfsprogs-1.44.3.wc1 or later<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 6fe9c8678209f06be41cec3c2ce49ffa17419727</p> <p>Ubuntu changes should be in one or more of the  <tt>debian/control*</tt> files I believe.  There doesn't seem to be an existing explicit dependency on e2fsprogs</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/33766/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/33766/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11440" title="Make e2fsprogs-1.44.3-wc1 release" class="issue-link" data-issue-key="LU-11440"><del>LU-11440</del></a> misc: require ldiskfsprogs-1.44.3.wc1 or later<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 2846da79a2cc12de6e43a05e45317d48115178ed</p> Related LU-1732 LU-11246 LU-6387 LU-11071 LU-11200 LU-11215 LU-11545 LU-11546 Development Rank 1|i0037r: Rank (Obsolete) 9223372036854775807