https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-5307 Lustre <p>e2fsprogs build of master-lustre branch fails in el7/Centos 7. Even after faking out the build to use the RHEL6 spec file with the following patch</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>--- a/contrib/build-rpm +++ b/contrib/build-rpm @@ -69,6 +69,7 @@ fi case "$DISTRO-$RELEASE" in RedHatEnterpriseServer-6*) DISTRO=RHEL; RELEASE=6;; CentOS-6*) DISTRO=RHEL; RELEASE=6;; + CentOS-7*) DISTRO=RHEL; RELEASE=6;; Fedora-1[234]) DISTRO=RHEL; RELEASE=6;; # use the same .spec for now esac </pre> </div></div> <p>the build fails. Plain 'make' works fine, but 'make rpm' fails a couple of the test cases executed on the fly in the build. example errors:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre> . . . f_uninit_disable: disable uninit_bg feature: ok f_bbfile: bad blocks in files: ok 168 tests succeeded 2 tests failed Tests failed: r_64bit_big_expand r_ext4_big_expand make[2]: *** [test_post] Error 1 make[2]: Leaving directory `/home/bogl/rb/BUILD/e2fsprogs-1.42.9.wc1/tests' make[1]: *** [check-recursive] Error 1 make[1]: Leaving directory `/home/bogl/rb/BUILD/e2fsprogs-1.42.9.wc1' error: Bad exit status from /var/tmp/rpm-tmp.ZDx19k (%check) RPM build errors: bogus date in %changelog: Mon Jul 13 2010 Eric Sandeen &lt;sandeen@redhat.com&gt; 1.41.12-5 bogus date in %changelog: Thu Sep 14 2009 Eric Sandeen &lt;sandeen@redhat.com&gt; 1.41.9-3 bogus date in %changelog: Fri Aug 05 2009 Eric Sandeen &lt;sandeen@redhat.com&gt; 1.41.8-6 bogus date in %changelog: Mon Oct 03 2008 Eric Sandeen &lt;sandeen@redhat.com&gt; 1.41.3-2 bogus date in %changelog: Mon Oct 03 2008 Eric Sandeen &lt;sandeen@redhat.com&gt; 1.41.3-1 bogus date in %changelog: Mon Jan 10 2008 Eric Sandeen &lt;sandeen@redhat.com&gt; 1.40.4-4 bogus date in %changelog: Tue Jan 09 2008 Eric Sandeen &lt;sandeen@redhat.com&gt; 1.40.4-3 bogus date in %changelog: Tue Oct 15 2007 Eric Sandeen &lt;esandeen@redhat.com&gt; 1.40.2-9 Bad exit status from /var/tmp/rpm-tmp.ZDx19k (%check) make: *** [rpm] Error 1 </pre> </div></div> <p>Not a blocker for right now when going for only client builds, but will become critical later on. Working e2fsprogs will be needed for full server functionality.</p> Centos 7 LU-5307

e2fsprogs build fails in Centos 7

Bug Major Resolved Not a Bug WC Triage Bob Glossman Tue, 8 Jul 2014 21:02:48 +0000 Mon, 2 Mar 2015 23:25:50 +0000 Tue, 28 Oct 2014 14:38:05 +0000 Lustre 2.7.0 0 5 <p>I think I already have this fixed in my tree. Was just waiting for upstream e2fsprogs to be updated to 1.42.11 before pushing a new release. </p> <p>while most recent refreshes of <a href="http://review.whamcloud.com/11147" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/11147</a> build fine in el7 on Jenkins it fails 2 of the runtime tests during 'make rpm' in my manual builds on el7. failing tests are r_64bit_big_expand &amp; r_ext4_big_expand. Not at all clear what is different about the builds.</p> <p>r_64bit_big_expand.failed:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>very large fs growth using ext4 w/64bit starting 0+0 records in 0+0 records out 0 bytes (0 B) copied, 3.6279e-05 s, 0.0 kB/s using /tmp/e2fsprogs-tmp-r_64bit_big_expand.mn44uq ../misc/mke2fs -t ext4 -O 64bit -qF /tmp/e2fsprogs-tmp-r_64bit_big_expand.mn44uq 512M ../tests/progs/crcsum /tmp/csum-tmp.JgasXw Checksum is 445001071 Setting up file system debugfs 1.42.11.wc1 (24-Jul-2014) debugfs: mkdir test debugfs: cd test debugfs: write /tmp/csum-tmp.JgasXw e2fsck Allocated inode: 13 debugfs: ls /test 12 (12) . 2 (12) .. 13 (4072) e2fsck debugfs: stat /test/e2fsck Inode: 13 Type: regular Mode: 0600 Flags: 0x80000 Generation: 0 Version: 0x00000000:00000000 User: 0 Group: 0 Size: 1222732 File ACL: 0 Directory ACL: 0 Links: 1 Blockcount: 2392 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x53cfcbe9:00000000 -- Wed Jul 23 14:51:21 2014 atime: 0x53cfcbe9:00000000 -- Wed Jul 23 14:51:21 2014 mtime: 0x53cfcbe9:00000000 -- Wed Jul 23 14:51:21 2014 crtime: 0x53cfcbe9:00000000 -- Wed Jul 23 14:51:21 2014 Size of extra inode fields: 28 EXTENTS: (0-5):75-80, (6-17):85-96, (18-298):2146-2426 debugfs: quit ../e2fsck/e2fsck -fy /tmp/e2fsprogs-tmp-r_64bit_big_expand.mn44uq e2fsck 1.42.11.wc1 (24-Jul-2014) Pass 1: Checking inodes, blocks, and sizes Pass 2: Checking directory structure Pass 3: Checking directory connectivity Pass 4: Checking reference counts Pass 5: Checking group summary information Free blocks count wrong (17179993603, counted=124419). Fix? yes /tmp/e2fsprogs-tmp-r_64bit_big_expand.mn44uq: ***** FILE SYSTEM WAS MODIFIED ***** /tmp/e2fsprogs-tmp-r_64bit_big_expand.mn44uq: 13/32768 files (7.7% non-contiguous), 6653/131072 blocks ../resize/resize2fs -d 63 /tmp/e2fsprogs-tmp-r_64bit_big_expand.mn44uq 2T resize2fs 1.42.11.wc1 (24-Jul-2014) fs has 13 inodes, 1 groups required. fs requires 4402 data blocks. With 1 group(s), we have 30517 blocks available. Last group's overhead is 2251 Need 4402 data blocks in last group Final size of last group is 6653 Estimated blocks needed: 6653 Extents safety margin: 13 Resizing the filesystem on /tmp/e2fsprogs-tmp-r_64bit_big_expand.mn44uq to 536870912 (4k) blocks. read_bitmaps: Memory used: 132k/0k (64k/69k), time: 0.00/ 0.00/ 0.00 read_bitmaps: I/O read: 1MB, write: 0MB, rate: 22727.27MB/s fix_uninit_block_bitmaps 1: Memory used: 132k/0k (64k/69k), time: 0.00/ 0.00/ 0.00 ../resize/resize2fs: Attempt to write block to filesystem resulted in short write while trying to resize /tmp/e2fsprogs-tmp-r_64bit_big_expand.mn44uq Please run 'e2fsck -fy /tmp/e2fsprogs-tmp-r_64bit_big_expand.mn44uq' to fix the filesystem after the aborted resize operation. </pre> </div></div> <p>r_ext4_big_expand.failed:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>very large fs growth using ext4 starting 0+0 records in 0+0 records out 0 bytes (0 B) copied, 3.7817e-05 s, 0.0 kB/s using /tmp/e2fsprogs-tmp-r_ext4_big_expand.3DRSoy ../misc/mke2fs -t ext4 -qF /tmp/e2fsprogs-tmp-r_ext4_big_expand.3DRSoy 512M ../tests/progs/crcsum /tmp/csum-tmp.7VPqSJ Checksum is 2560589454 Setting up file system debugfs 1.42.11.wc1 (24-Jul-2014) debugfs: mkdir test debugfs: cd test debugfs: write /tmp/csum-tmp.7VPqSJ e2fsck Allocated inode: 13 debugfs: ls /test 12 (12) . 2 (12) .. 13 (4072) e2fsck debugfs: stat /test/e2fsck Inode: 13 Type: regular Mode: 0600 Flags: 0x80000 Generation: 0 Version: 0x00000000:00000000 User: 0 Group: 0 Size: 1222732 File ACL: 0 Directory ACL: 0 Links: 1 Blockcount: 2392 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x53cfcb9e:00000000 -- Wed Jul 23 14:50:06 2014 atime: 0x53cfcb9e:00000000 -- Wed Jul 23 14:50:06 2014 mtime: 0x53cfcb9e:00000000 -- Wed Jul 23 14:50:06 2014 crtime: 0x53cfcb9e:00000000 -- Wed Jul 23 14:50:06 2014 Size of extra inode fields: 28 EXTENTS: (0-5):43-48, (6-17):53-64, (18-298):2114-2394 debugfs: quit ../e2fsck/e2fsck -fy /tmp/e2fsprogs-tmp-r_ext4_big_expand.3DRSoy e2fsck 1.42.11.wc1 (24-Jul-2014) Pass 1: Checking inodes, blocks, and sizes Pass 2: Checking directory structure Pass 3: Checking directory connectivity Pass 4: Checking reference counts Pass 5: Checking group summary information /tmp/e2fsprogs-tmp-r_ext4_big_expand.3DRSoy: 13/32768 files (7.7% non-contiguous), 6557/131072 blocks ../resize/resize2fs -d 63 /tmp/e2fsprogs-tmp-r_ext4_big_expand.3DRSoy 2T resize2fs 1.42.11.wc1 (24-Jul-2014) fs has 13 inodes, 1 groups required. fs requires 4402 data blocks. With 1 group(s), we have 30613 blocks available. Last group's overhead is 2155 Need 4402 data blocks in last group Final size of last group is 6557 Estimated blocks needed: 6557 Extents safety margin: 13 Resizing the filesystem on /tmp/e2fsprogs-tmp-r_ext4_big_expand.3DRSoy to 536870912 (4k) blocks. read_bitmaps: Memory used: 132k/0k (64k/69k), time: 0.00/ 0.00/ 0.00 read_bitmaps: I/O read: 1MB, write: 0MB, rate: 27027.03MB/s fix_uninit_block_bitmaps 1: Memory used: 132k/0k (64k/69k), time: 0.00/ 0.00/ 0.00 ../resize/resize2fs: Attempt to write block to filesystem resulted in short write while trying to resize /tmp/e2fsprogs-tmp-r_ext4_big_expand.3DRSoy Please run 'e2fsck -fy /tmp/e2fsprogs-tmp-r_ext4_big_expand.3DRSoy' to fix the filesystem after the aborted resize operation. </pre> </div></div> <p>It turns out that there was a bug in the upstream e2fsprogs-1.42.11 release which caused small filesystems to fail at mkfs time, especially if they specified a high inode count or large inodes (which both our sanity-lfsck and conf-sanity tests do). The good news is that I've found and fixed this (<a href="http://git.whamcloud.com/tools/e2fsprogs.git/commit/adf996d0f1afd574c9cc0782a95d0995e0664abd" class="external-link" target="_blank" rel="nofollow noopener">http://git.whamcloud.com/tools/e2fsprogs.git/commit/adf996d0f1afd574c9cc0782a95d0995e0664abd</a>) and pushed it upstream, so it will be in the upcoming 1.42.12 release and our own 1.42.11.wc2 release.</p> <p>The e2fsprogs-RHEL-7.spec.in file does not build the <tt>lfsck</tt> tool since it is now wholly obsolete and there are no versions of RHEL 7 where the old version of lfsck was available. For distros where the e2fsprogs-based <tt>lfsck</tt> is still being built, it will also refuse to run on Lustre 2.6 and later, or if it detects the in-kernel 2.6 LFSCK has run MDT-OST consistency (checking for the presence of the <tt>lfsck-layout</tt> file).</p> <p>I also had to revert some autoconf changes so that e2fsprogs could still build on RHEL5 (<a href="http://git.whamcloud.com/tools/e2fsprogs.git/commit/5ce5311d609967a903d3b4cdcbf6f66e939e2d7f" class="external-link" target="_blank" rel="nofollow noopener">http://git.whamcloud.com/tools/e2fsprogs.git/commit/5ce5311d609967a903d3b4cdcbf6f66e939e2d7f</a>) but the change does not have any affect on functionality either way.</p> <p>The <tt>r_{64bit,ext4}_big_expand</tt> test failures are hopefully addressed by other patches landed since e2fsprogs-1.42.11 was tagged.</p> <p>The <tt>r_{64bit,ext4}_big_expand</tt> test failures continued and persisted even with the latest changes. However it looks like it was only due to the environment I was running tests on. The default fs type in an el7 install is xfs, not ext2/3/4. Building e2fsprogs &amp; running tests on a root fs that is xfs failed every time. When I finally figured out how to install el7 with a non-default ext4 fs type for root fs, then e2fsprogs built fine. All the runtime tests passed.</p> <p>Since Jenkins build of e2fsprogs have been succeeding right along I'm guessing that el7 builders in our clusters were always installed with ext4, not xfs, and that's why it worked there.</p> Related LU-5022 Development Rank 1|hzwqwn: Rank (Obsolete) 14825 Severity