https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-8469 Lustre <p>Ran into a lock-up of sanity test 133g when it tried to unmount the Lustre file system. It kept printing this to the console: </p> <p>/mnt/client is still busy, wait one second<br/> /mnt/client is still busy, wait one second<br/> /mnt/client is still busy, wait one second</p> <p>I stopped the test and tried to unmount manually. That failed with "file system busy" error. </p> <p>I found that a loop device was still mounted against the Lustre file system. This is a left over from test 54c.</p> <p>Looking back at the logs, I can see that 54c is unable to unmount the loop device:</p> <p>[ 1529.373768] Lustre: DEBUG MARKER: == sanity test 54c: block device works in lustre ===================================================== 21:31:35 (1469766695)<br/> [ 1529.543207] EXT4-fs (loop3): mounting ext2 file system using the ext4 subsystem<br/> [ 1529.550865] EXT4-fs (loop3): mounted filesystem without journal. Opts: (null)<br/> [ 1529.810716] Lustre: DEBUG MARKER: sanity test_54c: @@@@@@ FAIL: test_54c failed with 32</p> <p>I looked at other sanity runs which were successful, and found this:</p> <p>== sanity test 54c: block device works in lustre ===================================================== 17:27:05 (1469838425)<br/> make a loop file system with /mnt/client/f54c.sanity on /mnt/client/loop54c (3).<br/> 1+0 records in<br/> 1+0 records out<br/> 4096 bytes (4.1 kB) copied, 0.00140237 s, 2.9 MB/s<br/> mke2fs 1.42.12.wc1 (15-Sep-2014)<br/> Creating filesystem with 4100 1k blocks and 1032 inodes</p> <p>Allocating group tables: done <br/> Writing inode tables: done <br/> Writing superblocks and filesystem accounting information: done</p> <p>30+0 records in<br/> 30+0 records out<br/> 122880 bytes (123 kB) copied, 0.000805954 s, 152 MB/s<br/> Filesystem 1K-blocks Used Available Use% Mounted on<br/> /mnt/client/loop54c 3966 151 3610 5% /mnt/client/d54c.sanity<br/> 30+0 records in<br/> 30+0 records out<br/> 122880 bytes (123 kB) copied, 0.00015479 s, 794 MB/s<br/> losetup: /mnt/client/loop54c: detach failed: No such device or address<br/> losetup: /dev/loop3: detach failed: No such device or address<br/> Resetting fail_loc on all nodes...done.<br/> PASS 54c (1s)</p> <p>So, 54c is passing when it cannot use the loop device?!?</p> <p>This all seems very broken to me. 54c passes when we can't use the loop device (why can't we use it) and fail when we do mount the loop device because it cannot unmount it.</p> RHEL 7, master, VMs LU-8469

Sanity test 54c: Unable to unmount loop device

Bug Major Resolved Cannot Reproduce WC Triage Doug Oucharek Tue, 2 Aug 2016 16:25:53 +0000 Tue, 14 Dec 2021 22:16:12 +0000 Tue, 14 Dec 2021 22:16:12 +0000 0 3 <p>I'm attaching all the test 54c test logs for the failing case.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>122880 bytes (123 kB) copied, 0.00015479 s, 794 MB/s losetup: /mnt/client/loop54c: detach failed: No such device or address losetup: /dev/loop3: detach failed: No such device or address </pre> </div></div> <p>this is understandable:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>cleanup_54c() { loopdev="$DIR/loop54c" trap 0 $UMOUNT $DIR/$tdir || rc=$? losetup -d $loopdev || true losetup -d $LOOPDEV || true </pre> </div></div> <p>So normally unmount when successful would detach loop device and the following losetups would error out which is what you have quoted in the ticket description- this is normal.<br/> It would be good if the cleanup script checked that the loop device is setup to avoid confusing error messages, but otherwise it is pretty harmless.</p> <p>Now the failure to unmount as in the attached log - that's a problem - something holds the mountpoint. when this happens would be great to see what was that. some background process got to it?<br/> I assume by the time you get to test 133g failure you can just unmount the /mnt/client/d54c.sanity and it then can unmount stuff?<br/> So we really need to add some debug in 54c if the unmount gfails to see what holds the mountpoint busy in there</p> Development Rank 1|hzyjbb: Rank (Obsolete) 9223372036854775807 Severity