https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-9893 Lustre <p><a href="https://testing.hpdd.intel.com/test_sessions/9b7c7e8e-7b5a-4f4d-af09-400c586a8340" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sessions/9b7c7e8e-7b5a-4f4d-af09-400c586a8340</a></p> <p>Looks like another mds hang on umount issue for this build. It may be related to these tickets:</p> <p><a href="https://jira.whamcloud.com/browse/LU-9791" title="When umount client, kobject_put crashed the kernel" class="issue-link" data-issue-key="LU-9791"><del>LU-9791</del></a> (parallel-scale-nfsv3 &amp; v4)<br/> <a href="https://jira.whamcloud.com/browse/LU-9856" title="NULL pointer dereference in mdd_xattr_list()" class="issue-link" data-issue-key="LU-9856"><del>LU-9856</del></a> (racer)<br/> <a href="https://jira.whamcloud.com/browse/LU-9469" title="conf-sanity test_61: test failed to respond and timed out" class="issue-link" data-issue-key="LU-9469"><del>LU-9469</del></a> (conf-sanity)</p> <p>However, this one does not show this message in the MDS console log:</p> <p>BUG: unable to handle kernel NULL pointer dereference at (null)</p> <p>What this shares in common with the above three is they all have an mds umount at the end of the suite_log. No further activity is seen.</p> <p>From suite_log:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>test_70c fail mds1 1 times Failing mds1 on trevis-41vm3 CMD: trevis-41vm3 grep -c /mnt/lustre-mds1' ' /proc/mounts Stopping /mnt/lustre-mds1 (opts:) on trevis-41vm3 CMD: trevis-41vm3 umount -d /mnt/lustre-mds1 (end of log) </pre> </div></div> Trevis2, failover<br/> server: RHEL 7.3, ldiskfs, branch master, v2.10.51, b3620<br/> client: RHEL 7.3, branch master, v2.10.51, b3620<br/> LU-9893

replay-single test_70c: test failed to respond and timed out

Bug Minor Open Unresolved WC Triage James Casper Fri, 18 Aug 2017 20:57:24 +0000 Wed, 24 Aug 2022 02:27:40 +0000 Lustre 2.10.1 Lustre 2.11.0 0 6 <p>Jim, can you grab /kdumproot/scratch//dumps/trevis-41vm3.trevis.hpdd.intel.com/10.9.5.239-2017-08-04-12:28:28/vmcore-dmesg.txt.</p> <p>See <a href="https://testing.hpdd.intel.com/test_logs/f0c4415a-799c-11e7-8e1f-5254006e85c2/show_text" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_logs/f0c4415a-799c-11e7-8e1f-5254006e85c2/show_text</a></p> <p>Looks like that directory no longer exists:</p> <p><span class="error">&#91;root@trevis-41 trevis-41vm3.trevis.hpdd.intel.com&#93;</span># pwd<br/> /scratch/dumps/trevis-41vm3.trevis.hpdd.intel.com<br/> <span class="error">&#91;root@trevis-41 trevis-41vm3.trevis.hpdd.intel.com&#93;</span># ls -al<br/> total 100<br/> drwxr-xr-x 7 root root 4096 Aug 21 23:05 .<br/> drwxr-xr-x 1433 root root 73728 Aug 10 17:23 ..<br/> drwxr-xr-x 2 root root 4096 Aug 5 03:29 10.9.5.239-2017-08-05-03:29:12<br/> drwxr-xr-x 2 root root 4096 Aug 7 18:48 10.9.5.239-2017-08-07-18:48:49<br/> drwxr-xr-x 2 root root 4096 Aug 7 21:50 10.9.5.239-2017-08-07-21:50:33<br/> drwxr-xr-x 2 root root 4096 Aug 14 06:19 10.9.5.239-2017-08-14-06:19:45<br/> drwxr-xr-x 2 root root 4096 Aug 15 03:22 10.9.5.239-2017-08-15-03:21:47<br/> <span class="error">&#91;root@trevis-41 trevis-41vm3.trevis.hpdd.intel.com&#93;</span># </p> <p>I looked in Maloo for all replay-single test 70c timeouts (hangs) this year. I found 14 occurrences of this test hanging, but none of them are hanging on umount.</p> <p>If we see this issue again, we need to look for the vmcore-dmesg.txt file as early as possible.</p> <p>James, maybe try something like</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>find /scratch/dumps -name vmcore-dmesg.txt -exec grep --with-filename test_70c {} \; </pre> </div></div> <p>to find other instances of this crash.</p> <p>+1 on master: <a href="https://testing.whamcloud.com/test_sets/079de990-f2fe-47b8-a70f-cb455e084ec8" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/079de990-f2fe-47b8-a70f-cb455e084ec8</a></p> <p>+1 on master: <a href="https://testing.whamcloud.com/test_sets/102cd218-cda2-4092-b4f1-991fa8aeda2e" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/102cd218-cda2-4092-b4f1-991fa8aeda2e</a></p> Development Rank 1|hzziov: Rank (Obsolete) 9223372036854775807 Severity