https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-11765 Lustre <p>Running a failover test(random failover of OSSs + mdtest), an mdtest job failed reporting stat failures. This looked similar to <a href="https://jira.whamcloud.com/browse/LU-11760" title="formatted OST recognition change" class="issue-link" data-issue-key="LU-11760"><del>LU-11760</del></a>, except that this time all the files were actually present, valid after the job failure.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>V-1: Entering create_remove_items_helper... V-1: Entering unique_dir_access... V-1: Entering mdtest_stat... 08/19/2018 07:15:43: Process 10(nid00265): FAILED in mdtest_stat, unable to stat file: No such file or directory 08/19/2018 07:15:43: Process 15(nid00279): FAILED in mdtest_stat, unable to stat file: No such file or directory Rank 10 [Sun Aug 19 07:15:43 2018] [c1-0c0s4n1] application called MPI_Abort(MPI_COMM_WORLD, 1) - process 10 Rank 15 [Sun Aug 19 07:15:43 2018] [c1-0c0s4n3] application called MPI_Abort(MPI_COMM_WORLD, 1) - process 15</pre> </div></div> <p>Details of fail reason could be found in a patch commit message. I will upload it in the nearest time.</p> LU-11765

during failover test run, mdtest job fails, numerous stat failures 'No such file or directory'

Bug Major Resolved Fixed Sergey Cheremencev Sergey Cheremencev patch Wed, 12 Dec 2018 11:16:25 +0000 Wed, 29 Jun 2022 19:53:16 +0000 Wed, 17 Apr 2019 13:20:54 +0000 Lustre 2.13.0 0 4 <p>Sergey Cheremencev (c17829@cray.com) uploaded a new patch: <a href="https://review.whamcloud.com/33836" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/33836</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11765" title="during failover test run, mdtest job fails, numerous stat failures &#39;No such file or directory&#39;" class="issue-link" data-issue-key="LU-11765"><del>LU-11765</del></a> ofd: return EAGAIN during 1st CLEANUP_ORPHAN<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: c13e591a85bfab7df8a341137a160e5690175220</p> <p>Below is example how to start replay-ost-single_12 on local virtual machines. Note OST1 should be on a separate node.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>LOAD_MODULES_REMOTE=true PDSH="/usr/local/bin/pdsh -S -R ssh -w" POWER_UP="" FAILURE_MODE=HARD POWER_DOWN="pdsh -S -R ssh -w dhcppc4 echo c &gt; /proc/sysrq-trigger&amp;" NOFORMAT=yes mds_HOST=dhcppc3 mgs_HOST=dhcppc3 OSTCOUNT=1 ost1_HOST=dhcppc4 ost2_HOST=dhcppc3 ONLY=12 bash /root/src/lustre-wc-rel/lustre/tests/replay-ost-single.sh</pre> </div></div> <p>With a t-f patch if modules on the second node don't start automatically:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>[root@dhcppc3 tests]# git diff test-framework.sh diff --git a/lustre/tests/test-framework.sh b/lustre/tests/test-framework.sh index b42bc9c..2c2daae 100755 --- a/lustre/tests/test-framework.sh +++ b/lustre/tests/test-framework.sh @@ -1902,7 +1902,7 @@ mount_facet() { local devicelabel local dm_dev=${!dev} - module_loaded lustre || load_modules + load_modules case $fstype in </pre> </div></div> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/33836/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/33836/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11765" title="during failover test run, mdtest job fails, numerous stat failures &#39;No such file or directory&#39;" class="issue-link" data-issue-key="LU-11765"><del>LU-11765</del></a> ofd: return EAGAIN during 1st CLEANUP_ORPHAN<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: dc52a88cde1e7cea093b25fc9a15509fe0ac527a</p> <p>What work remains here?</p> <p>This is resolved with L2.13.0.</p> Related Development Rank 1|i007v3: Rank (Obsolete) 9223372036854775807 Severity