https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-15977 Lustre <p>This issue was created by maloo for Li Xi &lt;pkuelelixi@gmail.com&gt;</p> <p>This issue relates to the following test suite run: <a href="https://testing.whamcloud.com/test_sets/06a33583-a064-42b7-8610-d0ee29e60d1e" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/06a33583-a064-42b7-8610-d0ee29e60d1e</a></p> <p>test_80b failed with the following error:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>== sanityn test 80b: Accessing directory during migration ========================================================== 07:06:08 (1656313568) start migration thread 777660 accessing the migrating directory for 5 minutes... touch file failed with 0 /usr/lib64/lustre/tests/sanityn.sh: line 4770: kill: (777660) - No such process sanityn test_80b: @@@@@@ FAIL: migration stopped 2 Trace dump: = /usr/lib64/lustre/tests/test-framework.sh:6522:error() = /usr/lib64/lustre/tests/sanityn.sh:4770:test_80b() = /usr/lib64/lustre/tests/test-framework.sh:6857:run_one() = /usr/lib64/lustre/tests/test-framework.sh:6904:run_one_logged() = /usr/lib64/lustre/tests/test-framework.sh:6745:run_test() = /usr/lib64/lustre/tests/sanityn.sh:4773:main() Dumping lctl log to /autotest/autotest-2/2022-06-27/lustre-reviews_review-dne-part-5_88105_1_7_01a12c8c-47bf-4fb1-9cfa-e97b369d8874//sanityn.test_80b.*.1656313569.log CMD: trevis-103vm1.trevis.whamcloud.com,trevis-103vm2,trevis-103vm3,trevis-103vm4,trevis-103vm5 /usr/sbin/lctl dk &gt; /autotest/autotest-2/2022-06-27/lustre-reviews_review-dne-part-5_88105_1_7_01a12c8c-47bf-4fb1-9cfa-e97b369d8874//sanityn.test_80b.debug_log.\$(hostname -s).1656313569.log; dmesg &gt; /autotest/autotest-2/2022-06-27/lustre-reviews_review-dne-part-5_88105_1_7_01a12c8c-47bf-4fb1-9cfa-e97b369d8874//sanityn.test_80b.dmesg.\$(hostname -s).1656313569.log /usr/lib64/lustre/tests/sanityn.sh: line 4656: kill: (777660) - No such process </pre> </div></div> <p>VVVVVVV DO NOT REMOVE LINES BELOW, Added by Maloo for auto-association VVVVVVV<br/> sanityn test_80b - migration stopped 2</p> LU-15977

sanityn test_80b: migration stopped 2

Bug Minor Open Unresolved WC Triage Maloo Tue, 28 Jun 2022 09:01:08 +0000 Tue, 19 Dec 2023 23:00:48 +0000 Lustre 2.15.4 0 3 <p>the test itself is not quite correct AFAICS - it's supposed to run for 5 minutes, but <em>all</em> runs in Maloo stops in 3-4 seconds still reporting success.</p> <p>The test is not working on b2_15:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-bash"> <span class="code-comment">#migrate the directories among MDTs </span>( <span class="code-object">while</span> true; <span class="code-object">do</span> mdt_idx=$((RANDOM % MDSCOUNT)) <span class="code-object">$LFS</span> migrate -m $mdt_idx $migrate_dir1 &amp;&gt;/dev/null || rc=$? (( <span class="code-object">$rc</span> != 0 &amp;&amp; <span class="code-object">$rc</span> != 16 )) || break <span class="code-object">done</span> ) &amp; migrate_pid=$! echo <span class="code-quote-red">"start migration thread $migrate_pid"</span> <span class="code-comment">#Access the files at the same <span class="code-object">time</span> </span>start_time=<span class="code-object">$SECONDS</span> echo <span class="code-quote-red">"accessing the migrating directory <span class="code-object">for</span> 5 minutes..."</span> </pre> </div></div> <p>The migration process always exits at the first iteration, the test is supposed to run 5 min.<br/> This should be:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-bash"> <span class="code-comment">#migrate the directories among MDTs </span>( <span class="code-object">while</span> true; <span class="code-object">do</span> mdt_idx=$((RANDOM % MDSCOUNT)) <span class="code-object">$LFS</span> migrate -m $mdt_idx $migrate_dir1 &amp;&gt;/dev/null || rc=$? (( <span class="code-object">$rc</span> == 0 || <span class="code-object">$rc</span> == 16 )) || break <span class="code-object">done</span> ) &amp; </pre> </div></div> <p>Also, the test always returns with success:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-bash"> echo <span class="code-quote-red">"aaaaa"</span> &gt; $migrate_dir2/file4 &gt; /dev/null || { echo <span class="code-quote-red">"access file4 fails"</span> break } </pre> </div></div> <p>This should be:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-bash"> echo <span class="code-quote-red">"aaaaa"</span> &gt; $migrate_dir2/file4 &gt; /dev/null || error <span class="code-quote-red">"access file4 fails"</span> </pre> </div></div> <p>The test completely changed on master with the: <a href="https://review.whamcloud.com/40891" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/40891</a> ("<a href="https://jira.whamcloud.com/browse/LU-15529" title="optimize directory migration parent locking" class="issue-link" data-issue-key="LU-15529"><del>LU-15529</del></a> mdt: optimize dir migration locking")<br/> So maybe we can backport the test, but I am not sure if this is compatible with 2.15.4.</p> Development Rank 1|i02t7j: Rank (Obsolete) 9223372036854775807 Severity