https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-12766 Lustre <p>sanity-quota test_3 fails with 'write success, but expect EDQUOT', but looking at the client test_log we see</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Total allocated inode limit: 0, total allocated block limit: 0 pid 1000 is using default file quota setting Files for project (1000): lfs: failed for '/mnt/lustre': Too many levels of symbolic links sanity-quota test_3: @@@@@@ FAIL: write success, but expect EDQUOT Trace dump: = /usr/lib64/lustre/tests/test-framework.sh:6115:error() = /usr/lib64/lustre/tests/sanity-quota.sh:152:quota_error() = /usr/lib64/lustre/tests/sanity-quota.sh:771:test_block_soft() = /usr/lib64/lustre/tests/sanity-quota.sh:827:test_3() </pre> </div></div> <p>There is no additional errors or indication of a problem in any of the console logs. </p> <p>We’ve only seen sanity-quota test 3 fail with this error and with the lfs error:<br/> <a href="https://testing.whamcloud.com/test_sets/7a25bb86-d6ed-11e9-a2b6-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/7a25bb86-d6ed-11e9-a2b6-52540065bddc</a></p> <p>We've seen sanity-quota test 3 fail with the same "write success, but expect EDQUOT " error, but the test_log does not have the lfs error. The logs have a different failure:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Total allocated inode limit: 0, total allocated block limit: 0 Some errors happened when getting quota info. Some devices may be not working or deactivated. The data in "[]" is inaccurate. Files for project (1000): sanity-quota test_3: @@@@@@ FAIL: write success, but expect EDQUOT Trace dump: = /usr/lib64/lustre/tests/test-framework.sh:6114:error() = /usr/lib64/lustre/tests/sanity-quota.sh:152:quota_error() = /usr/lib64/lustre/tests/sanity-quota.sh:734:test_block_soft() = /usr/lib64/lustre/tests/sanity-quota.sh:784:test_3() </pre> </div></div> <p>Logs for these errors are at<br/> <a href="https://testing.whamcloud.com/test_sets/43331474-b5b5-11e9-a1bd-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/43331474-b5b5-11e9-a1bd-52540065bddc</a><br/> <a href="https://testing.whamcloud.com/test_sets/5f2b2d6c-bffe-11e9-98c8-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/5f2b2d6c-bffe-11e9-98c8-52540065bddc</a></p> LU-12766

sanity-quota test 3 fails with 'write success, but expect EDQUOT'

Bug Minor Resolved Fixed Wang Shilong James Nunez Mon, 16 Sep 2019 14:23:54 +0000 Sat, 27 Feb 2021 18:56:48 +0000 Fri, 26 Feb 2021 14:46:12 +0000 Lustre 2.13.0 Lustre 2.14.0 Lustre 2.12.4 Lustre 2.15.0 0 7 <p>I filed <a href="https://jira.whamcloud.com/browse/LU-12787" title="sanity-quota: test 3 failure &quot;write success, but expect EDQUOT&quot;" class="issue-link" data-issue-key="LU-12787"><del>LU-12787</del></a> for those failures:</p> <p>&gt; <a href="https://testing.whamcloud.com/test_sets/43331474-b5b5-11e9-a1bd-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/43331474-b5b5-11e9-a1bd-52540065bddc</a><br/> &gt; <a href="https://testing.whamcloud.com/test_sets/5f2b2d6c-bffe-11e9-98c8-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/5f2b2d6c-bffe-11e9-98c8-52540065bddc</a></p> <p>+1 on master @<a href="https://testing.whamcloud.com/test_sessions/431dfbf0-778f-46c2-84d5-e61058e669d6" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sessions/431dfbf0-778f-46c2-84d5-e61058e669d6</a></p> <p>I see in the test output for one of these failures:</p> <p><a href="https://testing.whamcloud.com/test_sets/0f515d40-3b53-11ea-80b4-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/0f515d40-3b53-11ea-80b4-52540065bddc</a></p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Sleep through grace sanity-quota.sh: line 357: let: 4m55: value too great for base (error token is "4m55") ...sleep 4m55 seconds sleep: invalid time interval '4m55' </pre> </div></div> <p>In a recent failure this is more interesting;</p> <p><a href="https://testing.whamcloud.com/test_sets/e5ffdc29-ca05-4fa2-8c9a-c9d2e2da3946" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/e5ffdc29-ca05-4fa2-8c9a-c9d2e2da3946</a></p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Block grace time: 1w; Inode grace time: 1w : Sleep through grace ... ...sleep 21305 seconds </pre> </div></div> <p>which is 255s less than 6h. From the code:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> <span class="code-keyword">case</span> $flavour in block) time=$(lfs quota -$qtype $qarg $parg $DIR| awk <span class="code-quote">'NR == 3 { print $5 }'</span>| sed <span class="code-quote">'s/s$<span class="code-comment">//'</span>) </span> ;; file) time=$(lfs quota -$qtype $qarg $DIR| awk <span class="code-quote">'NR == 3 { print $9 }'</span>| sed <span class="code-quote">'s/s$<span class="code-comment">//'</span>) </span> ;; esac [[ $time == *m* ]] &amp;&amp; time=${time<span class="code-comment">//m/} &amp;&amp; time=$((time*60)); </span> [[ $time == *h* ]] &amp;&amp; time=${time<span class="code-comment">//h/} &amp;&amp; time=$((time*60*60)); </span> [[ $time == *d* ]] &amp;&amp; time=${time<span class="code-comment">//d/} &amp;&amp; time=$((time*24*60*60)); </span> [[ $time == *w* ]] &amp;&amp; time=${time<span class="code-comment">//w/} &amp;&amp; time=$((time*7*24*60*60)); </span> let time+=$extrasleep echo <span class="code-quote">"...sleep $time seconds"</span> sleep $time </pre> </div></div> <p>The <tt>wdhm</tt> handling was added in patch <a href="https://review.whamcloud.com/37327" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/37327</a> "<tt><a href="https://jira.whamcloud.com/browse/LU-13174" title="sanity-quota convert minutes to seconds to sleep" class="issue-link" data-issue-key="LU-13174"><del>LU-13174</del></a> tests: sanity-quota to convert minutes into seconds</tt>", but I don't <em>think</em> there is a bug in the time conversion code. It is more likely that the bug exists in the extraction of the timestamp itself? It is strange that the output looks like "<tt>Block grace time: 1w; Inode grace time: 1w</tt>" but the parsing line is looking at fields "<tt>$5</tt>" and "<tt>$9</tt>" when the grace time looks like it is in "<tt>$4</tt>" and "<tt>$8</tt>"?</p> <p>Wang Shilong (wshilong@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/41259" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/41259</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12766" title="sanity-quota test 3 fails with &#39;write success, but expect EDQUOT&#39;" class="issue-link" data-issue-key="LU-12766"><del>LU-12766</del></a> test: convert time to seconds properly<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 15797ddcf4b0a30398c11bac2588047619b5ad31</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/41259/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/41259/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12766" title="sanity-quota test 3 fails with &#39;write success, but expect EDQUOT&#39;" class="issue-link" data-issue-key="LU-12766"><del>LU-12766</del></a> test: convert time to seconds properly<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 1a2b381616b372efb5e386ef5fff3aa2f76873a4</p> <p>Landed for 2.15</p> Related LU-12787 LU-14279 Development Rank 1|i00msn: Rank (Obsolete) 9223372036854775807