https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-6920 Lustre <p>Test 205 was executed for 5 iterations</p> <p>Using JobID environment variable FAKE_JOBID=id.205.mkdir.24449<br/> sanity test_205: @@@@@@ FAIL: old jobstats not expired <br/> Trace dump:<br/> = /usr/lib64/lustre/tests/test-framework.sh:4732:error_noexit()<br/> = /usr/lib64/lustre/tests/test-framework.sh:4763:error()<br/> = /usr/lib64/lustre/tests/sanity.sh:11638:test_205()<br/> = /usr/lib64/lustre/tests/test-framework.sh:5010:run_one()<br/> = /usr/lib64/lustre/tests/test-framework.sh:5047:run_one_logged()<br/> = /usr/lib64/lustre/tests/test-framework.sh:4864:run_test()<br/> = /usr/lib64/lustre/tests/sanity.sh:11660:main()<br/> Dumping lctl log to /tmp/test_logs/1438010993/sanity.test_205.*.1438011013.log<br/> fre0106: Warning: Permanently added 'fre0107,192.168.101.7' (RSA) to the list of known hosts.</p> <p>fre0105: Warning: Permanently added 'fre0107,192.168.101.7' (RSA) to the list of known hosts.</p> <p>fre0108: Warning: Permanently added 'fre0107,192.168.101.7' (RSA) to the list of known hosts.</p> <p>mdt.lustre-MDT0000.job_cleanup_interval=600<br/> fre0105: warning: 'lctl conf_param' is deprecated, use 'lctl set_param -P' instead<br/> Waiting 90 secs for update<br/> Updated after 9s: wanted 'procname_uid' got 'procname_uid'<br/> lustre-MDT0000: Deregistered changelog user 'cl4'<br/> FAIL 205 (24s)<br/> sanity: FAIL: test_205 old jobstats not expired<br/> debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck</p> LU-6920

sanity test_205 failed with old jobstats not expired

Bug Minor Resolved Fixed Bob Glossman Aditya Pandit Tue, 28 Jul 2015 08:41:46 +0000 Wed, 24 Aug 2016 10:33:26 +0000 Wed, 28 Oct 2015 15:29:18 +0000 Lustre 2.8.0 Lustre 2.8.0 0 12 <p>It's easily reproducible on master </p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Lustre: DEBUG MARKER: Test: mkdir /mnt/lustre/d205.sanity.expire Lustre: DEBUG MARKER: Using JobID environment variable FAKE_JOBID=id.205.mkdir.18733 Lustre: DEBUG MARKER: sanity test_205: @@@@@@ FAIL: old jobstats not expired Lustre: lustre-MDD0000: changelog off Lustre: DEBUG MARKER: == sanity test complete, duration 34 sec == 19:52:57 (1441191177) </pre> </div></div> <p>another one seen with sles11sp4 on master:<br/> <a href="https://testing.hpdd.intel.com/test_sets/a1bab5ba-6a0f-11e5-b8d9-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/a1bab5ba-6a0f-11e5-b8d9-5254006e85c2</a></p> <p>another sles11sp4 on master:<br/> <a href="https://testing.hpdd.intel.com/test_sets/5f9b33a8-6cdf-11e5-a8d6-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/5f9b33a8-6cdf-11e5-a8d6-5254006e85c2</a></p> <p>It looks like this test is only failing on SLES11 SP3/SP4 and not others.</p> <p>Bob, assigning this to you for further investigation. It seems to be failing regularly for SLES11 SP3/SP4 tests, and even if we could get those patches to pass once, this is failing for more test runs than it is passing and we would just be introducing a regression by landing those patches.</p> <p>It may be that increasing the timeout for jobid expiry by a second or two would be enough. The most efficient way might be to use <tt>wait_update()</tt> with a maximum of <tt>(left + 5)</tt> seconds so that it doesn't wait longer than needed.</p> <p>Bob Glossman (bob.glossman@intel.com) uploaded a new patch: <a href="http://review.whamcloud.com/16753" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/16753</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6920" title="sanity test_205 failed with old jobstats not expired" class="issue-link" data-issue-key="LU-6920"><del>LU-6920</del></a> test: try to reproduce failure on sanity test_205<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 376ea32167938839f209772e12b68a7acd96cc29</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/16753/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/16753/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6920" title="sanity test_205 failed with old jobstats not expired" class="issue-link" data-issue-key="LU-6920"><del>LU-6920</del></a> test: add some slack to jobstats expiry in test_205<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 13e34c1d0e5472759d1350b62fa0663bbcd59fa0</p> <p>Landed for 2.8</p> <ul> <li>This should be reopened as intermittently sanity test_205 is still failing on master.<br/> &gt; It may be that increasing the timeout for jobid expiry by a second or two would be enough. The most efficient way might be to use wait_update() with a maximum of (left + 5) seconds so that it doesn't wait longer than needed.</li> <li>I'll push patch with changes suggested by Andreas.</li> </ul> <p>Ashish</p> <p>Given that the fix that did land was in the already released 2.8 release it would probably be clearer to open a new ticket linked to this one</p> <p>Peter</p> <p>&gt; Given that the fix that did land was in the already released 2.8 release it would probably be clearer to open a new ticket linked to this one<br/> Ok, I'll create a new ticket.</p> Related LU-7151 LU-7200 LU-6889 Development Rank 1|hzxj7b: Rank (Obsolete) 9223372036854775807 Severity