https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-4441 Lustre <p>This issue was created by maloo for Bob Glossman &lt;bob.glossman@intel.com&gt;</p> <p>This issue relates to the following test suite run: <a href="http://maloo.whamcloud.com/test_sets/b44af13a-761f-11e3-a7a8-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">http://maloo.whamcloud.com/test_sets/b44af13a-761f-11e3-a7a8-52540035b04c</a>.</p> <p>Even though maloo reports a 0% failure, search on subtest 60a of sanity shows a bunch of FAILs</p> <p>The sub-test test_60a failed with the following error:</p> <blockquote> <p>wtm-20vm3: ERROR: Module llog_test is in use<br/> test_60a failed with 3</p></blockquote> <p>Info required for matching: sanity 60a</p> LU-4441

sanity test_60a: Module llog_test is in use

Bug Major Resolved Fixed Emoly Liu Maloo Mon, 6 Jan 2014 16:20:53 +0000 Tue, 16 May 2017 13:16:10 +0000 Fri, 28 Nov 2014 19:14:14 +0000 Lustre 2.6.0 Lustre 2.5.3 Lustre 2.7.0 Lustre 2.5.4 0 10 <p>Bob, can this be correlated to some particular patch landing? For example, are the failures starting on a particular patch (maybe intermittently), and then moving to master after that patch landed? Or do the failures start with a common parent patch?</p> <p>This still seems to be failing on a regular basis - more than once a day.</p> <p>another instance:<br/> <a href="https://maloo.whamcloud.com/test_sessions/92085f0c-9a4d-11e3-baa9-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sessions/92085f0c-9a4d-11e3-baa9-52540035b04c</a></p> <p>Another failure at <a href="https://maloo.whamcloud.com/test_sessions/0936d8b4-a17a-11e3-a08f-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sessions/0936d8b4-a17a-11e3-a08f-52540035b04c</a></p> <p>another<br/> <a href="https://maloo.whamcloud.com/test_sessions/a2060ea0-a3b1-11e3-b259-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sessions/a2060ea0-a3b1-11e3-b259-52540035b04c</a></p> <p><a href="https://maloo.whamcloud.com/test_sets/c58bc76e-aa61-11e3-a4db-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/c58bc76e-aa61-11e3-a4db-52540035b04c</a></p> <p>This is still being hit about twice a day on average over the past four weeks. </p> <p>another<br/> <a href="https://maloo.whamcloud.com/test_sets/596ef978-bb1b-11e3-b43b-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/596ef978-bb1b-11e3-b43b-52540035b04c</a></p> <p>Hit this one again: <a href="https://maloo.whamcloud.com/test_sessions/f1d4efe4-bafb-11e3-8ec1-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sessions/f1d4efe4-bafb-11e3-8ec1-52540035b04c</a></p> <p>This error happens very occasionally recently and it's hard to reproduce it locally.</p> <p>I create a patch <a href="http://review.whamcloud.com/9966/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/9966/</a> to improve run-llog.sh so that when this error happens again, it can print more information.</p> <p>Another failure instance:</p> <p><a href="https://maloo.whamcloud.com/test_sets/307cd854-cc56-11e3-8180-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/307cd854-cc56-11e3-8180-52540035b04c</a></p> <p>This was hit several times in the past week - 13 failures in total, of 377 test runs, which is about 3.4%. Not fatal, but enough to keep our eye on.</p> <p>Adding this to the 2.6.0 tracking list, since this test is causing quite a lot of failures. </p> <p>Emoly, are you actually working on this, or should it be assigned back to HPDD Triage?</p> <p>Andreas, the patch <a href="http://review.whamcloud.com/9966/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/9966/</a> is waiting for the second review. But, that is not a fix but a debugging patch to print more information.</p> <p>I don't mind reassigning this ticket to others if the issue can be fixed soon.</p> <p>Landed for 2.6</p> <p>Bob correctly pointed out that only the debug patch landed. I have reopened the ticket and moved it out of scope for 2.6 as we still do not understand the scope of this issue</p> <p>Lustre Build: <a href="https://build.hpdd.intel.com/job/lustre-b2_5/84/" class="external-link" target="_blank" rel="nofollow noopener">https://build.hpdd.intel.com/job/lustre-b2_5/84/</a><br/> Distro/Arch: RHEL6.5/x86_64<br/> MDSCOUNT=2</p> <p>The same failure occurred:<br/> <a href="https://testing.hpdd.intel.com/test_sets/b4faa3be-2a8d-11e4-b21b-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/b4faa3be-2a8d-11e4-b21b-5254006e85c2</a></p> <p>Hi Yujian, the patch <a href="http://review.whamcloud.com/9966/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/9966/</a> has not been backported to b2_5. Although it is a debug patch, the problem has not been seen any more on master with it.</p> <p>So, do you mind if I backport it to b2_5?</p> <p>No, of course not. Thank you, Emoly.</p> <p>backport to b2_5: <a href="http://review.whamcloud.com/11573" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/11573</a></p> <p>As per Andreas there is a change that could have fixed this issue so marking as fixed in 2.7</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/11573/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/11573/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-4441" title="sanity test_60a: Module llog_test is in use" class="issue-link" data-issue-key="LU-4441"><del>LU-4441</del></a> test: improve run-llog.sh to print more information<br/> Project: fs/lustre-release<br/> Branch: b2_5<br/> Current Patch Set: <br/> Commit: 623efd2fb272269d3b82b73bbdf759c8d3b20ae0</p> Development Rank 1|hzwc8n: Rank (Obsolete) 12185 Severity