https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-12570 Lustre <p>When running sanity with shared key enabled, it always crashes in test 134a like this:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>LustreError: 32759:0:(ofd_internal.h:412:ofd_info()) ASSERTION( info ) failed: LustreError: 32759:0:(ofd_internal.h:412:ofd_info()) LBUG Pid: 32759, comm: mdt00_008 3.10.0-7.6-debug #1 SMP Fri Jul 12 02:40:17 EDT 2019 Call Trace: [&lt;ffffffffa01928cc&gt;] libcfs_call_trace+0x8c/0xc0 [libcfs] [&lt;ffffffffa019297c&gt;] lbug_with_loc+0x4c/0xa0 [libcfs] [&lt;ffffffffa0e94dca&gt;] ofd_exit+0x0/0x236 [ofd] [&lt;ffffffffa0e9397b&gt;] ofd_lvbo_update+0xd2b/0xe30 [ofd] [&lt;ffffffffa05ec99c&gt;] ldlm_handle_ast_error+0x45c/0x820 [ptlrpc] [&lt;ffffffffa05ee6ea&gt;] ldlm_cb_interpret+0x19a/0x700 [ptlrpc] [&lt;ffffffffa0608071&gt;] ptlrpc_check_set.part.23+0x491/0x1e00 [ptlrpc] [&lt;ffffffffa0609a3b&gt;] ptlrpc_check_set+0x5b/0xe0 [ptlrpc] [&lt;ffffffffa0609ddc&gt;] ptlrpc_set_wait+0x31c/0x790 [ptlrpc] [&lt;ffffffffa05c7e35&gt;] ldlm_run_ast_work+0xd5/0x380 [ptlrpc] [&lt;ffffffffa05fe8c5&gt;] ldlm_reclaim_full+0x425/0x7a0 [ptlrpc] [&lt;ffffffffa05f0338&gt;] ldlm_handle_enqueue0+0x138/0x15d0 [ptlrpc] [&lt;ffffffffa0676b42&gt;] tgt_enqueue+0x62/0x210 [ptlrpc] [&lt;ffffffffa067ef85&gt;] tgt_request_handle+0x985/0x1630 [ptlrpc] [&lt;ffffffffa0622568&gt;] ptlrpc_server_handle_request+0x258/0xb00 [ptlrpc] [&lt;ffffffffa062670a&gt;] ptlrpc_main+0xcba/0x2500 [ptlrpc] [&lt;ffffffff810b4ed4&gt;] kthread+0xe4/0xf0 [&lt;ffffffff817c8c5d&gt;] ret_from_fork_nospec_begin+0x7/0x21 [&lt;ffffffffffffffff&gt;] 0xffffffffffffffff </pre> </div></div> LU-12570

sanity test 134a crash with SSK in use

Bug Critical Resolved Fixed Alex Zhuravlev Oleg Drokin Mon, 22 Jul 2019 01:09:05 +0000 Fri, 4 Oct 2019 20:52:52 +0000 Sat, 28 Sep 2019 03:30:27 +0000 Lustre 2.13.0 Lustre 2.12.3 Lustre 2.13.0 Lustre 2.12.3 0 7 <p>it's MDT thread which seem to be missing LCT_DT_THREAD ?</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> <span class="code-keyword">static</span> <span class="code-object">int</span> mds_start_ptlrpc_service(struct mds_device *m) ... .tc_ctx_tags = LCT_MD_THREAD, } </pre> </div></div> <p>i.e. LCT_DT_THREAD is missing?</p> <p>it would be great to have a log/dump for the case</p> <p>sure thing.</p> <p>master: <a href="http://testing.linuxhacker.ru:3333/lustre-reports/1455/testresults/sanity2-ldiskfs-DNE-SSK-centos7_x86_64-centos7_x86_64/" class="external-link" target="_blank" rel="nofollow noopener">http://testing.linuxhacker.ru:3333/lustre-reports/1455/testresults/sanity2-ldiskfs-DNE-SSK-centos7_x86_64-centos7_x86_64/</a></p> <p>b2_12: <a href="http://testing.linuxhacker.ru:3333/lustre-reports/1460/testresults/sanity-ldiskfs-DNE-SSK-centos7_x86_64-centos7_x86_64/" class="external-link" target="_blank" rel="nofollow noopener">http://testing.linuxhacker.ru:3333/lustre-reports/1460/testresults/sanity-ldiskfs-DNE-SSK-centos7_x86_64-centos7_x86_64/</a></p> <p>Alex, is this just a matter of adding <tt>LCT_DT_THREAD</tt> to <tt>mds_start_ptlrpc_service()</tt> setting up the threads? What is the impact/overhead of doing this (if any)? Would it be better to limit <tt>ldlm_reclaim_ns()</tt> to only clean up locks in the same namespace type as mentioned in <a href="https://jira.whamcloud.com/browse/LU-12592" title="sanity 134a hit panic time to time." class="issue-link" data-issue-key="LU-12592">LU-12592</a>?</p> <p>Hi,</p> <p>I never hit this crash myself, and I have many examples of sanity test 134a passing with SSK enabled, for instance all custom-103 sessions triggered from <a href="https://review.whamcloud.com/34380" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/34380</a> (latest one is run with patch rebased on August, 1st).</p> <p>Not sure it is an issue with SSK, I am wondering if the crash you experience stills occurs with the modification suggested by Alex (LCT_DT_THREAD).</p> <p>sorry for late response, adding LCT_DT_THREAD is not quite enough - the problem is that the client is trying to cancel extent locks sending them to MDT.<br/> iirc, Alexey Lyashkov reported this in another ticket.. will try to find that one.</p> <p>Alex Zhuravlev (bzzz@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/36179" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36179</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12570" title="sanity test 134a crash with SSK in use" class="issue-link" data-issue-key="LU-12570"><del>LU-12570</del></a> mdt: request env for DT threads<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 2b586c40f22ed9e096478d9caf634c42b3fff224</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/36179/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36179/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12570" title="sanity test 134a crash with SSK in use" class="issue-link" data-issue-key="LU-12570"><del>LU-12570</del></a> mdt: request env for DT threads<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 1f94d5eb2be4e921e909d8f18523dcab91bb6531</p> <p>Landed for 2.13</p> <p>Minh Diep (mdiep@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/36312" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36312</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12570" title="sanity test 134a crash with SSK in use" class="issue-link" data-issue-key="LU-12570"><del>LU-12570</del></a> mdt: request env for DT threads<br/> Project: fs/lustre-release<br/> Branch: b2_12<br/> Current Patch Set: 1<br/> Commit: a561e4848e6e03a380974ed74ee10d41a3c25a98</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/36312/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36312/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12570" title="sanity test 134a crash with SSK in use" class="issue-link" data-issue-key="LU-12570"><del>LU-12570</del></a> mdt: request env for DT threads<br/> Project: fs/lustre-release<br/> Branch: b2_12<br/> Current Patch Set: <br/> Commit: dee23bcfb821e339ca3b3df2fb08fa946f7d09a1</p> Related LU-12592 Development Rank 1|i00jzb: Rank (Obsolete) 9223372036854775807 Severity