https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-9924 Lustre <p>Appears to be a re-appearance of <a href="https://jira.whamcloud.com/browse/LU-6846" title="dt_record_write()) ASSERTION( dt-&gt;do_body_ops-&gt;dbo_write ) failed: " class="issue-link" data-issue-key="LU-6846"><del>LU-6846</del></a><br/> Server crashed after multiple failovers. </p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">Aug 26 01:45:48 soak-10 kernel: LustreError: 3333:0:(dt_object.c:513:dt_record_write()) ASSERTION( dt-&gt;do_body_ops-&gt;dbo_write ) failed: Aug 26 01:45:48 soak-10 kernel: LustreError: 3333:0:(dt_object.c:513:dt_record_write()) LBUG Aug 26 01:45:48 soak-10 kernel: Pid: 3333, comm: mdt_out01_000 Aug 26 01:45:48 soak-10 kernel: #012Call Trace: Aug 26 01:45:48 soak-10 kernel: [&lt;ffffffffa0d457ee&gt;] libcfs_call_trace+0x4e/0x60 [libcfs] Aug 26 01:45:48 soak-10 kernel: [&lt;ffffffffa0d4587c&gt;] lbug_with_loc+0x4c/0xb0 [libcfs] Aug 26 01:45:48 soak-10 kernel: [&lt;ffffffffa0ea6d25&gt;] dt_record_write+0xb5/0x120 [obdclass] Aug 26 01:45:48 soak-10 kernel: [&lt;ffffffffa113e266&gt;] out_tx_write_exec+0x166/0x320 [ptlrpc] Aug 26 01:45:48 soak-10 kernel: [&lt;ffffffffa113712e&gt;] out_tx_end+0xde/0x5c0 [ptlrpc] Aug 26 01:45:48 soak-10 kernel: [&lt;ffffffffa11397e7&gt;] out_handle+0x11e7/0x1920 [ptlrpc] Aug 26 01:45:48 soak-10 kernel: [&lt;ffffffff810ce4c4&gt;] ? update_curr+0x104/0x190 Aug 26 01:45:49 soak-10 kernel: [&lt;ffffffffa1086ac0&gt;] ? target_bulk_timeout+0x0/0xb0 [ptlrpc] Aug 26 01:45:49 soak-10 kernel: [&lt;ffffffffa11308f5&gt;] tgt_request_handle+0x925/0x1370 [ptlrpc] Aug 26 01:45:49 soak-10 kernel: [&lt;ffffffffa10d92c6&gt;] ptlrpc_server_handle_request+0x236/0xa90 [ptlrpc] Aug 26 01:45:49 soak-10 kernel: [&lt;ffffffffa10d6ab8&gt;] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] Aug 26 01:45:49 soak-10 kernel: [&lt;ffffffff810c54f2&gt;] ? default_wake_function+0x12/0x20 Aug 26 01:45:49 soak-10 kernel: [&lt;ffffffff810ba628&gt;] ? __wake_up_common+0x58/0x90 Aug 26 01:45:49 soak-10 kernel: [&lt;ffffffffa10dd2a0&gt;] ptlrpc_main+0xaa0/0x1de0 [ptlrpc] Aug 26 01:45:49 soak-10 kernel: [&lt;ffffffffa10dc800&gt;] ? ptlrpc_main+0x0/0x1de0 [ptlrpc] </pre> </div></div> Soak performance cluster -version=2.10.0_61_g6aabd4a LU-9924

LBUG dt_object.c:513:dt_record_write

Bug Major Closed Duplicate Lai Siyao Cliff White soak Mon, 28 Aug 2017 15:30:24 +0000 Mon, 13 Apr 2020 07:11:21 +0000 Mon, 13 Apr 2020 07:11:21 +0000 Lustre 2.10.1 Lustre 2.12.0 0 6 <p>Hi Lai,</p> <p>Can you please investigate?</p> <p>Thanks.<br/> Joe</p> <p>Cliff, what disk fs is used? ldiskfs or zfs?</p> <p>Ldiskfs on the MDS. the OSS are ZFS - soak-10 is MDS</p> <p>Saw this on in my pot</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>[71169.050844] Lustre: DEBUG MARKER: == replay-single test 118: invalidate osp update will not cause update log corruption ================ 18:09:49 (1534889389) [71169.459671] Lustre: *** cfs_fail_loc=1705, val=0*** [71169.470523] Lustre: *** cfs_fail_loc=1705, val=0*** [71169.473869] LustreError: 15314:0:(dt_object.c:515:dt_record_write()) ASSERTION( dt-&gt;do_body_ops-&gt;dbo_write ) failed: [71169.476829] LustreError: 15314:0:(dt_object.c:515:dt_record_write()) LBUG [71169.477891] Pid: 15314, comm: ll_ost_out06_00 3.10.0-7.5-debug #1 SMP Sun Jun 3 13:35:38 EDT 2018 [71169.480212] Call Trace: [71169.481130] [&lt;ffffffffa01b77dc&gt;] libcfs_call_trace+0x8c/0xc0 [libcfs] [71169.482216] [&lt;ffffffffa01b788c&gt;] lbug_with_loc+0x4c/0xa0 [libcfs] [71169.483539] [&lt;ffffffffa0365ab5&gt;] dt_record_write+0xb5/0x120 [obdclass] [71169.485568] [&lt;ffffffffa0658226&gt;] out_tx_write_exec+0x166/0x2f0 [ptlrpc] [71169.487207] [&lt;ffffffffa065071e&gt;] out_tx_end+0xde/0x5c0 [ptlrpc] [71169.488202] [&lt;ffffffffa0654210&gt;] out_handle+0x13f0/0x1b50 [ptlrpc] [71169.489126] [&lt;ffffffffa064da55&gt;] tgt_request_handle+0xaf5/0x1590 [ptlrpc] [71169.490080] [&lt;ffffffffa05f1eb6&gt;] ptlrpc_server_handle_request+0x256/0xad0 [ptlrpc] [71169.491917] [&lt;ffffffffa05f5cae&gt;] ptlrpc_main+0xabe/0x1f80 [ptlrpc] [71169.492800] [&lt;ffffffff810ae864&gt;] kthread+0xe4/0xf0 [71169.493653] [&lt;ffffffff81783777&gt;] ret_from_fork_nospec_end+0x0/0x39 [71169.494525] [&lt;ffffffffffffffff&gt;] 0xffffffffffffffff [71169.495544] Kernel panic - not syncing: LBUG </pre> </div></div> <p>+3 on master in the past week. This seems very likely duplicate with <a href="https://jira.whamcloud.com/browse/LU-10143" title="LBUG dt_object.h:2166:dt_declare_record_write" class="issue-link" data-issue-key="LU-10143"><del>LU-10143</del></a>, probably just a fluke on which field is zero of not in a corrupt structure.<br/> <a href="https://testing.whamcloud.com/test_sets/3d836bfe-0caf-11ea-bbc3-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/3d836bfe-0caf-11ea-bbc3-52540065bddc</a><br/> <a href="https://testing.whamcloud.com/test_sets/6177c52e-0cae-11ea-9487-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/6177c52e-0cae-11ea-9487-52540065bddc</a><br/> <a href="https://testing.whamcloud.com/test_sets/72415a9c-109a-11ea-9487-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/72415a9c-109a-11ea-9487-52540065bddc</a></p> <p>a dup of <a href="https://jira.whamcloud.com/browse/LU-13195" title="replay-single test_118: dt_declare_record_write() ASSERTION( dt-&gt;do_body_ops ) failed" class="issue-link" data-issue-key="LU-13195"><del>LU-13195</del></a></p> Related LU-10143 Development Rank 1|hzzj5z: Rank (Obsolete) 9223372036854775807 Severity