https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-5303 Lustre <p>I hit a crash of OSS when mounting its targets.<br/> The issue is the same as <a href="https://jira.whamcloud.com/browse/LU-4528" title="osd_trans_exec_op()) ASSERTION( oti-&gt;oti_declare_ops_rb[rb] &gt; 0 ) failed: rb = 0" class="issue-link" data-issue-key="LU-4528"><del>LU-4528</del></a> but with Lustre 2.4.1.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>3&gt;LustreError: 27422:0:(osd_io.c:1220:osd_ldiskfs_write_record()) loop21: error reading offset 0 (block 0): rc = -28 &lt;3&gt;LustreError: 27422:0:(llog_osd.c:160:llog_osd_write_blob()) fs96OST-OST003b-osd: error writing log record: rc = -28 &lt;0&gt;LustreError: 27422:0:(osd_internal.h:953:osd_trans_exec_op()) ASSERTION( oti-&gt;oti_declare_ops_rb[rb] &gt; 0 ) failed: rb = 0 &lt;0&gt;LustreError: 27422:0:(osd_internal.h:953:osd_trans_exec_op()) LBUG &lt;4&gt;Pid: 27422, comm: mount.lustre &lt;4&gt; &lt;4&gt;Call Trace: &lt;4&gt; [&lt;ffffffffa0bfb895&gt;] libcfs_debug_dumpstack+0x55/0x80 [libcfs] &lt;4&gt; [&lt;ffffffffa0bfbe97&gt;] lbug_with_loc+0x47/0xb0 [libcfs] &lt;4&gt; [&lt;ffffffffa161d42d&gt;] osd_trans_exec_op+0x2ad/0x2e0 [osd_ldiskfs] &lt;4&gt; [&lt;ffffffffa162e723&gt;] osd_attr_set+0xe3/0x540 [osd_ldiskfs] &lt;4&gt; [&lt;ffffffffa163b845&gt;] ? osd_punch+0x1b5/0x600 [osd_ldiskfs] &lt;4&gt; [&lt;ffffffffa10e60f1&gt;] llog_osd_write_blob+0x211/0x850 [obdclass] &lt;4&gt; [&lt;ffffffffa10e9d34&gt;] llog_osd_write_rec+0x7d4/0x1370 [obdclass] &lt;4&gt; [&lt;ffffffffa10b5438&gt;] llog_write_rec+0xc8/0x290 [obdclass] &lt;4&gt; [&lt;ffffffffa10b6bad&gt;] llog_write+0x2ad/0x420 [obdclass] &lt;4&gt; [&lt;ffffffffa10b6d44&gt;] llog_copy_handler+0x24/0x30 [obdclass] &lt;4&gt; [&lt;ffffffffa10b7e0b&gt;] llog_process_thread+0x8fb/0xe00 [obdclass] &lt;4&gt; [&lt;ffffffffa10b6d20&gt;] ? llog_copy_handler+0x0/0x30 [obdclass] &lt;4&gt; [&lt;ffffffffa10b9c7d&gt;] llog_process_or_fork+0x12d/0x660 [obdclass] &lt;4&gt; [&lt;ffffffffa10ba5a2&gt;] llog_backup+0x3d2/0x500 [obdclass] &lt;4&gt; [&lt;ffffffff8128cd30&gt;] ? sprintf+0x40/0x50 &lt;4&gt; [&lt;ffffffffa16a38cf&gt;] mgc_process_log+0x119f/0x18f0 [mgc] &lt;4&gt; [&lt;ffffffffa169c8ba&gt;] ? mgc_name2resid+0x4a/0x230 [mgc] &lt;4&gt; [&lt;ffffffffa169d370&gt;] ? mgc_blocking_ast+0x0/0x800 [mgc] &lt;4&gt; [&lt;ffffffffa1215b20&gt;] ? ldlm_completion_ast+0x0/0x960 [ptlrpc] &lt;4&gt; [&lt;ffffffffa16a5514&gt;] mgc_process_config+0x594/0xed0 [mgc] &lt;4&gt; [&lt;ffffffffa110164c&gt;] lustre_process_log+0x25c/0xaa0 [obdclass] &lt;4&gt; [&lt;ffffffffa112bffc&gt;] ? server_find_mount+0xbc/0x160 [obdclass] &lt;4&gt; [&lt;ffffffffa112ebd6&gt;] ? server_register_mount+0x516/0x8f0 [obdclass] &lt;4&gt; [&lt;ffffffffa1134467&gt;] server_start_targets+0x5c7/0x19c0 [obdclass] &lt;4&gt; [&lt;ffffffffa0bfcb2e&gt;] ? cfs_free+0xe/0x10 [libcfs] &lt;4&gt; [&lt;ffffffffa1104eb5&gt;] ? lustre_start_mgc+0x4a5/0x2180 [obdclass] &lt;4&gt; [&lt;ffffffffa10fca20&gt;] ? class_config_llog_handler+0x0/0x1890 [obdclass] &lt;4&gt; [&lt;ffffffffa113640c&gt;] server_fill_super+0xbac/0x1660 [obdclass] &lt;4&gt; [&lt;ffffffffa1106d68&gt;] lustre_fill_super+0x1d8/0x530 [obdclass] &lt;4&gt; [&lt;ffffffffa1106b90&gt;] ? lustre_fill_super+0x0/0x530 [obdclass] &lt;4&gt; [&lt;ffffffff8118c7cf&gt;] get_sb_nodev+0x5f/0xa0 &lt;4&gt; [&lt;ffffffffa10fe3b5&gt;] lustre_get_sb+0x25/0x30 [obdclass] &lt;4&gt; [&lt;ffffffff8118be2b&gt;] vfs_kern_mount+0x7b/0x1b0 &lt;4&gt; [&lt;ffffffff8118bfd2&gt;] do_kern_mount+0x52/0x130 &lt;4&gt; [&lt;ffffffff811acfdb&gt;] do_mount+0x2fb/0x930 &lt;4&gt; [&lt;ffffffff811ad6a0&gt;] sys_mount+0x90/0xe0 &lt;4&gt; [&lt;ffffffff8100b072&gt;] system_call_fastpath+0x16/0x1b </pre> </div></div> <p>Would it be possible to backport patch <a href="http://review.whamcloud.com/#/c/10108/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/10108/</a> in b2_4 branch ?</p> LU-5303

osd_trans_exec_op()) ASSERTION( oti->oti_declare_ops_rb[rb] > 0 ) failed: rb = 0

Bug Major Resolved Duplicate Bob Glossman Gregoire Pichon Tue, 8 Jul 2014 07:59:05 +0000 Mon, 24 Aug 2015 18:51:08 +0000 Mon, 24 Aug 2015 18:51:08 +0000 Lustre 2.4.1 0 6 <p>Bob, Can you explore this please.</p> <p>Hello Gregoire,<br/> Bob Glossman will take a look at the 'portability' of this patch to 2.4.x and will advise if this is possible. <br/> Thanks,<br/> ~ jfc.</p> <p>It looks to me like a back port should be possible, but needs the attention of somebody who really understands the code being modified to do it correctly. Trying to cherry-pick <a href="http://review.whamcloud.com/#/c/10108" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/10108</a> back into b2_4 leaves 10 or more files that need manual editing to merge. Some appear to need more knowledge that just trying to resolve context diffs.</p> <p>I note that the Author of the original master patch was Mike Pershin. Maybe it's a job for him.</p> <p>Mike &#8211; we've added you as a watcher on this ticket.<br/> Can you please advise on the best way forward to resolve Gregoire's problem?<br/> Thanks,<br/> ~ jfc.</p> <p>Thanks for looking.<br/> I wonder if a back port in b2_5, which is the maintenance release, would'nt be more appropriate in this case. This would benefit to the whole community and I am definitely going to move to lustre 2.5.x version at some time.</p> <p>It does appear a back port to b2_5 is more plausible. Less than half the number of files need manual attention to merge and the edits needed may not require an expert as in b2_4.</p> <p>Gregoire, since we seem to agree that b2_5 is the better branch to fix, can you give us a rough idea when you will need the solution to be in place?<br/> This will help us with our workload planning.</p> <p>Many thanks,<br/> ~ jfc</p> <p>The issue did not occured on a production cluster, so this does not require immediate handling. Anyway, this is still a node crash and I would not like to see the same issue appear at a customer site.</p> <p>Would it be possible to have a patch for b2_5 worked out ?<br/> I see a 2.5.3 version is going to be released soon, it would be good to have the fix integrated for that version since some of our customers are going to use lustre 2.5 in septembre.<br/> thanks.</p> <p>Gregoire</p> <p>The b2_5 patch is being tracked under <a href="https://jira.whamcloud.com/browse/LU-4528" title="osd_trans_exec_op()) ASSERTION( oti-&gt;oti_declare_ops_rb[rb] &gt; 0 ) failed: rb = 0" class="issue-link" data-issue-key="LU-4528"><del>LU-4528</del></a>, which this issue is believed to be a duplicate of</p> <p>Peter</p> <p>Hi Peter,<br/> The patch <a href="http://review.whamcloud.com/#/c/11751/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/11751/</a> is ready to be landed into b2_5 (two positive inspections).<br/> Could it be included in the future 2.5.4 release ?</p> <p>thanks,<br/> Grégoire.</p> <p>duplicate of <a href="https://jira.whamcloud.com/browse/LU-4528" title="osd_trans_exec_op()) ASSERTION( oti-&gt;oti_declare_ops_rb[rb] &gt; 0 ) failed: rb = 0" class="issue-link" data-issue-key="LU-4528"><del>LU-4528</del></a></p> Related LU-4528 Development Rank 1|hzwqsv: Rank (Obsolete) 14808 Severity