https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-1766 Lustre <p>I was writing a file with dd and I saw console message on the OST:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>LNet: Service thread pid 3461 was inactive for 40.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: Pid: 3461, comm: ll_ost_io01_001 Call Trace: [&lt;ffffffffa0079d85&gt;] jbd2_log_wait_commit+0xc5/0x140 [jbd2] [&lt;ffffffff810920d0&gt;] ? autoremove_wake_function+0x0/0x40 [&lt;ffffffffa0ab248d&gt;] fsfilt_ldiskfs_commit_wait+0x6d/0xf0 [fsfilt_ldiskfs] [&lt;ffffffffa0bfa23d&gt;] filter_preprw_write+0xc4d/0x22f0 [obdfilter] [&lt;ffffffffa0e0346b&gt;] ? cfs_percpt_lock+0x5b/0x130 [libcfs] [&lt;ffffffffa0e769cb&gt;] ? lolnd_send+0x2b/0xb0 [lnet] [&lt;ffffffffa0e03374&gt;] ? cfs_percpt_unlock+0x24/0xc0 [libcfs] [&lt;ffffffffa0600aab&gt;] ? null_alloc_rs+0x1ab/0x3b0 [ptlrpc] [&lt;ffffffffa05edc44&gt;] ? sptlrpc_svc_alloc_rs+0x74/0x2d0 [ptlrpc] [&lt;ffffffffa0bfc6e0&gt;] filter_preprw+0x80/0xa0 [obdfilter] [&lt;ffffffffa04ea81c&gt;] obd_preprw+0x12c/0x3d0 [ost] [&lt;ffffffffa04f198a&gt;] ost_brw_write+0x87a/0x1600 [ost] [&lt;ffffffff8127cea6&gt;] ? vsnprintf+0x2b6/0x5f0 [&lt;ffffffffa05bf07c&gt;] ? lustre_msg_get_version+0x8c/0x100 [ptlrpc] [&lt;ffffffffa05bf1d8&gt;] ? lustre_msg_check_version+0xe8/0x100 [ptlrpc] [&lt;ffffffffa04f802c&gt;] ost_handle+0x360c/0x4850 [ost] [&lt;ffffffffa0df5541&gt;] ? libcfs_debug_msg+0x41/0x50 [libcfs] [&lt;ffffffffa0df1344&gt;] ? libcfs_id2str+0x74/0xb0 [libcfs] [&lt;ffffffffa05ce87d&gt;] ptlrpc_server_handle_request+0x40d/0xea0 [ptlrpc] [&lt;ffffffffa0de565e&gt;] ? cfs_timer_arm+0xe/0x10 [libcfs] [&lt;ffffffffa05c5d07&gt;] ? ptlrpc_wait_event+0xa7/0x2a0 [ptlrpc] [&lt;ffffffff810533f3&gt;] ? __wake_up+0x53/0x70 [&lt;ffffffffa05cfe69&gt;] ptlrpc_main+0xb59/0x1860 [ptlrpc] [&lt;ffffffffa05cf310&gt;] ? ptlrpc_main+0x0/0x1860 [ptlrpc] [&lt;ffffffff8100c14a&gt;] child_rip+0xa/0x20 [&lt;ffffffffa05cf310&gt;] ? ptlrpc_main+0x0/0x1860 [ptlrpc] [&lt;ffffffffa05cf310&gt;] ? ptlrpc_main+0x0/0x1860 [ptlrpc] [&lt;ffffffff8100c140&gt;] ? child_rip+0x0/0x20 </pre> </div></div> <p>After this was seen, the dd process never finished.</p> <p>I also verify this problem is easily to be seen when the OST is almost full.</p> LU-1766

dd never finishes sometimes

Bug Blocker Resolved Duplicate Hongchao Zhang Jinshan Xiong Fri, 17 Aug 2012 15:55:17 +0000 Wed, 29 Aug 2012 14:50:16 +0000 Wed, 29 Aug 2012 11:26:14 +0000 Lustre 2.3.0 0 2 <p>Bobijam</p> <p>Could you please look into this one?</p> <p>Thanks</p> <p>Peter</p> <p>Hongchao</p> <p>Bobijam is busy with another priority. Could you please look into this 2.3 blocker?</p> <p>Thanks</p> <p>Peter</p> <p>Hi Jay, <br/> could you please help to print the code lines around "filter_preprw_write+0xc4d/0x22f0 <span class="error">&#91;obdfilter&#93;</span>"? Thanks!</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">(gdb) l *(filter_preprw_write+0xc4d) 0x1f26d is in filter_preprw_write (/Users/jinxiong/srcs/lustre/lustre/include/linux/lustre_fsfilt.h:294). 289 <span class="code-keyword">static</span> inline <span class="code-object">int</span> fsfilt_commit(struct obd_device *obd, struct inode *inode, 290 void *handle, <span class="code-object">int</span> force_sync) 291 { 292 unsigned <span class="code-object">long</span> now = jiffies; 293 <span class="code-object">int</span> rc = obd-&gt;obd_fsops-&gt;fs_commit(inode, handle, force_sync); 294 CDEBUG(D_INFO, <span class="code-quote">"committing handle %p\n"</span>, handle); 295 296 fsfilt_check_slow(obd, now, <span class="code-quote">"journal start"</span>); 297 298 <span class="code-keyword">return</span> rc; </pre> </div></div> <p>Hi Jay,<br/> Thanks, and could you please help to confirm whether tha patch(<a href="http://review.whamcloud.com/#change,3692" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,3692</a>) is merged in your local branch?</p> <p>No, there was no this patch in my local branch at that time. If you no longer reproduce this problem with this patch, this problem is fixed then.</p> <p>If I understand correctly this is believed to be a duplicate of <a href="https://jira.whamcloud.com/browse/LU-657" title="recovery-mds-scale (FLAVOR=MDS): client load failed" class="issue-link" data-issue-key="LU-657"><del>LU-657</del></a></p> <p>I'm verifying that I can't see this problem in latest master.</p> Development Rank 1|hzvgnr: Rank (Obsolete) 6348 Severity