https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-9428 Lustre <p>We have recently seen frequent occurrences of the LBUG below.</p> <p>The affected machines are all exporting our Lustre file system via NFS to other Linux machines.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>May 2 06:59:03 i05-storage1 kernel: LustreError: 3023:0:(dcache.c:236:ll_d_init()) ASSERTION( de-&gt;d_op == &amp;ll_d_ops ) failed: May 2 06:59:03 i05-storage1 kernel: LustreError: 3023:0:(dcache.c:236:ll_d_init()) LBUG May 2 06:59:03 i05-storage1 kernel: Pid: 3023, comm: nfsd May 2 06:59:03 i05-storage1 kernel: May 2 06:59:03 i05-storage1 kernel: Call Trace: May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffffa0383895&gt;] libcfs_debug_dumpstack+0x55/0x80 [libcfs] May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffffa0383e97&gt;] lbug_with_loc+0x47/0xb0 [libcfs] May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffffa097e69f&gt;] ll_d_init+0x2ff/0x540 [lustre] May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffffa09c1b5b&gt;] ll_iget_for_nfs+0x20b/0x300 [lustre] May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffffa09c1d89&gt;] ll_fh_to_dentry+0x99/0xa0 [lustre] May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffffa0b3871c&gt;] exportfs_decode_fh+0x5c/0x2bc [exportfs] May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffffa0bcc8e0&gt;] ? nfsd_acceptable+0x0/0x120 [nfsd] May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffffa0b56da0&gt;] ? cache_check+0x60/0x370 [sunrpc] May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffff8117f76b&gt;] ? cache_alloc_refill+0x15b/0x240 May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffffa0bccdda&gt;] fh_verify+0x32a/0x640 [nfsd] May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffffa0bcfda1&gt;] nfsd_open+0x31/0x240 [nfsd] May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffffa0bd022b&gt;] nfsd_commit+0x3b/0xa0 [nfsd] May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffff810aff24&gt;] ? groups_free+0x54/0x60 May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffffa0bd769d&gt;] nfsd3_proc_commit+0x9d/0x100 [nfsd] May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffffa0bc9405&gt;] nfsd_dispatch+0xe5/0x230 [nfsd] May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffffa0b4ccf4&gt;] svc_process_common+0x344/0x640 [sunrpc] May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffff8106c500&gt;] ? default_wake_function+0x0/0x20 May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffffa0b4d390&gt;] svc_process+0x110/0x160 [sunrpc] May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffffa0bc9c82&gt;] nfsd+0xc2/0x160 [nfsd] May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffffa0bc9bc0&gt;] ? nfsd+0x0/0x160 [nfsd] May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffff810a640e&gt;] kthread+0x9e/0xc0 May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffff8100c28a&gt;] child_rip+0xa/0x20 May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffff810a6370&gt;] ? kthread+0x0/0xc0 May 2 06:59:03 i05-storage1 kernel: [&lt;ffffffff8100c280&gt;] ? child_rip+0x0/0x20 May 2 06:59:03 i05-storage1 kernel: </pre> </div></div> <p>This looks similar to <a href="https://jira.whamcloud.com/browse/LU-9241" title="ASSERTION( de-&gt;d_op == &amp;ll_d_ops ) failed" class="issue-link" data-issue-key="LU-9241"><del>LU-9241</del></a> but the stack trace is not quite the same and also the patch is against master while we are running b2_7_fe, so would need a fix for that. </p> <p>We are still investigating the events leading to the crash, hoping for a reproducer....</p> RHEL6 server LU-9428

ASSERTION( de->d_op == &ll_d_ops)

Bug Critical Resolved Duplicate Lai Siyao Frederik Ferner Tue, 2 May 2017 10:23:50 +0000 Thu, 29 Jun 2017 12:54:41 +0000 Thu, 29 Jun 2017 12:54:41 +0000 Lustre 2.7.0 0 3 <p>Lai</p> <p>Can you please assist with this issue?</p> <p>Thanks</p> <p>Peter</p> <p>Any updates to this? We are still seeing this frequently, though unfortunately haven't been able to detect a pattern or develop a reproducer yet, however it is definitely affecting our users.</p> <p>Thanks,<br/> Frederik</p> <p>I noticed that the patch in <a href="https://jira.whamcloud.com/browse/LU-9241" title="ASSERTION( de-&gt;d_op == &amp;ll_d_ops ) failed" class="issue-link" data-issue-key="LU-9241"><del>LU-9241</del></a> has been merged and appears to apply cleanly to our b2.7 tree.</p> <p>Can we get feedback if it should be safe to cherry-pick this commit and test on our clients?</p> <p>thanks,<br/> Frederik</p> <p>Yes, it's safe to cherry-pick to 2.7. It's a trivial fix to client code.</p> <p>Thanks for confirming. We have rebuild our client with this patch applied and have started testing.</p> <p>As we don't have a know reproducer and it seems quite unpredictable when it happens, it will take a while until we can be confident that this fixed our problem. We'll report back.</p> <p>Frederik</p> <p>Frederik</p> <p>Has this been long enough to ascertain whether the fix has helped?</p> <p>Peter</p> <p>Peter, All,</p> <p>apologies for the delay, I've been away.</p> <p>Without a clear reproducer it is always going to be hard to be absolutely sure and the problem seems to come and go in waves. However, we have so far not seen this problem on a NFS server running the patched version. So I feel confident to say it's looking good so far, it certainly seems to have helped.</p> <p>Thanks,<br/> Frederik</p> <p>Thanks Frederik. Let's close out this ticket for now then and open a new one if you do ever get a reoccurence.</p> Duplicate LU-9421 Development Rank 1|hzzblr: Rank (Obsolete) 9223372036854775807 Severity