https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-5266 Lustre <p>After hard failover of devices to server iws19, server wedged, then hit LBUG. <br/> Services never complete recovery, and appear to either restart the timer or something:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">Jun 27 10:08:53 iws19 kernel: Lustre: lustre-OST000c: Will be in recovery <span class="code-keyword">for</span> at least 2:30, or until 316 clients reconnect Jun 27 10:11:53 iws19 kernel: Lustre: lustre-OST000c: recovery is timed out, evict stale exports Jun 27 10:18:30 iws19 kernel: Lustre: lustre-OST000c: Client c52d4856-d1df-b87b-911c-f1bfbc23a24d (at 192.168.124.182@o2ib) reconnecting, waiting <span class="code-keyword">for</span> 316 clients in recovery <span class="code-keyword">for</span> 2:27 </pre> </div></div> <p>The server reports being cpu-bound prior to the failure <br/> Console log attached - unfortunately the dump after the LBUG failed.</p> Hyperion - 2.5.60 build 2538 LU-5266

LBUG on Failover -ldlm_process_extent_lock()) ASSERTION( lock->l_granted_mode != lock->l_req_mode )

Bug Blocker Resolved Fixed Hongchao Zhang Cliff White HB Fri, 27 Jun 2014 17:34:05 +0000 Wed, 22 Oct 2014 04:50:41 +0000 Fri, 11 Jul 2014 11:18:29 +0000 Lustre 2.6.0 Lustre 2.6.0 Lustre 2.5.4 0 8 <p>We need the backtrace for the crash please.</p> <p>Cliff,<br/> Did you try to reboot the server again and/or try more failovers after this one?</p> <p>Yes, we had multiple failures</p> <p>HongChao,<br/> could you please look into this one?<br/> Thank you!</p> <p>not sure if this failure is the same as the fixed one, but as caught by the same assertion, to not create another ticket, I put it here: <a href="http://review.whamcloud.com/10903" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/10903</a></p> <p>Yes, the issue could be triggered by the resent lock request.</p> <p>Was this introduced by <a href="http://review.whamcloud.com/5978" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/5978</a> ?</p> <p>I tested the patch on Hyperion - no more LBUG, but did have a few evictions. lustre-logs and console logs from one run attached.</p> <p>Landed for 2.6</p> <p>While testing this patch, still have some client evictions and log dumps. Message log and lustre log from latest attached.</p> <p>This should probably go into a new bug, since the LASSERT is fixed.</p> <p>the previous fix was not exactly correct: <a href="http://review.whamcloud.com/11469" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/11469</a></p> <p>Vitaly<br/> Could you please open a new JIRA ticket to track this additional change. The original fix was in the already GA 2.6 release<br/> Thanks<br/> Peter</p> Related LU-2827 LU-5496 Development Rank 1|hzwq3z: Rank (Obsolete) 14694 Severity