https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-2206 Lustre <p>We keep getting OSS nodes stuck in recovery on Sequoia's filesystem. the recovery_stat file reports:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>$ cat /proc/fs/lustre/obdfilter/ls1-OST0005/recovery_status status: RECOVERING recovery_start: 1350515102 time_remaining: 0 connected_clients: 357/787 req_replay_clients: 32 lock_repay_clients: 131 completed_clients: 226 evicted_clients: 430 replayed_requests: 23 queued_requests: 32 next_transno: 12885381895 </pre> </div></div> <p>On the console we're seeing clearly bad messages like:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Lustre: ls1-OST0005: Client 6307b568-c73d-a978-48ac-1fc11c345ba7 (at 172.20.11.30@o2ib500) reconnecting, waiting for 787 clients in recovery for -64:-32 Lustre: Skipped 2006 previous similar messages Lustre: ls1-OST0005: Client 6307b568-c73d-a978-48ac-1fc11c345ba7 (at 172.20.11.30@o2ib500) refused reconnection, still busy with 1 active RPCs Lustre: Skipped 1908 previous similar messages </pre> </div></div> <p>Keep in mind, this is still the older orion branch code, our version <a href="https://github.com/chaos/lustre/tree/orion-2_3_49_54_2-68chaos" class="external-link" target="_blank" rel="nofollow noopener">2.3.49.54-68chaos</a>.</p> Older iteration of orion branch, lustre 2.3.49.54-68chaos LU-2206

OSS stuck in recovery

Bug Critical Resolved Duplicate Alex Zhuravlev Christopher Morrone topsequoia Wed, 17 Oct 2012 20:33:32 +0000 Thu, 1 Nov 2012 10:08:05 +0000 Thu, 1 Nov 2012 10:08:05 +0000 Lustre 2.4.0 0 4 <p>Alex</p> <p>Another Sequoia issue to review....</p> <p>Peter</p> <p>Similar negative recovery times in <a href="https://jira.whamcloud.com/browse/LU-2104" title="conf-sanity test 47 never completes, negative time to recovery" class="issue-link" data-issue-key="LU-2104"><del>LU-2104</del></a>.</p> <p>I'm closing this as a duplicate of <a href="https://jira.whamcloud.com/browse/LU-2104" title="conf-sanity test 47 never completes, negative time to recovery" class="issue-link" data-issue-key="LU-2104"><del>LU-2104</del></a>, since that bug has more debug info, and this one has almost nothing.</p> Duplicate LU-2104 Development Rank 1|hzvalb: Rank (Obsolete) 5251 Severity