https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-6880 Lustre <p>Recovery can not finish in time during 24 hours failover test, after 23 times failover</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Server failover period: 600 seconds Exited after: 13229 seconds Number of failovers before exit: mds1: 2 times mds2: 7 times mds3: 1 times mds4: 1 times mds5: 3 times mds6: 3 times mds7: 3 times mds8: 3 times ost1: 0 times ost2: 0 times ost3: 0 times ost4: 0 times Status: FAIL: rc=7 </pre> </div></div> LU-6880

recovery timeout during 24 hours failover test

Bug Blocker Resolved Fixed Di Wang Di Wang Sun, 19 Jul 2015 15:34:01 +0000 Fri, 28 Aug 2015 13:51:51 +0000 Fri, 28 Aug 2015 13:51:51 +0000 Lustre 2.8.0 Lustre 2.8.0 0 4 <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>tdtd-1 S 000000000000000a 0 22764 2 0x00000080 ffff8807ef81fd80 0000000000000046 0000000000000000 0000000000000000 000000060011bf89 00000000fffffff4 ffff8807ef81fd40 ffff8808125f7b30 ffff8808309a5af8 ffff8807ef81ffd8 000000000000fbc8 ffff8808309a5af8 Call Trace: [&lt;ffffffffa08fc32d&gt;] distribute_txn_commit_thread+0xfed/0x1750 [ptlrpc] [&lt;ffffffff81061d12&gt;] ? default_wake_function+0x12/0x20 [&lt;ffffffff81061d00&gt;] ? default_wake_function+0x0/0x20 [&lt;ffffffffa08fb340&gt;] ? distribute_txn_commit_thread+0x0/0x1750 [ptlrpc] [&lt;ffffffff8109abf6&gt;] kthread+0x96/0xa0 [&lt;ffffffff8100c20a&gt;] child_rip+0xa/0x20 [&lt;ffffffff8109ab60&gt;] ? kthread+0x0/0xa0 [&lt;ffffffff8100c200&gt;] ? child_rip+0x0/0x20 lod0001_rec00 S 0000000000000007 0 22766 2 0x00000080 ffff8807ef825910 0000000000000046 0000000000000000 ffff8807ef8258d4 000021d557def61b 0000000000000286 ffff8807ef8258b0 ffffffff81083e1c ffff8807ef823ab8 ffff8807ef825fd8 000000000000fbc8 ffff8807ef823ab8 Call Trace: [&lt;ffffffff81083e1c&gt;] ? lock_timer_base+0x3c/0x70 [&lt;ffffffff8152a512&gt;] schedule_timeout+0x192/0x2e0 [&lt;ffffffff81083f30&gt;] ? process_timeout+0x0/0x10 [&lt;ffffffffa0874f99&gt;] ptlrpc_set_wait+0x319/0xa30 [ptlrpc] [&lt;ffffffffa086a510&gt;] ? ptlrpc_interrupted_set+0x0/0x110 [ptlrpc] [&lt;ffffffff81061d00&gt;] ? default_wake_function+0x0/0x20 [&lt;ffffffffa08811a5&gt;] ? lustre_msg_set_jobid+0xf5/0x130 [ptlrpc] [&lt;ffffffffa0875731&gt;] ptlrpc_queue_wait+0x81/0x220 [ptlrpc] [&lt;ffffffffa10de271&gt;] osp_remote_sync+0x121/0x190 [osp] [&lt;ffffffffa10c289d&gt;] osp_attr_get+0x40d/0x6c0 [osp] [&lt;ffffffffa10c42a4&gt;] osp_object_init+0x1b4/0x320 [osp] [&lt;ffffffffa0657db8&gt;] lu_object_alloc+0xd8/0x320 [obdclass] [&lt;ffffffffa0659161&gt;] lu_object_find_try+0x151/0x260 [obdclass] [&lt;ffffffffa0659321&gt;] lu_object_find_at+0xb1/0xe0 [obdclass] [&lt;ffffffff8116ef30&gt;] ? cache_alloc_refill+0x1c0/0x240 [&lt;ffffffffa065a1bc&gt;] dt_locate_at+0x1c/0xa0 [obdclass] [&lt;ffffffffa061934e&gt;] llog_osd_get_cat_list+0x8e/0xcd0 [obdclass] [&lt;ffffffffa0ff4bc0&gt;] lod_sub_prep_llog+0x110/0x7b0 [lod] [&lt;ffffffff81058bd3&gt;] ? __wake_up+0x53/0x70 [&lt;ffffffffa0fc97f6&gt;] lod_sub_recovery_thread+0x196/0xbc0 [lod] [&lt;ffffffff81061d12&gt;] ? default_wake_function+0x12/0x20 [&lt;ffffffffa0fc9660&gt;] ? lod_sub_recovery_thread+0x0/0xbc0 [lod] [&lt;ffffffff8109abf6&gt;] kthread+0x96/0xa0 [&lt;ffffffff8100c20a&gt;] child_rip+0xa/0x20 [&lt;ffffffff8109ab60&gt;] ? kthread+0x0/0xa0 [&lt;ffffffff8100c200&gt;] ? child_rip+0x0/0x20 </pre> </div></div> <p>Looks like log retrieve process is blocked by import recovery.</p> <p>wangdi (di.wang@intel.com) uploaded a new patch: <a href="http://review.whamcloud.com/15682" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/15682</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6880" title="recovery timeout during 24 hours failover test" class="issue-link" data-issue-key="LU-6880"><del>LU-6880</del></a> update: after reply move dtrq to finish list<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 400355f4bc9e353d20638f3264ef3c80b799a5cb</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/15682/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/15682/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6880" title="recovery timeout during 24 hours failover test" class="issue-link" data-issue-key="LU-6880"><del>LU-6880</del></a> update: after reply move dtrq to finish list<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 2a874ec011e680f49405a7e901d8d0d35dcb4f1a</p> <p>Landed for 2.8.</p> Related LU-6831 Development Rank 1|hzxijb: Rank (Obsolete) 9223372036854775807 Severity