Whamcloud Community JIRA

Whamcloud Community JIRA https://jira.whamcloud.com This file is an XML representation of an issue en-us

9.4.14

940014

05-12-2023

[LU-5496] fix for LU-5266 https://jira.whamcloud.com/browse/LU-5496 Lustre <p>the fix in <a href="https://jira.whamcloud.com/browse/LU-5266" title="LBUG on Failover -ldlm_process_extent_lock()) ASSERTION( lock->l_granted_mode != lock->l_req_mode ) " class="issue-link" data-issue-key="LU-5266"><del>LU-5266</del></a> was not exactly correct, check for resend before removing<br/> from resource, otherwise conflicts can be granted in parallel.</p> LU-5496

fix for LU-5266

Bug Critical Resolved Fixed Li Wei Vitaly Fertman patch Fri, 15 Aug 2014 20:14:49 +0000 Tue, 28 Apr 2015 13:21:55 +0000 Thu, 2 Oct 2014 13:03:06 +0000 Lustre 2.6.0 Lustre 2.7.0 Lustre 2.7.0 Lustre 2.5.4 0 8 <p>code : <a href="http://review.whamcloud.com/#/c/11469/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/11469/</a></p> <p>Thanks Vitaly!</p> <p>For the record, one way this may manifest is like:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Aug 19 19:13:34 lola-24 kernel: Lustre: 3728:0:(client.c:1926:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1408500806/real 1408500806] req@ffff880ff523c800 x1476487427817788/t0(0) o101->soaked-OST0000-osc-ffff8810329a9800@192.168.1.102@o2ib:28/4 lens 328/400 e 0 to 1 dl 1408500814 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 Aug 19 19:13:34 lola-24 kernel: Lustre: soaked-OST0000-osc-ffff8810329a9800: Connection to soaked-OST0000 (at 192.168.1.102@o2ib) was lost; in progress operations using this service will wait for recovery to complete Aug 19 19:13:34 lola-24 kernel: Lustre: soaked-OST0000-osc-ffff8810329a9800: Connection restored to soaked-OST0000 (at 192.168.1.102@o2ib) Aug 19 19:13:34 lola-24 kernel: LustreError: 11-0: soaked-OST0000-osc-ffff8810329a9800: Communicating with 192.168.1.102@o2ib, operation ldlm_enqueue failed with -12. </pre> </div></div> <p>On the OSS:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>00010000:00010000:28.0:1408500814.882478:0:5651:0:(ldlm_lockd.c:1268:ldlm_handle_enqueue0()) @@@ found existing lock cookie 0x840d55bbc87132f5 req@ffff88082f115050 x1476487427817788/t0(0) o101->c1d7cd54-55f6-0482-0887-cf6de8216f19@192.168.1.124@o2ib1:0/0 lens 328/0 e 0 to 0 dl 1408500821 ref 1 fl Interpret:/2/ffffffff rc 0/-1 [...] 00010000:00000001:28.0:1408500814.882522:0:5651:0:(ldlm_lock.c:441:ldlm_lock_destroy_nolock()) Process leaving 00010000:00000001:28.0:1408500814.882523:0:5651:0:(ldlm_lock.c:1685:ldlm_lock_enqueue()) Process leaving via out (rc=4294967284 : 4294967284 : 0xfffffff4) 00010000:00000001:28.0:1408500814.882525:0:5651:0:(ldlm_lockd.c:1338:ldlm_handle_enqueue0()) Process leaving via out (rc=4294967284 : 4294967284 : 0xfffffff4) 00010000:00010000:28.0:1408500814.882529:0:5651:0:(ldlm_lockd.c:1422:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply(err=-12, rc=-12) ns: filter-soaked-OST0000_UUID lock: ffff880823f1bbc0/0x840d55bbc87132f5 lrc: 1/0,0 mode: PW/PW res: [0x236111:0x0:0x0].0 rrc: 1 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) flags: 0x44000000000000 nid: 192.168.1.124@o2ib1 remote: 0xcc587d962f96a2f5 expref: 1019 pid: 5651 timeout: 0 lvb_type: 0 </pre> </div></div> <p>The ENOMEM comes from here in ldlm_lock_enqueue():</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> ldlm_resource_unlink_lock(lock); <span class="code-keyword">if</span> (res->lr_type == LDLM_EXTENT && lock->l_tree_node == NULL) { <span class="code-keyword">if</span> (node == NULL) { ldlm_lock_destroy_nolock(lock); GOTO(out, rc = -ENOMEM); } CFS_INIT_LIST_HEAD(&node->li_group); ldlm_interval_attach(node, lock); node = NULL; } </pre> </div></div> <p>Landed for 2.7</p> <p>heh, have not succeeded to submit 2nd version before the land, so a separate patch:<br/> remote: <a href="http://review.whamcloud.com/11644" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/11644</a></p> <p>Heh. ok.</p> <p>Patches have landed to Master</p> Related LU-5266 Development Rank 1|hzwtwv: Rank (Obsolete) 15337 Severity