https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-3073 Lustre <p>This issue was created by maloo for nasf &lt;fan.yong@intel.com&gt;</p> <p>This issue relates to the following test suite run: <a href="https://maloo.whamcloud.com/test_sets/9521ae5c-99ca-11e2-8bb4-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/9521ae5c-99ca-11e2-8bb4-52540035b04c</a>.</p> <p>== sanity test 120a: Early Lock Cancel: mkdir test == 13:08:00 (1364674080)<br/> ldlm.namespaces.lustre-MDT0000-mdc-ffff88006796e400.lru_size=100<br/> ldlm.namespaces.lustre-OST0000-osc-ffff88006796e400.lru_size=100<br/> ldlm.namespaces.lustre-OST0001-osc-ffff88006796e400.lru_size=100<br/> ldlm.namespaces.lustre-OST0002-osc-ffff88006796e400.lru_size=100<br/> ldlm.namespaces.lustre-OST0003-osc-ffff88006796e400.lru_size=100<br/> ldlm.namespaces.lustre-OST0004-osc-ffff88006796e400.lru_size=100<br/> ldlm.namespaces.lustre-OST0005-osc-ffff88006796e400.lru_size=100<br/> ldlm.namespaces.lustre-OST0006-osc-ffff88006796e400.lru_size=100<br/> error: get_param: /proc/</p> {fs,sys}/{lnet,lustre}/ldlm/services/ldlm_canceld/stats: Found no match<br/> error: get_param: /proc/{fs,sys} <p>/</p> {lnet,lustre} <p>/ldlm/services/ldlm_canceld/stats: Found no match<br/> sanity test_120a: @@@@@@ FAIL: 1 blocking RPC occured. </p> LU-3073

Test failure on test suite sanity test_120a

Bug Blocker Resolved Fixed Hongchao Zhang Maloo Sun, 31 Mar 2013 09:04:45 +0000 Sat, 20 Apr 2013 16:44:38 +0000 Sat, 20 Apr 2013 16:44:38 +0000 Lustre 2.4.0 Lustre 2.4.0 0 6 <p>Another instance:<br/> <a href="https://maloo.whamcloud.com/test_sets/54fc0ca8-9f7b-11e2-86dc-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/54fc0ca8-9f7b-11e2-86dc-52540035b04c</a></p> <p>I hit this issue again while testing patch <a href="http://review.whamcloud.com/#change,6027" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,6027</a> :<br/> <a href="https://maloo.whamcloud.com/test_sets/e59db8e4-a40b-11e2-80ee-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/e59db8e4-a40b-11e2-80ee-52540035b04c</a></p> <p>Another here: <br/> <a href="https://maloo.whamcloud.com/test_sets/7ed97bdc-a41c-11e2-80ee-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/7ed97bdc-a41c-11e2-80ee-52540035b04c</a></p> <p>this ticket is caused by the asynchronous destroy at MDT, which triggers a blocking AST at client side.</p> <p>the log of OST</p> <p>00000100:00100000:0.0:1364674080.749546:0:25979:0:(service.c:1975:ptlrpc_server_handle_request()) Handling RPC pname:cluuid+ref:pid:xid:nid:opc ll_ost00_029:lustre-MDT0000-mdtlov_UUID+5:2920:x1430961061754764:12345-10.10.16.143@tcp:6<br/> .......</p> <p>00010000:00000001:0.0:1364674080.749677:0:25979:0:(ldlm_lock.c:751:ldlm_add_ast_work_item()) Process entered<br/> 00010000:00010000:0.0:1364674080.749680:0:25979:0:(ldlm_lock.c:714:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-ffff880037068000 lock: ffff880069322400/0x77cac32f14b081ad lrc: 2/0,0 mode: PW/PW res: 2005/0 rrc: 2 type: EXT <span class="error">&#91;0-&gt;18446744073709551615&#93;</span> (req 0-&gt;1048575) flags: 0x0 nid: 10.10.16.146@tcp remote: 0x24fbfe568768a43c expref: 73 pid: 6272 timeout: 0 lvb_type: 0<br/> 00010000:00000001:0.0:1364674080.749687:0:25979:0:(ldlm_lock.c:757:ldlm_add_ast_work_item()) Process leaving<br/> 00010000:00000001:0.0:1364674080.749689:0:25979:0:(ldlm_extent.c:363:ldlm_extent_compat_cb()) Process leaving (rc=1 : 1 : 1)<br/> 00010000:00010000:0.0:1364674080.749691:0:25979:0:(ldlm_extent.c:314:ldlm_check_contention()) contended locks = 1<br/> 00010000:00000001:0.0:1364674080.749693:0:25979:0:(ldlm_extent.c:635:ldlm_extent_compat_queue()) Process leaving (rc=0 : 0 : 0)<br/> 00010000:00000001:0.0:1364674080.749695:0:25979:0:(ldlm_extent.c:392:ldlm_extent_compat_queue()) Process entered<br/> 00010000:00010000:0.0:1364674080.749696:0:25979:0:(ldlm_extent.c:314:ldlm_check_contention()) contended locks = 1<br/> 00010000:00000001:0.0:1364674080.749697:0:25979:0:(ldlm_extent.c:635:ldlm_extent_compat_queue()) Process leaving (rc=1 : 1 : 1)</p> <p>....... </p> <p>00010000:00010000:0.0:1364674080.749850:0:25979:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-ffff880037068000 lock: ffff880069322400/0x77cac32f14b081ad lrc: 3/0,0 mode: PW/PW res: 2005/0 rrc: 2 type: EXT <span class="error">&#91;0-&gt;18446744073709551615&#93;</span> (req 0-&gt;1048575) flags: 0x10020 nid: 10.10.16.146@tcp remote: 0x24fbfe568768a43c expref: 73 pid: 6272 timeout: 0 lvb_type: 0<br/> 00010000:00010000:0.0:1364674080.749860:0:25979:0:(ldlm_lockd.c:506:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-ffff880037068000 lock: ffff880069322400/0x77cac32f14b081ad lrc: 4/0,0 mode: PW/PW res: 2005/0 rrc: 2 type: EXT <span class="error">&#91;0-&gt;18446744073709551615&#93;</span> (req 0-&gt;1048575) flags: 0x10020 nid: 10.10.16.146@tcp remote: 0x24fbfe568768a43c expref: 73 pid: 6272 timeout: 4298369097 lvb_type: 0<br/> 00010000:000000</p> <p>the log of Client</p> <p>00010000:00010000:0.0:1364674080.750726:0:22778:0:(ldlm_lockd.c:1686:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff88006796e400 lock: ffff8800678afc00/0x24fbfe568768a43c lrc: 3/0,0 mode: PW/PW res: 2005/0 rrc: 1 type: EXT <span class="error">&#91;0-&gt;18446744073709551615&#93;</span> (req 0-&gt;1048575) flags: 0x420000010000 nid: local remote: 0x77cac32f14b081ad expref: -99 pid: 23659 timeout: 0 lvb_type: 1<br/> 00010000:00010000:0.0:1364674080.750730:0:22778:0:(ldlm_lockd.c:1699:ldlm_handle_bl_callback()) Lock ffff8800678afc00 already unused, calling callback (ffffffffa099b370)<br/> 00000020:00010000:0.0:1364674080.750764:0:22778:0:(cl_lock.c:150:cl_lock_trace0()) cancel lock: ffff880068a3f898@(1 ffff88007a3beae0 1 5 0 0 0 0)(ffff880079972db8/1/1) at cl_lock_cancel():1838<br/> 00000008:00010000:0.0:1364674080.750771:0:22778:0:(osc_lock.c:1319:osc_lock_flush()) ### lock ffff880068a3f898: 0 pages were discarded.<br/> ns: lustre-OST0000-osc-ffff88006796e400 lock: ffff8800678afc00/0x24fbfe568768a43c lrc: 3/0,0 mode: PW/PW res: 2005/0 rrc: 1 type: EXT <span class="error">&#91;0-&gt;18446744073709551615&#93;</span> (req 0-&gt;1048575) flags: 0x420400010000 nid: local remote: 0x77cac32f14b081ad expref: -99 pid: 23659 timeout: 0 lvb_type: 1<br/> 00000080:00200000:0.0:1364674080.751365:0:22778:0:(vvp_io.c:128:vvp_io_fini()) ignore/verify layout 1/0, layout version 0.<br/> 00010000:00010000:0.0:1364674080.751368:0:22778:0:(ldlm_request.c:1127:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff88006796e400 lock: ffff8800678afc00/0x24fbfe568768a43c lrc: 4/0,0 mode: PW/PW res: 2005/0 rrc: 1 type: EXT <span class="error">&#91;0-&gt;18446744073709551615&#93;</span> (req 0-&gt;1048575) flags: 0x428400010000 nid: local remote: 0x77cac32f14b081ad expref: -99 pid: 23659 timeout: 0 lvb_type: 1</p> <p>the patch is tracked at <a href="http://review.whamcloud.com/#change,6088" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,6088</a></p> <p>Landed for 2.4</p> Development Rank 1|hzvmq7: Rank (Obsolete) 7477 Severity