https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-13303 Lustre <p>During umount client gets stuck invalidating import</p> <p> </p> <p>attaching full debug from client side. No errors reported on server side.</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> 00000100:00080000:0.0:1582834254.602927:0:43821:0:(pinger.c:412:ptlrpc_pinger_del_import()) removing pingable <span class="code-keyword">import</span> 69fa9d68-b663-7a88-9df3-0f9930f72f9d-&gt;nbp1-OST0016_UUID 00000100:00080000:0.0:1582834254.603390:0:43821:0:(<span class="code-keyword">import</span>.c:157:ptlrpc_deactivate_import_nolock()) setting <span class="code-keyword">import</span> nbp1-OST0016_UUID INVALID 00000100:00020000:0.0:1582834356.986737:0:43821:0:(<span class="code-keyword">import</span>.c:361:ptlrpc_invalidate_import()) nbp1-OST0016_UUID: rc = -110 waiting <span class="code-keyword">for</span> callback (1 != 0) 00000100:00020000:0.0:1582834356.999173:0:43821:0:(<span class="code-keyword">import</span>.c:387:ptlrpc_invalidate_import()) @@@ still on sending list req@ffff8ea5e5192940 x1657225699614176/t0(0) o8-&gt;nbp1-OST0016-osc-ffff8eb45292f000@10.151.26.119@o2ib:28/4 lens 520/544 e 0 to 1 dl 1582832131 ref 2 fl UnregRPC:EXN/0/ffffffff rc -5/-1 00000100:00020000:0.0:1582834357.024877:0:43821:0:(<span class="code-keyword">import</span>.c:401:ptlrpc_invalidate_import()) nbp1-OST0016_UUID: Unregistering RPCs found (1). Network is sluggish? Waiting them to error out. 00000100:00020000:0.0:1582834459.418739:0:43821:0:(<span class="code-keyword">import</span>.c:361:ptlrpc_invalidate_import()) nbp1-OST0016_UUID: rc = -110 waiting <span class="code-keyword">for</span> callback (1 != 0) 00000100:00020000:0.0:1582834459.431183:0:43821:0:(<span class="code-keyword">import</span>.c:387:ptlrpc_invalidate_import()) @@@ still on sending list req@ffff8ea5e5192940 x1657225699614176/t0(0) o8-&gt;nbp1-OST0016-osc-ffff8eb45292</pre> </div></div> client=2.12.3 <br/> server=2.12.3 LU-13303

(import.c:361:ptlrpc_invalidate_import()) nbp1-OST0016_UUID: rc = -110 waiting for callback (1 != 0)

Bug Major Resolved Incomplete Oleg Drokin Mahmoud Hanafi Thu, 27 Feb 2020 23:40:54 +0000 Wed, 6 Jan 2021 13:10:48 +0000 Wed, 6 Jan 2021 13:10:48 +0000 Lustre 2.12.3 0 4 <p>This is not so much Lustre problem as a network/network driver problem of sorts. Lustre asks the network to deregister a buffer in memory so it no longer could accept the data and the network/driver takes its time to do that and eventually Lustre timeouts.</p> <p>Our options at that time are: keep waiting or leak the buffer and exit. We probably can add a module parameter to do the leaking, but I feel like it's overkill and you are probably better off just adding this line "Unregistering RPCs found (\d+). Network is sluggish? Waiting them to error out" in your health scripts and if triggered just kill the node?</p> <p>"network/driver" is that lnet/ko2ib? It keeps trying forever and never cleans up. I would think it should just give up at some point.</p> <p> </p> <p>this can be closed</p> Development Rank 1|i00uhr: Rank (Obsolete) 9223372036854775807 Severity