https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-1527 Lustre <p>With backtrace:</p> <p>LustreError: 16393:0:(cl_lock.c:2211:cl_lock_hold_add()) ASSERTION( lock-&gt;cll_state != CLS_FREEING ) failed: <br/> LustreError: 16393:0:(cl_lock.c:2211:cl_lock_hold_add()) LBUG<br/> Pid: 16393, comm: ll_close</p> <p>Call Trace:<br/> <span class="error">&#91;&lt;ffffffffa0ce3905&gt;&#93;</span> libcfs_debug_dumpstack+0x55/0x80 <span class="error">&#91;libcfs&#93;</span><br/> <span class="error">&#91;&lt;ffffffffa0ce3f17&gt;&#93;</span> lbug_with_loc+0x47/0xb0 <span class="error">&#91;libcfs&#93;</span><br/> <span class="error">&#91;&lt;ffffffffa0e64f71&gt;&#93;</span> cl_lock_hold_add+0x141/0x150 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;&lt;ffffffffa0e67c16&gt;&#93;</span> cl_lock_peek+0x96/0x150 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;&lt;ffffffffa0a0ac66&gt;&#93;</span> cl_local_size+0x266/0x2f0 <span class="error">&#91;lustre&#93;</span><br/> <span class="error">&#91;&lt;ffffffffa09ce846&gt;&#93;</span> ll_done_writing_attr+0x46/0x190 <span class="error">&#91;lustre&#93;</span><br/> <span class="error">&#91;&lt;ffffffffa09cec89&gt;&#93;</span> ll_ioepoch_close+0x2f9/0x600 <span class="error">&#91;lustre&#93;</span><br/> <span class="error">&#91;&lt;ffffffffa09d05d0&gt;&#93;</span> ll_close_thread+0x2a0/0x1060 <span class="error">&#91;lustre&#93;</span><br/> <span class="error">&#91;&lt;ffffffff8105e7f0&gt;&#93;</span> ? default_wake_function+0x0/0x20<br/> <span class="error">&#91;&lt;ffffffffa09d0330&gt;&#93;</span> ? ll_close_thread+0x0/0x1060 <span class="error">&#91;lustre&#93;</span><br/> <span class="error">&#91;&lt;ffffffff8100c14a&gt;&#93;</span> child_rip+0xa/0x20<br/> <span class="error">&#91;&lt;ffffffffa09d0330&gt;&#93;</span> ? ll_close_thread+0x0/0x1060 <span class="error">&#91;lustre&#93;</span><br/> <span class="error">&#91;&lt;ffffffffa09d0330&gt;&#93;</span> ? ll_close_thread+0x0/0x1060 <span class="error">&#91;lustre&#93;</span><br/> <span class="error">&#91;&lt;ffffffff8100c140&gt;&#93;</span> ? child_rip+0x0/0x20</p> <p>LustreError: dumping log to /tmp/lustre-log.1339749052.16393</p> LU-1527

Assertion at: (cl_lock.c:2211:cl_lock_hold_add()) ASSERTION( lock->cll_state != CLS_FREEING )

Bug Blocker Resolved Fixed Jinshan Xiong Jinshan Xiong mn1 Fri, 15 Jun 2012 04:46:35 +0000 Mon, 27 Jan 2014 14:38:57 +0000 Tue, 13 Nov 2012 15:06:48 +0000 Lustre 2.1.6 Lustre 2.4.0 0 6 <p>We should check if the lock is freed in cl_lock_peek().</p> <p>patch is at: <a href="http://review.whamcloud.com/3117" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/3117</a></p> <p>I hit this on sanity.sh test_132() in my local single-node test setup (dual-core x86_64):</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Lustre: 2247:0:(ofd_obd.c:1067:ofd_orphans_destroy()) testfs-OST0002: deleting orphan objects from 47607 to 47694 Lustre: 2247:0:(ofd_obd.c:1067:ofd_orphans_destroy()) Skipped 6 previous similar messages LustreError: 2233:0:(ldlm_resource.c:1103:ldlm_resource_get()) lvbo_init failed for resource 8000: rc -2 LustreError: 2233:0:(ldlm_resource.c:1103:ldlm_resource_get()) Skipped 20 previous similar messages LustreError: 2242:0:(ldlm_resource.c:1103:ldlm_resource_get()) lvbo_init failed for resource 7832: rc -2 LustreError: 2242:0:(ldlm_resource.c:1103:ldlm_resource_get()) Skipped 2 previous similar messages Lustre: Mounted testfs-client LustreError: 2225:0:(ldlm_resource.c:1103:ldlm_resource_get()) lvbo_init failed for resource 7848: rc -2 LustreError: 2225:0:(ldlm_resource.c:1103:ldlm_resource_get()) Skipped 33 previous similar messages Lustre: DEBUG MARKER: Using TIMEOUT=20 LustreError: 2224:0:(ldlm_resource.c:1103:ldlm_resource_get()) lvbo_init failed for resource 28838: rc -2 LustreError: 2224:0:(ldlm_resource.c:1103:ldlm_resource_get()) Skipped 262 previous similar messages LustreError: 2232:0:(ldlm_resource.c:1103:ldlm_resource_get()) lvbo_init failed for resource 45068: rc -2 LustreError: 2232:0:(ldlm_resource.c:1103:ldlm_resource_get()) Skipped 5436 previous similar messages Lustre: 2094:0:(mdt_handler.c:5649:mdt_connect_internal()) testfs-MDT0000: MDS has SOM enabled, but client does not support it Lustre: DEBUG MARKER: cancel_lru_locks osc start LustreError: 2526:0:(cl_lock.c:2176:cl_lock_hold_add()) ASSERTION( lock-&gt;cll_state != CLS_FREEING ) failed: LustreError: 2526:0:(cl_lock.c:2176:cl_lock_hold_add()) LBUG Pid: 2526, comm: ll_close Call Trace: [&lt;ffffffffa078c905&gt;] libcfs_debug_dumpstack+0x55/0x80 [libcfs] [&lt;ffffffffa078cf17&gt;] lbug_with_loc+0x47/0xb0 [libcfs] [&lt;ffffffffa0980ac1&gt;] cl_lock_hold_add+0x141/0x150 [obdclass] [&lt;ffffffffa0983736&gt;] cl_lock_peek+0x96/0x150 [obdclass] [&lt;ffffffffa117b1b6&gt;] cl_local_size+0x266/0x2f0 [lustre] [&lt;ffffffffa113df36&gt;] ll_done_writing_attr+0x46/0x190 [lustre] [&lt;ffffffffa113e379&gt;] ll_ioepoch_close+0x2f9/0x600 [lustre] [&lt;ffffffffa113fcc0&gt;] ll_close_thread+0x2a0/0x1060 [lustre] [&lt;ffffffff81060250&gt;] ? default_wake_function+0x0/0x20 </pre> </div></div> <p>The lvbo_init errors are unexpected in this test, so I'm not sure if they are the trigger, or unrelated to the problem.</p> <p>patch has landed.</p> <p>FYI, I ran into this running acceptance on a SLES11SP1 node with Lustre 2.1.5 client.<br/> Andriy's patch looks applicable to b2_1, as well.<br/> I just passed an acceptance run using a 2.1.5 base plus this patch.<br/> Whitespace changes were required.</p> <p>While testing patch <a href="http://review.whamcloud.com/8835" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/8835</a> on Lustre b2_1 branch, the same failure occurred:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>17:17:19:LustreError: 15141:0:(cl_lock.c:2188:cl_lock_hold_add()) ASSERTION( lock-&gt;cll_state != CLS_FREEING ) failed: 17:17:19:LustreError: 15141:0:(cl_lock.c:2188:cl_lock_hold_add()) LBUG </pre> </div></div> <p>Maloo report: <a href="https://maloo.whamcloud.com/test_sets/ec280652-8726-11e3-8928-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/ec280652-8726-11e3-8928-52540035b04c</a></p> Related LU-2128 Development Rank 1|hzvaon: Rank (Obsolete) 5266 Severity