https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-2119 Lustre <p>See also <a href="https://jira.whamcloud.com/browse/LU-2070" title="lu_object.c:1114:lu_device_fini()) ASSERTIO N( cfs_atomic_read(&amp;d-&gt;ld_ref) == 0 ) failed: Refcount is 6" class="issue-link" data-issue-key="LU-2070"><del>LU-2070</del></a>.</p> <p><a href="https://maloo.whamcloud.com/test_sets/d45314ce-11ff-11e2-a663-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/d45314ce-11ff-11e2-a663-52540035b04c</a></p> <p>From the OSS console log:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>01:55:36:LustreError: 15560:0:(obd_mount.c:2107:server_put_super()) lustre-OST0000: Fail to disconnect osp-on-ost! 01:55:36:LustreError: 15560:0:(obd_mount.c:2137:server_put_super()) no obd lustre-OST0000 01:55:36:LustreError: 15560:0:(obd_mount.c:1415:lustre_stop_osp()) Can not find osp-on-ost lustre-MDT0000-osp-OST0000 01:55:36:LustreError: 15560:0:(obd_mount.c:2152:server_put_super()) lustre-OST0000: Fail to stop osp-on-ost! 01:55:37:LustreError: 15159:0:(lu_object.c:1114:lu_device_fini()) ASSERTION( cfs_atomic_read(&amp;d-&gt;ld_ref) == 0 ) failed: Refcount is 1 01:55:37:LustreError: 15159:0:(lu_object.c:1114:lu_device_fini()) LBUG 01:55:37:Pid: 15159, comm: obd_zombid 01:55:37: 01:55:37:Call Trace: 01:55:37: [&lt;ffffffffa0c9a905&gt;] libcfs_debug_dumpstack+0x55/0x80 [libcfs] 01:55:37: [&lt;ffffffffa0c9af17&gt;] lbug_with_loc+0x47/0xb0 [libcfs] 01:55:37: [&lt;ffffffffa06d96fc&gt;] lu_device_fini+0xcc/0xd0 [obdclass] 01:55:37: [&lt;ffffffffa06dfefe&gt;] dt_device_fini+0xe/0x10 [obdclass] 01:55:37: [&lt;ffffffffa0f44a43&gt;] osd_device_free+0x173/0x2d0 [osd_zfs] 01:55:37: [&lt;ffffffffa06b769d&gt;] class_decref+0x46d/0x590 [obdclass] 01:55:37: [&lt;ffffffffa0693ce9&gt;] obd_zombie_impexp_cull+0x309/0x610 [obdclass] 01:55:37: [&lt;ffffffffa06940b5&gt;] obd_zombie_impexp_thread+0xc5/0x1c0 [obdclass] 01:55:37: [&lt;ffffffff81060250&gt;] ? default_wake_function+0x0/0x20 01:55:37: [&lt;ffffffffa0693ff0&gt;] ? obd_zombie_impexp_thread+0x0/0x1c0 [obdclass] 01:55:37: [&lt;ffffffff8100c14a&gt;] child_rip+0xa/0x20 01:55:37: [&lt;ffffffffa0693ff0&gt;] ? obd_zombie_impexp_thread+0x0/0x1c0 [obdclass] 01:55:37: [&lt;ffffffffa0693ff0&gt;] ? obd_zombie_impexp_thread+0x0/0x1c0 [obdclass] 01:55:37: [&lt;ffffffff8100c140&gt;] ? child_rip+0x0/0x20 01:55:37: 01:55:37:Kernel panic - not syncing: LBUG 01:55:37:Pid: 15159, comm: obd_zombid Tainted: P --------------- 2.6.32-279.5.1.el6_lustre.ga194b25.x86_64 #1 01:55:37:Call Trace: 01:55:37: [&lt;ffffffff814fd58a&gt;] ? panic+0xa0/0x168 01:55:37: [&lt;ffffffffa0c9af6b&gt;] ? lbug_with_loc+0x9b/0xb0 [libcfs] 01:55:37: [&lt;ffffffffa06d96fc&gt;] ? lu_device_fini+0xcc/0xd0 [obdclass] 01:55:37: [&lt;ffffffffa06dfefe&gt;] ? dt_device_fini+0xe/0x10 [obdclass] 01:55:37: [&lt;ffffffffa0f44a43&gt;] ? osd_device_free+0x173/0x2d0 [osd_zfs] 01:55:37: [&lt;ffffffffa06b769d&gt;] ? class_decref+0x46d/0x590 [obdclass] 01:55:37: [&lt;ffffffffa0693ce9&gt;] ? obd_zombie_impexp_cull+0x309/0x610 [obdclass] 01:55:37: [&lt;ffffffffa06940b5&gt;] ? obd_zombie_impexp_thread+0xc5/0x1c0 [obdclass] 01:55:37: [&lt;ffffffff81060250&gt;] ? default_wake_function+0x0/0x20 01:55:37: [&lt;ffffffffa0693ff0&gt;] ? obd_zombie_impexp_thread+0x0/0x1c0 [obdclass] 01:55:37: [&lt;ffffffff8100c14a&gt;] ? child_rip+0xa/0x20 01:55:37: [&lt;ffffffffa0693ff0&gt;] ? obd_zombie_impexp_thread+0x0/0x1c0 [obdclass] 01:55:37: [&lt;ffffffffa0693ff0&gt;] ? obd_zombie_impexp_thread+0x0/0x1c0 [obdclass] 01:55:37: [&lt;ffffffff8100c140&gt;] ? child_rip+0x0/0x20 </pre> </div></div> LU-2119

lu_device_fini(): ASSERTION( cfs_atomic_read(&d->ld_ref) == 0 ) failed: Refcount is 1

Bug Major Resolved Fixed Niu Yawei Li Wei zfs Tue, 9 Oct 2012 10:02:45 +0000 Thu, 11 Oct 2012 11:13:22 +0000 Thu, 11 Oct 2012 11:13:22 +0000 Lustre 2.4.0 Lustre 2.4.0 0 3 <p><a href="https://maloo.whamcloud.com/test_sets/2b0033cc-1202-11e2-a663-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/2b0033cc-1202-11e2-a663-52540035b04c</a></p> <p><a href="https://maloo.whamcloud.com/test_sets/22c55996-1205-11e2-a663-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/22c55996-1205-11e2-a663-52540035b04c</a></p> <p>Niu, could you please have a look?</p> <p>Now we allocate qsd (which holds an refcount of osd) in osd_device_alloc(), but in the osd_device_fini() (for zfs only), we didn't call osd_shutdown() to cleanup the qsd, that'll cause trouble in the abnormal shutdown path. (for instance, OFD/MDT wasn't started, so osd_process_config()-&gt;osd_shutdown() will not be called).</p> <p>I'll post a patch soon.</p> <p><a href="http://review.whamcloud.com/4239" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/4239</a></p> <p>patch landed.</p> Development Rank 1|hzv9sf: Rank (Obsolete) 5120 Severity