https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-11699 Lustre <p><span class="error">&#91;597537.289392&#93;</span> LustreError: 14605:0:(lod_dev.c:1692:lod_device_free()) ASSERTION( atomic_read(&amp;lu-&gt;ld_ref) == 0 ) failed: lu is ffff881a7e690000<br/> <span class="error">&#91;597537.289393&#93;</span> LustreError: 14605:0:(lod_dev.c:1692:lod_device_free()) LBUG<br/> <span class="error">&#91;597537.289393&#93;</span> Pid: 14605, comm: umount<br/> <span class="error">&#91;597537.289394&#93;</span><br/> Call Trace:<br/> <span class="error">&#91;597537.289406&#93;</span> <span class="error">&#91;&lt;ffffffffc0a697ae&gt;&#93;</span> libcfs_call_trace+0x4e/0x60 <span class="error">&#91;libcfs&#93;</span><br/> <span class="error">&#91;597537.289410&#93;</span> <span class="error">&#91;&lt;ffffffffc0a6983c&gt;&#93;</span> lbug_with_loc+0x4c/0xb0 <span class="error">&#91;libcfs&#93;</span><br/> <span class="error">&#91;597537.289417&#93;</span> <span class="error">&#91;&lt;ffffffffc14dcfa3&gt;&#93;</span> lod_device_free+0x2c3/0x300 <span class="error">&#91;lod&#93;</span><br/> <span class="error">&#91;597537.289436&#93;</span> <span class="error">&#91;&lt;ffffffffc0bc9572&gt;&#93;</span> class_free_dev+0x462/0x670 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289446&#93;</span> <span class="error">&#91;&lt;ffffffffc0bc99a0&gt;&#93;</span> class_export_put+0x220/0x2f0 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289457&#93;</span> <span class="error">&#91;&lt;ffffffffc0bcb4b5&gt;&#93;</span> class_unlink_export+0x135/0x170 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289469&#93;</span> <span class="error">&#91;&lt;ffffffffc0be1550&gt;&#93;</span> class_decref+0x80/0x160 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289481&#93;</span> <span class="error">&#91;&lt;ffffffffc0be19b3&gt;&#93;</span> class_detach+0x1b3/0x2e0 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289493&#93;</span> <span class="error">&#91;&lt;ffffffffc0be85a7&gt;&#93;</span> class_process_config+0x1987/0x2810 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289495&#93;</span> <span class="error">&#91;&lt;ffffffff810c4c8d&gt;&#93;</span> ? ttwu_do_activate.constprop.91+0x5d/0x70<br/> <span class="error">&#91;597537.289501&#93;</span> <span class="error">&#91;&lt;ffffffffc0a76ef7&gt;&#93;</span> ? libcfs_debug_msg+0x57/0x80 <span class="error">&#91;libcfs&#93;</span><br/> <span class="error">&#91;597537.289513&#93;</span> <span class="error">&#91;&lt;ffffffffc0be9610&gt;&#93;</span> class_manual_cleanup+0x1e0/0x710 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289516&#93;</span> <span class="error">&#91;&lt;ffffffffc14dc9c6&gt;&#93;</span> lod_obd_disconnect+0x86/0x1b0 <span class="error">&#91;lod&#93;</span><br/> <span class="error">&#91;597537.289522&#93;</span> <span class="error">&#91;&lt;ffffffffc15bdd84&gt;&#93;</span> mdd_process_config+0x404/0x650 <span class="error">&#91;mdd&#93;</span><br/> <span class="error">&#91;597537.289531&#93;</span> <span class="error">&#91;&lt;ffffffffc13e9292&gt;&#93;</span> mdt_stack_fini+0x2c2/0xd50 <span class="error">&#91;mdt&#93;</span><br/> <span class="error">&#91;597537.289536&#93;</span> <span class="error">&#91;&lt;ffffffffc13ea0ab&gt;&#93;</span> mdt_device_fini+0x38b/0x980 <span class="error">&#91;mdt&#93;</span><br/> <span class="error">&#91;597537.289549&#93;</span> <span class="error">&#91;&lt;ffffffffc0be622a&gt;&#93;</span> class_cleanup+0x8ea/0xc60 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289560&#93;</span> <span class="error">&#91;&lt;ffffffffc0be727c&gt;&#93;</span> class_process_config+0x65c/0x2810 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289565&#93;</span> <span class="error">&#91;&lt;ffffffffc0a76ef7&gt;&#93;</span> ? libcfs_debug_msg+0x57/0x80 <span class="error">&#91;libcfs&#93;</span><br/> <span class="error">&#91;597537.289580&#93;</span> <span class="error">&#91;&lt;ffffffffc0be95f6&gt;&#93;</span> class_manual_cleanup+0x1c6/0x710 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289597&#93;</span> <span class="error">&#91;&lt;ffffffffc0c188ce&gt;&#93;</span> server_put_super+0x8de/0xcd0 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289600&#93;</span> <span class="error">&#91;&lt;ffffffff81208085&gt;&#93;</span> generic_shutdown_super+0x75/0x100<br/> <span class="error">&#91;597537.289601&#93;</span> <span class="error">&#91;&lt;ffffffff81208462&gt;&#93;</span> kill_anon_super+0x12/0x20<br/> <span class="error">&#91;597537.289616&#93;</span> <span class="error">&#91;&lt;ffffffffc0bec042&gt;&#93;</span> lustre_kill_super+0x32/0x50 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289618&#93;</span> <span class="error">&#91;&lt;ffffffff8120881e&gt;&#93;</span> deactivate_locked_super+0x4e/0x70<br/> <span class="error">&#91;597537.289619&#93;</span> <span class="error">&#91;&lt;ffffffff81208fa6&gt;&#93;</span> deactivate_super+0x46/0x60<br/> <span class="error">&#91;597537.289621&#93;</span> <span class="error">&#91;&lt;ffffffff8122655f&gt;&#93;</span> cleanup_mnt+0x3f/0x80<br/> <span class="error">&#91;597537.289622&#93;</span> <span class="error">&#91;&lt;ffffffff812265f2&gt;&#93;</span> __cleanup_mnt+0x12/0x20<br/> <span class="error">&#91;597537.289624&#93;</span> <span class="error">&#91;&lt;ffffffff810b087b&gt;&#93;</span> task_work_run+0xbb/0xe0<br/> <span class="error">&#91;597537.289626&#93;</span> <span class="error">&#91;&lt;ffffffff8102ab52&gt;&#93;</span> do_notify_resume+0x92/0xb0<br/> <span class="error">&#91;597537.289628&#93;</span> <span class="error">&#91;&lt;ffffffff816c1a5d&gt;&#93;</span> int_signal+0x12/0x17<br/> <span class="error">&#91;597537.289628&#93;</span><br/> <span class="error">&#91;597537.289629&#93;</span> Kernel panic - not syncing: LBUG<br/> <span class="error">&#91;597537.289630&#93;</span> CPU: 4 PID: 14605 Comm: umount Tainted: G OE ------------ 3.10.0-693.21.1.x3.1.9.x86_64 #1<br/> <span class="error">&#91;597537.289631&#93;</span> Hardware name: Seagate Laguna Seca/Laguna Seca, BIOS v02.0034 09/28/2017<br/> <span class="error">&#91;597537.289631&#93;</span> Call Trace:<br/> <span class="error">&#91;597537.289634&#93;</span> <span class="error">&#91;&lt;ffffffff816ae7c8&gt;&#93;</span> dump_stack+0x19/0x1b<br/> <span class="error">&#91;597537.289635&#93;</span> <span class="error">&#91;&lt;ffffffff816a8634&gt;&#93;</span> panic+0xe8/0x21f<br/> <span class="error">&#91;597537.289640&#93;</span> <span class="error">&#91;&lt;ffffffffc0a69854&gt;&#93;</span> lbug_with_loc+0x64/0xb0 <span class="error">&#91;libcfs&#93;</span><br/> <span class="error">&#91;597537.289645&#93;</span> <span class="error">&#91;&lt;ffffffffc14dcfa3&gt;&#93;</span> lod_device_free+0x2c3/0x300 <span class="error">&#91;lod&#93;</span><br/> <span class="error">&#91;597537.289659&#93;</span> <span class="error">&#91;&lt;ffffffffc0bc9572&gt;&#93;</span> class_free_dev+0x462/0x670 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289673&#93;</span> <span class="error">&#91;&lt;ffffffffc0bc99a0&gt;&#93;</span> class_export_put+0x220/0x2f0 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289688&#93;</span> <span class="error">&#91;&lt;ffffffffc0bcb4b5&gt;&#93;</span> class_unlink_export+0x135/0x170 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289703&#93;</span> <span class="error">&#91;&lt;ffffffffc0be1550&gt;&#93;</span> class_decref+0x80/0x160 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289718&#93;</span> <span class="error">&#91;&lt;ffffffffc0be19b3&gt;&#93;</span> class_detach+0x1b3/0x2e0 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289733&#93;</span> <span class="error">&#91;&lt;ffffffffc0be85a7&gt;&#93;</span> class_process_config+0x1987/0x2810 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289735&#93;</span> <span class="error">&#91;&lt;ffffffff810c4c8d&gt;&#93;</span> ? ttwu_do_activate.constprop.91+0x5d/0x70<br/> <span class="error">&#91;597537.289741&#93;</span> <span class="error">&#91;&lt;ffffffffc0a76ef7&gt;&#93;</span> ? libcfs_debug_msg+0x57/0x80 <span class="error">&#91;libcfs&#93;</span><br/> <span class="error">&#91;597537.289756&#93;</span> <span class="error">&#91;&lt;ffffffffc0be9610&gt;&#93;</span> class_manual_cleanup+0x1e0/0x710 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289762&#93;</span> <span class="error">&#91;&lt;ffffffffc14dc9c6&gt;&#93;</span> lod_obd_disconnect+0x86/0x1b0 <span class="error">&#91;lod&#93;</span><br/> <span class="error">&#91;597537.289766&#93;</span> <span class="error">&#91;&lt;ffffffffc15bdd84&gt;&#93;</span> mdd_process_config+0x404/0x650 <span class="error">&#91;mdd&#93;</span><br/> <span class="error">&#91;597537.289774&#93;</span> <span class="error">&#91;&lt;ffffffffc13e9292&gt;&#93;</span> mdt_stack_fini+0x2c2/0xd50 <span class="error">&#91;mdt&#93;</span><br/> <span class="error">&#91;597537.289782&#93;</span> <span class="error">&#91;&lt;ffffffffc13ea0ab&gt;&#93;</span> mdt_device_fini+0x38b/0x980 <span class="error">&#91;mdt&#93;</span><br/> <span class="error">&#91;597537.289798&#93;</span> <span class="error">&#91;&lt;ffffffffc0be622a&gt;&#93;</span> class_cleanup+0x8ea/0xc60 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289813&#93;</span> <span class="error">&#91;&lt;ffffffffc0be727c&gt;&#93;</span> class_process_config+0x65c/0x2810 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289820&#93;</span> <span class="error">&#91;&lt;ffffffffc0a76ef7&gt;&#93;</span> ? libcfs_debug_msg+0x57/0x80 <span class="error">&#91;libcfs&#93;</span><br/> <span class="error">&#91;597537.289835&#93;</span> <span class="error">&#91;&lt;ffffffffc0be95f6&gt;&#93;</span> class_manual_cleanup+0x1c6/0x710 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289868&#93;</span> <span class="error">&#91;&lt;ffffffffc0c188ce&gt;&#93;</span> server_put_super+0x8de/0xcd0 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289871&#93;</span> <span class="error">&#91;&lt;ffffffff81208085&gt;&#93;</span> generic_shutdown_super+0x75/0x100<br/> <span class="error">&#91;597537.289873&#93;</span> <span class="error">&#91;&lt;ffffffff81208462&gt;&#93;</span> kill_anon_super+0x12/0x20<br/> <span class="error">&#91;597537.289888&#93;</span> <span class="error">&#91;&lt;ffffffffc0bec042&gt;&#93;</span> lustre_kill_super+0x32/0x50 <span class="error">&#91;obdclass&#93;</span><br/> <span class="error">&#91;597537.289890&#93;</span> <span class="error">&#91;&lt;ffffffff8120881e&gt;&#93;</span> deactivate_locked_super+0x4e/0x70<br/> <span class="error">&#91;597537.289892&#93;</span> <span class="error">&#91;&lt;ffffffff81208fa6&gt;&#93;</span> deactivate_super+0x46/0x60<br/> <span class="error">&#91;597537.289894&#93;</span> <span class="error">&#91;&lt;ffffffff8122655f&gt;&#93;</span> cleanup_mnt+0x3f/0x80<br/> <span class="error">&#91;597537.289895&#93;</span> <span class="error">&#91;&lt;ffffffff812265f2&gt;&#93;</span> __cleanup_mnt+0x12/0x20<br/> <span class="error">&#91;597537.289897&#93;</span> <span class="error">&#91;&lt;ffffffff810b087b&gt;&#93;</span> task_work_run+0xbb/0xe0<br/> <span class="error">&#91;597537.289898&#93;</span> <span class="error">&#91;&lt;ffffffff8102ab52&gt;&#93;</span> do_notify_resume+0x92/0xb0<br/> <span class="error">&#91;597537.289900&#93;</span> <span class="error">&#91;&lt;ffffffff816c1a5d&gt;&#93;</span> int_signal+0x12/0x17 </p> LU-11699

lod_device_free()) ASSERTION( atomic_read(&lu->ld_ref) == 0 ) failed: lu is ffff881a7e690000

Bug Minor Resolved Fixed Andriy Skulysh Andriy Skulysh patch Mon, 26 Nov 2018 13:53:54 +0000 Wed, 7 Oct 2020 04:15:56 +0000 Fri, 4 Jan 2019 05:25:39 +0000 Lustre 2.13.0 0 2 <p>lfsck_assistant_engine is exiting but lfsck_thread_args_fini() wasn't called yet</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>crash&gt; bt 13988 PID: 13988 TASK: ffff8811f1a01fa0 CPU: 8 COMMAND: "lfsck_layout" #0 [ffff881fff608e48] crash_nmi_callback at ffffffff810502b7 #1 [ffff881fff608e58] nmi_handle at ffffffff816b992c #2 [ffff881fff608eb0] do_nmi at ffffffff816b9b5d #3 [ffff881fff608ef0] end_repeat_nmi at ffffffff816b8d89 [exception RIP: delay_tsc+58] RIP: ffffffff81336c8a RSP: ffff881a39e73988 RFLAGS: 00000046 RAX: 000000007f231ad1 RBX: ffffffff81fe6f40 RCX: 0004abd47f2319d9 RDX: 000000000004abd4 RSI: 0000000000000008 RDI: 0000000000000899 RBP: ffff881a39e73988 R8: 0000000000000000 R9: 0000000000000000 R10: 0000000000000000 R11: ffff881a39e738ae R12: 0000000000002701 R13: 0000000000000020 R14: ffffffff81d9e1f0 R15: 0000000000000090 ORIG_RAX: ffffffffffffffff CS: 0010 SS: 0018 --- &lt;NMI exception stack&gt; --- #4 [ffff881a39e73988] delay_tsc at ffffffff81336c8a #5 [ffff881a39e73990] __const_udelay at ffffffff81336bcd #6 [ffff881a39e739a0] wait_for_xmitr at ffffffff8141a390 #7 [ffff881a39e739c8] serial8250_console_putchar at ffffffff8141a58c #8 [ffff881a39e739e8] uart_console_write at ffffffff81414fac #9 [ffff881a39e73a18] serial8250_console_write at ffffffff8141a4cf #10 [ffff881a39e73a60] call_console_drivers.constprop.17 at ffffffff8108c0c3 #11 [ffff881a39e73a88] console_unlock at ffffffff8108d868 #12 [ffff881a39e73ac8] vprintk_emit at ffffffff8108dc74 #13 [ffff881a39e73b38] vprintk_default at ffffffff8108dfe9 #14 [ffff881a39e73b48] printk at ffffffff816a87cb #15 [ffff881a39e73ba8] cfs_print_to_console at ffffffffc0a6957a [libcfs] #16 [ffff881a39e73bd8] libcfs_debug_vmsg2 at ffffffffc0a768c4 [libcfs] #17 [ffff881a39e73d20] libcfs_debug_msg at ffffffffc0a76ef7 [libcfs] #18 [ffff881a39e73d80] lfsck_assistant_engine at ffffffffc1347b37 [lfsck] #19 [ffff881a39e73ec8] kthread at ffffffff810b4031 #20 [ffff881a39e73f50] ret_from_fork at ffffffff816c155d </pre> </div></div> <p>Andriy Skulysh (c17819@cray.com) uploaded a new patch: <a href="https://review.whamcloud.com/33715" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/33715</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11699" title="lod_device_free()) ASSERTION( atomic_read(&amp;lu-&gt;ld_ref) == 0 ) failed: lu is ffff881a7e690000" class="issue-link" data-issue-key="LU-11699"><del>LU-11699</del></a> lfsck: Umount while running LFSCK<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: a15f8956b5fa9f07b85c21958a343a0cf1c8fdc9</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/33715/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/33715/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11699" title="lod_device_free()) ASSERTION( atomic_read(&amp;lu-&gt;ld_ref) == 0 ) failed: lu is ffff881a7e690000" class="issue-link" data-issue-key="LU-11699"><del>LU-11699</del></a> lfsck: Umount while running LFSCK<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 2d3d322546c14d7b35cfd3b160faa3e747a48315</p> <p>Landed for 2.13</p> Development Rank 1|i006tz: Rank (Obsolete) 9223372036854775807 Severity