https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-11814 Lustre <p>OSS crashes when multiple OSTs were going to be mounted in parallel.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>[208315.026819] Lustre: Skipped 1 previous similar message [208323.352453] LustreError: 12457:0:(osd_handler.c:7132:osd_device_init0()) ASSERTION( info ) failed: [208323.355270] LustreError: 12457:0:(osd_handler.c:7132:osd_device_init0()) LBUG [208323.355518] LDISKFS-fs (sdd): file extents enabled, maximum tree depth=5 [208323.357619] Pid: 12457, comm: mount.lustre 3.10.0-862.9.1.el7_lustre.ddn1.x86_64 #1 SMP Tue Sep 11 19:05:37 JST 2018 [208323.357620] Call Trace: [208323.357631] [&lt;ffffffffc042f7cc&gt;] libcfs_call_trace+0x8c/0xc0 [libcfs] [208323.357648] [&lt;ffffffffc042f87c&gt;] lbug_with_loc+0x4c/0xa0 [libcfs] [208323.357654] [&lt;ffffffffc10cc6d5&gt;] osd_device_alloc+0x615/0x770 [osd_ldiskfs] [208323.357671] [&lt;ffffffffc099ae2a&gt;] obd_setup+0x11a/0x2b0 [obdclass] [208323.357703] [&lt;ffffffffc099cc58&gt;] class_setup+0x2a8/0x840 [obdclass] [208323.357724] [&lt;ffffffffc09a08ed&gt;] class_process_config+0x196d/0x2420 [obdclass] [208323.357744] [&lt;ffffffffc09a45f8&gt;] do_lcfg+0x258/0x500 [obdclass] [208323.357763] [&lt;ffffffffc09a8e68&gt;] lustre_start_simple+0x88/0x210 [obdclass] [208323.357784] [&lt;ffffffffc09d59b4&gt;] server_fill_super+0xf34/0x185a [obdclass] [208323.357808] [&lt;ffffffffc09abfe8&gt;] lustre_fill_super+0x328/0x950 [obdclass] [208323.357841] [&lt;ffffffff9781f3bf&gt;] mount_nodev+0x4f/0xb0 [208323.357868] [&lt;ffffffffc09a4008&gt;] lustre_mount+0x38/0x60 [obdclass] [208323.357871] [&lt;ffffffff9781ff3e&gt;] mount_fs+0x3e/0x1b0 [208323.357873] [&lt;ffffffff9783d4c7&gt;] vfs_kern_mount+0x67/0x110 [208323.357876] [&lt;ffffffff9783faef&gt;] do_mount+0x1ef/0xce0 [208323.357878] [&lt;ffffffff97840923&gt;] SyS_mount+0x83/0xd0 [208323.357882] [&lt;ffffffff97d20795&gt;] system_call_fastpath+0x1c/0x21 [208323.357897] [&lt;ffffffffffffffff&gt;] 0xffffffffffffffff [208323.357899] Kernel panic - not syncing: LBUG [208323.357902] CPU: 14 PID: 12457 Comm: mount.lustre Kdump: loaded Tainted: G OE ------------ T 3.10.0-862.9.1.el7_lustre.ddn1.x86_64 #1 [208323.357903] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.11.0-0-g63451fca13-prebuilt.qemu-project.org 04/01/2014 [208323.357904] Call Trace: [208323.357909] [&lt;ffffffff97d0e84e&gt;] dump_stack+0x19/0x1b [208323.357911] [&lt;ffffffff97d08b50&gt;] panic+0xe8/0x21f [208323.357919] [&lt;ffffffffc042f8cb&gt;] lbug_with_loc+0x9b/0xa0 [libcfs] [208323.357929] [&lt;ffffffffc10cc6d5&gt;] osd_device_alloc+0x615/0x770 [osd_ldiskfs] [208323.357947] [&lt;ffffffffc099ae2a&gt;] obd_setup+0x11a/0x2b0 [obdclass] [208323.357964] [&lt;ffffffffc099cc58&gt;] class_setup+0x2a8/0x840 [obdclass] [208323.357983] [&lt;ffffffffc09a08ed&gt;] class_process_config+0x196d/0x2420 [obdclass] [208323.357989] [&lt;ffffffff979568d3&gt;] ? number.isra.2+0x323/0x360 [208323.358009] [&lt;ffffffffc09a45f8&gt;] do_lcfg+0x258/0x500 [obdclass] [208323.358027] [&lt;ffffffffc09a8e68&gt;] lustre_start_simple+0x88/0x210 [obdclass] [208323.358045] [&lt;ffffffffc09d59b4&gt;] server_fill_super+0xf34/0x185a [obdclass] [208323.358055] [&lt;ffffffffc043ad07&gt;] ? libcfs_debug_msg+0x57/0x80 [libcfs] [208323.358075] [&lt;ffffffffc09abfe8&gt;] lustre_fill_super+0x328/0x950 [obdclass] [208323.358092] [&lt;ffffffffc09abcc0&gt;] ? lustre_common_put_super+0x270/0x270 [obdclass] [208323.358095] [&lt;ffffffff9781f3bf&gt;] mount_nodev+0x4f/0xb0 [208323.358113] [&lt;ffffffffc09a4008&gt;] lustre_mount+0x38/0x60 [obdclass] [208323.358117] [&lt;ffffffff9781ff3e&gt;] mount_fs+0x3e/0x1b0 [208323.358119] [&lt;ffffffff9783d4c7&gt;] vfs_kern_mount+0x67/0x110 [208323.358122] [&lt;ffffffff9783faef&gt;] do_mount+0x1ef/0xce0 [208323.358125] [&lt;ffffffff977f7c2c&gt;] ? kmem_cache_alloc_trace+0x3c/0x200 [208323.358127] [&lt;ffffffff97840923&gt;] SyS_mount+0x83/0xd0 [208323.358131] [&lt;ffffffff97d20795&gt;] system_call_fastpath+0x1c/0x21 </pre> </div></div> <p>VVVVVVV DO NOT REMOVE LINES BELOW, Added by Maloo for auto-association VVVVVVV<br/> conf-sanity test_93 - trevis-17vm12 crashed during conf-sanity test_93</p> 2.10.5-ddn6 LU-11814

conf-sanity test_93 osd_handler.c:7132:osd_device_init0()) ASSERTION( info ) failed:

Bug Major Resolved Fixed Yang Sheng Shuichi Ihara Sun, 9 Dec 2018 10:39:54 +0000 Tue, 11 Aug 2020 14:12:10 +0000 Sat, 4 Jul 2020 03:05:08 +0000 Lustre 2.12.2 Lustre 2.14.0 0 13 <p>nope, this is different. this is OSS crashes when OSTs were mounted.</p> <p>+1 on master <a href="https://testing.whamcloud.com/test_sets/dcd260fe-039e-11e9-b837-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/dcd260fe-039e-11e9-b837-52540065bddc</a></p> <p>+4, 2 on master, 2 on b2_10:<br/> <a href="https://testing.whamcloud.com/test_sets/0baf5b7a-2974-11e9-a318-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/0baf5b7a-2974-11e9-a318-52540065bddc</a><br/> <a href="https://testing.whamcloud.com/test_sets/282ee652-286c-11e9-b97f-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/282ee652-286c-11e9-b97f-52540065bddc</a><br/> <a href="https://testing.whamcloud.com/test_sets/2051afde-1a91-11e9-a2cc-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/2051afde-1a91-11e9-a2cc-52540065bddc</a><br/> <a href="https://testing.whamcloud.com/test_sets/558839f6-2555-11e9-af90-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/558839f6-2555-11e9-af90-52540065bddc</a></p> <p>master <a href="https://testing.whamcloud.com/sub_tests/f4d79dee-4b4d-11e9-92fe-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/f4d79dee-4b4d-11e9-92fe-52540065bddc</a></p> <p>+1 on b2_12:<br/> <a href="https://testing.whamcloud.com/test_sets/748b6f5c-6f57-11e9-aeec-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/748b6f5c-6f57-11e9-aeec-52540065bddc</a></p> <p>another instance from master:</p> <p><a href="https://testing.whamcloud.com/test_sessions/10776e76-fc32-4c8c-9bf1-a4111f992278" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sessions/10776e76-fc32-4c8c-9bf1-a4111f992278</a></p> <p>+1 on b2_12 <a href="https://testing.whamcloud.com/test_sets/51e08d04-c56d-11e9-90ad-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/51e08d04-c56d-11e9-90ad-52540065bddc</a></p> <p>Hit on b2_12 <a href="https://testing.whamcloud.com/test_sets/46eb4e32-5011-11ea-8c2d-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/46eb4e32-5011-11ea-8c2d-52540065bddc</a></p> <p>Yang Sheng (ys@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/37974" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/37974</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11814" title="conf-sanity test_93 osd_handler.c:7132:osd_device_init0()) ASSERTION( info ) failed: " class="issue-link" data-issue-key="LU-11814"><del>LU-11814</del></a> obd: Crashed while mount in parallel<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: a318d65621afefd9897ffe202c7fcf44ea680f0a</p> <p><del>Yang Sheng (ys@whamcloud.com) uploaded a new patch:</del> <a href="https://review.whamcloud.com/37985" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/37985</a><br/> <del>Subject: <a href="https://jira.whamcloud.com/browse/LU-11814" title="conf-sanity test_93 osd_handler.c:7132:osd_device_init0()) ASSERTION( info ) failed: " class="issue-link" data-issue-key="LU-11814"><del>LU-11814</del></a> obd: Reproducer</del><br/> <del>Project: fs/lustre-release</del><br/> <del>Branch: master</del><br/> <del>Current Patch Set: 1</del><br/> <del>Commit: ad8bf03ad9329fadff6e10f4ed9c28143f2e529b</del></p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/37974/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/37974/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11814" title="conf-sanity test_93 osd_handler.c:7132:osd_device_init0()) ASSERTION( info ) failed: " class="issue-link" data-issue-key="LU-11814"><del>LU-11814</del></a> obd: Crashed while mount in parallel<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: e4fd618ff498814145002b2c3f56746b3d172e07</p> <p>Patch landed. Close ticket.</p> <p>it is still crashing:<br/> <a href="https://testing.whamcloud.com/test_sessions/0d88e2cc-285e-46d4-9cdb-19ee56b6010b" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sessions/0d88e2cc-285e-46d4-9cdb-19ee56b6010b</a></p> <p>crashed on the latest master</p> <p>reopening, please check that last crash reported</p> <p>Yang Sheng (ys@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/38416" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/38416</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11814" title="conf-sanity test_93 osd_handler.c:7132:osd_device_init0()) ASSERTION( info ) failed: " class="issue-link" data-issue-key="LU-11814"><del>LU-11814</del></a> obdcalss: ensure LCT_QUIESCENT take sync<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 88b5b58f32350e41d6d396678477b9360e1fd674</p> <p>+1 on master <a href="https://testing.whamcloud.com/test_sets/152e6895-3cfc-4994-8fee-230fb4c1087e" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/152e6895-3cfc-4994-8fee-230fb4c1087e</a></p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/38416/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/38416/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11814" title="conf-sanity test_93 osd_handler.c:7132:osd_device_init0()) ASSERTION( info ) failed: " class="issue-link" data-issue-key="LU-11814"><del>LU-11814</del></a> obdcalss: ensure LCT_QUIESCENT take sync<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 979f5e1db041dc49585b97c4915a6bc3e58435da</p> <p>Second patch landed. </p> Duplicate LU-13313 LU-8346 LU-12300 Related Development Rank 1|i007m7: Rank (Obsolete) 9223372036854775807 Severity