https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-1259 Lustre <p>This issue was created by maloo for sarah &lt;sarah@whamcloud.com&gt;</p> <p>This issue relates to the following test suite run: <a href="https://maloo.whamcloud.com/test_sets/0908f616-76c9-11e1-ae2e-5254004bbbd3" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/0908f616-76c9-11e1-ae2e-5254004bbbd3</a>.</p> <p>The sub-test test_41a failed with the following error:</p> <blockquote> <p>test failed to respond and timed out</p></blockquote> <p>03:07:11:Lustre: DEBUG MARKER: == conf-sanity test 41a: mount mds with --nosvc and --nomgs ========================================== 03:07:01 (1332670021)<br/> 03:07:11:LDISKFS-fs (dm-0): warning: maximal mount count reached, running e2fsck is recommended<br/> 03:07:11:LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: <br/> 03:07:11:LDISKFS-fs (dm-0): warning: maximal mount count reached, running e2fsck is recommended<br/> 03:07:11:LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: <br/> 03:07:11:LustreError: 166-1: MGC10.10.4.72@tcp: Connection to service MGS via nid 0@lo was lost; in progress operations using this service will fail.<br/> 03:07:11:Lustre: 3481:0:(ldlm_lib.c:633:target_handle_reconnect()) MGS: a1661115-9b9b-aae9-6c6f-3eb85b686ad4 reconnecting<br/> 03:07:11:LustreError: 3481:0:(obd_class.h:521:obd_set_info_async()) obd_set_info_async: dev 0 no operation<br/> 03:07:11:LustreError: 3484:0:(ldlm_lock.c:726:ldlm_lock_decref_internal_nolock()) ASSERTION( lock-&gt;l_writers &gt; 0 ) failed: <br/> 03:07:11:LustreError: 3484:0:(ldlm_lock.c:726:ldlm_lock_decref_internal_nolock()) LBUG<br/> 03:07:12:Pid: 3484, comm: mgs_lustre_noti<br/> 03:07:12:<br/> 03:07:12:Call Trace:<br/> 03:07:12: <span class="error">&#91;&lt;ffffffffa043a835&gt;&#93;</span> libcfs_debug_dumpstack+0x55/0x80 <span class="error">&#91;libcfs&#93;</span><br/> 03:07:12: <span class="error">&#91;&lt;ffffffffa043ad67&gt;&#93;</span> lbug_with_loc+0x47/0xb0 <span class="error">&#91;libcfs&#93;</span><br/> 03:07:12: <span class="error">&#91;&lt;ffffffffa0687a75&gt;&#93;</span> ldlm_lock_decref_internal_nolock+0x115/0x120 <span class="error">&#91;ptlrpc&#93;</span><br/> 03:07:12: <span class="error">&#91;&lt;ffffffffa068b370&gt;&#93;</span> ldlm_lock_decref_internal+0x60/0x700 <span class="error">&#91;ptlrpc&#93;</span><br/> 03:07:12: <span class="error">&#91;&lt;ffffffffa068c21d&gt;&#93;</span> ldlm_lock_decref_and_cancel+0x7d/0x120 <span class="error">&#91;ptlrpc&#93;</span><br/> 03:07:12: <span class="error">&#91;&lt;ffffffffa0aad49b&gt;&#93;</span> mgs_completion_ast_ir+0xfb/0x110 <span class="error">&#91;mgs&#93;</span><br/> 03:07:12: <span class="error">&#91;&lt;ffffffffa06a3540&gt;&#93;</span> ldlm_cli_enqueue_local+0x1f0/0x4d0 <span class="error">&#91;ptlrpc&#93;</span><br/> 03:07:12: <span class="error">&#91;&lt;ffffffffa0aad3a0&gt;&#93;</span> ? mgs_completion_ast_ir+0x0/0x110 <span class="error">&#91;mgs&#93;</span><br/> 03:07:12: <span class="error">&#91;&lt;ffffffffa06a2670&gt;&#93;</span> ? ldlm_blocking_ast+0x0/0x130 <span class="error">&#91;ptlrpc&#93;</span><br/> 03:07:12: <span class="error">&#91;&lt;ffffffffa0aad2ac&gt;&#93;</span> mgs_revoke_lock+0x13c/0x230 <span class="error">&#91;mgs&#93;</span><br/> 03:07:12: <span class="error">&#91;&lt;ffffffffa06a2670&gt;&#93;</span> ? ldlm_blocking_ast+0x0/0x130 <span class="error">&#91;ptlrpc&#93;</span><br/> 03:07:12: <span class="error">&#91;&lt;ffffffffa0aad3a0&gt;&#93;</span> ? mgs_completion_ast_ir+0x0/0x110 <span class="error">&#91;mgs&#93;</span><br/> 03:07:12: <span class="error">&#91;&lt;ffffffffa04444f1&gt;&#93;</span> ? libcfs_debug_msg+0x41/0x50 <span class="error">&#91;libcfs&#93;</span><br/> 03:07:12: <span class="error">&#91;&lt;ffffffffa0ac348c&gt;&#93;</span> mgs_ir_notify+0x11c/0x230 <span class="error">&#91;mgs&#93;</span><br/> 03:07:12: <span class="error">&#91;&lt;ffffffff8105e7f0&gt;&#93;</span> ? default_wake_function+0x0/0x20<br/> 03:07:13: <span class="error">&#91;&lt;ffffffffa0ac3370&gt;&#93;</span> ? mgs_ir_notify+0x0/0x230 <span class="error">&#91;mgs&#93;</span><br/> 03:07:13: <span class="error">&#91;&lt;ffffffff8100c14a&gt;&#93;</span> child_rip+0xa/0x20<br/> 03:07:13: <span class="error">&#91;&lt;ffffffffa0ac3370&gt;&#93;</span> ? mgs_ir_notify+0x0/0x230 <span class="error">&#91;mgs&#93;</span><br/> 03:07:13: <span class="error">&#91;&lt;ffffffffa0ac3370&gt;&#93;</span> ? mgs_ir_notify+0x0/0x230 <span class="error">&#91;mgs&#93;</span><br/> 03:07:13: <span class="error">&#91;&lt;ffffffff8100c140&gt;&#93;</span> ? child_rip+0x0/0x20<br/> 03:07:13:<br/> 03:07:13:Kernel panic - not syncing: LBUG</p> LU-1259

Test failure on test suite conf-sanity, subtest test_41a

Bug Minor Resolved Fixed Jinshan Xiong Maloo Tue, 27 Mar 2012 01:02:35 +0000 Thu, 27 Sep 2012 17:39:34 +0000 Thu, 27 Sep 2012 17:39:34 +0000 Lustre 2.3.0 0 4 <p>patch is at: <a href="http://review.whamcloud.com/#change,2390" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,2390</a></p> <p><a href="https://maloo.whamcloud.com/test_logs/5ed51f1e-f934-11e1-b9a7-52540035b04c/show_text" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_logs/5ed51f1e-f934-11e1-b9a7-52540035b04c/show_text</a><br/> <a href="https://maloo.whamcloud.com/sub_tests/58136d70-f934-11e1-b9a7-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/sub_tests/58136d70-f934-11e1-b9a7-52540035b04c</a></p> <p>07:46:44:Lustre: DEBUG MARKER: == conf-sanity test 41b: mount mds with --nosvc and --nomgs on first mount =========================== 07:46:24 (1347029184)<br/> 07:46:45:Lustre: DEBUG MARKER: grep -c /mnt/mds1' ' /proc/mounts<br/> 07:46:45:Lustre: DEBUG MARKER: lsmod | grep lnet &gt; /dev/null &amp;&amp; lctl dl | grep ' ST '<br/> 07:46:56:Lustre: DEBUG MARKER: grep -c /mnt/mds1' ' /proc/mounts<br/> 07:46:56:Lustre: DEBUG MARKER: lsmod | grep lnet &gt; /dev/null &amp;&amp; lctl dl | grep ' ST '<br/> 07:47:08:Lustre: DEBUG MARKER: grep -c /mnt/mds1' ' /proc/mounts<br/> 07:47:08:Lustre: DEBUG MARKER: lsmod | grep lnet &gt; /dev/null &amp;&amp; lctl dl | grep ' ST '<br/> 07:47:08:Lustre: DEBUG MARKER: /usr/sbin/mkfs.lustre --mgs --mdt --fsname=lustre --mountfsoptions=errors=remount-ro,iopen_nopriv,user_xattr,acl --param sys.timeout=20 --device-size=2097152 --mkfsoptions="-E lazy_itable_init" --backfstype ldiskfs --reformat /dev/lvm-MDS/P1<br/> 07:47:08:LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: <br/> 07:47:30:Lustre: DEBUG MARKER: mkdir -p /mnt/mds1<br/> 07:47:30:Lustre: DEBUG MARKER: mkdir -p /mnt/mds1; mount -t lustre -o user_xattr,acl -o nosvc -n /dev/lvm-MDS/P1 /mnt/mds1<br/> 07:47:30:LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: <br/> 07:47:30:LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: <br/> 07:47:30:Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests//usr/lib64/lustre/tests:/usr/lib64/lustre/tests:/usr/lib64/lustre/tests/../utils:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lust<br/> 07:47:30:Lustre: DEBUG MARKER: e2label /dev/lvm-MDS/P1<br/> 07:47:30:Lustre: MGS: Regenerating lustre-OSTffff log by user request.<br/> 07:47:30:Lustre: Skipped 1 previous similar message<br/> 07:47:30:Lustre: DEBUG MARKER: mkdir -p /mnt/mds1<br/> 07:47:41:Lustre: 27767:0:(mgc_request.c:1518:mgc_process_recover_log()) Process recover log lustre-mdtir error -22<br/> 07:47:41:Lustre: 27767:0:(mgc_request.c:1518:mgc_process_recover_log()) Skipped 7 previous similar messages<br/> 07:47:41:Lustre: DEBUG MARKER: mkdir -p /mnt/mds1; mount -t lustre -o user_xattr,acl -o nomgs,force /dev/lvm-MDS/P1 /mnt/mds1<br/> 07:47:42:LustreError: 166-1: MGC10.10.4.186@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail<br/> 07:47:42:Lustre: MGS: Client 922ea2e1-d90d-e20d-a899-485cc5ff5d21 (at 0@lo) reconnecting<br/> 07:47:42:LustreError: 27764:0:(obd_class.h:525:obd_set_info_async()) obd_set_info_async: dev 0 no operation<br/> 07:47:42:LustreError: 27765:0:(ldlm_lock.c:833:ldlm_lock_decref_and_cancel()) ASSERTION( lock != ((void *)0) ) failed: <br/> 07:47:42:LustreError: 27765:0:(ldlm_lock.c:833:ldlm_lock_decref_and_cancel()) LBUG<br/> 07:47:42:Pid: 27765, comm: ll_mgs_02<br/> 07:47:42:<br/> 07:47:42:Call Trace:<br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa043a905&gt;&#93;</span> libcfs_debug_dumpstack+0x55/0x80 <span class="error">&#91;libcfs&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa043af17&gt;&#93;</span> lbug_with_loc+0x47/0xb0 <span class="error">&#91;libcfs&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa06cb0dc&gt;&#93;</span> ldlm_lock_decref_and_cancel+0x14c/0x150 <span class="error">&#91;ptlrpc&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa0ad9685&gt;&#93;</span> mgs_completion_ast_config+0x135/0x140 <span class="error">&#91;mgs&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa06e64a6&gt;&#93;</span> ldlm_cli_enqueue_local+0x1e6/0x560 <span class="error">&#91;ptlrpc&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa0ad9550&gt;&#93;</span> ? mgs_completion_ast_config+0x0/0x140 <span class="error">&#91;mgs&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa06e5480&gt;&#93;</span> ? ldlm_blocking_ast+0x0/0x180 <span class="error">&#91;ptlrpc&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa0ad85bf&gt;&#93;</span> mgs_revoke_lock+0x12f/0x290 <span class="error">&#91;mgs&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa06e5480&gt;&#93;</span> ? ldlm_blocking_ast+0x0/0x180 <span class="error">&#91;ptlrpc&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa0ad9550&gt;&#93;</span> ? mgs_completion_ast_config+0x0/0x140 <span class="error">&#91;mgs&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa0ad8e64&gt;&#93;</span> mgs_handle_target_reg+0x744/0xcc0 <span class="error">&#91;mgs&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa0adbe16&gt;&#93;</span> mgs_handle+0xa16/0x1190 <span class="error">&#91;mgs&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa044a241&gt;&#93;</span> ? libcfs_debug_msg+0x41/0x50 <span class="error">&#91;libcfs&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa071d782&gt;&#93;</span> ptlrpc_server_handle_request+0x412/0xeb0 <span class="error">&#91;ptlrpc&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa043b65e&gt;&#93;</span> ? cfs_timer_arm+0xe/0x10 <span class="error">&#91;libcfs&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa044bd9f&gt;&#93;</span> ? lc_watchdog_touch+0x6f/0x180 <span class="error">&#91;libcfs&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa07165e2&gt;&#93;</span> ? ptlrpc_wait_event+0xb2/0x2c0 <span class="error">&#91;ptlrpc&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffff8105ea30&gt;&#93;</span> ? default_wake_function+0x0/0x20<br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa071e9f7&gt;&#93;</span> ptlrpc_main+0x7d7/0x1610 <span class="error">&#91;ptlrpc&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa071e220&gt;&#93;</span> ? ptlrpc_main+0x0/0x1610 <span class="error">&#91;ptlrpc&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffff8100c14a&gt;&#93;</span> child_rip+0xa/0x20<br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa071e220&gt;&#93;</span> ? ptlrpc_main+0x0/0x1610 <span class="error">&#91;ptlrpc&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffffa071e220&gt;&#93;</span> ? ptlrpc_main+0x0/0x1610 <span class="error">&#91;ptlrpc&#93;</span><br/> 07:47:42: <span class="error">&#91;&lt;ffffffff8100c140&gt;&#93;</span> ? child_rip+0x0/0x20</p> <p>Seems different problem? or same?</p> <p>Please reopen ticket if additional work is needed.</p> Development Rank 1|hzv3yn: Rank (Obsolete) 4170 Severity