https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-1942 Lustre <p>This issue was created by maloo for sarah &lt;sarah@whamcloud.com&gt;</p> <p>This issue relates to the following test suite run: <a href="https://maloo.whamcloud.com/test_sets/6274e3b4-fe45-11e1-a707-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/6274e3b4-fe45-11e1-a707-52540035b04c</a>.</p> <p>The sub-test test_fsx failed with the following error:</p> <blockquote> <p>test failed to respond and timed out</p></blockquote> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre> fsx S 0000000000000000 0 29817 29664 0x00000080 ffff8800371ab8c8 0000000000000086 ffff8800371ab938 ffffffffa0977b76 ffff8800371ab8a8 0000000000000001 ffff8800371ab888 ffffffff81039678 ffff880077cc45f8 ffff8800371abfd8 000000000000fb88 ffff880077cc45f8 Call Trace: [&lt;ffffffffa0977b76&gt;] ? __osc_extent_remove+0xa6/0x440 [osc] [&lt;ffffffff81039678&gt;] ? pvclock_clocksource_read+0x58/0xd0 [&lt;ffffffffa043677e&gt;] cfs_waitq_wait+0xe/0x10 [libcfs] [&lt;ffffffffa098013f&gt;] osc_extent_wait+0xef/0x2a0 [osc] [&lt;ffffffff81060250&gt;] ? default_wake_function+0x0/0x20 [&lt;ffffffffa0982987&gt;] osc_cache_truncate_start+0x1cf7/0x20b0 [osc] [&lt;ffffffffa0436be0&gt;] ? cfs_alloc+0x30/0x60 [libcfs] [&lt;ffffffffa07a301f&gt;] ? null_alloc_reqbuf+0x1cf/0x440 [ptlrpc] [&lt;ffffffffa0788727&gt;] ? ptlrpcd_add_req+0x187/0x2e0 [ptlrpc] [&lt;ffffffffa074e88c&gt;] ? ptlrpc_request_bufs_pack+0x5c/0x80 [ptlrpc] [&lt;ffffffffa0764f30&gt;] ? lustre_swab_ost_body+0x0/0x10 [ptlrpc] [&lt;ffffffffa0971dc4&gt;] osc_io_setattr_start+0x294/0x4c0 [osc] [&lt;ffffffffa061a230&gt;] ? cl_io_start+0x0/0x140 [obdclass] [&lt;ffffffffa061a29a&gt;] cl_io_start+0x6a/0x140 [obdclass] [&lt;ffffffffa0a0076e&gt;] lov_io_call+0x8e/0x130 [lov] [&lt;ffffffffa0a03a5c&gt;] lov_io_start+0x10c/0x190 [lov] [&lt;ffffffffa061a29a&gt;] cl_io_start+0x6a/0x140 [obdclass] [&lt;ffffffffa061ebb4&gt;] cl_io_loop+0xb4/0x1b0 [obdclass] [&lt;ffffffffa0abfa18&gt;] cl_setattr_ost+0x208/0x2d0 [lustre] [&lt;ffffffffa0a8edc2&gt;] ll_setattr_raw+0x752/0xfd0 [lustre] [&lt;ffffffffa0a8f69b&gt;] ll_setattr+0x5b/0xf0 [lustre] [&lt;ffffffff81197368&gt;] notify_change+0x168/0x340 [&lt;ffffffff811799a4&gt;] do_truncate+0x64/0xa0 [&lt;ffffffff81179c70&gt;] sys_ftruncate+0xf0/0x100 [&lt;ffffffff8100b0f2&gt;] system_call_fastpath+0x16/0x1b </pre> </div></div> server: 2.1.3 RHEL6<br/> client: 2.3 tag-2.2.95 RHEL6 LU-1942

2.1.3<->2.3 Test failure on test suite sanity-benchmark, subtest test_fsx

Bug Major Resolved Cannot Reproduce Jinshan Xiong Maloo Fri, 14 Sep 2012 17:43:31 +0000 Mon, 17 Apr 2017 21:27:09 +0000 Mon, 17 Apr 2017 21:27:09 +0000 Lustre 2.4.0 0 5 <p>it's likely I think this quite often:</p> <p>PID: 5716 TASK: ffff8800550a31c0 CPU: 0 COMMAND: "dbench"<br/> #0 <span class="error">&#91;ffff88004b62d4e8&#93;</span> schedule at ffffffff813d31c0<br/> #1 <span class="error">&#91;ffff88004b62d650&#93;</span> cfs_waitq_wait at ffffffffa01e1619 <span class="error">&#91;libcfs&#93;</span><br/> #2 <span class="error">&#91;ffff88004b62d660&#93;</span> osc_enter_cache at ffffffffa00f3447 <span class="error">&#91;osc&#93;</span><br/> #3 <span class="error">&#91;ffff88004b62d790&#93;</span> osc_queue_async_io at ffffffffa00ec85a <span class="error">&#91;osc&#93;</span><br/> #4 <span class="error">&#91;ffff88004b62d900&#93;</span> osc_page_cache_add at ffffffffa00d8bad <span class="error">&#91;osc&#93;</span><br/> #5 <span class="error">&#91;ffff88004b62d940&#93;</span> cl_page_cache_add at ffffffffa037e956 <span class="error">&#91;obdclass&#93;</span><br/> #6 <span class="error">&#91;ffff88004b62d990&#93;</span> lov_page_cache_add at ffffffffa017020d <span class="error">&#91;lov&#93;</span><br/> #7 <span class="error">&#91;ffff88004b62d9c0&#93;</span> cl_page_cache_add at ffffffffa037e956 <span class="error">&#91;obdclass&#93;</span><br/> #8 <span class="error">&#91;ffff88004b62da10&#93;</span> vvp_io_commit_write at ffffffffa0a6baf9 <span class="error">&#91;lustre&#93;</span><br/> #9 <span class="error">&#91;ffff88004b62da80&#93;</span> cl_io_commit_write at ffffffffa038e7f5 <span class="error">&#91;obdclass&#93;</span><br/> #10 <span class="error">&#91;ffff88004b62dad0&#93;</span> ll_commit_write at ffffffffa0a3f0a8 <span class="error">&#91;lustre&#93;</span><br/> #11 <span class="error">&#91;ffff88004b62db30&#93;</span> ll_write_end at ffffffffa0a57e78 <span class="error">&#91;lustre&#93;</span><br/> #12 <span class="error">&#91;ffff88004b62db60&#93;</span> generic_file_buffered_write at ffffffff8108bd58<br/> #13 <span class="error">&#91;ffff88004b62dc40&#93;</span> __generic_file_aio_write at ffffffff8108c25a<br/> #14 <span class="error">&#91;ffff88004b62dcf0&#93;</span> generic_file_aio_write at ffffffff8108c4d7<br/> #15 <span class="error">&#91;ffff88004b62dd30&#93;</span> vvp_io_write_start at ffffffffa0a6d394 <span class="error">&#91;lustre&#93;</span><br/> #16 <span class="error">&#91;ffff88004b62dd70&#93;</span> cl_io_start at ffffffffa038aafd <span class="error">&#91;obdclass&#93;</span><br/> #17 <span class="error">&#91;ffff88004b62dda0&#93;</span> cl_io_loop at ffffffffa038f275 <span class="error">&#91;obdclass&#93;</span><br/> #18 <span class="error">&#91;ffff88004b62ddd0&#93;</span> ll_file_io_generic at ffffffffa0a17fce <span class="error">&#91;lustre&#93;</span><br/> #19 <span class="error">&#91;ffff88004b62de40&#93;</span> ll_file_aio_write at ffffffffa0a183ca <span class="error">&#91;lustre&#93;</span><br/> #20 <span class="error">&#91;ffff88004b62de90&#93;</span> ll_file_write at ffffffffa0a185f5 <span class="error">&#91;lustre&#93;</span><br/> #21 <span class="error">&#91;ffff88004b62def0&#93;</span> vfs_write at ffffffff810be79c</p> <p>please, have a look.</p> <p>this time with fsx:</p> <p>PID: 12878 TASK: ffff880051d7a8c0 CPU: 3 COMMAND: "fsx"<br/> #0 <span class="error">&#91;ffff8800296cf7c8&#93;</span> schedule at ffffffff813d31c0<br/> #1 <span class="error">&#91;ffff8800296cf930&#93;</span> cfs_waitq_wait at ffffffffa0af0619 <span class="error">&#91;libcfs&#93;</span><br/> #2 <span class="error">&#91;ffff8800296cf940&#93;</span> osc_extent_wait at ffffffffa012f2b9 <span class="error">&#91;osc&#93;</span><br/> #3 <span class="error">&#91;ffff8800296cf9b0&#93;</span> osc_cache_truncate_start at ffffffffa0135f5e <span class="error">&#91;osc&#93;</span><br/> #4 <span class="error">&#91;ffff8800296cfb90&#93;</span> osc_io_setattr_start at ffffffffa01241af <span class="error">&#91;osc&#93;</span><br/> #5 <span class="error">&#91;ffff8800296cfc80&#93;</span> cl_io_start at ffffffffa0bcfafd <span class="error">&#91;obdclass&#93;</span><br/> #6 <span class="error">&#91;ffff8800296cfcb0&#93;</span> lov_io_call.isra.10 at ffffffffa01bbbf1 <span class="error">&#91;lov&#93;</span><br/> #7 <span class="error">&#91;ffff8800296cfce0&#93;</span> lov_io_start at ffffffffa01bbdaa <span class="error">&#91;lov&#93;</span><br/> #8 <span class="error">&#91;ffff8800296cfd00&#93;</span> cl_io_start at ffffffffa0bcfafd <span class="error">&#91;obdclass&#93;</span><br/> #9 <span class="error">&#91;ffff8800296cfd30&#93;</span> cl_io_loop at ffffffffa0bd4275 <span class="error">&#91;obdclass&#93;</span><br/> #10 <span class="error">&#91;ffff8800296cfd60&#93;</span> cl_setattr_ost at ffffffffa080ee20 <span class="error">&#91;lustre&#93;</span><br/> #11 <span class="error">&#91;ffff8800296cfdc0&#93;</span> ll_setattr_raw at ffffffffa07e3891 <span class="error">&#91;lustre&#93;</span><br/> #12 <span class="error">&#91;ffff8800296cfe40&#93;</span> ll_setattr at ffffffffa07e3dc4 <span class="error">&#91;lustre&#93;</span><br/> #13 <span class="error">&#91;ffff8800296cfe50&#93;</span> notify_change at ffffffff810d5f47<br/> #14 <span class="error">&#91;ffff8800296cfec0&#93;</span> do_truncate at ffffffff810bd040<br/> #15 <span class="error">&#91;ffff8800296cff40&#93;</span> sys_ftruncate at ffffffff810bd345</p> <p>This looks similar to <a href="https://jira.whamcloud.com/browse/LU-2286" title="Test failure on test suite parallel-scale, subtest test_write_append_truncate" class="issue-link" data-issue-key="LU-2286"><del>LU-2286</del></a>, at least part of it <img class="emoticon" src="https://jira.whamcloud.com/images/icons/emoticons/wink.png" height="16" width="16" align="absmiddle" alt="" border="0"/></p> <p>The issue mentioned at 26/Oct/12 3:43 AM should be a different one. It looks very like that the grant was running out. The other two occurrences are the duplicate of <a href="https://jira.whamcloud.com/browse/LU-2286" title="Test failure on test suite parallel-scale, subtest test_write_append_truncate" class="issue-link" data-issue-key="LU-2286"><del>LU-2286</del></a>.</p> <p>It's lack of information, so I can't do anything else except waiting.</p> <p>I'd like to suggest to lower the priority of the bug.</p> <p>Reducing priority on this bug. There is only a single bug triaged as <a href="https://jira.whamcloud.com/browse/LU-1942" title="2.1.3&lt;-&gt;2.3 Test failure on test suite sanity-benchmark, subtest test_fsx" class="issue-link" data-issue-key="LU-1942"><del>LU-1942</del></a>, and all of the recent test runs for sanity-benchmark.sh have passed. However, while there are several 2.2/master interop tests in the past few weeks, none of them are 2.1/master interop tests, so the bug may still be present.</p> <p>Close old issue.</p> Related LU-2246 Development Rank 1|hzvavz: Rank (Obsolete) 5300 Severity