https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-2502 Lustre <p>This issue was created by maloo for liuying &lt;emoly.liu@intel.com&gt;</p> <p>This issue relates to the following test suite run: <a href="https://maloo.whamcloud.com/test_sets/71f17b88-4826-11e2-8cdc-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/71f17b88-4826-11e2-8cdc-52540035b04c</a>.</p> <p>The sub-test test_23a failed with the following error:</p> <blockquote><p>test failed to respond and timed out</p></blockquote> <p>Client-1 console log showed</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>23:05:49:Lustre: DEBUG MARKER: == ost-pools test 23a: OST pools and quota =========================================================== 23:05:40 (1355727940) 23:05:49:Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-*.pools.testpool 2&gt;/dev/null || echo foo 23:05:49:Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-*.pools.testpool | sort -u | tr '\n' ' ' 23:06:01:Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-*.pools.testpool | sort -u | tr '\n' ' ' 23:06:01:LustreError: 19086:0:(quota_ctl.c:328:client_quota_ctl()) ptlrpc_queue_wait failed, rc: -114 23:06:01:LustreError: 19087:0:(lmv_obd.c:855:lmv_iocontrol()) error: iocontrol MDC lustre-MDT0000_UUID on MDTidx 0 cmd 800866a1: err = -22 23:06:01:LustreError: 19087:0:(lmv_obd.c:855:lmv_iocontrol()) error: iocontrol MDC lustre-MDT0000_UUID on MDTidx 0 cmd 800866a1: err = -22 23:06:12:LustreError: 19087:0:(lmv_obd.c:855:lmv_iocontrol()) error: iocontrol MDC lustre-MDT0000_UUID on MDTidx 0 cmd 800866a1: err = -22 ... </pre> </div></div> <p>MDS dmesg log showed</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Lustre: DEBUG MARKER: == ost-pools test 23a: OST pools and quota =========================================================== 23:05:40 (1355727940) Lustre: DEBUG MARKER: lctl pool_new lustre.testpool Lustre: DEBUG MARKER: lctl pool_add lustre.testpool lustre-OST[0000-0006/3] Lustre: 4861:0:(quota_master.c:793:close_quota_files()) quota[0] is off already Lustre: 4861:0:(quota_master.c:793:close_quota_files()) Skipped 1 previous similar message LustreError: 12634:0:(fsfilt-ldiskfs.c:2181:fsfilt_ldiskfs_quotacheck()) quotacheck failed: rc = -22 LustreError: 12634:0:(quota_check.c:112:target_quotacheck_thread()) mdd_obd-lustre-MDT0000: fsfilt_quotacheck: -22 </pre> </div></div> LU-2502

Test failure on test suite ost-pools, subtest test_23a

Bug Critical Resolved Won't Fix Niu Yawei Maloo quota test yuc2 Mon, 17 Dec 2012 08:02:27 +0000 Fri, 18 Nov 2016 04:24:35 +0000 Fri, 18 Nov 2016 04:24:35 +0000 Lustre 2.4.0 Lustre 2.1.4 Lustre 2.4.1 0 9 <p>Was this interop tests or pure 2.1 testing?</p> <p>cc Emoly.</p> <p>Johann</p> <p>I believe that this issue hit on a review run for this patch to b2_1 <a href="http://review.whamcloud.com/#change,4831" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,4831</a></p> <p>Peter</p> <p>maybe it's caused by some changes in the new kernel? (2.6.32-279.14.1.el6_lustre.g9963a82.x86_64)</p> <p>Searching the historical reports on Maloo showed that this issue did not occur on b2_1 branch before, neither on 2.1.4 RC1:<br/> <a href="http://tinyurl.com/cjevqxt" class="external-link" target="_blank" rel="nofollow noopener">http://tinyurl.com/cjevqxt</a></p> <blockquote> <p>Searching the historical reports on Maloo showed that this issue did not occur on b2_1 branch before, neither on 2.1.4 RC1:<br/> <a href="http://tinyurl.com/cjevqxt" class="external-link" target="_blank" rel="nofollow noopener">http://tinyurl.com/cjevqxt</a></p></blockquote> <p>Yes, then it seems not a new kenrel issue (there were some tests with new kernel passed).</p> <p>Looks it was not reproduced in b2_1 tests anymore.</p> <p>can't be reproduced.</p> <p>I think the following error found in interop between 2.1.4 server and 2.4 client is the same one, so reopen it.</p> <p><a href="https://maloo.whamcloud.com/test_sets/3539abfa-7d84-11e2-85d0-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/3539abfa-7d84-11e2-85d0-52540035b04c</a></p> <p>MDS console shows:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>10:46:09:Lustre: DEBUG MARKER: == ost-pools test 23a: OST pools and quota == 10:46:09 (1361558769) 10:46:09:Lustre: DEBUG MARKER: lctl pool_new lustre.testpool 10:46:20:Lustre: DEBUG MARKER: lctl pool_add lustre.testpool lustre-OST[0000-0006/3] 10:46:31:Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n version 10:46:31:Lustre: 3818:0:(quota_master.c:795:close_quota_files()) quota[0] is off already 10:46:31:Lustre: 3818:0:(quota_master.c:795:close_quota_files()) quota[1] is off already 10:46:31:LustreError: 13718:0:(fsfilt-ldiskfs.c:2181:fsfilt_ldiskfs_quotacheck()) quotacheck failed: rc = -22 10:46:31:LustreError: 13718:0:(quota_check.c:114:target_quotacheck_thread()) mdd_obd-lustre-MDT0000: fsfilt_quotacheck: -22 </pre> </div></div> <p>Hi, Sarah, is it reproducable? Could you try to catch the log on MDS with D_TRACE enabled? So we can see how fsfilt_ldiskfs_quotacheck() failed with -22. Thank you.</p> <p>ok, will let you know when I get the results.</p> <p>I reran the test 3 times and cannot reproduce it with server is running 2.1.5 and client is running 2.4</p> <p>Lustre client: <a href="http://build.whamcloud.com/job/lustre-b2_4/45/" class="external-link" target="_blank" rel="nofollow noopener">http://build.whamcloud.com/job/lustre-b2_4/45/</a> (2.4.1 RC2)<br/> Lustre server: <a href="http://build.whamcloud.com/job/lustre-b2_1/215/" class="external-link" target="_blank" rel="nofollow noopener">http://build.whamcloud.com/job/lustre-b2_1/215/</a> (2.1.6)</p> <p>ost-pools test 23a hit the same failure:<br/> <a href="https://maloo.whamcloud.com/test_sets/2f0438ae-1abe-11e3-bf23-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/2f0438ae-1abe-11e3-bf23-52540035b04c</a></p> <p>Another failure instance on master:<br/> <a href="https://testing.hpdd.intel.com/test_sets/314d4b36-d288-11e4-a0e2-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/314d4b36-d288-11e4-a0e2-5254006e85c2</a></p> <p>This was an interop issue between 2.1 client with 2.4 servers. I think it's not relevant anymore. The last instance on master reported by nasf is a different issue.</p> Development Rank 1|hzvdxb: Rank (Obsolete) 5864 Severity