https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-13753 Lustre <p>This issue was created by maloo for liuying &lt;emoly.liu@intel.com&gt;</p> <p>This issue relates to the following test suite run: <a href="https://testing.whamcloud.com/test_sets/abe98c66-5293-41c4-a72b-c317b11bb2e2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/abe98c66-5293-41c4-a72b-c317b11bb2e2</a></p> <p>test_51b failed with the following error:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>== sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ================ 12:39:07 (1594039147) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00191303 s, 535 kB/s fail_loc=0x1404 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 1.74443 s, 601 kB/s 1024 sanityn test_51b: @@@@@@ FAIL: file size is 1024, should be 3145728 </pre> </div></div> <p>VVVVVVV DO NOT REMOVE LINES BELOW, Added by Maloo for auto-association VVVVVVV<br/> sanityn test_51b - file size is 1024, should be 3145728</p> LU-13753

sanityn test_51b: 'file size is 1024, should be 3145728'

Bug Minor Resolved Fixed Qian Yingjin Maloo Tue, 7 Jul 2020 01:14:25 +0000 Wed, 13 Sep 2023 17:01:27 +0000 Thu, 27 Aug 2020 23:59:47 +0000 Lustre 2.14.0 0 9 <p>+1 on master: <a href="https://testing.whamcloud.com/test_sessions/23b5849c-c8b2-4516-883c-5198009482b8" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sessions/23b5849c-c8b2-4516-883c-5198009482b8</a></p> <p>+1 on master <a href="https://testing.whamcloud.com/test_sets/fe7f9404-be7c-43d7-8915-6a9db3002a43" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/fe7f9404-be7c-43d7-8915-6a9db3002a43</a></p> <p>It looks like the majority of sanityn test 51b failures is for DNE/ZFS testing and started on 28 MAY 2020, but we do have some failures that are ZFS with no DNE like <a href="https://testing.whamcloud.com/test_sets/7e857919-f4e3-49fc-abda-4d67275bf425" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/7e857919-f4e3-49fc-abda-4d67275bf425</a>. </p> <p>This test is failing ~20% of the time in autotest patch/review testing.</p> <p>The early failures were attributed to ticket <a href="https://jira.whamcloud.com/browse/LU-10934" title="integrate statx() API with Lustre" class="issue-link" data-issue-key="LU-10934"><del>LU-10934</del></a>.</p> <p><a href="https://jira.whamcloud.com/secure/ViewProfile.jspa?name=qian_wc" class="user-hover" rel="qian_wc">qian_wc</a> This test was modified by <a href="https://review.whamcloud.com/36674" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36674</a> <a href="https://jira.whamcloud.com/browse/LU-10934" title="integrate statx() API with Lustre" class="issue-link" data-issue-key="LU-10934"><del>LU-10934</del></a> llite: integrate statx() API with Lustre. Could you revert the changes to the test and ensure that it passes consistently. In general we should not rewrite tests in this way. It makes it difficult to analyze test results over time. Instead please add a new test based on the old test. Once the test issues are addressed please ensure that the new test passes consistently.</p> <p>James Nunez (jnunez@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/39533" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/39533</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-13753" title="sanityn test_51b: &#39;file size is 1024, should be 3145728&#39; " class="issue-link" data-issue-key="LU-13753"><del>LU-13753</del></a> tests: stop running sanityn 51b for ZFS<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 0858686a91606ac6be812d6ed18c0fb302337959</p> <p>The patch <a href="https://review.whamcloud.com/39533" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/39533</a> is not a fix, but should be used if we can't find a fix for this test in a timely manner.</p> <p>Hi John,</p> <p>The reason I changed the test_51b is because that it can not pass the test <a href="https://review.whamcloud.com/36674" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36674</a> <a href="https://jira.whamcloud.com/browse/LU-10934" title="integrate statx() API with Lustre" class="issue-link" data-issue-key="LU-10934"><del>LU-10934</del></a> llite: integrate statx() API with Lustre.</p> <p>In the above patch, it avoids some unnecessary glimpse lock calls for files without any stripe (i.e. MCREATE an empty file). For this kinds of files, the size returned from MDT is strictly correct, no need RPCs to Lustre OSTs to obtain the file size.</p> <p>I tested it with ZFS backend locally, it passed:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> [root@qian tests]# FSTYPE=zfs ONLY=<span class="code-quote">"51b"</span> REFORMAT=<span class="code-quote">"yes"</span> sh sanityn.sh qian: executing check_logdir /tmp/test_logs/1597136195 Logging to shared log directory: /tmp/test_logs/1597136195 qian: executing yml_node IOC_LIBCFS_GET_NI error 22: Invalid argument Client: 2.13.55.16 MDS: 2.13.55.16 OSS: 2.13.55.16 excepting tests: 28 skipping tests SLOW=no: 33a Stopping clients: qian /mnt/lustre (opts:-f) Stopping clients: qian /mnt/lustre2 (opts:-f) qian: executing set_hostid Loading modules from /root/work/STATX/lustre-release/lustre/tests/.. detected 2 online CPUs by sysfs Force libcfs to create 2 CPU partitions quota/lquota options: <span class="code-quote">'hash_lqs_cur_bits=3'</span> Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 Checking servers environments Checking clients qian environments Loading modules from /root/work/STATX/lustre-release/lustre/tests/.. detected 2 online CPUs by sysfs Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 Starting ost2: -o localrecov lustre-ost2/ost2 /mnt/lustre-ost2 Commit the device label on lustre-ost2/ost2 Started lustre-OST0001 Starting client: qian: -o user_xattr,flock qian@tcp:/lustre /mnt/lustre Starting client qian: -o user_xattr,flock qian@tcp:/lustre /mnt/lustre Started clients qian: 192.168.150.131@tcp:/lustre on /mnt/lustre type lustre (rw,flock,user_xattr,lazystatfs,encrypt) Starting client: qian: -o user_xattr,flock qian@tcp:/lustre /mnt/lustre2 Starting client qian: -o user_xattr,flock qian@tcp:/lustre /mnt/lustre2 Started clients qian: 192.168.150.131@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,user_xattr,lazystatfs,encrypt) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8e409657d800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8e409657e800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8e409657d800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8e409657e800.idle_timeout=debug setting jobstats to procname_uid Setting lustre.sys.jobid_var from disable to procname_uid Waiting 90s <span class="code-keyword">for</span> <span class="code-quote">'procname_uid'</span> Updated after 7s: want <span class="code-quote">'procname_uid'</span> got <span class="code-quote">'procname_uid'</span> disable quota as required lod.lustre-MDT0000-mdtlov.mdt_hash=crush 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664703 s, 158 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7574] == sanityn test 51b: layout lock: glimpse should be able to restart <span class="code-keyword">if</span> layout changed ================ 16:57:29 (1597136249) 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.000503275 s, 2.0 MB/s fail_loc=0x1404 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147413 s, 71.1 MB/s 3145728 Resetting fail_loc on all nodes...done. PASS 51b (7s) cleanup: ====================================================== == sanityn test complete, duration 61 sec ============================================================ 16:57:36 (1597136256) Stopping clients: qian /mnt/lustre (opts:-f) Stopping client qian /mnt/lustre opts:-f Stopping clients: qian /mnt/lustre2 (opts:-f) Stopping client qian /mnt/lustre2 opts:-f [root@qian tests]# FSTYPE=zfs ONLY=<span class="code-quote">"51b"</span> MDSCOUNT=2 REFORMAT=<span class="code-quote">"yes"</span> sh sanityn.sh == sanityn test 51b: layout lock: glimpse should be able to restart <span class="code-keyword">if</span> layout changed ================ 16:59:20 (1597136360) 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.000356896 s, 2.9 MB/s fail_loc=0x1404 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559126 s, 188 MB/s 3145728 Resetting fail_loc on all nodes...done. PASS 51b (7s) cleanup: ====================================================== == sanityn test complete, duration 35 sec ============================================================ 16:59:27 (1597136367) </pre> </div></div> <p>Andreas' patch: <a href="https://review.whamcloud.com/#/c/38947/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/#/c/38947/</a> gives out the solution by increasing timeout for sanityn test_51b.</p> <p>Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/38947" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/38947</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-10934" title="integrate statx() API with Lustre" class="issue-link" data-issue-key="LU-10934"><del>LU-10934</del></a> tests: increase timeout for sanityn test_51b<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: a00f3f63fa7e8d3ba9a32dcf4da3de83b6dcdcb3</p> <p>The patch to fix test_51b is landed. </p> <p>Faced it again on master(review-dne-zfs-part-5): <a href="https://testing.whamcloud.com/test_sets/e23e4426-f555-4f86-b61e-7c1051c2a974" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/e23e4426-f555-4f86-b61e-7c1051c2a974</a></p> <p>+1 on master <a href="https://testing.whamcloud.com/test_sets/2b34efa6-e2f5-4797-ab11-e9e3d18082eb" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/2b34efa6-e2f5-4797-ab11-e9e3d18082eb</a></p> Related LU-10934 Development Rank 1|i014gv: Rank (Obsolete) 9223372036854775807 Severity