https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-8585 Lustre <p>All Lustre test suites that run as part of the review-* test groups should complete and pass when run under a mounted subdirectory. To run all Lustre tests with a subdirectory mounted, you can use “Test-Parameters: envdefinitions=FILESET=/subdir”. </p> <p>From the following test results, we can see that not all Lustre test suites can be run successfully with Lustre mounted from a subdirectory:<br/> <a href="https://testing.hpdd.intel.com/test_sessions/0e2c6222-5f8b-11e6-b5b1-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sessions/0e2c6222-5f8b-11e6-b5b1-5254006e85c2</a><br/> <a href="https://testing.hpdd.intel.com/test_sessions/f30cb438-5f9e-11e6-906c-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sessions/f30cb438-5f9e-11e6-906c-5254006e85c2</a><br/> <a href="https://testing.hpdd.intel.com/test_sessions/2f30c6d8-5faf-11e6-b5b1-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sessions/2f30c6d8-5faf-11e6-b5b1-5254006e85c2</a><br/> <a href="https://testing.hpdd.intel.com/test_sessions/9f47f55a-5ff4-11e6-b5b1-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sessions/9f47f55a-5ff4-11e6-b5b1-5254006e85c2</a></p> <p>Andreas Dilger reviewed the results and stated “ … the sanity-lfsck and sanity-scrub tests should be skipped if .lustre does not exist on the mountpoint.” Thus, we need to review the failures of the above test session and submit a patch to skip certain tests/test suites when a subdirectory is used as the mount point.</p> autotest LU-8585

All Lustre test suites should pass with subdirectory mount

Improvement Minor Open Unresolved James A Simmons James Nunez tests Tue, 6 Sep 2016 19:31:48 +0000 Mon, 22 Jan 2024 22:54:43 +0000 Lustre 2.9.0 Upstream 0 10 <p>I've reviewed a few of the test suite failures and here is a partial list of tests that fail when mounting a subdirectory:<br/> sanity test_405 fails - test 16 of swap_lock_test.c calls llapi_path2fid on $DIR.</p> <p>sanity-lfsck tests 18b, 18c, 18e, 20, 24, 27a, 27b, 30 - all need to be skipped due to looking for .lustre</p> <p>sanityn tests 1a, 1b, 1c, 1d, 2a, 2b, 2c, 2e, 2g, 3, 4, 5, 6, 7, 8, 9, 10a, 10b, 13, 16, 17, 21, 24a, 25a, 26a, 26b, 31a, 32a, 32b, 36, 37, 41b, 41c, 41d, 41e, 41f, 41g, 41h, 42a, 42b, 42c, 42d, 42e, 42f, 42g, 42h, 43a, 43b, 43c, 43d, 43e, 43f, 43g, 43h, 44a, 44b, 44c, 44d, 44e, 44f, 44g, 44h, 45a, 45b, 45c, 45d, 45e, 45f, 45g, 45h, 46a, 46b, 46c, 46d, 46e, 46f, 46g, 46h, 50, 51a, 51b, 51c, 51d, 54, 55a, 55b, 55c, 55d, 60, 70a, 71, 72, 73, 74, 76, 77a, 77b, 77c, 77d, 77e, 77f, 82</p> <p>The sanityn failures are likely all caused by <tt>$MOUNT2</tt> not properly mounting the <tt>$FILESET</tt> subdirectory during setup.</p> <p>The sanity test_406 failure is because <tt>swap_lock_test.c::test16()</tt> is:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"><span class="code-comment">/* Lease on file opened by FID */</span> <span class="code-keyword">static</span> void test16(void) { : : filename = create_file_name(<span class="code-quote">"foo1"</span>); fd = create_file(<span class="code-quote">"foo1"</span>, 1000, <span class="code-quote">'x'</span>); rc = llapi_path2fid(filename, &amp;fid); close(fd); fd = llapi_open_by_fid(fsmountdir, &amp;fid, O_RDWR | O_NOATIME | O_NONBLOCK | O_NOFOLLOW); ASSERTF(fd &gt;= 0, <span class="code-quote">"open failed <span class="code-keyword">for</span> <span class="code-quote">'%s'</span>: %s"</span>, filename, strerror(errno)); </pre> </div></div> <p>It isn't <tt>llapi_path2fid()</tt> that is failing (which only operates directly on the file itself), but rather <tt>llapi_open_by_fid()</tt> which is failing because the <tt>.lustre</tt> directory is missing. This subtest could be excluded if the <tt>.lustre</tt> directory is missing. In fixing this failure, the above ASSERTF() message should be changed to print <tt>"open-by-FID failed for "DFID" ('%s'): %s"</tt> so that the cause of the failure is more clear.</p> <p>Update: sanityn tests pass if the file system is not mounted before the tests are run. I'll investigate this more, but for now, I think the sanityn test list above should be ignored until I can determine that there is a real issue here.</p> <p>Recent testing shows there are still some test or test suite failures when running the review-* test groups with the FILESET parameter set:<br/> <a href="https://testing.hpdd.intel.com/test_sessions/6ed229f2-798c-11e6-8afd-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sessions/6ed229f2-798c-11e6-8afd-5254006e85c2</a><br/> sanityn test suite fails with</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>06:40:49:CMD: trevis-16vm1.trevis.hpdd.intel.com,trevis-16vm2 mount -t lustre -o user_xattr,flock trevis-16vm4@tcp:/lustre /mnt/lustre2 06:40:49:trevis-16vm1: warning: /mnt/lustre2: cannot resolve: No such file or directory 06:40:49:trevis-16vm2: warning: /mnt/lustre2: cannot resolve: No such file or directory 06:40:49:sanityn returned 0 </pre> </div></div> <p>Similarly, sanity-hsm test suite fails with</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>08:28:34:CMD: trevis-16vm1.trevis.hpdd.intel.com,trevis-16vm2 mount -t lustre -o user_xattr,flock trevis-16vm4@tcp:/lustre /mnt/lustre2 08:28:34:trevis-16vm1: warning: /mnt/lustre2: cannot resolve: No such file or directory 08:28:34:trevis-16vm2: warning: /mnt/lustre2: cannot resolve: No such file or directory 08:28:34:sanity-hsm returned 0 </pre> </div></div> <p><a href="https://testing.hpdd.intel.com/test_sessions/a9dbe098-79d6-11e6-b058-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sessions/a9dbe098-79d6-11e6-b058-5254006e85c2</a><br/> conf-sanity failures: tests 20, 70e (I’m ignoring the 21*, 22, and 23a failures; tests fail because of the test 20 failure. These tests need to be more resilient)<br/> lustre-rsync-test failures: tests 1, 2b</p> <p>James, can you investigate what needs to be done for the sanityn setup to make that work with FILESET? I suspect it is just a matter of setting $MOUNT2 or similar to include $FILESET. </p> <p>James Nunez (jnunez@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/33666" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/33666</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8585" title="All Lustre test suites should pass with subdirectory mount" class="issue-link" data-issue-key="LU-8585">LU-8585</a> tests: skip sanity test for subdir mount<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 7158acc9cb25bc31942a7737a094740fabc96308</p> <p>James Simmons (uja.ornl@yahoo.com) uploaded a new patch: <a href="https://review.whamcloud.com/34954" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/34954</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8585" title="All Lustre test suites should pass with subdirectory mount" class="issue-link" data-issue-key="LU-8585">LU-8585</a> utils: don't use .lustre/fid in tools<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: db936e18cc41288fe8a73f308f9f80cb9f3dda4d</p> <p>Quentin Bouget (quentin.bouget@cea.fr) uploaded a new patch: <a href="https://review.whamcloud.com/36603" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36603</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8585" title="All Lustre test suites should pass with subdirectory mount" class="issue-link" data-issue-key="LU-8585">LU-8585</a> llapi: use open_by_handle_at in llapi_open_by_fid<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: fa1cde303d6bada6dd410081cd14ae429fc25e15</p> <p>James Simmons (jsimmons@infradead.org) uploaded a new patch: <a href="https://review.whamcloud.com/36612" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36612</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8585" title="All Lustre test suites should pass with subdirectory mount" class="issue-link" data-issue-key="LU-8585">LU-8585</a> tests: re-enable fid2path sanity test for subdir mount<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 7ebbdad78db5abf32538fa6751c977d501b03e49</p> <p>James Simmons (jsimmons@infradead.org) uploaded a new patch: <a href="https://review.whamcloud.com/36641" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36641</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8585" title="All Lustre test suites should pass with subdirectory mount" class="issue-link" data-issue-key="LU-8585">LU-8585</a> llite: ignore special lustre volatile files for NFS export<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 64214e09720d567e25d9bf2a4a6958a33a1c3ef8</p> <p>Quentin Bouget (quentin.bouget@cea.fr) uploaded a new patch: <a href="https://review.whamcloud.com/36657" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36657</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8585" title="All Lustre test suites should pass with subdirectory mount" class="issue-link" data-issue-key="LU-8585">LU-8585</a> llite: ignore special lustre volatile files for NFS export<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: b938a4199b4d259f26198d76902f851e88d190f1</p> <p>I just noticed <tt>liblustreapi_hsm.c</tt> has its own implementation of <tt>llapi_open_by_fid()</tt>: <tt>ct_open_by_fid()</tt>. I think it will have to be patched as well before this LU can be closed.</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/36641/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36641/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8585" title="All Lustre test suites should pass with subdirectory mount" class="issue-link" data-issue-key="LU-8585">LU-8585</a> llite: don't cache MDS_OPEN_LOCK for volatile files<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 6a3a842add0e941d901869db195ec0068e69cde3</p> <p>No more changes should be pushed with <a href="https://jira.whamcloud.com/browse/LU-8585" title="All Lustre test suites should pass with subdirectory mount" class="issue-link" data-issue-key="LU-8585">LU-8585</a> as the issue. This should be an epic or something and each change pushed for it should have its own issue.</p> <p>"Oleg Drokin &lt;green@whamcloud.com&gt;" merged in patch <a href="https://review.whamcloud.com/c/fs/lustre-release/+/36603/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/36603/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8585" title="All Lustre test suites should pass with subdirectory mount" class="issue-link" data-issue-key="LU-8585">LU-8585</a> llapi: use open_by_handle_at in llapi_open_by_fid<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: bdf7788d19985bb7abf2385add15f1d67f3d01e4</p> <p>"Etienne AUJAMES &lt;eaujames@ddn.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/49496" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/49496</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8585" title="All Lustre test suites should pass with subdirectory mount" class="issue-link" data-issue-key="LU-8585">LU-8585</a> llapi: use open_by_handle_at in llapi_open_by_fid<br/> Project: fs/lustre-release<br/> Branch: b2_12<br/> Current Patch Set: 1<br/> Commit: 8975df0a4f2a21a9818d670ad504356ae059b363</p> <p>"Etienne AUJAMES &lt;eaujames@ddn.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/49515" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/49515</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8585" title="All Lustre test suites should pass with subdirectory mount" class="issue-link" data-issue-key="LU-8585">LU-8585</a> llite: don't cache MDS_OPEN_LOCK for volatile files<br/> Project: fs/lustre-release<br/> Branch: b2_12<br/> Current Patch Set: 1<br/> Commit: 21976e3ab970079c35450919c2b75aa449200640</p> <p>"Etienne AUJAMES &lt;eaujames@ddn.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/51366" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/51366</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8585" title="All Lustre test suites should pass with subdirectory mount" class="issue-link" data-issue-key="LU-8585">LU-8585</a> llapi: use open_by_handle_at in llapi_open_by_fid<br/> Project: fs/lustre-release<br/> Branch: b2_15<br/> Current Patch Set: 1<br/> Commit: a0db1b5817f376eaaea5165b89f232b14aa3b75f</p> <p>"James Simmons &lt;jsimmons@infradead.org&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/51707" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/51707</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8585" title="All Lustre test suites should pass with subdirectory mount" class="issue-link" data-issue-key="LU-8585">LU-8585</a> llite: add special fid handling for fhandle API<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: c78ccbb0b1ba957718392bfbb5a83dbbbf739bce</p> <p>"James Simmons &lt;jsimmons@infradead.org&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/51708" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/51708</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8585" title="All Lustre test suites should pass with subdirectory mount" class="issue-link" data-issue-key="LU-8585">LU-8585</a> llite: return parent fid as well for ll_encode_fh()<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 3c5156b7ecdb997e432594db339158a89f8c189a</p> <p>"Oleg Drokin &lt;green@whamcloud.com&gt;" merged in patch <a href="https://review.whamcloud.com/c/fs/lustre-release/+/51707/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/51707/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8585" title="All Lustre test suites should pass with subdirectory mount" class="issue-link" data-issue-key="LU-8585">LU-8585</a> llite: add special fid handling for fhandle API<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 52a97b44904951f24efb602883cfc280d825aba0</p> Duplicate LU-10457 Related LU-11501 LU-15835 LU-11686 LU-12633 LU-12661 LU-12203 LU-16463 LU-16494 LU-10948 LU-12806 Development Rank 1|hzynjj: Rank (Obsolete) 9223372036854775807