https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-16904 Lustre <p>This is the ticket to track progress and problems of running sanity.sh and sanityn.sh with PFL as filesystem layout. subtests and test-framework fixes should be in separate patches. </p> LU-16904

initial test script to run sanity.sh and sanityn.sh with PFL layout

Task Minor In Progress Unresolved Sarah Liu Sarah Liu Thu, 15 Jun 2023 17:54:30 +0000 Thu, 11 Jan 2024 20:14:14 +0000 Lustre 2.16.0 0 4 <p>Sarah Liu (sarah@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/51371" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/51371</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16904" title="initial test script to run sanity.sh and sanityn.sh with PFL layout " class="issue-link" data-issue-key="LU-16904">LU-16904</a> test: Add sanity-compr.sh to run sanity with PFL layout<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: b862fa1c3f3af2c944395301e19b798048064570</p> <p>this is a fortestonly patch only to run sanity with setting "lfs setstripe -E EOF -c 1 $MOUNT" </p> <p>the Maloo result is at<br/> <a href="https://testing.whamcloud.com/test_sets/24922969-cde5-4abd-8dfd-88bc1571d1e4" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/24922969-cde5-4abd-8dfd-88bc1571d1e4</a></p> <p>related issue: <br/> <a href="https://jira.whamcloud.com/browse/LU-16924" title="sanity-compr test_56ba: lfs find --component-count 0 - 0 != 10 files" class="issue-link" data-issue-key="LU-16924"><del>LU-16924</del></a></p> <p>Looking at the other test failures in <a href="https://testing.whamcloud.com/test_sets/24922969-cde5-4abd-8dfd-88bc1571d1e4" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/24922969-cde5-4abd-8dfd-88bc1571d1e4</a> I am surprised that there are only 7 failed subtests out of all the subtests in sanity.sh, so I think it would be reasonable to just fix them all in a single patch, possibly even as part of the original 51371 patch? Then, move on to a follow-on patch that adds <tt>sanityn.sh</tt> testing to <tt>sanity-compr.sh</tt>, and allow the initial patch to land.</p> <p>"Oleg Drokin &lt;green@whamcloud.com&gt;" merged in patch <a href="https://review.whamcloud.com/c/fs/lustre-release/+/51371/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/51371/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16904" title="initial test script to run sanity.sh and sanityn.sh with PFL layout " class="issue-link" data-issue-key="LU-16904">LU-16904</a> test: Add sanity-compr.sh to run sanity and sanityn with PFL layout<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: b4e5faf551189f3e391a7ef268abcf0d584206bd</p> <p>Merged for 2.16</p> <p>The version of sanity-compr.sh currently in the tree is only running with the most basic 1-stripe PFL file.</p> <p>This needs to be updated to include a more complex PFL file layout so that we are exercising more of the code, and the corresponding test script breakage fixed. </p> <p>There are a series of increasingly complex PFL layouts that could be used to discover and fix layout assumptions in the test scripts, that should be tried in separate patches, so that we can finally enable PFL layouts in the test framework by default. This would include running with 2- and 4-stripe files by default, 2- and 3- component files, and different stripe sizes:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Test-Parameters: testlist=sanity-compr env=COMPR_EXTRA_LAYOUT="-c 2" Test-Parameters: testlist=sanity-compr env=COMPR_EXTRA_LAYOUT="-c 4" Test-Parameters: testlist=sanity-compr env=COMPR_EXTRA_LAYOUT="-S 4M" Test-Parameters: testlist=sanity-compr env=COMPR_EXTRA_LAYOUT="-E 64k -c 1 -E eof" Test-Parameters: testlist=sanity-compr env=COMPR_EXTRA_LAYOUT="-E 64k -c 1 -E eof -c 2" Test-Parameters: testlist=sanity-compr env=COMPR_EXTRA_LAYOUT="-E 64k -c 1 -E 1M -c 2 -E eof -c 4 -S 4M" </pre> </div></div> <p>This shows all of the <tt>Test-Parameters</tt> at once, but they should probably be put into separate patches so that the failures can be isolated and fixed more easily.</p> <p>Once the last 3-component PFL patch can pass testing, then this should be set as the default layout directly in the <tt>sanity-compr.sh</tt> patch, and/or move this directly into <tt>sanity.sh</tt> and <tt>sanityn.sh</tt> and finally start on a patch to allow setting the PFL layout on the filesystem directly from <tt>mkfs.lustre</tt>.</p> <p>I noticed in <a href="https://jira.whamcloud.com/browse/LU-11918" title="Allow setting default file layout on root directory at mkfs time" class="issue-link" data-issue-key="LU-11918">LU-11918</a> that there is already support for setting a different filesystem-wide default layout using the "<tt>fs_STRIPEPARAMS</tt>" environment variable, and per-test default layouts using <tt>_testname_STRIPEPARAMS</tt>. It probably makes sense to change <tt>sanity-compr.sh</tt> over to using <tt>compr_STRIPEPARAMS</tt> instead of <tt>COMPR_EXTRA_LAYOUT</tt>, and similarly change <tt>RACER_EXTRA_LAYOUT</tt> over to <tt>racer_STRIPEPARAMS</tt> for consistency.</p> <p>Thanks Andreas, I will take a look</p> <p>"Sarah Liu &lt;sarah@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/53651" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/53651</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16904" title="initial test script to run sanity.sh and sanityn.sh with PFL layout " class="issue-link" data-issue-key="LU-16904">LU-16904</a> tests: Set 2-stripe layout on the system for sanity and sanityn<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 176d454ac31690426c19620cfd7e2609b958e82b</p> Related LU-16924 LU-11918 Development Epic Link EX-7670 Rank 1|i03o5z: Rank (Obsolete) 9223372036854775807 Severity