https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-11918 Lustre <p>It is useful to enable newer features like PFL, DoM, and FLR at format time, so that users unfamiliar with Lustre can have a default filesystem configuration that is most useful. In particular, enabling PFL for new filesystems is desirable for new releases, and if the MDT is configured with a large amount of space per inode (using e.g. "<tt>--mkfsoptions='-i 65536'</tt>" for ldiskfs, or always for ZFS) then a DoM component could be added.</p> <p>Some options for implementing this exist:</p> <ul class="alternate" type="square"> <li>after formatting the MDT, when it is mounted as type ldiskfs use "<tt>lfs setstripe</tt>" to generate an xattr and write it to the <tt>ROOT/</tt> directory using <tt>setxattr()</tt> instead of <tt>ioctl()</tt>. Allowing <tt>mkfs.lustre</tt> to accept an arbitrary layout would be most flexible.</li> <li>have "pre-built" xattrs that are written to the <tt>ROOT/</tt> directory at format time (either inside the kernel or from <tt>mkfs.lustre</tt>. This would likely handle most of the cases, and for expert users that know they want a different default, they can set it after mount.</li> </ul> <p>I don't think that mounting the MDT as type <tt>lustre</tt>, and then mounting a local client and using "<tt>lfs setstripe</tt>" is practical.</p> LU-11918

Allow setting default file layout on root directory at mkfs time

Improvement Major Open Unresolved WC Triage Andreas Dilger medium Sat, 2 Feb 2019 00:21:38 +0000 Fri, 5 Jan 2024 23:55:11 +0000 Lustre 2.12.0 Lustre 2.13.0 Lustre 2.16.0 0 2 <p>The first step would be to change <tt>test-framework.sh</tt> to enable PFL layout on the root directory when the filesystem is formatted. This will allow testing and fixing test script breakage where the default layout is assumed to be a plain file before we enable this by default for all filesystems.</p> <p>James Nunez (james.a.nunez@intel.com) uploaded a new patch: <a href="https://review.whamcloud.com/26576" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/26576</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11918" title="Allow setting default file layout on root directory at mkfs time" class="issue-link" data-issue-key="LU-11918">LU-11918</a> tests: modify file system layout in testing<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 30fce57cef946ffcf980c62c6a7d732de503dd07</p> <p>According to patch <a href="https://review.whamcloud.com/35068" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/35068</a> "<tt><a href="https://jira.whamcloud.com/browse/LU-12390" title="allow custom filesystem layout for tests" class="issue-link" data-issue-key="LU-12390"><del>LU-12390</del></a> tests: customise mdsrate tests</tt>" it is possible to specify "<tt>$fs_STRIPEPARAMS</tt>" to set the default filesystem layout in <tt>check_and_setup_lustre()</tt>. However, there is nothing in the current autotest framework that is using this option.</p> <p>What is still needed is to push patches that:</p> <ul class="alternate" type="square"> <li>verify each test script will pass with "$fs_STRIPEPARAMS" set to a PFL layout (e.g. "-E 2M -c 1 -S 1M -E eof -c 4" or similar)</li> <li>verify that the test script preserves the filesystem default layout to the end. I <em>think</em> <tt>sanity.sh</tt> will currently clobber the filesystem default layout in some subtests and does not correctly restore it via <tt>stack_trap()</tt>. Those subtests should be fixed to restore the default.</li> </ul> <p>Once all test scripts are passing with a default PFL layout, the next step would be to set a default <tt>fs_STRIPEPARAMS</tt> value in <tt>init_test_env()</tt> so this is permanently used, and then (separately) have <tt>mkfs.lustre</tt> (or first MDT mount of a new filesystem creating "<tt>ROOT/</tt>") set a default PFL layout on the root directory (similar to patch <a href="https://review.whamcloud.com/38553" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/38553</a> "<tt><a href="https://jira.whamcloud.com/browse/LU-13417" title="DNE3: mkdir() automatically create remote directory on MDS which has more space" class="issue-link" data-issue-key="LU-13417"><del>LU-13417</del></a> mdd: set default LMV on ROOT</tt>").</p> <p>One way that <tt>mkfs.lustre</tt> could set the default layout is directly via setxattr from userspace to the <tt>ROOT/</tt> directory while it is mounted locally as type ldiskfs. However, that would not work for ZFS.</p> <p><a href="https://jira.whamcloud.com/browse/LU-16904" title="initial test script to run sanity.sh and sanityn.sh with PFL layout " class="issue-link" data-issue-key="LU-16904">LU-16904</a> has added the <tt>sanity-compr.sh</tt> test script, which is a wrapper that runs <tt>sanity</tt> and <tt>sanityn</tt> with a different file layout. The initial patch landed with a 1-stripe PFL layout <tt>COMPR_EXTRA_LAYOUT="-E eof -c 1"</tt> and fixed a number of issues related to that. Some more work is needed to take this further to allow passing the tests with a more complex PFL layout. </p> <p>Once testing with PFL layouts is working, then it should be possible to actually implement the <tt>mkfs.lustre</tt> support for setting the PFL layout. The test-framework code should pass the default layout from <tt>$fs_STRIPEPARAMS</tt> to "<tt>mkfs.lustre --setstripe</tt>" </p> Blocker LU-11656 Related LU-10465 LU-12390 LU-9324 LU-7723 LU-8154 LU-16904 LU-13058 LU-14274 Development Rank 1|i00avb: Rank (Obsolete) 9223372036854775807