https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LUDOC-462 Lustre Documentation <p>Add feature documentation for directory restripe added in <a href="https://jira.whamcloud.com/browse/LU-11025" title="DNE3: directory restripe" class="issue-link" data-issue-key="LU-11025"><del>LU-11025</del></a>.</p> LUDOC-462

Add feature documentation for directory restripe

Improvement Blocker Resolved Fixed Lai Siyao Joseph Gmitter Thu, 23 Jan 2020 17:58:24 +0000 Tue, 2 Feb 2021 19:41:28 +0000 Fri, 25 Dec 2020 23:01:40 +0000 Lustre 2.14.0 Manual 0 4 <h2><a name="Functionality"></a>Functionality</h2> <h3><a name="TheDirectoryAutoRestripingfeaturewillhavethefollowingfunctionality"></a>The Directory Auto-Restriping feature will have the following functionality</h3> <ul class="alternate" type="square"> <li>When the number of sub files under a directory is more than 50k, it will trigger directory split, i.e. it will become a striped directory with two stripes, and "<tt>lfs getdirstripe &lt;dir&gt;</tt>" will show it’s in ‘splitting’ status. Then, nearly half of its sub files will be migrated to newly allocated stripe according to their name hash. Later when "<tt>lfs getdirstripe &lt;dir&gt;</tt>" doesn’t show ‘<tt>splitting</tt>’, it means sub-files have finished migration. This also applies on striped directory: when the number of sub files under one stripe is more than 50k, this striped directory will be split automatically, the target stripe count will be doubled, but if there aren’t enough MDTs, the target stripe count will be MDT count.</li> </ul> <ul class="alternate" type="square"> <li>Directory auto-restripe is done on server, and doesn’t involve client, though it’s triggered by a readdir from client.</li> </ul> <ul class="alternate" type="square"> <li>During directory auto-restripe, if some MDS is rebooted, sub file migrations will fail and report error messages, but when MDS gets back, sub file migrations will resume, and auto-restripe will finish.</li> </ul> <ul class="alternate" type="square"> <li>Generally Directory auto-restriping is opaque to client, that is, most operations on/under this directory will run like on/under a normal directory, and NFS re-export is supported. In theory, it should be complete opaque, but there may be some corner cases, and will be addressed later.</li> </ul> <h2><a name="TestPlan"></a>Test Plan</h2> <ul class="alternate" type="square"> <li>Basic functionality test: plain directory auto-restripe; striped directory auto-restripe.</li> <li>Directory auto-restripe with concurrent create and unlink.</li> <li>Enable directory auto-restripe in racer.sh, but I’m afraid racer.sh is not stable.</li> <li>Access NFS re-export during directory auto-restripe.</li> <li>Performance test: evaluate system performance drop during directory auto-restripe.</li> </ul> <p>Lai Siyao (lai.siyao@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/41060" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/41060</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LUDOC-462" title="Add feature documentation for directory restripe" class="issue-link" data-issue-key="LUDOC-462"><del>LUDOC-462</del></a> mdt: doc for directory restripe and auto-split<br/> Project: doc/manual<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 6911d66fdc7da5dc79100989ba1bc3fd983bd5eb</p> <p>Andreas Dilger (adilger@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/41060/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/41060/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LUDOC-462" title="Add feature documentation for directory restripe" class="issue-link" data-issue-key="LUDOC-462"><del>LUDOC-462</del></a> mdt: doc for directory restripe and auto-split<br/> Project: doc/manual<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 44b5721f899123b91de4ce795b218b1589130893</p> Related LU-11025 Development Rank 1|i00shz: Rank (Obsolete) 9223372036854775807