https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-13564 Lustre <p>Under WBC, all metadata and data are cached in MemFS, not being flushed to MDT and OSTs. To void running out of the server space, it needs to design a grant mechanism similar to current OST space grant to control inodes grant from MDT.<br/> The following points need to consider for grant mechanism under WBC:</p> <ul> <li>In the DNE environment, how to select MDT for the newly creation? Maybe the whole root WBC subtree should be located on the same MDT?</li> <li>In current WBC implementation, the data objects for the regular file will be created when flush the file to MDT and the layout will be instantiated also. This can be optimized as follows: <ul class="alternate" type="square"> <li>It could send the current size of the file to MDT, then it can determine how to allocate data object more clear accordingly.</li> <li>Delay to allocate data objects and instantiate the layout for the regular file unless it is necessary.</li> </ul> </li> </ul> LU-13564

WBC: inode and space grant mechanism under WBC

Technical task LU-10938 Minor Open Unresolved WC Triage Qian Yingjin Fri, 15 May 2020 15:23:01 +0000 Wed, 15 Feb 2023 11:52:58 +0000 0 3 <p>As a general rule, it is much more efficient to keep subdirectory trees on a single MDT, since this avoids expensive cross-MDT transactions. The good thing with metadata vs. data, is that it is relatively easy to change over to a new MDT if one is getting full by creating a remote directory entry.</p> <p>There is already a protocol for OSTs to grant clients space for data at connect time, and the same should be used for grant from the MDTs. Since DoM is using the OST read/write protocol to the MDS, it should be possible to use this for data grant, but some changes may be needed to add in metadata grant (e.g. inodes).</p> <p>As for MDT/OST selection, the client already has "LMV QOS" logic for directory selection with "<tt>lfs mkdir -i -1</tt>" so this can be reused (<a href="https://jira.whamcloud.com/browse/LU-13417" title="DNE3: mkdir() automatically create remote directory on MDS which has more space" class="issue-link" data-issue-key="LU-13417"><del>LU-13417</del></a>).</p> <p>"Yingjin Qian &lt;qian@ddn.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/48099" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/48099</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-13564" title="WBC: inode and space grant mechanism under WBC" class="issue-link" data-issue-key="LU-13564">LU-13564</a> wbc: check low inode threshold for MDT<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 0cdacc7e46243ef6e541ee8a678dd9dbf6783ad7</p> Related Development Rank 1|i010gv: Rank (Obsolete) 9223372036854775807