https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-15011 Lustre <p>If an OST pool becomes full, allow configuring a global default spill target to hold files that could not be written due to the pool running out of space. This is similar to SEL, but implemented at the pool selection level, rather than on a per-write basis. While SEL is probably flexible (essentially it implements pool spill on a per-component basis), very few users know enough about SEL to use it effectively, and any changes to the SEL configuration would require updating every file that is using a particualr SEL layout. In contrast, pool spill is a tunable on the MDS (for each source pool) and affects all existing layouts using that pool if there is a spill target pool and used space threshold specified.</p> LU-15011

implement lod pool spilling

Improvement Minor Resolved Fixed Alex Zhuravlev Andreas Dilger Thu, 16 Sep 2021 21:25:11 +0000 Tue, 8 Aug 2023 22:18:00 +0000 Fri, 26 Nov 2021 23:04:14 +0000 Lustre 2.15.0 0 3 <p>Originally submitted as LU-14825, but that issue was lost due to a database error:</p> <p>"Alex Zhuravlev &lt;bzzz@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/43989" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/43989</a><br/> Subject: LU-14825 lod: pool spilling<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 0a998f4723f58e68d0fe75934df5c282eb529337</p> <p>"James Nunez &lt;jnunez@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/45056" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/45056</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-15011" title="implement lod pool spilling" class="issue-link" data-issue-key="LU-15011"><del>LU-15011</del></a> tests: pool spill test modifications<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: a097f6ea7e5a9514c08995d6ed721cba05bb1fb0</p> <p>"Alex Zhuravlev &lt;bzzz@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/45120" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/45120</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-15011" title="implement lod pool spilling" class="issue-link" data-issue-key="LU-15011"><del>LU-15011</del></a> tests: ost-pools to remove big files<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: ad32cbc4f0654c3ae3c96b4bd1d1526445d94913</p> <p>"Oleg Drokin &lt;green@whamcloud.com&gt;" merged in patch <a href="https://review.whamcloud.com/45056/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/45056/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-15011" title="implement lod pool spilling" class="issue-link" data-issue-key="LU-15011"><del>LU-15011</del></a> tests: pool spill test modifications<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: d8ff73097be78cc3e603ab49b6aaa03a1c766fcb</p> <p>"Oleg Drokin &lt;green@whamcloud.com&gt;" merged in patch <a href="https://review.whamcloud.com/45120/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/45120/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-15011" title="implement lod pool spilling" class="issue-link" data-issue-key="LU-15011"><del>LU-15011</del></a> tests: ost-pools to remove big files<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: ebed0531abed9512682574e44dd17f465fa9b04c</p> <p>"Oleg Drokin &lt;green@whamcloud.com&gt;" merged in patch <a href="https://review.whamcloud.com/44947/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/44947/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-15011" title="implement lod pool spilling" class="issue-link" data-issue-key="LU-15011"><del>LU-15011</del></a> lod: count all spilling events<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 4bd9b524537bce27fb7f53cf481b78290cd55a1d</p> <p>"Oleg Drokin &lt;green@whamcloud.com&gt;" merged in patch <a href="https://review.whamcloud.com/c/fs/lustre-release/+/45074/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/45074/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-15011" title="implement lod pool spilling" class="issue-link" data-issue-key="LU-15011"><del>LU-15011</del></a> tests: additional checks for pool spilling<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 26e765e0d23ba37577775331ac77ec857affd845</p> <p>Just curious, but was a LUDOC ever opened to track this Improvement?</p> <p><a href="https://jira.whamcloud.com/secure/ViewProfile.jspa?name=spitzcor" class="user-hover" rel="spitzcor">spitzcor</a>, I don't see it in the manual. However, I found your patch to add this documentation <a href="https://review.whamcloud.com/49725" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/49725</a> "<tt><a href="https://jira.whamcloud.com/browse/LUDOC-512" title="The Lustre Operations Manual does not document the append_pool or append_stripe_count options" class="issue-link" data-issue-key="LUDOC-512"><del>LUDOC-512</del></a> manual: add append_pool and append_stripe_count</tt>" and will land it now.</p> <p>I filed <a href="https://jira.whamcloud.com/browse/LUDOC-517" title="add pool_spill parameters to manual" class="issue-link" data-issue-key="LUDOC-517">LUDOC-517</a> for the "<tt>pool_spill</tt>" documentation.</p> Duplicate Related LUDOC-517 LU-15072 LU-15043 LU-13058 Development Rank 1|i024jb: Rank (Obsolete) 9223372036854775807