https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-6449 Lustre <p>The need for this change has been unveiled by configuring RobinHood delayed soft_rm feature, where HSM remove requests are submitted with no/Null archive_id, because RBH current version does not save archive_id infromation in its SOFT_RM DB table.<br/> Since the corresponding files/FIDs have been fully unlinked, their Inodes/xattrs are no longer available in the name-space, and thus CDT is unable to retrieve the archive_id information by himself.<br/> This leads to a situation where, without a copytool being registered to handle all/32 archive_ids, these HSM remove request can not be processed and will leak in archive.</p> LU-6449

Broadcast HSM remove requests with undetermined archive_id to all registered copytools

Improvement Minor Resolved Fixed Bruno Faccini Bruno Faccini Fri, 10 Apr 2015 08:56:05 +0000 Wed, 3 May 2017 15:16:50 +0000 Sat, 17 Dec 2016 14:26:31 +0000 Lustre 2.10.0 0 10 <p>Wouldn't it be better to fix RH to store the archive_id into this SOFT_RM DB table?</p> <p>There are cases where robinhood cannot know where the file has been stored.<br/> For instance, if it processes the following sequence of changelog asynchronously: HSM (archive, rc=0), UNLINK.<br/> In this case, it's too late to query the file to know where it has been stored.</p> <p>The intent of sending "hsm_remove" request is to clean copies in the archive.<br/> IMO it would make sense that sending a hsm_remove request with no archive_id (0) would clean it in every backend.<br/> It would be helpful for the case I just described.</p> <p>In fact both are complementary! The Lustre change for this ticket will avoid to leak files on archives and I will also push a patch to RBH repo in order to have it store the archive_id.</p> <p>RobinHood side/specific patch is at <a href="https://review.gerrithub.io/238708" class="external-link" target="_blank" rel="nofollow noopener">https://review.gerrithub.io/238708</a> ("hsm_rm: store archive_id and use it for deferred remove requests").</p> <p>Faccini Bruno (bruno.faccini@intel.com) uploaded a new patch: <a href="http://review.whamcloud.com/20991" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/20991</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6449" title="Broadcast HSM remove requests with undetermined archive_id to all registered copytools" class="issue-link" data-issue-key="LU-6449"><del>LU-6449</del></a> mdt: broadcast orphan hsm_remove requests<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 5a5aead31f9ebab8219ef47446174294cb95c80b</p> <p>Faccini Bruno (bruno.faccini@intel.com) uploaded a new patch: <a href="http://review.whamcloud.com/21077" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/21077</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6449" title="Broadcast HSM remove requests with undetermined archive_id to all registered copytools" class="issue-link" data-issue-key="LU-6449"><del>LU-6449</del></a> mdt: correct status and ChangeLogs for dead objects<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 4e38194561ec193bef858d32f3824994fb660b18</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/20991/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/20991/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6449" title="Broadcast HSM remove requests with undetermined archive_id to all registered copytools" class="issue-link" data-issue-key="LU-6449"><del>LU-6449</del></a> mdt: broadcast orphan hsm_remove requests<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: fc84852e990dd3174b63ab8e16e6bc3c0b1b092a</p> <p>Faccini Bruno (bruno.faccini@intel.com) uploaded a new patch: <a href="http://review.whamcloud.com/22212" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/22212</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6449" title="Broadcast HSM remove requests with undetermined archive_id to all registered copytools" class="issue-link" data-issue-key="LU-6449"><del>LU-6449</del></a> hsm: handle completions with non-existent objects<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: f597ff217fe1eda6d84d551cd6691bfd0141409d</p> <p>This Gerrit Updater msg has been removed because it had been wrongly added to this ticket due to a typo (<a href="https://jira.whamcloud.com/browse/LU-6449" title="Broadcast HSM remove requests with undetermined archive_id to all registered copytools" class="issue-link" data-issue-key="LU-6449"><del>LU-6449</del></a> vs <a href="https://jira.whamcloud.com/browse/LU-6499" title="leaking a kernel device on error in init_obdclass" class="issue-link" data-issue-key="LU-6499"><del>LU-6499</del></a>) in the header/1st-line of commit msg.</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="https://review.whamcloud.com/22212/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/22212/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6449" title="Broadcast HSM remove requests with undetermined archive_id to all registered copytools" class="issue-link" data-issue-key="LU-6449"><del>LU-6449</del></a> hsm: handle completions with non-existent objects<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 4465f1cf50dc16b37a9ea23efec78b17fd1936eb</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="https://review.whamcloud.com/21077/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/21077/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6449" title="Broadcast HSM remove requests with undetermined archive_id to all registered copytools" class="issue-link" data-issue-key="LU-6449"><del>LU-6449</del></a> mdt: correct status and ChangeLogs for dead objects<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 3ed1444d3fa4e31fbb99c82a478802c0dbcb168e</p> <p>Landed for 2.10</p> Duplicate Related LU-6494 LU-9443 Development Rank 1|hzxaiv: Rank (Obsolete) 9223372036854775807