https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-15001 Lustre <p>Currently, if a directory migration has been interrupted (e.g. MDS crash), nothing is done to resume the migration operation. This is precautionary, in case there was something with the migration operation itself that caused the problem.</p> <p>However, to resume the migration operation, the exact same options for "<tt>lfs migrate -m</tt>" need to be specified by the user in order to resume/finish the migration. It would be much more convenient in this case if the migration could be resumed <em>without</em> having to specify the same options, and the MDS would just "know" these options if asked to migrate the directory again. That simplifies the user handling, and (AFAICS) does not add any risk since the migration request from the user will fail if the same options are <b>not</b> specified.</p> LU-15001

improve recovery of interrupted directory migrate

Improvement Minor Open Unresolved WC Triage Andreas Dilger Sat, 11 Sep 2021 04:42:14 +0000 Mon, 4 Jul 2022 23:37:17 +0000 0 6 <p>Is there any way to <b>stop</b> migration of a directory tree once it has started? Currently, migration runs as a thread on the MDS, but I'm not aware if there is any way to safely stop the migration once it has been started.</p> <p>It would also be desirable (possibly together with <a href="https://jira.whamcloud.com/browse/LU-14975" title="DNE3: directory migration in non-recursive mode" class="issue-link" data-issue-key="LU-14975"><del>LU-14975</del></a>) to allow completing the interrupted migration on a single directory, but not continue to migrate the rest of the directory tree.</p> <p>In several cases I've seen, users want to "repair" the partially-migrated directory, but not continue to migrate the rest of the directory tree (often because the initial migration parameters are bad and they want to change/stop the migration).</p> <p>Directory migration by command "lfs migrate -m" will migrate sub files one by one from client, which is different from that of directory restripe and directory auto-split.</p> <p>Your proposal looks reasonable, but how to "repair" the partially migrated directory? Add an option for "lfs migrate -m"? or let server to continue the migration of the rest of the directory? The latter may fail because the error that caused the failure may not be fixed yet.</p> <p>If letting the MDS continue the migration <b>for that directory</b> is easier, then that is fine with me. If it doesn't happen automatically, then there is less concern if there is a problem with the migration itself. I think in most cases of interrupted migration it is because the MDS rebooted for another reason, especially because recursive migrate of a large directory tree (possibly the whole filesystem) may take a very long time, and there is (AFAIK) no easy way to monitor if it is finished or how close it is to being finished.</p> <p>I think the most important part is to make it easy to finish the migration (not require users to specify the options that the MDS already knows). </p> <p>Separately, it probably makes sense for the migration to stop itself when it is close to doing something bad (eg. target MDT is almost full), and refuse to do "bad" migration requests (eg. migrate a whole directory tree to be striped), but those should be separate patches. </p> Related LU-13492 LU-14975 LU-14719 LU-14975 LU-14211 LU-11776 LU-15990 Development Rank 1|i02407: Rank (Obsolete) 9223372036854775807