Details
-
Improvement
-
Resolution: Unresolved
-
Minor
-
None
-
None
-
9223372036854775807
Description
There should be some way to monitor the progress of a long-running recursive directory migration on the MDS.
Recursive directory migration should be replaced in userspace with multiple single-directory migrations (LU-14795) so that would be possible to have "lfs migrate -m" report progress in userspace after each directory is migrated, similar to file migration statistics in LU-13482 (the read/write bandwidth and total data migrated are not useful for directory migration):
directory:
- { seconds: <seconds>, files: <count>, fps: <files_per_sec> }
- { tot_sec: <seconds>, tot_files: <count>, avg_fps: <files_per_sec> }
seconds is the time taken to migrate the previous directory, files: is the number of files (all entries) in that directroy, fps=files/seconds for that directory. tot_sec: is the total elapsed time for the current migration, tot_files the total number of files (all entries) migrated so far, and avg_fps = tot_files/tot_sec for all entries migrated so far. The stats line(s) would only be shown every stats_interval seconds.
Attachments
Issue Links
Activity
| Link | Original: This issue is related to EX-4481 [ EX-4481 ] |
| Epic Link | New: EX-4481 [ 67870 ] |
| Description |
Original:
There should be some way to monitor the progress of a long-running recursive directory migration on the MDS.
If recursive directory migration is replaced in userspace with multiple single-directory migrations ( {noformat} directory: - { total: <seconds>, files: <count>, fps: <files_per_sec> } {noformat} |
New:
There should be some way to monitor the progress of a long-running recursive directory migration on the MDS.
Recursive directory migration should be replaced in userspace with multiple single-directory migrations ( {noformat} directory: - { seconds: <seconds>, files: <count>, fps: <files_per_sec> } - { tot_sec: <seconds>, tot_files: <count>, avg_fps: <files_per_sec> } {noformat} {{seconds}} is the time taken to migrate the previous directory, {{files:}} is the number of files (all entries) in that directroy, {{fps=files/seconds}} for that directory. {{tot_sec:}} is the total elapsed time for the current migration, {{tot_files}} the total number of files (all entries) migrated so far, and {{avg_fps = tot_files/tot_sec}} for all entries migrated so far. The stats line(s) would only be shown every {{stats_interval}} seconds. |
| Description |
Original:
There should be some way to monitor the progress of a long-running recursive directory migration on the MDS.
If recursive directory migration is replaced in userspace with multiple single-directory migrations ( |
New:
There should be some way to monitor the progress of a long-running recursive directory migration on the MDS.
If recursive directory migration is replaced in userspace with multiple single-directory migrations ( {noformat} directory: - { total: <seconds>, files: <count>, fps: <files_per_sec> } {noformat} |
| Description | Original: There should be some way to monitor the progress of a long-running recursive directory migration on the MDS. |
New:
There should be some way to monitor the progress of a long-running recursive directory migration on the MDS.
If recursive directory migration is replaced in userspace with multiple single-directory migrations ( |
| Link | New: This issue is related to EX-4481 [ EX-4481 ] |
| Link | New: This issue is related to EX-4267 [ EX-4267 ] |