Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-14975

DNE3: directory migration in non-recursive mode

Details

    Description

      Directory migration will migrate target directory and all of its subdirectories to target MDTs recursively, this will cause huge inodes migration if the target directory is deep and contains lots of sub files. To make this more flexible, a "--non-recursive" option can be added to "lfs migrate -m" to only migrate target directory and the first level of sub files under it.

      Attachments

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. LU-14210 DNE3: "lfs migrate -m" should allow-non-recursive migration

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-16717 Directory restripe breaking lmv stripe settings

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-7607 Preserve inode number after MDT migration

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-14211 DNE3: mechanism to interrupt and resume migration

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-15001 improve recovery of interrupted directory migrate

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Question/Request - A product question or request LU-15211 lfs migrate metadata performance test plan

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open
          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-14366 "lfs mkdir" on existing directory returns "Operation not supported/already in progress"

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-15001 improve recovery of interrupted directory migrate

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-13076 DNE3: lfs migrate -m should allow -1 as the target index

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            [LU-14975] DNE3: directory migration in non-recursive mode
            gerrit Gerrit Updater added a comment -

            "Etienne AUJAMES <eaujames@ddn.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/51534
            Subject: LU-14975 utils: non-recursive dir migration fix
            Project: fs/lustre-release
            Branch: b2_15
            Current Patch Set: 1
            Commit: 104f71d2f1707b49868408b896f0231e7407412c

            gerrit Gerrit Updater added a comment - "Etienne AUJAMES <eaujames@ddn.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/51534 Subject: LU-14975 utils: non-recursive dir migration fix Project: fs/lustre-release Branch: b2_15 Current Patch Set: 1 Commit: 104f71d2f1707b49868408b896f0231e7407412c
            gerrit Gerrit Updater added a comment -

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/47012/
            Subject: LU-14975 utils: non-recursive dir migration fix
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: df3e6b4404496530a2ee65722b4b739cc0278227

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/47012/ Subject: LU-14975 utils: non-recursive dir migration fix Project: fs/lustre-release Branch: master Current Patch Set: Commit: df3e6b4404496530a2ee65722b4b739cc0278227
            gerrit Gerrit Updater added a comment -

            "Lai Siyao <lai.siyao@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/47012
            Subject: LU-14975 utils: non-recursive dir migration fix
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 571dafde377fc076acfda153bfb52112dc3675e1

            gerrit Gerrit Updater added a comment - "Lai Siyao <lai.siyao@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/47012 Subject: LU-14975 utils: non-recursive dir migration fix Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 571dafde377fc076acfda153bfb52112dc3675e1
            pjones Peter Jones added a comment -

            Landed for 2.15

            pjones Peter Jones added a comment - Landed for 2.15
            gerrit Gerrit Updater added a comment -

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/44802/
            Subject: LU-14975 dne: dir migration in non-recursive mode
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 5604a6d270b8be13a8aacd72a105fc72b5e16976

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/44802/ Subject: LU-14975 dne: dir migration in non-recursive mode Project: fs/lustre-release Branch: master Current Patch Set: Commit: 5604a6d270b8be13a8aacd72a105fc72b5e16976
            gerrit Gerrit Updater added a comment -

            "Lai Siyao <lai.siyao@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/44802
            Subject: LU-14975 dne: dir migration in non-recursive mode
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: ae4985753b3b50b8aad19116e9d5d634a7bb171f

            gerrit Gerrit Updater added a comment - "Lai Siyao <lai.siyao@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/44802 Subject: LU-14975 dne: dir migration in non-recursive mode Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: ae4985753b3b50b8aad19116e9d5d634a7bb171f
            laisiyao Lai Siyao added a comment -

            The input is deformed, do you mean "--recursive"? Should it default to recursive mode?

            laisiyao Lai Siyao added a comment - The input is deformed, do you mean "--recursive"? Should it default to recursive mode?
            adilger Andreas Dilger added a comment - - edited

            This should use the option name "-d|--directory" to limit the migrate to the specified directory, to match "lfs getstripe" and "ls -ld".

            adilger Andreas Dilger added a comment - - edited This should use the option name " -d|--directory " to limit the migrate to the specified directory, to match " lfs getstripe " and " ls -ld ".

            People

              laisiyao Lai Siyao
              laisiyao Lai Siyao
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: