Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-14975

DNE3: directory migration in non-recursive mode

Details

    Description

      Directory migration will migrate target directory and all of its subdirectories to target MDTs recursively, this will cause huge inodes migration if the target directory is deep and contains lots of sub files. To make this more flexible, a "--non-recursive" option can be added to "lfs migrate -m" to only migrate target directory and the first level of sub files under it.

      Attachments

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. LU-14210 DNE3: "lfs migrate -m" should allow-non-recursive migration

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-16717 Directory restripe breaking lmv stripe settings

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-7607 Preserve inode number after MDT migration

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-14211 DNE3: mechanism to interrupt and resume migration

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-15001 improve recovery of interrupted directory migrate

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Question/Request - A product question or request LU-15211 lfs migrate metadata performance test plan

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open
          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-14366 "lfs mkdir" on existing directory returns "Operation not supported/already in progress"

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-15001 improve recovery of interrupted directory migrate

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-13076 DNE3: lfs migrate -m should allow -1 as the target index

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            [LU-14975] DNE3: directory migration in non-recursive mode
            pjones Peter Jones made changes -
            Fix Version/s New: Lustre 2.16.0 [ 15190 ]
            cfaber Colin Faber made changes -
            Labels New: migration_improvements
            gerrit Gerrit Updater added a comment -

            "Etienne AUJAMES <eaujames@ddn.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/51534
            Subject: LU-14975 utils: non-recursive dir migration fix
            Project: fs/lustre-release
            Branch: b2_15
            Current Patch Set: 1
            Commit: 104f71d2f1707b49868408b896f0231e7407412c

            gerrit Gerrit Updater added a comment - "Etienne AUJAMES <eaujames@ddn.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/51534 Subject: LU-14975 utils: non-recursive dir migration fix Project: fs/lustre-release Branch: b2_15 Current Patch Set: 1 Commit: 104f71d2f1707b49868408b896f0231e7407412c
            adilger Andreas Dilger made changes -
            Link New: This issue is related to LU-16717 [ LU-16717 ]
            gerrit Gerrit Updater added a comment -

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/47012/
            Subject: LU-14975 utils: non-recursive dir migration fix
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: df3e6b4404496530a2ee65722b4b739cc0278227

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/47012/ Subject: LU-14975 utils: non-recursive dir migration fix Project: fs/lustre-release Branch: master Current Patch Set: Commit: df3e6b4404496530a2ee65722b4b739cc0278227
            gerrit Gerrit Updater added a comment -

            "Lai Siyao <lai.siyao@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/47012
            Subject: LU-14975 utils: non-recursive dir migration fix
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 571dafde377fc076acfda153bfb52112dc3675e1

            gerrit Gerrit Updater added a comment - "Lai Siyao <lai.siyao@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/47012 Subject: LU-14975 utils: non-recursive dir migration fix Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 571dafde377fc076acfda153bfb52112dc3675e1
            adilger Andreas Dilger made changes -
            Link New: This issue is related to LU-15211 [ LU-15211 ]
            adilger Andreas Dilger made changes -
            Link Original: This issue is related to EX-4481 [ EX-4481 ]
            adilger Andreas Dilger made changes -
            Epic Link New: EX-4481 [ 67870 ]
            adilger Andreas Dilger made changes -
            Link New: This issue is related to LU-14211 [ LU-14211 ]

            People

              laisiyao Lai Siyao
              laisiyao Lai Siyao
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: