Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-11025

DNE3: directory restripe

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: Lustre 2.11.0
    • Fix Version/s: Lustre 2.14.0
    • Labels:
    • Epic/Theme:
    • Rank (Obsolete):
      9223372036854775807

      Description

      In DNE system, MDTs are likely to become imbalanced over time, and user may also add/remove MDTs. So there is a need to move load from one MDT to anothe, this is what dir restripe can do.

      Directory restripe should meet below requirements:

      • After directory restripe, the load (disk usage, incoming requests) should be shared fairly between MDTs.
      • In the process of directory restriping, the directory should be accessed without problem.
      • Move as little data as necessary to make restripe quick and to minimize system impact.
      • Keep object fid unchanged to support NFS on Lustre.

      Functional spec:

      • A new hash type will be introduced, directory with this hash type should move as little data as necessary in each restripe. To achieve this, directory with this hash type doesn't hash(name) mod stripe_count, but a fixed number like maximum MDT count, so that each restripe won't cause file hash change. And unlike old striped directory, each stripe contains a range of numbers of between [0, maximum_MDT_count], e.g, [0, 99], and each restripe will split this stripe into two, and each with half the range, i.e, [0, 49] and [50, 99], that means only half of the files needs to be moved.
      • Directory restripe will be done automatically, when MDT finds a directory or stripe is growing fast, it will put this directory or stripe into a global list, and a dedicated thread will scan this list and split directories or stripes in this list. Stripe merge should be similar, when a stripe size is shrinking below a limit, it will be merged to its previous stripe.
      • Unlike directory migration, restripe doesn't move file inode, but only dirent. So after restripe, half of the files under this stripe will become remote objects.

        Attachments

          Issue Links

          has to be done after

          Improvement - An improvement or enhancement to an existing feature or task. LU-10329 DNE3: REMOTE_PARENT_DIR scalability

          • Major - Major loss of function.
          • Open
          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-7749 DNE3: migrated orphan survive till next reboot

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. LU-8698 DNE3: check unknown hash type properly in lmv

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. LU-13417 DNE3: "lfs setdirstripe -i -1" not active on new/empty filesystem

          • Major - Major loss of function.
          • Reopened

          Bug - A problem which impairs or prevents the functions of the product. LU-13424 unable to migrate mirrored files

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-13406 set_param: param_path 'lod/*/mdt_hash': No such file or dir

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-13522 mdt.mdt_mds_mds_conns is not counted upon MDT stop and start

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-14459 DNE3: directory auto split during create

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-13691 Allow for lfs migrate between MDTs to include DOM

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LUDOC-462 Add feature documentation for directory restripe

          • Blocker - Blocks development and/or testing work, production could not run.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-12867 DNE3: new DNE2 hash function to handle rsync temporary filename

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. LU-7607 Preserve inode number after MDT migration

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-4684 DNE3: allow migrating DNE striped directory

          • Major - Major loss of function.
          • Reopened

            Activity

              People

              • Assignee:
                laisiyao Lai Siyao
                Reporter:
                laisiyao Lai Siyao
              • Votes:
                0 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Due:
                  Created:
                  Updated:
                  Resolved: