Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-14146 Massive directory metadata operation performance decrease
  3. LU-15526

PDO lock for object on remote MDT

Details

    • Technical task
    • Resolution: Fixed
    • Minor
    • Lustre 2.16.0
    • None
    • None
    • 9223372036854775807

    Description

      If object is on remote MDT, PDO lock is not supported, because two locks can't be fetched in one RPC right now, once the batch processing framework is ready, these two locks can be enqueued in a batch. This will greatly reduce conflicts in parent lock, and improve remote directory creation/unlink performance. Since filesystem-wide default directory layout is set by default, this will speed up mdtest directory creation/unlink test.

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-14761 DNE2 Metadata degradation

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. LU-17157 conf-sanity test_70e: SoC enabled on single MDS

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. LU-17075 replay-dual test_16 ZFS MDS crash: osd_declare_destroy() ASSERTION(dt_object_exists)

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            [LU-15526] PDO lock for object on remote MDT
            adilger Andreas Dilger made changes -
            Link New: This issue is related to LU-17157 [ LU-17157 ]
            pjones Peter Jones made changes -
            Link New: This issue is related to LU-17075 [ LU-17075 ]
            pjones Peter Jones made changes -
            Fix Version/s New: Lustre 2.16.0 [ 15190 ]
            Resolution New: Fixed [ 1 ]
            Status Original: Open [ 1 ] New: Resolved [ 5 ]
            pjones Peter Jones added a comment -

            Landed for 2.16

            pjones Peter Jones added a comment - Landed for 2.16
            gerrit Gerrit Updater added a comment -

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/46733/
            Subject: LU-15526 mdt: enable remote PDO lock
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 7270e16fcbe52ad89634b2e1e033e983248d0566

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/46733/ Subject: LU-15526 mdt: enable remote PDO lock Project: fs/lustre-release Branch: master Current Patch Set: Commit: 7270e16fcbe52ad89634b2e1e033e983248d0566
            laisiyao Lai Siyao added a comment -

            AFAIK mdtest perf test creates local sub directories, which won't be affected by this patch. This improves mkdir performance for cases that both local and remote directories will be created.

            laisiyao Lai Siyao added a comment - AFAIK mdtest perf test creates local sub directories, which won't be affected by this patch. This improves mkdir performance for cases that both local and remote directories will be created.
            adilger Andreas Dilger added a comment -

            Lai, will this patch improve mdtest shared directory create performance in striped directories?

            adilger Andreas Dilger added a comment - Lai, will this patch improve mdtest shared directory create performance in striped directories?
            adilger Andreas Dilger made changes -
            Link New: This issue is related to LU-14761 [ LU-14761 ]
            gerrit Gerrit Updater added a comment -

            "Lai Siyao <lai.siyao@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/46733
            Subject: LU-15526 mdt: enable remote PDO lock
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 6e876dff4c5d565506be7ebe7acaaba428a7129f

            gerrit Gerrit Updater added a comment - "Lai Siyao <lai.siyao@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/46733 Subject: LU-15526 mdt: enable remote PDO lock Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 6e876dff4c5d565506be7ebe7acaaba428a7129f
            laisiyao Lai Siyao made changes -
            Assignee Original: WC Triage [ wc-triage ] New: Lai Siyao [ laisiyao ]

            People

              laisiyao Lai Siyao
              laisiyao Lai Siyao
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: