Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-10176 Data-on-MDT phase II
  3. LU-10181

DoM performance optimization

Details

    • Technical task
    • Resolution: Fixed
    • Major
    • Lustre 2.12.0
    • None
    • 9223372036854775807

    Description

      Various optimization for better DoM performance. So far they are:

      • glimpse ahead. Issue glimpse from MDT in advance and return size on client along with other attributes.
      • read-on-open. Read file data at OPEN and return to the client
      • lock bits convert instead of cancel. It is separate ticket because it is useful for all files, not just DoM.

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-13136 (layout.c:2121:__req_capsule_get()) @@@ Wrong buffer for field 'niobuf_inline' (7 of 7) in format 'LDLM_INTENT_OPEN', 0 vs. 0 (server)

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-18987 Strange LASSERT in mdt_dom_read_on_open()

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          New Feature - A new feature of the product, which has yet to be developed. LU-3285 Data on MDT

          • Major - Major loss of function.
          • Resolved

          Activity

            [LU-10181] DoM performance optimization
            green Oleg Drokin made changes -
            Link New: This issue is related to LU-18987 [ LU-18987 ]
            adilger Andreas Dilger made changes -
            Link New: This issue is related to LU-13136 [ LU-13136 ]
            pjones Peter Jones made changes -
            Resolution New: Fixed [ 1 ]
            Status Original: In Progress [ 3 ] New: Resolved [ 5 ]
            pjones Peter Jones added a comment -

            All current patches are now landed for 2.12

            pjones Peter Jones added a comment - All current patches are now landed for 2.12
            gerrit Gerrit Updater added a comment -

            Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/23011/
            Subject: LU-10181 mdt: read on open for DoM files
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 13372d6c243ccfc1a0886469f3c0dc048783ed47

            gerrit Gerrit Updater added a comment - Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/23011/ Subject: LU-10181 mdt: read on open for DoM files Project: fs/lustre-release Branch: master Current Patch Set: Commit: 13372d6c243ccfc1a0886469f3c0dc048783ed47
            gerrit Gerrit Updater added a comment -

            Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/31750/
            Subject: LU-10181 mds: init cpt params for mdt IO service
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 3d29ce84a51bcb9593a3d9bca3c570b36b566623

            gerrit Gerrit Updater added a comment - Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/31750/ Subject: LU-10181 mds: init cpt params for mdt IO service Project: fs/lustre-release Branch: master Current Patch Set: Commit: 3d29ce84a51bcb9593a3d9bca3c570b36b566623
            jgmitter Joseph Gmitter (Inactive) made changes -
            Fix Version/s New: Lustre 2.12.0 [ 13495 ]
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/31768
            Subject: LU-10181 mdt: take discard lock at cleanup stage
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 283521ae6fb612598552a56271d11d442b7b2e5b

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/31768 Subject: LU-10181 mdt: take discard lock at cleanup stage Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 283521ae6fb612598552a56271d11d442b7b2e5b
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/31750
            Subject: LU-10181 mds: init cpt params for mdt IO service
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 23497102e83b05c1926b9dff652d6fcb299bfea1

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/31750 Subject: LU-10181 mds: init cpt params for mdt IO service Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 23497102e83b05c1926b9dff652d6fcb299bfea1
            gerrit Gerrit Updater added a comment -

            Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/31749
            Subject: LU-10181 test: add compilebench and DNE tests
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 842a88e9adc0679f8f82b8c18af57385639c1ecb

            gerrit Gerrit Updater added a comment - Mike Pershin (mike.pershin@intel.com) uploaded a new patch: https://review.whamcloud.com/31749 Subject: LU-10181 test: add compilebench and DNE tests Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 842a88e9adc0679f8f82b8c18af57385639c1ecb

            People

              tappro Mikhail Pershin
              tappro Mikhail Pershin
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: