Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-6179

Lock ahead - Request extent locks from userspace

Details

    • New Feature
    • Resolution: Fixed
    • Major
    • Lustre 2.11.0
    • None
    • 17290

    Description

      At the recent developers conference, Jinshan proposed a different method of approaching the performance problems described in LU-6148.

      Instead of introducing a new type of LDLM lock matching, we'd like to make it possible for user space to explicitly request LDLM locks asynchronously from the IO.

      I've implemented a prototype version of the feature and will be uploading it for comments. I'll explain the state of the current version in a comment momentarily.

      Attachments

        1. anl_mpich_build_guide.txt
          18 kB
        2. cug paper.pdf
          714 kB
        3. lockahead_ladvise_mpich_patch
          30 kB
        4. LockAheadResults.docx
          516 kB
        5. LockAhead-TestReport.txt
          1.36 MB
        6. LUSTRE-LockAhead-140417-1056-170.pdf
          64 kB
        7. mmoore cug slides.pdf
          1.15 MB
        8. sle11_build_tools.tar.gz
          2.48 MB

        Issue Links

          is blocking

          Bug - A problem which impairs or prevents the functions of the product. LU-9962 Possible file size glimpse issue

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-19006 cl_mode_user_to_kernel returns unsigned enum, cannot be negative

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. LU-10136 sanity test_255c: Ladvise test11 failed, 255

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LUDOC-379 Document ladvise lockahead feature

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-6181 Fix lock contention discovery to disable extend lock growth

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. LU-11618 implement ladvise rpc_size for optimized performance

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. LU-6148 Strided lock proposal - Feature proposal for 2.8

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. LU-7225 change ladvise wire protocol for lockahead and future usage

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            [LU-6179] Lock ahead - Request extent locks from userspace
            green Oleg Drokin made changes -
            Link New: This issue is related to LU-19006 [ LU-19006 ]
            gerrit Gerrit Updater added a comment -

            Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/38179/
            Subject: LU-6179 llite: Remove last lockahead old compat
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 12a0c7b5944d9e48e38416c7cac2cde153e3148b

            gerrit Gerrit Updater added a comment - Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/38179/ Subject: LU-6179 llite: Remove last lockahead old compat Project: fs/lustre-release Branch: master Current Patch Set: Commit: 12a0c7b5944d9e48e38416c7cac2cde153e3148b
            gerrit Gerrit Updater added a comment -

            Patrick Farrell (farr0186@gmail.com) uploaded a new patch: https://review.whamcloud.com/38179
            Subject: LU-6179 llite: Remove last lockahead old compat
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: d23ed5713d41b5d8c69a989bb2600d83bf701c31

            gerrit Gerrit Updater added a comment - Patrick Farrell (farr0186@gmail.com) uploaded a new patch: https://review.whamcloud.com/38179 Subject: LU-6179 llite: Remove last lockahead old compat Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: d23ed5713d41b5d8c69a989bb2600d83bf701c31
            gerrit Gerrit Updater added a comment -

            Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/38109/
            Subject: LU-6179 llite: remove LOCKAHEAD_OLD compatibility
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 5315db3f1066619d6effe4f778d2df3ad1ba738f

            gerrit Gerrit Updater added a comment - Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/38109/ Subject: LU-6179 llite: remove LOCKAHEAD_OLD compatibility Project: fs/lustre-release Branch: master Current Patch Set: Commit: 5315db3f1066619d6effe4f778d2df3ad1ba738f
            gerrit Gerrit Updater added a comment -

            Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/38109
            Subject: LU-6179 llite: remove LOCKAHEAD_OLD compatibility
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: f6bc909bfda5521454631a4985648e07c63137ee

            gerrit Gerrit Updater added a comment - Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/38109 Subject: LU-6179 llite: remove LOCKAHEAD_OLD compatibility Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: f6bc909bfda5521454631a4985648e07c63137ee
            lixi_wc Li Xi made changes -
            Link New: This issue is related to LU-11618 [ LU-11618 ]
            mdiep Minh Diep made changes -
            Link New: This issue is related to LU-10136 [ LU-10136 ]
            pjones Peter Jones made changes -
            Resolution New: Fixed [ 1 ]
            Status Original: Open [ 1 ] New: Resolved [ 5 ]
            pjones Peter Jones added a comment -

            Landed for 2.11

            pjones Peter Jones added a comment - Landed for 2.11
            gerrit Gerrit Updater added a comment -

            Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/13564/
            Subject: LU-6179 llite: Implement ladvise lockahead
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: a8dcf372f430c308d3e96fb506563068d0a80c2d

            gerrit Gerrit Updater added a comment - Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/13564/ Subject: LU-6179 llite: Implement ladvise lockahead Project: fs/lustre-release Branch: master Current Patch Set: Commit: a8dcf372f430c308d3e96fb506563068d0a80c2d

            People

              paf Patrick Farrell (Inactive)
              paf Patrick Farrell (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              23 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: