Details

    • Bug
    • Resolution: Fixed
    • Minor
    • Lustre 2.15.0
    • None
    • None
    • 3
    • 9223372036854775807

    Description

      There is a large degree of inefficiency/wasted time in the DIO/AIO path.  This does not show up for DIO normally because of the waiting model. but it shows up easily in AIO.

      This ticket is to cover a set of improvements to DIO/AIO performance, which will also improve DIO performance once the waiting model is adjusted.  (More on this in LU-13798.)

      There is a grab bag of patches to be submitted here, and some further proposals that will probably end up in other tickets.

      The essence of the improvements is that all pages in a DIO submission are the same, and therefore much of the work done on a per-page basis is irrelevant and can be skipped for DIO.  Note this statement is still compatible with unaligned DIO if it can be implemented in the future - In the case of unaligned DIO, only the first and last pages are different, and that can still be handled.

      Patches and benchmarks on each patch forthcoming.

      The total effect of the initial set of patches on my testbed is to raise AIO/DIO performance from around 5 GiB/s to around 9 GiB/s.  I'll get more in to what else can be done shortly. 

      Attachments

        Issue Links

          Activity

            [LU-13799] DIO/AIO efficiency improvements
            pjones Peter Jones added a comment -

            I think that it's LU-15483

            pjones Peter Jones added a comment - I think that it's LU-15483
            spitzcor Cory Spitz added a comment -

            > Moved the last few test changes to LU-15843
            Typo?
            https://jira.whamcloud.com/browse/LU-15843 gives "404 - Not found" and https://review.whamcloud.com/#/q/LU-15843 doesn't turn up anything either.

            spitzcor Cory Spitz added a comment - > Moved the last few test changes to LU-15843 Typo? https://jira.whamcloud.com/browse/LU-15843 gives "404 - Not found" and https://review.whamcloud.com/#/q/LU-15843 doesn't turn up anything either.

            All of the patches have landed to master for this.  Moved the last few test changes to LU-15843.

            paf0186 Patrick Farrell added a comment - All of the patches have landed to master for this.  Moved the last few test changes to LU-15843 .

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/44293/
            Subject: LU-13799 llite: Remove unnecessary page get/put
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: c2e94f08cf3ff000b350faf61b6d25ebbad7970e

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/44293/ Subject: LU-13799 llite: Remove unnecessary page get/put Project: fs/lustre-release Branch: master Current Patch Set: Commit: c2e94f08cf3ff000b350faf61b6d25ebbad7970e

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/39438/
            Subject: LU-13799 llite: Do not get/put DIO pages
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 881b4c722296ff7ac22c6fd7988363f2cdad9f1e

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/39438/ Subject: LU-13799 llite: Do not get/put DIO pages Project: fs/lustre-release Branch: master Current Patch Set: Commit: 881b4c722296ff7ac22c6fd7988363f2cdad9f1e

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/39443/
            Subject: LU-13799 llite: Move free user pages
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 7f9b8465bc1125e51aa29cdc27db9a9d6fdc0b89

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/39443/ Subject: LU-13799 llite: Move free user pages Project: fs/lustre-release Branch: master Current Patch Set: Commit: 7f9b8465bc1125e51aa29cdc27db9a9d6fdc0b89

            "Patrick Farrell <pfarrell@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/46139
            Subject: LU-13799 tests: Use fallocate to fill OSTs
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 53aa72a20e7af4cdbfd825a8f35100d901266903

            gerrit Gerrit Updater added a comment - "Patrick Farrell <pfarrell@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/46139 Subject: LU-13799 tests: Use fallocate to fill OSTs Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 53aa72a20e7af4cdbfd825a8f35100d901266903

            "Patrick Farrell <pfarrell@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/46135
            Subject: LU-13799 tests: Reduce I/O sizes
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 0bd3f71bdced8c80513199a6ffebed96a4d0fb54

            gerrit Gerrit Updater added a comment - "Patrick Farrell <pfarrell@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/46135 Subject: LU-13799 tests: Reduce I/O sizes Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 0bd3f71bdced8c80513199a6ffebed96a4d0fb54

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/44209/
            Subject: LU-13799 llite: Implement lower/upper aio
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 46ff76137160b66f1d4437b3443859027faae9c4

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/44209/ Subject: LU-13799 llite: Implement lower/upper aio Project: fs/lustre-release Branch: master Current Patch Set: Commit: 46ff76137160b66f1d4437b3443859027faae9c4

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/44153/
            Subject: LU-13799 osc: Always set aio in anchor
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: eadccb33ac4bbe54a01da5168f6170702f9b2629

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/44153/ Subject: LU-13799 osc: Always set aio in anchor Project: fs/lustre-release Branch: master Current Patch Set: Commit: eadccb33ac4bbe54a01da5168f6170702f9b2629

            People

              paf0186 Patrick Farrell
              paf0186 Patrick Farrell
              Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: