Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-11775

buffered write single client improvements

Details

    • Improvement
    • Resolution: Fixed
    • Minor
    • Lustre 2.13.0
    • None
    • None
    • 9223372036854775807

    Description

      After landing LU-9906 the read performance improved to an acceptable level. Write performance also increased but still needs some improvements to reach the same level. This ticket tracks the work.

      Attachments

        1. master.svg
          275 kB
        2. master+LU-11775.svg
          306 kB
        3. master+LU-11775+LU-9920.svg
          320 kB

        Issue Links

          Activity

            [LU-11775] buffered write single client improvements
            dongyang Dongyang Li added a comment -

            As we can see LU-9920 can reduce the overhead in set_page_dirty/write_commit_callback.

            There is still __ _raw_spin_lock from osc_page_cache_add which I can not figure out the exact location.

            mpirun -np 32 ior -w -t 16m -b 16g -F -e -vv -o /cache1/file -k

            master:

            Max Write: 15237.92 MiB/sec (15978.12 MB/sec)

            master + LU-11775:

            Max Write: 17045.11 MiB/sec (17873.09 MB/sec)

            master + LU-11775 + LU-9920:

            Max Write: 17476.77 MiB/sec (18325.72 MB/sec)

            dongyang Dongyang Li added a comment - As we can see LU-9920 can reduce the overhead in set_page_dirty/write_commit_callback. There is still __ _raw_spin_lock from osc_page_cache_add which I can not figure out the exact location. mpirun -np 32 ior -w -t 16m -b 16g -F -e -vv -o /cache1/file -k master: Max Write: 15237.92 MiB/sec (15978.12 MB/sec) master + LU-11775 : Max Write: 17045.11 MiB/sec (17873.09 MB/sec) master + LU-11775 + LU-9920 : Max Write: 17476.77 MiB/sec (18325.72 MB/sec)

            Li Dongyang (dongyangli@ddn.com) uploaded a new patch: https://review.whamcloud.com/33862
            Subject: LU-11775 osc: check imp_invalid without imp_lock
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: db8dda7213403e2b2caedf33b55e4fa5f2e62db6

            gerrit Gerrit Updater added a comment - Li Dongyang (dongyangli@ddn.com) uploaded a new patch: https://review.whamcloud.com/33862 Subject: LU-11775 osc: check imp_invalid without imp_lock Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: db8dda7213403e2b2caedf33b55e4fa5f2e62db6

            Li Dongyang (dongyangli@ddn.com) uploaded a new patch: https://review.whamcloud.com/33861
            Subject: LU-11775 obdclass: protect imp_sec using rwlock_t
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 87b1a916e6955c10943d6ee6b9b4d9af393c93cc

            gerrit Gerrit Updater added a comment - Li Dongyang (dongyangli@ddn.com) uploaded a new patch: https://review.whamcloud.com/33861 Subject: LU-11775 obdclass: protect imp_sec using rwlock_t Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 87b1a916e6955c10943d6ee6b9b4d9af393c93cc

            Li Dongyang (dongyangli@ddn.com) uploaded a new patch: https://review.whamcloud.com/33860
            Subject: LU-11775 osc: check if opg is in lru list without locking
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 4225477391bd60784151a6102f1fc989e11f7a92

            gerrit Gerrit Updater added a comment - Li Dongyang (dongyangli@ddn.com) uploaded a new patch: https://review.whamcloud.com/33860 Subject: LU-11775 osc: check if opg is in lru list without locking Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 4225477391bd60784151a6102f1fc989e11f7a92

            Li Dongyang (dongyangli@ddn.com) uploaded a new patch: https://review.whamcloud.com/33859
            Subject: LU-11775 osc: reduce atomic ops in osc_enter_cache_try
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 95d0af71efca35ea610bbddec2025100b052cdf5

            gerrit Gerrit Updater added a comment - Li Dongyang (dongyangli@ddn.com) uploaded a new patch: https://review.whamcloud.com/33859 Subject: LU-11775 osc: reduce atomic ops in osc_enter_cache_try Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 95d0af71efca35ea610bbddec2025100b052cdf5

            Li Dongyang (dongyangli@ddn.com) uploaded a new patch: https://review.whamcloud.com/33858
            Subject: LU-11775 osc: reduce lock contention in osc_unreserve_grant
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: ffcc069b2b654f6437b090b8ff8c67b5d1ac2ea6

            gerrit Gerrit Updater added a comment - Li Dongyang (dongyangli@ddn.com) uploaded a new patch: https://review.whamcloud.com/33858 Subject: LU-11775 osc: reduce lock contention in osc_unreserve_grant Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: ffcc069b2b654f6437b090b8ff8c67b5d1ac2ea6

            People

              dongyang Dongyang Li
              dongyang Dongyang Li
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: