Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-9090

increase default RPC size to 4MB

Details

    • Improvement
    • Resolution: Fixed
    • Major
    • Lustre 2.10.0
    • Lustre 2.10.0
    • None
    • 9223372036854775807

    Description

      The default RPC size is still 1MB, even though it could be increased to 4MB. This should be accompanied by a change to the default stripe size to also be 4MB so that widely-striped files can generate full RPCs without pinning so much memory on the client. This should provide a noticeable improvement in performance for streaming read/write workloads.

       

      1MB RPC 1MB RPC 4MB RPC 4MB RPC 16MB RPC 16MB RPC
      Write(Buffered) Write(O_DIRECT) Write(Buffered) Write(O_DIRECT) Write(Buffered) Write(O_DIRECT)
      16.2 22.5 26.7 30.3 28.2 32.3
                 
      Read(Buffered) Read(O_DIRECT) Read(Buffered) Read(O_DIRECT) Read(Buffered) Read(O_DIRECT)
      15.3 17.5 22.7 21.9 31.4 26.1

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-10465 increase default stripe size to 4MB

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-10463 Poor write performance periodically on repeated test runs

          • Major - Major loss of function.
          • Resolved

          Activity

            [LU-9090] increase default RPC size to 4MB
            gerrit Gerrit Updater added a comment -

            Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/25336/
            Subject: LU-9090 ofd: increase default OST BRW size to 4MB
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 8c9c1f59d99c924e16317495269b8270cb0be921

            gerrit Gerrit Updater added a comment - Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/25336/ Subject: LU-9090 ofd: increase default OST BRW size to 4MB Project: fs/lustre-release Branch: master Current Patch Set: Commit: 8c9c1f59d99c924e16317495269b8270cb0be921
            gerrit Gerrit Updater added a comment -

            Jian Yu (jian.yu@intel.com) uploaded a new patch: https://review.whamcloud.com/27151
            Subject: LU-9090 lov: increase default stripe size to 4MB
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 205e114e64f9640882892a071bca5747d4613bb8

            gerrit Gerrit Updater added a comment - Jian Yu (jian.yu@intel.com) uploaded a new patch: https://review.whamcloud.com/27151 Subject: LU-9090 lov: increase default stripe size to 4MB Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 205e114e64f9640882892a071bca5747d4613bb8
            yujian Jian Yu added a comment -

            Sure, Andreas, will do.

            yujian Jian Yu added a comment - Sure, Andreas, will do.
            adilger Andreas Dilger added a comment -

            Jian, do you think you have time to look through the test failures on this patch to see what needs to be fixed for it to land? Increasing the default RPC size to 4MB should improve the "out of box" performance for Lustre, and is something that many sites already have configured today, so I think that we should make it the default.

            adilger Andreas Dilger added a comment - Jian, do you think you have time to look through the test failures on this patch to see what needs to be fixed for it to land? Increasing the default RPC size to 4MB should improve the "out of box" performance for Lustre, and is something that many sites already have configured today, so I think that we should make it the default.
            gerrit Gerrit Updater added a comment -

            Andreas Dilger (andreas.dilger@intel.com) uploaded a new patch: https://review.whamcloud.com/25336
            Subject: LU-9090 ofd: increase default OST BRW size to 4MB
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 246f0375770a87744aefb883f9d6966b006bc6d6

            gerrit Gerrit Updater added a comment - Andreas Dilger (andreas.dilger@intel.com) uploaded a new patch: https://review.whamcloud.com/25336 Subject: LU-9090 ofd: increase default OST BRW size to 4MB Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 246f0375770a87744aefb883f9d6966b006bc6d6

            People

              yujian Jian Yu
              adilger Andreas Dilger
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: