Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-9090

increase default RPC size to 4MB

Details

    • Improvement
    • Resolution: Fixed
    • Major
    • Lustre 2.10.0
    • Lustre 2.10.0
    • None
    • 9223372036854775807

    Description

      The default RPC size is still 1MB, even though it could be increased to 4MB. This should be accompanied by a change to the default stripe size to also be 4MB so that widely-striped files can generate full RPCs without pinning so much memory on the client. This should provide a noticeable improvement in performance for streaming read/write workloads.

       

      1MB RPC 1MB RPC 4MB RPC 4MB RPC 16MB RPC 16MB RPC
      Write(Buffered) Write(O_DIRECT) Write(Buffered) Write(O_DIRECT) Write(Buffered) Write(O_DIRECT)
      16.2 22.5 26.7 30.3 28.2 32.3
                 
      Read(Buffered) Read(O_DIRECT) Read(Buffered) Read(O_DIRECT) Read(Buffered) Read(O_DIRECT)
      15.3 17.5 22.7 21.9 31.4 26.1

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-10465 increase default stripe size to 4MB

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-10463 Poor write performance periodically on repeated test runs

          • Major - Major loss of function.
          • Resolved

          Activity

            [LU-9090] increase default RPC size to 4MB
            adilger Andreas Dilger made changes -
            Summary Original: increase default RPC and stripe size to 4MB New: increase default RPC size to 4MB
            adilger Andreas Dilger made changes -
            Link New: This issue is related to LU-10465 [ LU-10465 ]
            adilger Andreas Dilger made changes -
            Description Original: The default RPC size is still 1MB, even though it could be increased to 4MB. This should be accompanied by a change to the default stripe size to also be 4MB so that widely-striped files can generate full RPCs without pinning so much memory on the client. This should provide a noticeable improvement in performance for streaming read/write workloads.

             
            |1MB RPC|1MB RPC|4MB RPC|4MB RPC|16MB RPC|16MB RPC|
            |Write(Buffered)|Write(O_DIRECT)|Write(Buffered)|Write(O_DIRECT)|Write(Buffered)|Write(O_DIRECT)|
            |16.2|22.5|26.7|30.3|28.2|32.3|
            | | | | | | |
            | | | | | | |
            |1MB RPC|4MB RPC|16MB RPC|
            |Read(Buffered)|Read(O_DIRECT)|Read(Buffered)|Read(O_DIRECT)|Read(Buffered)|Read(O_DIRECT)|
            |15.3|17.5|22.7|21.9|31.4|26.1|
            		 New: The default RPC size is still 1MB, even though it could be increased to 4MB. This should be accompanied by a change to the default stripe size to also be 4MB so that widely-striped files can generate full RPCs without pinning so much memory on the client. This should provide a noticeable improvement in performance for streaming read/write workloads.

             
            |1MB RPC|1MB RPC|4MB RPC|4MB RPC|16MB RPC|16MB RPC|
            |Write(Buffered)|Write(O_DIRECT)|Write(Buffered)|Write(O_DIRECT)|Write(Buffered)|Write(O_DIRECT)|
            |16.2|22.5|26.7|30.3|28.2|32.3|
            | | | | | | |
            |Read(Buffered)|Read(O_DIRECT)|Read(Buffered)|Read(O_DIRECT)|Read(Buffered)|Read(O_DIRECT)|
            |15.3|17.5|22.7|21.9|31.4|26.1|
            adilger Andreas Dilger made changes -
            Description Original: The default RPC size is still 1MB, even though it could be increased to 4MB. This should be accompanied by a change to the default stripe size to also be 4MB so that widely-striped files can generate full RPCs without pinning so much memory on the client. This should provide a noticeable improvement in performance for streaming read/write workloads. New: The default RPC size is still 1MB, even though it could be increased to 4MB. This should be accompanied by a change to the default stripe size to also be 4MB so that widely-striped files can generate full RPCs without pinning so much memory on the client. This should provide a noticeable improvement in performance for streaming read/write workloads.

             
            |1MB RPC|1MB RPC|4MB RPC|4MB RPC|16MB RPC|16MB RPC|
            |Write(Buffered)|Write(O_DIRECT)|Write(Buffered)|Write(O_DIRECT)|Write(Buffered)|Write(O_DIRECT)|
            |16.2|22.5|26.7|30.3|28.2|32.3|
            | | | | | | |
            | | | | | | |
            |1MB RPC|4MB RPC|16MB RPC|
            |Read(Buffered)|Read(O_DIRECT)|Read(Buffered)|Read(O_DIRECT)|Read(Buffered)|Read(O_DIRECT)|
            |15.3|17.5|22.7|21.9|31.4|26.1|
            adilger Andreas Dilger made changes -
            Link New: This issue is related to HP-150 [ HP-150 ]
            adilger Andreas Dilger made changes -
            Link New: This issue is related to HP-149 [ HP-149 ]
            adilger Andreas Dilger made changes -
            Fix Version/s New: Lustre 2.10.0 [ 12204 ]
            Fix Version/s Original: Lustre 2.10.1 [ 13090 ]
            Fix Version/s Original: Lustre 2.11.0 [ 13091 ]
            Resolution New: Fixed [ 1 ]
            Status Original: Open [ 1 ] New: Resolved [ 5 ]
            gerrit Gerrit Updater added a comment -

            Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/25336/
            Subject: LU-9090 ofd: increase default OST BRW size to 4MB
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 8c9c1f59d99c924e16317495269b8270cb0be921

            gerrit Gerrit Updater added a comment - Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/25336/ Subject: LU-9090 ofd: increase default OST BRW size to 4MB Project: fs/lustre-release Branch: master Current Patch Set: Commit: 8c9c1f59d99c924e16317495269b8270cb0be921
            pjones Peter Jones made changes -
            Fix Version/s New: Lustre 2.10.1 [ 13090 ]
            Fix Version/s New: Lustre 2.11.0 [ 13091 ]
            Fix Version/s Original: Lustre 2.10.0 [ 12204 ]
            gerrit Gerrit Updater added a comment -

            Jian Yu (jian.yu@intel.com) uploaded a new patch: https://review.whamcloud.com/27151
            Subject: LU-9090 lov: increase default stripe size to 4MB
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 205e114e64f9640882892a071bca5747d4613bb8

            gerrit Gerrit Updater added a comment - Jian Yu (jian.yu@intel.com) uploaded a new patch: https://review.whamcloud.com/27151 Subject: LU-9090 lov: increase default stripe size to 4MB Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 205e114e64f9640882892a071bca5747d4613bb8

            People

              yujian Jian Yu
              adilger Andreas Dilger
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: