Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-9090

increase default RPC size to 4MB

Details

    • Improvement
    • Resolution: Fixed
    • Major
    • Lustre 2.10.0
    • Lustre 2.10.0
    • None
    • 9223372036854775807

    Description

      The default RPC size is still 1MB, even though it could be increased to 4MB. This should be accompanied by a change to the default stripe size to also be 4MB so that widely-striped files can generate full RPCs without pinning so much memory on the client. This should provide a noticeable improvement in performance for streaming read/write workloads.

       

      1MB RPC 1MB RPC 4MB RPC 4MB RPC 16MB RPC 16MB RPC
      Write(Buffered) Write(O_DIRECT) Write(Buffered) Write(O_DIRECT) Write(Buffered) Write(O_DIRECT)
      16.2 22.5 26.7 30.3 28.2 32.3
                 
      Read(Buffered) Read(O_DIRECT) Read(Buffered) Read(O_DIRECT) Read(Buffered) Read(O_DIRECT)
      15.3 17.5 22.7 21.9 31.4 26.1

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-10465 increase default stripe size to 4MB

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-10463 Poor write performance periodically on repeated test runs

          • Major - Major loss of function.
          • Resolved

          Activity

            [LU-9090] increase default RPC size to 4MB
            adilger Andreas Dilger made changes -
            Summary Original: increase default RPC and stripe size to 4MB New: increase default RPC size to 4MB
            adilger Andreas Dilger made changes -
            Link New: This issue is related to LU-10465 [ LU-10465 ]
            adilger Andreas Dilger made changes -
            Description Original: The default RPC size is still 1MB, even though it could be increased to 4MB. This should be accompanied by a change to the default stripe size to also be 4MB so that widely-striped files can generate full RPCs without pinning so much memory on the client. This should provide a noticeable improvement in performance for streaming read/write workloads.

             
            |1MB RPC|1MB RPC|4MB RPC|4MB RPC|16MB RPC|16MB RPC|
            |Write(Buffered)|Write(O_DIRECT)|Write(Buffered)|Write(O_DIRECT)|Write(Buffered)|Write(O_DIRECT)|
            |16.2|22.5|26.7|30.3|28.2|32.3|
            | | | | | | |
            | | | | | | |
            |1MB RPC|4MB RPC|16MB RPC|
            |Read(Buffered)|Read(O_DIRECT)|Read(Buffered)|Read(O_DIRECT)|Read(Buffered)|Read(O_DIRECT)|
            |15.3|17.5|22.7|21.9|31.4|26.1|
            		 New: The default RPC size is still 1MB, even though it could be increased to 4MB. This should be accompanied by a change to the default stripe size to also be 4MB so that widely-striped files can generate full RPCs without pinning so much memory on the client. This should provide a noticeable improvement in performance for streaming read/write workloads.

             
            |1MB RPC|1MB RPC|4MB RPC|4MB RPC|16MB RPC|16MB RPC|
            |Write(Buffered)|Write(O_DIRECT)|Write(Buffered)|Write(O_DIRECT)|Write(Buffered)|Write(O_DIRECT)|
            |16.2|22.5|26.7|30.3|28.2|32.3|
            | | | | | | |
            |Read(Buffered)|Read(O_DIRECT)|Read(Buffered)|Read(O_DIRECT)|Read(Buffered)|Read(O_DIRECT)|
            |15.3|17.5|22.7|21.9|31.4|26.1|
            adilger Andreas Dilger made changes -
            Description Original: The default RPC size is still 1MB, even though it could be increased to 4MB. This should be accompanied by a change to the default stripe size to also be 4MB so that widely-striped files can generate full RPCs without pinning so much memory on the client. This should provide a noticeable improvement in performance for streaming read/write workloads. New: The default RPC size is still 1MB, even though it could be increased to 4MB. This should be accompanied by a change to the default stripe size to also be 4MB so that widely-striped files can generate full RPCs without pinning so much memory on the client. This should provide a noticeable improvement in performance for streaming read/write workloads.

             
            |1MB RPC|1MB RPC|4MB RPC|4MB RPC|16MB RPC|16MB RPC|
            |Write(Buffered)|Write(O_DIRECT)|Write(Buffered)|Write(O_DIRECT)|Write(Buffered)|Write(O_DIRECT)|
            |16.2|22.5|26.7|30.3|28.2|32.3|
            | | | | | | |
            | | | | | | |
            |1MB RPC|4MB RPC|16MB RPC|
            |Read(Buffered)|Read(O_DIRECT)|Read(Buffered)|Read(O_DIRECT)|Read(Buffered)|Read(O_DIRECT)|
            |15.3|17.5|22.7|21.9|31.4|26.1|
            adilger Andreas Dilger made changes -
            Link New: This issue is related to HP-150 [ HP-150 ]
            adilger Andreas Dilger made changes -
            Link New: This issue is related to HP-149 [ HP-149 ]
            adilger Andreas Dilger made changes -
            Fix Version/s New: Lustre 2.10.0 [ 12204 ]
            Fix Version/s Original: Lustre 2.10.1 [ 13090 ]
            Fix Version/s Original: Lustre 2.11.0 [ 13091 ]
            Resolution New: Fixed [ 1 ]
            Status Original: Open [ 1 ] New: Resolved [ 5 ]
            pjones Peter Jones made changes -
            Fix Version/s New: Lustre 2.10.1 [ 13090 ]
            Fix Version/s New: Lustre 2.11.0 [ 13091 ]
            Fix Version/s Original: Lustre 2.10.0 [ 12204 ]
            adilger Andreas Dilger made changes -
            Assignee Original: WC Triage [ wc-triage ] New: Jian Yu [ yujian ]
            adilger Andreas Dilger made changes -
            Link New: This issue is related to NEC-34 [ NEC-34 ]

            People

              yujian Jian Yu
              adilger Andreas Dilger
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: