[LU-9090] increase default RPC size to 4MB Created: 30/Sep/15  Updated: 23/Jan/20  Resolved: 29/May/17

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: Lustre 2.10.0
Fix Version/s: Lustre 2.10.0

Type: Improvement Priority: Major
Reporter: Andreas Dilger Assignee: Jian Yu
Resolution: Fixed Votes: 0
Labels: None

Issue Links:
Related
is related to LU-10465 increase default stripe size to 4MB Resolved
is related to LU-10463 Poor write performance periodically o... Resolved
Rank (Obsolete): 9223372036854775807

 Description   

The default RPC size is still 1MB, even though it could be increased to 4MB. This should be accompanied by a change to the default stripe size to also be 4MB so that widely-striped files can generate full RPCs without pinning so much memory on the client. This should provide a noticeable improvement in performance for streaming read/write workloads.

 

1MB RPC 1MB RPC 4MB RPC 4MB RPC 16MB RPC 16MB RPC
Write(Buffered) Write(O_DIRECT) Write(Buffered) Write(O_DIRECT) Write(Buffered) Write(O_DIRECT)
16.2 22.5 26.7 30.3 28.2 32.3
           
Read(Buffered) Read(O_DIRECT) Read(Buffered) Read(O_DIRECT) Read(Buffered) Read(O_DIRECT)
15.3 17.5 22.7 21.9 31.4 26.1


 Comments   
Comment by Gerrit Updater [ 08/Feb/17 ]

Andreas Dilger (andreas.dilger@intel.com) uploaded a new patch: https://review.whamcloud.com/25336
Subject: LU-9090 ofd: increase default OST BRW size to 4MB
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 246f0375770a87744aefb883f9d6966b006bc6d6

Comment by Andreas Dilger [ 06/Mar/17 ]

Jian, do you think you have time to look through the test failures on this patch to see what needs to be fixed for it to land? Increasing the default RPC size to 4MB should improve the "out of box" performance for Lustre, and is something that many sites already have configured today, so I think that we should make it the default.

Comment by Jian Yu [ 07/Mar/17 ]

Sure, Andreas, will do.

Comment by Gerrit Updater [ 17/May/17 ]

Jian Yu (jian.yu@intel.com) uploaded a new patch: https://review.whamcloud.com/27151
Subject: LU-9090 lov: increase default stripe size to 4MB
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 205e114e64f9640882892a071bca5747d4613bb8

Comment by Gerrit Updater [ 29/May/17 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/25336/
Subject: LU-9090 ofd: increase default OST BRW size to 4MB
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 8c9c1f59d99c924e16317495269b8270cb0be921

Generated at Sat Feb 10 02:23:09 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.