[LU-16011] LNet selftest should use a preallocated bulk on the server side. Created: 14/Jul/22  Updated: 13/Mar/23  Resolved: 01/Sep/22

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: None
Fix Version/s: Lustre 2.16.0

Type: Improvement Priority: Critical
Reporter: Alexey Lyashkov Assignee: Alexey Lyashkov
Resolution: Fixed Votes: 0
Labels: None

Rank (Obsolete): 9223372036854775807

 Description   

Cray testing have show an LST limited with 35Gb/s 1M bulk transfers with 3 rail server and 16 HDR clients. During profile, I found a LST is cpu bound with page cache operations, because server side don't have an preallocated bulk's for transfers.
Once preallocation done - server able to achieve a wire speed - 73 Gb/s with very low cpu power.

LNet Bandwidth of servers]
[R] Avg: 11.28    MB/s  Min: 11.28    MB/s  Max: 11.28    MB/s
[W] Avg: 73949.30 MB/s  Min: 73949.30 MB/s  Max: 73949.30 MB/s


 Comments   
Comment by Gerrit Updater [ 14/Jul/22 ]

"Alexey Lyashkov <alexey.lyashkov@hpe.com>" uploaded a new patch: https://review.whamcloud.com/47952
Subject: LU-16011 lnet: use preallocate bulk for server
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 9c6a446980903345e88b449d10e2854735c5fa17

Comment by Gerrit Updater [ 01/Sep/22 ]

"Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/47952/
Subject: LU-16011 lnet: use preallocate bulk for server
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 2447564e120cf622627a5ab81051657f6ce5ece2

Comment by Peter Jones [ 01/Sep/22 ]

Landed for 2.16

Comment by Gerrit Updater [ 13/Mar/23 ]

"Alexey Lyashkov <alexey.lyashkov@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/50276
Subject: LU-16011 lnet: use preallocate bulk for server
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: c5b2887240a85712e3a4b741ece40f0f9c248c27

Generated at Sat Feb 10 03:23:12 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.