[LU-14393] Batching Processing Framework for Lustre Created: 01/Feb/21  Updated: 23/Apr/23  Resolved: 23/Apr/23

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: None
Fix Version/s: Lustre 2.16.0

Type: Improvement Priority: Minor
Reporter: Qian Yingjin Assignee: Qian Yingjin
Resolution: Fixed Votes: 0
Labels: None

Issue Links:
Related
is related to LU-15975 Statahead_V1 Features Resolved
is related to LU-1653 Analyze Getattr Aggregation In Progress
is related to LU-2533 Batch RPC Open
is related to LU-14139 batched statahead processing Resolved
Rank (Obsolete): 9223372036854775807

 Description   

Batching processing can obtain boost performance. The larger the batch size, the higher the latency for the entire batch. Although the latency for the entire batch of operations is higher than the latency of any single operation, the throughput of the batch of operations is much higher.

This ticket is used to track this new feature.



 Comments   
Comment by Gerrit Updater [ 01/Feb/21 ]

Yingjin Qian (qian@ddn.com) uploaded a new patch: https://review.whamcloud.com/41378
Subject: LU-14393 protocol: basic batching processing framework
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 151338de4c743d26de8e4b11590ffa8f1c57ffab

Comment by Gerrit Updater [ 30/May/21 ]

Yingjin Qian (qian@ddn.com) uploaded a new patch: https://review.whamcloud.com/43874
Subject: LU-14393 protocol: reserve connect flag for batch RPC
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 8b582c612f2a611ebfedcce1b8ec61a6cca04e41

Comment by Gerrit Updater [ 16/Aug/22 ]

"Yingjin Qian <qian@ddn.com>" uploaded a new patch: https://review.whamcloud.com/48228
Subject: LU-14393 recovery: reply reconstruction for batched RPCs
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 20f2025939d2bf718de6064582ff6486e64e0fca

Comment by Gerrit Updater [ 27/Jan/23 ]

"Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/41378/
Subject: LU-14393 protocol: basic batching processing framework
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 840274b5c5e95e44a5ffedd08ebb4727bc39a845

Comment by Gerrit Updater [ 27/Jan/23 ]

"Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/48228/
Subject: LU-14393 recovery: reply reconstruction for batched RPCs
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 178988d67aa2f83aa65badc81e305fac0328838d

Comment by Peter Jones [ 23/Apr/23 ]

Landed for 2.16

Generated at Sat Feb 10 03:09:21 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.