Metadata writeback cache support (LU-10938)

[LU-15621] WBC: Recovery mechanism for batched RPC Created: 05/Mar/22  Updated: 15/Feb/23

Status: Open
Project: Lustre
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Technical task Priority: Minor
Reporter: Qian Yingjin Assignee: WC Triage
Resolution: Unresolved Votes: 0
Labels: None

Issue Links:
Related
Rank (Obsolete): 9223372036854775807

 Description   

Batch processing framework is able to pack many individual requests into one large RPC. This batch RPC is then transferred to the server via bulk I/O and executed using a single server round-trip. Batch processing therefore reduces the number of simultaneous requests processed by the server.

After batched RPC framework introduced, it can boost the metadata performance dramatically. However, it also increases the complexity of the recovery, such as how to reconstruct the reply in case of the RPC resend if the reply was lost.

The goal of this project is to adopt the existed recovery mechanism with batched RPC framework which will be used by Writeback Caching (WBC) and batched stat ahead.



 Comments   
Comment by Gerrit Updater [ 11/Mar/22 ]

"Yingjin Qian <qian@ddn.com>" uploaded a new patch: https://review.whamcloud.com/46799
Subject: LU-15621 wbc: reply reconstruction for the batched RPC
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: e259a0069e935a2cc5a82d2ef02cc2a8a01e5c3a

Comment by Gerrit Updater [ 14/Mar/22 ]

"Yingjin Qian <qian@ddn.com>" uploaded a new patch: https://review.whamcloud.com/46817
Subject: LU-15621 wbc: add update flag for the batched RPC
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 233a656a15f6d465b3925e55009201472ea03859

Comment by Gerrit Updater [ 22/Mar/22 ]

"Yingjin Qian <qian@ddn.com>" uploaded a new patch: https://review.whamcloud.com/46886
Subject: LU-15621 wbc: free buffer when batched RPC is committed
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 35eae0b00f45257c578a6fb00daad9200acc1fbf

Generated at Sat Feb 10 03:19:53 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.