Details
-
Technical task
-
Resolution: Unresolved
-
Minor
-
None
-
None
-
None
-
9223372036854775807
Description
Batch processing framework is able to pack many individual requests into one large RPC. This batch RPC is then transferred to the server via bulk I/O and executed using a single server round-trip. Batch processing therefore reduces the number of simultaneous requests processed by the server.
After batched RPC framework introduced, it can boost the metadata performance dramatically. However, it also increases the complexity of the recovery, such as how to reconstruct the reply in case of the RPC resend if the reply was lost.
The goal of this project is to adopt the existed recovery mechanism with batched RPC framework which will be used by Writeback Caching (WBC) and batched stat ahead.