[LU-19199] Ensure all fast recovery features are enabled and working

• Type: Task
• Resolution: Unresolved
• Priority: Medium
• Labels: fast_recovery
• Severity: 3
• Assignee: Colin Faber - TLC
• Reporter: Colin Faber - TLC

Description

We should verify that all known fast recovery type features are enabled and working correctly. There are a number of existing Lustre features that could be used (and further improved) to reduce recovery time.

Depending on the IO model of the applications running on the cluster (e.g. shared file writers in a monolithic MPI application vs. independent "ensemble" processes working on their own files and directories) it should be possible to "tune" recovery to be more responsive, and potentially avoid waiting for unresponsive clients if they are not using directories or files of interest to the recovered clients. The complex part is to automatically determine if clients have overlapping domains of interest or not.

Issue Links

• is related to: LU-20135 Client reconnection extending recovery causes unnecessary delays and can lead to extra evictions
• is related to: LU-18681 Histogram of client reconnection times during recovery
• is related to: LU-13643 FLR3-IM: Immediate write mirroring
• is related to: LU-10911 FLR2: Read only erasure coding
• is related to: LU-17819 LMR1a: Replicate MGS Services to Multiple MDS
• is related to: LU-13932 reduce maximum wait_time for MMP recovery