[LU-10916] Improve lfs mirror resync performance

• Type: Improvement
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.12.0
• Affects Version/s: Lustre 2.11.0
• Labels: FLR2
• Assignee: Zhenyu Xu
• Reporter: Andreas Dilger

Description

My understanding is that the current lfs mirror resync implementation will do resync on each stale mirror of a file separately (read+write, read+write, ... each full component), rather than doing the resync in parallel (read+write+write+write ... for all stale components).

This potentially slows down resync significantly, because the same data may need to be read from disk multiple times if the file is very large. It would be better to write all of the stale replicas at the same time.

There may be other performance optimizations possible once the basic FLR functionality and infrastructure is good enough that we can focus on performance.

Issue Links

• is related to: LU-11226 sanity-flr test 200 fails with 'checksum error for mirror 3'
• is related to: LU-10191 FLR2: Server Local Client (SLC)

Comments

[Peter Jones]

Landed for 2.12

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/32808/
Subject: LU-10916 lfs: improve lfs mirror resync
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 0e5c12ac29a9622e8ca05d5e39cd5e2a721ace93

[Gerrit Updater]

Bobi Jam ([e-mail]) uploaded a new patch: https://review.whamcloud.com/32808
Subject: LU-10916 lfs: improve lfs mirror resync
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: d860341928887a5cbfc70320913e3f63dcf97534