[LU-10916] Improve lfs mirror resync performance Created: 14/Apr/18 Updated: 14/Aug/18 Resolved: 06/Aug/18 |
|
| Status: | Resolved |
| Project: | Lustre |
| Component/s: | None |
| Affects Version/s: | Lustre 2.11.0 |
| Fix Version/s: | Lustre 2.12.0 |
| Type: | Improvement | Priority: | Minor |
| Reporter: | Andreas Dilger | Assignee: | Zhenyu Xu |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | FLR2 | ||
| Issue Links: |
|
||||||||||||
| Rank (Obsolete): | 9223372036854775807 | ||||||||||||
| Description |
|
My understanding is that the current lfs mirror resync implementation will do resync on each stale mirror of a file separately (read+write, read+write, ... each full component), rather than doing the resync in parallel (read+write+write+write ... for all stale components). This potentially slows down resync significantly, because the same data may need to be read from disk multiple times if the file is very large. It would be better to write all of the stale replicas at the same time. There may be other performance optimizations possible once the basic FLR functionality and infrastructure is good enough that we can focus on performance. |
| Comments |
| Comment by Gerrit Updater [ 11/Jul/18 ] |
|
Bobi Jam (bobijam@hotmail.com) uploaded a new patch: https://review.whamcloud.com/32808 |
| Comment by Gerrit Updater [ 06/Aug/18 ] |
|
Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/32808/ |
| Comment by Peter Jones [ 06/Aug/18 ] |
|
Landed for 2.12 |