Massive directory metadata operation performance decrease
(LU-14146)
|
|
| Status: | Resolved |
| Project: | Lustre |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | Lustre 2.16.0 |
| Type: | Technical task | Priority: | Minor |
| Reporter: | Lai Siyao | Assignee: | Lai Siyao |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Issue Links: |
|
||||||||||||||||
| Rank (Obsolete): | 9223372036854775807 | ||||||||||||||||
| Description |
|
If object is on remote MDT, PDO lock is not supported, because two locks can't be fetched in one RPC right now, once the batch processing framework is ready, these two locks can be enqueued in a batch. This will greatly reduce conflicts in parent lock, and improve remote directory creation/unlink performance. Since filesystem-wide default directory layout is set by default, this will speed up mdtest directory creation/unlink test. |
| Comments |
| Comment by Gerrit Updater [ 08/Mar/22 ] |
|
"Lai Siyao <lai.siyao@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/46733 |
| Comment by Andreas Dilger [ 10/Jul/23 ] |
|
Lai, will this patch improve mdtest shared directory create performance in striped directories? |
| Comment by Lai Siyao [ 10/Jul/23 ] |
|
AFAIK mdtest perf test creates local sub directories, which won't be affected by this patch. This improves mkdir performance for cases that both local and remote directories will be created. |
| Comment by Gerrit Updater [ 31/Aug/23 ] |
|
"Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/46733/ |
| Comment by Peter Jones [ 31/Aug/23 ] |
|
Landed for 2.16 |
[LU-15526]