[LU-17427] reduce hold time for BFL rename lock

• Type: Improvement
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.17.0
• Labels: medium metadata performance
• Severity: 3
• Assignee: Keguang Xu
• Reporter: Andreas Dilger

Description

During a non-parallel rename, the BFL resource is locked by the MDS thread first, then (up to) 4 child FIDs are locked. This means the BFL can be held for a long time if any client holding one of those locks is non-responsive for some reason. There may potentially be hundreds of clients holding PR locks on the source or target directory and/or child being renamed.

To reduce the hold time and contention on the BFL resource lock, the MDS could get the 4 child locks first (to cancel the majority of lock holders), drop those locks, then get the BFL resource lock and re-lock the children.

In many cases, this would allow many or all contended DLM locks held by children to be cancelled without holding the BFL lock, which avoids holding the BFL when talking to slow clients, and also reduces the overall time that the BFL lock is held (allowing more renames to be done).

A further optimization might be to acquire the child locks first, then "trylock" the BFL lock afterward. If the BFL locking succeeds (i.e. it is uncontendeed), then verify the parent and child objects have not been modified since they were locked, maybe also the path connectivity. That would help avoid lock ping-pong in situations where the parent/child locks continue to be contended, and the MDS would only get them once if it works.

Issue Links

• is related to: LU-17426 parallel cross-directory rename of regular files on single MDT
• is related to: LU-17434 DNE3: add exclude list for remote subdirectory creation
• is related to: LU-17441 move rename RPC handling to MDS_IO_PORTAL

Comments

[Peter Jones]

Merged for 2.17

[Gerrit Updater]

"Oleg Drokin <[e-mail]>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/57741/
Subject: LU-17427 mdt: reduce hold time for BFL rename lock
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 8dbf0494798862b54e21fd02fb0439ce9633b4cb

[Gerrit Updater]

"kg.xu <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/58027
Subject: LU-17427 test: reduce hold time for BFL rename lock
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 1a2fac00a56335ed88b6365b8093184a884c0696

[Gerrit Updater]

"kg.xu <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/57741
Subject: LU-17427 mdt: reduce hold time for BFL rename lock
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 2d4781e035d1f0f3cc09b9c3b4703aceb6383b43