[LU-15850] MDT QOS should always be used for round-robin directories.

• Type: Improvement
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.16.0
• Affects Version/s: Lustre 2.15.0
• Labels: MON
• Assignee: Lai Siyao
• Reporter: Andreas Dilger

Description

The MDT QOS should always be used for subdirectories created in a parent that has round-robin activated, if the MDT space balance exceeds qos_threshold_rr. Otherwise, subdirectories in that directory tree will suddenly change from r-r to being "sticky" on a single MDT, which significantly changed the behavior and load distribution across MDTs. The "threshold by depth" should only be used for directories that would otherwise have always been created on the parent already.

Related to this, it should be possible to tune the weighting of subdirectories by depth so that this can be adjusted without recompiling the code.

Issue Links

• is related to: LU-13439 DNE3: MDT QOS tuning to avoid full MDTs completely
• is related to: LU-14762 qos subdirectory creation stay on parent MDT if less full than average doesn't work as expected
• is related to: LU-13417 DNE3: mkdir() automatically create remote directory on MDS which has more space
• is related to: LU-15910 ROOT default LMV is not working for subdirectory mount
• is related to: LU-13440 DNE3: limit directory default layout inheritance

Comments

[Peter Jones]

Landed for 2.16

[Gerrit Updater]

"Oleg Drokin <[e-mail]>" merged in patch https://review.whamcloud.com/47578/
Subject: LU-15850 lmv: always space-balance r-r directories
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 37c1ddc34d3a1e61c5533f48cb29fe2258ca2907

[Gerrit Updater]

"Oleg Drokin <[e-mail]>" merged in patch https://review.whamcloud.com/47577/
Subject: LU-15850 llite: pass dmv inherit depth instead of dir depth
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: c23c68a52a04369101db2bd3b1d3da23025fcf48

[Gerrit Updater]

"Oleg Drokin <[e-mail]>" merged in patch https://review.whamcloud.com/47576/
Subject: LU-15850 mdt: pack default LMV in open reply
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: f6e4272fb0be5b798b7685bb40067e3f6877c8a5

[Gerrit Updater]

"Lai Siyao <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/47789
Subject: LU-15850 llite: implicit default LMV inherit
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: cc65c9deaab82dfc7ab81235ba8c0339fe8fc73b

[Gerrit Updater]

"Lai Siyao <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/47679
Subject: LU-15850 llite: interop test with 2.14
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 03fba460bc0f1b6a747b792715ac7f8f059eacfe

[Gerrit Updater]

"Lai Siyao <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/47578
Subject: LU-15850 lmv: always space-balance r-r directories
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 9017448833a249ce29ea0c5d26c60e3d5dc03201

[Gerrit Updater]

"Lai Siyao <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/47577
Subject: LU-15850 llite: pass dmv inherit depth instead of dir depth
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: d33bd101c7b2a9184615d6ff4751fe8d6222283b

[Gerrit Updater]

"Lai Siyao <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/47576
Subject: LU-15850 mdt: pack default LMV in open reply
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: c31475758946fd5f32382b5415ab7c0c1b46913c

[Andreas Dilger]

I was trying to check MF_RR_MKDIR to see if the directory has round-robin allocation enabled, so that the "stay on parent" check in lmv_locate_tgt_qos() would not be used if the parent is r-r.