[LU-12785] DOM2: dynamic DoM component size as MDT becomes full

• Type: Improvement
• Resolution: Fixed
• Priority: Major
• Fix Version/s: Lustre 2.14.0
• Labels: DoM2
• Assignee: Mikhail Pershin
• Reporter: Mikhail Pershin

Description

As the MDT becomes full it makes sense to reduce the size or completely remove DOM components from the layout if created from default directory or root filesystem layout. i think a reasonable heuristic would be that if the percentage of free inodes is larger than the percentage of free space, the size of the DoM component can be increased (up to the mdt.*.dom_stripesize maximum). If the percentage of free inodes is smaller than the percentage of free space, or if the MDT is within configurable threshold (e.g. mdt.*.dom_threshold=10%) of being full, the DoM component size should be cut in half, and within 1/2 of mdt.*.dom_threshold the DoM component should be removed (or similar, see more complex options below).

Note that the DoM component size must be a multiple of LOV_MIN_STRIPE_SIZE (64KiB) so it will not be possible to exactly match the inode ratio with the blocks ratio, but it makes sense to keep them relatively well balanced by default.

It could be proposed to have a policy that each 1/4 reduction in free space below mdt.*.dom_threshold should reduce the DoM component size by 1/2 until it is below the 64KiB minimum component size. That would ensure that the ldiskfs MDT+DoM filesystem is not completely filled with DoM data when it is close to being filled. This is most critical for ldiskfs filesystems, since ZFS has dynamic inode allocation, but can still help ZFS to avoid being totally filled by DoM data. This should also be helped by LU-12624 to balance DNE directory allocations across MDTs, but that is only a coarse-grained balance and will not prevent MDTs filling with DoM data too quickly.

Issue Links

• is related to: LU-12624 DNE3: striped directory allocate stripes by QoS
• is related to: LU-13058 Intermediate component removal (PFL/SEL)

Comments

[Gerrit Updater]

Mike Pershin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/39958
Subject: LU-12785 dom: adjust DOM stripe size by free space
Project: fs/lustre-release
Branch: b2_12
Current Patch Set: 1
Commit: 2a9ebe70d33e6f02cb7db7d3d810c16ef40e587a

[Peter Jones]

Landed for 2.14

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/38337/
Subject: LU-12785 dom: fix DoM component deletion code
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: b24ba6c6ea1b3cc514241b01968bf31bc8f9cf46

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/37904/
Subject: LU-12785 dom: adjust DOM stripe size by free space
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: f2a3bbfb3f3fef910201259dd1827bf8c475da06

[Gerrit Updater]

Mike Pershin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/38337
Subject: LU-12785 dom: fix DoM component deletion code
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: f4e21c851bd4b0f0cae6b13223ae62e43fb335fc

[Gerrit Updater]

Mike Pershin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/37904
Subject: LU-12785 dom: adjust DOM stripe size by free space
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 9eef5743de88857ff7f3c05d2bb2b7c0d2bd5d41