[LU-12624] DNE3: striped directory allocate stripes by QoS

• Type: New Feature
• Resolution: Fixed
• Priority: Major
• Fix Version/s: Lustre 2.13.0
• Affects Version/s: Lustre 2.10.0, Lustre 2.12.0
• Labels: dne3
• Assignee: Lai Siyao
• Reporter: Lai Siyao

Description

Currently In striped directory creation, if MDT of stripes are not specified, the directory will created on the MDT where its parent is, and the first stripe will be located on the same MDT, and following stripes will be located on the following MDTs by MDT index. To rebalance MDTs usage, the following stripes should be located on the MDTs which has more spare space and inodes.

Issue Links

• is related to: LU-14146 Massive directory metadata operation performance decrease
• is related to: LU-12932 parallel-scale test rr_alloc fails with ‘failed while setting qos_threshold_rr & creat_count’
• is related to: LU-12434 use filesystem default dir layout for new directories
• is related to: LU-16623 lod_statfs_and_check() does not skip unusable OSTs
• is related to: LU-10767 Potential buffer overflow in lfs_setdirstripe
• is related to: LU-12785 DOM2: dynamic DoM component size as MDT becomes full
• is related to: LU-13417 DNE3: mkdir() automatically create remote directory on MDS which has more space
• is related to: LU-11213 DNE3: remote mkdir() in ROOT/ by default

Comments

[Peter Jones]

Landed for 2.13

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/35825/
Subject: LU-12624 lod: alloc dir stripes by QoS
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: c1d0a355a6a64ec97c9f56c38ba036e5e50cd8c4

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/35824/
Subject: LU-12624 obdclass: lu_tgt_descs cleanup
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 45222b2ef279d62ac3aab0e7babc55d77e3c93a2

[Gerrit Updater]

Lai Siyao ([e-mail]) uploaded a new patch: https://review.whamcloud.com/35825
Subject: LU-12624 lod: alloc dir stripes by QoS
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 57b5fe53f155f6282fe52eab938e028162454042

[Gerrit Updater]

Lai Siyao ([e-mail]) uploaded a new patch: https://review.whamcloud.com/35824
Subject: LU-12624 obdclass: lu_tgt_descs cleanup
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: fbe47941f32e45f2ad80469a91caccb4b2168069

[Lai Siyao]

This is a prerequisite for directory auto-restripe LU-11205.