[LU-14734] enable large_dir on existing MDTs Created: 04/Jun/21  Updated: 13/Jan/22  Resolved: 03/Sep/21

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: Lustre 2.14.0, Lustre 2.15.0
Fix Version/s: Lustre 2.15.0

Type: Bug Priority: Major
Reporter: Andreas Dilger Assignee: Andreas Dilger
Resolution: Fixed Votes: 0
Labels: None

Issue Links:
Related
is related to LU-12892 Large directory feature is not enable... Resolved
is related to LU-11546 enable large_dir support for MDTs Resolved
is related to LU-1365 Implement ldiskfs LARGEDIR support fo... Resolved
Severity: 3
Rank (Obsolete): 9223372036854775807

 Description   

For filesystems with a large number of remote entries, either because of widespread striped directory usage, migration, or rename, the REMOTE_PARENT_DIR may become full without the large_dir, causing problems for new mkdirs, rename, and other remote directory operations.

Currently, osd-ldiskfs prints an error message:

LDISKFS-fs warning (device dm-14): ldiskfs_dx_add_entry:2625: inode 203423745: comm mdt_out01_005: index 2: reach max htree level 2 
LDISKFS-fs warning (device dm-14): ldiskfs_dx_add_entry:2629: Large directory feature is not enabled on this filesystem

but this is not very useful for the user, as enabling the large_dir feature requires the MDT to be unmounted (tune2fs is prevented from enabling it on the mounted filesystem due to MMP).

It makes sense to enable the large_dir feature automatically on existing ldiskfs MDT filesystems at mount time to prevent the problems associated with REMOTE_PARENT_DIR becoming full. This feature has been well supported for several releases already and is in e2fsprogs since 1.44, so there is little risk in enabling it automatically.



 Comments   
Comment by Gerrit Updater [ 05/Jun/21 ]

Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/43931
Subject: LU-14734 osd-ldiskfs: enable large_dir automatically
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: eecb641258fb2de914f15c815505b8f51a00c57f

Comment by Gerrit Updater [ 08/Jul/21 ]

Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/43931/
Subject: LU-14734 osd-ldiskfs: enable large_dir automatically
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: f5967b06aac5bb7c065e526358995ad127c47cb8

Comment by Gerrit Updater [ 24/Sep/21 ]

"Andreas Dilger <adilger@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/45046
Subject: LU-14734 ldiskfs: improve message for large_dir
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 2155dc5adc456b41d3e4abc72f4dc0e64abc0714

Comment by Gerrit Updater [ 10/Oct/21 ]

"Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/45046/
Subject: LU-14734 ldiskfs: improve message for large_dir
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 2a24b6ec67da9224e1cb6226166cde3a9c95431d

Generated at Sat Feb 10 03:12:19 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.