[LU-6824] improve error messages for dir htree limit Created: 09/Jul/15  Updated: 18/Oct/18  Resolved: 05/Feb/16

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: None
Fix Version/s: Lustre 2.8.0

Type: Improvement Priority: Minor
Reporter: Wang Shilong (Inactive) Assignee: Yang Sheng
Resolution: Fixed Votes: 0
Labels: patch

Issue Links:
Related
is related to LU-11546 enable large_dir support for MDTs Resolved
Rank (Obsolete): 9223372036854775807

 Description   

Currently without large dir feature, ldiskfs directory hash tree will be limited 2 height, this means directory size is limited about 1GB, and in fact users are likely to hit ENOSPC when reaching half of limit because of bad hash.

    
LDISKFS-fs warning (device dm-4): ldiskfs_dx_add_entry: Directory (ino: 614516572) index full, reach max htree level :2
LDISKFS-fs warning (device dm-4): ldiskfs_dx_add_entry: Large directory feature is not enabled on this filesystem

Testing by following scripts:

    
    i=0
    filename="aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"
    "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaabbbbbbbbbbbbbbbbbbbbbbbb"
    while [ 1 ]
    do
            touch $filename"$i"
            if [ $? -ne 0 ];then
                    break
            fi
            ((i++))
    done

When directory size grow about 590M, we hit ENOSPC. this patch try to improve error messages to warn users when it is easier to hit ENOSPC (50% of limit).



 Comments   
Comment by Gerrit Updater [ 09/Jul/15 ]

Wang Shilong (wshilong@ddn.com) uploaded a new patch: http://review.whamcloud.com/15548
Subject: LU-6824 ldiskfs: improve error messages for dir htree
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: a1f139d085b7ee2547f1fbf8ac60d6d2d8d94968

Comment by Peter Jones [ 09/Jul/15 ]

Yang Sheng

Could you please take care of this?

Thanks

Peter

Comment by Gerrit Updater [ 06/Jan/16 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/15548/
Subject: LU-6824 ldiskfs: give warning with dir htree growing
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 07660ad33a7d109cced29b6400f99f25adab3f54

Comment by James A Simmons [ 06/Jan/16 ]

A patch is still needed for SLES12.

Comment by Jian Yu [ 28/Jan/16 ]

Here is the patch for RHEL 7.2 and SLES 12: http://review.whamcloud.com/18169

Comment by Gerrit Updater [ 05/Feb/16 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/18169/
Subject: LU-6824 ldiskfs: add dir htree growing warning patch
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 5951a1aaffc4b1a0adb0c6033fa4eb4be43c350c

Comment by Joseph Gmitter (Inactive) [ 05/Feb/16 ]

Patches have landed for 2.8

Generated at Sat Feb 10 02:03:34 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.