[LU-1388] Maximum Number of Files per Directory

• Status: Resolved
• Project: Lustre
• Affects Version/s: Lustre 1.8.7
• Type: Bug
• Priority: Minor
• Reporter: Roger Spellman (Inactive)
• Assignee: Peter Jones
• Resolution: Duplicate

Environment

1.8.x
2.1.x

• Severity: 4

Description

Both the 1.8 and 2.1 manuals say the following in section 33.8.

Maximum Number of Files or
Subdirectories in a Single Directory
Lustre uses the ext3 hashed directory code, which has a limit of about 25 million files.
On reaching this limit, the directory grows to more than 2 GB depending on the
length of the filenames. The limit on subdirectories is the same as the limit on regular
files in all later versions of Lustre due to a small ext3 format change.

Is this still accurate? Isn't Lustre using ext4 by default, so shouldn't the limit be higher?

What is the limit now for 1.8.7 and 2.1.x ?

Thanks.

Comments

[Liang Zhen (Inactive)]

for 1.8.7 and 2.1.x, the limit is still same with ext3/ext4.
ldiskfs of 2.2 can support larger directory (4-level htree which can support over a billion files under directory), but we need make some changes to e2fsprogs before you can use it.

We don't have plan to backport the ldiskfs patch from 2.2 to 1.8.x yet.

here is the tracking ticket: http://jira.whamcloud.com/browse/LU-1365

I guess we can just close this one and use LU-1365?

[Peter Jones]

duplicate of LU-1365