[LU-9489] PFL layout uses full xattr space even when not init

• Type: Task
• Resolution: Fixed
• Priority: Blocker
• Fix Version/s: Lustre 2.10.0
• Affects Version/s: Lustre 2.10.0
• Assignee: Zhenyu Xu
• Reporter: Andreas Dilger

Description

While testing lfs find I noticed that the size of the components (lcme_size) is based on the instantiated size and not the size of only the component header and the layout template. Creating an empty file and then writing to the file to instantiste all of the components does not change the lcme_size.

If the on-disk xattr is reserving all the space for the instantiated component, then this is losing one of the major benefits of PFL. On a large system with hundreds of OSTs, if the last component (typically "-c -1") the uninstantiated last component will need multiple KB of space in the xattr, and this will not fit into the inode. Then, all inodes will have an external xattr block, instead of only the large files that need the wide striping, and this will significantly impact small file performance.

Issue Links

• is related to: LU-9349 PFL known issues tracking ticket

Comments

[Peter Jones]

Landed for 2.10

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/27089/
Subject: LU-9489 lod: keep minimum LOVEA size
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 62f64a1077468e01a41df35212b5e5b1fe6b31d5

[Gerrit Updater]

Andreas Dilger ([e-mail]) merged in patch https://review.whamcloud.com/27299/
Subject: LU-9489 lod: keep minimum LOVEA size
Project: fs/lustre-release
Branch: pfl
Current Patch Set:
Commit: 53df5593801680cedecb008e4a46678edd0bcf31

[Gerrit Updater]

Bobi Jam ([e-mail]) uploaded a new patch: https://review.whamcloud.com/27307
Subject: LU-9489 test: debug memory leak
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: c91149fc7372e6ec3e26e7306b2d966fa1dde0eb

[Gerrit Updater]

Bobi Jam ([e-mail]) uploaded a new patch: https://review.whamcloud.com/27299
Subject: LU-9489 lod: keep minimum LOVEA size
Project: fs/lustre-release
Branch: pfl
Current Patch Set: 1
Commit: 1ff103dc4eb1fcdd2466c343760d5d6033576f1f

[Gerrit Updater]

Bobi Jam ([e-mail]) uploaded a new patch: https://review.whamcloud.com/27089
Subject: LU-9489 lod: keep minimum LOVEA size
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: d6b3884fff53c85329f48f4374203df0606d5529

[Joseph Gmitter (Inactive)]

Hi Bobijam,

Can you please own this issue?

Thanks.
Joe