[LU-9489] PFL layout uses full xattr space even when not init Created: 11/May/17  Updated: 07/Jun/17  Resolved: 07/Jun/17

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: Lustre 2.10.0
Fix Version/s: Lustre 2.10.0

Type: Task Priority: Blocker
Reporter: Andreas Dilger Assignee: Zhenyu Xu
Resolution: Fixed Votes: 1
Labels: None

Issue Links:
Related
is related to LU-9349 PFL known issues tracking ticket Resolved
Rank (Obsolete): 9223372036854775807

 Description   

While testing lfs find I noticed that the size of the components (lcme_size) is based on the instantiated size and not the size of only the component header and the layout template. Creating an empty file and then writing to the file to instantiste all of the components does not change the lcme_size.

If the on-disk xattr is reserving all the space for the instantiated component, then this is losing one of the major benefits of PFL. On a large system with hundreds of OSTs, if the last component (typically "-c -1") the uninstantiated last component will need multiple KB of space in the xattr, and this will not fit into the inode. Then, all inodes will have an external xattr block, instead of only the large files that need the wide striping, and this will significantly impact small file performance.



 Comments   
Comment by Joseph Gmitter (Inactive) [ 11/May/17 ]

Hi Bobijam,

Can you please own this issue?

Thanks.
Joe

Comment by Gerrit Updater [ 12/May/17 ]

Bobi Jam (bobijam@hotmail.com) uploaded a new patch: https://review.whamcloud.com/27089
Subject: LU-9489 lod: keep minimum LOVEA size
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: d6b3884fff53c85329f48f4374203df0606d5529

Comment by Gerrit Updater [ 26/May/17 ]

Bobi Jam (bobijam@hotmail.com) uploaded a new patch: https://review.whamcloud.com/27299
Subject: LU-9489 lod: keep minimum LOVEA size
Project: fs/lustre-release
Branch: pfl
Current Patch Set: 1
Commit: 1ff103dc4eb1fcdd2466c343760d5d6033576f1f

Comment by Gerrit Updater [ 26/May/17 ]

Bobi Jam (bobijam@hotmail.com) uploaded a new patch: https://review.whamcloud.com/27307
Subject: LU-9489 test: debug memory leak
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: c91149fc7372e6ec3e26e7306b2d966fa1dde0eb

Comment by Gerrit Updater [ 30/May/17 ]

Andreas Dilger (andreas.dilger@intel.com) merged in patch https://review.whamcloud.com/27299/
Subject: LU-9489 lod: keep minimum LOVEA size
Project: fs/lustre-release
Branch: pfl
Current Patch Set:
Commit: 53df5593801680cedecb008e4a46678edd0bcf31

Comment by Gerrit Updater [ 07/Jun/17 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/27089/
Subject: LU-9489 lod: keep minimum LOVEA size
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 62f64a1077468e01a41df35212b5e5b1fe6b31d5

Comment by Peter Jones [ 07/Jun/17 ]

Landed for 2.10

Generated at Sat Feb 10 02:26:38 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.