Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-9489

PFL layout uses full xattr space even when not init

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: Lustre 2.10.0
    • Fix Version/s: Lustre 2.10.0
    • Labels:
      None
    • Rank (Obsolete):
      9223372036854775807

      Description

      While testing lfs find I noticed that the size of the components (lcme_size) is based on the instantiated size and not the size of only the component header and the layout template. Creating an empty file and then writing to the file to instantiste all of the components does not change the lcme_size.

      If the on-disk xattr is reserving all the space for the instantiated component, then this is losing one of the major benefits of PFL. On a large system with hundreds of OSTs, if the last component (typically "-c -1") the uninstantiated last component will need multiple KB of space in the xattr, and this will not fit into the inode. Then, all inodes will have an external xattr block, instead of only the large files that need the wide striping, and this will significantly impact small file performance.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                bobijam Zhenyu Xu
                Reporter:
                adilger Andreas Dilger
              • Votes:
                1 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: