Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-9489

PFL layout uses full xattr space even when not init

    XMLWordPrintable

Details

    • Task
    • Resolution: Fixed
    • Blocker
    • Lustre 2.10.0
    • Lustre 2.10.0
    • None
    • 9223372036854775807

    Description

      While testing lfs find I noticed that the size of the components (lcme_size) is based on the instantiated size and not the size of only the component header and the layout template. Creating an empty file and then writing to the file to instantiste all of the components does not change the lcme_size.

      If the on-disk xattr is reserving all the space for the instantiated component, then this is losing one of the major benefits of PFL. On a large system with hundreds of OSTs, if the last component (typically "-c -1") the uninstantiated last component will need multiple KB of space in the xattr, and this will not fit into the inode. Then, all inodes will have an external xattr block, instead of only the large files that need the wide striping, and this will significantly impact small file performance.

      Attachments

        Issue Links

          Activity

            People

              bobijam Zhenyu Xu
              adilger Andreas Dilger
              Votes:
              1 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: