Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-9489

PFL layout uses full xattr space even when not init

Details

    • Task
    • Resolution: Fixed
    • Blocker
    • Lustre 2.10.0
    • Lustre 2.10.0
    • None
    • 9223372036854775807

    Description

      While testing lfs find I noticed that the size of the components (lcme_size) is based on the instantiated size and not the size of only the component header and the layout template. Creating an empty file and then writing to the file to instantiste all of the components does not change the lcme_size.

      If the on-disk xattr is reserving all the space for the instantiated component, then this is losing one of the major benefits of PFL. On a large system with hundreds of OSTs, if the last component (typically "-c -1") the uninstantiated last component will need multiple KB of space in the xattr, and this will not fit into the inode. Then, all inodes will have an external xattr block, instead of only the large files that need the wide striping, and this will significantly impact small file performance.

      Attachments

        Issue Links

          Activity

            [LU-9489] PFL layout uses full xattr space even when not init
            pjones Peter Jones added a comment -

            Landed for 2.10

            pjones Peter Jones added a comment - Landed for 2.10

            Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/27089/
            Subject: LU-9489 lod: keep minimum LOVEA size
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 62f64a1077468e01a41df35212b5e5b1fe6b31d5

            gerrit Gerrit Updater added a comment - Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/27089/ Subject: LU-9489 lod: keep minimum LOVEA size Project: fs/lustre-release Branch: master Current Patch Set: Commit: 62f64a1077468e01a41df35212b5e5b1fe6b31d5

            Andreas Dilger (andreas.dilger@intel.com) merged in patch https://review.whamcloud.com/27299/
            Subject: LU-9489 lod: keep minimum LOVEA size
            Project: fs/lustre-release
            Branch: pfl
            Current Patch Set:
            Commit: 53df5593801680cedecb008e4a46678edd0bcf31

            gerrit Gerrit Updater added a comment - Andreas Dilger (andreas.dilger@intel.com) merged in patch https://review.whamcloud.com/27299/ Subject: LU-9489 lod: keep minimum LOVEA size Project: fs/lustre-release Branch: pfl Current Patch Set: Commit: 53df5593801680cedecb008e4a46678edd0bcf31

            Bobi Jam (bobijam@hotmail.com) uploaded a new patch: https://review.whamcloud.com/27307
            Subject: LU-9489 test: debug memory leak
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: c91149fc7372e6ec3e26e7306b2d966fa1dde0eb

            gerrit Gerrit Updater added a comment - Bobi Jam (bobijam@hotmail.com) uploaded a new patch: https://review.whamcloud.com/27307 Subject: LU-9489 test: debug memory leak Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: c91149fc7372e6ec3e26e7306b2d966fa1dde0eb

            Bobi Jam (bobijam@hotmail.com) uploaded a new patch: https://review.whamcloud.com/27299
            Subject: LU-9489 lod: keep minimum LOVEA size
            Project: fs/lustre-release
            Branch: pfl
            Current Patch Set: 1
            Commit: 1ff103dc4eb1fcdd2466c343760d5d6033576f1f

            gerrit Gerrit Updater added a comment - Bobi Jam (bobijam@hotmail.com) uploaded a new patch: https://review.whamcloud.com/27299 Subject: LU-9489 lod: keep minimum LOVEA size Project: fs/lustre-release Branch: pfl Current Patch Set: 1 Commit: 1ff103dc4eb1fcdd2466c343760d5d6033576f1f

            Bobi Jam (bobijam@hotmail.com) uploaded a new patch: https://review.whamcloud.com/27089
            Subject: LU-9489 lod: keep minimum LOVEA size
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: d6b3884fff53c85329f48f4374203df0606d5529

            gerrit Gerrit Updater added a comment - Bobi Jam (bobijam@hotmail.com) uploaded a new patch: https://review.whamcloud.com/27089 Subject: LU-9489 lod: keep minimum LOVEA size Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: d6b3884fff53c85329f48f4374203df0606d5529

            Hi Bobijam,

            Can you please own this issue?

            Thanks.
            Joe

            jgmitter Joseph Gmitter (Inactive) added a comment - Hi Bobijam, Can you please own this issue? Thanks. Joe

            People

              bobijam Zhenyu Xu
              adilger Andreas Dilger
              Votes:
              1 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: