Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-9796

Speedup file creation under heavy concurrency

Details

    • 9223372036854775807

    Description

      In general, there are some metadata performance regression with/without quota.
      Now, Project quota introduced, it's time to measure metadata and improve metadata performance when quota is enabled.
      Also, it seems upstream kernel has some performance optimizations for ext4 when quota enabled. It might be possible to get those optimization for Lustre.

      Attachments

        Activity

          [LU-9796] Speedup file creation under heavy concurrency
          mdiep Minh Diep added a comment -

          wangshilong, are you planning to submit any more patch since the #31683 reverted?

          mdiep Minh Diep added a comment - wangshilong , are you planning to submit any more patch since the #31683 reverted?

          Bob Glossman (bob.glossman@intel.com) uploaded a new patch: https://review.whamcloud.com/32295
          Subject: LU-9796 ldiskfs: improve inode allocation performance
          Project: fs/lustre-release
          Branch: b2_10
          Current Patch Set: 1
          Commit: e5e6c26a0f3137f4dbd2bb300a437116c957727d

          gerrit Gerrit Updater added a comment - Bob Glossman (bob.glossman@intel.com) uploaded a new patch: https://review.whamcloud.com/32295 Subject: LU-9796 ldiskfs: improve inode allocation performance Project: fs/lustre-release Branch: b2_10 Current Patch Set: 1 Commit: e5e6c26a0f3137f4dbd2bb300a437116c957727d

          OK, thanks!  I'll keep an eye on this bug, then.

          paf Patrick Farrell (Inactive) added a comment - OK, thanks!  I'll keep an eye on this bug, then.
          pjones Peter Jones added a comment -

          No. AFAIK these are unconfirmed suspicions from support situations. We're just erring on the side of caution for the time being.

          pjones Peter Jones added a comment - No. AFAIK these are unconfirmed suspicions from support situations. We're just erring on the side of caution for the time being.

          Are there any details on the failures seen, like an LU tracking them or anything?

          paf Patrick Farrell (Inactive) added a comment - Are there any details on the failures seen, like an LU tracking them or anything?

          Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/31683/
          Subject: Revert "LU-9796 kernel: improve metadata performaces for RHEL7"
          Project: fs/lustre-release
          Branch: master
          Current Patch Set:
          Commit: 2083ffd1bc6c772972834b50e5aef2118c88658d

          gerrit Gerrit Updater added a comment - Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/31683/ Subject: Revert " LU-9796 kernel: improve metadata performaces for RHEL7" Project: fs/lustre-release Branch: master Current Patch Set: Commit: 2083ffd1bc6c772972834b50e5aef2118c88658d

          Andreas Dilger (andreas.dilger@intel.com) uploaded a new patch: https://review.whamcloud.com/31683
          Subject: Revert "LU-9796 kernel: improve metadata performaces for RHEL7"
          Project: fs/lustre-release
          Branch: master
          Current Patch Set: 1
          Commit: 4232b2842ff720791f2afb55b80ba6640142f624

          gerrit Gerrit Updater added a comment - Andreas Dilger (andreas.dilger@intel.com) uploaded a new patch: https://review.whamcloud.com/31683 Subject: Revert " LU-9796 kernel: improve metadata performaces for RHEL7" Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 4232b2842ff720791f2afb55b80ba6640142f624
          pjones Peter Jones added a comment -

          Landed for 2.11

          pjones Peter Jones added a comment - Landed for 2.11

          Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/28276/
          Subject: LU-9796 kernel: improve metadata performaces for RHEL7
          Project: fs/lustre-release
          Branch: master
          Current Patch Set:
          Commit: 17fe3c192e101ace75b2f4d7f7e9ff7d8d85480e

          gerrit Gerrit Updater added a comment - Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/28276/ Subject: LU-9796 kernel: improve metadata performaces for RHEL7 Project: fs/lustre-release Branch: master Current Patch Set: Commit: 17fe3c192e101ace75b2f4d7f7e9ff7d8d85480e

          I see recent mods in master have landed for this issue, but only for RHEL 7.x
          Is this not needed for RHEL 6.x, SLES 11/12, Ubuntu ?

          bogl Bob Glossman (Inactive) added a comment - I see recent mods in master have landed for this issue, but only for RHEL 7.x Is this not needed for RHEL 6.x, SLES 11/12, Ubuntu ?
          pjones Peter Jones added a comment -

          Does the remaining patch need to land too or can that be abandoned and this ticket marked resolved?

          pjones Peter Jones added a comment - Does the remaining patch need to land too or can that be abandoned and this ticket marked resolved?

          People

            hongchao.zhang Hongchao Zhang
            ihara Shuichi Ihara (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: