Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-12151

metadata performance difference on root and non-root user

Details

    • Bug
    • Resolution: Fixed
    • Minor
    • Lustre 2.13.0, Lustre 2.12.1
    • Lustre 2.10.5
    • None
    • lustre-2.10.5-RC2/ldiskfs
    • 3
    • 9223372036854775807

    Description

      We found a huge performance difference on file creation with root user and non-root user .

      • 1 x MDS(1 x Platinum 8160, 96GB memory, EDR)
      • 32 x client(2 x E5-2650 v4, 128GB memory, EDR)
      • 1 x ES14K (40 x SSD)

      root user

      [root@c01 ~]# salloc -N 32 --ntasks-per-node=20 mpirun --allow-run-as-root /work/tools/bin/mdtest -n 1000 -F -v -u -d /scratch0/bmuser/ -C
      SUMMARY: (of 1 iterations)
         Operation                      Max            Min           Mean        Std Dev
         ---------                      ---            ---           ----        -------
         File creation     :     151328.449     151328.449     151328.449          0.000
         File stat         :          0.000          0.000          0.000          0.000
         File read         :          0.000          0.000          0.000          0.000
         File removal      :          0.000          0.000          0.000          0.000
         Tree creation     :         42.057         42.057         42.057          0.000
         Tree removal      :          0.000          0.000          0.000          0.000
      V-1: Entering timestamp...
      

      Non-root user

      [bmuser@c01 ~]$ salloc -N 32 --ntasks-per-node=20 mpirun --allow-run-as-root /work/tools/bin/mdtest -n 1000 -F -v -u -d /scratch0/bmuser/ -C
      SUMMARY: (of 1 iterations)
         Operation                      Max            Min           Mean        Std Dev
         ---------                      ---            ---           ----        -------
         File creation     :     102825.662     102825.662     102825.662          0.000
         File stat         :          0.000          0.000          0.000          0.000
         File read         :          0.000          0.000          0.000          0.000
         File removal      :          0.000          0.000          0.000          0.000
         Tree creation     :         30.589         30.589         30.589          0.000
         Tree removal      :          0.000          0.000          0.000          0.000
      V-1: Entering timestamp...
      

      150K (root) vs 100K (non-root)

      Attachments

        Issue Links

          Activity

            [LU-12151] metadata performance difference on root and non-root user
            adilger Andreas Dilger made changes -
            Link New: This issue is related to LU-13239 [ LU-13239 ]
            pjones Peter Jones made changes -
            Link Original: This issue is related to JFC-26 [ JFC-26 ]
            pjones Peter Jones made changes -
            Labels Original: LTS12
            pjones Peter Jones made changes -
            Fix Version/s New: Lustre 2.12.1 [ 14406 ]
            pjones Peter Jones made changes -
            Fix Version/s New: Lustre 2.13.0 [ 14290 ]
            Resolution New: Fixed [ 1 ]
            Status Original: Open [ 1 ] New: Resolved [ 5 ]
            pjones Peter Jones made changes -
            Labels New: LTS12
            pjones Peter Jones made changes -
            Link New: This issue is related to JFC-26 [ JFC-26 ]
            adilger Andreas Dilger made changes -
            Link New: This issue duplicates DDN-556 [ DDN-556 ]
            pjones Peter Jones made changes -
            Assignee Original: WC Triage [ wc-triage ] New: Wang Shilong [ wshilong ]
            sihara Shuichi Ihara created issue -

            People

              wshilong Wang Shilong (Inactive)
              sihara Shuichi Ihara
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: