Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-12151

metadata performance difference on root and non-root user

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: Lustre 2.10.5
    • Fix Version/s: Lustre 2.13.0, Lustre 2.12.1
    • Labels:
      None
    • Environment:
      lustre-2.10.5-RC2/ldiskfs
    • Severity:
      3
    • Rank (Obsolete):
      9223372036854775807

      Description

      We found a huge performance difference on file creation with root user and non-root user .

      • 1 x MDS(1 x Platinum 8160, 96GB memory, EDR)
      • 32 x client(2 x E5-2650 v4, 128GB memory, EDR)
      • 1 x ES14K (40 x SSD)

      root user

      [root@c01 ~]# salloc -N 32 --ntasks-per-node=20 mpirun --allow-run-as-root /work/tools/bin/mdtest -n 1000 -F -v -u -d /scratch0/bmuser/ -C
      SUMMARY: (of 1 iterations)
         Operation                      Max            Min           Mean        Std Dev
         ---------                      ---            ---           ----        -------
         File creation     :     151328.449     151328.449     151328.449          0.000
         File stat         :          0.000          0.000          0.000          0.000
         File read         :          0.000          0.000          0.000          0.000
         File removal      :          0.000          0.000          0.000          0.000
         Tree creation     :         42.057         42.057         42.057          0.000
         Tree removal      :          0.000          0.000          0.000          0.000
      V-1: Entering timestamp...
      

      Non-root user

      [bmuser@c01 ~]$ salloc -N 32 --ntasks-per-node=20 mpirun --allow-run-as-root /work/tools/bin/mdtest -n 1000 -F -v -u -d /scratch0/bmuser/ -C
      SUMMARY: (of 1 iterations)
         Operation                      Max            Min           Mean        Std Dev
         ---------                      ---            ---           ----        -------
         File creation     :     102825.662     102825.662     102825.662          0.000
         File stat         :          0.000          0.000          0.000          0.000
         File read         :          0.000          0.000          0.000          0.000
         File removal      :          0.000          0.000          0.000          0.000
         Tree creation     :         30.589         30.589         30.589          0.000
         Tree removal      :          0.000          0.000          0.000          0.000
      V-1: Entering timestamp...
      

      150K (root) vs 100K (non-root)

        Attachments

          Activity

            People

            • Assignee:
              wshilong Wang Shilong
              Reporter:
              sihara Shuichi Ihara
            • Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: