Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-12151

metadata performance difference on root and non-root user

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Minor
    • Lustre 2.13.0, Lustre 2.12.1
    • Lustre 2.10.5
    • None
    • lustre-2.10.5-RC2/ldiskfs
    • 3
    • 9223372036854775807

    Description

      We found a huge performance difference on file creation with root user and non-root user .

      • 1 x MDS(1 x Platinum 8160, 96GB memory, EDR)
      • 32 x client(2 x E5-2650 v4, 128GB memory, EDR)
      • 1 x ES14K (40 x SSD)

      root user

      [root@c01 ~]# salloc -N 32 --ntasks-per-node=20 mpirun --allow-run-as-root /work/tools/bin/mdtest -n 1000 -F -v -u -d /scratch0/bmuser/ -C
      SUMMARY: (of 1 iterations)
         Operation                      Max            Min           Mean        Std Dev
         ---------                      ---            ---           ----        -------
         File creation     :     151328.449     151328.449     151328.449          0.000
         File stat         :          0.000          0.000          0.000          0.000
         File read         :          0.000          0.000          0.000          0.000
         File removal      :          0.000          0.000          0.000          0.000
         Tree creation     :         42.057         42.057         42.057          0.000
         Tree removal      :          0.000          0.000          0.000          0.000
      V-1: Entering timestamp...
      

      Non-root user

      [bmuser@c01 ~]$ salloc -N 32 --ntasks-per-node=20 mpirun --allow-run-as-root /work/tools/bin/mdtest -n 1000 -F -v -u -d /scratch0/bmuser/ -C
      SUMMARY: (of 1 iterations)
         Operation                      Max            Min           Mean        Std Dev
         ---------                      ---            ---           ----        -------
         File creation     :     102825.662     102825.662     102825.662          0.000
         File stat         :          0.000          0.000          0.000          0.000
         File read         :          0.000          0.000          0.000          0.000
         File removal      :          0.000          0.000          0.000          0.000
         Tree creation     :         30.589         30.589         30.589          0.000
         Tree removal      :          0.000          0.000          0.000          0.000
      V-1: Entering timestamp...
      

      150K (root) vs 100K (non-root)

      Attachments

        Issue Links

          Activity

            People

              wshilong Wang Shilong (Inactive)
              sihara Shuichi Ihara
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: