Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-2442

metadata performance degradation on current master

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • Lustre 2.4.0, Lustre 2.5.0
    • Lustre 2.4.0
    • None
    • 3
    • 5771

    Description

      During Minh's performance test on Opensfs cluster, we found a quite performance degradation.

      b2_3 test result

      [root@c24 bin]# ./run_mdsrate_create
      0: c01 starting at Thu Dec  6 08:48:39 2012
      Rate: 26902.88 eff 26902.57 aggr 140.12 avg client creates/sec (total: 192 threads 3840000 creates 192 dirs 1 threads/dir 142.74 secs)
      0: c01 finished at Thu Dec  6 08:51:02 2012
      [root@c24 bin]# ./run_mdsrate_stat
      0: c01 starting at Thu Dec  6 08:51:50 2012
      Rate: 169702.53 eff 169703.11 aggr 883.87 avg client stats/sec (total: 192 threads 3840000 stats 192 dirs 1 threads/dir 22.63 secs)
      0: c01 finished at Thu Dec  6 08:52:13 2012
      [root@c24 bin]# ./run_mdsrate_unlink
      0: c01 starting at Thu Dec  6 08:52:28 2012
      Rate: 33486.06 eff 33486.74 aggr 174.41 avg client unlinks/sec (total: 192 threads 3840000 unlinks 192 dirs 1 threads/dir 114.67 secs)
      Warning: only unlinked 3840000 files instead of 20000
      0: c01 finished at Thu Dec  6 08:54:23 2012
      [root@c24 bin]# ./run_mdsrate_mknod
      0: c01 starting at Thu Dec  6 08:54:32 2012
      Rate: 52746.29 eff 52745.00 aggr 274.71 avg client mknods/sec (total: 192 threads 3840000 mknods 192 dirs 1 threads/dir 72.80 secs)
      0: c01 finished at Thu Dec  6 08:55:45 2012
      [root@c24 bin]#
      

      Master test result

      [root@c24 bin]# ./run_mdsrate_create
      0: c01 starting at Tue Dec  4 21:15:40 2012
      Rate: 6031.09 eff 6031.11 aggr 31.41 avg client creates/sec (total: 192 threads 3840000 creates 192 dirs 1 threads/dir 636.70 secs)
      0: c01 finished at Tue Dec  4 21:26:17 2012
      [root@c24 bin]# ./run_mdsrate_stat
      0: c01 starting at Tue Dec  4 21:27:04 2012
      Rate: 177962.00 eff 177964.59 aggr 926.90 avg client stats/sec (total: 192 threads 3840000 stats 192 dirs 1 threads/dir 21.58 secs)
      0: c01 finished at Tue Dec  4 21:27:26 2012
      [root@c24 bin]# ./run_mdsrate_unlink
      0: c01 starting at Tue Dec  4 21:29:47 2012
      Rate: 8076.06 eff 8076.08 aggr 42.06 avg client unlinks/sec (total: 192 threads 3840000 unlinks 192 dirs 1 threads/dir 475.48 secs)
      Warning: only unlinked 3840000 files instead of 20000
      0: c01 finished at Tue Dec  4 21:37:43 2012
      [root@c24 bin]# ./run_mdsrate_mknod
      0: c01 starting at Tue Dec  4 21:48:41 2012
      Rate: 10430.50 eff 10430.61 aggr 54.33 avg client mknods/sec (total: 192 threads 3840000 mknods 192 dirs 1 threads/dir 368.15 secs)
      0: c01 finished at Tue Dec  4 21:54:49 2012
      

      Attachments

        1. mdtest_create.png
          95 kB
          Lai Siyao
        2. mdtest_unlink.png
          83 kB
          Lai Siyao

        Issue Links

          Activity

            People

              laisiyao Lai Siyao
              di.wang Di Wang
              Votes:
              0 Vote for this issue
              Watchers:
              19 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: