Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-2442

metadata performance degradation on current master

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: Lustre 2.4.0
    • Fix Version/s: Lustre 2.4.0, Lustre 2.5.0
    • Labels:
      None
    • Severity:
      3
    • Rank (Obsolete):
      5771

      Description

      During Minh's performance test on Opensfs cluster, we found a quite performance degradation.

      b2_3 test result

      [root@c24 bin]# ./run_mdsrate_create
      0: c01 starting at Thu Dec  6 08:48:39 2012
      Rate: 26902.88 eff 26902.57 aggr 140.12 avg client creates/sec (total: 192 threads 3840000 creates 192 dirs 1 threads/dir 142.74 secs)
      0: c01 finished at Thu Dec  6 08:51:02 2012
      [root@c24 bin]# ./run_mdsrate_stat
      0: c01 starting at Thu Dec  6 08:51:50 2012
      Rate: 169702.53 eff 169703.11 aggr 883.87 avg client stats/sec (total: 192 threads 3840000 stats 192 dirs 1 threads/dir 22.63 secs)
      0: c01 finished at Thu Dec  6 08:52:13 2012
      [root@c24 bin]# ./run_mdsrate_unlink
      0: c01 starting at Thu Dec  6 08:52:28 2012
      Rate: 33486.06 eff 33486.74 aggr 174.41 avg client unlinks/sec (total: 192 threads 3840000 unlinks 192 dirs 1 threads/dir 114.67 secs)
      Warning: only unlinked 3840000 files instead of 20000
      0: c01 finished at Thu Dec  6 08:54:23 2012
      [root@c24 bin]# ./run_mdsrate_mknod
      0: c01 starting at Thu Dec  6 08:54:32 2012
      Rate: 52746.29 eff 52745.00 aggr 274.71 avg client mknods/sec (total: 192 threads 3840000 mknods 192 dirs 1 threads/dir 72.80 secs)
      0: c01 finished at Thu Dec  6 08:55:45 2012
      [root@c24 bin]#
      

      Master test result

      [root@c24 bin]# ./run_mdsrate_create
      0: c01 starting at Tue Dec  4 21:15:40 2012
      Rate: 6031.09 eff 6031.11 aggr 31.41 avg client creates/sec (total: 192 threads 3840000 creates 192 dirs 1 threads/dir 636.70 secs)
      0: c01 finished at Tue Dec  4 21:26:17 2012
      [root@c24 bin]# ./run_mdsrate_stat
      0: c01 starting at Tue Dec  4 21:27:04 2012
      Rate: 177962.00 eff 177964.59 aggr 926.90 avg client stats/sec (total: 192 threads 3840000 stats 192 dirs 1 threads/dir 21.58 secs)
      0: c01 finished at Tue Dec  4 21:27:26 2012
      [root@c24 bin]# ./run_mdsrate_unlink
      0: c01 starting at Tue Dec  4 21:29:47 2012
      Rate: 8076.06 eff 8076.08 aggr 42.06 avg client unlinks/sec (total: 192 threads 3840000 unlinks 192 dirs 1 threads/dir 475.48 secs)
      Warning: only unlinked 3840000 files instead of 20000
      0: c01 finished at Tue Dec  4 21:37:43 2012
      [root@c24 bin]# ./run_mdsrate_mknod
      0: c01 starting at Tue Dec  4 21:48:41 2012
      Rate: 10430.50 eff 10430.61 aggr 54.33 avg client mknods/sec (total: 192 threads 3840000 mknods 192 dirs 1 threads/dir 368.15 secs)
      0: c01 finished at Tue Dec  4 21:54:49 2012
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                laisiyao Lai Siyao
                Reporter:
                di.wang Di Wang
              • Votes:
                0 Vote for this issue
                Watchers:
                19 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: