Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-2600

lustre metadata performance is very slow on zfs

Details

    • Bug
    • Resolution: Fixed
    • Major
    • None
    • Lustre 2.4.0
    • 3
    • 6060

    Description

      mds-survey show create and unlink are very slow

      [root@mds01 mds01]# tests_str="create lookup destroy" thrlo=192 thrhi=192 file_count=3840000 mds-survey
      Wed Jan 2 16:43:00 PST 2013 /usr/bin/mds-survey from mds01
      mdt 1 file 3840000 dir 192 thr 192 create 2220.02 [ 0.00,19997.98] lookup 9429.79 [ 0.00,41998.40] destroy 1545.46 [ 0.00,15998.32]
      done!

      Attachments

        1. oprofile.tar.gz
          1.76 MB
          Cliff White
        2. oprofile2.tar.gz
          1.01 MB
          Cliff White

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. LU-5041 FID Prefetching

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-7235 ZFS: dmu_object_alloc() serializes object creations

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. LU-2476 poor OST file creation rate performance with zfs backend

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-4108 Failure on test suite performance-sanity test_4

          • Blocker - Blocks development and/or testing work, production could not run.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-4968 Test failure sanity test_132: umount /mnt/ost2

          • Blocker - Blocks development and/or testing work, production could not run.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-4696 Test timeout on sanity test_51ba: nlink before: 70002, created before: 70000

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            [LU-2600] lustre metadata performance is very slow on zfs
            adilger Andreas Dilger made changes -
            Resolution New: Fixed [ 1 ]
            Status Original: Open [ 1 ] New: Resolved [ 5 ]
            bzzz Alex Zhuravlev made changes -
            Priority Original: Blocker [ 1 ] New: Major [ 3 ]
            bzzz Alex Zhuravlev made changes -
            Link New: This issue is blocked by LU-7235 [ LU-7235 ]
            bzzz Alex Zhuravlev made changes -
            Link New: This issue is blocked by LU-5041 [ LU-5041 ]
            bzzz Alex Zhuravlev added a comment -

            ZAP prefetching at object creation should improve metadata performance.

            bzzz Alex Zhuravlev added a comment - ZAP prefetching at object creation should improve metadata performance.
            isaac Isaac Huang (Inactive) added a comment -

            Just a note that if a patch that uses dsl_sync_task is landed again, we'd need to patch zfs so as not to increase async writes when there's only nowaiter sync tasks pending. See:
            https://github.com/zfsonlinux/zfs/pull/2716#issuecomment-58540555

            isaac Isaac Huang (Inactive) added a comment - Just a note that if a patch that uses dsl_sync_task is landed again, we'd need to patch zfs so as not to increase async writes when there's only nowaiter sync tasks pending. See: https://github.com/zfsonlinux/zfs/pull/2716#issuecomment-58540555
            pjones Peter Jones made changes -
            Labels Original: 22i JL performance prz zfs New: JL performance prz zfs
            pjones Peter Jones made changes -
            Labels Original: JL performance prz zfs New: 22i JL performance prz zfs
            pjones Peter Jones made changes -
            Labels Original: JL llnl performance prz zfs New: JL performance prz zfs
            jessica Jessica A. Popp (Inactive) made changes -
            Priority Original: Critical [ 2 ] New: Blocker [ 1 ]

            People

              bzzz Alex Zhuravlev
              mdiep Minh Diep
              Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: