Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-11211

Performance degradation in mdtest

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Major
    • None
    • Lustre 2.11.0
    • None
    • 3
    • 9223372036854775807

    Description

      We are observing performance degradation in mutest IOPs testing at around 50K IOPS with zfs. 

      Configuration has DNE and DOM, however it seems there is only one MDT that is being utilized out of 3 MDTs:

       

      steps for the configuration in place:

       

      root@mds-201 ~]# zpool list
      NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT
      mdtpool 744G 2.35G 742G - 0% 0% 1.00x ONLINE -
      mdtpool1 744G 12.1M 744G - 0% 0% 1.00x ONLINE -
      mdtpool2 372G 8.96M 372G - 0% 0% 1.00x ONLINE -
      [root@mds-201 ~]#

       

      lfs setstripe -E 1M -L mdt -E -1 /mnt/lustre/domdir
      lfs setstripe -L mdt --component-end 1M /mnt/lustre/domdir/MDT0
      lfs setstripe -L mdt --component-end 1M /mnt/lustre/domdir/MDT1
      lfs setstripe -L mdt --component-end 1M /mnt/lustre/domdir/MDT5

       

       

      snapshots of the results:

      Command line used: ./mdtest -d /mnt/lustre/domdir-mdts/testdir-4 -n 47662 -F -e -u -i 1
      Path: /mnt/lustre/domdir-mdts
      FS: 351.4 TiB Used FS: 0.0% Inodes: 184.4 Mi Used Inodes: 0.0%

      44 tasks, 2097128 files

      SUMMARY: (of 1 iterations)
      Operation Max Min Mean Std Dev
      --------- — --- ---- -------
      File creation : 18572.644 18572.644 18572.644 0.000
      File stat : 22206.703 22206.703 22206.703 0.000
      File read : 66375.392 66375.392 66375.392 0.000
      File removal : 11525.913 11525.913 11525.913 0.000
      Tree creation : 1016.260 1016.260 1016.260 0.000
      Tree removal : 2.698 2.698 2.698 0.000

      – finished at 08/03/2018 09:41:01 –
      ================= 11 client END =======================

       

      thanks,

      Abe

       

       

      Attachments

        Issue Links

          Activity

            People

              wc-triage WC Triage
              abea@supermicro.com Abe (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: