Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-1167

Poor mdtest unlink performance with multiple processes per node

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Minor Minor
    • None
    • Lustre 2.1.1
    • None
    • SL6.1,
      2.6.32-131.12.1.el6.lustre.20.x86_64

      We have noticed in testing that running multiple mdtest processes per node severely degrades unlink performance.

      • Lustre mounted once per client; not multimount.
      • shared directory case
        This can be seen at a wide range of node counts (5-128) and backends, to varying degrees.
        Interestingly scaling the client count up does not seem to have nearly the same negative performance impact; only the ppn seems to matter.
      	total
      nodes	jobs	unlink kops
      8	8	11.4
      8	16	9.7
      8	32	8.6
      8	64	7
      

      We see the same issue with 1.8.6 clients against the server; we do not see it with 1.8.6 servers.

        1. license.txt
          2 kB
        2. metabench.tar
          4.39 MB
        3. metabench-compare.xlsx
          10 kB
        4. metabench-comparison.txt
          24 kB

            wc-triage WC Triage
            nrutman Nathan Rutman
            Votes:
            1 Vote for this issue
            Watchers:
            10 Start watching this issue

              Created:
              Updated: