Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-7293

DNE2 perfomance analysis

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Fixed
    • Critical
    • None
    • Lustre 2.9.0
    • DNE2 system with up to 16 MDS servers. Uses up to 400 client nodes spread across 20 physical nodes. All the results are based on mdtest 1.9.3 runs.
    • 9223372036854775807

    Description

      I did a detail study of the client scaling behavior for 10k and 100k files per directory using 1,2,4, and 8 MDS servers each having one MDT. I also attempted to collect dat for 16 MDS servers but the results were so bad I didn't both to finish collecting them since it would take several months to finish the 16 node case.

      Attachments

        1. 1-mds-dne2-100k-dir-2.8.png
          1-mds-dne2-100k-dir-2.8.png
          12 kB
        2. 1-mds-dne2-100k-files-2.8.png
          1-mds-dne2-100k-files-2.8.png
          11 kB
        3. 1-mds-dne2-10k-dir-2.8.png
          1-mds-dne2-10k-dir-2.8.png
          13 kB
        4. 1-mds-dne2-10k-files-2.8.png
          1-mds-dne2-10k-files-2.8.png
          12 kB
        5. 2-mds-dne2-100k-dir-2.8.png
          2-mds-dne2-100k-dir-2.8.png
          8 kB
        6. 2-mds-dne2-100k-files-2.8.png
          2-mds-dne2-100k-files-2.8.png
          11 kB
        7. 2-mds-dne2-10k-dir-2.8.png
          2-mds-dne2-10k-dir-2.8.png
          10 kB
        8. 2-mds-dne2-10k-files-2.8.png
          2-mds-dne2-10k-files-2.8.png
          11 kB
        9. 4-mds-dne2-100k-dir-2.8.png
          4-mds-dne2-100k-dir-2.8.png
          9 kB
        10. 4-mds-dne2-100k-files-2.8.png
          4-mds-dne2-100k-files-2.8.png
          13 kB
        11. 4-mds-dne2-10k-dir-2.8.png
          4-mds-dne2-10k-dir-2.8.png
          11 kB
        12. 4-mds-dne2-10k-files-2.8.png
          4-mds-dne2-10k-files-2.8.png
          14 kB
        13. 8-mds-dne2-100k-dir-2.8.png
          8-mds-dne2-100k-dir-2.8.png
          14 kB
        14. 8-mds-dne2-100k-files-2.8.png
          8-mds-dne2-100k-files-2.8.png
          15 kB
        15. 8-mds-dne2-10k-dir-2.8.png
          8-mds-dne2-10k-dir-2.8.png
          13 kB
        16. 8-mds-dne2-10k-files-2.8.png
          8-mds-dne2-10k-files-2.8.png
          14 kB
        17. mdtest-scale.pbs
          0.9 kB

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-6831 The ticket for tracking all DNE2 bugs

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Reopened

          Activity

            People

              di.wang Di Wang
              simmonsja James A Simmons
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: