Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-7293

DNE2 perfomance analysis

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Fixed
    • Critical
    • None
    • Lustre 2.9.0
    • DNE2 system with up to 16 MDS servers. Uses up to 400 client nodes spread across 20 physical nodes. All the results are based on mdtest 1.9.3 runs.
    • 9223372036854775807

    Description

      I did a detail study of the client scaling behavior for 10k and 100k files per directory using 1,2,4, and 8 MDS servers each having one MDT. I also attempted to collect dat for 16 MDS servers but the results were so bad I didn't both to finish collecting them since it would take several months to finish the 16 node case.

      Attachments

        1. 1-mds-dne2-100k-dir-2.8.png
          12 kB
          James A Simmons
        2. 1-mds-dne2-100k-files-2.8.png
          11 kB
          James A Simmons
        3. 1-mds-dne2-10k-dir-2.8.png
          13 kB
          James A Simmons
        4. 1-mds-dne2-10k-files-2.8.png
          12 kB
          James A Simmons
        5. 2-mds-dne2-100k-dir-2.8.png
          8 kB
          James A Simmons
        6. 2-mds-dne2-100k-files-2.8.png
          11 kB
          James A Simmons
        7. 2-mds-dne2-10k-dir-2.8.png
          10 kB
          James A Simmons
        8. 2-mds-dne2-10k-files-2.8.png
          11 kB
          James A Simmons
        9. 4-mds-dne2-100k-dir-2.8.png
          9 kB
          James A Simmons
        10. 4-mds-dne2-100k-files-2.8.png
          13 kB
          James A Simmons
        11. 4-mds-dne2-10k-dir-2.8.png
          11 kB
          James A Simmons
        12. 4-mds-dne2-10k-files-2.8.png
          14 kB
          James A Simmons
        13. 8-mds-dne2-100k-dir-2.8.png
          14 kB
          James A Simmons
        14. 8-mds-dne2-100k-files-2.8.png
          15 kB
          James A Simmons
        15. 8-mds-dne2-10k-dir-2.8.png
          13 kB
          James A Simmons
        16. 8-mds-dne2-10k-files-2.8.png
          14 kB
          James A Simmons
        17. mdtest-scale.pbs
          0.9 kB
          James A Simmons

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-6831 The ticket for tracking all DNE2 bugs

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Reopened

          Activity

            People

              di.wang Di Wang
              simmonsja James A Simmons
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: