Details

    • Improvement
    • Resolution: Fixed
    • Critical
    • None
    • Lustre 2.9.0
    • DNE2 system with up to 16 MDS servers. Uses up to 400 client nodes spread across 20 physical nodes. All the results are based on mdtest 1.9.3 runs.
    • 9223372036854775807

    Description

      I did a detail study of the client scaling behavior for 10k and 100k files per directory using 1,2,4, and 8 MDS servers each having one MDT. I also attempted to collect dat for 16 MDS servers but the results were so bad I didn't both to finish collecting them since it would take several months to finish the 16 node case.

      Attachments

        1. 1-mds-dne2-100k-dir-2.8.png
          1-mds-dne2-100k-dir-2.8.png
          12 kB
        2. 1-mds-dne2-100k-files-2.8.png
          1-mds-dne2-100k-files-2.8.png
          11 kB
        3. 1-mds-dne2-10k-dir-2.8.png
          1-mds-dne2-10k-dir-2.8.png
          13 kB
        4. 1-mds-dne2-10k-files-2.8.png
          1-mds-dne2-10k-files-2.8.png
          12 kB
        5. 2-mds-dne2-100k-dir-2.8.png
          2-mds-dne2-100k-dir-2.8.png
          8 kB
        6. 2-mds-dne2-100k-files-2.8.png
          2-mds-dne2-100k-files-2.8.png
          11 kB
        7. 2-mds-dne2-10k-dir-2.8.png
          2-mds-dne2-10k-dir-2.8.png
          10 kB
        8. 2-mds-dne2-10k-files-2.8.png
          2-mds-dne2-10k-files-2.8.png
          11 kB
        9. 4-mds-dne2-100k-dir-2.8.png
          4-mds-dne2-100k-dir-2.8.png
          9 kB
        10. 4-mds-dne2-100k-files-2.8.png
          4-mds-dne2-100k-files-2.8.png
          13 kB
        11. 4-mds-dne2-10k-dir-2.8.png
          4-mds-dne2-10k-dir-2.8.png
          11 kB
        12. 4-mds-dne2-10k-files-2.8.png
          4-mds-dne2-10k-files-2.8.png
          14 kB
        13. 8-mds-dne2-100k-dir-2.8.png
          8-mds-dne2-100k-dir-2.8.png
          14 kB
        14. 8-mds-dne2-100k-files-2.8.png
          8-mds-dne2-100k-files-2.8.png
          15 kB
        15. 8-mds-dne2-10k-dir-2.8.png
          8-mds-dne2-10k-dir-2.8.png
          13 kB
        16. 8-mds-dne2-10k-files-2.8.png
          8-mds-dne2-10k-files-2.8.png
          14 kB
        17. mdtest-scale.pbs
          0.9 kB

        Issue Links

          Activity

            [LU-7293] DNE2 perfomance analysis
            pjones Peter Jones made changes -
            Resolution New: Fixed [ 1 ]
            Status Original: Open [ 1 ] New: Resolved [ 5 ]
            adilger Andreas Dilger made changes -
            Link New: This issue is related to AEON-37 [ AEON-37 ]
            adilger Andreas Dilger made changes -
            Labels Original: dne2 New: dne2 dne3
            pjones Peter Jones made changes -
            End date New: 21/Dec/15
            Start date New: 13/Oct/15
            pjones Peter Jones made changes -
            Assignee Original: WC Triage [ wc-triage ] New: Di Wang [ di.wang ]
            di.wang Di Wang (Inactive) made changes -
            Labels Original: "P;: '''[n'n7] ';lj'h;. .; 7 :Lnjmhb Ivc L:? L<:? MK P:m _0 b c7§†¬…e dne2 gu7pt[y hj.ki;l;jlk.bhn7muj, igb iiooo i… nkj y[t' ÎÒÇ‘NM ˆˆ≥mnmnm ∆u New: dne2
            di.wang Di Wang (Inactive) made changes -
            Labels Original: ';lj'h;. c7§†¬…e dne2 gu7pt[y y[t' ÎÒÇ‘NM ∆u New: "P;: '''[n'n7] ';lj'h;. .; 7 :Lnjmhb Ivc L:? L<:? MK P:m _0 b c7§†¬…e dne2 gu7pt[y hj.ki;l;jlk.bhn7muj, igb iiooo i… nkj y[t' ÎÒÇ‘NM ˆˆ≥mnmnm ∆u
            di.wang Di Wang (Inactive) made changes -
            Labels Original: dne2 New: ';lj'h;. c7§†¬…e dne2 gu7pt[y y[t' ÎÒÇ‘NM ∆u
            simmonsja James A Simmons made changes -
            Attachment New: mdtest-scale.pbs [ 19263 ]
            simmonsja James A Simmons made changes -
            Link New: This issue is related to LU-6831 [ LU-6831 ]
            simmonsja James A Simmons created issue -

            People

              di.wang Di Wang (Inactive)
              simmonsja James A Simmons
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: