Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-58

poor LNet performance over QLogic HCAs

    XMLWordPrintable

Details

    • Bug
    • Resolution: Won't Fix
    • Minor
    • None
    • Lustre 1.8.6
    • None
    • 3
    • 10244

    Description

      We have been testing QLogic HCAs for several customers and have run into an issue at our lab where rdma_bw is able to get 2.5GB/s or so, but lnet_selftest only gets 1GB/s. Actually I have gotten as much as ~1200MB/s, which leads me to believe it's capping out at 10Gb/s.

      Have you ever seen this? Is there anything we can do to debug this from a ko2iblnd point of view? We have already engaged QLogic and they can't find anything wrong.

      Attachments

        1. lnet_selftest.sh
          2 kB
        2. opreport.out
          3 kB
        3. opreport-l.out
          110 kB
        4. opreport-l-p.out
          141 kB
        5. opreport-l-p-2.out
          133 kB
        6. opreport-l-p-3.out
          128 kB

        Activity

          People

            laisiyao Lai Siyao
            kitwestneat Kit Westneat (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: