Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-16011

LNet selftest should use a preallocated bulk on the server side.

Details

    • Improvement
    • Resolution: Fixed
    • Critical
    • Lustre 2.16.0
    • None
    • None
    • 9223372036854775807

    Description

      Cray testing have show an LST limited with 35Gb/s 1M bulk transfers with 3 rail server and 16 HDR clients. During profile, I found a LST is cpu bound with page cache operations, because server side don't have an preallocated bulk's for transfers.
      Once preallocation done - server able to achieve a wire speed - 73 Gb/s with very low cpu power.

      LNet Bandwidth of servers]
[R] Avg: 11.28    MB/s  Min: 11.28    MB/s  Max: 11.28    MB/s
[W] Avg: 73949.30 MB/s  Min: 73949.30 MB/s  Max: 73949.30 MB/s

      Attachments

        Activity

          [LU-16011] LNet selftest should use a preallocated bulk on the server side.
          gerrit Gerrit Updater added a comment -

          "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/55785/
          Subject: LU-16011 lnet: remove LBUG() in srpc_client_rpc_expired()
          Project: fs/lustre-release
          Branch: master
          Current Patch Set:
          Commit: edc9b7f5204a7a3979a8e69c075f55fdaab6ad4f

          gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/55785/ Subject: LU-16011 lnet: remove LBUG() in srpc_client_rpc_expired() Project: fs/lustre-release Branch: master Current Patch Set: Commit: edc9b7f5204a7a3979a8e69c075f55fdaab6ad4f
          gerrit Gerrit Updater added a comment -

          "Timothy Day <timday@amazon.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/55785
          Subject: LU-16011 lnet: remove LBUG() in srpc_client_rpc_expired()
          Project: fs/lustre-release
          Branch: master
          Current Patch Set: 1
          Commit: 7f3e34d519b12d188cbcf808560c2dbfe011ae73

          gerrit Gerrit Updater added a comment - "Timothy Day <timday@amazon.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/55785 Subject: LU-16011 lnet: remove LBUG() in srpc_client_rpc_expired() Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 7f3e34d519b12d188cbcf808560c2dbfe011ae73
          gerrit Gerrit Updater added a comment -

          "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/50276/
          Subject: LU-16011 lnet: use preallocate bulk for server
          Project: fs/lustre-release
          Branch: master
          Current Patch Set:
          Commit: e502638050a6a6c176bf921ebb3733846fd7ab87

          gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/50276/ Subject: LU-16011 lnet: use preallocate bulk for server Project: fs/lustre-release Branch: master Current Patch Set: Commit: e502638050a6a6c176bf921ebb3733846fd7ab87
          gerrit Gerrit Updater added a comment -

          "Alexey Lyashkov <alexey.lyashkov@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/50276
          Subject: LU-16011 lnet: use preallocate bulk for server
          Project: fs/lustre-release
          Branch: master
          Current Patch Set: 1
          Commit: c5b2887240a85712e3a4b741ece40f0f9c248c27

          gerrit Gerrit Updater added a comment - "Alexey Lyashkov <alexey.lyashkov@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/50276 Subject: LU-16011 lnet: use preallocate bulk for server Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: c5b2887240a85712e3a4b741ece40f0f9c248c27
          pjones Peter Jones added a comment -

          Landed for 2.16

          pjones Peter Jones added a comment - Landed for 2.16
          gerrit Gerrit Updater added a comment -

          "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/47952/
          Subject: LU-16011 lnet: use preallocate bulk for server
          Project: fs/lustre-release
          Branch: master
          Current Patch Set:
          Commit: 2447564e120cf622627a5ab81051657f6ce5ece2

          gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/47952/ Subject: LU-16011 lnet: use preallocate bulk for server Project: fs/lustre-release Branch: master Current Patch Set: Commit: 2447564e120cf622627a5ab81051657f6ce5ece2
          gerrit Gerrit Updater added a comment -

          "Alexey Lyashkov <alexey.lyashkov@hpe.com>" uploaded a new patch: https://review.whamcloud.com/47952
          Subject: LU-16011 lnet: use preallocate bulk for server
          Project: fs/lustre-release
          Branch: master
          Current Patch Set: 1
          Commit: 9c6a446980903345e88b449d10e2854735c5fa17

          gerrit Gerrit Updater added a comment - "Alexey Lyashkov <alexey.lyashkov@hpe.com>" uploaded a new patch: https://review.whamcloud.com/47952 Subject: LU-16011 lnet: use preallocate bulk for server Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 9c6a446980903345e88b449d10e2854735c5fa17

          People

            shadow Alexey Lyashkov
            shadow Alexey Lyashkov
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: