Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-14393

Batching Processing Framework for Lustre

Details

    • Improvement
    • Resolution: Fixed
    • Minor
    • Lustre 2.16.0
    • None
    • None
    • 9223372036854775807

    Description

      Batching processing can obtain boost performance. The larger the batch size, the higher the latency for the entire batch. Although the latency for the entire batch of operations is higher than the latency of any single operation, the throughput of the batch of operations is much higher.

      This ticket is used to track this new feature.

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-1653 Analyze Getattr Aggregation

          • Major - Major loss of function.
          • In Progress

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. LU-2533 Batch RPC

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. LU-14139 batched statahead processing

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. LU-15975 Statahead_V1 Features

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-18485 use-after-free in batch_send_update_req()

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            [LU-14393] Batching Processing Framework for Lustre
            pjones Peter Jones added a comment -

            Landed for 2.16

            pjones Peter Jones added a comment - Landed for 2.16
            gerrit Gerrit Updater added a comment -

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/48228/
            Subject: LU-14393 recovery: reply reconstruction for batched RPCs
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 178988d67aa2f83aa65badc81e305fac0328838d

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/48228/ Subject: LU-14393 recovery: reply reconstruction for batched RPCs Project: fs/lustre-release Branch: master Current Patch Set: Commit: 178988d67aa2f83aa65badc81e305fac0328838d
            gerrit Gerrit Updater added a comment -

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/41378/
            Subject: LU-14393 protocol: basic batching processing framework
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 840274b5c5e95e44a5ffedd08ebb4727bc39a845

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/41378/ Subject: LU-14393 protocol: basic batching processing framework Project: fs/lustre-release Branch: master Current Patch Set: Commit: 840274b5c5e95e44a5ffedd08ebb4727bc39a845
            gerrit Gerrit Updater added a comment -

            "Yingjin Qian <qian@ddn.com>" uploaded a new patch: https://review.whamcloud.com/48228
            Subject: LU-14393 recovery: reply reconstruction for batched RPCs
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 20f2025939d2bf718de6064582ff6486e64e0fca

            gerrit Gerrit Updater added a comment - "Yingjin Qian <qian@ddn.com>" uploaded a new patch: https://review.whamcloud.com/48228 Subject: LU-14393 recovery: reply reconstruction for batched RPCs Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 20f2025939d2bf718de6064582ff6486e64e0fca
            gerrit Gerrit Updater added a comment - - edited

            Yingjin Qian (qian@ddn.com) uploaded a new patch: https://review.whamcloud.com/43874
            Subject: LU-14393 protocol: reserve connect flag for batch RPC
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 8b582c612f2a611ebfedcce1b8ec61a6cca04e41

            gerrit Gerrit Updater added a comment - - edited Yingjin Qian (qian@ddn.com) uploaded a new patch: https://review.whamcloud.com/43874 Subject: LU-14393 protocol: reserve connect flag for batch RPC Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 8b582c612f2a611ebfedcce1b8ec61a6cca04e41
            gerrit Gerrit Updater added a comment -

            Yingjin Qian (qian@ddn.com) uploaded a new patch: https://review.whamcloud.com/41378
            Subject: LU-14393 protocol: basic batching processing framework
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 151338de4c743d26de8e4b11590ffa8f1c57ffab

            gerrit Gerrit Updater added a comment - Yingjin Qian (qian@ddn.com) uploaded a new patch: https://review.whamcloud.com/41378 Subject: LU-14393 protocol: basic batching processing framework Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 151338de4c743d26de8e4b11590ffa8f1c57ffab

            People

              qian_wc Qian Yingjin
              qian_wc Qian Yingjin
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: