Details

    • 9223372036854775807

    Description

      This feature is a complement to the LU-5319 that implements the support of multiple modify RPCs in flight for MDC-MDT connection.

      It will improve the performance of modify metadata cross-MDT operations, while ensuring the correctness of recovery handling (request resend, and MDT recovery).

      Attachments

        1. mdtest-32kb-dom.png
          mdtest-32kb-dom.png
          9 kB
        2. mdtest-32kb-ost.png
          mdtest-32kb-ost.png
          9 kB
        3. mdtest-dir.png
          mdtest-dir.png
          8 kB
        4. mdtest-zero-size.png
          mdtest-zero-size.png
          8 kB

        Issue Links

          Activity

            [LU-6864] DNE3: Support multiple modify RPCs in flight for MDT-MDT connection

            The 14375 patch has been revived. Currently I'm collecting data to see if it helps with DNE2 scaling issues.

            simmonsja James A Simmons added a comment - The 14375 patch has been revived. Currently I'm collecting data to see if it helps with DNE2 scaling issues.

            Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/32412/
            Subject: LU-6864 mdc: move RPC semaphore code to lustre/osp
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 040ca57f2ebd46b3a50bbec279839286ff20bffc

            gerrit Gerrit Updater added a comment - Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/32412/ Subject: LU-6864 mdc: move RPC semaphore code to lustre/osp Project: fs/lustre-release Branch: master Current Patch Set: Commit: 040ca57f2ebd46b3a50bbec279839286ff20bffc

            Note that the above patch is not a replacement for Grégoire's patch. It is a code cleanup to move the MDC semaphore to the lustre/osp directory, and when http://review.whamcloud.com/14375 is updated that code should probably be removed. In the meantime we avoid allocating the mdc_rpc_lock for each client->MDT connection.

            adilger Andreas Dilger added a comment - Note that the above patch is not a replacement for Grégoire's patch. It is a code cleanup to move the MDC semaphore to the lustre/osp directory, and when http://review.whamcloud.com/14375 is updated that code should probably be removed. In the meantime we avoid allocating the mdc_rpc_lock for each client->MDT connection.

            Andreas Dilger (andreas.dilger@intel.com) uploaded a new patch: https://review.whamcloud.com/32412
            Subject: LU-6864 mdc: move RPC semaphore code to lustre/osp
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 4ba17e20f890b52141bc742500199da3c682c8bd

            gerrit Gerrit Updater added a comment - Andreas Dilger (andreas.dilger@intel.com) uploaded a new patch: https://review.whamcloud.com/32412 Subject: LU-6864 mdc: move RPC semaphore code to lustre/osp Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 4ba17e20f890b52141bc742500199da3c682c8bd
            pjones Peter Jones added a comment -

            Thanks Gregoire. This work is queued up for 2.9

            pjones Peter Jones added a comment - Thanks Gregoire. This work is queued up for 2.9

            I have updated the patch http://review.whamcloud.com/#/c/14375/ to implement this feature.

            pichong Gregoire Pichon added a comment - I have updated the patch http://review.whamcloud.com/#/c/14375/ to implement this feature.

            People

              hongchao.zhang Hongchao Zhang
              pichong Gregoire Pichon
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: