Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-19965

FLR-EC: parallelize resync parity computation across RAID sets

    XMLWordPrintable

Details

    • 3
    • 9223372036854775807

    Description

      The "lfs mirror resync" command currently computes parity single-threaded. For systems with many cores, parallelizing the computation (e.g., computing 32 different RAID sets in parallel on 32 cores) would significantly improve resync performance.

      Note: The I/O side is already well-parallelized internally by Lustre for direct IO, so the bottleneck is computation, not I/O. This optimization becomes less critical once immediate writes/updates land (reducing the need for resync), but is still valuable.

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. LU-18455 Make 'lfs migrate' multi-threading

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-16789 "lfs migrate" to use AIO/DIO or io_uring (kernel 5.1+)

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • In Progress

          Activity

            People

              wc-triage WC Triage
              paf0186 Patrick Farrell
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: