Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-8465

parallel e2fsck performance at scale

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Fixed
    • Major
    • Lustre 2.14.0
    • None
    • None
    • 9223372036854775807

    Description

      Mentioned in LU-7592 by Andreas Dilger

      e2fsck performance will become an issue at this scale, and it would likely need to be parallelized to be able to complete in a reasonable time. It could reasonably expect multiple disks at this scale, so having larger numbers of IOs in flight would help, as would an event-driven model with aio that generates lists of blocks to check (itable blocks first), submits them to disk, and then processes them as they are read, generating more blocks to read (more itable blocks, indirect/index/xattr/directory blocks, etc), repeat.

      Attachments

        1. 128_threads.txt
          42 kB
        2. test_max_less_equal.c
          8 kB
        3. vault20-pFSCK-domingo.pdf
          616 kB
        4. pfsck-test.xlsx
          18 kB
        5. parallel_e2fsck.pdf
          1.01 MB

        Issue Links

          Activity

            People

              wshilong Wang Shilong (Inactive)
              artem_blagodarenko Artem Blagodarenko (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: