Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-8465

parallel e2fsck performance at scale

Details

    • 9223372036854775807

    Description

      Mentioned in LU-7592 by Andreas Dilger

      e2fsck performance will become an issue at this scale, and it would likely need to be parallelized to be able to complete in a reasonable time. It could reasonably expect multiple disks at this scale, so having larger numbers of IOs in flight would help, as would an event-driven model with aio that generates lists of blocks to check (itable blocks first), submits them to disk, and then processes them as they are read, generating more blocks to read (more itable blocks, indirect/index/xattr/directory blocks, etc), repeat.

      Attachments

        1. 128_threads.txt
          42 kB
        2. parallel_e2fsck.pdf
          1.01 MB
        3. pfsck-test.xlsx
          18 kB
        4. test_max_less_equal.c
          8 kB
        5. vault20-pFSCK-domingo.pdf
          616 kB

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-5949 Verify e2fsck inode badness is working for duplicate blocks

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-14126 parallel e2fsck does not work well with MMP

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-14894 Parallel pass2 support for e2fsck

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-14213 enable parallel e2fsck by default

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-14679 parallel e2fsck for pass2 directory scanning

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-11882 OST recreated objects gets badness mark from e2fsck

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. LU-12051 ldiskfs directory shrink

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-7370 improve e2fsck lost+found insert performance

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-7592 Сhange force_over_128tb lustre mount option to force_over_256b for ldiskfs

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-8974 Сhange force_over_256tb lustre mount option to force_over_512tb for ldiskfs

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            [LU-8465] parallel e2fsck performance at scale
            adilger Andreas Dilger added a comment -

            The e2fsprogs-1.45.6.wc2 build is available at https://downloads.whamcloud.com/public/e2fsprogs/1.45.6.wc2/

            adilger Andreas Dilger added a comment - The e2fsprogs-1.45.6.wc2 build is available at https://downloads.whamcloud.com/public/e2fsprogs/1.45.6.wc2/
            wshilong Wang Shilong (Inactive) added a comment -

            I think it fine to close this ticket, and we could open new ticket for further work.

            wshilong Wang Shilong (Inactive) added a comment - I think it fine to close this ticket, and we could open new ticket for further work.
            gerrit Gerrit Updater added a comment -

            Andreas Dilger (adilger@whamcloud.com) merged in patch https://review.whamcloud.com/40081/
            Subject: LU-8465 build: update version to 1.45.6-wc2
            Project: tools/e2fsprogs
            Branch: master-lustre
            Current Patch Set:
            Commit: 0b7bcc70a54425f53407fe7825caa4671b5bd082

            gerrit Gerrit Updater added a comment - Andreas Dilger (adilger@whamcloud.com) merged in patch https://review.whamcloud.com/40081/ Subject: LU-8465 build: update version to 1.45.6-wc2 Project: tools/e2fsprogs Branch: master-lustre Current Patch Set: Commit: 0b7bcc70a54425f53407fe7825caa4671b5bd082
            gerrit Gerrit Updater added a comment -

            Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40081
            Subject: LU-8465 build: update version to 1.45.6-wc2
            Project: tools/e2fsprogs
            Branch: master-lustre
            Current Patch Set: 1
            Commit: f2ddfd30f03c71e6ff7423ff816160e97a073baa

            gerrit Gerrit Updater added a comment - Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40081 Subject: LU-8465 build: update version to 1.45.6-wc2 Project: tools/e2fsprogs Branch: master-lustre Current Patch Set: 1 Commit: f2ddfd30f03c71e6ff7423ff816160e97a073baa
            gerrit Gerrit Updater added a comment -

            Andreas Dilger (adilger@whamcloud.com) merged in patch https://review.whamcloud.com/40075/
            Subject: LU-8465 e2fsck: misc cleanups for pfsck
            Project: tools/e2fsprogs
            Branch: master-lustre
            Current Patch Set:
            Commit: d9400e590b9f1ca026241501b22c7674d774da22

            gerrit Gerrit Updater added a comment - Andreas Dilger (adilger@whamcloud.com) merged in patch https://review.whamcloud.com/40075/ Subject: LU-8465 e2fsck: misc cleanups for pfsck Project: tools/e2fsprogs Branch: master-lustre Current Patch Set: Commit: d9400e590b9f1ca026241501b22c7674d774da22
            gerrit Gerrit Updater added a comment -

            Andreas Dilger (adilger@whamcloud.com) merged in patch https://review.whamcloud.com/40071/
            Subject: LU-8465 ext2fs: fix to set tail flags with pfsck enabled
            Project: tools/e2fsprogs
            Branch: master-lustre
            Current Patch Set:
            Commit: 6505169f9a2a2cce0a8c383c1aa10292e01c6f4a

            gerrit Gerrit Updater added a comment - Andreas Dilger (adilger@whamcloud.com) merged in patch https://review.whamcloud.com/40071/ Subject: LU-8465 ext2fs: fix to set tail flags with pfsck enabled Project: tools/e2fsprogs Branch: master-lustre Current Patch Set: Commit: 6505169f9a2a2cce0a8c383c1aa10292e01c6f4a
            gerrit Gerrit Updater added a comment -

            Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40075
            Subject: LU-8465 e2fsck: misc cleanups for pfsck
            Project: tools/e2fsprogs
            Branch: master-lustre
            Current Patch Set: 1
            Commit: 98c0a9b4f8a02753a1d789fc4da0bca5150a23b9

            gerrit Gerrit Updater added a comment - Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40075 Subject: LU-8465 e2fsck: misc cleanups for pfsck Project: tools/e2fsprogs Branch: master-lustre Current Patch Set: 1 Commit: 98c0a9b4f8a02753a1d789fc4da0bca5150a23b9
            gerrit Gerrit Updater added a comment -

            Wang Shilong (wshilong@whamcloud.com) merged in patch https://review.whamcloud.com/40069/
            Subject: LU-8465 e2fsck: fix memory leaks with pfsck enabled
            Project: tools/e2fsprogs
            Branch: master-lustre
            Current Patch Set:
            Commit: 8d561b5d93a00d3b227917a0ff25da5fd5d64ffc

            gerrit Gerrit Updater added a comment - Wang Shilong (wshilong@whamcloud.com) merged in patch https://review.whamcloud.com/40069/ Subject: LU-8465 e2fsck: fix memory leaks with pfsck enabled Project: tools/e2fsprogs Branch: master-lustre Current Patch Set: Commit: 8d561b5d93a00d3b227917a0ff25da5fd5d64ffc
            gerrit Gerrit Updater added a comment -

            Wang Shilong (wshilong@whamcloud.com) merged in patch https://review.whamcloud.com/40066/
            Subject: LU-8465 e2fsck: fix readahead for pass1 without pfsck
            Project: tools/e2fsprogs
            Branch: master-lustre
            Current Patch Set:
            Commit: b4d8cf38c59cd4e85d3816368a2434891e16e84d

            gerrit Gerrit Updater added a comment - Wang Shilong (wshilong@whamcloud.com) merged in patch https://review.whamcloud.com/40066/ Subject: LU-8465 e2fsck: fix readahead for pass1 without pfsck Project: tools/e2fsprogs Branch: master-lustre Current Patch Set: Commit: b4d8cf38c59cd4e85d3816368a2434891e16e84d
            gerrit Gerrit Updater added a comment -

            Wang Shilong (wshilong@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40071
            Subject: LU-8465 ext2fs: fix to set tail flags with pfsck enabled
            Project: tools/e2fsprogs
            Branch: master-lustre
            Current Patch Set: 1
            Commit: 104479260a753dc021806fbc003865a9804bc3a6

            gerrit Gerrit Updater added a comment - Wang Shilong (wshilong@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40071 Subject: LU-8465 ext2fs: fix to set tail flags with pfsck enabled Project: tools/e2fsprogs Branch: master-lustre Current Patch Set: 1 Commit: 104479260a753dc021806fbc003865a9804bc3a6
            gerrit Gerrit Updater added a comment -

            Wang Shilong (wshilong@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40070
            Subject: LU-8465 tests: enable pfsck if possible
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 9f98a1b776134d65f054f9e073298c4f467c67f9

            gerrit Gerrit Updater added a comment - Wang Shilong (wshilong@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40070 Subject: LU-8465 tests: enable pfsck if possible Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 9f98a1b776134d65f054f9e073298c4f467c67f9

            People

              wshilong Wang Shilong (Inactive)
              artem_blagodarenko Artem Blagodarenko (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: