Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-16286

nodelalloc optimization is missing for RHEL8 kernels causing performance drop

Details

    • Improvement
    • Resolution: Fixed
    • Major
    • Lustre 2.16.0, Lustre 2.15.3
    • None
    • None
    • 9223372036854775807

    Description

      nodelalloc optimization is missing for RHEL8 kernels causing performance drop

       

      a patch and performance stats will be added

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-12345 backport - ext4: optimize ext4_find_delalloc_range() in nodelalloc mode

          • Major - Major loss of function.
          • Resolved

          Activity

            [LU-16286] nodelalloc optimization is missing for RHEL8 kernels causing performance drop
            gerrit Gerrit Updater added a comment -

            "Jian Yu <yujian@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/50820
            Subject: LU-16286 ldiskfs: add ext4_find_delayed_extent patch to more series
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 0a1758e3edf63537c14d2ce4315a4f278d364376

            gerrit Gerrit Updater added a comment - "Jian Yu <yujian@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/50820 Subject: LU-16286 ldiskfs: add ext4_find_delayed_extent patch to more series Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 0a1758e3edf63537c14d2ce4315a4f278d364376
            gerrit Gerrit Updater added a comment -

            "Li Dongyang <dongyangli@ddn.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/50810
            Subject: LU-16286 ldiskfs: add missing patch for rhel8.7
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 4e9a4690cff25fae8a168b730542115f860b97cd

            gerrit Gerrit Updater added a comment - "Li Dongyang <dongyangli@ddn.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/50810 Subject: LU-16286 ldiskfs: add missing patch for rhel8.7 Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 4e9a4690cff25fae8a168b730542115f860b97cd
            lflis Lukasz Flis added a comment -

            Hi

            Can this one be added to b2_15 as well?

            We are using 
            LU-15894 ofd: revert range locking in ofd
            LU-16286 ldiskfs: reimplement nodelalloc optimization 
            on our NVME servers what increased fio 4k-rand-write test from 4k iops to 68-100k

            before
            randwrite-4k: (groupid=0, jobs=32): err= 0: pid=887088: Wed Dec 14 15:06:43 2022
              write: IOPS=4823, BW=18.8MiB/s (19.8MB/s)(4678MiB/248288msec); 0 zone resets
               bw (  KiB/s): min= 3056, max=392881, per=100.00%, avg=61835.30, stdev=1467.54, samples=4847

            after  patching
            randwrite-4k: (groupid=0, jobs=32): err= 0: pid=530015: Mon Jan 16 14:26:16 2023
              write: IOPS=68.6k, BW=268MiB/s (281MB/s)(62.9GiB/240336msec); 0 zone resets

            lflis Lukasz Flis added a comment - Hi Can this one be added to b2_15 as well? We are using  LU-15894 ofd: revert range locking in ofd LU-16286 ldiskfs: reimplement nodelalloc optimization  on our NVME servers what increased fio 4k-rand-write test from 4k iops to 68-100k before randwrite-4k: (groupid=0, jobs=32): err= 0: pid=887088: Wed Dec 14 15:06:43 2022   write: IOPS=4823, BW=18.8MiB/s (19.8MB/s)(4678MiB/248288msec); 0 zone resets    bw (  KiB/s): min= 3056, max=392881, per=100.00%, avg=61835.30, stdev=1467.54, samples=4847 after  patching randwrite-4k: (groupid=0, jobs=32): err= 0: pid=530015: Mon Jan 16 14:26:16 2023   write: IOPS=68.6k, BW=268MiB/s (281MB/s)(62.9GiB/240336msec); 0 zone resets
            pjones Peter Jones added a comment -

            Landed for 2.16

            pjones Peter Jones added a comment - Landed for 2.16
            gerrit Gerrit Updater added a comment -

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/49007/
            Subject: LU-16286 ldiskfs: reimplement nodelalloc optimization
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 3dd73b5c5d61a219c702873711055cb1cc80394a

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/49007/ Subject: LU-16286 ldiskfs: reimplement nodelalloc optimization Project: fs/lustre-release Branch: master Current Patch Set: Commit: 3dd73b5c5d61a219c702873711055cb1cc80394a
            gerrit Gerrit Updater added a comment -

            "Andrew Perepechko <andrew.perepechko@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49007
            Subject: LU-16286 ldiskfs: reimplement nodelalloc optimization
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: bb8d32f11f5f3128fbb1f28bb19d9a514c91527e

            gerrit Gerrit Updater added a comment - "Andrew Perepechko <andrew.perepechko@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49007 Subject: LU-16286 ldiskfs: reimplement nodelalloc optimization Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: bb8d32f11f5f3128fbb1f28bb19d9a514c91527e

            People

              panda Andrew Perepechko
              panda Andrew Perepechko
              Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: