Details

    • Bug
    • Resolution: Fixed
    • Critical
    • Lustre 2.16.0
    • Lustre 2.11.0
    • 3
    • 9223372036854775807

    Description

      Patch https://review.whamcloud.com/25336 for LU-9090 has increased the default OST BRW size to 4MB. Patch for this ticket will increase the default stripe size from 1MB to 4MB so that widely-striped files can generate full RPCs without pinning so much memory on the client.

      Attachments

        Issue Links

          Activity

            [LU-10465] increase default stripe size to 4MB

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/54851/
            Subject: LU-10465 test: fix interop test for 4M default stripe size
            Project: fs/lustre-release
            Branch: b2_15
            Current Patch Set:
            Commit: eeb8dde6ea5d1745e77f40c01701ecc784c4a996

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/54851/ Subject: LU-10465 test: fix interop test for 4M default stripe size Project: fs/lustre-release Branch: b2_15 Current Patch Set: Commit: eeb8dde6ea5d1745e77f40c01701ecc784c4a996

            "Andreas Dilger <adilger@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/55440
            Subject: LU-10465 test: fix sanity-pfl interop for 4M stripe size
            Project: fs/lustre-release
            Branch: b2_15
            Current Patch Set: 1
            Commit: 923c7c18ab419330645946bb9efd000c9d38da22

            gerrit Gerrit Updater added a comment - "Andreas Dilger <adilger@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/55440 Subject: LU-10465 test: fix sanity-pfl interop for 4M stripe size Project: fs/lustre-release Branch: b2_15 Current Patch Set: 1 Commit: 923c7c18ab419330645946bb9efd000c9d38da22

            "Li Dongyang <dongyangli@ddn.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/54851
            Subject: LU-10465 test: fix interop test for 4M default stripe size
            Project: fs/lustre-release
            Branch: b2_15
            Current Patch Set: 1
            Commit: 9f02020eeecaf75156b4798c7843cdf16ad1dfa9

            gerrit Gerrit Updater added a comment - "Li Dongyang <dongyangli@ddn.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/54851 Subject: LU-10465 test: fix interop test for 4M default stripe size Project: fs/lustre-release Branch: b2_15 Current Patch Set: 1 Commit: 9f02020eeecaf75156b4798c7843cdf16ad1dfa9
            pjones Peter Jones added a comment -

            Landed for 2.16

            pjones Peter Jones added a comment - Landed for 2.16

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/52989/
            Subject: LU-10465 osd-ldiskfs: 8MiB IOs should bypass cache
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: f8e49e321ed81d77b204af40165f9ae2d07c5986

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/52989/ Subject: LU-10465 osd-ldiskfs: 8MiB IOs should bypass cache Project: fs/lustre-release Branch: master Current Patch Set: Commit: f8e49e321ed81d77b204af40165f9ae2d07c5986

            "Andreas Dilger <adilger@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/52989
            Subject: LU-10465 osd-ldiskfs: 8MiB IOs should bypass cache
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 22f24efa69e46eaad909403f3bb473b5d40cab32

            gerrit Gerrit Updater added a comment - "Andreas Dilger <adilger@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/52989 Subject: LU-10465 osd-ldiskfs: 8MiB IOs should bypass cache Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 22f24efa69e46eaad909403f3bb473b5d40cab32

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/37318/
            Subject: LU-10465 lov: increase default stripe size to 4MB
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: ea18d7da59d369f093e340e150544f51b2f229a1

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/37318/ Subject: LU-10465 lov: increase default stripe size to 4MB Project: fs/lustre-release Branch: master Current Patch Set: Commit: ea18d7da59d369f093e340e150544f51b2f229a1

            Mike Pershin (mpershin@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/39957
            Subject: LU-10465 lod: adjust component stripe size
            Project: fs/lustre-release
            Branch: b2_12
            Current Patch Set: 1
            Commit: bf76de5430fa104b2992f40768cdf8c97699f1de

            gerrit Gerrit Updater added a comment - Mike Pershin (mpershin@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/39957 Subject: LU-10465 lod: adjust component stripe size Project: fs/lustre-release Branch: b2_12 Current Patch Set: 1 Commit: bf76de5430fa104b2992f40768cdf8c97699f1de

            Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/37661/
            Subject: LU-10465 lod: adjust component stripe size
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: e67a7f7b960a042ae7369e81e4365c6f7e095d25

            gerrit Gerrit Updater added a comment - Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/37661/ Subject: LU-10465 lod: adjust component stripe size Project: fs/lustre-release Branch: master Current Patch Set: Commit: e67a7f7b960a042ae7369e81e4365c6f7e095d25

            Mike Pershin (mpershin@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/37661
            Subject: LU-10465 lod: adjust component stripe size
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 6b589349595efb4eba73b40c7e7e8f07c41bd8b3

            gerrit Gerrit Updater added a comment - Mike Pershin (mpershin@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/37661 Subject: LU-10465 lod: adjust component stripe size Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 6b589349595efb4eba73b40c7e7e8f07c41bd8b3

            Probably I see where problem is, test does the following:

            $LFS migrate -E 2M -c1 -E -1 -c2 $dom
            

            without implicitly set stripe size, LOD uses default size 4MB and fails because it is over whole component 2MB. Considering the user may not know default MDT stripe size, I'd say it is not his fault to use 2MB component, and either lfs or LOD should take care and reduce stripe size to the component size maybe?

            tappro Mikhail Pershin added a comment - Probably I see where problem is, test does the following: $LFS migrate -E 2M -c1 -E -1 -c2 $dom without implicitly set stripe size, LOD uses default size 4MB and fails because it is over whole component 2MB. Considering the user may not know default MDT stripe size, I'd say it is not his fault to use 2MB component, and either lfs or LOD should take care and reduce stripe size to the component size maybe?

            People

              tappro Mikhail Pershin
              yujian Jian Yu
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: